make -C tools/testing/selftests TARGETS=net/forwarding TEST_PROGS=tc_actioons.sh TEST_GEN_PROGS="" run_tests make: Entering directory '/home/virtme/testing-4/tools/testing/selftests' make[1]: Entering directory '/home/virtme/testing-4/tools/testing/selftests/net/forwarding' make[1]: Nothing to be done for 'all'. make[1]: Leaving directory '/home/virtme/testing-4/tools/testing/selftests/net/forwarding' make[1]: Entering directory '/home/virtme/testing-4/tools/testing/selftests/net/forwarding' TAP version 13 1..1 # timeout set to 10800 # selftests: net/forwarding: tc_actions.sh # TEST: gact drop and ok (skip_hw) [ OK ] # TEST: mirred egress flower redirect (skip_hw) [ OK ] # TEST: mirred egress flower mirror (skip_hw) [ OK ] # TEST: mirred egress matchall mirror (skip_hw) [ OK ] # TEST: mirred_egress_to_ingress (skip_hw) [ OK ] # [ 2354.048553][ C2] [ 2354.048772][ C2] ============================================ [ 2354.049216][ C2] WARNING: possible recursive locking detected [ 2354.049663][ C2] 6.8.0-rc2-virtme #1 Not tainted [ 2354.050019][ C2] -------------------------------------------- [ 2354.050460][ C2] swapper/2/0 is trying to acquire lock: [ 2354.050864][ C2] ffff88800a3a1b70 (slock-AF_INET/1){+.-.}-{2:2}, at: tcp_v4_rcv+0x221e/0x2ac0 [ 2354.051519][ C2] [ 2354.051519][ C2] but task is already holding lock: [ 2354.052033][ C2] ffff88800a3a0e30 (slock-AF_INET/1){+.-.}-{2:2}, at: tcp_v4_rcv+0x221e/0x2ac0 [ 2354.052670][ C2] [ 2354.052670][ C2] other info that might help us debug this: [ 2354.053261][ C2] Possible unsafe locking scenario: [ 2354.053261][ C2] [ 2354.053838][ C2] CPU0 [ 2354.054081][ C2] ---- [ 2354.054312][ C2] lock(slock-AF_INET/1); [ 2354.054632][ C2] lock(slock-AF_INET/1); [ 2354.054951][ C2] [ 2354.054951][ C2] *** DEADLOCK *** [ 2354.054951][ C2] [ 2354.055528][ C2] May be due to missing lock nesting notation [ 2354.055528][ C2] [ 2354.056150][ C2] 8 locks held by swapper/2/0: [ 2354.056526][ C2] #0: ffffffff98f447e0 (rcu_read_lock){....}-{1:2}, at: process_backlog+0x1ed/0x5e0 [ 2354.057251][ C2] #1: ffffffff98f447e0 (rcu_read_lock){....}-{1:2}, at: ip_local_deliver_finish+0x1f5/0x480 [ 2354.058033][ C2] #2: ffff88800a3a0e30 (slock-AF_INET/1){+.-.}-{2:2}, at: tcp_v4_rcv+0x221e/0x2ac0 [ 2354.058775][ C2] #3: ffffffff98f447e0 (rcu_read_lock){....}-{1:2}, at: __ip_queue_xmit+0x65/0x1910 [ 2354.059507][ C2] #4: ffffffff98f447e0 (rcu_read_lock){....}-{1:2}, at: ip_finish_output2+0x262/0x18e0 [ 2354.060237][ C2] #5: ffffffff98f44780 (rcu_read_lock_bh){....}-{1:2}, at: __dev_queue_xmit+0x1da/0x17e0 [ 2354.060982][ C2] #6: ffffffff98f447e0 (rcu_read_lock){....}-{1:2}, at: netif_receive_skb_internal+0x84/0x300 [ 2354.061774][ C2] #7: ffffffff98f447e0 (rcu_read_lock){....}-{1:2}, at: ip_local_deliver_finish+0x1f5/0x480 [ 2354.062588][ C2] [ 2354.062588][ C2] stack backtrace: [ 2354.063053][ C2] CPU: 2 PID: 0 Comm: swapper/2 Not tainted 6.8.0-rc2-virtme #1 [ 2354.063644][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2354.064547][ C2] Call Trace: [ 2354.064805][ C2] [ 2354.065026][ C2] dump_stack_lvl+0x64/0xb0 [ 2354.065384][ C2] validate_chain+0x525/0xa00 [ 2354.065759][ C2] ? __pfx_validate_chain+0x10/0x10 [ 2354.066146][ C2] ? hlock_class+0x4e/0x130 [ 2354.066493][ C2] ? mark_lock+0x38/0x3e0 [ 2354.066831][ C2] __lock_acquire+0xb67/0x1610 [ 2354.067203][ C2] ? lock_downgrade+0xa0/0x110 [ 2354.067576][ C2] ? mark_lock+0x38/0x3e0 [ 2354.067924][ C2] lock_acquire.part.0+0xe5/0x330 [ 2354.068323][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2354.068703][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 2354.069128][ C2] ? __pfx_sk_filter_trim_cap+0x10/0x10 [ 2354.069545][ C2] ? lock_acquire+0x1c1/0x220 [ 2354.069917][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2354.070285][ C2] _raw_spin_lock_nested+0x33/0x80 [ 2354.070671][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2354.071024][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2354.071390][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2354.071755][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2354.072144][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 2354.072574][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2354.072977][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2354.073407][ C2] ip_local_deliver+0x19d/0x480 [ 2354.073777][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2354.074179][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2354.074585][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2354.075064][ C2] ip_rcv+0x564/0x740 [ 2354.075361][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2354.075709][ C2] ? lock_acquire.part.0+0xe5/0x330 [ 2354.076116][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2354.076564][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2354.076918][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2354.077356][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2354.077829][ C2] ? mark_held_locks+0xa5/0xf0 [ 2354.078206][ C2] ? lock_acquire+0x1c1/0x220 [ 2354.078580][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2354.079057][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2354.079483][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2354.079922][ C2] ? __copy_skb_header+0xaf/0x490 [ 2354.080298][ C2] ? __skb_clone+0x57a/0x760 [ 2354.080633][ C2] netif_receive_skb+0x55/0x280 [ 2354.080980][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2354.081431][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2354.081903][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2354.082361][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2354.082769][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2354.083188][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2354.083632][ C2] ? __pfx_check_irq_usage+0x10/0x10 [ 2354.084006][ C2] ? __bfs+0x247/0x650 [ 2354.084301][ C2] ? __pfx_hlock_conflict+0x10/0x10 [ 2354.084688][ C2] ? check_path.constprop.0+0x24/0x50 [ 2354.085075][ C2] ? check_noncircular+0x14e/0x3e0 [ 2354.085467][ C2] ? hlock_class+0x4e/0x130 [ 2354.085819][ C2] ? __pfx_check_noncircular+0x10/0x10 [ 2354.086247][ C2] ? __pfx_validate_chain+0x10/0x10 [ 2354.086654][ C2] ? hlock_class+0x4e/0x130 [ 2354.087023][ C2] ? hlock_class+0x4e/0x130 [ 2354.087373][ C2] ? check_prev_add+0x773/0xce0 [ 2354.087746][ C2] __tcf_classify+0x329/0x7d0 [ 2354.088121][ C2] tcf_classify+0x283/0x930 [ 2354.088472][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2354.088862][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2354.089247][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2354.089642][ C2] tc_run+0x2e4/0x5d0 [ 2354.089948][ C2] ? __pfx_tc_run+0x10/0x10 [ 2354.090292][ C2] ? lock_acquire+0x1c1/0x220 [ 2354.090655][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2354.091050][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2354.091427][ C2] ? mark_held_locks+0xa5/0xf0 [ 2354.091780][ C2] ? lockdep_hardirqs_on_prepare.part.0+0x151/0x370 [ 2354.092282][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2354.092695][ C2] ? neigh_hh_output+0x348/0x590 [ 2354.093075][ C2] ip_finish_output2+0x786/0x18e0 [ 2354.093460][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2354.093874][ C2] ? __ip_finish_output+0x3dd/0x770 [ 2354.094267][ C2] ip_output+0x16b/0x4f0 [ 2354.094594][ C2] ? mark_held_locks+0xa5/0xf0 [ 2354.094970][ C2] ? __pfx_ip_output+0x10/0x10 [ 2354.095348][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 2354.095776][ C2] ? lockdep_hardirqs_on_prepare.part.0+0x151/0x370 [ 2354.096270][ C2] ? ip_local_out+0x114/0x3b0 [ 2354.096634][ C2] __ip_queue_xmit+0x672/0x1910 [ 2354.097017][ C2] ? __skb_clone+0x57a/0x760 [ 2354.097365][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2354.097768][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2354.098189][ C2] ? tcp_small_queue_check.isra.0+0xe9/0x380 [ 2354.098661][ C2] tcp_write_xmit+0x94f/0x1cb0 [ 2354.099034][ C2] ? ipv4_mtu+0x37/0x360 [ 2354.099360][ C2] ? __pfx_tcp_write_xmit+0x10/0x10 [ 2354.099748][ C2] ? __pfx_tcp_current_mss+0x10/0x10 [ 2354.100161][ C2] __tcp_push_pending_frames+0x96/0x320 [ 2354.100601][ C2] tcp_rcv_state_process+0x786/0x1fe0 [ 2354.101015][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2354.101391][ C2] ? hlock_class+0x4e/0x130 [ 2354.101727][ C2] ? __lock_acquired+0x18a/0x6b0 [ 2354.102103][ C2] ? __pfx_tcp_rcv_state_process+0x10/0x10 [ 2354.102545][ C2] ? __pfx___lock_acquired+0x10/0x10 [ 2354.102948][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2354.103387][ C2] tcp_v4_do_rcv+0x154/0x860 [ 2354.103749][ C2] tcp_v4_rcv+0x2449/0x2ac0 [ 2354.104105][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2354.104481][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2354.104868][ C2] ? __pfx_lock_acquire.part.0+0x10/0x10 [ 2354.105308][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2354.105725][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2354.106128][ C2] ip_local_deliver+0x19d/0x480 [ 2354.106485][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2354.106876][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2354.107257][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2354.107711][ C2] ip_rcv+0x564/0x740 [ 2354.108015][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2354.108343][ C2] ? lock_acquire.part.0+0xe5/0x330 [ 2354.108713][ C2] ? process_backlog+0x1ed/0x5e0 [ 2354.109085][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2354.109448][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2354.109898][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2354.110364][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2354.110779][ C2] ? lock_acquire+0x1c1/0x220 [ 2354.111115][ C2] ? process_backlog+0x1ed/0x5e0 [ 2354.111494][ C2] process_backlog+0xd3/0x5e0 [ 2354.111864][ C2] __napi_poll.constprop.0+0xa2/0x460 [ 2354.112277][ C2] net_rx_action+0x440/0xb40 [ 2354.112640][ C2] ? _nohz_idle_balance.isra.0+0x44b/0x630 [ 2354.113090][ C2] ? __pfx_net_rx_action+0x10/0x10 [ 2354.113469][ C2] ? lockdep_hardirqs_on_prepare.part.0+0x151/0x370 [ 2354.113967][ C2] __do_softirq+0x1b9/0x7ff [ 2354.114338][ C2] irq_exit_rcu+0x98/0xc0 [ 2354.114679][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2354.115120][ C2] [ 2354.115341][ C2] [ 2354.115568][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2354.116027][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2354.116409][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2354.117809][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000242 [ 2354.118264][ C2] RAX: 0000000002a12043 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2354.118824][ C2] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff956968b6 [ 2354.119418][ C2] RBP: 0000000000000000 R08: 0000000000000001 R09: ffffed1006b7eea4 [ 2354.120031][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2354.120626][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2354.121184][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2354.121607][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2354.121991][ C2] default_idle_call+0x69/0xa0 [ 2354.122351][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2354.122723][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2354.123153][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2354.123563][ C2] do_idle+0xfb/0x160 [ 2354.123872][ C2] cpu_startup_entry+0x55/0x60 [ 2354.124249][ C2] start_secondary+0x21c/0x2b0 [ 2354.124623][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2354.125036][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2354.125499][ C2] [ 2380.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [perl:4135] [ 2380.569689][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2380.570950][ C1] irq event stamp: 209232 [ 2380.571172][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2380.571702][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2380.572180][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2380.572650][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2380.573114][ C1] CPU: 1 PID: 4135 Comm: perl Not tainted 6.8.0-rc2-virtme #1 [ 2380.573491][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2380.574104][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2380.574391][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2380.575362][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 2380.575672][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2380.576072][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2380.576471][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2380.576871][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2380.577273][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2380.577680][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2380.578128][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2380.578461][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2380.578863][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2380.579265][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2380.579665][ C1] PKRU: 55555554 [ 2380.579848][ C1] Call Trace: [ 2380.580022][ C1] [ 2380.580171][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2380.580435][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2380.580681][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2380.580959][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2380.581232][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2380.581522][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.581787][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2380.582096][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2380.582359][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2380.582669][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2380.582965][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.583282][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2380.583571][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 2380.583854][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2380.584135][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2380.584448][ C1] ? get_stack_info+0x36/0xc0 [ 2380.584689][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.584934][ C1] ? lock_release+0x1d5/0x250 [ 2380.585173][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2380.585422][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2380.585696][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.585982][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.586222][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2380.586463][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2380.586725][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2380.586958][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2380.587206][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2380.587466][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2380.587753][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2380.588039][ C1] ip_local_deliver+0x19d/0x480 [ 2380.588288][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2380.588561][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2380.588825][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2380.589171][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2380.589425][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2380.589745][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2380.590016][ C1] ip_rcv+0x564/0x740 [ 2380.590221][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2380.590452][ C1] ? set_track_prepare+0x8a/0xd0 [ 2380.590705][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2380.590980][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2380.591256][ C1] ? skb_clone+0x10b/0x330 [ 2380.591482][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2380.591802][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.592107][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2380.592390][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2380.592688][ C1] ? __tcf_classify+0x329/0x7d0 [ 2380.592937][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2380.593167][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2380.593471][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.593755][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2380.594081][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.594320][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2380.594618][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2380.594902][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2380.595220][ C1] ? __copy_skb_header+0xaf/0x490 [ 2380.595479][ C1] ? __skb_clone+0x57a/0x760 [ 2380.595714][ C1] netif_receive_skb+0x55/0x280 [ 2380.595963][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2380.596279][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2380.596612][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.596910][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2380.597187][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2380.597476][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2380.597798][ C1] ? hlock_class+0x4e/0x130 [ 2380.598031][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2380.598310][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2380.598586][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2380.598849][ C1] ? hlock_class+0x4e/0x130 [ 2380.599082][ C1] ? mark_lock+0x38/0x3e0 [ 2380.599300][ C1] ? stack_access_ok+0xda/0x1f0 [ 2380.599549][ C1] ? __lock_acquire+0xb67/0x1610 [ 2380.599803][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2380.600078][ C1] ? get_stack_info+0x36/0xc0 [ 2380.600320][ C1] ? stack_access_ok+0xda/0x1f0 [ 2380.600567][ C1] ? get_reg+0x119/0x190 [ 2380.600782][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2380.601051][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2380.601360][ C1] __tcf_classify+0x329/0x7d0 [ 2380.601604][ C1] tcf_classify+0x283/0x930 [ 2380.601836][ C1] ? arch_stack_walk+0xa2/0x100 [ 2380.602085][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2380.602342][ C1] ? get_stack_info+0x36/0xc0 [ 2380.602582][ C1] tc_run+0x2e4/0x5d0 [ 2380.602788][ C1] ? __pfx_tc_run+0x10/0x10 [ 2380.603019][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.603262][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2380.603523][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2380.603777][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.604017][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2380.604282][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.604587][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2380.604860][ C1] ? neigh_hh_output+0x348/0x590 [ 2380.605113][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2380.605378][ C1] ip_finish_output2+0x786/0x18e0 [ 2380.605635][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2380.605912][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2380.606250][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2380.606529][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2380.606783][ C1] ? __ip_finish_output+0x10f/0x770 [ 2380.607048][ C1] ip_output+0x16b/0x4f0 [ 2380.607266][ C1] ? run_timer_softirq+0x72/0x100 [ 2380.607524][ C1] ? __pfx_ip_output+0x10/0x10 [ 2380.607778][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.608065][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2380.608319][ C1] ? ip_local_out+0x114/0x3b0 [ 2380.608562][ C1] __ip_queue_xmit+0x672/0x1910 [ 2380.608811][ C1] ? __create_object+0x5e/0xb0 [ 2380.609058][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2380.609326][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2380.609608][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2380.609882][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2380.610167][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2380.610440][ C1] tcp_delack_timer+0x84/0x240 [ 2380.610687][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2380.610960][ C1] call_timer_fn+0x173/0x430 [ 2380.611199][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2380.611462][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2380.611725][ C1] __run_timers.part.0+0x52d/0x890 [ 2380.611987][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2380.612262][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2380.612551][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.612790][ C1] ? clockevents_program_event+0xf6/0x300 [ 2380.613082][ C1] ? lock_release+0x1d5/0x250 [ 2380.613324][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.613590][ C1] ? ktime_get+0xb3/0x190 [ 2380.613810][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2380.614110][ C1] run_timer_softirq+0x72/0x100 [ 2380.614363][ C1] __do_softirq+0x1b9/0x7ff [ 2380.614594][ C1] irq_exit_rcu+0x98/0xc0 [ 2380.614817][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2380.615103][ C1] [ 2380.615256][ C1] [ 2380.615407][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.615713][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2380.616039][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2380.617012][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2380.617321][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2380.617731][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2380.618130][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2380.618531][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2380.618933][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2380.619337][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2380.619640][ C1] pipe_read+0xa16/0xdf0 [ 2380.619861][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2380.620140][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2380.620384][ C1] ? iterate_tty_write+0x299/0x540 [ 2380.620646][ C1] ? lock_release+0x1d5/0x250 [ 2380.620887][ C1] vfs_read+0x911/0xc00 [ 2380.621102][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.621342][ C1] ? __might_fault+0xc6/0x180 [ 2380.621584][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2380.621823][ C1] ? __might_fault+0xc6/0x180 [ 2380.622062][ C1] ? lock_release+0x1d5/0x250 [ 2380.622304][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.622569][ C1] ? __fget_light+0x54/0x1e0 [ 2380.622808][ C1] ksys_read+0x17a/0x1e0 [ 2380.623025][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2380.623271][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.623577][ C1] do_syscall_64+0xc9/0x1e0 [ 2380.623808][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2380.624112][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2380.624341][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2380.625323][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2380.625743][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2380.626145][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2380.626547][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2380.626950][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2380.627350][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2380.627763][ C1] [ 2380.627920][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 26s! [swapper/2:0] [ 2380.628351][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2380.629634][ C2] irq event stamp: 44114564 [ 2380.629873][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2380.630424][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2380.630940][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2380.631444][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2380.631916][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2380.632396][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2380.633010][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.633336][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2380.634307][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2380.634616][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2380.635016][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2380.635428][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2380.635827][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2380.636254][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2380.636657][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2380.637102][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2380.637445][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2380.637856][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2380.638256][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2380.638667][ C2] PKRU: 55555554 [ 2380.638848][ C2] Call Trace: [ 2380.639026][ C2] [ 2380.639174][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2380.639436][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2380.639694][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2380.639972][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2380.640275][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2380.640562][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.640826][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2380.641134][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2380.641394][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2380.641661][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2380.641971][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2380.642269][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.642584][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2380.642874][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.643170][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2380.643458][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2380.643770][ C2] ? get_stack_info+0x36/0xc0 [ 2380.644012][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.644279][ C2] ? lock_release+0x1d5/0x250 [ 2380.644517][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2380.644767][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2380.645039][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.645325][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.645565][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2380.645804][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2380.646066][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2380.646301][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2380.646549][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2380.646806][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2380.647083][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2380.647361][ C2] ip_local_deliver+0x19d/0x480 [ 2380.647616][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2380.647891][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2380.648167][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2380.648536][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2380.648790][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2380.649110][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2380.649373][ C2] ip_rcv+0x564/0x740 [ 2380.649587][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2380.649820][ C2] ? set_track_prepare+0x8a/0xd0 [ 2380.650076][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2380.650361][ C2] ? start_secondary+0x21c/0x2b0 [ 2380.650615][ C2] ? skb_clone+0x10b/0x330 [ 2380.650850][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2380.651169][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.651474][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2380.651758][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2380.652054][ C2] ? __tcf_classify+0x329/0x7d0 [ 2380.652333][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2380.652565][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2380.652864][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.653160][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2380.653484][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.653726][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2380.654022][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2380.654318][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2380.654635][ C2] ? __copy_skb_header+0xaf/0x490 [ 2380.654901][ C2] ? __skb_clone+0x57a/0x760 [ 2380.655132][ C2] netif_receive_skb+0x55/0x280 [ 2380.655381][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2380.655697][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2380.656028][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.656356][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2380.656630][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2380.656917][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2380.657238][ C2] ? get_stack_info+0x36/0xc0 [ 2380.657480][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2380.657752][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2380.658079][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2380.658353][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2380.658636][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2380.658954][ C2] ? kernel_text_address+0x17/0xe0 [ 2380.659216][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2380.659531][ C2] ? arch_stack_walk+0x8c/0x100 [ 2380.659782][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2380.660049][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.660362][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.660601][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2380.660883][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.661190][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2380.661470][ C2] ? get_stack_info+0x36/0xc0 [ 2380.661712][ C2] __tcf_classify+0x329/0x7d0 [ 2380.661955][ C2] tcf_classify+0x283/0x930 [ 2380.662186][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2380.662443][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2380.662758][ C2] tc_run+0x2e4/0x5d0 [ 2380.662963][ C2] ? __pfx_tc_run+0x10/0x10 [ 2380.663197][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.663437][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2380.663698][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2380.663951][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.664216][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2380.664482][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.664785][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2380.665059][ C2] ? neigh_hh_output+0x348/0x590 [ 2380.665311][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2380.665577][ C2] ip_finish_output2+0x786/0x18e0 [ 2380.665834][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2380.666172][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2380.666448][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2380.666710][ C2] ? __ip_finish_output+0x10f/0x770 [ 2380.666974][ C2] ip_output+0x16b/0x4f0 [ 2380.667192][ C2] ? __pfx_ip_output+0x10/0x10 [ 2380.667433][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2380.667733][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.668046][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2380.668358][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2380.668611][ C2] ? __alloc_skb+0xd4/0x280 [ 2380.668841][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2380.669112][ C2] ? tcp_fragment+0x168/0x1040 [ 2380.669359][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2380.669610][ C2] ? ip_local_out+0x114/0x3b0 [ 2380.669852][ C2] __ip_queue_xmit+0x672/0x1910 [ 2380.670101][ C2] ? __skb_clone+0x57a/0x760 [ 2380.670338][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2380.670615][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2380.670893][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2380.671137][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2380.671386][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2380.671684][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2380.672004][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2380.672272][ C2] tcp_send_loss_probe+0x348/0x830 [ 2380.672533][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2380.672802][ C2] tcp_write_timer+0x82/0x1d0 [ 2380.673043][ C2] call_timer_fn+0x173/0x430 [ 2380.673282][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2380.673543][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2380.673804][ C2] __run_timers.part.0+0x52d/0x890 [ 2380.674063][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2380.674333][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2380.674618][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.674857][ C2] ? clockevents_program_event+0xf6/0x300 [ 2380.675147][ C2] ? lock_release+0x1d5/0x250 [ 2380.675386][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.675651][ C2] ? ktime_get+0xb3/0x190 [ 2380.675872][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2380.676190][ C2] run_timer_softirq+0x72/0x100 [ 2380.676444][ C2] __do_softirq+0x1b9/0x7ff [ 2380.676677][ C2] irq_exit_rcu+0x98/0xc0 [ 2380.676899][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2380.677185][ C2] [ 2380.677337][ C2] [ 2380.677486][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.677807][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2380.678063][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2380.679030][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2380.679338][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2380.679738][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2380.680137][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2380.680561][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2380.680959][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2380.681359][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2380.681650][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2380.681912][ C2] default_idle_call+0x69/0xa0 [ 2380.682170][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2380.682422][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2380.682702][ C2] ? lock_release+0x1d5/0x250 [ 2380.682940][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2380.683215][ C2] do_idle+0xfb/0x160 [ 2380.683418][ C2] cpu_startup_entry+0x55/0x60 [ 2380.683662][ C2] start_secondary+0x21c/0x2b0 [ 2380.683905][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2380.684197][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2380.684512][ C2] [ 2380.887103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2380.887472][ C1] rcu: 1-....: (26703 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=6414 [ 2380.888020][ C1] rcu: (t=26000 jiffies g=1882453 q=635 ncpus=4) [ 2380.888345][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2380.888792][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2380.889403][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.889730][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2380.890698][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2380.891009][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2380.891406][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2380.891807][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2380.892206][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2380.892603][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2380.892999][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2380.893455][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2380.893790][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2380.894188][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2380.894585][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2380.894983][ C1] PKRU: 55555554 [ 2380.895164][ C1] Call Trace: [ 2380.895335][ C1] [ 2380.895482][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2380.895754][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2380.896006][ C1] ? check_cpu_stall+0x284/0x500 [ 2380.896256][ C1] ? rcu_pending+0x92/0x360 [ 2380.896488][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2380.896757][ C1] ? update_process_times+0xb9/0x110 [ 2380.897025][ C1] ? tick_sched_handle+0x67/0x130 [ 2380.897282][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2380.897570][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2380.897821][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2380.898132][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2380.898405][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2380.898691][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.898957][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2380.899265][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2380.899525][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2380.899834][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2380.900129][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.900443][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2380.900732][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.901027][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2380.901314][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2380.901624][ C1] ? get_stack_info+0x36/0xc0 [ 2380.901865][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.902104][ C1] ? lock_release+0x1d5/0x250 [ 2380.902344][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2380.902592][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2380.902862][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.903148][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.903386][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2380.903624][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2380.903883][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2380.904119][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2380.904366][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2380.904624][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2380.904898][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2380.905174][ C1] ip_local_deliver+0x19d/0x480 [ 2380.905420][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2380.905693][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2380.905957][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2380.906302][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2380.906556][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2380.906874][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2380.907137][ C1] ip_rcv+0x564/0x740 [ 2380.907343][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2380.907575][ C1] ? set_track_prepare+0x8a/0xd0 [ 2380.907836][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2380.908112][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2380.908382][ C1] ? skb_clone+0x10b/0x330 [ 2380.908610][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2380.908929][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.909238][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2380.909519][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2380.909813][ C1] ? __tcf_classify+0x329/0x7d0 [ 2380.910060][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2380.910292][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2380.910592][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.910875][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2380.911199][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.911438][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2380.911733][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2380.912020][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2380.912337][ C1] ? __copy_skb_header+0xaf/0x490 [ 2380.912594][ C1] ? __skb_clone+0x57a/0x760 [ 2380.912828][ C1] netif_receive_skb+0x55/0x280 [ 2380.913075][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2380.913386][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2380.913716][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.914016][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2380.914289][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2380.914578][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2380.914890][ C1] ? hlock_class+0x4e/0x130 [ 2380.915122][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2380.915397][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2380.915673][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2380.915937][ C1] ? hlock_class+0x4e/0x130 [ 2380.916166][ C1] ? mark_lock+0x38/0x3e0 [ 2380.916387][ C1] ? stack_access_ok+0xda/0x1f0 [ 2380.916634][ C1] ? __lock_acquire+0xb67/0x1610 [ 2380.916887][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2380.917161][ C1] ? get_stack_info+0x36/0xc0 [ 2380.917401][ C1] ? stack_access_ok+0xda/0x1f0 [ 2380.917655][ C1] ? get_reg+0x119/0x190 [ 2380.917870][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2380.918136][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2380.918445][ C1] __tcf_classify+0x329/0x7d0 [ 2380.918687][ C1] tcf_classify+0x283/0x930 [ 2380.918918][ C1] ? arch_stack_walk+0xa2/0x100 [ 2380.919165][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2380.919421][ C1] ? get_stack_info+0x36/0xc0 [ 2380.919663][ C1] tc_run+0x2e4/0x5d0 [ 2380.919866][ C1] ? __pfx_tc_run+0x10/0x10 [ 2380.920098][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.920337][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2380.920598][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2380.920849][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.921085][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2380.921356][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.921660][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2380.921932][ C1] ? neigh_hh_output+0x348/0x590 [ 2380.922185][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2380.922453][ C1] ip_finish_output2+0x786/0x18e0 [ 2380.922708][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2380.922987][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2380.923323][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2380.923598][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2380.923852][ C1] ? __ip_finish_output+0x10f/0x770 [ 2380.924118][ C1] ip_output+0x16b/0x4f0 [ 2380.924336][ C1] ? run_timer_softirq+0x72/0x100 [ 2380.924618][ C1] ? __pfx_ip_output+0x10/0x10 [ 2380.924864][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.925149][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2380.925401][ C1] ? ip_local_out+0x114/0x3b0 [ 2380.925643][ C1] __ip_queue_xmit+0x672/0x1910 [ 2380.925892][ C1] ? __create_object+0x5e/0xb0 [ 2380.926135][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2380.926403][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2380.926683][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2380.926954][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2380.927236][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2380.927509][ C1] tcp_delack_timer+0x84/0x240 [ 2380.927767][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2380.928037][ C1] call_timer_fn+0x173/0x430 [ 2380.928273][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2380.928535][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2380.928796][ C1] __run_timers.part.0+0x52d/0x890 [ 2380.929056][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2380.929328][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2380.929612][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.929850][ C1] ? clockevents_program_event+0xf6/0x300 [ 2380.930141][ C1] ? lock_release+0x1d5/0x250 [ 2380.930378][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.930644][ C1] ? ktime_get+0xb3/0x190 [ 2380.930864][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2380.931161][ C1] run_timer_softirq+0x72/0x100 [ 2380.931408][ C1] __do_softirq+0x1b9/0x7ff [ 2380.931640][ C1] irq_exit_rcu+0x98/0xc0 [ 2380.931861][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2380.932147][ C1] [ 2380.932296][ C1] [ 2380.932448][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.932752][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2380.933077][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2380.934042][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2380.934349][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2380.934748][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2380.935146][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2380.935543][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2380.935942][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2380.936342][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2380.936636][ C1] pipe_read+0xa16/0xdf0 [ 2380.936859][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2380.937135][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2380.937378][ C1] ? iterate_tty_write+0x299/0x540 [ 2380.937646][ C1] ? lock_release+0x1d5/0x250 [ 2380.937887][ C1] vfs_read+0x911/0xc00 [ 2380.938100][ C1] ? lock_acquire+0x1c1/0x220 [ 2380.938339][ C1] ? __might_fault+0xc6/0x180 [ 2380.938577][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2380.938816][ C1] ? __might_fault+0xc6/0x180 [ 2380.939056][ C1] ? lock_release+0x1d5/0x250 [ 2380.939296][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.939558][ C1] ? __fget_light+0x54/0x1e0 [ 2380.939795][ C1] ksys_read+0x17a/0x1e0 [ 2380.940013][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2380.940257][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.940559][ C1] do_syscall_64+0xc9/0x1e0 [ 2380.940791][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2380.941090][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2380.941315][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2380.942285][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2380.942705][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2380.943101][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2380.943504][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2380.943902][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2380.944299][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2380.944699][ C1] [ 2380.944870][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2380.945151][ C2] NMI backtrace for cpu 2 [ 2380.945158][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2380.945163][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2380.945167][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.945176][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2380.945181][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2380.945186][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2380.945190][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2380.945193][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2380.945197][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2380.945201][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2380.945204][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2380.945209][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2380.945214][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2380.945217][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2380.945220][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2380.945223][ C2] PKRU: 55555554 [ 2380.945225][ C2] Call Trace: [ 2380.945228][ C2] [ 2380.945232][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2380.945244][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2380.945252][ C2] ? nmi_handle+0x153/0x420 [ 2380.945261][ C2] ? default_do_nmi+0x41/0x100 [ 2380.945268][ C2] ? exc_nmi+0xf3/0x120 [ 2380.945273][ C2] ? end_repeat_nmi+0xf/0x60 [ 2380.945285][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2380.945293][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.945300][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.945307][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2380.945311][ C2] [ 2380.945312][ C2] [ 2380.945315][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2380.945318][ C2] ? get_stack_info+0x36/0xc0 [ 2380.945322][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.945325][ C2] ? lock_release+0x1d5/0x250 [ 2380.945329][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2380.945333][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2380.945335][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.945339][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.945341][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2380.945345][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2380.945348][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2380.945355][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2380.945357][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2380.945362][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2380.945368][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2380.945371][ C2] ip_local_deliver+0x19d/0x480 [ 2380.945374][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2380.945376][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2380.945379][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2380.945384][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2380.945388][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2380.945391][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2380.945400][ C2] ip_rcv+0x564/0x740 [ 2380.945403][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2380.945405][ C2] ? set_track_prepare+0x8a/0xd0 [ 2380.945410][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2380.945413][ C2] ? start_secondary+0x21c/0x2b0 [ 2380.945416][ C2] ? skb_clone+0x10b/0x330 [ 2380.945420][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2380.945426][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.945431][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2380.945435][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2380.945444][ C2] ? __tcf_classify+0x329/0x7d0 [ 2380.945447][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2380.945450][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2380.945453][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.945456][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2380.945461][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.945463][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2380.945467][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2380.945471][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2380.945475][ C2] ? __copy_skb_header+0xaf/0x490 [ 2380.945480][ C2] ? __skb_clone+0x57a/0x760 [ 2380.945482][ C2] netif_receive_skb+0x55/0x280 [ 2380.945486][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2380.945494][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2380.945500][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2380.945507][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2380.945511][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2380.945521][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2380.945528][ C2] ? get_stack_info+0x36/0xc0 [ 2380.945533][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2380.945536][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2380.945540][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2380.945543][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2380.945546][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2380.945549][ C2] ? kernel_text_address+0x17/0xe0 [ 2380.945552][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2380.945557][ C2] ? arch_stack_walk+0x8c/0x100 [ 2380.945561][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2380.945564][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2380.945567][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.945569][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2380.945573][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.945577][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2380.945580][ C2] ? get_stack_info+0x36/0xc0 [ 2380.945584][ C2] __tcf_classify+0x329/0x7d0 [ 2380.945590][ C2] tcf_classify+0x283/0x930 [ 2380.945595][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2380.945598][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2380.945602][ C2] tc_run+0x2e4/0x5d0 [ 2380.945606][ C2] ? __pfx_tc_run+0x10/0x10 [ 2380.945609][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.945611][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2380.945615][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2380.945619][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.945621][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2380.945624][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2380.945627][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2380.945630][ C2] ? neigh_hh_output+0x348/0x590 [ 2380.945634][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2380.945637][ C2] ip_finish_output2+0x786/0x18e0 [ 2380.945640][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2380.945649][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2380.945653][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2380.945659][ C2] ? __ip_finish_output+0x10f/0x770 [ 2380.945665][ C2] ip_output+0x16b/0x4f0 [ 2380.945668][ C2] ? __pfx_ip_output+0x10/0x10 [ 2380.945671][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2380.945674][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.945677][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2380.945680][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2380.945683][ C2] ? __alloc_skb+0xd4/0x280 [ 2380.945685][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2380.945690][ C2] ? tcp_fragment+0x168/0x1040 [ 2380.945694][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2380.945697][ C2] ? ip_local_out+0x114/0x3b0 [ 2380.945700][ C2] __ip_queue_xmit+0x672/0x1910 [ 2380.945704][ C2] ? __skb_clone+0x57a/0x760 [ 2380.945707][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2380.945712][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2380.945715][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2380.945720][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2380.945724][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2380.945729][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2380.945732][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2380.945735][ C2] tcp_send_loss_probe+0x348/0x830 [ 2380.945738][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2380.945741][ C2] tcp_write_timer+0x82/0x1d0 [ 2380.945744][ C2] call_timer_fn+0x173/0x430 [ 2380.945748][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2380.945752][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2380.945757][ C2] __run_timers.part.0+0x52d/0x890 [ 2380.945760][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2380.945764][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2380.945767][ C2] ? lock_acquire+0x1c1/0x220 [ 2380.945769][ C2] ? clockevents_program_event+0xf6/0x300 [ 2380.945772][ C2] ? lock_release+0x1d5/0x250 [ 2380.945775][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2380.945778][ C2] ? ktime_get+0xb3/0x190 [ 2380.945781][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2380.945785][ C2] run_timer_softirq+0x72/0x100 [ 2380.945788][ C2] __do_softirq+0x1b9/0x7ff [ 2380.945792][ C2] irq_exit_rcu+0x98/0xc0 [ 2380.945794][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2380.945798][ C2] [ 2380.945798][ C2] [ 2380.945799][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2380.945803][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2380.945806][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2380.945807][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2380.945809][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2380.945811][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2380.945812][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2380.945813][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2380.945815][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2380.945818][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2380.945821][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2380.945825][ C2] default_idle_call+0x69/0xa0 [ 2380.945828][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2380.945831][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2380.945834][ C2] ? lock_release+0x1d5/0x250 [ 2380.945837][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2380.945841][ C2] do_idle+0xfb/0x160 [ 2380.945843][ C2] cpu_startup_entry+0x55/0x60 [ 2380.945845][ C2] start_secondary+0x21c/0x2b0 [ 2380.945848][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2380.945852][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2380.945857][ C2] [ 2408.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 52s! [perl:4135] [ 2408.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2408.570948][ C1] irq event stamp: 209232 [ 2408.571171][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2408.571704][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2408.572183][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2408.572654][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2408.573116][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2408.573564][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2408.574178][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2408.574504][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2408.575476][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2408.575784][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2408.576191][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2408.576591][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2408.576987][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2408.577387][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2408.577794][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2408.578242][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2408.578574][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2408.578972][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2408.579372][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2408.579770][ C1] PKRU: 55555554 [ 2408.579952][ C1] Call Trace: [ 2408.580122][ C1] [ 2408.580273][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2408.580534][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2408.580778][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2408.581054][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2408.581325][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2408.581614][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2408.581882][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2408.582188][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2408.582449][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2408.582757][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2408.583053][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2408.583368][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2408.583656][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2408.583951][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2408.584238][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2408.584548][ C1] ? get_stack_info+0x36/0xc0 [ 2408.584788][ C1] ? lock_acquire+0x1c1/0x220 [ 2408.585029][ C1] ? lock_release+0x1d5/0x250 [ 2408.585269][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2408.585518][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2408.585789][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2408.586072][ C1] ? lock_acquire+0x1c1/0x220 [ 2408.586311][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2408.586552][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2408.586812][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2408.587045][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2408.587293][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2408.587559][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2408.587836][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2408.588112][ C1] ip_local_deliver+0x19d/0x480 [ 2408.588359][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2408.588629][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2408.588892][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2408.589239][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2408.589491][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2408.589810][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2408.590072][ C1] ip_rcv+0x564/0x740 [ 2408.590278][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2408.590507][ C1] ? set_track_prepare+0x8a/0xd0 [ 2408.590760][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2408.591035][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2408.591310][ C1] ? skb_clone+0x10b/0x330 [ 2408.591535][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2408.591853][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2408.592160][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2408.592441][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2408.592739][ C1] ? __tcf_classify+0x329/0x7d0 [ 2408.592989][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2408.593216][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2408.593517][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2408.593801][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2408.594127][ C1] ? lock_acquire+0x1c1/0x220 [ 2408.594364][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2408.594664][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2408.594949][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2408.595267][ C1] ? __copy_skb_header+0xaf/0x490 [ 2408.595525][ C1] ? __skb_clone+0x57a/0x760 [ 2408.595761][ C1] netif_receive_skb+0x55/0x280 [ 2408.596011][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2408.596325][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2408.596659][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2408.596957][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2408.597234][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2408.597531][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2408.597844][ C1] ? hlock_class+0x4e/0x130 [ 2408.598077][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2408.598355][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2408.598630][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2408.598893][ C1] ? hlock_class+0x4e/0x130 [ 2408.599126][ C1] ? mark_lock+0x38/0x3e0 [ 2408.599346][ C1] ? stack_access_ok+0xda/0x1f0 [ 2408.599596][ C1] ? __lock_acquire+0xb67/0x1610 [ 2408.599849][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2408.600126][ C1] ? get_stack_info+0x36/0xc0 [ 2408.600367][ C1] ? stack_access_ok+0xda/0x1f0 [ 2408.600615][ C1] ? get_reg+0x119/0x190 [ 2408.600832][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2408.601103][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2408.601413][ C1] __tcf_classify+0x329/0x7d0 [ 2408.601656][ C1] tcf_classify+0x283/0x930 [ 2408.601889][ C1] ? arch_stack_walk+0xa2/0x100 [ 2408.602138][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2408.602396][ C1] ? get_stack_info+0x36/0xc0 [ 2408.602636][ C1] tc_run+0x2e4/0x5d0 [ 2408.602844][ C1] ? __pfx_tc_run+0x10/0x10 [ 2408.603074][ C1] ? lock_acquire+0x1c1/0x220 [ 2408.603314][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2408.603575][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2408.603827][ C1] ? lock_acquire+0x1c1/0x220 [ 2408.604067][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2408.604332][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2408.604639][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2408.604912][ C1] ? neigh_hh_output+0x348/0x590 [ 2408.605166][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2408.605430][ C1] ip_finish_output2+0x786/0x18e0 [ 2408.605687][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2408.605964][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2408.606304][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2408.606582][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2408.606836][ C1] ? __ip_finish_output+0x10f/0x770 [ 2408.607105][ C1] ip_output+0x16b/0x4f0 [ 2408.607324][ C1] ? run_timer_softirq+0x72/0x100 [ 2408.607590][ C1] ? __pfx_ip_output+0x10/0x10 [ 2408.607834][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2408.608121][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2408.608372][ C1] ? ip_local_out+0x114/0x3b0 [ 2408.608614][ C1] __ip_queue_xmit+0x672/0x1910 [ 2408.608863][ C1] ? __create_object+0x5e/0xb0 [ 2408.609107][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2408.609375][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2408.609656][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2408.609931][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2408.610213][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2408.610485][ C1] tcp_delack_timer+0x84/0x240 [ 2408.610730][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2408.611000][ C1] call_timer_fn+0x173/0x430 [ 2408.611238][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2408.611500][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2408.611762][ C1] __run_timers.part.0+0x52d/0x890 [ 2408.612022][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2408.612296][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2408.612583][ C1] ? lock_acquire+0x1c1/0x220 [ 2408.612821][ C1] ? clockevents_program_event+0xf6/0x300 [ 2408.613112][ C1] ? lock_release+0x1d5/0x250 [ 2408.613352][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2408.613617][ C1] ? ktime_get+0xb3/0x190 [ 2408.613836][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2408.614135][ C1] run_timer_softirq+0x72/0x100 [ 2408.614384][ C1] __do_softirq+0x1b9/0x7ff [ 2408.614619][ C1] irq_exit_rcu+0x98/0xc0 [ 2408.614841][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2408.615127][ C1] [ 2408.615280][ C1] [ 2408.615430][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2408.615736][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2408.616062][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2408.617035][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2408.617345][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2408.617756][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2408.618155][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2408.618557][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2408.618957][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2408.619357][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2408.619656][ C1] pipe_read+0xa16/0xdf0 [ 2408.619876][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2408.620154][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2408.620397][ C1] ? iterate_tty_write+0x299/0x540 [ 2408.620659][ C1] ? lock_release+0x1d5/0x250 [ 2408.620900][ C1] vfs_read+0x911/0xc00 [ 2408.621114][ C1] ? lock_acquire+0x1c1/0x220 [ 2408.621354][ C1] ? __might_fault+0xc6/0x180 [ 2408.621596][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2408.621837][ C1] ? __might_fault+0xc6/0x180 [ 2408.622075][ C1] ? lock_release+0x1d5/0x250 [ 2408.622317][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2408.622581][ C1] ? __fget_light+0x54/0x1e0 [ 2408.622820][ C1] ksys_read+0x17a/0x1e0 [ 2408.623037][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2408.623283][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2408.623590][ C1] do_syscall_64+0xc9/0x1e0 [ 2408.623823][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2408.624123][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2408.624353][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2408.625328][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2408.625750][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2408.626153][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2408.626551][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2408.626949][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2408.627348][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2408.627758][ C1] [ 2408.627914][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 52s! [swapper/2:0] [ 2408.628349][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2408.629604][ C2] irq event stamp: 44114564 [ 2408.629834][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2408.630376][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2408.630885][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2408.631363][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2408.631832][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2408.632287][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2408.632898][ C2] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 2408.633190][ C2] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 2408.634157][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000246 [ 2408.634465][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [ 2408.634862][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2408.635261][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [ 2408.635657][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2408.636054][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2408.636452][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2408.636898][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2408.637236][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2408.637643][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2408.638040][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2408.638439][ C2] PKRU: 55555554 [ 2408.638634][ C2] Call Trace: [ 2408.638818][ C2] [ 2408.638967][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2408.639229][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2408.639472][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2408.639748][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2408.640020][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2408.640307][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2408.640571][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2408.640876][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2408.641135][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 2408.641393][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2408.641657][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2408.641971][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2408.642266][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2408.642581][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2408.642867][ C2] ? kasan_check_range+0x158/0x1c0 [ 2408.643126][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 2408.643406][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2408.643716][ C2] ? get_stack_info+0x36/0xc0 [ 2408.643957][ C2] ? lock_acquire+0x1c1/0x220 [ 2408.644199][ C2] ? lock_release+0x1d5/0x250 [ 2408.644437][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2408.644690][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2408.644961][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2408.645244][ C2] ? lock_acquire+0x1c1/0x220 [ 2408.645481][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2408.645721][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2408.645979][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2408.646210][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2408.646456][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2408.646713][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2408.646987][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2408.647267][ C2] ip_local_deliver+0x19d/0x480 [ 2408.647518][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2408.647787][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2408.648048][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2408.648394][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2408.648646][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2408.648964][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2408.649227][ C2] ip_rcv+0x564/0x740 [ 2408.649432][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2408.649660][ C2] ? set_track_prepare+0x8a/0xd0 [ 2408.649912][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2408.650187][ C2] ? start_secondary+0x21c/0x2b0 [ 2408.650436][ C2] ? skb_clone+0x10b/0x330 [ 2408.650665][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2408.650983][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2408.651289][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2408.651569][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2408.651862][ C2] ? __tcf_classify+0x329/0x7d0 [ 2408.652110][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2408.652341][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2408.652639][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2408.652922][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2408.653247][ C2] ? lock_acquire+0x1c1/0x220 [ 2408.653485][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2408.653780][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2408.654064][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2408.654379][ C2] ? __copy_skb_header+0xaf/0x490 [ 2408.654635][ C2] ? __skb_clone+0x57a/0x760 [ 2408.654870][ C2] netif_receive_skb+0x55/0x280 [ 2408.655116][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2408.655426][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2408.655757][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2408.656055][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2408.656327][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2408.656616][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2408.656925][ C2] ? get_stack_info+0x36/0xc0 [ 2408.657166][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2408.657432][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2408.657769][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2408.658044][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2408.658320][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2408.658633][ C2] ? kernel_text_address+0x17/0xe0 [ 2408.658893][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2408.659206][ C2] ? arch_stack_walk+0x8c/0x100 [ 2408.659455][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2408.659717][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2408.659999][ C2] ? lock_acquire+0x1c1/0x220 [ 2408.660238][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2408.660517][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2408.660821][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2408.661096][ C2] ? get_stack_info+0x36/0xc0 [ 2408.661337][ C2] __tcf_classify+0x329/0x7d0 [ 2408.661577][ C2] tcf_classify+0x283/0x930 [ 2408.661809][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2408.662068][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2408.662379][ C2] tc_run+0x2e4/0x5d0 [ 2408.662585][ C2] ? __pfx_tc_run+0x10/0x10 [ 2408.662813][ C2] ? lock_acquire+0x1c1/0x220 [ 2408.663049][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2408.663310][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2408.663562][ C2] ? lock_acquire+0x1c1/0x220 [ 2408.663799][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2408.664062][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2408.664366][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2408.664636][ C2] ? neigh_hh_output+0x348/0x590 [ 2408.664887][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2408.665152][ C2] ip_finish_output2+0x786/0x18e0 [ 2408.665407][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2408.665741][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2408.666014][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2408.666266][ C2] ? __ip_finish_output+0x10f/0x770 [ 2408.666530][ C2] ip_output+0x16b/0x4f0 [ 2408.666747][ C2] ? __pfx_ip_output+0x10/0x10 [ 2408.666989][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2408.667263][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2408.667580][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2408.667855][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2408.668105][ C2] ? __alloc_skb+0xd4/0x280 [ 2408.668335][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2408.668603][ C2] ? tcp_fragment+0x168/0x1040 [ 2408.668848][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2408.669099][ C2] ? ip_local_out+0x114/0x3b0 [ 2408.669338][ C2] __ip_queue_xmit+0x672/0x1910 [ 2408.669584][ C2] ? __skb_clone+0x57a/0x760 [ 2408.669821][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2408.670086][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2408.670366][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2408.670609][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2408.670858][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2408.671160][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2408.671477][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2408.671720][ C2] tcp_send_loss_probe+0x348/0x830 [ 2408.671979][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2408.672246][ C2] tcp_write_timer+0x82/0x1d0 [ 2408.672485][ C2] call_timer_fn+0x173/0x430 [ 2408.672719][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2408.672980][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2408.673241][ C2] __run_timers.part.0+0x52d/0x890 [ 2408.673501][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2408.673769][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2408.674050][ C2] ? lock_acquire+0x1c1/0x220 [ 2408.674289][ C2] ? clockevents_program_event+0xf6/0x300 [ 2408.674577][ C2] ? lock_release+0x1d5/0x250 [ 2408.674814][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2408.675076][ C2] ? ktime_get+0xb3/0x190 [ 2408.675299][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2408.675590][ C2] run_timer_softirq+0x72/0x100 [ 2408.675838][ C2] __do_softirq+0x1b9/0x7ff [ 2408.676075][ C2] irq_exit_rcu+0x98/0xc0 [ 2408.676294][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2408.676583][ C2] [ 2408.676732][ C2] [ 2408.676881][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2408.677183][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2408.677439][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2408.678414][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2408.678721][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2408.679120][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2408.679518][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2408.679913][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2408.680310][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2408.680707][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2408.680994][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2408.681255][ C2] default_idle_call+0x69/0xa0 [ 2408.681497][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2408.681747][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2408.682022][ C2] ? lock_release+0x1d5/0x250 [ 2408.682261][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2408.682531][ C2] do_idle+0xfb/0x160 [ 2408.682733][ C2] cpu_startup_entry+0x55/0x60 [ 2408.682975][ C2] start_secondary+0x21c/0x2b0 [ 2408.683219][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2408.683485][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2408.683801][ C2] [ 2436.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 78s! [perl:4135] [ 2436.569705][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2436.570981][ C1] irq event stamp: 209232 [ 2436.571203][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2436.571741][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2436.572223][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2436.572698][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2436.573167][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2436.573620][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2436.574238][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2436.574572][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2436.575557][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2436.575867][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2436.576271][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2436.576679][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2436.577078][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2436.577489][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2436.577895][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2436.578347][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2436.578682][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2436.579086][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2436.579490][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2436.579893][ C1] PKRU: 55555554 [ 2436.580076][ C1] Call Trace: [ 2436.580248][ C1] [ 2436.580402][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2436.580668][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2436.580914][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2436.581195][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2436.581469][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2436.581761][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2436.582031][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2436.582341][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2436.582606][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2436.582926][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2436.583237][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2436.583556][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2436.583846][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2436.584146][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2436.584440][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2436.584752][ C1] ? get_stack_info+0x36/0xc0 [ 2436.584997][ C1] ? lock_acquire+0x1c1/0x220 [ 2436.585241][ C1] ? lock_release+0x1d5/0x250 [ 2436.585484][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2436.585734][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2436.586009][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2436.586295][ C1] ? lock_acquire+0x1c1/0x220 [ 2436.586536][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2436.586781][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2436.587043][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2436.587278][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2436.587537][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2436.587796][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2436.588081][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2436.588362][ C1] ip_local_deliver+0x19d/0x480 [ 2436.588613][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2436.588887][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2436.589153][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2436.589516][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2436.589771][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2436.590095][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2436.590362][ C1] ip_rcv+0x564/0x740 [ 2436.590573][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2436.590806][ C1] ? set_track_prepare+0x8a/0xd0 [ 2436.591062][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2436.591341][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2436.591619][ C1] ? skb_clone+0x10b/0x330 [ 2436.591855][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2436.592182][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2436.592490][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2436.592773][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2436.593072][ C1] ? __tcf_classify+0x329/0x7d0 [ 2436.593326][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2436.593557][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2436.593863][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2436.594150][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2436.594477][ C1] ? lock_acquire+0x1c1/0x220 [ 2436.594716][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2436.595016][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2436.595303][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2436.595622][ C1] ? __copy_skb_header+0xaf/0x490 [ 2436.595881][ C1] ? __skb_clone+0x57a/0x760 [ 2436.596119][ C1] netif_receive_skb+0x55/0x280 [ 2436.596369][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2436.596684][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2436.597026][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2436.597339][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2436.597619][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2436.597910][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2436.598231][ C1] ? hlock_class+0x4e/0x130 [ 2436.598465][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2436.598745][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2436.599021][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2436.599290][ C1] ? hlock_class+0x4e/0x130 [ 2436.599524][ C1] ? mark_lock+0x38/0x3e0 [ 2436.599743][ C1] ? stack_access_ok+0xda/0x1f0 [ 2436.599995][ C1] ? __lock_acquire+0xb67/0x1610 [ 2436.600251][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2436.600534][ C1] ? get_stack_info+0x36/0xc0 [ 2436.600775][ C1] ? stack_access_ok+0xda/0x1f0 [ 2436.601027][ C1] ? get_reg+0x119/0x190 [ 2436.601243][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2436.601513][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2436.601831][ C1] __tcf_classify+0x329/0x7d0 [ 2436.602076][ C1] tcf_classify+0x283/0x930 [ 2436.602311][ C1] ? arch_stack_walk+0xa2/0x100 [ 2436.602568][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2436.602825][ C1] ? get_stack_info+0x36/0xc0 [ 2436.603064][ C1] tc_run+0x2e4/0x5d0 [ 2436.603273][ C1] ? __pfx_tc_run+0x10/0x10 [ 2436.603508][ C1] ? lock_acquire+0x1c1/0x220 [ 2436.603748][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2436.604011][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2436.604267][ C1] ? lock_acquire+0x1c1/0x220 [ 2436.604508][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2436.604780][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2436.605088][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2436.605363][ C1] ? neigh_hh_output+0x348/0x590 [ 2436.605618][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2436.605885][ C1] ip_finish_output2+0x786/0x18e0 [ 2436.606143][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2436.606423][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2436.606763][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2436.607043][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2436.607302][ C1] ? __ip_finish_output+0x10f/0x770 [ 2436.607578][ C1] ip_output+0x16b/0x4f0 [ 2436.607794][ C1] ? run_timer_softirq+0x72/0x100 [ 2436.608057][ C1] ? __pfx_ip_output+0x10/0x10 [ 2436.608303][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2436.608592][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2436.608846][ C1] ? ip_local_out+0x114/0x3b0 [ 2436.609089][ C1] __ip_queue_xmit+0x672/0x1910 [ 2436.609340][ C1] ? __create_object+0x5e/0xb0 [ 2436.609586][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2436.609855][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2436.610139][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2436.610414][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2436.610698][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2436.610971][ C1] tcp_delack_timer+0x84/0x240 [ 2436.611217][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2436.611497][ C1] call_timer_fn+0x173/0x430 [ 2436.611735][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2436.611996][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2436.612265][ C1] __run_timers.part.0+0x52d/0x890 [ 2436.612527][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2436.612801][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2436.613089][ C1] ? lock_acquire+0x1c1/0x220 [ 2436.613330][ C1] ? clockevents_program_event+0xf6/0x300 [ 2436.613624][ C1] ? lock_release+0x1d5/0x250 [ 2436.613866][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2436.614132][ C1] ? ktime_get+0xb3/0x190 [ 2436.614355][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2436.614660][ C1] run_timer_softirq+0x72/0x100 [ 2436.614909][ C1] __do_softirq+0x1b9/0x7ff [ 2436.615147][ C1] irq_exit_rcu+0x98/0xc0 [ 2436.615380][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2436.615668][ C1] [ 2436.615821][ C1] [ 2436.615978][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2436.616285][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2436.616613][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2436.617598][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2436.617908][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2436.618317][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2436.618715][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2436.619131][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2436.619532][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2436.619942][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2436.620244][ C1] pipe_read+0xa16/0xdf0 [ 2436.620465][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2436.620749][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2436.621001][ C1] ? iterate_tty_write+0x299/0x540 [ 2436.621265][ C1] ? lock_release+0x1d5/0x250 [ 2436.621507][ C1] vfs_read+0x911/0xc00 [ 2436.621721][ C1] ? lock_acquire+0x1c1/0x220 [ 2436.621962][ C1] ? __might_fault+0xc6/0x180 [ 2436.622205][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2436.622452][ C1] ? __might_fault+0xc6/0x180 [ 2436.622691][ C1] ? lock_release+0x1d5/0x250 [ 2436.622931][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2436.623198][ C1] ? __fget_light+0x54/0x1e0 [ 2436.623445][ C1] ksys_read+0x17a/0x1e0 [ 2436.623663][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2436.623909][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2436.624221][ C1] do_syscall_64+0xc9/0x1e0 [ 2436.624455][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2436.624756][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2436.624990][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2436.625962][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2436.626383][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2436.626786][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2436.627187][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2436.627594][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2436.627992][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2436.628399][ C1] [ 2436.628558][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 78s! [swapper/2:0] [ 2436.628988][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2436.630251][ C2] irq event stamp: 44114564 [ 2436.630481][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2436.631016][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2436.631528][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2436.632005][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2436.632475][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2436.632930][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2436.633545][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2436.633870][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2436.634836][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2436.635145][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2436.635541][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2436.635938][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2436.636337][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2436.636735][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2436.637132][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2436.637585][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2436.637915][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2436.638315][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2436.638714][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2436.639110][ C2] PKRU: 55555554 [ 2436.639293][ C2] Call Trace: [ 2436.639466][ C2] [ 2436.639615][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2436.639875][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2436.640120][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2436.640396][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2436.640666][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2436.640955][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2436.641220][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2436.641526][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2436.641785][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2436.642046][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2436.642356][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2436.642649][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2436.642963][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2436.643253][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2436.643545][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2436.643833][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2436.644144][ C2] ? get_stack_info+0x36/0xc0 [ 2436.644381][ C2] ? lock_acquire+0x1c1/0x220 [ 2436.644622][ C2] ? lock_release+0x1d5/0x250 [ 2436.644861][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2436.645109][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2436.645380][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2436.645663][ C2] ? lock_acquire+0x1c1/0x220 [ 2436.645900][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2436.646141][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2436.646400][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2436.646635][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2436.646880][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2436.647137][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2436.647422][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2436.647698][ C2] ip_local_deliver+0x19d/0x480 [ 2436.647944][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2436.648215][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2436.648476][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2436.648824][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2436.649075][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2436.649394][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2436.649656][ C2] ip_rcv+0x564/0x740 [ 2436.649858][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2436.650087][ C2] ? set_track_prepare+0x8a/0xd0 [ 2436.650339][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2436.650617][ C2] ? start_secondary+0x21c/0x2b0 [ 2436.650866][ C2] ? skb_clone+0x10b/0x330 [ 2436.651092][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2436.651409][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2436.651714][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2436.651994][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2436.652292][ C2] ? __tcf_classify+0x329/0x7d0 [ 2436.652541][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2436.652769][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2436.653068][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2436.653351][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2436.653676][ C2] ? lock_acquire+0x1c1/0x220 [ 2436.653913][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2436.654209][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2436.654491][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2436.654806][ C2] ? __copy_skb_header+0xaf/0x490 [ 2436.655062][ C2] ? __skb_clone+0x57a/0x760 [ 2436.655296][ C2] netif_receive_skb+0x55/0x280 [ 2436.655544][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2436.655854][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2436.656186][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2436.656486][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2436.656761][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2436.657048][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2436.657369][ C2] ? get_stack_info+0x36/0xc0 [ 2436.657608][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2436.657872][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2436.658189][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2436.658463][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2436.658738][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2436.659051][ C2] ? kernel_text_address+0x17/0xe0 [ 2436.659312][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2436.659624][ C2] ? arch_stack_walk+0x8c/0x100 [ 2436.659872][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2436.660136][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2436.660419][ C2] ? lock_acquire+0x1c1/0x220 [ 2436.660655][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2436.660938][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2436.661241][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2436.661519][ C2] ? get_stack_info+0x36/0xc0 [ 2436.661758][ C2] __tcf_classify+0x329/0x7d0 [ 2436.661998][ C2] tcf_classify+0x283/0x930 [ 2436.662233][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2436.662488][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2436.662800][ C2] tc_run+0x2e4/0x5d0 [ 2436.663004][ C2] ? __pfx_tc_run+0x10/0x10 [ 2436.663235][ C2] ? lock_acquire+0x1c1/0x220 [ 2436.663471][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2436.663731][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2436.663983][ C2] ? lock_acquire+0x1c1/0x220 [ 2436.664222][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2436.664485][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2436.664787][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2436.665056][ C2] ? neigh_hh_output+0x348/0x590 [ 2436.665308][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2436.665571][ C2] ip_finish_output2+0x786/0x18e0 [ 2436.665825][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2436.666161][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2436.666438][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2436.666688][ C2] ? __ip_finish_output+0x10f/0x770 [ 2436.666951][ C2] ip_output+0x16b/0x4f0 [ 2436.667167][ C2] ? __pfx_ip_output+0x10/0x10 [ 2436.667416][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2436.667690][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2436.668000][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2436.668277][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2436.668525][ C2] ? __alloc_skb+0xd4/0x280 [ 2436.668756][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2436.669025][ C2] ? tcp_fragment+0x168/0x1040 [ 2436.669268][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2436.669519][ C2] ? ip_local_out+0x114/0x3b0 [ 2436.669758][ C2] __ip_queue_xmit+0x672/0x1910 [ 2436.670005][ C2] ? __skb_clone+0x57a/0x760 [ 2436.670239][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2436.670504][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2436.670785][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2436.671031][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2436.671280][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2436.671580][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2436.671897][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2436.672140][ C2] tcp_send_loss_probe+0x348/0x830 [ 2436.672400][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2436.672665][ C2] tcp_write_timer+0x82/0x1d0 [ 2436.672905][ C2] call_timer_fn+0x173/0x430 [ 2436.673142][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2436.673401][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2436.673661][ C2] __run_timers.part.0+0x52d/0x890 [ 2436.673919][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2436.674188][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2436.674470][ C2] ? lock_acquire+0x1c1/0x220 [ 2436.674707][ C2] ? clockevents_program_event+0xf6/0x300 [ 2436.674997][ C2] ? lock_release+0x1d5/0x250 [ 2436.675234][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2436.675497][ C2] ? ktime_get+0xb3/0x190 [ 2436.675714][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2436.676009][ C2] run_timer_softirq+0x72/0x100 [ 2436.676256][ C2] __do_softirq+0x1b9/0x7ff [ 2436.676487][ C2] irq_exit_rcu+0x98/0xc0 [ 2436.676707][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2436.676989][ C2] [ 2436.677138][ C2] [ 2436.677290][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2436.677599][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2436.677854][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2436.678820][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2436.679129][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2436.679527][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2436.679923][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2436.680319][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2436.680715][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2436.681116][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2436.681402][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2436.681661][ C2] default_idle_call+0x69/0xa0 [ 2436.681903][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2436.682154][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2436.682429][ C2] ? lock_release+0x1d5/0x250 [ 2436.682667][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2436.682937][ C2] do_idle+0xfb/0x160 [ 2436.683142][ C2] cpu_startup_entry+0x55/0x60 [ 2436.683383][ C2] start_secondary+0x21c/0x2b0 [ 2436.683628][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2436.683896][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2436.684207][ C2] [ 2458.945107][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2458.945662][ C1] rcu: 1-....: (104588 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=25607 [ 2458.946497][ C1] rcu: (t=104058 jiffies g=1882453 q=655 ncpus=4) [ 2458.946997][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2458.947687][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2458.948631][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2458.949026][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2458.950008][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2458.950322][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2458.950719][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2458.951123][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2458.951522][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2458.951920][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2458.952325][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2458.952888][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2458.953383][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2458.953943][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2458.954500][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2458.955069][ C1] PKRU: 55555554 [ 2458.955332][ C1] Call Trace: [ 2458.955587][ C1] [ 2458.955809][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2458.956210][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2458.956568][ C1] ? check_cpu_stall+0x284/0x500 [ 2458.956947][ C1] ? rcu_pending+0x92/0x360 [ 2458.957289][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2458.957687][ C1] ? update_process_times+0xb9/0x110 [ 2458.958091][ C1] ? tick_sched_handle+0x67/0x130 [ 2458.958484][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2458.958914][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2458.959272][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2458.959742][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2458.960141][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2458.960564][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2458.960956][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2458.961407][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2458.961804][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2458.962270][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2458.962722][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2458.963194][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2458.963634][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2458.964067][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2458.964501][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2458.964967][ C1] ? get_stack_info+0x36/0xc0 [ 2458.965335][ C1] ? lock_acquire+0x1c1/0x220 [ 2458.965702][ C1] ? lock_release+0x1d5/0x250 [ 2458.966072][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2458.966457][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2458.966874][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2458.967318][ C1] ? lock_acquire+0x1c1/0x220 [ 2458.967685][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2458.968057][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2458.968457][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2458.968810][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2458.969177][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2458.969569][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2458.969984][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2458.970411][ C1] ip_local_deliver+0x19d/0x480 [ 2458.970788][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2458.971197][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2458.971593][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2458.972124][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2458.972495][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2458.972974][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2458.973369][ C1] ip_rcv+0x564/0x740 [ 2458.973671][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2458.974013][ C1] ? set_track_prepare+0x8a/0xd0 [ 2458.974404][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2458.974829][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2458.975233][ C1] ? skb_clone+0x10b/0x330 [ 2458.975578][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2458.976066][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2458.976520][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2458.976952][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2458.977413][ C1] ? __tcf_classify+0x329/0x7d0 [ 2458.977797][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2458.978149][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2458.978594][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2458.979019][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2458.979498][ C1] ? lock_acquire+0x1c1/0x220 [ 2458.979858][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2458.980293][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2458.980712][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2458.981181][ C1] ? __copy_skb_header+0xaf/0x490 [ 2458.981558][ C1] ? __skb_clone+0x57a/0x760 [ 2458.981890][ C1] netif_receive_skb+0x55/0x280 [ 2458.982268][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2458.982737][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2458.983200][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2458.983617][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2458.984000][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2458.984402][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2458.984838][ C1] ? hlock_class+0x4e/0x130 [ 2458.985164][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2458.985551][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2458.985928][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2458.986314][ C1] ? hlock_class+0x4e/0x130 [ 2458.986632][ C1] ? mark_lock+0x38/0x3e0 [ 2458.986939][ C1] ? stack_access_ok+0xda/0x1f0 [ 2458.987322][ C1] ? __lock_acquire+0xb67/0x1610 [ 2458.987580][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2458.987858][ C1] ? get_stack_info+0x36/0xc0 [ 2458.988101][ C1] ? stack_access_ok+0xda/0x1f0 [ 2458.988352][ C1] ? get_reg+0x119/0x190 [ 2458.988569][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2458.988838][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2458.989157][ C1] __tcf_classify+0x329/0x7d0 [ 2458.989398][ C1] tcf_classify+0x283/0x930 [ 2458.989631][ C1] ? arch_stack_walk+0xa2/0x100 [ 2458.989882][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2458.990144][ C1] ? get_stack_info+0x36/0xc0 [ 2458.990386][ C1] tc_run+0x2e4/0x5d0 [ 2458.990592][ C1] ? __pfx_tc_run+0x10/0x10 [ 2458.990822][ C1] ? lock_acquire+0x1c1/0x220 [ 2458.991062][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2458.991334][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2458.991588][ C1] ? lock_acquire+0x1c1/0x220 [ 2458.991828][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2458.992094][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2458.992406][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2458.992676][ C1] ? neigh_hh_output+0x348/0x590 [ 2458.992928][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2458.993198][ C1] ip_finish_output2+0x786/0x18e0 [ 2458.993454][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2458.993735][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2458.994076][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2458.994357][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2458.994612][ C1] ? __ip_finish_output+0x10f/0x770 [ 2458.994881][ C1] ip_output+0x16b/0x4f0 [ 2458.995098][ C1] ? run_timer_softirq+0x72/0x100 [ 2458.995367][ C1] ? __pfx_ip_output+0x10/0x10 [ 2458.995610][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2458.995897][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2458.996156][ C1] ? ip_local_out+0x114/0x3b0 [ 2458.996397][ C1] __ip_queue_xmit+0x672/0x1910 [ 2458.996647][ C1] ? __create_object+0x5e/0xb0 [ 2458.996894][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2458.997169][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2458.997460][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2458.997736][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2458.998019][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2458.998294][ C1] tcp_delack_timer+0x84/0x240 [ 2458.998539][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2458.998809][ C1] call_timer_fn+0x173/0x430 [ 2458.999046][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2458.999317][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2458.999578][ C1] __run_timers.part.0+0x52d/0x890 [ 2458.999838][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2459.000118][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2459.000402][ C1] ? lock_acquire+0x1c1/0x220 [ 2459.000643][ C1] ? clockevents_program_event+0xf6/0x300 [ 2459.000932][ C1] ? lock_release+0x1d5/0x250 [ 2459.001179][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2459.001446][ C1] ? ktime_get+0xb3/0x190 [ 2459.001669][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2459.001965][ C1] run_timer_softirq+0x72/0x100 [ 2459.002220][ C1] __do_softirq+0x1b9/0x7ff [ 2459.002454][ C1] irq_exit_rcu+0x98/0xc0 [ 2459.002673][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2459.002961][ C1] [ 2459.003120][ C1] [ 2459.003269][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2459.003575][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2459.003900][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2459.004874][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2459.005190][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2459.005586][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2459.005985][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2459.006391][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2459.006789][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2459.007224][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2459.007526][ C1] pipe_read+0xa16/0xdf0 [ 2459.007746][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2459.008028][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2459.008286][ C1] ? iterate_tty_write+0x299/0x540 [ 2459.008548][ C1] ? lock_release+0x1d5/0x250 [ 2459.008788][ C1] vfs_read+0x911/0xc00 [ 2459.009004][ C1] ? lock_acquire+0x1c1/0x220 [ 2459.009248][ C1] ? __might_fault+0xc6/0x180 [ 2459.009489][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2459.009729][ C1] ? __might_fault+0xc6/0x180 [ 2459.009970][ C1] ? lock_release+0x1d5/0x250 [ 2459.010215][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2459.010480][ C1] ? __fget_light+0x54/0x1e0 [ 2459.010719][ C1] ksys_read+0x17a/0x1e0 [ 2459.010936][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2459.011187][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2459.011493][ C1] do_syscall_64+0xc9/0x1e0 [ 2459.011729][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2459.012026][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2459.012262][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2459.013233][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2459.013652][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2459.014049][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2459.014453][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2459.014848][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2459.015251][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2459.015650][ C1] [ 2459.015807][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2459.016084][ C2] NMI backtrace for cpu 2 [ 2459.016093][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2459.016100][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2459.016105][ C2] RIP: 0010:kasan_check_range+0x156/0x1c0 [ 2459.016117][ C2] Code: d0 74 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea 09 48 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 [ 2459.016122][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000286 [ 2459.016128][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [ 2459.016132][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2459.016136][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [ 2459.016137][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2459.016139][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2459.016141][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2459.016142][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2459.016146][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2459.016148][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2459.016149][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2459.016150][ C2] PKRU: 55555554 [ 2459.016151][ C2] Call Trace: [ 2459.016154][ C2] [ 2459.016159][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2459.016166][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2459.016171][ C2] ? nmi_handle+0x153/0x420 [ 2459.016176][ C2] ? default_do_nmi+0x41/0x100 [ 2459.016179][ C2] ? exc_nmi+0xf3/0x120 [ 2459.016182][ C2] ? end_repeat_nmi+0xf/0x60 [ 2459.016188][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2459.016192][ C2] ? kasan_check_range+0x156/0x1c0 [ 2459.016196][ C2] ? kasan_check_range+0x156/0x1c0 [ 2459.016199][ C2] ? kasan_check_range+0x156/0x1c0 [ 2459.016202][ C2] [ 2459.016202][ C2] [ 2459.016204][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 2459.016207][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2459.016210][ C2] ? get_stack_info+0x36/0xc0 [ 2459.016214][ C2] ? lock_acquire+0x1c1/0x220 [ 2459.016218][ C2] ? lock_release+0x1d5/0x250 [ 2459.016222][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2459.016226][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2459.016229][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2459.016232][ C2] ? lock_acquire+0x1c1/0x220 [ 2459.016234][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2459.016239][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2459.016243][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2459.016250][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2459.016252][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2459.016258][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2459.016265][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2459.016269][ C2] ip_local_deliver+0x19d/0x480 [ 2459.016271][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2459.016274][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2459.016276][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2459.016283][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2459.016288][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2459.016291][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2459.016300][ C2] ip_rcv+0x564/0x740 [ 2459.016303][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2459.016305][ C2] ? set_track_prepare+0x8a/0xd0 [ 2459.016310][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2459.016313][ C2] ? start_secondary+0x21c/0x2b0 [ 2459.016317][ C2] ? skb_clone+0x10b/0x330 [ 2459.016322][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2459.016328][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2459.016334][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2459.016339][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2459.016348][ C2] ? __tcf_classify+0x329/0x7d0 [ 2459.016352][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2459.016354][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2459.016358][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2459.016361][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2459.016365][ C2] ? lock_acquire+0x1c1/0x220 [ 2459.016367][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2459.016371][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2459.016375][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2459.016379][ C2] ? __copy_skb_header+0xaf/0x490 [ 2459.016385][ C2] ? __skb_clone+0x57a/0x760 [ 2459.016387][ C2] netif_receive_skb+0x55/0x280 [ 2459.016391][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2459.016400][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2459.016407][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2459.016413][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2459.016418][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2459.016429][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2459.016436][ C2] ? get_stack_info+0x36/0xc0 [ 2459.016440][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2459.016444][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2459.016448][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2459.016451][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2459.016454][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2459.016456][ C2] ? kernel_text_address+0x17/0xe0 [ 2459.016460][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2459.016464][ C2] ? arch_stack_walk+0x8c/0x100 [ 2459.016469][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2459.016472][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2459.016475][ C2] ? lock_acquire+0x1c1/0x220 [ 2459.016478][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2459.016482][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2459.016488][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2459.016490][ C2] ? get_stack_info+0x36/0xc0 [ 2459.016494][ C2] __tcf_classify+0x329/0x7d0 [ 2459.016500][ C2] tcf_classify+0x283/0x930 [ 2459.016504][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2459.016507][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2459.016512][ C2] tc_run+0x2e4/0x5d0 [ 2459.016516][ C2] ? __pfx_tc_run+0x10/0x10 [ 2459.016519][ C2] ? lock_acquire+0x1c1/0x220 [ 2459.016521][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2459.016525][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2459.016529][ C2] ? lock_acquire+0x1c1/0x220 [ 2459.016532][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2459.016536][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2459.016539][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2459.016541][ C2] ? neigh_hh_output+0x348/0x590 [ 2459.016545][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2459.016549][ C2] ip_finish_output2+0x786/0x18e0 [ 2459.016552][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2459.016560][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2459.016562][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2459.016566][ C2] ? __ip_finish_output+0x10f/0x770 [ 2459.016569][ C2] ip_output+0x16b/0x4f0 [ 2459.016572][ C2] ? __pfx_ip_output+0x10/0x10 [ 2459.016574][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2459.016577][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2459.016580][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2459.016583][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2459.016585][ C2] ? __alloc_skb+0xd4/0x280 [ 2459.016588][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2459.016592][ C2] ? tcp_fragment+0x168/0x1040 [ 2459.016595][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2459.016598][ C2] ? ip_local_out+0x114/0x3b0 [ 2459.016601][ C2] __ip_queue_xmit+0x672/0x1910 [ 2459.016605][ C2] ? __skb_clone+0x57a/0x760 [ 2459.016608][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2459.016613][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2459.016616][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2459.016620][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2459.016624][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2459.016628][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2459.016631][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2459.016634][ C2] tcp_send_loss_probe+0x348/0x830 [ 2459.016637][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2459.016640][ C2] tcp_write_timer+0x82/0x1d0 [ 2459.016643][ C2] call_timer_fn+0x173/0x430 [ 2459.016647][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2459.016651][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2459.016655][ C2] __run_timers.part.0+0x52d/0x890 [ 2459.016658][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2459.016662][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2459.016665][ C2] ? lock_acquire+0x1c1/0x220 [ 2459.016667][ C2] ? clockevents_program_event+0xf6/0x300 [ 2459.016672][ C2] ? lock_release+0x1d5/0x250 [ 2459.016674][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2459.016678][ C2] ? ktime_get+0xb3/0x190 [ 2459.016681][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2459.016685][ C2] run_timer_softirq+0x72/0x100 [ 2459.016689][ C2] __do_softirq+0x1b9/0x7ff [ 2459.016693][ C2] irq_exit_rcu+0x98/0xc0 [ 2459.016696][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2459.016699][ C2] [ 2459.016700][ C2] [ 2459.016701][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2459.016704][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2459.016707][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2459.016709][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2459.016711][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2459.016713][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2459.016714][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2459.016715][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2459.016717][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2459.016720][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2459.016723][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2459.016727][ C2] default_idle_call+0x69/0xa0 [ 2459.016730][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2459.016733][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2459.016737][ C2] ? lock_release+0x1d5/0x250 [ 2459.016740][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2459.016744][ C2] do_idle+0xfb/0x160 [ 2459.016747][ C2] cpu_startup_entry+0x55/0x60 [ 2459.016750][ C2] start_secondary+0x21c/0x2b0 [ 2459.016753][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2459.016756][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2459.016762][ C2] [ 2484.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 122s! [perl:4135] [ 2484.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2484.570962][ C1] irq event stamp: 209232 [ 2484.571182][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2484.571713][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2484.572190][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2484.572659][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2484.573124][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2484.573572][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2484.574183][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2484.574508][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2484.575478][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2484.575785][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2484.576184][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2484.576583][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2484.576981][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2484.577388][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2484.577786][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2484.578232][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2484.578564][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2484.578962][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2484.579358][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2484.579763][ C1] PKRU: 55555554 [ 2484.579943][ C1] Call Trace: [ 2484.580115][ C1] [ 2484.580266][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2484.580529][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2484.580772][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2484.581049][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2484.581322][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2484.581608][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2484.581876][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2484.582182][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2484.582443][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2484.582752][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2484.583049][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2484.583368][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2484.583654][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2484.583949][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2484.584236][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2484.584547][ C1] ? get_stack_info+0x36/0xc0 [ 2484.584789][ C1] ? lock_acquire+0x1c1/0x220 [ 2484.585032][ C1] ? lock_release+0x1d5/0x250 [ 2484.585270][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2484.585520][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2484.585792][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2484.586077][ C1] ? lock_acquire+0x1c1/0x220 [ 2484.586316][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2484.586557][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2484.586817][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2484.587051][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2484.587306][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2484.587564][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2484.587844][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2484.588128][ C1] ip_local_deliver+0x19d/0x480 [ 2484.588374][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2484.588646][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2484.588909][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2484.589257][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2484.589510][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2484.589827][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2484.590090][ C1] ip_rcv+0x564/0x740 [ 2484.590293][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2484.590524][ C1] ? set_track_prepare+0x8a/0xd0 [ 2484.590778][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2484.591053][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2484.591326][ C1] ? skb_clone+0x10b/0x330 [ 2484.591555][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2484.591874][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2484.592181][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2484.592462][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2484.592757][ C1] ? __tcf_classify+0x329/0x7d0 [ 2484.593005][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2484.593236][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2484.593536][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2484.593819][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2484.594144][ C1] ? lock_acquire+0x1c1/0x220 [ 2484.594386][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2484.594683][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2484.594967][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2484.595285][ C1] ? __copy_skb_header+0xaf/0x490 [ 2484.595544][ C1] ? __skb_clone+0x57a/0x760 [ 2484.595778][ C1] netif_receive_skb+0x55/0x280 [ 2484.596026][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2484.596337][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2484.596669][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2484.596967][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2484.597245][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2484.597535][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2484.597847][ C1] ? hlock_class+0x4e/0x130 [ 2484.598080][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2484.598356][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2484.598632][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2484.598894][ C1] ? hlock_class+0x4e/0x130 [ 2484.599126][ C1] ? mark_lock+0x38/0x3e0 [ 2484.599345][ C1] ? stack_access_ok+0xda/0x1f0 [ 2484.599599][ C1] ? __lock_acquire+0xb67/0x1610 [ 2484.599852][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2484.600127][ C1] ? get_stack_info+0x36/0xc0 [ 2484.600368][ C1] ? stack_access_ok+0xda/0x1f0 [ 2484.600615][ C1] ? get_reg+0x119/0x190 [ 2484.600829][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2484.601100][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2484.601410][ C1] __tcf_classify+0x329/0x7d0 [ 2484.601652][ C1] tcf_classify+0x283/0x930 [ 2484.601882][ C1] ? arch_stack_walk+0xa2/0x100 [ 2484.602130][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2484.602386][ C1] ? get_stack_info+0x36/0xc0 [ 2484.602627][ C1] tc_run+0x2e4/0x5d0 [ 2484.602832][ C1] ? __pfx_tc_run+0x10/0x10 [ 2484.603065][ C1] ? lock_acquire+0x1c1/0x220 [ 2484.603304][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2484.603565][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2484.603819][ C1] ? lock_acquire+0x1c1/0x220 [ 2484.604056][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2484.604322][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2484.604627][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2484.604899][ C1] ? neigh_hh_output+0x348/0x590 [ 2484.605152][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2484.605417][ C1] ip_finish_output2+0x786/0x18e0 [ 2484.605673][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2484.605950][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2484.606287][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2484.606562][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2484.606813][ C1] ? __ip_finish_output+0x10f/0x770 [ 2484.607085][ C1] ip_output+0x16b/0x4f0 [ 2484.607303][ C1] ? run_timer_softirq+0x72/0x100 [ 2484.607560][ C1] ? __pfx_ip_output+0x10/0x10 [ 2484.607803][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2484.608088][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2484.608339][ C1] ? ip_local_out+0x114/0x3b0 [ 2484.608579][ C1] __ip_queue_xmit+0x672/0x1910 [ 2484.608827][ C1] ? __create_object+0x5e/0xb0 [ 2484.609071][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2484.609339][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2484.609619][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2484.609891][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2484.610175][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2484.610446][ C1] tcp_delack_timer+0x84/0x240 [ 2484.610690][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2484.610962][ C1] call_timer_fn+0x173/0x430 [ 2484.611199][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2484.611461][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2484.611721][ C1] __run_timers.part.0+0x52d/0x890 [ 2484.611980][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2484.612254][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2484.612538][ C1] ? lock_acquire+0x1c1/0x220 [ 2484.612775][ C1] ? clockevents_program_event+0xf6/0x300 [ 2484.613068][ C1] ? lock_release+0x1d5/0x250 [ 2484.613307][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2484.613572][ C1] ? ktime_get+0xb3/0x190 [ 2484.613791][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2484.614088][ C1] run_timer_softirq+0x72/0x100 [ 2484.614336][ C1] __do_softirq+0x1b9/0x7ff [ 2484.614567][ C1] irq_exit_rcu+0x98/0xc0 [ 2484.614789][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2484.615074][ C1] [ 2484.615225][ C1] [ 2484.615375][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2484.615680][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2484.616005][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2484.616974][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2484.617288][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2484.617686][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2484.618083][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2484.618481][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2484.618881][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2484.619282][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2484.619597][ C1] pipe_read+0xa16/0xdf0 [ 2484.619818][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2484.620094][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2484.620338][ C1] ? iterate_tty_write+0x299/0x540 [ 2484.620599][ C1] ? lock_release+0x1d5/0x250 [ 2484.620839][ C1] vfs_read+0x911/0xc00 [ 2484.621054][ C1] ? lock_acquire+0x1c1/0x220 [ 2484.621293][ C1] ? __might_fault+0xc6/0x180 [ 2484.621534][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2484.621770][ C1] ? __might_fault+0xc6/0x180 [ 2484.622011][ C1] ? lock_release+0x1d5/0x250 [ 2484.622251][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2484.622515][ C1] ? __fget_light+0x54/0x1e0 [ 2484.622753][ C1] ksys_read+0x17a/0x1e0 [ 2484.622969][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2484.623213][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2484.623517][ C1] do_syscall_64+0xc9/0x1e0 [ 2484.623748][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2484.624048][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2484.624276][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2484.625240][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2484.625659][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2484.626055][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2484.626455][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2484.626852][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2484.627257][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2484.627657][ C1] [ 2484.627816][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 122s! [swapper/2:0] [ 2484.628254][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2484.629516][ C2] irq event stamp: 44114564 [ 2484.629745][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2484.630283][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2484.630797][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2484.631277][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2484.631748][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2484.632206][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2484.632823][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2484.633149][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2484.634122][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2484.634431][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2484.634830][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2484.635228][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2484.635629][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2484.636028][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2484.636427][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2484.636874][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2484.637215][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2484.637618][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2484.638020][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2484.638419][ C2] PKRU: 55555554 [ 2484.638600][ C2] Call Trace: [ 2484.638773][ C2] [ 2484.638922][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2484.639185][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2484.639430][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2484.639706][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2484.639978][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2484.640268][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2484.640533][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2484.640840][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2484.641103][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2484.641366][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2484.641679][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2484.641973][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2484.642290][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2484.642582][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2484.642875][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2484.643166][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2484.643478][ C2] ? get_stack_info+0x36/0xc0 [ 2484.643719][ C2] ? lock_acquire+0x1c1/0x220 [ 2484.643959][ C2] ? lock_release+0x1d5/0x250 [ 2484.644200][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2484.644449][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2484.644721][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2484.645007][ C2] ? lock_acquire+0x1c1/0x220 [ 2484.645244][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2484.645486][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2484.645746][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2484.645982][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2484.646230][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2484.646490][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2484.646766][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2484.647042][ C2] ip_local_deliver+0x19d/0x480 [ 2484.647297][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2484.647568][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2484.647833][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2484.648183][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2484.648438][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2484.648759][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2484.649021][ C2] ip_rcv+0x564/0x740 [ 2484.649226][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2484.649458][ C2] ? set_track_prepare+0x8a/0xd0 [ 2484.649711][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2484.649987][ C2] ? start_secondary+0x21c/0x2b0 [ 2484.650240][ C2] ? skb_clone+0x10b/0x330 [ 2484.650466][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2484.650787][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2484.651096][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2484.651380][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2484.651676][ C2] ? __tcf_classify+0x329/0x7d0 [ 2484.651927][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2484.652158][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2484.652461][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2484.652748][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2484.653073][ C2] ? lock_acquire+0x1c1/0x220 [ 2484.653311][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2484.653610][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2484.653896][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2484.654212][ C2] ? __copy_skb_header+0xaf/0x490 [ 2484.654471][ C2] ? __skb_clone+0x57a/0x760 [ 2484.654708][ C2] netif_receive_skb+0x55/0x280 [ 2484.654957][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2484.655275][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2484.655608][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2484.655907][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2484.656186][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2484.656475][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2484.656788][ C2] ? get_stack_info+0x36/0xc0 [ 2484.657031][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2484.657301][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2484.657620][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2484.657895][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2484.658173][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2484.658490][ C2] ? kernel_text_address+0x17/0xe0 [ 2484.658750][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2484.659065][ C2] ? arch_stack_walk+0x8c/0x100 [ 2484.659315][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2484.659578][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2484.659864][ C2] ? lock_acquire+0x1c1/0x220 [ 2484.660104][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2484.660389][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2484.660695][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2484.660972][ C2] ? get_stack_info+0x36/0xc0 [ 2484.661216][ C2] __tcf_classify+0x329/0x7d0 [ 2484.661455][ C2] tcf_classify+0x283/0x930 [ 2484.661690][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2484.661947][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2484.662263][ C2] tc_run+0x2e4/0x5d0 [ 2484.662469][ C2] ? __pfx_tc_run+0x10/0x10 [ 2484.662701][ C2] ? lock_acquire+0x1c1/0x220 [ 2484.662940][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2484.663203][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2484.663456][ C2] ? lock_acquire+0x1c1/0x220 [ 2484.663694][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2484.663959][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2484.664265][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2484.664537][ C2] ? neigh_hh_output+0x348/0x590 [ 2484.664790][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2484.665054][ C2] ip_finish_output2+0x786/0x18e0 [ 2484.665313][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2484.665653][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2484.665930][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2484.666185][ C2] ? __ip_finish_output+0x10f/0x770 [ 2484.666449][ C2] ip_output+0x16b/0x4f0 [ 2484.666665][ C2] ? __pfx_ip_output+0x10/0x10 [ 2484.666909][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2484.667192][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2484.667504][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2484.667782][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2484.668034][ C2] ? __alloc_skb+0xd4/0x280 [ 2484.668265][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2484.668534][ C2] ? tcp_fragment+0x168/0x1040 [ 2484.668780][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2484.669034][ C2] ? ip_local_out+0x114/0x3b0 [ 2484.669276][ C2] __ip_queue_xmit+0x672/0x1910 [ 2484.669525][ C2] ? __skb_clone+0x57a/0x760 [ 2484.669759][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2484.670029][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2484.670311][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2484.670557][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2484.670807][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2484.671107][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2484.671428][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2484.671671][ C2] tcp_send_loss_probe+0x348/0x830 [ 2484.671932][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2484.672200][ C2] tcp_write_timer+0x82/0x1d0 [ 2484.672441][ C2] call_timer_fn+0x173/0x430 [ 2484.672680][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2484.672942][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2484.673204][ C2] __run_timers.part.0+0x52d/0x890 [ 2484.673467][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2484.673737][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2484.674023][ C2] ? lock_acquire+0x1c1/0x220 [ 2484.674261][ C2] ? clockevents_program_event+0xf6/0x300 [ 2484.674558][ C2] ? lock_release+0x1d5/0x250 [ 2484.674799][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2484.675063][ C2] ? ktime_get+0xb3/0x190 [ 2484.675284][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2484.675582][ C2] run_timer_softirq+0x72/0x100 [ 2484.675831][ C2] __do_softirq+0x1b9/0x7ff [ 2484.676062][ C2] irq_exit_rcu+0x98/0xc0 [ 2484.676286][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2484.676570][ C2] [ 2484.676722][ C2] [ 2484.676872][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2484.677186][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2484.677445][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2484.678417][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2484.678726][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2484.679125][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2484.679524][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2484.679923][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2484.680325][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2484.680727][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2484.681015][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2484.681278][ C2] default_idle_call+0x69/0xa0 [ 2484.681522][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2484.681774][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2484.682054][ C2] ? lock_release+0x1d5/0x250 [ 2484.682293][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2484.682569][ C2] do_idle+0xfb/0x160 [ 2484.682774][ C2] cpu_startup_entry+0x55/0x60 [ 2484.683021][ C2] start_secondary+0x21c/0x2b0 [ 2484.683266][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2484.683536][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2484.683848][ C2] [ 2512.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 149s! [perl:4135] [ 2512.569706][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2512.570970][ C1] irq event stamp: 209232 [ 2512.571188][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2512.571733][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2512.572216][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2512.572685][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2512.573152][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2512.573600][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2512.574217][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2512.574542][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2512.575514][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2512.575824][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2512.576224][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2512.576622][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2512.577032][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2512.577433][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2512.577832][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2512.578279][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2512.578609][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2512.579013][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2512.579417][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2512.579816][ C1] PKRU: 55555554 [ 2512.579998][ C1] Call Trace: [ 2512.580173][ C1] [ 2512.580322][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2512.580585][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2512.580830][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2512.581107][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2512.581385][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2512.581679][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2512.581945][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2512.582254][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2512.582521][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2512.582832][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2512.583128][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2512.583444][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2512.583734][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2512.584031][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2512.584323][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2512.584634][ C1] ? get_stack_info+0x36/0xc0 [ 2512.584877][ C1] ? lock_acquire+0x1c1/0x220 [ 2512.585118][ C1] ? lock_release+0x1d5/0x250 [ 2512.585358][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2512.585608][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2512.585880][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2512.586166][ C1] ? lock_acquire+0x1c1/0x220 [ 2512.586403][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2512.586646][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2512.586906][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2512.587151][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2512.587399][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2512.587657][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2512.587933][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2512.588211][ C1] ip_local_deliver+0x19d/0x480 [ 2512.588459][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2512.588730][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2512.588994][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2512.589346][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2512.589602][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2512.589924][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2512.590189][ C1] ip_rcv+0x564/0x740 [ 2512.590396][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2512.590628][ C1] ? set_track_prepare+0x8a/0xd0 [ 2512.590883][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2512.591161][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2512.591435][ C1] ? skb_clone+0x10b/0x330 [ 2512.591665][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2512.591984][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2512.592290][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2512.592576][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2512.592869][ C1] ? __tcf_classify+0x329/0x7d0 [ 2512.593120][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2512.593351][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2512.593649][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2512.593936][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2512.594265][ C1] ? lock_acquire+0x1c1/0x220 [ 2512.594504][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2512.594800][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2512.595087][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2512.595410][ C1] ? __copy_skb_header+0xaf/0x490 [ 2512.595667][ C1] ? __skb_clone+0x57a/0x760 [ 2512.595900][ C1] netif_receive_skb+0x55/0x280 [ 2512.596149][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2512.596463][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2512.596796][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2512.597103][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2512.597378][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2512.597666][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2512.597979][ C1] ? hlock_class+0x4e/0x130 [ 2512.598214][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2512.598489][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2512.598765][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2512.599030][ C1] ? hlock_class+0x4e/0x130 [ 2512.599260][ C1] ? mark_lock+0x38/0x3e0 [ 2512.599482][ C1] ? stack_access_ok+0xda/0x1f0 [ 2512.599730][ C1] ? __lock_acquire+0xb67/0x1610 [ 2512.599984][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2512.600263][ C1] ? get_stack_info+0x36/0xc0 [ 2512.600503][ C1] ? stack_access_ok+0xda/0x1f0 [ 2512.600748][ C1] ? get_reg+0x119/0x190 [ 2512.600967][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2512.601236][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2512.601547][ C1] __tcf_classify+0x329/0x7d0 [ 2512.601789][ C1] tcf_classify+0x283/0x930 [ 2512.602022][ C1] ? arch_stack_walk+0xa2/0x100 [ 2512.602272][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2512.602529][ C1] ? get_stack_info+0x36/0xc0 [ 2512.602772][ C1] tc_run+0x2e4/0x5d0 [ 2512.602979][ C1] ? __pfx_tc_run+0x10/0x10 [ 2512.603224][ C1] ? lock_acquire+0x1c1/0x220 [ 2512.603462][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2512.603721][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2512.603976][ C1] ? lock_acquire+0x1c1/0x220 [ 2512.604216][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2512.604480][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2512.604787][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2512.605059][ C1] ? neigh_hh_output+0x348/0x590 [ 2512.605312][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2512.605576][ C1] ip_finish_output2+0x786/0x18e0 [ 2512.605832][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2512.606113][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2512.606451][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2512.606726][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2512.606988][ C1] ? __ip_finish_output+0x10f/0x770 [ 2512.607253][ C1] ip_output+0x16b/0x4f0 [ 2512.607470][ C1] ? run_timer_softirq+0x72/0x100 [ 2512.607726][ C1] ? __pfx_ip_output+0x10/0x10 [ 2512.607968][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2512.608257][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2512.608508][ C1] ? ip_local_out+0x114/0x3b0 [ 2512.608747][ C1] __ip_queue_xmit+0x672/0x1910 [ 2512.608994][ C1] ? __create_object+0x5e/0xb0 [ 2512.609241][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2512.609509][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2512.609792][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2512.610065][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2512.610347][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2512.610620][ C1] tcp_delack_timer+0x84/0x240 [ 2512.610863][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2512.611137][ C1] call_timer_fn+0x173/0x430 [ 2512.611372][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2512.611633][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2512.611894][ C1] __run_timers.part.0+0x52d/0x890 [ 2512.612156][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2512.612431][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2512.612715][ C1] ? lock_acquire+0x1c1/0x220 [ 2512.612955][ C1] ? clockevents_program_event+0xf6/0x300 [ 2512.613246][ C1] ? lock_release+0x1d5/0x250 [ 2512.613486][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2512.613750][ C1] ? ktime_get+0xb3/0x190 [ 2512.613972][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2512.614267][ C1] run_timer_softirq+0x72/0x100 [ 2512.614516][ C1] __do_softirq+0x1b9/0x7ff [ 2512.614751][ C1] irq_exit_rcu+0x98/0xc0 [ 2512.614971][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2512.615264][ C1] [ 2512.615414][ C1] [ 2512.615563][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2512.615868][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2512.616193][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2512.617171][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2512.617482][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2512.617880][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2512.618280][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2512.618679][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2512.619076][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2512.619478][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2512.619776][ C1] pipe_read+0xa16/0xdf0 [ 2512.619998][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2512.620279][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2512.620522][ C1] ? iterate_tty_write+0x299/0x540 [ 2512.620784][ C1] ? lock_release+0x1d5/0x250 [ 2512.621022][ C1] vfs_read+0x911/0xc00 [ 2512.621241][ C1] ? lock_acquire+0x1c1/0x220 [ 2512.621478][ C1] ? __might_fault+0xc6/0x180 [ 2512.621719][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2512.621960][ C1] ? __might_fault+0xc6/0x180 [ 2512.622201][ C1] ? lock_release+0x1d5/0x250 [ 2512.622440][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2512.622705][ C1] ? __fget_light+0x54/0x1e0 [ 2512.622940][ C1] ksys_read+0x17a/0x1e0 [ 2512.623160][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2512.623407][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2512.623711][ C1] do_syscall_64+0xc9/0x1e0 [ 2512.623946][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2512.624245][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2512.624474][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2512.625444][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2512.625867][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2512.626266][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2512.626664][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2512.627070][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2512.627471][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2512.627873][ C1] [ 2512.628031][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 149s! [swapper/2:0] [ 2512.628460][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2512.629726][ C2] irq event stamp: 44114564 [ 2512.629955][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2512.630496][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2512.631013][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2512.631492][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2512.631969][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2512.632432][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2512.633051][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2512.633392][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2512.634375][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2512.634701][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2512.635103][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2512.635506][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2512.635909][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2512.636312][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2512.636713][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2512.637172][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2512.637507][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2512.637913][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2512.638319][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2512.638731][ C2] PKRU: 55555554 [ 2512.638914][ C2] Call Trace: [ 2512.639087][ C2] [ 2512.639237][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2512.639507][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2512.639754][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2512.640033][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2512.640312][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2512.640602][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2512.640868][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2512.641181][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2512.641445][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2512.641713][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2512.642026][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2512.642327][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2512.642642][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2512.642934][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2512.643233][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2512.643523][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2512.643838][ C2] ? get_stack_info+0x36/0xc0 [ 2512.644085][ C2] ? lock_acquire+0x1c1/0x220 [ 2512.644326][ C2] ? lock_release+0x1d5/0x250 [ 2512.644567][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2512.644818][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2512.645091][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2512.645381][ C2] ? lock_acquire+0x1c1/0x220 [ 2512.645621][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2512.645861][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2512.646123][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2512.646360][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2512.646610][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2512.646869][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2512.647161][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2512.647439][ C2] ip_local_deliver+0x19d/0x480 [ 2512.647688][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2512.647962][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2512.648228][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2512.648577][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2512.648832][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2512.649155][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2512.649419][ C2] ip_rcv+0x564/0x740 [ 2512.649624][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2512.649857][ C2] ? set_track_prepare+0x8a/0xd0 [ 2512.650116][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2512.650393][ C2] ? start_secondary+0x21c/0x2b0 [ 2512.650647][ C2] ? skb_clone+0x10b/0x330 [ 2512.650875][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2512.651196][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2512.651504][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2512.651787][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2512.652082][ C2] ? __tcf_classify+0x329/0x7d0 [ 2512.652332][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2512.652565][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2512.652866][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2512.653156][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2512.653484][ C2] ? lock_acquire+0x1c1/0x220 [ 2512.653728][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2512.654028][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2512.654318][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2512.654637][ C2] ? __copy_skb_header+0xaf/0x490 [ 2512.654895][ C2] ? __skb_clone+0x57a/0x760 [ 2512.655132][ C2] netif_receive_skb+0x55/0x280 [ 2512.655381][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2512.655697][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2512.656032][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2512.656334][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2512.656612][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2512.656902][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2512.657225][ C2] ? get_stack_info+0x36/0xc0 [ 2512.657472][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2512.657738][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2512.658059][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2512.658336][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2512.658616][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2512.658932][ C2] ? kernel_text_address+0x17/0xe0 [ 2512.659197][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2512.659511][ C2] ? arch_stack_walk+0x8c/0x100 [ 2512.659761][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2512.660028][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2512.660317][ C2] ? lock_acquire+0x1c1/0x220 [ 2512.660558][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2512.660840][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2512.661147][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2512.661426][ C2] ? get_stack_info+0x36/0xc0 [ 2512.661677][ C2] __tcf_classify+0x329/0x7d0 [ 2512.661920][ C2] tcf_classify+0x283/0x930 [ 2512.662153][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2512.662410][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2512.662724][ C2] tc_run+0x2e4/0x5d0 [ 2512.662931][ C2] ? __pfx_tc_run+0x10/0x10 [ 2512.663165][ C2] ? lock_acquire+0x1c1/0x220 [ 2512.663405][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2512.663669][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2512.663924][ C2] ? lock_acquire+0x1c1/0x220 [ 2512.664162][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2512.664430][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2512.664734][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2512.665010][ C2] ? neigh_hh_output+0x348/0x590 [ 2512.665265][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2512.665534][ C2] ip_finish_output2+0x786/0x18e0 [ 2512.665793][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2512.666139][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2512.666417][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2512.666674][ C2] ? __ip_finish_output+0x10f/0x770 [ 2512.666946][ C2] ip_output+0x16b/0x4f0 [ 2512.667166][ C2] ? __pfx_ip_output+0x10/0x10 [ 2512.667411][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2512.667693][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2512.668009][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2512.668290][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2512.668553][ C2] ? __alloc_skb+0xd4/0x280 [ 2512.668783][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2512.669056][ C2] ? tcp_fragment+0x168/0x1040 [ 2512.669299][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2512.669553][ C2] ? ip_local_out+0x114/0x3b0 [ 2512.669794][ C2] __ip_queue_xmit+0x672/0x1910 [ 2512.670045][ C2] ? __skb_clone+0x57a/0x760 [ 2512.670284][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2512.670552][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2512.670833][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2512.671081][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2512.671333][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2512.671635][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2512.671958][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2512.672202][ C2] tcp_send_loss_probe+0x348/0x830 [ 2512.672468][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2512.672742][ C2] tcp_write_timer+0x82/0x1d0 [ 2512.672982][ C2] call_timer_fn+0x173/0x430 [ 2512.673223][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2512.673487][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2512.673749][ C2] __run_timers.part.0+0x52d/0x890 [ 2512.674011][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2512.674282][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2512.674571][ C2] ? lock_acquire+0x1c1/0x220 [ 2512.674812][ C2] ? clockevents_program_event+0xf6/0x300 [ 2512.675102][ C2] ? lock_release+0x1d5/0x250 [ 2512.675344][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2512.675616][ C2] ? ktime_get+0xb3/0x190 [ 2512.675837][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2512.676138][ C2] run_timer_softirq+0x72/0x100 [ 2512.676389][ C2] __do_softirq+0x1b9/0x7ff [ 2512.676622][ C2] irq_exit_rcu+0x98/0xc0 [ 2512.676844][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2512.677140][ C2] [ 2512.677295][ C2] [ 2512.677444][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2512.677752][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2512.678012][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2512.678985][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2512.679298][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2512.679699][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2512.680104][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2512.680506][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2512.680908][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2512.681311][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2512.681603][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2512.681866][ C2] default_idle_call+0x69/0xa0 [ 2512.682111][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2512.682364][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2512.682647][ C2] ? lock_release+0x1d5/0x250 [ 2512.682887][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2512.683166][ C2] do_idle+0xfb/0x160 [ 2512.683371][ C2] cpu_startup_entry+0x55/0x60 [ 2512.683616][ C2] start_secondary+0x21c/0x2b0 [ 2512.683861][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2512.684134][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2512.684447][ C2] [ 2537.019105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2537.019493][ C1] rcu: 1-....: (182478 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=44721 [ 2537.020050][ C1] rcu: (t=182132 jiffies g=1882453 q=671 ncpus=4) [ 2537.020389][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2537.020840][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2537.021459][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 2537.021759][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 2537.022740][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 2537.023057][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2537.023457][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2537.023857][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2537.024270][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2537.024678][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2537.025078][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2537.025537][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2537.025871][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2537.026275][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2537.026682][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2537.027095][ C1] PKRU: 55555554 [ 2537.027279][ C1] Call Trace: [ 2537.027459][ C1] [ 2537.027610][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2537.027885][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2537.028140][ C1] ? check_cpu_stall+0x284/0x500 [ 2537.028399][ C1] ? rcu_pending+0x92/0x360 [ 2537.028639][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2537.028910][ C1] ? update_process_times+0xb9/0x110 [ 2537.029182][ C1] ? tick_sched_handle+0x67/0x130 [ 2537.029447][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2537.029732][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2537.029973][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2537.030287][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2537.030558][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2537.030849][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2537.031116][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2537.031423][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2537.031686][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2537.031997][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2537.032294][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2537.032611][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2537.032902][ C1] ? kasan_check_range+0x12/0x1c0 [ 2537.033160][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2537.033441][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2537.033753][ C1] ? get_stack_info+0x36/0xc0 [ 2537.033996][ C1] ? lock_acquire+0x1c1/0x220 [ 2537.034236][ C1] ? lock_release+0x1d5/0x250 [ 2537.034477][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2537.034726][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2537.034997][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2537.035287][ C1] ? lock_acquire+0x1c1/0x220 [ 2537.035529][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2537.035771][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2537.036032][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2537.036276][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2537.036525][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2537.036790][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2537.037083][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2537.037362][ C1] ip_local_deliver+0x19d/0x480 [ 2537.037624][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2537.037903][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2537.038172][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2537.038536][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2537.038793][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2537.039115][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2537.039385][ C1] ip_rcv+0x564/0x740 [ 2537.039596][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2537.039828][ C1] ? set_track_prepare+0x8a/0xd0 [ 2537.040083][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2537.040361][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2537.040640][ C1] ? skb_clone+0x10b/0x330 [ 2537.040877][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2537.041199][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2537.041504][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2537.041797][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2537.042097][ C1] ? __tcf_classify+0x329/0x7d0 [ 2537.042347][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2537.042580][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2537.042881][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2537.043174][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2537.043504][ C1] ? lock_acquire+0x1c1/0x220 [ 2537.043743][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2537.044037][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2537.044342][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2537.044662][ C1] ? __copy_skb_header+0xaf/0x490 [ 2537.044926][ C1] ? __skb_clone+0x57a/0x760 [ 2537.045159][ C1] netif_receive_skb+0x55/0x280 [ 2537.045416][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2537.045731][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2537.046063][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2537.046365][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2537.046641][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2537.046942][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2537.047253][ C1] ? hlock_class+0x4e/0x130 [ 2537.047495][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2537.047769][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2537.048051][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2537.048316][ C1] ? hlock_class+0x4e/0x130 [ 2537.048546][ C1] ? mark_lock+0x38/0x3e0 [ 2537.048775][ C1] ? stack_access_ok+0xda/0x1f0 [ 2537.049033][ C1] ? __lock_acquire+0xb67/0x1610 [ 2537.049288][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2537.049566][ C1] ? get_stack_info+0x36/0xc0 [ 2537.049806][ C1] ? stack_access_ok+0xda/0x1f0 [ 2537.050052][ C1] ? get_reg+0x119/0x190 [ 2537.050269][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2537.050536][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2537.050847][ C1] __tcf_classify+0x329/0x7d0 [ 2537.051090][ C1] tcf_classify+0x283/0x930 [ 2537.051321][ C1] ? arch_stack_walk+0xa2/0x100 [ 2537.051570][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2537.051825][ C1] ? get_stack_info+0x36/0xc0 [ 2537.052066][ C1] tc_run+0x2e4/0x5d0 [ 2537.052272][ C1] ? __pfx_tc_run+0x10/0x10 [ 2537.052504][ C1] ? lock_acquire+0x1c1/0x220 [ 2537.052742][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2537.053003][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2537.053256][ C1] ? lock_acquire+0x1c1/0x220 [ 2537.053494][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2537.053759][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2537.054066][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2537.054338][ C1] ? neigh_hh_output+0x348/0x590 [ 2537.054590][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2537.054862][ C1] ip_finish_output2+0x786/0x18e0 [ 2537.055119][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2537.055402][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2537.055741][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2537.056017][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2537.056279][ C1] ? __ip_finish_output+0x10f/0x770 [ 2537.056544][ C1] ip_output+0x16b/0x4f0 [ 2537.056765][ C1] ? run_timer_softirq+0x72/0x100 [ 2537.057032][ C1] ? __pfx_ip_output+0x10/0x10 [ 2537.057275][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2537.057573][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2537.057830][ C1] ? ip_local_out+0x114/0x3b0 [ 2537.058071][ C1] __ip_queue_xmit+0x672/0x1910 [ 2537.058334][ C1] ? __create_object+0x5e/0xb0 [ 2537.058579][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2537.058851][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2537.059144][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2537.059415][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2537.059699][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2537.059974][ C1] tcp_delack_timer+0x84/0x240 [ 2537.060218][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2537.060493][ C1] call_timer_fn+0x173/0x430 [ 2537.060729][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2537.060998][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2537.061267][ C1] __run_timers.part.0+0x52d/0x890 [ 2537.061528][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2537.061804][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2537.062095][ C1] ? lock_acquire+0x1c1/0x220 [ 2537.062343][ C1] ? clockevents_program_event+0xf6/0x300 [ 2537.062639][ C1] ? lock_release+0x1d5/0x250 [ 2537.062878][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2537.063145][ C1] ? ktime_get+0xb3/0x190 [ 2537.063376][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2537.063673][ C1] run_timer_softirq+0x72/0x100 [ 2537.063921][ C1] __do_softirq+0x1b9/0x7ff [ 2537.064157][ C1] irq_exit_rcu+0x98/0xc0 [ 2537.064386][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2537.064681][ C1] [ 2537.064830][ C1] [ 2537.064983][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2537.065287][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2537.065620][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2537.066607][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2537.066927][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2537.067332][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2537.067732][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2537.068133][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2537.068533][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2537.068946][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2537.069247][ C1] pipe_read+0xa16/0xdf0 [ 2537.069470][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2537.069750][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2537.070006][ C1] ? iterate_tty_write+0x299/0x540 [ 2537.070269][ C1] ? lock_release+0x1d5/0x250 [ 2537.070509][ C1] vfs_read+0x911/0xc00 [ 2537.070730][ C1] ? lock_acquire+0x1c1/0x220 [ 2537.070969][ C1] ? __might_fault+0xc6/0x180 [ 2537.071216][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2537.071455][ C1] ? __might_fault+0xc6/0x180 [ 2537.071696][ C1] ? lock_release+0x1d5/0x250 [ 2537.071937][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2537.072204][ C1] ? __fget_light+0x54/0x1e0 [ 2537.072448][ C1] ksys_read+0x17a/0x1e0 [ 2537.072676][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2537.072925][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2537.073228][ C1] do_syscall_64+0xc9/0x1e0 [ 2537.073464][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2537.073765][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2537.073993][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2537.074966][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2537.075391][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2537.075791][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2537.076190][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2537.076592][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2537.077007][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2537.077410][ C1] [ 2537.077570][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2537.077849][ C2] NMI backtrace for cpu 2 [ 2537.077856][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2537.077863][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2537.077867][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2537.077876][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2537.077882][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2537.077887][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2537.077890][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2537.077894][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2537.077897][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2537.077901][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2537.077904][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2537.077909][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2537.077914][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2537.077918][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2537.077920][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2537.077924][ C2] PKRU: 55555554 [ 2537.077926][ C2] Call Trace: [ 2537.077929][ C2] [ 2537.077932][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2537.077940][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2537.077947][ C2] ? nmi_handle+0x153/0x420 [ 2537.077952][ C2] ? default_do_nmi+0x41/0x100 [ 2537.077955][ C2] ? exc_nmi+0xf3/0x120 [ 2537.077958][ C2] ? end_repeat_nmi+0xf/0x60 [ 2537.077963][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2537.077967][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2537.077970][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2537.077973][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2537.077976][ C2] [ 2537.077977][ C2] [ 2537.077978][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2537.077980][ C2] ? get_stack_info+0x36/0xc0 [ 2537.077984][ C2] ? lock_acquire+0x1c1/0x220 [ 2537.077988][ C2] ? lock_release+0x1d5/0x250 [ 2537.077991][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2537.077995][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2537.077998][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2537.078001][ C2] ? lock_acquire+0x1c1/0x220 [ 2537.078003][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2537.078007][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2537.078010][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2537.078017][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2537.078019][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2537.078024][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2537.078029][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2537.078032][ C2] ip_local_deliver+0x19d/0x480 [ 2537.078034][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2537.078036][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2537.078039][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2537.078045][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2537.078049][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2537.078052][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2537.078061][ C2] ip_rcv+0x564/0x740 [ 2537.078063][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2537.078066][ C2] ? set_track_prepare+0x8a/0xd0 [ 2537.078070][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2537.078073][ C2] ? start_secondary+0x21c/0x2b0 [ 2537.078077][ C2] ? skb_clone+0x10b/0x330 [ 2537.078081][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2537.078087][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2537.078092][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2537.078096][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2537.078104][ C2] ? __tcf_classify+0x329/0x7d0 [ 2537.078108][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2537.078110][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2537.078114][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2537.078117][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2537.078121][ C2] ? lock_acquire+0x1c1/0x220 [ 2537.078123][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2537.078127][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2537.078131][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2537.078135][ C2] ? __copy_skb_header+0xaf/0x490 [ 2537.078139][ C2] ? __skb_clone+0x57a/0x760 [ 2537.078142][ C2] netif_receive_skb+0x55/0x280 [ 2537.078145][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2537.078152][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2537.078159][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2537.078166][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2537.078170][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2537.078180][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2537.078188][ C2] ? get_stack_info+0x36/0xc0 [ 2537.078192][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2537.078195][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2537.078201][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2537.078203][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2537.078206][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2537.078209][ C2] ? kernel_text_address+0x17/0xe0 [ 2537.078213][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2537.078218][ C2] ? arch_stack_walk+0x8c/0x100 [ 2537.078222][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2537.078225][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2537.078228][ C2] ? lock_acquire+0x1c1/0x220 [ 2537.078231][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2537.078236][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2537.078240][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2537.078242][ C2] ? get_stack_info+0x36/0xc0 [ 2537.078247][ C2] __tcf_classify+0x329/0x7d0 [ 2537.078252][ C2] tcf_classify+0x283/0x930 [ 2537.078257][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2537.078260][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2537.078264][ C2] tc_run+0x2e4/0x5d0 [ 2537.078268][ C2] ? __pfx_tc_run+0x10/0x10 [ 2537.078271][ C2] ? lock_acquire+0x1c1/0x220 [ 2537.078273][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2537.078278][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2537.078282][ C2] ? lock_acquire+0x1c1/0x220 [ 2537.078284][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2537.078287][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2537.078291][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2537.078293][ C2] ? neigh_hh_output+0x348/0x590 [ 2537.078297][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2537.078300][ C2] ip_finish_output2+0x786/0x18e0 [ 2537.078304][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2537.078312][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2537.078314][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2537.078318][ C2] ? __ip_finish_output+0x10f/0x770 [ 2537.078321][ C2] ip_output+0x16b/0x4f0 [ 2537.078324][ C2] ? __pfx_ip_output+0x10/0x10 [ 2537.078326][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2537.078329][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2537.078332][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2537.078336][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2537.078338][ C2] ? __alloc_skb+0xd4/0x280 [ 2537.078340][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2537.078345][ C2] ? tcp_fragment+0x168/0x1040 [ 2537.078349][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2537.078351][ C2] ? ip_local_out+0x114/0x3b0 [ 2537.078355][ C2] __ip_queue_xmit+0x672/0x1910 [ 2537.078358][ C2] ? __skb_clone+0x57a/0x760 [ 2537.078361][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2537.078366][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2537.078369][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2537.078374][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2537.078379][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2537.078384][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2537.078387][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2537.078390][ C2] tcp_send_loss_probe+0x348/0x830 [ 2537.078394][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2537.078397][ C2] tcp_write_timer+0x82/0x1d0 [ 2537.078400][ C2] call_timer_fn+0x173/0x430 [ 2537.078405][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2537.078409][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2537.078413][ C2] __run_timers.part.0+0x52d/0x890 [ 2537.078416][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2537.078421][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2537.078423][ C2] ? lock_acquire+0x1c1/0x220 [ 2537.078426][ C2] ? clockevents_program_event+0xf6/0x300 [ 2537.078430][ C2] ? lock_release+0x1d5/0x250 [ 2537.078432][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2537.078435][ C2] ? ktime_get+0xb3/0x190 [ 2537.078439][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2537.078443][ C2] run_timer_softirq+0x72/0x100 [ 2537.078446][ C2] __do_softirq+0x1b9/0x7ff [ 2537.078451][ C2] irq_exit_rcu+0x98/0xc0 [ 2537.078454][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2537.078457][ C2] [ 2537.078458][ C2] [ 2537.078459][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2537.078462][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2537.078466][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2537.078468][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2537.078471][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2537.078473][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2537.078474][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2537.078475][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2537.078477][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2537.078480][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2537.078482][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2537.078487][ C2] default_idle_call+0x69/0xa0 [ 2537.078490][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2537.078493][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2537.078497][ C2] ? lock_release+0x1d5/0x250 [ 2537.078499][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2537.078503][ C2] do_idle+0xfb/0x160 [ 2537.078506][ C2] cpu_startup_entry+0x55/0x60 [ 2537.078508][ C2] start_secondary+0x21c/0x2b0 [ 2537.078512][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2537.078516][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2537.078522][ C2] [ 2564.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 197s! [perl:4135] [ 2564.569710][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2564.570976][ C1] irq event stamp: 209232 [ 2564.571195][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2564.571727][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2564.572207][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2564.572676][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2564.573142][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2564.573595][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2564.574208][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2564.574534][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2564.575506][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2564.575814][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2564.576220][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2564.576618][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2564.577021][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2564.577423][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2564.577822][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2564.578268][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2564.578601][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2564.579001][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2564.579403][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2564.579801][ C1] PKRU: 55555554 [ 2564.579983][ C1] Call Trace: [ 2564.580155][ C1] [ 2564.580306][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2564.580570][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2564.580816][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2564.581096][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2564.581369][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2564.581659][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2564.581925][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2564.582235][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2564.582497][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2564.582808][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2564.583105][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2564.583420][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2564.583709][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2564.584004][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2564.584293][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2564.584604][ C1] ? get_stack_info+0x36/0xc0 [ 2564.584845][ C1] ? lock_acquire+0x1c1/0x220 [ 2564.585087][ C1] ? lock_release+0x1d5/0x250 [ 2564.585328][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2564.585578][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2564.585851][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2564.586134][ C1] ? lock_acquire+0x1c1/0x220 [ 2564.586374][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2564.586617][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2564.586883][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2564.587118][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2564.587363][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2564.587622][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2564.587901][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2564.588178][ C1] ip_local_deliver+0x19d/0x480 [ 2564.588425][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2564.588697][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2564.588960][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2564.589307][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2564.589561][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2564.589881][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2564.590145][ C1] ip_rcv+0x564/0x740 [ 2564.590354][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2564.590584][ C1] ? set_track_prepare+0x8a/0xd0 [ 2564.590837][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2564.591116][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2564.591389][ C1] ? skb_clone+0x10b/0x330 [ 2564.591615][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2564.591935][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2564.592244][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2564.592527][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2564.592821][ C1] ? __tcf_classify+0x329/0x7d0 [ 2564.593076][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2564.593306][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2564.593606][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2564.593891][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2564.594216][ C1] ? lock_acquire+0x1c1/0x220 [ 2564.594453][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2564.594751][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2564.595037][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2564.595352][ C1] ? __copy_skb_header+0xaf/0x490 [ 2564.595611][ C1] ? __skb_clone+0x57a/0x760 [ 2564.595847][ C1] netif_receive_skb+0x55/0x280 [ 2564.596096][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2564.596409][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2564.596747][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2564.597046][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2564.597321][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2564.597608][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2564.597925][ C1] ? hlock_class+0x4e/0x130 [ 2564.598160][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2564.598436][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2564.598712][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2564.598975][ C1] ? hlock_class+0x4e/0x130 [ 2564.599206][ C1] ? mark_lock+0x38/0x3e0 [ 2564.599425][ C1] ? stack_access_ok+0xda/0x1f0 [ 2564.599675][ C1] ? __lock_acquire+0xb67/0x1610 [ 2564.599927][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2564.600204][ C1] ? get_stack_info+0x36/0xc0 [ 2564.600443][ C1] ? stack_access_ok+0xda/0x1f0 [ 2564.600690][ C1] ? get_reg+0x119/0x190 [ 2564.600906][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2564.601175][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2564.601483][ C1] __tcf_classify+0x329/0x7d0 [ 2564.601723][ C1] tcf_classify+0x283/0x930 [ 2564.601956][ C1] ? arch_stack_walk+0xa2/0x100 [ 2564.602205][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2564.602462][ C1] ? get_stack_info+0x36/0xc0 [ 2564.602703][ C1] tc_run+0x2e4/0x5d0 [ 2564.602910][ C1] ? __pfx_tc_run+0x10/0x10 [ 2564.603140][ C1] ? lock_acquire+0x1c1/0x220 [ 2564.603379][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2564.603639][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2564.603893][ C1] ? lock_acquire+0x1c1/0x220 [ 2564.604133][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2564.604400][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2564.604710][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2564.604983][ C1] ? neigh_hh_output+0x348/0x590 [ 2564.605249][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2564.605515][ C1] ip_finish_output2+0x786/0x18e0 [ 2564.605772][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2564.606050][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2564.606388][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2564.606666][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2564.606928][ C1] ? __ip_finish_output+0x10f/0x770 [ 2564.607192][ C1] ip_output+0x16b/0x4f0 [ 2564.607407][ C1] ? run_timer_softirq+0x72/0x100 [ 2564.607665][ C1] ? __pfx_ip_output+0x10/0x10 [ 2564.607910][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2564.608198][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2564.608449][ C1] ? ip_local_out+0x114/0x3b0 [ 2564.608688][ C1] __ip_queue_xmit+0x672/0x1910 [ 2564.608936][ C1] ? __create_object+0x5e/0xb0 [ 2564.609181][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2564.609448][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2564.609729][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2564.610003][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2564.610284][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2564.610555][ C1] tcp_delack_timer+0x84/0x240 [ 2564.610799][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2564.611069][ C1] call_timer_fn+0x173/0x430 [ 2564.611308][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2564.611570][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2564.611831][ C1] __run_timers.part.0+0x52d/0x890 [ 2564.612090][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2564.612365][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2564.612650][ C1] ? lock_acquire+0x1c1/0x220 [ 2564.612890][ C1] ? clockevents_program_event+0xf6/0x300 [ 2564.613181][ C1] ? lock_release+0x1d5/0x250 [ 2564.613420][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2564.613684][ C1] ? ktime_get+0xb3/0x190 [ 2564.613905][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2564.614202][ C1] run_timer_softirq+0x72/0x100 [ 2564.614450][ C1] __do_softirq+0x1b9/0x7ff [ 2564.614683][ C1] irq_exit_rcu+0x98/0xc0 [ 2564.614903][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2564.615190][ C1] [ 2564.615342][ C1] [ 2564.615491][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2564.615797][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2564.616122][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2564.617101][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2564.617410][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2564.617808][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2564.618208][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2564.618606][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2564.619004][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2564.619403][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2564.619701][ C1] pipe_read+0xa16/0xdf0 [ 2564.619922][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2564.620204][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2564.620446][ C1] ? iterate_tty_write+0x299/0x540 [ 2564.620708][ C1] ? lock_release+0x1d5/0x250 [ 2564.620947][ C1] vfs_read+0x911/0xc00 [ 2564.621162][ C1] ? lock_acquire+0x1c1/0x220 [ 2564.621399][ C1] ? __might_fault+0xc6/0x180 [ 2564.621641][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2564.621881][ C1] ? __might_fault+0xc6/0x180 [ 2564.622120][ C1] ? lock_release+0x1d5/0x250 [ 2564.622358][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2564.622623][ C1] ? __fget_light+0x54/0x1e0 [ 2564.622861][ C1] ksys_read+0x17a/0x1e0 [ 2564.623079][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2564.623321][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2564.623626][ C1] do_syscall_64+0xc9/0x1e0 [ 2564.623865][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2564.624165][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2564.624397][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2564.625367][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2564.625789][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2564.626187][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2564.626586][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2564.626994][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2564.627396][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2564.627798][ C1] [ 2564.627955][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 197s! [swapper/2:0] [ 2564.628380][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2564.629648][ C2] irq event stamp: 44114564 [ 2564.629884][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2564.630421][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2564.630934][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2564.631417][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2564.631887][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2564.632348][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2564.632965][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 2564.633255][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 2564.634229][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [ 2564.634539][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2564.634940][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2564.635345][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2564.635747][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2564.636149][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2564.636550][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2564.637026][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2564.637363][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2564.637765][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2564.638164][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2564.638565][ C2] PKRU: 55555554 [ 2564.638747][ C2] Call Trace: [ 2564.638919][ C2] [ 2564.639068][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2564.639333][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2564.639579][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2564.639857][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2564.640133][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2564.640423][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2564.640687][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2564.640996][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2564.641259][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2564.641521][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2564.641832][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2564.642130][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2564.642446][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2564.642736][ C2] ? kasan_check_range+0x12/0x1c0 [ 2564.642994][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 2564.643277][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2564.643589][ C2] ? get_stack_info+0x36/0xc0 [ 2564.643831][ C2] ? lock_acquire+0x1c1/0x220 [ 2564.644071][ C2] ? lock_release+0x1d5/0x250 [ 2564.644313][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2564.644561][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2564.644835][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2564.645120][ C2] ? lock_acquire+0x1c1/0x220 [ 2564.645360][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2564.645602][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2564.645862][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2564.646095][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2564.646344][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2564.646603][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2564.646886][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2564.647165][ C2] ip_local_deliver+0x19d/0x480 [ 2564.647412][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2564.647683][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2564.647947][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2564.648292][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2564.648546][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2564.648867][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2564.649129][ C2] ip_rcv+0x564/0x740 [ 2564.649334][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2564.649565][ C2] ? set_track_prepare+0x8a/0xd0 [ 2564.649818][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2564.650094][ C2] ? start_secondary+0x21c/0x2b0 [ 2564.650347][ C2] ? skb_clone+0x10b/0x330 [ 2564.650576][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2564.650897][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2564.651205][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2564.651486][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2564.651782][ C2] ? __tcf_classify+0x329/0x7d0 [ 2564.652030][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2564.652262][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2564.652563][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2564.652849][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2564.653174][ C2] ? lock_acquire+0x1c1/0x220 [ 2564.653413][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2564.653710][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2564.653997][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2564.654314][ C2] ? __copy_skb_header+0xaf/0x490 [ 2564.654572][ C2] ? __skb_clone+0x57a/0x760 [ 2564.654807][ C2] netif_receive_skb+0x55/0x280 [ 2564.655055][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2564.655369][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2564.655702][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2564.656005][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2564.656279][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2564.656571][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2564.656892][ C2] ? get_stack_info+0x36/0xc0 [ 2564.657136][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2564.657399][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2564.657717][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2564.657995][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2564.658272][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2564.658589][ C2] ? kernel_text_address+0x17/0xe0 [ 2564.658850][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2564.659165][ C2] ? arch_stack_walk+0x8c/0x100 [ 2564.659414][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2564.659678][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2564.659962][ C2] ? lock_acquire+0x1c1/0x220 [ 2564.660202][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2564.660483][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2564.660787][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2564.661063][ C2] ? get_stack_info+0x36/0xc0 [ 2564.661309][ C2] __tcf_classify+0x329/0x7d0 [ 2564.661553][ C2] tcf_classify+0x283/0x930 [ 2564.661786][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2564.662042][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2564.662354][ C2] tc_run+0x2e4/0x5d0 [ 2564.662562][ C2] ? __pfx_tc_run+0x10/0x10 [ 2564.662791][ C2] ? lock_acquire+0x1c1/0x220 [ 2564.663031][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2564.663295][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2564.663549][ C2] ? lock_acquire+0x1c1/0x220 [ 2564.663789][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2564.664053][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2564.664358][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2564.664630][ C2] ? neigh_hh_output+0x348/0x590 [ 2564.664883][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2564.665148][ C2] ip_finish_output2+0x786/0x18e0 [ 2564.665407][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2564.665745][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2564.666020][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2564.666274][ C2] ? __ip_finish_output+0x10f/0x770 [ 2564.666540][ C2] ip_output+0x16b/0x4f0 [ 2564.666770][ C2] ? __pfx_ip_output+0x10/0x10 [ 2564.667021][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2564.667304][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2564.667620][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2564.667897][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2564.668149][ C2] ? __alloc_skb+0xd4/0x280 [ 2564.668382][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2564.668654][ C2] ? tcp_fragment+0x168/0x1040 [ 2564.668899][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2564.669152][ C2] ? ip_local_out+0x114/0x3b0 [ 2564.669390][ C2] __ip_queue_xmit+0x672/0x1910 [ 2564.669638][ C2] ? __skb_clone+0x57a/0x760 [ 2564.669875][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2564.670143][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2564.670424][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2564.670669][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2564.670919][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2564.671221][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2564.671542][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2564.671786][ C2] tcp_send_loss_probe+0x348/0x830 [ 2564.672048][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2564.672317][ C2] tcp_write_timer+0x82/0x1d0 [ 2564.672558][ C2] call_timer_fn+0x173/0x430 [ 2564.672794][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2564.673054][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2564.673317][ C2] __run_timers.part.0+0x52d/0x890 [ 2564.673578][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2564.673848][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2564.674133][ C2] ? lock_acquire+0x1c1/0x220 [ 2564.674372][ C2] ? clockevents_program_event+0xf6/0x300 [ 2564.674661][ C2] ? lock_release+0x1d5/0x250 [ 2564.674902][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2564.675167][ C2] ? ktime_get+0xb3/0x190 [ 2564.675391][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2564.675687][ C2] run_timer_softirq+0x72/0x100 [ 2564.675936][ C2] __do_softirq+0x1b9/0x7ff [ 2564.676170][ C2] irq_exit_rcu+0x98/0xc0 [ 2564.676389][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2564.676678][ C2] [ 2564.676839][ C2] [ 2564.676990][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2564.677296][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2564.677553][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2564.678521][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2564.678832][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2564.679229][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2564.679631][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2564.680031][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2564.680430][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2564.680828][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2564.681121][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2564.681382][ C2] default_idle_call+0x69/0xa0 [ 2564.681628][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2564.681880][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2564.682157][ C2] ? lock_release+0x1d5/0x250 [ 2564.682397][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2564.682671][ C2] do_idle+0xfb/0x160 [ 2564.682874][ C2] cpu_startup_entry+0x55/0x60 [ 2564.683118][ C2] start_secondary+0x21c/0x2b0 [ 2564.683363][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2564.683632][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2564.683943][ C2] [ 2592.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 223s! [perl:4135] [ 2592.569721][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2592.571029][ C1] irq event stamp: 209232 [ 2592.571245][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2592.571792][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2592.572288][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2592.572780][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2592.573244][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2592.573720][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2592.574349][ C1] RIP: 0010:kasan_check_range+0x81/0x1c0 [ 2592.574650][ C1] Code: 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da <48> 29 ea 48 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d [ 2592.575648][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [ 2592.575967][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 2592.576368][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2592.576794][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 2592.577191][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2592.577587][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2592.577987][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2592.578434][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2592.578766][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2592.579166][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2592.579563][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2592.579963][ C1] PKRU: 55555554 [ 2592.580144][ C1] Call Trace: [ 2592.580314][ C1] [ 2592.580472][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2592.580735][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2592.580978][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2592.581255][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2592.581526][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2592.581830][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2592.582103][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2592.582428][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2592.582708][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 2592.582976][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2592.583299][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2592.583610][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2592.583943][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2592.584229][ C1] ? kasan_check_range+0x81/0x1c0 [ 2592.584495][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2592.584785][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2592.585110][ C1] ? get_stack_info+0x36/0xc0 [ 2592.585367][ C1] ? lock_acquire+0x1c1/0x220 [ 2592.585619][ C1] ? lock_release+0x1d5/0x250 [ 2592.585864][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2592.586112][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2592.586382][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2592.586674][ C1] ? lock_acquire+0x1c1/0x220 [ 2592.586914][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2592.587171][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2592.587449][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2592.587685][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2592.587947][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2592.588210][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2592.588500][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2592.588795][ C1] ip_local_deliver+0x19d/0x480 [ 2592.589048][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2592.589326][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2592.589592][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2592.589955][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2592.590228][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2592.590561][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2592.590830][ C1] ip_rcv+0x564/0x740 [ 2592.591034][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2592.591278][ C1] ? set_track_prepare+0x8a/0xd0 [ 2592.591549][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2592.591826][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2592.592110][ C1] ? skb_clone+0x10b/0x330 [ 2592.592342][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2592.592674][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2592.592998][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2592.593292][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2592.593591][ C1] ? __tcf_classify+0x329/0x7d0 [ 2592.593853][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2592.594083][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2592.594381][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2592.594667][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2592.595009][ C1] ? lock_acquire+0x1c1/0x220 [ 2592.595264][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2592.595568][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2592.595853][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2592.596169][ C1] ? __copy_skb_header+0xaf/0x490 [ 2592.596427][ C1] ? __skb_clone+0x57a/0x760 [ 2592.596666][ C1] netif_receive_skb+0x55/0x280 [ 2592.596913][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2592.597226][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2592.597558][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2592.597856][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2592.598131][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2592.598419][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2592.598731][ C1] ? hlock_class+0x4e/0x130 [ 2592.598965][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2592.599240][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2592.599515][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2592.599778][ C1] ? hlock_class+0x4e/0x130 [ 2592.600010][ C1] ? mark_lock+0x38/0x3e0 [ 2592.600230][ C1] ? stack_access_ok+0xda/0x1f0 [ 2592.600477][ C1] ? __lock_acquire+0xb67/0x1610 [ 2592.600731][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2592.601009][ C1] ? get_stack_info+0x36/0xc0 [ 2592.601248][ C1] ? stack_access_ok+0xda/0x1f0 [ 2592.601511][ C1] ? get_reg+0x119/0x190 [ 2592.601748][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2592.602015][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2592.602342][ C1] __tcf_classify+0x329/0x7d0 [ 2592.602587][ C1] tcf_classify+0x283/0x930 [ 2592.602837][ C1] ? arch_stack_walk+0xa2/0x100 [ 2592.603086][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2592.603362][ C1] ? get_stack_info+0x36/0xc0 [ 2592.603618][ C1] tc_run+0x2e4/0x5d0 [ 2592.603824][ C1] ? __pfx_tc_run+0x10/0x10 [ 2592.604060][ C1] ? lock_acquire+0x1c1/0x220 [ 2592.604313][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2592.604593][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2592.604846][ C1] ? lock_acquire+0x1c1/0x220 [ 2592.605102][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2592.605371][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2592.605692][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2592.605962][ C1] ? neigh_hh_output+0x348/0x590 [ 2592.606231][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2592.606508][ C1] ip_finish_output2+0x786/0x18e0 [ 2592.606775][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2592.607068][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2592.607418][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2592.607694][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2592.607963][ C1] ? __ip_finish_output+0x10f/0x770 [ 2592.608231][ C1] ip_output+0x16b/0x4f0 [ 2592.608460][ C1] ? run_timer_softirq+0x72/0x100 [ 2592.608717][ C1] ? __pfx_ip_output+0x10/0x10 [ 2592.608981][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2592.609268][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2592.609530][ C1] ? ip_local_out+0x114/0x3b0 [ 2592.609774][ C1] __ip_queue_xmit+0x672/0x1910 [ 2592.610021][ C1] ? __create_object+0x5e/0xb0 [ 2592.610280][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2592.610563][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2592.610861][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2592.611138][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2592.611432][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2592.611719][ C1] tcp_delack_timer+0x84/0x240 [ 2592.611963][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2592.612243][ C1] call_timer_fn+0x173/0x430 [ 2592.612483][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2592.612757][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2592.613016][ C1] __run_timers.part.0+0x52d/0x890 [ 2592.613276][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2592.613569][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2592.613862][ C1] ? lock_acquire+0x1c1/0x220 [ 2592.614100][ C1] ? clockevents_program_event+0xf6/0x300 [ 2592.614389][ C1] ? lock_release+0x1d5/0x250 [ 2592.614628][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2592.614891][ C1] ? ktime_get+0xb3/0x190 [ 2592.615112][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2592.615408][ C1] run_timer_softirq+0x72/0x100 [ 2592.615655][ C1] __do_softirq+0x1b9/0x7ff [ 2592.615888][ C1] irq_exit_rcu+0x98/0xc0 [ 2592.616108][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2592.616394][ C1] [ 2592.616552][ C1] [ 2592.616703][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2592.617008][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2592.617332][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2592.618303][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2592.618611][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2592.619009][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2592.619410][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2592.619808][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2592.620213][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2592.620626][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2592.620950][ C1] pipe_read+0xa16/0xdf0 [ 2592.621172][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2592.621465][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2592.621712][ C1] ? iterate_tty_write+0x299/0x540 [ 2592.621989][ C1] ? lock_release+0x1d5/0x250 [ 2592.622228][ C1] vfs_read+0x911/0xc00 [ 2592.622460][ C1] ? lock_acquire+0x1c1/0x220 [ 2592.622707][ C1] ? __might_fault+0xc6/0x180 [ 2592.622950][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2592.623189][ C1] ? __might_fault+0xc6/0x180 [ 2592.623429][ C1] ? lock_release+0x1d5/0x250 [ 2592.623672][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2592.623951][ C1] ? __fget_light+0x54/0x1e0 [ 2592.624188][ C1] ksys_read+0x17a/0x1e0 [ 2592.624423][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2592.624677][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2592.624988][ C1] do_syscall_64+0xc9/0x1e0 [ 2592.625222][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2592.625534][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2592.625778][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2592.626775][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2592.627211][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2592.627620][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2592.628022][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2592.628438][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2592.628856][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2592.629271][ C1] [ 2592.629429][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 223s! [swapper/2:0] [ 2592.629866][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2592.631133][ C2] irq event stamp: 44114564 [ 2592.631361][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2592.631901][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2592.632414][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2592.632890][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2592.633361][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2592.633818][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2592.634433][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2592.634759][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2592.635730][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2592.636038][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2592.636438][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2592.636846][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2592.637249][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2592.637648][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2592.638048][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2592.638496][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2592.638834][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2592.639239][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2592.639638][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2592.640036][ C2] PKRU: 55555554 [ 2592.640219][ C2] Call Trace: [ 2592.640392][ C2] [ 2592.640540][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2592.640802][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2592.641046][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2592.641322][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2592.641597][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2592.641884][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2592.642150][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2592.642458][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2592.642719][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2592.642981][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2592.643291][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2592.643588][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2592.643903][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2592.644193][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2592.644489][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2592.644777][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2592.645087][ C2] ? get_stack_info+0x36/0xc0 [ 2592.645330][ C2] ? lock_acquire+0x1c1/0x220 [ 2592.645570][ C2] ? lock_release+0x1d5/0x250 [ 2592.645809][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2592.646058][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2592.646330][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2592.646623][ C2] ? lock_acquire+0x1c1/0x220 [ 2592.646862][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2592.647101][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2592.647361][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2592.647598][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2592.647845][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2592.648104][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2592.648380][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2592.648656][ C2] ip_local_deliver+0x19d/0x480 [ 2592.648905][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2592.649179][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2592.649444][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2592.649798][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2592.650053][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2592.650373][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2592.650641][ C2] ip_rcv+0x564/0x740 [ 2592.650845][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2592.651077][ C2] ? set_track_prepare+0x8a/0xd0 [ 2592.651332][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2592.651608][ C2] ? start_secondary+0x21c/0x2b0 [ 2592.651859][ C2] ? skb_clone+0x10b/0x330 [ 2592.652087][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2592.652407][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2592.652711][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2592.652995][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2592.653289][ C2] ? __tcf_classify+0x329/0x7d0 [ 2592.653538][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2592.653770][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2592.654068][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2592.654355][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2592.654680][ C2] ? lock_acquire+0x1c1/0x220 [ 2592.654918][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2592.655214][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2592.655500][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2592.655815][ C2] ? __copy_skb_header+0xaf/0x490 [ 2592.656074][ C2] ? __skb_clone+0x57a/0x760 [ 2592.656308][ C2] netif_receive_skb+0x55/0x280 [ 2592.656562][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2592.656875][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2592.657208][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2592.657506][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2592.657780][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2592.658067][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2592.658380][ C2] ? get_stack_info+0x36/0xc0 [ 2592.658622][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2592.658886][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2592.659206][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2592.659481][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2592.659758][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2592.660073][ C2] ? kernel_text_address+0x17/0xe0 [ 2592.660335][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2592.660647][ C2] ? arch_stack_walk+0x8c/0x100 [ 2592.660896][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2592.661160][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2592.661448][ C2] ? lock_acquire+0x1c1/0x220 [ 2592.661686][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2592.661969][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2592.662275][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2592.662550][ C2] ? get_stack_info+0x36/0xc0 [ 2592.662791][ C2] __tcf_classify+0x329/0x7d0 [ 2592.663031][ C2] tcf_classify+0x283/0x930 [ 2592.663265][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2592.663520][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2592.663832][ C2] tc_run+0x2e4/0x5d0 [ 2592.664038][ C2] ? __pfx_tc_run+0x10/0x10 [ 2592.664272][ C2] ? lock_acquire+0x1c1/0x220 [ 2592.664510][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2592.664771][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2592.665024][ C2] ? lock_acquire+0x1c1/0x220 [ 2592.665261][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2592.665527][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2592.665830][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2592.666102][ C2] ? neigh_hh_output+0x348/0x590 [ 2592.666354][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2592.666626][ C2] ip_finish_output2+0x786/0x18e0 [ 2592.666883][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2592.667222][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2592.667497][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2592.667750][ C2] ? __ip_finish_output+0x10f/0x770 [ 2592.668014][ C2] ip_output+0x16b/0x4f0 [ 2592.668232][ C2] ? __pfx_ip_output+0x10/0x10 [ 2592.668480][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2592.668759][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2592.669070][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2592.669349][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2592.669601][ C2] ? __alloc_skb+0xd4/0x280 [ 2592.669829][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2592.670100][ C2] ? tcp_fragment+0x168/0x1040 [ 2592.670344][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2592.670595][ C2] ? ip_local_out+0x114/0x3b0 [ 2592.670834][ C2] __ip_queue_xmit+0x672/0x1910 [ 2592.671082][ C2] ? __skb_clone+0x57a/0x760 [ 2592.671319][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2592.671586][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2592.671865][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2592.672112][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2592.672362][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2592.672662][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2592.672981][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2592.673225][ C2] tcp_send_loss_probe+0x348/0x830 [ 2592.673485][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2592.673755][ C2] tcp_write_timer+0x82/0x1d0 [ 2592.673994][ C2] call_timer_fn+0x173/0x430 [ 2592.674231][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2592.674492][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2592.674752][ C2] __run_timers.part.0+0x52d/0x890 [ 2592.675012][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2592.675281][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2592.675567][ C2] ? lock_acquire+0x1c1/0x220 [ 2592.675805][ C2] ? clockevents_program_event+0xf6/0x300 [ 2592.676097][ C2] ? lock_release+0x1d5/0x250 [ 2592.676337][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2592.676606][ C2] ? ktime_get+0xb3/0x190 [ 2592.676833][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2592.677133][ C2] run_timer_softirq+0x72/0x100 [ 2592.677382][ C2] __do_softirq+0x1b9/0x7ff [ 2592.677614][ C2] irq_exit_rcu+0x98/0xc0 [ 2592.677835][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2592.678120][ C2] [ 2592.678273][ C2] [ 2592.678422][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2592.678726][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2592.678983][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2592.679953][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2592.680263][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2592.680661][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2592.681059][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2592.681477][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2592.681876][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2592.682277][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2592.682566][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2592.682828][ C2] default_idle_call+0x69/0xa0 [ 2592.683070][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2592.683322][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2592.683601][ C2] ? lock_release+0x1d5/0x250 [ 2592.683837][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2592.684114][ C2] do_idle+0xfb/0x160 [ 2592.684317][ C2] cpu_startup_entry+0x55/0x60 [ 2592.684560][ C2] start_secondary+0x21c/0x2b0 [ 2592.684802][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2592.685076][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2592.685387][ C2] [ 2615.077103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2615.077472][ C1] rcu: 1-....: (260362 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=63880 [ 2615.078017][ C1] rcu: (t=260190 jiffies g=1882453 q=680 ncpus=4) [ 2615.078347][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2615.078795][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2615.079406][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2615.079738][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2615.080705][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2615.081013][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2615.081410][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2615.081810][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2615.082208][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2615.082606][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2615.083002][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2615.083448][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2615.083782][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2615.084183][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2615.084580][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2615.084976][ C1] PKRU: 55555554 [ 2615.085158][ C1] Call Trace: [ 2615.085329][ C1] [ 2615.085476][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2615.085750][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2615.086001][ C1] ? check_cpu_stall+0x284/0x500 [ 2615.086254][ C1] ? rcu_pending+0x92/0x360 [ 2615.086492][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2615.086762][ C1] ? update_process_times+0xb9/0x110 [ 2615.087030][ C1] ? tick_sched_handle+0x67/0x130 [ 2615.087287][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2615.087573][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2615.087816][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2615.088126][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2615.088401][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2615.088687][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2615.088951][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2615.089257][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2615.089519][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2615.089827][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2615.090123][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2615.090437][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2615.090726][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2615.091021][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2615.091309][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2615.091619][ C1] ? get_stack_info+0x36/0xc0 [ 2615.091861][ C1] ? lock_acquire+0x1c1/0x220 [ 2615.092101][ C1] ? lock_release+0x1d5/0x250 [ 2615.092340][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2615.092588][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2615.092859][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2615.093145][ C1] ? lock_acquire+0x1c1/0x220 [ 2615.093382][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2615.093622][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2615.093881][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2615.094116][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2615.094364][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2615.094623][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2615.094898][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2615.095173][ C1] ip_local_deliver+0x19d/0x480 [ 2615.095421][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2615.095696][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2615.095962][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2615.096309][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2615.096567][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2615.096887][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2615.097150][ C1] ip_rcv+0x564/0x740 [ 2615.097352][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2615.097585][ C1] ? set_track_prepare+0x8a/0xd0 [ 2615.097838][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2615.098114][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2615.098386][ C1] ? skb_clone+0x10b/0x330 [ 2615.098622][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2615.098940][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2615.099245][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2615.099529][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2615.099821][ C1] ? __tcf_classify+0x329/0x7d0 [ 2615.100069][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2615.100301][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2615.100601][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2615.100885][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2615.101209][ C1] ? lock_acquire+0x1c1/0x220 [ 2615.101447][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2615.101743][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2615.102029][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2615.102346][ C1] ? __copy_skb_header+0xaf/0x490 [ 2615.102608][ C1] ? __skb_clone+0x57a/0x760 [ 2615.102842][ C1] netif_receive_skb+0x55/0x280 [ 2615.103088][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2615.103402][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2615.103733][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2615.104033][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2615.104307][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2615.104595][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2615.104904][ C1] ? hlock_class+0x4e/0x130 [ 2615.105139][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2615.105413][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2615.105690][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2615.105953][ C1] ? hlock_class+0x4e/0x130 [ 2615.106182][ C1] ? mark_lock+0x38/0x3e0 [ 2615.106404][ C1] ? stack_access_ok+0xda/0x1f0 [ 2615.106662][ C1] ? __lock_acquire+0xb67/0x1610 [ 2615.106915][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2615.107191][ C1] ? get_stack_info+0x36/0xc0 [ 2615.107431][ C1] ? stack_access_ok+0xda/0x1f0 [ 2615.107677][ C1] ? get_reg+0x119/0x190 [ 2615.107892][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2615.108158][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2615.108467][ C1] __tcf_classify+0x329/0x7d0 [ 2615.108709][ C1] tcf_classify+0x283/0x930 [ 2615.108939][ C1] ? arch_stack_walk+0xa2/0x100 [ 2615.109188][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2615.109445][ C1] ? get_stack_info+0x36/0xc0 [ 2615.109685][ C1] tc_run+0x2e4/0x5d0 [ 2615.109890][ C1] ? __pfx_tc_run+0x10/0x10 [ 2615.110121][ C1] ? lock_acquire+0x1c1/0x220 [ 2615.110359][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2615.110620][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2615.110872][ C1] ? lock_acquire+0x1c1/0x220 [ 2615.111109][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2615.111374][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2615.111679][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2615.111950][ C1] ? neigh_hh_output+0x348/0x590 [ 2615.112203][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2615.112468][ C1] ip_finish_output2+0x786/0x18e0 [ 2615.112723][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2615.113002][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2615.113338][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2615.113612][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2615.113865][ C1] ? __ip_finish_output+0x10f/0x770 [ 2615.114128][ C1] ip_output+0x16b/0x4f0 [ 2615.114346][ C1] ? run_timer_softirq+0x72/0x100 [ 2615.114602][ C1] ? __pfx_ip_output+0x10/0x10 [ 2615.114844][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2615.115130][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2615.115382][ C1] ? ip_local_out+0x114/0x3b0 [ 2615.115626][ C1] __ip_queue_xmit+0x672/0x1910 [ 2615.115873][ C1] ? __create_object+0x5e/0xb0 [ 2615.116116][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2615.116382][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2615.116672][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2615.116943][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2615.117225][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2615.117499][ C1] tcp_delack_timer+0x84/0x240 [ 2615.117743][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2615.118016][ C1] call_timer_fn+0x173/0x430 [ 2615.118251][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2615.118513][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2615.118775][ C1] __run_timers.part.0+0x52d/0x890 [ 2615.119035][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2615.119308][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2615.119592][ C1] ? lock_acquire+0x1c1/0x220 [ 2615.119833][ C1] ? clockevents_program_event+0xf6/0x300 [ 2615.120124][ C1] ? lock_release+0x1d5/0x250 [ 2615.120361][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2615.120625][ C1] ? ktime_get+0xb3/0x190 [ 2615.120847][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2615.121143][ C1] run_timer_softirq+0x72/0x100 [ 2615.121390][ C1] __do_softirq+0x1b9/0x7ff [ 2615.121624][ C1] irq_exit_rcu+0x98/0xc0 [ 2615.121845][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2615.122132][ C1] [ 2615.122281][ C1] [ 2615.122433][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2615.122735][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2615.123061][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2615.124030][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2615.124339][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2615.124740][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2615.125138][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2615.125537][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2615.125934][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2615.126337][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2615.126638][ C1] pipe_read+0xa16/0xdf0 [ 2615.126861][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2615.127138][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2615.127382][ C1] ? iterate_tty_write+0x299/0x540 [ 2615.127644][ C1] ? lock_release+0x1d5/0x250 [ 2615.127885][ C1] vfs_read+0x911/0xc00 [ 2615.128099][ C1] ? lock_acquire+0x1c1/0x220 [ 2615.128338][ C1] ? __might_fault+0xc6/0x180 [ 2615.128577][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2615.128817][ C1] ? __might_fault+0xc6/0x180 [ 2615.129057][ C1] ? lock_release+0x1d5/0x250 [ 2615.129298][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2615.129562][ C1] ? __fget_light+0x54/0x1e0 [ 2615.129799][ C1] ksys_read+0x17a/0x1e0 [ 2615.130017][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2615.130262][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2615.130564][ C1] do_syscall_64+0xc9/0x1e0 [ 2615.130799][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2615.131100][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2615.131330][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2615.132303][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2615.132726][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2615.133125][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2615.133523][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2615.133921][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2615.134320][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2615.134720][ C1] [ 2615.134879][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2615.135161][ C2] NMI backtrace for cpu 2 [ 2615.135172][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2615.135178][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2615.135183][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 2615.135195][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 2615.135201][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2615.135207][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2615.135210][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2615.135212][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2615.135213][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2615.135215][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2615.135217][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2615.135219][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2615.135222][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2615.135224][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2615.135225][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2615.135226][ C2] PKRU: 55555554 [ 2615.135228][ C2] Call Trace: [ 2615.135232][ C2] [ 2615.135235][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2615.135243][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2615.135249][ C2] ? nmi_handle+0x153/0x420 [ 2615.135254][ C2] ? default_do_nmi+0x41/0x100 [ 2615.135258][ C2] ? exc_nmi+0xf3/0x120 [ 2615.135260][ C2] ? end_repeat_nmi+0xf/0x60 [ 2615.135267][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2615.135270][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2615.135273][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2615.135276][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 2615.135279][ C2] [ 2615.135280][ C2] [ 2615.135282][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2615.135284][ C2] ? get_stack_info+0x36/0xc0 [ 2615.135289][ C2] ? lock_acquire+0x1c1/0x220 [ 2615.135294][ C2] ? lock_release+0x1d5/0x250 [ 2615.135297][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2615.135302][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2615.135304][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2615.135308][ C2] ? lock_acquire+0x1c1/0x220 [ 2615.135310][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2615.135314][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2615.135318][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2615.135324][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2615.135326][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2615.135331][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2615.135339][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2615.135343][ C2] ip_local_deliver+0x19d/0x480 [ 2615.135345][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2615.135347][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2615.135349][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2615.135356][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2615.135361][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2615.135364][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2615.135374][ C2] ip_rcv+0x564/0x740 [ 2615.135376][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2615.135379][ C2] ? set_track_prepare+0x8a/0xd0 [ 2615.135384][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2615.135386][ C2] ? start_secondary+0x21c/0x2b0 [ 2615.135391][ C2] ? skb_clone+0x10b/0x330 [ 2615.135395][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2615.135401][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2615.135406][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2615.135412][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2615.135420][ C2] ? __tcf_classify+0x329/0x7d0 [ 2615.135424][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2615.135426][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2615.135430][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2615.135433][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2615.135437][ C2] ? lock_acquire+0x1c1/0x220 [ 2615.135440][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2615.135444][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2615.135448][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2615.135452][ C2] ? __copy_skb_header+0xaf/0x490 [ 2615.135457][ C2] ? __skb_clone+0x57a/0x760 [ 2615.135460][ C2] netif_receive_skb+0x55/0x280 [ 2615.135463][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2615.135472][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2615.135479][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2615.135485][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2615.135490][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2615.135500][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2615.135508][ C2] ? get_stack_info+0x36/0xc0 [ 2615.135513][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2615.135516][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2615.135522][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2615.135524][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2615.135528][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2615.135530][ C2] ? kernel_text_address+0x17/0xe0 [ 2615.135534][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2615.135540][ C2] ? arch_stack_walk+0x8c/0x100 [ 2615.135545][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2615.135548][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2615.135551][ C2] ? lock_acquire+0x1c1/0x220 [ 2615.135553][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2615.135559][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2615.135565][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2615.135567][ C2] ? get_stack_info+0x36/0xc0 [ 2615.135572][ C2] __tcf_classify+0x329/0x7d0 [ 2615.135577][ C2] tcf_classify+0x283/0x930 [ 2615.135582][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2615.135585][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2615.135589][ C2] tc_run+0x2e4/0x5d0 [ 2615.135594][ C2] ? __pfx_tc_run+0x10/0x10 [ 2615.135597][ C2] ? lock_acquire+0x1c1/0x220 [ 2615.135600][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2615.135604][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2615.135608][ C2] ? lock_acquire+0x1c1/0x220 [ 2615.135610][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2615.135614][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2615.135617][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2615.135620][ C2] ? neigh_hh_output+0x348/0x590 [ 2615.135624][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2615.135627][ C2] ip_finish_output2+0x786/0x18e0 [ 2615.135630][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2615.135638][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2615.135640][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2615.135644][ C2] ? __ip_finish_output+0x10f/0x770 [ 2615.135648][ C2] ip_output+0x16b/0x4f0 [ 2615.135651][ C2] ? __pfx_ip_output+0x10/0x10 [ 2615.135653][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2615.135656][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2615.135660][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2615.135664][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2615.135667][ C2] ? __alloc_skb+0xd4/0x280 [ 2615.135670][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2615.135675][ C2] ? tcp_fragment+0x168/0x1040 [ 2615.135679][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2615.135682][ C2] ? ip_local_out+0x114/0x3b0 [ 2615.135685][ C2] __ip_queue_xmit+0x672/0x1910 [ 2615.135689][ C2] ? __skb_clone+0x57a/0x760 [ 2615.135692][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2615.135697][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2615.135701][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2615.135705][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2615.135710][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2615.135715][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2615.135718][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2615.135721][ C2] tcp_send_loss_probe+0x348/0x830 [ 2615.135725][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2615.135727][ C2] tcp_write_timer+0x82/0x1d0 [ 2615.135731][ C2] call_timer_fn+0x173/0x430 [ 2615.135736][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2615.135740][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2615.135744][ C2] __run_timers.part.0+0x52d/0x890 [ 2615.135748][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2615.135752][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2615.135755][ C2] ? lock_acquire+0x1c1/0x220 [ 2615.135757][ C2] ? clockevents_program_event+0xf6/0x300 [ 2615.135763][ C2] ? lock_release+0x1d5/0x250 [ 2615.135766][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2615.135770][ C2] ? ktime_get+0xb3/0x190 [ 2615.135774][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2615.135778][ C2] run_timer_softirq+0x72/0x100 [ 2615.135782][ C2] __do_softirq+0x1b9/0x7ff [ 2615.135786][ C2] irq_exit_rcu+0x98/0xc0 [ 2615.135789][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2615.135794][ C2] [ 2615.135794][ C2] [ 2615.135795][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2615.135799][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2615.135802][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2615.135804][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2615.135808][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2615.135809][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2615.135811][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2615.135812][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2615.135814][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2615.135817][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2615.135820][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2615.135824][ C2] default_idle_call+0x69/0xa0 [ 2615.135828][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2615.135831][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2615.135835][ C2] ? lock_release+0x1d5/0x250 [ 2615.135838][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2615.135842][ C2] do_idle+0xfb/0x160 [ 2615.135844][ C2] cpu_startup_entry+0x55/0x60 [ 2615.135847][ C2] start_secondary+0x21c/0x2b0 [ 2615.135850][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2615.135854][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2615.135860][ C2] [ 2640.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 268s! [perl:4135] [ 2640.569706][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2640.570964][ C1] irq event stamp: 209232 [ 2640.571181][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2640.571711][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2640.572188][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2640.572656][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2640.573123][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2640.573575][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2640.574191][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2640.574519][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2640.575492][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2640.575801][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2640.576203][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2640.576608][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2640.577007][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2640.577406][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2640.577808][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2640.578255][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2640.578588][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2640.578989][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2640.579388][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2640.579789][ C1] PKRU: 55555554 [ 2640.579971][ C1] Call Trace: [ 2640.580151][ C1] [ 2640.580303][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2640.580567][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2640.580811][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2640.581087][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2640.581359][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2640.581649][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2640.581913][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2640.582220][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2640.582482][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2640.582791][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2640.583085][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2640.583400][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2640.583690][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2640.583983][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2640.584274][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2640.584586][ C1] ? get_stack_info+0x36/0xc0 [ 2640.584825][ C1] ? lock_acquire+0x1c1/0x220 [ 2640.585068][ C1] ? lock_release+0x1d5/0x250 [ 2640.585307][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2640.585556][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2640.585828][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2640.586116][ C1] ? lock_acquire+0x1c1/0x220 [ 2640.586359][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2640.586601][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2640.586860][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2640.587096][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2640.587342][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2640.587599][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2640.587879][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2640.588156][ C1] ip_local_deliver+0x19d/0x480 [ 2640.588404][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2640.588675][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2640.588939][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2640.589289][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2640.589543][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2640.589863][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2640.590127][ C1] ip_rcv+0x564/0x740 [ 2640.590331][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2640.590562][ C1] ? set_track_prepare+0x8a/0xd0 [ 2640.590814][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2640.591094][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2640.591366][ C1] ? skb_clone+0x10b/0x330 [ 2640.591594][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2640.591913][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2640.592220][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2640.592504][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2640.592797][ C1] ? __tcf_classify+0x329/0x7d0 [ 2640.593048][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2640.593279][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2640.593580][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2640.593868][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2640.594194][ C1] ? lock_acquire+0x1c1/0x220 [ 2640.594433][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2640.594733][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2640.595020][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2640.595337][ C1] ? __copy_skb_header+0xaf/0x490 [ 2640.595595][ C1] ? __skb_clone+0x57a/0x760 [ 2640.595829][ C1] netif_receive_skb+0x55/0x280 [ 2640.596078][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2640.596397][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2640.596729][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2640.597030][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2640.597305][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2640.597593][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2640.597908][ C1] ? hlock_class+0x4e/0x130 [ 2640.598142][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2640.598418][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2640.598694][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2640.598958][ C1] ? hlock_class+0x4e/0x130 [ 2640.599191][ C1] ? mark_lock+0x38/0x3e0 [ 2640.599411][ C1] ? stack_access_ok+0xda/0x1f0 [ 2640.599659][ C1] ? __lock_acquire+0xb67/0x1610 [ 2640.599914][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2640.600193][ C1] ? get_stack_info+0x36/0xc0 [ 2640.600431][ C1] ? stack_access_ok+0xda/0x1f0 [ 2640.600680][ C1] ? get_reg+0x119/0x190 [ 2640.600898][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2640.601165][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2640.601476][ C1] __tcf_classify+0x329/0x7d0 [ 2640.601720][ C1] tcf_classify+0x283/0x930 [ 2640.601954][ C1] ? arch_stack_walk+0xa2/0x100 [ 2640.602205][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2640.602461][ C1] ? get_stack_info+0x36/0xc0 [ 2640.602703][ C1] tc_run+0x2e4/0x5d0 [ 2640.602909][ C1] ? __pfx_tc_run+0x10/0x10 [ 2640.603139][ C1] ? lock_acquire+0x1c1/0x220 [ 2640.603378][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2640.603639][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2640.603893][ C1] ? lock_acquire+0x1c1/0x220 [ 2640.604132][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2640.604397][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2640.604703][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2640.604975][ C1] ? neigh_hh_output+0x348/0x590 [ 2640.605232][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2640.605496][ C1] ip_finish_output2+0x786/0x18e0 [ 2640.605753][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2640.606032][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2640.606383][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2640.606660][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2640.606914][ C1] ? __ip_finish_output+0x10f/0x770 [ 2640.607180][ C1] ip_output+0x16b/0x4f0 [ 2640.607396][ C1] ? run_timer_softirq+0x72/0x100 [ 2640.607653][ C1] ? __pfx_ip_output+0x10/0x10 [ 2640.607898][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2640.608186][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2640.608438][ C1] ? ip_local_out+0x114/0x3b0 [ 2640.608676][ C1] __ip_queue_xmit+0x672/0x1910 [ 2640.608926][ C1] ? __create_object+0x5e/0xb0 [ 2640.609170][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2640.609438][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2640.609719][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2640.609993][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2640.610274][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2640.610545][ C1] tcp_delack_timer+0x84/0x240 [ 2640.610790][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2640.611063][ C1] call_timer_fn+0x173/0x430 [ 2640.611300][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2640.611561][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2640.611821][ C1] __run_timers.part.0+0x52d/0x890 [ 2640.612082][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2640.612358][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2640.612644][ C1] ? lock_acquire+0x1c1/0x220 [ 2640.612884][ C1] ? clockevents_program_event+0xf6/0x300 [ 2640.613174][ C1] ? lock_release+0x1d5/0x250 [ 2640.613413][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2640.613679][ C1] ? ktime_get+0xb3/0x190 [ 2640.613901][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2640.614198][ C1] run_timer_softirq+0x72/0x100 [ 2640.614446][ C1] __do_softirq+0x1b9/0x7ff [ 2640.614679][ C1] irq_exit_rcu+0x98/0xc0 [ 2640.614899][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2640.615186][ C1] [ 2640.615336][ C1] [ 2640.615486][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2640.615791][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2640.616115][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2640.617092][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2640.617402][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2640.617799][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2640.618200][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2640.618598][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2640.618996][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2640.619396][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2640.619693][ C1] pipe_read+0xa16/0xdf0 [ 2640.619913][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2640.620193][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2640.620435][ C1] ? iterate_tty_write+0x299/0x540 [ 2640.620698][ C1] ? lock_release+0x1d5/0x250 [ 2640.620938][ C1] vfs_read+0x911/0xc00 [ 2640.621153][ C1] ? lock_acquire+0x1c1/0x220 [ 2640.621390][ C1] ? __might_fault+0xc6/0x180 [ 2640.621631][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2640.621871][ C1] ? __might_fault+0xc6/0x180 [ 2640.622111][ C1] ? lock_release+0x1d5/0x250 [ 2640.622348][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2640.622613][ C1] ? __fget_light+0x54/0x1e0 [ 2640.622851][ C1] ksys_read+0x17a/0x1e0 [ 2640.623068][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2640.623312][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2640.623617][ C1] do_syscall_64+0xc9/0x1e0 [ 2640.623851][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2640.624150][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2640.624379][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2640.625350][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2640.625774][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2640.626174][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2640.626584][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2640.626989][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2640.627390][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2640.627792][ C1] [ 2640.627948][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 268s! [swapper/2:0] [ 2640.628386][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2640.629646][ C2] irq event stamp: 44114564 [ 2640.629874][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2640.630414][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2640.630928][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2640.631406][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2640.631876][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2640.632335][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2640.632948][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2640.633274][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2640.634245][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2640.634553][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2640.634951][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2640.635351][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2640.635750][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2640.636152][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2640.636559][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2640.637006][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2640.637341][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2640.637742][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2640.638142][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2640.638539][ C2] PKRU: 55555554 [ 2640.638721][ C2] Call Trace: [ 2640.638893][ C2] [ 2640.639043][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2640.639307][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2640.639551][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2640.639828][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2640.640102][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2640.640394][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2640.640660][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2640.640967][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2640.641229][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2640.641491][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2640.641802][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2640.642098][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2640.642414][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2640.642703][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2640.642999][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2640.643288][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2640.643599][ C2] ? get_stack_info+0x36/0xc0 [ 2640.643842][ C2] ? lock_acquire+0x1c1/0x220 [ 2640.644081][ C2] ? lock_release+0x1d5/0x250 [ 2640.644322][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2640.644571][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2640.644842][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2640.645130][ C2] ? lock_acquire+0x1c1/0x220 [ 2640.645368][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2640.645611][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2640.645871][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2640.646108][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2640.646363][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2640.646622][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2640.646898][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2640.647177][ C2] ip_local_deliver+0x19d/0x480 [ 2640.647424][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2640.647697][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2640.647960][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2640.648309][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2640.648562][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2640.648882][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2640.649147][ C2] ip_rcv+0x564/0x740 [ 2640.649351][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2640.649583][ C2] ? set_track_prepare+0x8a/0xd0 [ 2640.649837][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2640.650114][ C2] ? start_secondary+0x21c/0x2b0 [ 2640.650366][ C2] ? skb_clone+0x10b/0x330 [ 2640.650594][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2640.650912][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2640.651219][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2640.651503][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2640.651796][ C2] ? __tcf_classify+0x329/0x7d0 [ 2640.652045][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2640.652278][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2640.652577][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2640.652863][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2640.653190][ C2] ? lock_acquire+0x1c1/0x220 [ 2640.653433][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2640.653729][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2640.654015][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2640.654333][ C2] ? __copy_skb_header+0xaf/0x490 [ 2640.654591][ C2] ? __skb_clone+0x57a/0x760 [ 2640.654825][ C2] netif_receive_skb+0x55/0x280 [ 2640.655073][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2640.655388][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2640.655720][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2640.656020][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2640.656295][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2640.656591][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2640.656904][ C2] ? get_stack_info+0x36/0xc0 [ 2640.657147][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2640.657412][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2640.657731][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2640.658006][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2640.658287][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2640.658609][ C2] ? kernel_text_address+0x17/0xe0 [ 2640.658881][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2640.659194][ C2] ? arch_stack_walk+0x8c/0x100 [ 2640.659442][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2640.659706][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2640.659992][ C2] ? lock_acquire+0x1c1/0x220 [ 2640.660231][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2640.660513][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2640.660820][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2640.661094][ C2] ? get_stack_info+0x36/0xc0 [ 2640.661337][ C2] __tcf_classify+0x329/0x7d0 [ 2640.661579][ C2] tcf_classify+0x283/0x930 [ 2640.661810][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2640.662066][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2640.662381][ C2] tc_run+0x2e4/0x5d0 [ 2640.662587][ C2] ? __pfx_tc_run+0x10/0x10 [ 2640.662818][ C2] ? lock_acquire+0x1c1/0x220 [ 2640.663058][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2640.663320][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2640.663572][ C2] ? lock_acquire+0x1c1/0x220 [ 2640.663809][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2640.664075][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2640.664380][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2640.664652][ C2] ? neigh_hh_output+0x348/0x590 [ 2640.664905][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2640.665171][ C2] ip_finish_output2+0x786/0x18e0 [ 2640.665428][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2640.665765][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2640.666041][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2640.666298][ C2] ? __ip_finish_output+0x10f/0x770 [ 2640.666573][ C2] ip_output+0x16b/0x4f0 [ 2640.666791][ C2] ? __pfx_ip_output+0x10/0x10 [ 2640.667032][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2640.667312][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2640.667623][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2640.667901][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2640.668154][ C2] ? __alloc_skb+0xd4/0x280 [ 2640.668383][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2640.668655][ C2] ? tcp_fragment+0x168/0x1040 [ 2640.668897][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2640.669150][ C2] ? ip_local_out+0x114/0x3b0 [ 2640.669391][ C2] __ip_queue_xmit+0x672/0x1910 [ 2640.669639][ C2] ? __skb_clone+0x57a/0x760 [ 2640.669875][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2640.670144][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2640.670423][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2640.670669][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2640.670919][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2640.671221][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2640.671541][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2640.671783][ C2] tcp_send_loss_probe+0x348/0x830 [ 2640.672043][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2640.672315][ C2] tcp_write_timer+0x82/0x1d0 [ 2640.672552][ C2] call_timer_fn+0x173/0x430 [ 2640.672797][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2640.673059][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2640.673321][ C2] __run_timers.part.0+0x52d/0x890 [ 2640.673580][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2640.673848][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2640.674136][ C2] ? lock_acquire+0x1c1/0x220 [ 2640.674375][ C2] ? clockevents_program_event+0xf6/0x300 [ 2640.674666][ C2] ? lock_release+0x1d5/0x250 [ 2640.674906][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2640.675170][ C2] ? ktime_get+0xb3/0x190 [ 2640.675389][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2640.675688][ C2] run_timer_softirq+0x72/0x100 [ 2640.675936][ C2] __do_softirq+0x1b9/0x7ff [ 2640.676169][ C2] irq_exit_rcu+0x98/0xc0 [ 2640.676399][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2640.676685][ C2] [ 2640.676837][ C2] [ 2640.676987][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2640.677293][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2640.677551][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2640.678522][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2640.678830][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2640.679229][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2640.679626][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2640.680026][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2640.680426][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2640.680825][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2640.681116][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2640.681378][ C2] default_idle_call+0x69/0xa0 [ 2640.681620][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2640.681870][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2640.682151][ C2] ? lock_release+0x1d5/0x250 [ 2640.682389][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2640.682664][ C2] do_idle+0xfb/0x160 [ 2640.682867][ C2] cpu_startup_entry+0x55/0x60 [ 2640.683112][ C2] start_secondary+0x21c/0x2b0 [ 2640.683354][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2640.683625][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2640.683936][ C2] [ 2668.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 294s! [swapper/2:0] [ 2668.569712][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2668.570970][ C2] irq event stamp: 44114564 [ 2668.571198][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2668.571735][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2668.572246][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2668.572719][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2668.573191][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2668.573646][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2668.574256][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2668.574580][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2668.575553][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2668.575858][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2668.576263][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2668.576661][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2668.577057][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2668.577455][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2668.577852][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2668.578299][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2668.578630][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2668.579028][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2668.579425][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2668.579825][ C2] PKRU: 55555554 [ 2668.580005][ C2] Call Trace: [ 2668.580177][ C2] [ 2668.580326][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2668.580588][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2668.580830][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2668.581109][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2668.581381][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2668.581672][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2668.581937][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2668.582242][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2668.582501][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2668.582762][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2668.583070][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2668.583367][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2668.583681][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2668.583967][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2668.584262][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2668.584548][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2668.584858][ C2] ? get_stack_info+0x36/0xc0 [ 2668.585100][ C2] ? lock_acquire+0x1c1/0x220 [ 2668.585342][ C2] ? lock_release+0x1d5/0x250 [ 2668.585584][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2668.585832][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2668.586105][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2668.586393][ C2] ? lock_acquire+0x1c1/0x220 [ 2668.586631][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2668.586871][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2668.587133][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2668.587366][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2668.587612][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2668.587869][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2668.588143][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2668.588421][ C2] ip_local_deliver+0x19d/0x480 [ 2668.588667][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2668.588938][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2668.589201][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2668.589548][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2668.589801][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2668.590121][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2668.590381][ C2] ip_rcv+0x564/0x740 [ 2668.590583][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2668.590814][ C2] ? set_track_prepare+0x8a/0xd0 [ 2668.591066][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2668.591341][ C2] ? start_secondary+0x21c/0x2b0 [ 2668.591592][ C2] ? skb_clone+0x10b/0x330 [ 2668.591819][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2668.592139][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2668.592441][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2668.592723][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2668.593013][ C2] ? __tcf_classify+0x329/0x7d0 [ 2668.593263][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2668.593494][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2668.593793][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2668.594076][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2668.594401][ C2] ? lock_acquire+0x1c1/0x220 [ 2668.594642][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2668.594935][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2668.595223][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2668.595540][ C2] ? __copy_skb_header+0xaf/0x490 [ 2668.595797][ C2] ? __skb_clone+0x57a/0x760 [ 2668.596030][ C2] netif_receive_skb+0x55/0x280 [ 2668.596282][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2668.596594][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2668.596923][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2668.597228][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2668.597500][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2668.597789][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2668.598097][ C2] ? get_stack_info+0x36/0xc0 [ 2668.598338][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2668.598600][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2668.598916][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2668.599192][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2668.599468][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2668.599781][ C2] ? kernel_text_address+0x17/0xe0 [ 2668.600040][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2668.600359][ C2] ? arch_stack_walk+0x8c/0x100 [ 2668.600611][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2668.600874][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2668.601157][ C2] ? lock_acquire+0x1c1/0x220 [ 2668.601396][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2668.601675][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2668.601981][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2668.602255][ C2] ? get_stack_info+0x36/0xc0 [ 2668.602496][ C2] __tcf_classify+0x329/0x7d0 [ 2668.602737][ C2] tcf_classify+0x283/0x930 [ 2668.602968][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2668.603223][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2668.603533][ C2] tc_run+0x2e4/0x5d0 [ 2668.603740][ C2] ? __pfx_tc_run+0x10/0x10 [ 2668.603970][ C2] ? lock_acquire+0x1c1/0x220 [ 2668.604209][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2668.604469][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2668.604723][ C2] ? lock_acquire+0x1c1/0x220 [ 2668.604960][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2668.605225][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2668.605526][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2668.605797][ C2] ? neigh_hh_output+0x348/0x590 [ 2668.606049][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2668.606318][ C2] ip_finish_output2+0x786/0x18e0 [ 2668.606574][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2668.606909][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2668.607183][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2668.607436][ C2] ? __ip_finish_output+0x10f/0x770 [ 2668.607699][ C2] ip_output+0x16b/0x4f0 [ 2668.607917][ C2] ? __pfx_ip_output+0x10/0x10 [ 2668.608161][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2668.608435][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2668.608752][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2668.609028][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2668.609280][ C2] ? __alloc_skb+0xd4/0x280 [ 2668.609511][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2668.609780][ C2] ? tcp_fragment+0x168/0x1040 [ 2668.610024][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2668.610275][ C2] ? ip_local_out+0x114/0x3b0 [ 2668.610512][ C2] __ip_queue_xmit+0x672/0x1910 [ 2668.610760][ C2] ? __skb_clone+0x57a/0x760 [ 2668.610995][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2668.611262][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2668.611540][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2668.611785][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2668.612036][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2668.612341][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2668.612661][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2668.612906][ C2] tcp_send_loss_probe+0x348/0x830 [ 2668.613167][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2668.613436][ C2] tcp_write_timer+0x82/0x1d0 [ 2668.613677][ C2] call_timer_fn+0x173/0x430 [ 2668.613914][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2668.614178][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2668.614439][ C2] __run_timers.part.0+0x52d/0x890 [ 2668.614701][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2668.614971][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2668.615256][ C2] ? lock_acquire+0x1c1/0x220 [ 2668.615497][ C2] ? clockevents_program_event+0xf6/0x300 [ 2668.615793][ C2] ? lock_release+0x1d5/0x250 [ 2668.616034][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2668.616310][ C2] ? ktime_get+0xb3/0x190 [ 2668.616532][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2668.616824][ C2] run_timer_softirq+0x72/0x100 [ 2668.617070][ C2] __do_softirq+0x1b9/0x7ff [ 2668.617303][ C2] irq_exit_rcu+0x98/0xc0 [ 2668.617523][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2668.617808][ C2] [ 2668.617957][ C2] [ 2668.618108][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2668.618413][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2668.618668][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2668.619635][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2668.619943][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2668.620339][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2668.620739][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2668.621141][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2668.621537][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2668.621934][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2668.622225][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2668.622485][ C2] default_idle_call+0x69/0xa0 [ 2668.622728][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2668.622978][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2668.623256][ C2] ? lock_release+0x1d5/0x250 [ 2668.623494][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2668.623765][ C2] do_idle+0xfb/0x160 [ 2668.623973][ C2] cpu_startup_entry+0x55/0x60 [ 2668.624222][ C2] start_secondary+0x21c/0x2b0 [ 2668.624466][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2668.624734][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2668.625043][ C2] [ 2668.625200][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 294s! [perl:4135] [ 2668.625618][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2668.626879][ C1] irq event stamp: 209232 [ 2668.627096][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2668.627623][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2668.628099][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2668.628565][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2668.629026][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2668.629472][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2668.630083][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2668.630407][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2668.631374][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2668.631680][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2668.632077][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2668.632475][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2668.632873][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2668.633271][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2668.633666][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2668.634112][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2668.634445][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2668.634847][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2668.635245][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2668.635642][ C1] PKRU: 55555554 [ 2668.635823][ C1] Call Trace: [ 2668.635995][ C1] [ 2668.636142][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2668.636411][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2668.636656][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2668.636931][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2668.637207][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2668.637494][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2668.637759][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2668.638066][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2668.638327][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2668.638637][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2668.638932][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2668.639246][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2668.639537][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2668.639831][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2668.640120][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2668.640432][ C1] ? get_stack_info+0x36/0xc0 [ 2668.640673][ C1] ? lock_acquire+0x1c1/0x220 [ 2668.640912][ C1] ? lock_release+0x1d5/0x250 [ 2668.641152][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2668.641401][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2668.641672][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2668.641958][ C1] ? lock_acquire+0x1c1/0x220 [ 2668.642196][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2668.642436][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2668.642695][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2668.642931][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2668.643178][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2668.643436][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2668.643711][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2668.643986][ C1] ip_local_deliver+0x19d/0x480 [ 2668.644234][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2668.644504][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2668.644768][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2668.645115][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2668.645371][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2668.645691][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2668.645954][ C1] ip_rcv+0x564/0x740 [ 2668.646157][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2668.646396][ C1] ? set_track_prepare+0x8a/0xd0 [ 2668.646650][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2668.646925][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2668.647199][ C1] ? skb_clone+0x10b/0x330 [ 2668.647427][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2668.647746][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2668.648053][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2668.648335][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2668.648627][ C1] ? __tcf_classify+0x329/0x7d0 [ 2668.648875][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2668.649105][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2668.649404][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2668.649688][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2668.650013][ C1] ? lock_acquire+0x1c1/0x220 [ 2668.650252][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2668.650546][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2668.650832][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2668.651149][ C1] ? __copy_skb_header+0xaf/0x490 [ 2668.651406][ C1] ? __skb_clone+0x57a/0x760 [ 2668.651639][ C1] netif_receive_skb+0x55/0x280 [ 2668.651886][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2668.652198][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2668.652529][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2668.652829][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2668.653103][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2668.653391][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2668.653702][ C1] ? hlock_class+0x4e/0x130 [ 2668.653935][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2668.654211][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2668.654487][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2668.654750][ C1] ? hlock_class+0x4e/0x130 [ 2668.654980][ C1] ? mark_lock+0x38/0x3e0 [ 2668.655201][ C1] ? stack_access_ok+0xda/0x1f0 [ 2668.655449][ C1] ? __lock_acquire+0xb67/0x1610 [ 2668.655702][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2668.655978][ C1] ? get_stack_info+0x36/0xc0 [ 2668.656226][ C1] ? stack_access_ok+0xda/0x1f0 [ 2668.656472][ C1] ? get_reg+0x119/0x190 [ 2668.656687][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2668.656954][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2668.657263][ C1] __tcf_classify+0x329/0x7d0 [ 2668.657505][ C1] tcf_classify+0x283/0x930 [ 2668.657735][ C1] ? arch_stack_walk+0xa2/0x100 [ 2668.657984][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2668.658239][ C1] ? get_stack_info+0x36/0xc0 [ 2668.658480][ C1] tc_run+0x2e4/0x5d0 [ 2668.658687][ C1] ? __pfx_tc_run+0x10/0x10 [ 2668.658918][ C1] ? lock_acquire+0x1c1/0x220 [ 2668.659155][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2668.659416][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2668.659668][ C1] ? lock_acquire+0x1c1/0x220 [ 2668.659905][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2668.660169][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2668.660474][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2668.660744][ C1] ? neigh_hh_output+0x348/0x590 [ 2668.660996][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2668.661259][ C1] ip_finish_output2+0x786/0x18e0 [ 2668.661514][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2668.661794][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2668.662130][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2668.662404][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2668.662656][ C1] ? __ip_finish_output+0x10f/0x770 [ 2668.662920][ C1] ip_output+0x16b/0x4f0 [ 2668.663137][ C1] ? run_timer_softirq+0x72/0x100 [ 2668.663395][ C1] ? __pfx_ip_output+0x10/0x10 [ 2668.663636][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2668.663923][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2668.664174][ C1] ? ip_local_out+0x114/0x3b0 [ 2668.664414][ C1] __ip_queue_xmit+0x672/0x1910 [ 2668.664661][ C1] ? __create_object+0x5e/0xb0 [ 2668.664903][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2668.665169][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2668.665451][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2668.665723][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2668.666002][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2668.666284][ C1] tcp_delack_timer+0x84/0x240 [ 2668.666527][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2668.666800][ C1] call_timer_fn+0x173/0x430 [ 2668.667033][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2668.667296][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2668.667557][ C1] __run_timers.part.0+0x52d/0x890 [ 2668.667818][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2668.668091][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2668.668375][ C1] ? lock_acquire+0x1c1/0x220 [ 2668.668613][ C1] ? clockevents_program_event+0xf6/0x300 [ 2668.668902][ C1] ? lock_release+0x1d5/0x250 [ 2668.669141][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2668.669404][ C1] ? ktime_get+0xb3/0x190 [ 2668.669627][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2668.669923][ C1] run_timer_softirq+0x72/0x100 [ 2668.670170][ C1] __do_softirq+0x1b9/0x7ff [ 2668.670408][ C1] irq_exit_rcu+0x98/0xc0 [ 2668.670627][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2668.670915][ C1] [ 2668.671064][ C1] [ 2668.671215][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2668.671518][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2668.671843][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2668.672814][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2668.673120][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2668.673521][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2668.673919][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2668.674317][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2668.674713][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2668.675114][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2668.675409][ C1] pipe_read+0xa16/0xdf0 [ 2668.675630][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2668.675907][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2668.676151][ C1] ? iterate_tty_write+0x299/0x540 [ 2668.676418][ C1] ? lock_release+0x1d5/0x250 [ 2668.676658][ C1] vfs_read+0x911/0xc00 [ 2668.676873][ C1] ? lock_acquire+0x1c1/0x220 [ 2668.677111][ C1] ? __might_fault+0xc6/0x180 [ 2668.677350][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2668.677590][ C1] ? __might_fault+0xc6/0x180 [ 2668.677830][ C1] ? lock_release+0x1d5/0x250 [ 2668.678069][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2668.678334][ C1] ? __fget_light+0x54/0x1e0 [ 2668.678569][ C1] ksys_read+0x17a/0x1e0 [ 2668.678789][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2668.679033][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2668.679335][ C1] do_syscall_64+0xc9/0x1e0 [ 2668.679573][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2668.679872][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2668.680098][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2668.681078][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2668.681506][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2668.681908][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2668.682304][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2668.682704][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2668.683102][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2668.683502][ C1] [ 2693.135103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2693.135462][ C1] rcu: 1-....: (338192 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=83219 [ 2693.136004][ C1] rcu: (t=338248 jiffies g=1882453 q=685 ncpus=4) [ 2693.136338][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2693.136785][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2693.137396][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2693.137723][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2693.138689][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2693.138996][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2693.139393][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2693.139789][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2693.140189][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2693.140585][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2693.140981][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2693.141425][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2693.141755][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2693.142160][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2693.142556][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2693.142952][ C1] PKRU: 55555554 [ 2693.143134][ C1] Call Trace: [ 2693.143306][ C1] [ 2693.143452][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2693.143723][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2693.143974][ C1] ? check_cpu_stall+0x284/0x500 [ 2693.144226][ C1] ? rcu_pending+0x92/0x360 [ 2693.144457][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2693.144726][ C1] ? update_process_times+0xb9/0x110 [ 2693.144997][ C1] ? tick_sched_handle+0x67/0x130 [ 2693.145252][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2693.145537][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2693.145779][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2693.146102][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2693.146374][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2693.146661][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2693.146925][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2693.147230][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2693.147491][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2693.147800][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2693.148092][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2693.148407][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2693.148696][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2693.148988][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2693.149277][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2693.149587][ C1] ? get_stack_info+0x36/0xc0 [ 2693.149827][ C1] ? lock_acquire+0x1c1/0x220 [ 2693.150066][ C1] ? lock_release+0x1d5/0x250 [ 2693.150306][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2693.150555][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2693.150825][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2693.151110][ C1] ? lock_acquire+0x1c1/0x220 [ 2693.151346][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2693.151587][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2693.151845][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2693.152080][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2693.152326][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2693.152584][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2693.152859][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2693.153134][ C1] ip_local_deliver+0x19d/0x480 [ 2693.153380][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2693.153652][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2693.153915][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2693.154264][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2693.154517][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2693.154834][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2693.155096][ C1] ip_rcv+0x564/0x740 [ 2693.155300][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2693.155530][ C1] ? set_track_prepare+0x8a/0xd0 [ 2693.155782][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2693.156063][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2693.156335][ C1] ? skb_clone+0x10b/0x330 [ 2693.156563][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2693.156881][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2693.157185][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2693.157471][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2693.157763][ C1] ? __tcf_classify+0x329/0x7d0 [ 2693.158011][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2693.158243][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2693.158540][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2693.158827][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2693.159151][ C1] ? lock_acquire+0x1c1/0x220 [ 2693.159390][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2693.159684][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2693.159970][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2693.160287][ C1] ? __copy_skb_header+0xaf/0x490 [ 2693.160543][ C1] ? __skb_clone+0x57a/0x760 [ 2693.160775][ C1] netif_receive_skb+0x55/0x280 [ 2693.161022][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2693.161335][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2693.161667][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2693.161966][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2693.162239][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2693.162526][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2693.162838][ C1] ? hlock_class+0x4e/0x130 [ 2693.163072][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2693.163347][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2693.163621][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2693.163888][ C1] ? hlock_class+0x4e/0x130 [ 2693.164118][ C1] ? mark_lock+0x38/0x3e0 [ 2693.164340][ C1] ? stack_access_ok+0xda/0x1f0 [ 2693.164589][ C1] ? __lock_acquire+0xb67/0x1610 [ 2693.164843][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2693.165123][ C1] ? get_stack_info+0x36/0xc0 [ 2693.165362][ C1] ? stack_access_ok+0xda/0x1f0 [ 2693.165608][ C1] ? get_reg+0x119/0x190 [ 2693.165828][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2693.166103][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2693.166413][ C1] __tcf_classify+0x329/0x7d0 [ 2693.166654][ C1] tcf_classify+0x283/0x930 [ 2693.166886][ C1] ? arch_stack_walk+0xa2/0x100 [ 2693.167135][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2693.167392][ C1] ? get_stack_info+0x36/0xc0 [ 2693.167635][ C1] tc_run+0x2e4/0x5d0 [ 2693.167840][ C1] ? __pfx_tc_run+0x10/0x10 [ 2693.168072][ C1] ? lock_acquire+0x1c1/0x220 [ 2693.168310][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2693.168571][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2693.168824][ C1] ? lock_acquire+0x1c1/0x220 [ 2693.169064][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2693.169328][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2693.169633][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2693.169904][ C1] ? neigh_hh_output+0x348/0x590 [ 2693.170157][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2693.170422][ C1] ip_finish_output2+0x786/0x18e0 [ 2693.170677][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2693.170955][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2693.171294][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2693.171568][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2693.171821][ C1] ? __ip_finish_output+0x10f/0x770 [ 2693.172086][ C1] ip_output+0x16b/0x4f0 [ 2693.172303][ C1] ? run_timer_softirq+0x72/0x100 [ 2693.172560][ C1] ? __pfx_ip_output+0x10/0x10 [ 2693.172801][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2693.173089][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2693.173342][ C1] ? ip_local_out+0x114/0x3b0 [ 2693.173580][ C1] __ip_queue_xmit+0x672/0x1910 [ 2693.173828][ C1] ? __create_object+0x5e/0xb0 [ 2693.174072][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2693.174339][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2693.174622][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2693.174895][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2693.175175][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2693.175451][ C1] tcp_delack_timer+0x84/0x240 [ 2693.175694][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2693.175967][ C1] call_timer_fn+0x173/0x430 [ 2693.176210][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2693.176473][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2693.176735][ C1] __run_timers.part.0+0x52d/0x890 [ 2693.176997][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2693.177272][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2693.177556][ C1] ? lock_acquire+0x1c1/0x220 [ 2693.177794][ C1] ? clockevents_program_event+0xf6/0x300 [ 2693.178084][ C1] ? lock_release+0x1d5/0x250 [ 2693.178325][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2693.178588][ C1] ? ktime_get+0xb3/0x190 [ 2693.178810][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2693.179105][ C1] run_timer_softirq+0x72/0x100 [ 2693.179354][ C1] __do_softirq+0x1b9/0x7ff [ 2693.179588][ C1] irq_exit_rcu+0x98/0xc0 [ 2693.179808][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2693.180096][ C1] [ 2693.180247][ C1] [ 2693.180399][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2693.180704][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2693.181028][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2693.182011][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2693.182325][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2693.182724][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2693.183124][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2693.183522][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2693.183920][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2693.184323][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2693.184619][ C1] pipe_read+0xa16/0xdf0 [ 2693.184841][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2693.185119][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2693.185363][ C1] ? iterate_tty_write+0x299/0x540 [ 2693.185624][ C1] ? lock_release+0x1d5/0x250 [ 2693.185863][ C1] vfs_read+0x911/0xc00 [ 2693.186086][ C1] ? lock_acquire+0x1c1/0x220 [ 2693.186324][ C1] ? __might_fault+0xc6/0x180 [ 2693.186564][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2693.186803][ C1] ? __might_fault+0xc6/0x180 [ 2693.187044][ C1] ? lock_release+0x1d5/0x250 [ 2693.187283][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2693.187548][ C1] ? __fget_light+0x54/0x1e0 [ 2693.187784][ C1] ksys_read+0x17a/0x1e0 [ 2693.188002][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2693.188245][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2693.188548][ C1] do_syscall_64+0xc9/0x1e0 [ 2693.188782][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2693.189081][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2693.189309][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2693.190281][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2693.190703][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2693.191105][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2693.191503][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2693.191901][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2693.192302][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2693.192703][ C1] [ 2693.192867][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2693.193148][ C2] NMI backtrace for cpu 2 [ 2693.193158][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2693.193164][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2693.193168][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2693.193177][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2693.193182][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2693.193185][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2693.193187][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2693.193189][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2693.193190][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2693.193192][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2693.193193][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2693.193195][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2693.193198][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2693.193200][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2693.193201][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2693.193203][ C2] PKRU: 55555554 [ 2693.193204][ C2] Call Trace: [ 2693.193207][ C2] [ 2693.193209][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2693.193217][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2693.193222][ C2] ? nmi_handle+0x153/0x420 [ 2693.193228][ C2] ? default_do_nmi+0x41/0x100 [ 2693.193230][ C2] ? exc_nmi+0xf3/0x120 [ 2693.193233][ C2] ? end_repeat_nmi+0xf/0x60 [ 2693.193238][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2693.193241][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2693.193244][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2693.193247][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2693.193250][ C2] [ 2693.193251][ C2] [ 2693.193252][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2693.193255][ C2] ? get_stack_info+0x36/0xc0 [ 2693.193259][ C2] ? lock_acquire+0x1c1/0x220 [ 2693.193263][ C2] ? lock_release+0x1d5/0x250 [ 2693.193266][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2693.193270][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2693.193273][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2693.193276][ C2] ? lock_acquire+0x1c1/0x220 [ 2693.193278][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2693.193281][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2693.193284][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2693.193290][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2693.193292][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2693.193297][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2693.193303][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2693.193306][ C2] ip_local_deliver+0x19d/0x480 [ 2693.193309][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2693.193311][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2693.193313][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2693.193319][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2693.193322][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2693.193325][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2693.193334][ C2] ip_rcv+0x564/0x740 [ 2693.193336][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2693.193339][ C2] ? set_track_prepare+0x8a/0xd0 [ 2693.193343][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2693.193346][ C2] ? start_secondary+0x21c/0x2b0 [ 2693.193349][ C2] ? skb_clone+0x10b/0x330 [ 2693.193353][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2693.193359][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2693.193364][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2693.193367][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2693.193376][ C2] ? __tcf_classify+0x329/0x7d0 [ 2693.193379][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2693.193381][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2693.193385][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2693.193388][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2693.193392][ C2] ? lock_acquire+0x1c1/0x220 [ 2693.193394][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2693.193398][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2693.193402][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2693.193405][ C2] ? __copy_skb_header+0xaf/0x490 [ 2693.193410][ C2] ? __skb_clone+0x57a/0x760 [ 2693.193412][ C2] netif_receive_skb+0x55/0x280 [ 2693.193415][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2693.193423][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2693.193430][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2693.193436][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2693.193441][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2693.193451][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2693.193458][ C2] ? get_stack_info+0x36/0xc0 [ 2693.193462][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2693.193465][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2693.193468][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2693.193471][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2693.193474][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2693.193476][ C2] ? kernel_text_address+0x17/0xe0 [ 2693.193479][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2693.193483][ C2] ? arch_stack_walk+0x8c/0x100 [ 2693.193487][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2693.193490][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2693.193494][ C2] ? lock_acquire+0x1c1/0x220 [ 2693.193496][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2693.193500][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2693.193505][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2693.193507][ C2] ? get_stack_info+0x36/0xc0 [ 2693.193512][ C2] __tcf_classify+0x329/0x7d0 [ 2693.193517][ C2] tcf_classify+0x283/0x930 [ 2693.193521][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2693.193523][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2693.193528][ C2] tc_run+0x2e4/0x5d0 [ 2693.193531][ C2] ? __pfx_tc_run+0x10/0x10 [ 2693.193534][ C2] ? lock_acquire+0x1c1/0x220 [ 2693.193536][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2693.193540][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2693.193544][ C2] ? lock_acquire+0x1c1/0x220 [ 2693.193546][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2693.193549][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2693.193552][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2693.193555][ C2] ? neigh_hh_output+0x348/0x590 [ 2693.193558][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2693.193562][ C2] ip_finish_output2+0x786/0x18e0 [ 2693.193565][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2693.193573][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2693.193575][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2693.193579][ C2] ? __ip_finish_output+0x10f/0x770 [ 2693.193582][ C2] ip_output+0x16b/0x4f0 [ 2693.193586][ C2] ? __pfx_ip_output+0x10/0x10 [ 2693.193588][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2693.193591][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2693.193594][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2693.193597][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2693.193599][ C2] ? __alloc_skb+0xd4/0x280 [ 2693.193601][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2693.193604][ C2] ? tcp_fragment+0x168/0x1040 [ 2693.193607][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2693.193610][ C2] ? ip_local_out+0x114/0x3b0 [ 2693.193613][ C2] __ip_queue_xmit+0x672/0x1910 [ 2693.193617][ C2] ? __skb_clone+0x57a/0x760 [ 2693.193619][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2693.193624][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2693.193627][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2693.193631][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2693.193636][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2693.193640][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2693.193642][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2693.193646][ C2] tcp_send_loss_probe+0x348/0x830 [ 2693.193649][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2693.193652][ C2] tcp_write_timer+0x82/0x1d0 [ 2693.193655][ C2] call_timer_fn+0x173/0x430 [ 2693.193659][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2693.193664][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2693.193668][ C2] __run_timers.part.0+0x52d/0x890 [ 2693.193671][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2693.193675][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2693.193678][ C2] ? lock_acquire+0x1c1/0x220 [ 2693.193680][ C2] ? clockevents_program_event+0xf6/0x300 [ 2693.193683][ C2] ? lock_release+0x1d5/0x250 [ 2693.193686][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2693.193689][ C2] ? ktime_get+0xb3/0x190 [ 2693.193692][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2693.193696][ C2] run_timer_softirq+0x72/0x100 [ 2693.193699][ C2] __do_softirq+0x1b9/0x7ff [ 2693.193704][ C2] irq_exit_rcu+0x98/0xc0 [ 2693.193706][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2693.193709][ C2] [ 2693.193710][ C2] [ 2693.193711][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2693.193714][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2693.193718][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2693.193720][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2693.193722][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2693.193724][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2693.193725][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2693.193726][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2693.193728][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2693.193731][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2693.193734][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2693.193737][ C2] default_idle_call+0x69/0xa0 [ 2693.193740][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2693.193743][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2693.193747][ C2] ? lock_release+0x1d5/0x250 [ 2693.193749][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2693.193753][ C2] do_idle+0xfb/0x160 [ 2693.193756][ C2] cpu_startup_entry+0x55/0x60 [ 2693.193758][ C2] start_secondary+0x21c/0x2b0 [ 2693.193761][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2693.193765][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2693.193771][ C2] [ 2720.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 342s! [swapper/2:0] [ 2720.569712][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2720.570992][ C2] irq event stamp: 44114564 [ 2720.571225][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2720.571782][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2720.572305][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2720.572795][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2720.573270][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2720.573724][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2720.574333][ C2] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 2720.574620][ C2] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 2720.575588][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000216 [ 2720.575895][ C2] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2720.576300][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2720.576697][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2720.577095][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2720.577491][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2720.577888][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2720.578333][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2720.578663][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2720.579064][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2720.579462][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2720.579857][ C2] PKRU: 55555554 [ 2720.580038][ C2] Call Trace: [ 2720.580211][ C2] [ 2720.580359][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2720.580624][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2720.580867][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2720.581142][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2720.581416][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2720.581702][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2720.581966][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2720.582272][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2720.582531][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 2720.582790][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2720.583050][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2720.583360][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2720.583656][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2720.583970][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2720.584259][ C2] ? kasan_check_range+0x54/0x1c0 [ 2720.584515][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 2720.584795][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2720.585105][ C2] ? get_stack_info+0x36/0xc0 [ 2720.585347][ C2] ? lock_acquire+0x1c1/0x220 [ 2720.585588][ C2] ? lock_release+0x1d5/0x250 [ 2720.585825][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2720.586078][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2720.586351][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2720.586634][ C2] ? lock_acquire+0x1c1/0x220 [ 2720.586872][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2720.587112][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2720.587372][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2720.587606][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2720.587852][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2720.588109][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2720.588383][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2720.588661][ C2] ip_local_deliver+0x19d/0x480 [ 2720.588906][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2720.589178][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2720.589442][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2720.589789][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2720.590042][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2720.590361][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2720.590626][ C2] ip_rcv+0x564/0x740 [ 2720.590830][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2720.591060][ C2] ? set_track_prepare+0x8a/0xd0 [ 2720.591315][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2720.591589][ C2] ? start_secondary+0x21c/0x2b0 [ 2720.591840][ C2] ? skb_clone+0x10b/0x330 [ 2720.592070][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2720.592388][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2720.592692][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2720.592974][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2720.593265][ C2] ? __tcf_classify+0x329/0x7d0 [ 2720.593514][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2720.593745][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2720.594045][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2720.594328][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2720.594652][ C2] ? lock_acquire+0x1c1/0x220 [ 2720.594890][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2720.595184][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2720.595469][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2720.595784][ C2] ? __copy_skb_header+0xaf/0x490 [ 2720.596047][ C2] ? __skb_clone+0x57a/0x760 [ 2720.596281][ C2] netif_receive_skb+0x55/0x280 [ 2720.596526][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2720.596838][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2720.597169][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2720.597468][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2720.597741][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2720.598029][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2720.598338][ C2] ? get_stack_info+0x36/0xc0 [ 2720.598580][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2720.598844][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2720.599160][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2720.599435][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2720.599711][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2720.600025][ C2] ? kernel_text_address+0x17/0xe0 [ 2720.600285][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2720.600597][ C2] ? arch_stack_walk+0x8c/0x100 [ 2720.600845][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2720.601110][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2720.601392][ C2] ? lock_acquire+0x1c1/0x220 [ 2720.601630][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2720.601911][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2720.602216][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2720.602490][ C2] ? get_stack_info+0x36/0xc0 [ 2720.602731][ C2] __tcf_classify+0x329/0x7d0 [ 2720.602973][ C2] tcf_classify+0x283/0x930 [ 2720.603205][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2720.603459][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2720.603771][ C2] tc_run+0x2e4/0x5d0 [ 2720.603977][ C2] ? __pfx_tc_run+0x10/0x10 [ 2720.604207][ C2] ? lock_acquire+0x1c1/0x220 [ 2720.604447][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2720.604708][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2720.604968][ C2] ? lock_acquire+0x1c1/0x220 [ 2720.605213][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2720.605485][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2720.605796][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2720.606072][ C2] ? neigh_hh_output+0x348/0x590 [ 2720.606324][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2720.606587][ C2] ip_finish_output2+0x786/0x18e0 [ 2720.606843][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2720.607179][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2720.607453][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2720.607705][ C2] ? __ip_finish_output+0x10f/0x770 [ 2720.607967][ C2] ip_output+0x16b/0x4f0 [ 2720.608187][ C2] ? __pfx_ip_output+0x10/0x10 [ 2720.608430][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2720.608705][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2720.609017][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2720.609292][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2720.609543][ C2] ? __alloc_skb+0xd4/0x280 [ 2720.609774][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2720.610042][ C2] ? tcp_fragment+0x168/0x1040 [ 2720.610287][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2720.610538][ C2] ? ip_local_out+0x114/0x3b0 [ 2720.610775][ C2] __ip_queue_xmit+0x672/0x1910 [ 2720.611024][ C2] ? __skb_clone+0x57a/0x760 [ 2720.611259][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2720.611524][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2720.611802][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2720.612047][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2720.612296][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2720.612596][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2720.612916][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2720.613159][ C2] tcp_send_loss_probe+0x348/0x830 [ 2720.613418][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2720.613686][ C2] tcp_write_timer+0x82/0x1d0 [ 2720.613924][ C2] call_timer_fn+0x173/0x430 [ 2720.614159][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2720.614419][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2720.614679][ C2] __run_timers.part.0+0x52d/0x890 [ 2720.614940][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2720.615210][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2720.615491][ C2] ? lock_acquire+0x1c1/0x220 [ 2720.615730][ C2] ? clockevents_program_event+0xf6/0x300 [ 2720.616025][ C2] ? lock_release+0x1d5/0x250 [ 2720.616265][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2720.616527][ C2] ? ktime_get+0xb3/0x190 [ 2720.616748][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2720.617041][ C2] run_timer_softirq+0x72/0x100 [ 2720.617288][ C2] __do_softirq+0x1b9/0x7ff [ 2720.617521][ C2] irq_exit_rcu+0x98/0xc0 [ 2720.617740][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2720.618026][ C2] [ 2720.618175][ C2] [ 2720.618324][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2720.618628][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2720.618883][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2720.619847][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2720.620154][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2720.620550][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2720.620949][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2720.621346][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2720.621741][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2720.622141][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2720.622431][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2720.622691][ C2] default_idle_call+0x69/0xa0 [ 2720.622935][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2720.623186][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2720.623461][ C2] ? lock_release+0x1d5/0x250 [ 2720.623699][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2720.623971][ C2] do_idle+0xfb/0x160 [ 2720.624174][ C2] cpu_startup_entry+0x55/0x60 [ 2720.624421][ C2] start_secondary+0x21c/0x2b0 [ 2720.624664][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2720.624932][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2720.625242][ C2] [ 2720.625399][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 342s! [perl:4135] [ 2720.625825][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2720.627091][ C1] irq event stamp: 209232 [ 2720.627309][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2720.627841][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2720.628317][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2720.628784][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2720.629247][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2720.629695][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2720.630307][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2720.630630][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2720.631600][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2720.631908][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2720.632307][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2720.632708][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2720.633106][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2720.633503][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2720.633900][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2720.634348][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2720.634681][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2720.635083][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2720.635480][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2720.635879][ C1] PKRU: 55555554 [ 2720.636067][ C1] Call Trace: [ 2720.636241][ C1] [ 2720.636391][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2720.636654][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2720.636898][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2720.637175][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2720.637449][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2720.637736][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2720.638001][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2720.638308][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2720.638569][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2720.638880][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2720.639180][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2720.639492][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2720.639781][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2720.640077][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2720.640376][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2720.640688][ C1] ? get_stack_info+0x36/0xc0 [ 2720.640931][ C1] ? lock_acquire+0x1c1/0x220 [ 2720.641174][ C1] ? lock_release+0x1d5/0x250 [ 2720.641415][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2720.641666][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2720.641939][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2720.642227][ C1] ? lock_acquire+0x1c1/0x220 [ 2720.642467][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2720.642709][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2720.642971][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2720.643208][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2720.643457][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2720.643716][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2720.643993][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2720.644271][ C1] ip_local_deliver+0x19d/0x480 [ 2720.644520][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2720.644794][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2720.645060][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2720.645410][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2720.645665][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2720.645995][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2720.646261][ C1] ip_rcv+0x564/0x740 [ 2720.646465][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2720.646698][ C1] ? set_track_prepare+0x8a/0xd0 [ 2720.646953][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2720.647232][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2720.647505][ C1] ? skb_clone+0x10b/0x330 [ 2720.647736][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2720.648057][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2720.648364][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2720.648647][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2720.648943][ C1] ? __tcf_classify+0x329/0x7d0 [ 2720.649195][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2720.649429][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2720.649731][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2720.650017][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2720.650344][ C1] ? lock_acquire+0x1c1/0x220 [ 2720.650584][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2720.650882][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2720.651171][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2720.651489][ C1] ? __copy_skb_header+0xaf/0x490 [ 2720.651749][ C1] ? __skb_clone+0x57a/0x760 [ 2720.651984][ C1] netif_receive_skb+0x55/0x280 [ 2720.652233][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2720.652550][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2720.652883][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2720.653186][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2720.653461][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2720.653753][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2720.654065][ C1] ? hlock_class+0x4e/0x130 [ 2720.654302][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2720.654579][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2720.654858][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2720.655124][ C1] ? hlock_class+0x4e/0x130 [ 2720.655354][ C1] ? mark_lock+0x38/0x3e0 [ 2720.655578][ C1] ? stack_access_ok+0xda/0x1f0 [ 2720.655829][ C1] ? __lock_acquire+0xb67/0x1610 [ 2720.656091][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2720.656369][ C1] ? get_stack_info+0x36/0xc0 [ 2720.656613][ C1] ? stack_access_ok+0xda/0x1f0 [ 2720.656861][ C1] ? get_reg+0x119/0x190 [ 2720.657078][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2720.657348][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2720.657660][ C1] __tcf_classify+0x329/0x7d0 [ 2720.657903][ C1] tcf_classify+0x283/0x930 [ 2720.658137][ C1] ? arch_stack_walk+0xa2/0x100 [ 2720.658387][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2720.658644][ C1] ? get_stack_info+0x36/0xc0 [ 2720.658887][ C1] tc_run+0x2e4/0x5d0 [ 2720.659092][ C1] ? __pfx_tc_run+0x10/0x10 [ 2720.659326][ C1] ? lock_acquire+0x1c1/0x220 [ 2720.659566][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2720.659828][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2720.660082][ C1] ? lock_acquire+0x1c1/0x220 [ 2720.660322][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2720.660588][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2720.660896][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2720.661169][ C1] ? neigh_hh_output+0x348/0x590 [ 2720.661426][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2720.661693][ C1] ip_finish_output2+0x786/0x18e0 [ 2720.661951][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2720.662233][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2720.662571][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2720.662847][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2720.663101][ C1] ? __ip_finish_output+0x10f/0x770 [ 2720.663371][ C1] ip_output+0x16b/0x4f0 [ 2720.663590][ C1] ? run_timer_softirq+0x72/0x100 [ 2720.663850][ C1] ? __pfx_ip_output+0x10/0x10 [ 2720.664093][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2720.664382][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2720.664634][ C1] ? ip_local_out+0x114/0x3b0 [ 2720.664875][ C1] __ip_queue_xmit+0x672/0x1910 [ 2720.665124][ C1] ? __create_object+0x5e/0xb0 [ 2720.665367][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2720.665636][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2720.665927][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2720.666202][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2720.666485][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2720.666759][ C1] tcp_delack_timer+0x84/0x240 [ 2720.667004][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2720.667278][ C1] call_timer_fn+0x173/0x430 [ 2720.667515][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2720.667778][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2720.668041][ C1] __run_timers.part.0+0x52d/0x890 [ 2720.668303][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2720.668577][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2720.668861][ C1] ? lock_acquire+0x1c1/0x220 [ 2720.669103][ C1] ? clockevents_program_event+0xf6/0x300 [ 2720.669397][ C1] ? lock_release+0x1d5/0x250 [ 2720.669635][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2720.669901][ C1] ? ktime_get+0xb3/0x190 [ 2720.670124][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2720.670433][ C1] run_timer_softirq+0x72/0x100 [ 2720.670686][ C1] __do_softirq+0x1b9/0x7ff [ 2720.670932][ C1] irq_exit_rcu+0x98/0xc0 [ 2720.671155][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2720.671443][ C1] [ 2720.671592][ C1] [ 2720.671745][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2720.672050][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2720.672376][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2720.673353][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2720.673661][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2720.674064][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2720.674462][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2720.674861][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2720.675262][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2720.675665][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2720.675966][ C1] pipe_read+0xa16/0xdf0 [ 2720.676191][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2720.676467][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2720.676712][ C1] ? iterate_tty_write+0x299/0x540 [ 2720.676975][ C1] ? lock_release+0x1d5/0x250 [ 2720.677217][ C1] vfs_read+0x911/0xc00 [ 2720.677431][ C1] ? lock_acquire+0x1c1/0x220 [ 2720.677671][ C1] ? __might_fault+0xc6/0x180 [ 2720.677911][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2720.678150][ C1] ? __might_fault+0xc6/0x180 [ 2720.678391][ C1] ? lock_release+0x1d5/0x250 [ 2720.678635][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2720.678901][ C1] ? __fget_light+0x54/0x1e0 [ 2720.679140][ C1] ksys_read+0x17a/0x1e0 [ 2720.679358][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2720.679603][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2720.679908][ C1] do_syscall_64+0xc9/0x1e0 [ 2720.680142][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2720.680443][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2720.680679][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2720.681652][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2720.682072][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2720.682471][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2720.682876][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2720.683277][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2720.683675][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2720.684075][ C1] [ 2748.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 368s! [swapper/2:0] [ 2748.569690][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2748.570939][ C2] irq event stamp: 44114564 [ 2748.571169][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2748.571702][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2748.572211][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2748.572686][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2748.573156][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2748.573611][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2748.574221][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2748.574545][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2748.575513][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2748.575822][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2748.576222][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2748.576618][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2748.577015][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2748.577413][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2748.577812][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2748.578257][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2748.578589][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2748.578995][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2748.579395][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2748.579793][ C2] PKRU: 55555554 [ 2748.579975][ C2] Call Trace: [ 2748.580143][ C2] [ 2748.580294][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2748.580554][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2748.580797][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2748.581073][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2748.581344][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2748.581633][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2748.581898][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2748.582203][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2748.582464][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2748.582726][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2748.583033][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2748.583328][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2748.583641][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2748.583929][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2748.584224][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2748.584512][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2748.584821][ C2] ? get_stack_info+0x36/0xc0 [ 2748.585061][ C2] ? lock_acquire+0x1c1/0x220 [ 2748.585301][ C2] ? lock_release+0x1d5/0x250 [ 2748.585541][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2748.585793][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2748.586065][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2748.586348][ C2] ? lock_acquire+0x1c1/0x220 [ 2748.586585][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2748.586827][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2748.587086][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2748.587319][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2748.587564][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2748.587824][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2748.588100][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2748.588376][ C2] ip_local_deliver+0x19d/0x480 [ 2748.588623][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2748.588892][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2748.589155][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2748.589500][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2748.589751][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2748.590071][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2748.590337][ C2] ip_rcv+0x564/0x740 [ 2748.590543][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2748.590771][ C2] ? set_track_prepare+0x8a/0xd0 [ 2748.591023][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2748.591299][ C2] ? start_secondary+0x21c/0x2b0 [ 2748.591549][ C2] ? skb_clone+0x10b/0x330 [ 2748.591776][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2748.592093][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2748.592400][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2748.592680][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2748.592974][ C2] ? __tcf_classify+0x329/0x7d0 [ 2748.593220][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2748.593450][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2748.593749][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2748.594032][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2748.594355][ C2] ? lock_acquire+0x1c1/0x220 [ 2748.594594][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2748.594889][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2748.595173][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2748.595490][ C2] ? __copy_skb_header+0xaf/0x490 [ 2748.595747][ C2] ? __skb_clone+0x57a/0x760 [ 2748.595989][ C2] netif_receive_skb+0x55/0x280 [ 2748.596237][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2748.596546][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2748.596879][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2748.597177][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2748.597450][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2748.597741][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2748.598054][ C2] ? get_stack_info+0x36/0xc0 [ 2748.598297][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2748.598563][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2748.598881][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2748.599162][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2748.599444][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2748.599767][ C2] ? kernel_text_address+0x17/0xe0 [ 2748.600026][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2748.600339][ C2] ? arch_stack_walk+0x8c/0x100 [ 2748.600587][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2748.600851][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2748.601134][ C2] ? lock_acquire+0x1c1/0x220 [ 2748.601373][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2748.601654][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2748.601957][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2748.602234][ C2] ? get_stack_info+0x36/0xc0 [ 2748.602473][ C2] __tcf_classify+0x329/0x7d0 [ 2748.602714][ C2] tcf_classify+0x283/0x930 [ 2748.602948][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2748.603204][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2748.603515][ C2] tc_run+0x2e4/0x5d0 [ 2748.603721][ C2] ? __pfx_tc_run+0x10/0x10 [ 2748.603950][ C2] ? lock_acquire+0x1c1/0x220 [ 2748.604189][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2748.604448][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2748.604700][ C2] ? lock_acquire+0x1c1/0x220 [ 2748.604939][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2748.605204][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2748.605508][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2748.605786][ C2] ? neigh_hh_output+0x348/0x590 [ 2748.606038][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2748.606303][ C2] ip_finish_output2+0x786/0x18e0 [ 2748.606559][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2748.606894][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2748.607171][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2748.607423][ C2] ? __ip_finish_output+0x10f/0x770 [ 2748.607688][ C2] ip_output+0x16b/0x4f0 [ 2748.607903][ C2] ? __pfx_ip_output+0x10/0x10 [ 2748.608151][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2748.608425][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2748.608737][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2748.609013][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2748.609264][ C2] ? __alloc_skb+0xd4/0x280 [ 2748.609496][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2748.609764][ C2] ? tcp_fragment+0x168/0x1040 [ 2748.610007][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2748.610258][ C2] ? ip_local_out+0x114/0x3b0 [ 2748.610498][ C2] __ip_queue_xmit+0x672/0x1910 [ 2748.610744][ C2] ? __skb_clone+0x57a/0x760 [ 2748.610979][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2748.611244][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2748.611526][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2748.611770][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2748.612018][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2748.612319][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2748.612639][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2748.612882][ C2] tcp_send_loss_probe+0x348/0x830 [ 2748.613141][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2748.613408][ C2] tcp_write_timer+0x82/0x1d0 [ 2748.613648][ C2] call_timer_fn+0x173/0x430 [ 2748.613885][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2748.614147][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2748.614408][ C2] __run_timers.part.0+0x52d/0x890 [ 2748.614667][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2748.614936][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2748.615219][ C2] ? lock_acquire+0x1c1/0x220 [ 2748.615457][ C2] ? clockevents_program_event+0xf6/0x300 [ 2748.615749][ C2] ? lock_release+0x1d5/0x250 [ 2748.615991][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2748.616254][ C2] ? ktime_get+0xb3/0x190 [ 2748.616476][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2748.616772][ C2] run_timer_softirq+0x72/0x100 [ 2748.617018][ C2] __do_softirq+0x1b9/0x7ff [ 2748.617252][ C2] irq_exit_rcu+0x98/0xc0 [ 2748.617472][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2748.617758][ C2] [ 2748.617907][ C2] [ 2748.618058][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2748.618361][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2748.618621][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2748.619588][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2748.619895][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2748.620294][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2748.620691][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2748.621088][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2748.621483][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2748.621885][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2748.622173][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2748.622432][ C2] default_idle_call+0x69/0xa0 [ 2748.622676][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2748.622927][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2748.623203][ C2] ? lock_release+0x1d5/0x250 [ 2748.623446][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2748.623717][ C2] do_idle+0xfb/0x160 [ 2748.623918][ C2] cpu_startup_entry+0x55/0x60 [ 2748.624161][ C2] start_secondary+0x21c/0x2b0 [ 2748.624405][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2748.624672][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2748.624983][ C2] [ 2748.625141][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 368s! [perl:4135] [ 2748.625568][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2748.626839][ C1] irq event stamp: 209232 [ 2748.627058][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2748.627590][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2748.628067][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2748.628539][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2748.629003][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2748.629453][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2748.630069][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2748.630400][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2748.631381][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2748.631691][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2748.632098][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2748.632501][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2748.632908][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2748.633311][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2748.633718][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2748.634175][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2748.634515][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2748.634923][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2748.635327][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2748.635749][ C1] PKRU: 55555554 [ 2748.635948][ C1] Call Trace: [ 2748.636128][ C1] [ 2748.636280][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2748.636548][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2748.636794][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2748.637074][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2748.637363][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2748.637671][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2748.637940][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2748.638250][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2748.638514][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2748.638825][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2748.639124][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2748.639440][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2748.639731][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2748.640029][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2748.640319][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2748.640633][ C1] ? get_stack_info+0x36/0xc0 [ 2748.640875][ C1] ? lock_acquire+0x1c1/0x220 [ 2748.641118][ C1] ? lock_release+0x1d5/0x250 [ 2748.641358][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2748.641610][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2748.641884][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2748.642174][ C1] ? lock_acquire+0x1c1/0x220 [ 2748.642414][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2748.642655][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2748.642919][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2748.643157][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2748.643406][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2748.643666][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2748.643944][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2748.644227][ C1] ip_local_deliver+0x19d/0x480 [ 2748.644475][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2748.644751][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2748.645017][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2748.645368][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2748.645623][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2748.645954][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2748.646221][ C1] ip_rcv+0x564/0x740 [ 2748.646426][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2748.646661][ C1] ? set_track_prepare+0x8a/0xd0 [ 2748.646917][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2748.647196][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2748.647469][ C1] ? skb_clone+0x10b/0x330 [ 2748.647699][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2748.648021][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2748.648332][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2748.648616][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2748.648913][ C1] ? __tcf_classify+0x329/0x7d0 [ 2748.649163][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2748.649396][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2748.649698][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2748.649983][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2748.650310][ C1] ? lock_acquire+0x1c1/0x220 [ 2748.650550][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2748.650847][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2748.651133][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2748.651451][ C1] ? __copy_skb_header+0xaf/0x490 [ 2748.651711][ C1] ? __skb_clone+0x57a/0x760 [ 2748.651947][ C1] netif_receive_skb+0x55/0x280 [ 2748.652197][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2748.652509][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2748.652842][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2748.653144][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2748.653419][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2748.653711][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2748.654024][ C1] ? hlock_class+0x4e/0x130 [ 2748.654259][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2748.654535][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2748.654816][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2748.655081][ C1] ? hlock_class+0x4e/0x130 [ 2748.655314][ C1] ? mark_lock+0x38/0x3e0 [ 2748.655535][ C1] ? stack_access_ok+0xda/0x1f0 [ 2748.655795][ C1] ? __lock_acquire+0xb67/0x1610 [ 2748.656050][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2748.656328][ C1] ? get_stack_info+0x36/0xc0 [ 2748.656571][ C1] ? stack_access_ok+0xda/0x1f0 [ 2748.656819][ C1] ? get_reg+0x119/0x190 [ 2748.657036][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2748.657306][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2748.657618][ C1] __tcf_classify+0x329/0x7d0 [ 2748.657862][ C1] tcf_classify+0x283/0x930 [ 2748.658094][ C1] ? arch_stack_walk+0xa2/0x100 [ 2748.658345][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2748.658604][ C1] ? get_stack_info+0x36/0xc0 [ 2748.658846][ C1] tc_run+0x2e4/0x5d0 [ 2748.659053][ C1] ? __pfx_tc_run+0x10/0x10 [ 2748.659289][ C1] ? lock_acquire+0x1c1/0x220 [ 2748.659529][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2748.659792][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2748.660047][ C1] ? lock_acquire+0x1c1/0x220 [ 2748.660286][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2748.660554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2748.660860][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2748.661135][ C1] ? neigh_hh_output+0x348/0x590 [ 2748.661389][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2748.661657][ C1] ip_finish_output2+0x786/0x18e0 [ 2748.661914][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2748.662195][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2748.662534][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2748.662810][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2748.663064][ C1] ? __ip_finish_output+0x10f/0x770 [ 2748.663334][ C1] ip_output+0x16b/0x4f0 [ 2748.663556][ C1] ? run_timer_softirq+0x72/0x100 [ 2748.663815][ C1] ? __pfx_ip_output+0x10/0x10 [ 2748.664061][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2748.664349][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2748.664603][ C1] ? ip_local_out+0x114/0x3b0 [ 2748.664846][ C1] __ip_queue_xmit+0x672/0x1910 [ 2748.665096][ C1] ? __create_object+0x5e/0xb0 [ 2748.665341][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2748.665611][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2748.665901][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2748.666177][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2748.666462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2748.666737][ C1] tcp_delack_timer+0x84/0x240 [ 2748.666983][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2748.667259][ C1] call_timer_fn+0x173/0x430 [ 2748.667497][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2748.667766][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2748.668044][ C1] __run_timers.part.0+0x52d/0x890 [ 2748.668306][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2748.668580][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2748.668867][ C1] ? lock_acquire+0x1c1/0x220 [ 2748.669106][ C1] ? clockevents_program_event+0xf6/0x300 [ 2748.669400][ C1] ? lock_release+0x1d5/0x250 [ 2748.669639][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2748.669905][ C1] ? ktime_get+0xb3/0x190 [ 2748.670127][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2748.670425][ C1] run_timer_softirq+0x72/0x100 [ 2748.670674][ C1] __do_softirq+0x1b9/0x7ff [ 2748.670908][ C1] irq_exit_rcu+0x98/0xc0 [ 2748.671132][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2748.671419][ C1] [ 2748.671568][ C1] [ 2748.671722][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2748.672028][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2748.672356][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2748.673338][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2748.673647][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2748.674050][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2748.674454][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2748.674855][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2748.675259][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2748.675664][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2748.675968][ C1] pipe_read+0xa16/0xdf0 [ 2748.676195][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2748.676475][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2748.676726][ C1] ? iterate_tty_write+0x299/0x540 [ 2748.676991][ C1] ? lock_release+0x1d5/0x250 [ 2748.677237][ C1] vfs_read+0x911/0xc00 [ 2748.677453][ C1] ? lock_acquire+0x1c1/0x220 [ 2748.677696][ C1] ? __might_fault+0xc6/0x180 [ 2748.677938][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2748.678180][ C1] ? __might_fault+0xc6/0x180 [ 2748.678424][ C1] ? lock_release+0x1d5/0x250 [ 2748.678669][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2748.678936][ C1] ? __fget_light+0x54/0x1e0 [ 2748.679177][ C1] ksys_read+0x17a/0x1e0 [ 2748.679396][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2748.679644][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2748.679951][ C1] do_syscall_64+0xc9/0x1e0 [ 2748.680188][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2748.680493][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2748.680723][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2748.681708][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2748.682136][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2748.682539][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2748.682944][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2748.683348][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2748.683752][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2748.684159][ C1] [ 2771.193117][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2771.193502][ C1] rcu: 1-....: (415964 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=102168 [ 2771.194056][ C1] rcu: (t=416306 jiffies g=1882453 q=685 ncpus=4) [ 2771.194390][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2771.194841][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2771.195459][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2771.195755][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2771.196732][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 2771.197042][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2771.197445][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2771.197849][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2771.198252][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2771.198652][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2771.199054][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2771.199505][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2771.199838][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2771.200240][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2771.200640][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2771.201045][ C1] PKRU: 55555554 [ 2771.201227][ C1] Call Trace: [ 2771.201399][ C1] [ 2771.201552][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2771.201827][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2771.202080][ C1] ? check_cpu_stall+0x284/0x500 [ 2771.202334][ C1] ? rcu_pending+0x92/0x360 [ 2771.202565][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2771.202835][ C1] ? update_process_times+0xb9/0x110 [ 2771.203108][ C1] ? tick_sched_handle+0x67/0x130 [ 2771.203366][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2771.203651][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2771.203895][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2771.204210][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2771.204483][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2771.204772][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2771.205039][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2771.205344][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2771.205608][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2771.205929][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2771.206232][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2771.206550][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2771.206840][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 2771.207125][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2771.207406][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2771.207719][ C1] ? get_stack_info+0x36/0xc0 [ 2771.207962][ C1] ? lock_acquire+0x1c1/0x220 [ 2771.208202][ C1] ? lock_release+0x1d5/0x250 [ 2771.208443][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2771.208693][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2771.208966][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2771.209255][ C1] ? lock_acquire+0x1c1/0x220 [ 2771.209494][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2771.209736][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2771.209996][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2771.210235][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2771.210484][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2771.210743][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2771.211023][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2771.211301][ C1] ip_local_deliver+0x19d/0x480 [ 2771.211549][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2771.211826][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2771.212090][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2771.212438][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2771.212691][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2771.213011][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2771.213279][ C1] ip_rcv+0x564/0x740 [ 2771.213483][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2771.213715][ C1] ? set_track_prepare+0x8a/0xd0 [ 2771.213970][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2771.214247][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2771.214518][ C1] ? skb_clone+0x10b/0x330 [ 2771.214750][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2771.215070][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2771.215377][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2771.215661][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2771.215972][ C1] ? __tcf_classify+0x329/0x7d0 [ 2771.216221][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2771.216460][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2771.216762][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2771.217047][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2771.217375][ C1] ? lock_acquire+0x1c1/0x220 [ 2771.217616][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2771.217914][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2771.218202][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2771.218522][ C1] ? __copy_skb_header+0xaf/0x490 [ 2771.218781][ C1] ? __skb_clone+0x57a/0x760 [ 2771.219017][ C1] netif_receive_skb+0x55/0x280 [ 2771.219268][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2771.219580][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2771.219917][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2771.220218][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2771.220494][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2771.220787][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2771.221104][ C1] ? hlock_class+0x4e/0x130 [ 2771.221339][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2771.221617][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2771.221897][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2771.222163][ C1] ? hlock_class+0x4e/0x130 [ 2771.222395][ C1] ? mark_lock+0x38/0x3e0 [ 2771.222617][ C1] ? stack_access_ok+0xda/0x1f0 [ 2771.222869][ C1] ? __lock_acquire+0xb67/0x1610 [ 2771.223127][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2771.223406][ C1] ? get_stack_info+0x36/0xc0 [ 2771.223650][ C1] ? stack_access_ok+0xda/0x1f0 [ 2771.223900][ C1] ? get_reg+0x119/0x190 [ 2771.224119][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2771.224389][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2771.224702][ C1] __tcf_classify+0x329/0x7d0 [ 2771.224949][ C1] tcf_classify+0x283/0x930 [ 2771.225184][ C1] ? arch_stack_walk+0xa2/0x100 [ 2771.225435][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2771.225701][ C1] ? get_stack_info+0x36/0xc0 [ 2771.225946][ C1] tc_run+0x2e4/0x5d0 [ 2771.226152][ C1] ? __pfx_tc_run+0x10/0x10 [ 2771.226388][ C1] ? lock_acquire+0x1c1/0x220 [ 2771.226630][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2771.226894][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2771.227152][ C1] ? lock_acquire+0x1c1/0x220 [ 2771.227392][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2771.227661][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2771.227969][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2771.228247][ C1] ? neigh_hh_output+0x348/0x590 [ 2771.228503][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2771.228773][ C1] ip_finish_output2+0x786/0x18e0 [ 2771.229032][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2771.229312][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2771.229652][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2771.229932][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2771.230188][ C1] ? __ip_finish_output+0x10f/0x770 [ 2771.230455][ C1] ip_output+0x16b/0x4f0 [ 2771.230674][ C1] ? run_timer_softirq+0x72/0x100 [ 2771.230931][ C1] ? __pfx_ip_output+0x10/0x10 [ 2771.231177][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2771.231463][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2771.231716][ C1] ? ip_local_out+0x114/0x3b0 [ 2771.231959][ C1] __ip_queue_xmit+0x672/0x1910 [ 2771.232210][ C1] ? __create_object+0x5e/0xb0 [ 2771.232454][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2771.232722][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2771.233004][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2771.233278][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2771.233563][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2771.233836][ C1] tcp_delack_timer+0x84/0x240 [ 2771.234082][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2771.234355][ C1] call_timer_fn+0x173/0x430 [ 2771.234593][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2771.234860][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2771.235124][ C1] __run_timers.part.0+0x52d/0x890 [ 2771.235386][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2771.235661][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2771.235958][ C1] ? lock_acquire+0x1c1/0x220 [ 2771.236196][ C1] ? clockevents_program_event+0xf6/0x300 [ 2771.236490][ C1] ? lock_release+0x1d5/0x250 [ 2771.236730][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2771.236997][ C1] ? ktime_get+0xb3/0x190 [ 2771.237219][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2771.237522][ C1] run_timer_softirq+0x72/0x100 [ 2771.237772][ C1] __do_softirq+0x1b9/0x7ff [ 2771.238005][ C1] irq_exit_rcu+0x98/0xc0 [ 2771.238231][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2771.238518][ C1] [ 2771.238669][ C1] [ 2771.238821][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2771.239129][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2771.239457][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2771.240434][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2771.240746][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2771.241148][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2771.241548][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2771.241948][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2771.242351][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2771.242754][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2771.243053][ C1] pipe_read+0xa16/0xdf0 [ 2771.243276][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2771.243555][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2771.243801][ C1] ? iterate_tty_write+0x299/0x540 [ 2771.244064][ C1] ? lock_release+0x1d5/0x250 [ 2771.244308][ C1] vfs_read+0x911/0xc00 [ 2771.244523][ C1] ? lock_acquire+0x1c1/0x220 [ 2771.244768][ C1] ? __might_fault+0xc6/0x180 [ 2771.245011][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2771.245250][ C1] ? __might_fault+0xc6/0x180 [ 2771.245492][ C1] ? lock_release+0x1d5/0x250 [ 2771.245739][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2771.246006][ C1] ? __fget_light+0x54/0x1e0 [ 2771.246245][ C1] ksys_read+0x17a/0x1e0 [ 2771.246471][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2771.246716][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2771.247023][ C1] do_syscall_64+0xc9/0x1e0 [ 2771.247256][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2771.247558][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2771.247788][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2771.248763][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2771.249187][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2771.249588][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2771.249989][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2771.250389][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2771.250787][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2771.251192][ C1] [ 2771.251357][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2771.251645][ C2] NMI backtrace for cpu 2 [ 2771.251655][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2771.251662][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2771.251667][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2771.251678][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2771.251684][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2771.251689][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2771.251693][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2771.251697][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2771.251701][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2771.251704][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2771.251708][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2771.251713][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2771.251718][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2771.251722][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2771.251725][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2771.251728][ C2] PKRU: 55555554 [ 2771.251731][ C2] Call Trace: [ 2771.251735][ C2] [ 2771.251741][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2771.251754][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2771.251763][ C2] ? nmi_handle+0x153/0x420 [ 2771.251773][ C2] ? default_do_nmi+0x41/0x100 [ 2771.251780][ C2] ? exc_nmi+0xf3/0x120 [ 2771.251786][ C2] ? end_repeat_nmi+0xf/0x60 [ 2771.251799][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2771.251807][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2771.251812][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2771.251815][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2771.251818][ C2] [ 2771.251819][ C2] [ 2771.251820][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2771.251823][ C2] ? get_stack_info+0x36/0xc0 [ 2771.251827][ C2] ? lock_acquire+0x1c1/0x220 [ 2771.251831][ C2] ? lock_release+0x1d5/0x250 [ 2771.251834][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2771.251838][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2771.251841][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2771.251844][ C2] ? lock_acquire+0x1c1/0x220 [ 2771.251846][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2771.251850][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2771.251853][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2771.251860][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2771.251862][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2771.251867][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2771.251874][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2771.251877][ C2] ip_local_deliver+0x19d/0x480 [ 2771.251880][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2771.251882][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2771.251884][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2771.251891][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2771.251895][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2771.251898][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2771.251908][ C2] ip_rcv+0x564/0x740 [ 2771.251911][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2771.251913][ C2] ? set_track_prepare+0x8a/0xd0 [ 2771.251918][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2771.251921][ C2] ? start_secondary+0x21c/0x2b0 [ 2771.251924][ C2] ? skb_clone+0x10b/0x330 [ 2771.251928][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2771.251935][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2771.251940][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2771.251945][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2771.251954][ C2] ? __tcf_classify+0x329/0x7d0 [ 2771.251958][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2771.251960][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2771.251964][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2771.251967][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2771.251971][ C2] ? lock_acquire+0x1c1/0x220 [ 2771.251973][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2771.251977][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2771.251981][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2771.251985][ C2] ? __copy_skb_header+0xaf/0x490 [ 2771.251990][ C2] ? __skb_clone+0x57a/0x760 [ 2771.251992][ C2] netif_receive_skb+0x55/0x280 [ 2771.251995][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2771.252003][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2771.252010][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2771.252017][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2771.252022][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2771.252032][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2771.252039][ C2] ? get_stack_info+0x36/0xc0 [ 2771.252044][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2771.252047][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2771.252052][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2771.252054][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2771.252058][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2771.252060][ C2] ? kernel_text_address+0x17/0xe0 [ 2771.252063][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2771.252068][ C2] ? arch_stack_walk+0x8c/0x100 [ 2771.252072][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2771.252075][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2771.252079][ C2] ? lock_acquire+0x1c1/0x220 [ 2771.252081][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2771.252086][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2771.252091][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2771.252094][ C2] ? get_stack_info+0x36/0xc0 [ 2771.252098][ C2] __tcf_classify+0x329/0x7d0 [ 2771.252103][ C2] tcf_classify+0x283/0x930 [ 2771.252108][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2771.252111][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2771.252115][ C2] tc_run+0x2e4/0x5d0 [ 2771.252120][ C2] ? __pfx_tc_run+0x10/0x10 [ 2771.252123][ C2] ? lock_acquire+0x1c1/0x220 [ 2771.252125][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2771.252129][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2771.252133][ C2] ? lock_acquire+0x1c1/0x220 [ 2771.252136][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2771.252139][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2771.252143][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2771.252145][ C2] ? neigh_hh_output+0x348/0x590 [ 2771.252149][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2771.252153][ C2] ip_finish_output2+0x786/0x18e0 [ 2771.252156][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2771.252164][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2771.252167][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2771.252170][ C2] ? __ip_finish_output+0x10f/0x770 [ 2771.252174][ C2] ip_output+0x16b/0x4f0 [ 2771.252177][ C2] ? __pfx_ip_output+0x10/0x10 [ 2771.252180][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2771.252183][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2771.252186][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2771.252189][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2771.252192][ C2] ? __alloc_skb+0xd4/0x280 [ 2771.252194][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2771.252199][ C2] ? tcp_fragment+0x168/0x1040 [ 2771.252202][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2771.252205][ C2] ? ip_local_out+0x114/0x3b0 [ 2771.252209][ C2] __ip_queue_xmit+0x672/0x1910 [ 2771.252212][ C2] ? __skb_clone+0x57a/0x760 [ 2771.252215][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2771.252220][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2771.252223][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2771.252227][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2771.252232][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2771.252236][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2771.252239][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2771.252242][ C2] tcp_send_loss_probe+0x348/0x830 [ 2771.252245][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2771.252248][ C2] tcp_write_timer+0x82/0x1d0 [ 2771.252252][ C2] call_timer_fn+0x173/0x430 [ 2771.252256][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2771.252261][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2771.252265][ C2] __run_timers.part.0+0x52d/0x890 [ 2771.252268][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2771.252272][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2771.252275][ C2] ? lock_acquire+0x1c1/0x220 [ 2771.252278][ C2] ? clockevents_program_event+0xf6/0x300 [ 2771.252283][ C2] ? lock_release+0x1d5/0x250 [ 2771.252285][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2771.252289][ C2] ? ktime_get+0xb3/0x190 [ 2771.252293][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2771.252297][ C2] run_timer_softirq+0x72/0x100 [ 2771.252300][ C2] __do_softirq+0x1b9/0x7ff [ 2771.252305][ C2] irq_exit_rcu+0x98/0xc0 [ 2771.252308][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2771.252312][ C2] [ 2771.252313][ C2] [ 2771.252314][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2771.252317][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2771.252321][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2771.252323][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2771.252325][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2771.252327][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2771.252329][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2771.252330][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2771.252332][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2771.252335][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2771.252338][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2771.252341][ C2] default_idle_call+0x69/0xa0 [ 2771.252345][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2771.252347][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2771.252351][ C2] ? lock_release+0x1d5/0x250 [ 2771.252353][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2771.252357][ C2] do_idle+0xfb/0x160 [ 2771.252360][ C2] cpu_startup_entry+0x55/0x60 [ 2771.252362][ C2] start_secondary+0x21c/0x2b0 [ 2771.252365][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2771.252369][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2771.252376][ C2] [ 2796.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 413s! [perl:4135] [ 2796.569701][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2796.570974][ C1] irq event stamp: 209232 [ 2796.571195][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2796.571726][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2796.572205][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2796.572675][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2796.573142][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2796.573592][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2796.574206][ C1] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 2796.574500][ C1] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 2796.575473][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000246 [ 2796.575789][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 2796.576193][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2796.576592][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 2796.576992][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2796.577393][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2796.577794][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2796.578243][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2796.578576][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2796.578980][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2796.579382][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2796.579786][ C1] PKRU: 55555554 [ 2796.579968][ C1] Call Trace: [ 2796.580141][ C1] [ 2796.580290][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2796.580553][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2796.580798][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2796.581076][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2796.581350][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2796.581641][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2796.581907][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2796.582216][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2796.582478][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 2796.582741][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2796.583053][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2796.583349][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2796.583664][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2796.583955][ C1] ? kasan_check_range+0x158/0x1c0 [ 2796.584218][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2796.584500][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2796.584814][ C1] ? get_stack_info+0x36/0xc0 [ 2796.585058][ C1] ? lock_acquire+0x1c1/0x220 [ 2796.585301][ C1] ? lock_release+0x1d5/0x250 [ 2796.585548][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2796.585800][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2796.586074][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2796.586363][ C1] ? lock_acquire+0x1c1/0x220 [ 2796.586604][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2796.586845][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2796.587108][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2796.587344][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2796.587594][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2796.587854][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2796.588133][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2796.588412][ C1] ip_local_deliver+0x19d/0x480 [ 2796.588660][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2796.588935][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2796.589202][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2796.589552][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2796.589807][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2796.590131][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2796.590396][ C1] ip_rcv+0x564/0x740 [ 2796.590600][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2796.590834][ C1] ? set_track_prepare+0x8a/0xd0 [ 2796.591089][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2796.591369][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2796.591644][ C1] ? skb_clone+0x10b/0x330 [ 2796.591874][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2796.592196][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2796.592505][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2796.592790][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2796.593088][ C1] ? __tcf_classify+0x329/0x7d0 [ 2796.593338][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2796.593572][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2796.593875][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2796.594162][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2796.594489][ C1] ? lock_acquire+0x1c1/0x220 [ 2796.594730][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2796.595030][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2796.595318][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2796.595644][ C1] ? __copy_skb_header+0xaf/0x490 [ 2796.595903][ C1] ? __skb_clone+0x57a/0x760 [ 2796.596140][ C1] netif_receive_skb+0x55/0x280 [ 2796.596388][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2796.596700][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2796.597035][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2796.597335][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2796.597611][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2796.597901][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2796.598214][ C1] ? hlock_class+0x4e/0x130 [ 2796.598447][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2796.598724][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2796.599000][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2796.599265][ C1] ? hlock_class+0x4e/0x130 [ 2796.599496][ C1] ? mark_lock+0x38/0x3e0 [ 2796.599716][ C1] ? stack_access_ok+0xda/0x1f0 [ 2796.599966][ C1] ? __lock_acquire+0xb67/0x1610 [ 2796.600223][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2796.600499][ C1] ? get_stack_info+0x36/0xc0 [ 2796.600739][ C1] ? stack_access_ok+0xda/0x1f0 [ 2796.600987][ C1] ? get_reg+0x119/0x190 [ 2796.601204][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2796.601471][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2796.601784][ C1] __tcf_classify+0x329/0x7d0 [ 2796.602026][ C1] tcf_classify+0x283/0x930 [ 2796.602258][ C1] ? arch_stack_walk+0xa2/0x100 [ 2796.602506][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2796.602762][ C1] ? get_stack_info+0x36/0xc0 [ 2796.603004][ C1] tc_run+0x2e4/0x5d0 [ 2796.603210][ C1] ? __pfx_tc_run+0x10/0x10 [ 2796.603443][ C1] ? lock_acquire+0x1c1/0x220 [ 2796.603683][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2796.603944][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2796.604199][ C1] ? lock_acquire+0x1c1/0x220 [ 2796.604436][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2796.604701][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2796.605004][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2796.605279][ C1] ? neigh_hh_output+0x348/0x590 [ 2796.605531][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2796.605802][ C1] ip_finish_output2+0x786/0x18e0 [ 2796.606059][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2796.606337][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2796.606674][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2796.606949][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2796.607203][ C1] ? __ip_finish_output+0x10f/0x770 [ 2796.607468][ C1] ip_output+0x16b/0x4f0 [ 2796.607686][ C1] ? run_timer_softirq+0x72/0x100 [ 2796.607943][ C1] ? __pfx_ip_output+0x10/0x10 [ 2796.608187][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2796.608474][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2796.608726][ C1] ? ip_local_out+0x114/0x3b0 [ 2796.608967][ C1] __ip_queue_xmit+0x672/0x1910 [ 2796.609216][ C1] ? __create_object+0x5e/0xb0 [ 2796.609460][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2796.609728][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2796.610010][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2796.610284][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2796.610567][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2796.610840][ C1] tcp_delack_timer+0x84/0x240 [ 2796.611084][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2796.611358][ C1] call_timer_fn+0x173/0x430 [ 2796.611594][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2796.611856][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2796.612117][ C1] __run_timers.part.0+0x52d/0x890 [ 2796.612378][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2796.612651][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2796.612936][ C1] ? lock_acquire+0x1c1/0x220 [ 2796.613175][ C1] ? clockevents_program_event+0xf6/0x300 [ 2796.613468][ C1] ? lock_release+0x1d5/0x250 [ 2796.613707][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2796.613972][ C1] ? ktime_get+0xb3/0x190 [ 2796.614194][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2796.614490][ C1] run_timer_softirq+0x72/0x100 [ 2796.614738][ C1] __do_softirq+0x1b9/0x7ff [ 2796.614970][ C1] irq_exit_rcu+0x98/0xc0 [ 2796.615193][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2796.615479][ C1] [ 2796.615635][ C1] [ 2796.615786][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2796.616091][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2796.616418][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2796.617388][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2796.617701][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2796.618101][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2796.618501][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2796.618899][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2796.619300][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2796.619702][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2796.619998][ C1] pipe_read+0xa16/0xdf0 [ 2796.620220][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2796.620502][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2796.620745][ C1] ? iterate_tty_write+0x299/0x540 [ 2796.621007][ C1] ? lock_release+0x1d5/0x250 [ 2796.621250][ C1] vfs_read+0x911/0xc00 [ 2796.621463][ C1] ? lock_acquire+0x1c1/0x220 [ 2796.621702][ C1] ? __might_fault+0xc6/0x180 [ 2796.621943][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2796.622181][ C1] ? __might_fault+0xc6/0x180 [ 2796.622421][ C1] ? lock_release+0x1d5/0x250 [ 2796.622661][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2796.622925][ C1] ? __fget_light+0x54/0x1e0 [ 2796.623165][ C1] ksys_read+0x17a/0x1e0 [ 2796.623382][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2796.623632][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2796.623939][ C1] do_syscall_64+0xc9/0x1e0 [ 2796.624171][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2796.624472][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2796.624699][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2796.625681][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2796.626103][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2796.626501][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2796.626902][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2796.627303][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2796.627701][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2796.628101][ C1] [ 2796.628263][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 413s! [swapper/2:0] [ 2796.628690][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2796.629947][ C2] irq event stamp: 44114564 [ 2796.630180][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2796.630715][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2796.631226][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2796.631702][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2796.632173][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2796.632627][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2796.633238][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2796.633565][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2796.634540][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2796.634847][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2796.635249][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2796.635656][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2796.636056][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2796.636457][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2796.636858][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2796.637307][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2796.637639][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2796.638038][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2796.638439][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2796.638839][ C2] PKRU: 55555554 [ 2796.639022][ C2] Call Trace: [ 2796.639193][ C2] [ 2796.639346][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2796.639615][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2796.639860][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2796.640138][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2796.640410][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2796.640699][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2796.640967][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2796.641279][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2796.641543][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2796.641811][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2796.642127][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2796.642431][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2796.642749][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2796.643041][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2796.643344][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2796.643640][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2796.643957][ C2] ? get_stack_info+0x36/0xc0 [ 2796.644204][ C2] ? lock_acquire+0x1c1/0x220 [ 2796.644448][ C2] ? lock_release+0x1d5/0x250 [ 2796.644695][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2796.644948][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2796.645231][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2796.645520][ C2] ? lock_acquire+0x1c1/0x220 [ 2796.645775][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2796.646022][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2796.646287][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2796.646526][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2796.646776][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2796.647037][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2796.647321][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2796.647605][ C2] ip_local_deliver+0x19d/0x480 [ 2796.647857][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2796.648132][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2796.648401][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2796.648759][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2796.649015][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2796.649342][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2796.649610][ C2] ip_rcv+0x564/0x740 [ 2796.649821][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2796.650053][ C2] ? set_track_prepare+0x8a/0xd0 [ 2796.650310][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2796.650591][ C2] ? start_secondary+0x21c/0x2b0 [ 2796.650847][ C2] ? skb_clone+0x10b/0x330 [ 2796.651083][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2796.651407][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2796.651720][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2796.652004][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2796.652304][ C2] ? __tcf_classify+0x329/0x7d0 [ 2796.652554][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2796.652788][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2796.653089][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2796.653374][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2796.653699][ C2] ? lock_acquire+0x1c1/0x220 [ 2796.653943][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2796.654241][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2796.654526][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2796.654843][ C2] ? __copy_skb_header+0xaf/0x490 [ 2796.655100][ C2] ? __skb_clone+0x57a/0x760 [ 2796.655337][ C2] netif_receive_skb+0x55/0x280 [ 2796.655593][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2796.655904][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2796.656239][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2796.656539][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2796.656812][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2796.657104][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2796.657417][ C2] ? get_stack_info+0x36/0xc0 [ 2796.657656][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2796.657922][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2796.658241][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2796.658525][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2796.658809][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2796.659130][ C2] ? kernel_text_address+0x17/0xe0 [ 2796.659390][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2796.659705][ C2] ? arch_stack_walk+0x8c/0x100 [ 2796.659952][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2796.660217][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2796.660504][ C2] ? lock_acquire+0x1c1/0x220 [ 2796.660746][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2796.661031][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2796.661342][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2796.661625][ C2] ? get_stack_info+0x36/0xc0 [ 2796.661866][ C2] __tcf_classify+0x329/0x7d0 [ 2796.662108][ C2] tcf_classify+0x283/0x930 [ 2796.662341][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2796.662596][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2796.662908][ C2] tc_run+0x2e4/0x5d0 [ 2796.663114][ C2] ? __pfx_tc_run+0x10/0x10 [ 2796.663343][ C2] ? lock_acquire+0x1c1/0x220 [ 2796.663581][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2796.663840][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2796.664092][ C2] ? lock_acquire+0x1c1/0x220 [ 2796.664330][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2796.664594][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2796.664896][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2796.665167][ C2] ? neigh_hh_output+0x348/0x590 [ 2796.665419][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2796.665691][ C2] ip_finish_output2+0x786/0x18e0 [ 2796.665948][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2796.666284][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2796.666559][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2796.666810][ C2] ? __ip_finish_output+0x10f/0x770 [ 2796.667075][ C2] ip_output+0x16b/0x4f0 [ 2796.667292][ C2] ? __pfx_ip_output+0x10/0x10 [ 2796.667534][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2796.667809][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2796.668124][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2796.668399][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2796.668650][ C2] ? __alloc_skb+0xd4/0x280 [ 2796.668881][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2796.669151][ C2] ? tcp_fragment+0x168/0x1040 [ 2796.669395][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2796.669646][ C2] ? ip_local_out+0x114/0x3b0 [ 2796.669884][ C2] __ip_queue_xmit+0x672/0x1910 [ 2796.670132][ C2] ? __skb_clone+0x57a/0x760 [ 2796.670368][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2796.670633][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2796.670913][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2796.671157][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2796.671408][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2796.671715][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2796.672034][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2796.672279][ C2] tcp_send_loss_probe+0x348/0x830 [ 2796.672538][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2796.672805][ C2] tcp_write_timer+0x82/0x1d0 [ 2796.673044][ C2] call_timer_fn+0x173/0x430 [ 2796.673280][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2796.673541][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2796.673801][ C2] __run_timers.part.0+0x52d/0x890 [ 2796.674062][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2796.674331][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2796.674613][ C2] ? lock_acquire+0x1c1/0x220 [ 2796.674851][ C2] ? clockevents_program_event+0xf6/0x300 [ 2796.675142][ C2] ? lock_release+0x1d5/0x250 [ 2796.675379][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2796.675651][ C2] ? ktime_get+0xb3/0x190 [ 2796.675874][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2796.676169][ C2] run_timer_softirq+0x72/0x100 [ 2796.676417][ C2] __do_softirq+0x1b9/0x7ff [ 2796.676651][ C2] irq_exit_rcu+0x98/0xc0 [ 2796.676869][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2796.677157][ C2] [ 2796.677306][ C2] [ 2796.677457][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2796.677758][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2796.678015][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2796.678984][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2796.679291][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2796.679690][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2796.680089][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2796.680486][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2796.680884][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2796.681285][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2796.681572][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2796.681832][ C2] default_idle_call+0x69/0xa0 [ 2796.682075][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2796.682327][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2796.682602][ C2] ? lock_release+0x1d5/0x250 [ 2796.682840][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2796.683112][ C2] do_idle+0xfb/0x160 [ 2796.683314][ C2] cpu_startup_entry+0x55/0x60 [ 2796.683557][ C2] start_secondary+0x21c/0x2b0 [ 2796.683800][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2796.684068][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2796.684379][ C2] [ 2824.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 439s! [swapper/2:0] [ 2824.569694][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2824.570948][ C2] irq event stamp: 44114564 [ 2824.571178][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2824.571712][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2824.572223][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2824.572700][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2824.573172][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2824.573628][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2824.574236][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2824.574559][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2824.575536][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2824.575842][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2824.576242][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2824.576639][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2824.577037][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2824.577434][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2824.577832][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2824.578280][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2824.578613][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2824.579010][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2824.579408][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2824.579808][ C2] PKRU: 55555554 [ 2824.579988][ C2] Call Trace: [ 2824.580159][ C2] [ 2824.580308][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2824.580570][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2824.580818][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2824.581101][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2824.581380][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2824.581672][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2824.581939][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2824.582243][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2824.582503][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2824.582769][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2824.583080][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2824.583382][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2824.583700][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2824.583990][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2824.584291][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2824.584582][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2824.584897][ C2] ? get_stack_info+0x36/0xc0 [ 2824.585143][ C2] ? lock_acquire+0x1c1/0x220 [ 2824.585389][ C2] ? lock_release+0x1d5/0x250 [ 2824.585638][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2824.585887][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2824.586168][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2824.586457][ C2] ? lock_acquire+0x1c1/0x220 [ 2824.586699][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2824.586943][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2824.587210][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2824.587443][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2824.587690][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2824.587946][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2824.588221][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2824.588499][ C2] ip_local_deliver+0x19d/0x480 [ 2824.588745][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2824.589016][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2824.589278][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2824.589624][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2824.589877][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2824.590196][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2824.590458][ C2] ip_rcv+0x564/0x740 [ 2824.590661][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2824.590892][ C2] ? set_track_prepare+0x8a/0xd0 [ 2824.591145][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2824.591419][ C2] ? start_secondary+0x21c/0x2b0 [ 2824.591670][ C2] ? skb_clone+0x10b/0x330 [ 2824.591896][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2824.592216][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2824.592519][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2824.592800][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2824.593092][ C2] ? __tcf_classify+0x329/0x7d0 [ 2824.593340][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2824.593570][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2824.593869][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2824.594153][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2824.594480][ C2] ? lock_acquire+0x1c1/0x220 [ 2824.594719][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2824.595012][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2824.595302][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2824.595624][ C2] ? __copy_skb_header+0xaf/0x490 [ 2824.595882][ C2] ? __skb_clone+0x57a/0x760 [ 2824.596116][ C2] netif_receive_skb+0x55/0x280 [ 2824.596362][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2824.596674][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2824.597008][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2824.597317][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2824.597589][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2824.597879][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2824.598189][ C2] ? get_stack_info+0x36/0xc0 [ 2824.598431][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2824.598692][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2824.599007][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2824.599283][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2824.599560][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2824.599873][ C2] ? kernel_text_address+0x17/0xe0 [ 2824.600134][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2824.600446][ C2] ? arch_stack_walk+0x8c/0x100 [ 2824.600693][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2824.600956][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2824.601240][ C2] ? lock_acquire+0x1c1/0x220 [ 2824.601479][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2824.601759][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2824.602064][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2824.602338][ C2] ? get_stack_info+0x36/0xc0 [ 2824.602578][ C2] __tcf_classify+0x329/0x7d0 [ 2824.602819][ C2] tcf_classify+0x283/0x930 [ 2824.603050][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2824.603305][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2824.603617][ C2] tc_run+0x2e4/0x5d0 [ 2824.603823][ C2] ? __pfx_tc_run+0x10/0x10 [ 2824.604053][ C2] ? lock_acquire+0x1c1/0x220 [ 2824.604292][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2824.604552][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2824.604805][ C2] ? lock_acquire+0x1c1/0x220 [ 2824.605043][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2824.605308][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2824.605616][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2824.605888][ C2] ? neigh_hh_output+0x348/0x590 [ 2824.606144][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2824.606407][ C2] ip_finish_output2+0x786/0x18e0 [ 2824.606667][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2824.607001][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2824.607276][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2824.607527][ C2] ? __ip_finish_output+0x10f/0x770 [ 2824.607789][ C2] ip_output+0x16b/0x4f0 [ 2824.608007][ C2] ? __pfx_ip_output+0x10/0x10 [ 2824.608250][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2824.608524][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2824.608836][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2824.609111][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2824.609360][ C2] ? __alloc_skb+0xd4/0x280 [ 2824.609591][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2824.609860][ C2] ? tcp_fragment+0x168/0x1040 [ 2824.610104][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2824.610355][ C2] ? ip_local_out+0x114/0x3b0 [ 2824.610592][ C2] __ip_queue_xmit+0x672/0x1910 [ 2824.610841][ C2] ? __skb_clone+0x57a/0x760 [ 2824.611076][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2824.611342][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2824.611619][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2824.611864][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2824.612114][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2824.612414][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2824.612732][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2824.612974][ C2] tcp_send_loss_probe+0x348/0x830 [ 2824.613235][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2824.613502][ C2] tcp_write_timer+0x82/0x1d0 [ 2824.613741][ C2] call_timer_fn+0x173/0x430 [ 2824.613976][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2824.614237][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2824.614496][ C2] __run_timers.part.0+0x52d/0x890 [ 2824.614757][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2824.615026][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2824.615309][ C2] ? lock_acquire+0x1c1/0x220 [ 2824.615557][ C2] ? clockevents_program_event+0xf6/0x300 [ 2824.615844][ C2] ? lock_release+0x1d5/0x250 [ 2824.616082][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2824.616344][ C2] ? ktime_get+0xb3/0x190 [ 2824.616565][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2824.616859][ C2] run_timer_softirq+0x72/0x100 [ 2824.617106][ C2] __do_softirq+0x1b9/0x7ff [ 2824.617341][ C2] irq_exit_rcu+0x98/0xc0 [ 2824.617559][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2824.617844][ C2] [ 2824.617993][ C2] [ 2824.618142][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2824.618446][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2824.618702][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2824.619677][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2824.619985][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2824.620385][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2824.620790][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2824.621197][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2824.621600][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2824.622005][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2824.622301][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2824.622564][ C2] default_idle_call+0x69/0xa0 [ 2824.622811][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2824.623067][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2824.623349][ C2] ? lock_release+0x1d5/0x250 [ 2824.623592][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2824.623867][ C2] do_idle+0xfb/0x160 [ 2824.624073][ C2] cpu_startup_entry+0x55/0x60 [ 2824.624325][ C2] start_secondary+0x21c/0x2b0 [ 2824.624573][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2824.624846][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2824.625163][ C2] [ 2824.625322][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 439s! [perl:4135] [ 2824.625754][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2824.627014][ C1] irq event stamp: 209232 [ 2824.627233][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2824.627766][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2824.628246][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2824.628715][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2824.629181][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2824.629630][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2824.630245][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 2824.630534][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 2824.631509][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 2824.631816][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2824.632219][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2824.632619][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2824.633018][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2824.633417][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2824.633820][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2824.634269][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2824.634602][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2824.635003][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2824.635409][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2824.635811][ C1] PKRU: 55555554 [ 2824.635993][ C1] Call Trace: [ 2824.636163][ C1] [ 2824.636313][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2824.636576][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2824.636819][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2824.637098][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2824.637371][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2824.637660][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2824.637926][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2824.638231][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2824.638495][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2824.638804][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2824.639103][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2824.639420][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2824.639709][ C1] ? kasan_check_range+0x12/0x1c0 [ 2824.639965][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2824.640249][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2824.640560][ C1] ? get_stack_info+0x36/0xc0 [ 2824.640801][ C1] ? lock_acquire+0x1c1/0x220 [ 2824.641042][ C1] ? lock_release+0x1d5/0x250 [ 2824.641284][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2824.641534][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2824.641810][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2824.642094][ C1] ? lock_acquire+0x1c1/0x220 [ 2824.642334][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2824.642576][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2824.642836][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2824.643070][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2824.643318][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2824.643577][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2824.643856][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2824.644136][ C1] ip_local_deliver+0x19d/0x480 [ 2824.644385][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2824.644658][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2824.644922][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2824.645273][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2824.645537][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2824.645858][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2824.646122][ C1] ip_rcv+0x564/0x740 [ 2824.646327][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2824.646557][ C1] ? set_track_prepare+0x8a/0xd0 [ 2824.646811][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2824.647089][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2824.647363][ C1] ? skb_clone+0x10b/0x330 [ 2824.647589][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2824.647910][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2824.648218][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2824.648500][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2824.648799][ C1] ? __tcf_classify+0x329/0x7d0 [ 2824.649050][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2824.649281][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2824.649583][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2824.649869][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2824.650196][ C1] ? lock_acquire+0x1c1/0x220 [ 2824.650433][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2824.650732][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2824.651018][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2824.651336][ C1] ? __copy_skb_header+0xaf/0x490 [ 2824.651595][ C1] ? __skb_clone+0x57a/0x760 [ 2824.651831][ C1] netif_receive_skb+0x55/0x280 [ 2824.652081][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2824.652396][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2824.652729][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2824.653029][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2824.653307][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2824.653595][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2824.653908][ C1] ? hlock_class+0x4e/0x130 [ 2824.654143][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2824.654420][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2824.654696][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2824.654960][ C1] ? hlock_class+0x4e/0x130 [ 2824.655193][ C1] ? mark_lock+0x38/0x3e0 [ 2824.655418][ C1] ? stack_access_ok+0xda/0x1f0 [ 2824.655669][ C1] ? __lock_acquire+0xb67/0x1610 [ 2824.655925][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2824.656205][ C1] ? get_stack_info+0x36/0xc0 [ 2824.656447][ C1] ? stack_access_ok+0xda/0x1f0 [ 2824.656695][ C1] ? get_reg+0x119/0x190 [ 2824.656912][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2824.657182][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2824.657493][ C1] __tcf_classify+0x329/0x7d0 [ 2824.657735][ C1] tcf_classify+0x283/0x930 [ 2824.657969][ C1] ? arch_stack_walk+0xa2/0x100 [ 2824.658221][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2824.658478][ C1] ? get_stack_info+0x36/0xc0 [ 2824.658720][ C1] tc_run+0x2e4/0x5d0 [ 2824.658929][ C1] ? __pfx_tc_run+0x10/0x10 [ 2824.659163][ C1] ? lock_acquire+0x1c1/0x220 [ 2824.659407][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2824.659674][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2824.659932][ C1] ? lock_acquire+0x1c1/0x220 [ 2824.660177][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2824.660447][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2824.660764][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2824.661042][ C1] ? neigh_hh_output+0x348/0x590 [ 2824.661301][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2824.661571][ C1] ip_finish_output2+0x786/0x18e0 [ 2824.661832][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2824.662117][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2824.662464][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2824.662747][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2824.663001][ C1] ? __ip_finish_output+0x10f/0x770 [ 2824.663266][ C1] ip_output+0x16b/0x4f0 [ 2824.663482][ C1] ? run_timer_softirq+0x72/0x100 [ 2824.663740][ C1] ? __pfx_ip_output+0x10/0x10 [ 2824.663984][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2824.664272][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2824.664528][ C1] ? ip_local_out+0x114/0x3b0 [ 2824.664769][ C1] __ip_queue_xmit+0x672/0x1910 [ 2824.665018][ C1] ? __create_object+0x5e/0xb0 [ 2824.665263][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2824.665537][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2824.665818][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2824.666094][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2824.666374][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2824.666647][ C1] tcp_delack_timer+0x84/0x240 [ 2824.666891][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2824.667163][ C1] call_timer_fn+0x173/0x430 [ 2824.667401][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2824.667663][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2824.667924][ C1] __run_timers.part.0+0x52d/0x890 [ 2824.668184][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2824.668458][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2824.668749][ C1] ? lock_acquire+0x1c1/0x220 [ 2824.668990][ C1] ? clockevents_program_event+0xf6/0x300 [ 2824.669280][ C1] ? lock_release+0x1d5/0x250 [ 2824.669522][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2824.669786][ C1] ? ktime_get+0xb3/0x190 [ 2824.670007][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2824.670305][ C1] run_timer_softirq+0x72/0x100 [ 2824.670553][ C1] __do_softirq+0x1b9/0x7ff [ 2824.670787][ C1] irq_exit_rcu+0x98/0xc0 [ 2824.671007][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2824.671294][ C1] [ 2824.671446][ C1] [ 2824.671596][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2824.671907][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2824.672233][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2824.673204][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2824.673513][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2824.673912][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2824.674312][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2824.674713][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2824.675112][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2824.675519][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2824.675817][ C1] pipe_read+0xa16/0xdf0 [ 2824.676037][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2824.676317][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2824.676560][ C1] ? iterate_tty_write+0x299/0x540 [ 2824.676821][ C1] ? lock_release+0x1d5/0x250 [ 2824.677063][ C1] vfs_read+0x911/0xc00 [ 2824.677278][ C1] ? lock_acquire+0x1c1/0x220 [ 2824.677517][ C1] ? __might_fault+0xc6/0x180 [ 2824.677758][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2824.677999][ C1] ? __might_fault+0xc6/0x180 [ 2824.678238][ C1] ? lock_release+0x1d5/0x250 [ 2824.678478][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2824.678742][ C1] ? __fget_light+0x54/0x1e0 [ 2824.678981][ C1] ksys_read+0x17a/0x1e0 [ 2824.679198][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2824.679444][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2824.679750][ C1] do_syscall_64+0xc9/0x1e0 [ 2824.679983][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2824.680281][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2824.680512][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2824.681486][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2824.681913][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2824.682316][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2824.682721][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2824.683122][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2824.683524][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2824.683929][ C1] [ 2849.251103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2849.251473][ C1] rcu: 1-....: (493793 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=121105 [ 2849.252029][ C1] rcu: (t=494364 jiffies g=1882453 q=688 ncpus=4) [ 2849.252362][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2849.252813][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2849.253432][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 2849.253726][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 2849.254702][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 2849.255013][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2849.255420][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2849.255823][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2849.256225][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2849.256625][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2849.257026][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2849.257475][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2849.257812][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2849.258214][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2849.258613][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2849.259016][ C1] PKRU: 55555554 [ 2849.259198][ C1] Call Trace: [ 2849.259372][ C1] [ 2849.259528][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2849.259806][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2849.260060][ C1] ? check_cpu_stall+0x284/0x500 [ 2849.260314][ C1] ? rcu_pending+0x92/0x360 [ 2849.260544][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2849.260817][ C1] ? update_process_times+0xb9/0x110 [ 2849.261088][ C1] ? tick_sched_handle+0x67/0x130 [ 2849.261346][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2849.261631][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2849.261875][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2849.262189][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2849.262462][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2849.262753][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2849.263020][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2849.263326][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2849.263590][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2849.263899][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2849.264198][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2849.264514][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2849.264804][ C1] ? kasan_check_range+0x12/0x1c0 [ 2849.265065][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2849.265357][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2849.265670][ C1] ? get_stack_info+0x36/0xc0 [ 2849.265910][ C1] ? lock_acquire+0x1c1/0x220 [ 2849.266153][ C1] ? lock_release+0x1d5/0x250 [ 2849.266394][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2849.266648][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2849.266921][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2849.267208][ C1] ? lock_acquire+0x1c1/0x220 [ 2849.267447][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2849.267688][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2849.267950][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2849.268187][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2849.268434][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2849.268693][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2849.268971][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2849.269249][ C1] ip_local_deliver+0x19d/0x480 [ 2849.269497][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2849.269768][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2849.270036][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2849.270390][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2849.270645][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2849.270967][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2849.271232][ C1] ip_rcv+0x564/0x740 [ 2849.271437][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2849.271669][ C1] ? set_track_prepare+0x8a/0xd0 [ 2849.271923][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2849.272204][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2849.272479][ C1] ? skb_clone+0x10b/0x330 [ 2849.272708][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2849.273029][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2849.273338][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2849.273623][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2849.273918][ C1] ? __tcf_classify+0x329/0x7d0 [ 2849.274170][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2849.274402][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2849.274703][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2849.274993][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2849.275327][ C1] ? lock_acquire+0x1c1/0x220 [ 2849.275567][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2849.275866][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2849.276154][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2849.276472][ C1] ? __copy_skb_header+0xaf/0x490 [ 2849.276732][ C1] ? __skb_clone+0x57a/0x760 [ 2849.276968][ C1] netif_receive_skb+0x55/0x280 [ 2849.277217][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2849.277534][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2849.277868][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2849.278169][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2849.278446][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2849.278736][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2849.279051][ C1] ? hlock_class+0x4e/0x130 [ 2849.279287][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2849.279565][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2849.279841][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2849.280108][ C1] ? hlock_class+0x4e/0x130 [ 2849.280341][ C1] ? mark_lock+0x38/0x3e0 [ 2849.280563][ C1] ? stack_access_ok+0xda/0x1f0 [ 2849.280814][ C1] ? __lock_acquire+0xb67/0x1610 [ 2849.281070][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2849.281351][ C1] ? get_stack_info+0x36/0xc0 [ 2849.281590][ C1] ? stack_access_ok+0xda/0x1f0 [ 2849.281839][ C1] ? get_reg+0x119/0x190 [ 2849.282059][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2849.282330][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2849.282643][ C1] __tcf_classify+0x329/0x7d0 [ 2849.282886][ C1] tcf_classify+0x283/0x930 [ 2849.283122][ C1] ? arch_stack_walk+0xa2/0x100 [ 2849.283379][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2849.283644][ C1] ? get_stack_info+0x36/0xc0 [ 2849.283893][ C1] tc_run+0x2e4/0x5d0 [ 2849.284104][ C1] ? __pfx_tc_run+0x10/0x10 [ 2849.284340][ C1] ? lock_acquire+0x1c1/0x220 [ 2849.284586][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2849.284854][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2849.285116][ C1] ? lock_acquire+0x1c1/0x220 [ 2849.285369][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2849.285643][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2849.285960][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2849.286239][ C1] ? neigh_hh_output+0x348/0x590 [ 2849.286499][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2849.286773][ C1] ip_finish_output2+0x786/0x18e0 [ 2849.287039][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2849.287329][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2849.287676][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2849.287961][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2849.288222][ C1] ? __ip_finish_output+0x10f/0x770 [ 2849.288495][ C1] ip_output+0x16b/0x4f0 [ 2849.288716][ C1] ? run_timer_softirq+0x72/0x100 [ 2849.288981][ C1] ? __pfx_ip_output+0x10/0x10 [ 2849.289232][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2849.289529][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2849.289787][ C1] ? ip_local_out+0x114/0x3b0 [ 2849.290033][ C1] __ip_queue_xmit+0x672/0x1910 [ 2849.290292][ C1] ? __create_object+0x5e/0xb0 [ 2849.290545][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2849.290821][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2849.291111][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2849.291395][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2849.291686][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2849.291968][ C1] tcp_delack_timer+0x84/0x240 [ 2849.292221][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2849.292499][ C1] call_timer_fn+0x173/0x430 [ 2849.292743][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2849.293015][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2849.293284][ C1] __run_timers.part.0+0x52d/0x890 [ 2849.293551][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2849.293839][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2849.294132][ C1] ? lock_acquire+0x1c1/0x220 [ 2849.294380][ C1] ? clockevents_program_event+0xf6/0x300 [ 2849.294679][ C1] ? lock_release+0x1d5/0x250 [ 2849.294922][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2849.295190][ C1] ? ktime_get+0xb3/0x190 [ 2849.295425][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2849.295724][ C1] run_timer_softirq+0x72/0x100 [ 2849.295975][ C1] __do_softirq+0x1b9/0x7ff [ 2849.296212][ C1] irq_exit_rcu+0x98/0xc0 [ 2849.296435][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2849.296726][ C1] [ 2849.296877][ C1] [ 2849.297030][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2849.297340][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2849.297668][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2849.298649][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2849.298961][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2849.299363][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2849.299771][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2849.300176][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2849.300586][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2849.300998][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2849.301299][ C1] pipe_read+0xa16/0xdf0 [ 2849.301522][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2849.301805][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2849.302050][ C1] ? iterate_tty_write+0x299/0x540 [ 2849.302314][ C1] ? lock_release+0x1d5/0x250 [ 2849.302559][ C1] vfs_read+0x911/0xc00 [ 2849.302779][ C1] ? lock_acquire+0x1c1/0x220 [ 2849.303021][ C1] ? __might_fault+0xc6/0x180 [ 2849.303270][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2849.303515][ C1] ? __might_fault+0xc6/0x180 [ 2849.303761][ C1] ? lock_release+0x1d5/0x250 [ 2849.304009][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2849.304282][ C1] ? __fget_light+0x54/0x1e0 [ 2849.304525][ C1] ksys_read+0x17a/0x1e0 [ 2849.304751][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2849.305001][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2849.305322][ C1] do_syscall_64+0xc9/0x1e0 [ 2849.305561][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2849.305872][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2849.306114][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2849.307111][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2849.307545][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2849.307956][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2849.308364][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2849.308774][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2849.309185][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2849.309602][ C1] [ 2849.309764][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2849.310045][ C2] NMI backtrace for cpu 2 [ 2849.310060][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2849.310067][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2849.310072][ C2] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 2849.310081][ C2] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 ca 35 0c fe 89 d8 [ 2849.310084][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000246 [ 2849.310088][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2849.310090][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2849.310092][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2849.310093][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2849.310096][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2849.310098][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2849.310100][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2849.310103][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2849.310104][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2849.310106][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2849.310107][ C2] PKRU: 55555554 [ 2849.310108][ C2] Call Trace: [ 2849.310112][ C2] [ 2849.310116][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2849.310124][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2849.310129][ C2] ? nmi_handle+0x153/0x420 [ 2849.310134][ C2] ? default_do_nmi+0x41/0x100 [ 2849.310137][ C2] ? exc_nmi+0xf3/0x120 [ 2849.310140][ C2] ? end_repeat_nmi+0xf/0x60 [ 2849.310145][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2849.310149][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 2849.310152][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 2849.310156][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 2849.310159][ C2] [ 2849.310160][ C2] [ 2849.310161][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2849.310164][ C2] ? get_stack_info+0x36/0xc0 [ 2849.310169][ C2] ? lock_acquire+0x1c1/0x220 [ 2849.310172][ C2] ? lock_release+0x1d5/0x250 [ 2849.310176][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2849.310181][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2849.310183][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2849.310186][ C2] ? lock_acquire+0x1c1/0x220 [ 2849.310189][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2849.310193][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2849.310196][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2849.310203][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2849.310205][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2849.310210][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2849.310217][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2849.310220][ C2] ip_local_deliver+0x19d/0x480 [ 2849.310223][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2849.310225][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2849.310228][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2849.310234][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2849.310239][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2849.310242][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2849.310251][ C2] ip_rcv+0x564/0x740 [ 2849.310254][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2849.310257][ C2] ? set_track_prepare+0x8a/0xd0 [ 2849.310261][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2849.310264][ C2] ? start_secondary+0x21c/0x2b0 [ 2849.310268][ C2] ? skb_clone+0x10b/0x330 [ 2849.310273][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2849.310279][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2849.310284][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2849.310289][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2849.310297][ C2] ? __tcf_classify+0x329/0x7d0 [ 2849.310302][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2849.310304][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2849.310307][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2849.310311][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2849.310316][ C2] ? lock_acquire+0x1c1/0x220 [ 2849.310318][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2849.310322][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2849.310326][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2849.310330][ C2] ? __copy_skb_header+0xaf/0x490 [ 2849.310335][ C2] ? __skb_clone+0x57a/0x760 [ 2849.310338][ C2] netif_receive_skb+0x55/0x280 [ 2849.310341][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2849.310350][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2849.310357][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2849.310363][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2849.310368][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2849.310378][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2849.310386][ C2] ? get_stack_info+0x36/0xc0 [ 2849.310390][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2849.310393][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2849.310398][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2849.310400][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2849.310404][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2849.310406][ C2] ? kernel_text_address+0x17/0xe0 [ 2849.310410][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2849.310414][ C2] ? arch_stack_walk+0x8c/0x100 [ 2849.310419][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2849.310422][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2849.310425][ C2] ? lock_acquire+0x1c1/0x220 [ 2849.310428][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2849.310432][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2849.310437][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2849.310440][ C2] ? get_stack_info+0x36/0xc0 [ 2849.310445][ C2] __tcf_classify+0x329/0x7d0 [ 2849.310450][ C2] tcf_classify+0x283/0x930 [ 2849.310454][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2849.310458][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2849.310462][ C2] tc_run+0x2e4/0x5d0 [ 2849.310466][ C2] ? __pfx_tc_run+0x10/0x10 [ 2849.310469][ C2] ? lock_acquire+0x1c1/0x220 [ 2849.310472][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2849.310476][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2849.310480][ C2] ? lock_acquire+0x1c1/0x220 [ 2849.310482][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2849.310486][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2849.310489][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2849.310491][ C2] ? neigh_hh_output+0x348/0x590 [ 2849.310495][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2849.310499][ C2] ip_finish_output2+0x786/0x18e0 [ 2849.310503][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2849.310510][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2849.310513][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2849.310517][ C2] ? __ip_finish_output+0x10f/0x770 [ 2849.310520][ C2] ip_output+0x16b/0x4f0 [ 2849.310523][ C2] ? __pfx_ip_output+0x10/0x10 [ 2849.310526][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2849.310529][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2849.310532][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2849.310536][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2849.310539][ C2] ? __alloc_skb+0xd4/0x280 [ 2849.310542][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2849.310547][ C2] ? tcp_fragment+0x168/0x1040 [ 2849.310550][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2849.310553][ C2] ? ip_local_out+0x114/0x3b0 [ 2849.310558][ C2] __ip_queue_xmit+0x672/0x1910 [ 2849.310561][ C2] ? __skb_clone+0x57a/0x760 [ 2849.310564][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2849.310569][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2849.310572][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2849.310576][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2849.310581][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2849.310585][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2849.310588][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2849.310591][ C2] tcp_send_loss_probe+0x348/0x830 [ 2849.310595][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2849.310597][ C2] tcp_write_timer+0x82/0x1d0 [ 2849.310600][ C2] call_timer_fn+0x173/0x430 [ 2849.310605][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2849.310610][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2849.310614][ C2] __run_timers.part.0+0x52d/0x890 [ 2849.310617][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2849.310621][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2849.310624][ C2] ? lock_acquire+0x1c1/0x220 [ 2849.310626][ C2] ? clockevents_program_event+0xf6/0x300 [ 2849.310631][ C2] ? lock_release+0x1d5/0x250 [ 2849.310634][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2849.310638][ C2] ? ktime_get+0xb3/0x190 [ 2849.310642][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2849.310646][ C2] run_timer_softirq+0x72/0x100 [ 2849.310649][ C2] __do_softirq+0x1b9/0x7ff [ 2849.310654][ C2] irq_exit_rcu+0x98/0xc0 [ 2849.310657][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2849.310661][ C2] [ 2849.310662][ C2] [ 2849.310663][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2849.310667][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2849.310670][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2849.310672][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2849.310674][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2849.310676][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2849.310678][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2849.310679][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2849.310681][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2849.310684][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2849.310687][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2849.310691][ C2] default_idle_call+0x69/0xa0 [ 2849.310694][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2849.310697][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2849.310702][ C2] ? lock_release+0x1d5/0x250 [ 2849.310704][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2849.310708][ C2] do_idle+0xfb/0x160 [ 2849.310711][ C2] cpu_startup_entry+0x55/0x60 [ 2849.310713][ C2] start_secondary+0x21c/0x2b0 [ 2849.310716][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2849.310720][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2849.310726][ C2] [ 2876.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 488s! [perl:4135] [ 2876.569704][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2876.570970][ C1] irq event stamp: 209232 [ 2876.571192][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2876.571724][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2876.572203][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2876.572675][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2876.573140][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2876.573591][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2876.574206][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2876.574533][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2876.575515][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2876.575822][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2876.576226][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2876.576626][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2876.577026][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2876.577428][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2876.577831][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2876.578282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2876.578621][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2876.579022][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2876.579423][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2876.579827][ C1] PKRU: 55555554 [ 2876.580008][ C1] Call Trace: [ 2876.580180][ C1] [ 2876.580330][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2876.580593][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2876.580835][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2876.581116][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2876.581390][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2876.581679][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2876.581947][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2876.582253][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2876.582516][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2876.582827][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2876.583125][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2876.583442][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2876.583732][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2876.584029][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2876.584321][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2876.584633][ C1] ? get_stack_info+0x36/0xc0 [ 2876.584876][ C1] ? lock_acquire+0x1c1/0x220 [ 2876.585119][ C1] ? lock_release+0x1d5/0x250 [ 2876.585366][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2876.585615][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2876.585891][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2876.586177][ C1] ? lock_acquire+0x1c1/0x220 [ 2876.586418][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2876.586659][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2876.586921][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2876.587156][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2876.587405][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2876.587664][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2876.587948][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2876.588228][ C1] ip_local_deliver+0x19d/0x480 [ 2876.588476][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2876.588750][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2876.589015][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2876.589364][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2876.589619][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2876.589941][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2876.590206][ C1] ip_rcv+0x564/0x740 [ 2876.590410][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2876.590644][ C1] ? set_track_prepare+0x8a/0xd0 [ 2876.590900][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2876.591178][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2876.591453][ C1] ? skb_clone+0x10b/0x330 [ 2876.591682][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2876.592002][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2876.592312][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2876.592594][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2876.592891][ C1] ? __tcf_classify+0x329/0x7d0 [ 2876.593142][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2876.593373][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2876.593676][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2876.593961][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2876.594290][ C1] ? lock_acquire+0x1c1/0x220 [ 2876.594530][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2876.594829][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2876.595115][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2876.595441][ C1] ? __copy_skb_header+0xaf/0x490 [ 2876.595701][ C1] ? __skb_clone+0x57a/0x760 [ 2876.595938][ C1] netif_receive_skb+0x55/0x280 [ 2876.596188][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2876.596502][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2876.596837][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2876.597139][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2876.597415][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2876.597709][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2876.598029][ C1] ? hlock_class+0x4e/0x130 [ 2876.598263][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2876.598542][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2876.598822][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2876.599089][ C1] ? hlock_class+0x4e/0x130 [ 2876.599325][ C1] ? mark_lock+0x38/0x3e0 [ 2876.599547][ C1] ? stack_access_ok+0xda/0x1f0 [ 2876.599798][ C1] ? __lock_acquire+0xb67/0x1610 [ 2876.600056][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2876.600334][ C1] ? get_stack_info+0x36/0xc0 [ 2876.600578][ C1] ? stack_access_ok+0xda/0x1f0 [ 2876.600828][ C1] ? get_reg+0x119/0x190 [ 2876.601044][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2876.601315][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2876.601628][ C1] __tcf_classify+0x329/0x7d0 [ 2876.601874][ C1] tcf_classify+0x283/0x930 [ 2876.602109][ C1] ? arch_stack_walk+0xa2/0x100 [ 2876.602359][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2876.602617][ C1] ? get_stack_info+0x36/0xc0 [ 2876.602860][ C1] tc_run+0x2e4/0x5d0 [ 2876.603066][ C1] ? __pfx_tc_run+0x10/0x10 [ 2876.603302][ C1] ? lock_acquire+0x1c1/0x220 [ 2876.603543][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2876.603810][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2876.604069][ C1] ? lock_acquire+0x1c1/0x220 [ 2876.604314][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2876.604582][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2876.604887][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2876.605171][ C1] ? neigh_hh_output+0x348/0x590 [ 2876.605427][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2876.605696][ C1] ip_finish_output2+0x786/0x18e0 [ 2876.605959][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2876.606245][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2876.606590][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2876.606873][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2876.607132][ C1] ? __ip_finish_output+0x10f/0x770 [ 2876.607405][ C1] ip_output+0x16b/0x4f0 [ 2876.607626][ C1] ? run_timer_softirq+0x72/0x100 [ 2876.607890][ C1] ? __pfx_ip_output+0x10/0x10 [ 2876.608140][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2876.608433][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2876.608692][ C1] ? ip_local_out+0x114/0x3b0 [ 2876.608937][ C1] __ip_queue_xmit+0x672/0x1910 [ 2876.609192][ C1] ? __create_object+0x5e/0xb0 [ 2876.609440][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2876.609714][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2876.610003][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2876.610280][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2876.610571][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2876.610849][ C1] tcp_delack_timer+0x84/0x240 [ 2876.611099][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2876.611378][ C1] call_timer_fn+0x173/0x430 [ 2876.611619][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2876.611886][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2876.612156][ C1] __run_timers.part.0+0x52d/0x890 [ 2876.612423][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2876.612702][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2876.612995][ C1] ? lock_acquire+0x1c1/0x220 [ 2876.613238][ C1] ? clockevents_program_event+0xf6/0x300 [ 2876.613536][ C1] ? lock_release+0x1d5/0x250 [ 2876.613780][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2876.614051][ C1] ? ktime_get+0xb3/0x190 [ 2876.614277][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2876.614581][ C1] run_timer_softirq+0x72/0x100 [ 2876.614836][ C1] __do_softirq+0x1b9/0x7ff [ 2876.615073][ C1] irq_exit_rcu+0x98/0xc0 [ 2876.615309][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2876.615602][ C1] [ 2876.615756][ C1] [ 2876.615911][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2876.616224][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2876.616557][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2876.617544][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2876.617856][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2876.618258][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2876.618660][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2876.619061][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2876.619466][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2876.619871][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2876.620170][ C1] pipe_read+0xa16/0xdf0 [ 2876.620396][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2876.620676][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2876.620922][ C1] ? iterate_tty_write+0x299/0x540 [ 2876.621190][ C1] ? lock_release+0x1d5/0x250 [ 2876.621433][ C1] vfs_read+0x911/0xc00 [ 2876.621648][ C1] ? lock_acquire+0x1c1/0x220 [ 2876.621890][ C1] ? __might_fault+0xc6/0x180 [ 2876.622134][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2876.622373][ C1] ? __might_fault+0xc6/0x180 [ 2876.622616][ C1] ? lock_release+0x1d5/0x250 [ 2876.622858][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2876.623126][ C1] ? __fget_light+0x54/0x1e0 [ 2876.623368][ C1] ksys_read+0x17a/0x1e0 [ 2876.623588][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2876.623836][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2876.624145][ C1] do_syscall_64+0xc9/0x1e0 [ 2876.624377][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2876.624681][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2876.624911][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2876.625911][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2876.626342][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2876.626749][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2876.627157][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2876.627563][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2876.627970][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2876.628382][ C1] [ 2876.628544][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 488s! [swapper/2:0] [ 2876.628968][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2876.630224][ C2] irq event stamp: 44114564 [ 2876.630453][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2876.630987][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2876.631499][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2876.631976][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2876.632447][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2876.632901][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2876.633516][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2876.633841][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2876.634810][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2876.635117][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2876.635526][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2876.635923][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2876.636319][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2876.636718][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2876.637117][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2876.637568][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2876.637899][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2876.638298][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2876.638698][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2876.639096][ C2] PKRU: 55555554 [ 2876.639279][ C2] Call Trace: [ 2876.639448][ C2] [ 2876.639598][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2876.639859][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2876.640103][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2876.640378][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2876.640650][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2876.640939][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2876.641208][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2876.641514][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2876.641774][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2876.642036][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2876.642345][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2876.642639][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2876.642954][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2876.643243][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2876.643537][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2876.643826][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2876.644136][ C2] ? get_stack_info+0x36/0xc0 [ 2876.644377][ C2] ? lock_acquire+0x1c1/0x220 [ 2876.644617][ C2] ? lock_release+0x1d5/0x250 [ 2876.644857][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2876.645106][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2876.645385][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2876.645669][ C2] ? lock_acquire+0x1c1/0x220 [ 2876.645908][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2876.646150][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2876.646410][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2876.646644][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2876.646889][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2876.647149][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2876.647426][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2876.647702][ C2] ip_local_deliver+0x19d/0x480 [ 2876.647949][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2876.648221][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2876.648483][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2876.648831][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2876.649084][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2876.649404][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2876.649667][ C2] ip_rcv+0x564/0x740 [ 2876.649872][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2876.650100][ C2] ? set_track_prepare+0x8a/0xd0 [ 2876.650357][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2876.650634][ C2] ? start_secondary+0x21c/0x2b0 [ 2876.650885][ C2] ? skb_clone+0x10b/0x330 [ 2876.651113][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2876.651431][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2876.651736][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2876.652017][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2876.652312][ C2] ? __tcf_classify+0x329/0x7d0 [ 2876.652560][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2876.652789][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2876.653090][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2876.653374][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2876.653697][ C2] ? lock_acquire+0x1c1/0x220 [ 2876.653935][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2876.654238][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2876.654522][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2876.654838][ C2] ? __copy_skb_header+0xaf/0x490 [ 2876.655094][ C2] ? __skb_clone+0x57a/0x760 [ 2876.655336][ C2] netif_receive_skb+0x55/0x280 [ 2876.655585][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2876.655896][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2876.656229][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2876.656526][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2876.656801][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2876.657089][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2876.657401][ C2] ? get_stack_info+0x36/0xc0 [ 2876.657643][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2876.657909][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2876.658227][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2876.658503][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2876.658779][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2876.659093][ C2] ? kernel_text_address+0x17/0xe0 [ 2876.659354][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2876.659667][ C2] ? arch_stack_walk+0x8c/0x100 [ 2876.659917][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2876.660181][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2876.660465][ C2] ? lock_acquire+0x1c1/0x220 [ 2876.660703][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2876.660986][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2876.661290][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2876.661567][ C2] ? get_stack_info+0x36/0xc0 [ 2876.661805][ C2] __tcf_classify+0x329/0x7d0 [ 2876.662053][ C2] tcf_classify+0x283/0x930 [ 2876.662288][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2876.662542][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2876.662856][ C2] tc_run+0x2e4/0x5d0 [ 2876.663062][ C2] ? __pfx_tc_run+0x10/0x10 [ 2876.663293][ C2] ? lock_acquire+0x1c1/0x220 [ 2876.663532][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2876.663793][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2876.664048][ C2] ? lock_acquire+0x1c1/0x220 [ 2876.664288][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2876.664554][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2876.664860][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2876.665132][ C2] ? neigh_hh_output+0x348/0x590 [ 2876.665393][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2876.665659][ C2] ip_finish_output2+0x786/0x18e0 [ 2876.665921][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2876.666259][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2876.666537][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2876.666791][ C2] ? __ip_finish_output+0x10f/0x770 [ 2876.667056][ C2] ip_output+0x16b/0x4f0 [ 2876.667273][ C2] ? __pfx_ip_output+0x10/0x10 [ 2876.667517][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2876.667792][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2876.668104][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2876.668380][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2876.668632][ C2] ? __alloc_skb+0xd4/0x280 [ 2876.668864][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2876.669135][ C2] ? tcp_fragment+0x168/0x1040 [ 2876.669378][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2876.669631][ C2] ? ip_local_out+0x114/0x3b0 [ 2876.669871][ C2] __ip_queue_xmit+0x672/0x1910 [ 2876.670120][ C2] ? __skb_clone+0x57a/0x760 [ 2876.670355][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2876.670621][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2876.670904][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2876.671149][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2876.671398][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2876.671701][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2876.672021][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2876.672267][ C2] tcp_send_loss_probe+0x348/0x830 [ 2876.672528][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2876.672795][ C2] tcp_write_timer+0x82/0x1d0 [ 2876.673036][ C2] call_timer_fn+0x173/0x430 [ 2876.673275][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2876.673538][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2876.673799][ C2] __run_timers.part.0+0x52d/0x890 [ 2876.674060][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2876.674330][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2876.674613][ C2] ? lock_acquire+0x1c1/0x220 [ 2876.674853][ C2] ? clockevents_program_event+0xf6/0x300 [ 2876.675145][ C2] ? lock_release+0x1d5/0x250 [ 2876.675392][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2876.675657][ C2] ? ktime_get+0xb3/0x190 [ 2876.675877][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2876.676179][ C2] run_timer_softirq+0x72/0x100 [ 2876.676426][ C2] __do_softirq+0x1b9/0x7ff [ 2876.676659][ C2] irq_exit_rcu+0x98/0xc0 [ 2876.676880][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2876.677166][ C2] [ 2876.677315][ C2] [ 2876.677467][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2876.677771][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2876.678028][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2876.678996][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2876.679304][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2876.679704][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2876.680101][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2876.680499][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2876.680898][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2876.681300][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2876.681587][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2876.681847][ C2] default_idle_call+0x69/0xa0 [ 2876.682093][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2876.682345][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2876.682621][ C2] ? lock_release+0x1d5/0x250 [ 2876.682862][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2876.683135][ C2] do_idle+0xfb/0x160 [ 2876.683340][ C2] cpu_startup_entry+0x55/0x60 [ 2876.683583][ C2] start_secondary+0x21c/0x2b0 [ 2876.683827][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2876.684096][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2876.684409][ C2] [ 2904.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 514s! [swapper/2:0] [ 2904.569699][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2904.570954][ C2] irq event stamp: 44114564 [ 2904.571180][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2904.571715][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2904.572225][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2904.572696][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2904.573163][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2904.573619][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2904.574228][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2904.574558][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2904.575527][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2904.575834][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2904.576230][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2904.576628][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2904.577026][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2904.577422][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2904.577816][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2904.578262][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2904.578594][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2904.578992][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2904.579389][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2904.579784][ C2] PKRU: 55555554 [ 2904.579964][ C2] Call Trace: [ 2904.580138][ C2] [ 2904.580284][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2904.580544][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2904.580787][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2904.581062][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2904.581334][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2904.581619][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2904.581881][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2904.582187][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2904.582446][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2904.582706][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2904.583023][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2904.583318][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2904.583630][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2904.583916][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2904.584212][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2904.584498][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2904.584807][ C2] ? get_stack_info+0x36/0xc0 [ 2904.585055][ C2] ? lock_acquire+0x1c1/0x220 [ 2904.585296][ C2] ? lock_release+0x1d5/0x250 [ 2904.585533][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2904.585781][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2904.586053][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2904.586343][ C2] ? lock_acquire+0x1c1/0x220 [ 2904.586582][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2904.586819][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2904.587080][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2904.587316][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2904.587563][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2904.587820][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2904.588093][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2904.588372][ C2] ip_local_deliver+0x19d/0x480 [ 2904.588617][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2904.588894][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2904.589158][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2904.589504][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2904.589756][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2904.590075][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2904.590337][ C2] ip_rcv+0x564/0x740 [ 2904.590540][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2904.590771][ C2] ? set_track_prepare+0x8a/0xd0 [ 2904.591023][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2904.591299][ C2] ? start_secondary+0x21c/0x2b0 [ 2904.591550][ C2] ? skb_clone+0x10b/0x330 [ 2904.591777][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2904.592096][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2904.592399][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2904.592682][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2904.592973][ C2] ? __tcf_classify+0x329/0x7d0 [ 2904.593224][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2904.593454][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2904.593755][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2904.594042][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2904.594367][ C2] ? lock_acquire+0x1c1/0x220 [ 2904.594605][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2904.594899][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2904.595196][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2904.595517][ C2] ? __copy_skb_header+0xaf/0x490 [ 2904.595773][ C2] ? __skb_clone+0x57a/0x760 [ 2904.596005][ C2] netif_receive_skb+0x55/0x280 [ 2904.596255][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2904.596566][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2904.596895][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2904.597194][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2904.597465][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2904.597751][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2904.598062][ C2] ? get_stack_info+0x36/0xc0 [ 2904.598303][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2904.598566][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2904.598881][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2904.599155][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2904.599433][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2904.599746][ C2] ? kernel_text_address+0x17/0xe0 [ 2904.600006][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2904.600317][ C2] ? arch_stack_walk+0x8c/0x100 [ 2904.600563][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2904.600827][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2904.601112][ C2] ? lock_acquire+0x1c1/0x220 [ 2904.601350][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2904.601630][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2904.601934][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2904.602208][ C2] ? get_stack_info+0x36/0xc0 [ 2904.602450][ C2] __tcf_classify+0x329/0x7d0 [ 2904.602692][ C2] tcf_classify+0x283/0x930 [ 2904.602921][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2904.603177][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2904.603494][ C2] tc_run+0x2e4/0x5d0 [ 2904.603698][ C2] ? __pfx_tc_run+0x10/0x10 [ 2904.603930][ C2] ? lock_acquire+0x1c1/0x220 [ 2904.604171][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2904.604431][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2904.604684][ C2] ? lock_acquire+0x1c1/0x220 [ 2904.604921][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2904.605193][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2904.605496][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2904.605769][ C2] ? neigh_hh_output+0x348/0x590 [ 2904.606019][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2904.606286][ C2] ip_finish_output2+0x786/0x18e0 [ 2904.606546][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2904.606883][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2904.607158][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2904.607409][ C2] ? __ip_finish_output+0x10f/0x770 [ 2904.607673][ C2] ip_output+0x16b/0x4f0 [ 2904.607889][ C2] ? __pfx_ip_output+0x10/0x10 [ 2904.608131][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2904.608409][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2904.608720][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2904.608997][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2904.609249][ C2] ? __alloc_skb+0xd4/0x280 [ 2904.609479][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2904.609749][ C2] ? tcp_fragment+0x168/0x1040 [ 2904.609992][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2904.610243][ C2] ? ip_local_out+0x114/0x3b0 [ 2904.610483][ C2] __ip_queue_xmit+0x672/0x1910 [ 2904.610731][ C2] ? __skb_clone+0x57a/0x760 [ 2904.610967][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2904.611236][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2904.611514][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2904.611759][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2904.612010][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2904.612310][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2904.612630][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2904.612871][ C2] tcp_send_loss_probe+0x348/0x830 [ 2904.613133][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2904.613403][ C2] tcp_write_timer+0x82/0x1d0 [ 2904.613640][ C2] call_timer_fn+0x173/0x430 [ 2904.613879][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2904.614145][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2904.614405][ C2] __run_timers.part.0+0x52d/0x890 [ 2904.614664][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2904.614933][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2904.615226][ C2] ? lock_acquire+0x1c1/0x220 [ 2904.615464][ C2] ? clockevents_program_event+0xf6/0x300 [ 2904.615752][ C2] ? lock_release+0x1d5/0x250 [ 2904.615991][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2904.616254][ C2] ? ktime_get+0xb3/0x190 [ 2904.616473][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2904.616769][ C2] run_timer_softirq+0x72/0x100 [ 2904.617016][ C2] __do_softirq+0x1b9/0x7ff [ 2904.617249][ C2] irq_exit_rcu+0x98/0xc0 [ 2904.617468][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2904.617752][ C2] [ 2904.617903][ C2] [ 2904.618051][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2904.618355][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2904.618612][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2904.619577][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2904.619884][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2904.620281][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2904.620677][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2904.621075][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2904.621473][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2904.621873][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2904.622164][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2904.622423][ C2] default_idle_call+0x69/0xa0 [ 2904.622664][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2904.622914][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2904.623193][ C2] ? lock_release+0x1d5/0x250 [ 2904.623431][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2904.623705][ C2] do_idle+0xfb/0x160 [ 2904.623908][ C2] cpu_startup_entry+0x55/0x60 [ 2904.624153][ C2] start_secondary+0x21c/0x2b0 [ 2904.624395][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2904.624668][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2904.624984][ C2] [ 2904.625150][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 514s! [perl:4135] [ 2904.625577][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2904.626837][ C1] irq event stamp: 209232 [ 2904.627057][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2904.627588][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2904.628066][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2904.628536][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2904.629000][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2904.629450][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2904.630061][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa8/0xb90 [ 2904.630383][ C1] Code: 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 <48> 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 [ 2904.631357][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2904.631665][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2904.632064][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2904.632465][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2904.632864][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2904.633262][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2904.633662][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2904.634108][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2904.634442][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2904.634843][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2904.635250][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2904.635652][ C1] PKRU: 55555554 [ 2904.635833][ C1] Call Trace: [ 2904.636004][ C1] [ 2904.636155][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2904.636417][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2904.636661][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2904.636940][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2904.637212][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2904.637498][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2904.637765][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2904.638071][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2904.638333][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2904.638643][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2904.638939][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2904.639255][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2904.639544][ C1] ? queued_spin_lock_slowpath+0xa8/0xb90 [ 2904.639833][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2904.640121][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2904.640432][ C1] ? get_stack_info+0x36/0xc0 [ 2904.640673][ C1] ? lock_acquire+0x1c1/0x220 [ 2904.640913][ C1] ? lock_release+0x1d5/0x250 [ 2904.641152][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2904.641401][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2904.641672][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2904.641959][ C1] ? lock_acquire+0x1c1/0x220 [ 2904.642198][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2904.642438][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2904.642697][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2904.642934][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2904.643182][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2904.643440][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2904.643714][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2904.643990][ C1] ip_local_deliver+0x19d/0x480 [ 2904.644241][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2904.644513][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2904.644777][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2904.645131][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2904.645384][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2904.645704][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2904.645967][ C1] ip_rcv+0x564/0x740 [ 2904.646172][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2904.646403][ C1] ? set_track_prepare+0x8a/0xd0 [ 2904.646657][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2904.646932][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2904.647205][ C1] ? skb_clone+0x10b/0x330 [ 2904.647434][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2904.647753][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2904.648063][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2904.648345][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2904.648639][ C1] ? __tcf_classify+0x329/0x7d0 [ 2904.648887][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2904.649119][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2904.649419][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2904.649702][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2904.650027][ C1] ? lock_acquire+0x1c1/0x220 [ 2904.650265][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2904.650564][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2904.650850][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2904.651168][ C1] ? __copy_skb_header+0xaf/0x490 [ 2904.651426][ C1] ? __skb_clone+0x57a/0x760 [ 2904.651661][ C1] netif_receive_skb+0x55/0x280 [ 2904.651908][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2904.652220][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2904.652554][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2904.652855][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2904.653129][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2904.653418][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2904.653728][ C1] ? hlock_class+0x4e/0x130 [ 2904.653961][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2904.654237][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2904.654515][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2904.654778][ C1] ? hlock_class+0x4e/0x130 [ 2904.655013][ C1] ? mark_lock+0x38/0x3e0 [ 2904.655236][ C1] ? stack_access_ok+0xda/0x1f0 [ 2904.655486][ C1] ? __lock_acquire+0xb67/0x1610 [ 2904.655740][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2904.656016][ C1] ? get_stack_info+0x36/0xc0 [ 2904.656257][ C1] ? stack_access_ok+0xda/0x1f0 [ 2904.656504][ C1] ? get_reg+0x119/0x190 [ 2904.656719][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2904.656986][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2904.657296][ C1] __tcf_classify+0x329/0x7d0 [ 2904.657539][ C1] tcf_classify+0x283/0x930 [ 2904.657771][ C1] ? arch_stack_walk+0xa2/0x100 [ 2904.658024][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2904.658281][ C1] ? get_stack_info+0x36/0xc0 [ 2904.658525][ C1] tc_run+0x2e4/0x5d0 [ 2904.658730][ C1] ? __pfx_tc_run+0x10/0x10 [ 2904.658966][ C1] ? lock_acquire+0x1c1/0x220 [ 2904.659210][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2904.659476][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2904.659734][ C1] ? lock_acquire+0x1c1/0x220 [ 2904.659973][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2904.660241][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2904.660547][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2904.660825][ C1] ? neigh_hh_output+0x348/0x590 [ 2904.661085][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2904.661356][ C1] ip_finish_output2+0x786/0x18e0 [ 2904.661616][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2904.661897][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2904.662241][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2904.662521][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2904.662779][ C1] ? __ip_finish_output+0x10f/0x770 [ 2904.663048][ C1] ip_output+0x16b/0x4f0 [ 2904.663270][ C1] ? run_timer_softirq+0x72/0x100 [ 2904.663531][ C1] ? __pfx_ip_output+0x10/0x10 [ 2904.663783][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2904.664074][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2904.664330][ C1] ? ip_local_out+0x114/0x3b0 [ 2904.664575][ C1] __ip_queue_xmit+0x672/0x1910 [ 2904.664829][ C1] ? __create_object+0x5e/0xb0 [ 2904.665083][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2904.665357][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2904.665645][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2904.665923][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2904.666209][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2904.666487][ C1] tcp_delack_timer+0x84/0x240 [ 2904.666735][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2904.667012][ C1] call_timer_fn+0x173/0x430 [ 2904.667253][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2904.667519][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2904.667784][ C1] __run_timers.part.0+0x52d/0x890 [ 2904.668049][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2904.668327][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2904.668617][ C1] ? lock_acquire+0x1c1/0x220 [ 2904.668858][ C1] ? clockevents_program_event+0xf6/0x300 [ 2904.669158][ C1] ? lock_release+0x1d5/0x250 [ 2904.669402][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2904.669671][ C1] ? ktime_get+0xb3/0x190 [ 2904.669897][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2904.670199][ C1] run_timer_softirq+0x72/0x100 [ 2904.670450][ C1] __do_softirq+0x1b9/0x7ff [ 2904.670689][ C1] irq_exit_rcu+0x98/0xc0 [ 2904.670914][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2904.671204][ C1] [ 2904.671357][ C1] [ 2904.671514][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2904.671824][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2904.672156][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2904.673137][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2904.673447][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2904.673848][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2904.674248][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2904.674651][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2904.675060][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2904.675465][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2904.675761][ C1] pipe_read+0xa16/0xdf0 [ 2904.675985][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2904.676264][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2904.676509][ C1] ? iterate_tty_write+0x299/0x540 [ 2904.676773][ C1] ? lock_release+0x1d5/0x250 [ 2904.677016][ C1] vfs_read+0x911/0xc00 [ 2904.677231][ C1] ? lock_acquire+0x1c1/0x220 [ 2904.677473][ C1] ? __might_fault+0xc6/0x180 [ 2904.677715][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2904.677954][ C1] ? __might_fault+0xc6/0x180 [ 2904.678198][ C1] ? lock_release+0x1d5/0x250 [ 2904.678442][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2904.678713][ C1] ? __fget_light+0x54/0x1e0 [ 2904.678953][ C1] ksys_read+0x17a/0x1e0 [ 2904.679171][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2904.679418][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2904.679723][ C1] do_syscall_64+0xc9/0x1e0 [ 2904.679958][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2904.680265][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2904.680495][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2904.681486][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2904.681915][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2904.682318][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2904.682726][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2904.683131][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2904.683535][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2904.683943][ C1] [ 2927.309104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 2927.309469][ C1] rcu: 1-....: (571621 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=140206 [ 2927.310024][ C1] rcu: (t=572422 jiffies g=1882453 q=694 ncpus=4) [ 2927.310356][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2927.310804][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2927.311421][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 2927.311708][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 2927.312680][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 2927.312989][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2927.313389][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2927.313788][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2927.314193][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2927.314594][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2927.315000][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2927.315448][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2927.315780][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2927.316187][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2927.316587][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2927.316988][ C1] PKRU: 55555554 [ 2927.317171][ C1] Call Trace: [ 2927.317344][ C1] [ 2927.317492][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 2927.317765][ C1] ? print_cpu_stall+0x263/0x6a0 [ 2927.318017][ C1] ? check_cpu_stall+0x284/0x500 [ 2927.318269][ C1] ? rcu_pending+0x92/0x360 [ 2927.318502][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 2927.318772][ C1] ? update_process_times+0xb9/0x110 [ 2927.319041][ C1] ? tick_sched_handle+0x67/0x130 [ 2927.319297][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 2927.319582][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2927.319824][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 2927.320138][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2927.320411][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2927.320700][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2927.320966][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2927.321273][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2927.321536][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2927.321846][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2927.322141][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2927.322456][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2927.322747][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 2927.323028][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 2927.323310][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2927.323621][ C1] ? get_stack_info+0x36/0xc0 [ 2927.323863][ C1] ? lock_acquire+0x1c1/0x220 [ 2927.324105][ C1] ? lock_release+0x1d5/0x250 [ 2927.324345][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2927.324594][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2927.324868][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2927.325158][ C1] ? lock_acquire+0x1c1/0x220 [ 2927.325398][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2927.325640][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2927.325900][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2927.326133][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2927.326381][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2927.326639][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2927.326915][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2927.327194][ C1] ip_local_deliver+0x19d/0x480 [ 2927.327442][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2927.327715][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2927.327979][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2927.328326][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2927.328582][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2927.328904][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2927.329168][ C1] ip_rcv+0x564/0x740 [ 2927.329373][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2927.329605][ C1] ? set_track_prepare+0x8a/0xd0 [ 2927.329859][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2927.330136][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2927.330412][ C1] ? skb_clone+0x10b/0x330 [ 2927.330640][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2927.330958][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2927.331266][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2927.331549][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2927.331847][ C1] ? __tcf_classify+0x329/0x7d0 [ 2927.332097][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2927.332327][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2927.332628][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2927.332913][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2927.333240][ C1] ? lock_acquire+0x1c1/0x220 [ 2927.333479][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2927.333777][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2927.334063][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2927.334381][ C1] ? __copy_skb_header+0xaf/0x490 [ 2927.334640][ C1] ? __skb_clone+0x57a/0x760 [ 2927.334877][ C1] netif_receive_skb+0x55/0x280 [ 2927.335137][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2927.335452][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2927.335786][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2927.336084][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2927.336361][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2927.336650][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2927.336965][ C1] ? hlock_class+0x4e/0x130 [ 2927.337197][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2927.337476][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2927.337753][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2927.338018][ C1] ? hlock_class+0x4e/0x130 [ 2927.338251][ C1] ? mark_lock+0x38/0x3e0 [ 2927.338471][ C1] ? stack_access_ok+0xda/0x1f0 [ 2927.338721][ C1] ? __lock_acquire+0xb67/0x1610 [ 2927.338975][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2927.339252][ C1] ? get_stack_info+0x36/0xc0 [ 2927.339494][ C1] ? stack_access_ok+0xda/0x1f0 [ 2927.339743][ C1] ? get_reg+0x119/0x190 [ 2927.339964][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2927.340234][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2927.340545][ C1] __tcf_classify+0x329/0x7d0 [ 2927.340788][ C1] tcf_classify+0x283/0x930 [ 2927.341022][ C1] ? arch_stack_walk+0xa2/0x100 [ 2927.341275][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2927.341536][ C1] ? get_stack_info+0x36/0xc0 [ 2927.341780][ C1] tc_run+0x2e4/0x5d0 [ 2927.341988][ C1] ? __pfx_tc_run+0x10/0x10 [ 2927.342221][ C1] ? lock_acquire+0x1c1/0x220 [ 2927.342461][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2927.342723][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2927.342978][ C1] ? lock_acquire+0x1c1/0x220 [ 2927.343218][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2927.343486][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2927.343795][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2927.344072][ C1] ? neigh_hh_output+0x348/0x590 [ 2927.344329][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2927.344604][ C1] ip_finish_output2+0x786/0x18e0 [ 2927.344865][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2927.345155][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2927.345498][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2927.345781][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2927.346039][ C1] ? __ip_finish_output+0x10f/0x770 [ 2927.346310][ C1] ip_output+0x16b/0x4f0 [ 2927.346531][ C1] ? run_timer_softirq+0x72/0x100 [ 2927.346791][ C1] ? __pfx_ip_output+0x10/0x10 [ 2927.347040][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2927.347331][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2927.347588][ C1] ? ip_local_out+0x114/0x3b0 [ 2927.347833][ C1] __ip_queue_xmit+0x672/0x1910 [ 2927.348088][ C1] ? __create_object+0x5e/0xb0 [ 2927.348337][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2927.348610][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2927.348897][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2927.349175][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2927.349465][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2927.349742][ C1] tcp_delack_timer+0x84/0x240 [ 2927.349991][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2927.350268][ C1] call_timer_fn+0x173/0x430 [ 2927.350511][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2927.350778][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2927.351044][ C1] __run_timers.part.0+0x52d/0x890 [ 2927.351310][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2927.351588][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2927.351881][ C1] ? lock_acquire+0x1c1/0x220 [ 2927.352124][ C1] ? clockevents_program_event+0xf6/0x300 [ 2927.352422][ C1] ? lock_release+0x1d5/0x250 [ 2927.352670][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2927.352940][ C1] ? ktime_get+0xb3/0x190 [ 2927.353166][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2927.353470][ C1] run_timer_softirq+0x72/0x100 [ 2927.353724][ C1] __do_softirq+0x1b9/0x7ff [ 2927.353960][ C1] irq_exit_rcu+0x98/0xc0 [ 2927.354187][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2927.354479][ C1] [ 2927.354634][ C1] [ 2927.354787][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2927.355102][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2927.355431][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2927.356413][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2927.356726][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2927.357129][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2927.357530][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2927.357935][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2927.358339][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2927.358744][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2927.359043][ C1] pipe_read+0xa16/0xdf0 [ 2927.359267][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2927.359548][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2927.359795][ C1] ? iterate_tty_write+0x299/0x540 [ 2927.360058][ C1] ? lock_release+0x1d5/0x250 [ 2927.360301][ C1] vfs_read+0x911/0xc00 [ 2927.360518][ C1] ? lock_acquire+0x1c1/0x220 [ 2927.360762][ C1] ? __might_fault+0xc6/0x180 [ 2927.361009][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2927.361251][ C1] ? __might_fault+0xc6/0x180 [ 2927.361493][ C1] ? lock_release+0x1d5/0x250 [ 2927.361735][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2927.362002][ C1] ? __fget_light+0x54/0x1e0 [ 2927.362244][ C1] ksys_read+0x17a/0x1e0 [ 2927.362466][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2927.362716][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2927.363027][ C1] do_syscall_64+0xc9/0x1e0 [ 2927.363267][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2927.363573][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2927.363807][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2927.364796][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2927.365234][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2927.365645][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2927.366053][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2927.366459][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2927.366864][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2927.367276][ C1] [ 2927.367435][ C1] Sending NMI from CPU 1 to CPUs 2: [ 2927.367714][ C2] NMI backtrace for cpu 2 [ 2927.367728][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2927.367735][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2927.367740][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2927.367750][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2927.367755][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2927.367758][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2927.367760][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2927.367762][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2927.367763][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2927.367764][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2927.367766][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2927.367768][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2927.367771][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2927.367773][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2927.367774][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2927.367776][ C2] PKRU: 55555554 [ 2927.367777][ C2] Call Trace: [ 2927.367779][ C2] [ 2927.367781][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 2927.367789][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 2927.367794][ C2] ? nmi_handle+0x153/0x420 [ 2927.367799][ C2] ? default_do_nmi+0x41/0x100 [ 2927.367802][ C2] ? exc_nmi+0xf3/0x120 [ 2927.367804][ C2] ? end_repeat_nmi+0xf/0x60 [ 2927.367809][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2927.367812][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2927.367815][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2927.367818][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2927.367821][ C2] [ 2927.367822][ C2] [ 2927.367823][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2927.367826][ C2] ? get_stack_info+0x36/0xc0 [ 2927.367830][ C2] ? lock_acquire+0x1c1/0x220 [ 2927.367834][ C2] ? lock_release+0x1d5/0x250 [ 2927.367837][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2927.367841][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2927.367844][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2927.367847][ C2] ? lock_acquire+0x1c1/0x220 [ 2927.367850][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2927.367853][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2927.367856][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2927.367862][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2927.367865][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2927.367870][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2927.367874][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2927.367878][ C2] ip_local_deliver+0x19d/0x480 [ 2927.367880][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2927.367882][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2927.367885][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2927.367889][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2927.367893][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2927.367896][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2927.367905][ C2] ip_rcv+0x564/0x740 [ 2927.367907][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2927.367910][ C2] ? set_track_prepare+0x8a/0xd0 [ 2927.367914][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2927.367917][ C2] ? start_secondary+0x21c/0x2b0 [ 2927.367920][ C2] ? skb_clone+0x10b/0x330 [ 2927.367924][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2927.367930][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2927.367935][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2927.367938][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2927.367946][ C2] ? __tcf_classify+0x329/0x7d0 [ 2927.367950][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2927.367952][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2927.367956][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2927.367959][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2927.367963][ C2] ? lock_acquire+0x1c1/0x220 [ 2927.367965][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2927.367969][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2927.367972][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2927.367976][ C2] ? __copy_skb_header+0xaf/0x490 [ 2927.367980][ C2] ? __skb_clone+0x57a/0x760 [ 2927.367983][ C2] netif_receive_skb+0x55/0x280 [ 2927.367986][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2927.367993][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2927.368000][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2927.368007][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2927.368011][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2927.368022][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2927.368029][ C2] ? get_stack_info+0x36/0xc0 [ 2927.368034][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2927.368036][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2927.368040][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2927.368042][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2927.368046][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2927.368048][ C2] ? kernel_text_address+0x17/0xe0 [ 2927.368051][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2927.368056][ C2] ? arch_stack_walk+0x8c/0x100 [ 2927.368059][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2927.368063][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2927.368066][ C2] ? lock_acquire+0x1c1/0x220 [ 2927.368068][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2927.368073][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2927.368077][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2927.368080][ C2] ? get_stack_info+0x36/0xc0 [ 2927.368084][ C2] __tcf_classify+0x329/0x7d0 [ 2927.368090][ C2] tcf_classify+0x283/0x930 [ 2927.368094][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2927.368097][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2927.368101][ C2] tc_run+0x2e4/0x5d0 [ 2927.368105][ C2] ? __pfx_tc_run+0x10/0x10 [ 2927.368108][ C2] ? lock_acquire+0x1c1/0x220 [ 2927.368110][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2927.368114][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2927.368118][ C2] ? lock_acquire+0x1c1/0x220 [ 2927.368120][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2927.368123][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2927.368126][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2927.368129][ C2] ? neigh_hh_output+0x348/0x590 [ 2927.368133][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2927.368136][ C2] ip_finish_output2+0x786/0x18e0 [ 2927.368140][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2927.368147][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2927.368150][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2927.368154][ C2] ? __ip_finish_output+0x10f/0x770 [ 2927.368157][ C2] ip_output+0x16b/0x4f0 [ 2927.368160][ C2] ? __pfx_ip_output+0x10/0x10 [ 2927.368163][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2927.368166][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2927.368169][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2927.368172][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2927.368174][ C2] ? __alloc_skb+0xd4/0x280 [ 2927.368177][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2927.368181][ C2] ? tcp_fragment+0x168/0x1040 [ 2927.368185][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2927.368187][ C2] ? ip_local_out+0x114/0x3b0 [ 2927.368191][ C2] __ip_queue_xmit+0x672/0x1910 [ 2927.368195][ C2] ? __skb_clone+0x57a/0x760 [ 2927.368198][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2927.368203][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2927.368206][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2927.368209][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2927.368214][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2927.368218][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2927.368221][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2927.368225][ C2] tcp_send_loss_probe+0x348/0x830 [ 2927.368228][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2927.368231][ C2] tcp_write_timer+0x82/0x1d0 [ 2927.368234][ C2] call_timer_fn+0x173/0x430 [ 2927.368237][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2927.368242][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2927.368246][ C2] __run_timers.part.0+0x52d/0x890 [ 2927.368249][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2927.368253][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2927.368256][ C2] ? lock_acquire+0x1c1/0x220 [ 2927.368258][ C2] ? clockevents_program_event+0xf6/0x300 [ 2927.368262][ C2] ? lock_release+0x1d5/0x250 [ 2927.368264][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2927.368267][ C2] ? ktime_get+0xb3/0x190 [ 2927.368271][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2927.368275][ C2] run_timer_softirq+0x72/0x100 [ 2927.368278][ C2] __do_softirq+0x1b9/0x7ff [ 2927.368283][ C2] irq_exit_rcu+0x98/0xc0 [ 2927.368285][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2927.368288][ C2] [ 2927.368289][ C2] [ 2927.368290][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2927.368293][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2927.368297][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2927.368299][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2927.368301][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2927.368303][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2927.368305][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2927.368306][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2927.368308][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2927.368311][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2927.368314][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2927.368318][ C2] default_idle_call+0x69/0xa0 [ 2927.368321][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2927.368323][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2927.368327][ C2] ? lock_release+0x1d5/0x250 [ 2927.368329][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2927.368333][ C2] do_idle+0xfb/0x160 [ 2927.368336][ C2] cpu_startup_entry+0x55/0x60 [ 2927.368338][ C2] start_secondary+0x21c/0x2b0 [ 2927.368341][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2927.368345][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2927.368351][ C2] [ 2952.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 558s! [swapper/2:0] [ 2952.569696][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2952.570958][ C2] irq event stamp: 44114564 [ 2952.571187][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2952.571724][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2952.572234][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2952.572708][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2952.573183][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2952.573638][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2952.574246][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2952.574570][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2952.575542][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2952.575849][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2952.576249][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2952.576646][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2952.577042][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2952.577439][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2952.577838][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2952.578286][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2952.578620][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2952.579020][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2952.579418][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2952.579819][ C2] PKRU: 55555554 [ 2952.580001][ C2] Call Trace: [ 2952.580171][ C2] [ 2952.580321][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2952.580584][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2952.580826][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2952.581105][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2952.581377][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2952.581664][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2952.581929][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2952.582234][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2952.582494][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2952.582756][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2952.583066][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2952.583363][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2952.583682][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2952.583968][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2952.584264][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2952.584551][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2952.584870][ C2] ? get_stack_info+0x36/0xc0 [ 2952.585112][ C2] ? lock_acquire+0x1c1/0x220 [ 2952.585353][ C2] ? lock_release+0x1d5/0x250 [ 2952.585592][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2952.585838][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2952.586113][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2952.586396][ C2] ? lock_acquire+0x1c1/0x220 [ 2952.586635][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2952.586876][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2952.587137][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2952.587370][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2952.587617][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2952.587874][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2952.588148][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2952.588431][ C2] ip_local_deliver+0x19d/0x480 [ 2952.588677][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2952.588948][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2952.589212][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2952.589559][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2952.589812][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2952.590132][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2952.590395][ C2] ip_rcv+0x564/0x740 [ 2952.590599][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2952.590831][ C2] ? set_track_prepare+0x8a/0xd0 [ 2952.591084][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2952.591360][ C2] ? start_secondary+0x21c/0x2b0 [ 2952.591612][ C2] ? skb_clone+0x10b/0x330 [ 2952.591841][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2952.592162][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2952.592467][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2952.592749][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2952.593041][ C2] ? __tcf_classify+0x329/0x7d0 [ 2952.593292][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2952.593524][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2952.593825][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2952.594109][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2952.594435][ C2] ? lock_acquire+0x1c1/0x220 [ 2952.594674][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2952.594980][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2952.595266][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2952.595583][ C2] ? __copy_skb_header+0xaf/0x490 [ 2952.595842][ C2] ? __skb_clone+0x57a/0x760 [ 2952.596076][ C2] netif_receive_skb+0x55/0x280 [ 2952.596324][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2952.596637][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2952.596967][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2952.597268][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2952.597541][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2952.597831][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2952.598141][ C2] ? get_stack_info+0x36/0xc0 [ 2952.598383][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2952.598646][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2952.598964][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2952.599240][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2952.599517][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2952.599833][ C2] ? kernel_text_address+0x17/0xe0 [ 2952.600094][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2952.600407][ C2] ? arch_stack_walk+0x8c/0x100 [ 2952.600655][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2952.600919][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2952.601202][ C2] ? lock_acquire+0x1c1/0x220 [ 2952.601444][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2952.601723][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2952.602028][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2952.602303][ C2] ? get_stack_info+0x36/0xc0 [ 2952.602544][ C2] __tcf_classify+0x329/0x7d0 [ 2952.602786][ C2] tcf_classify+0x283/0x930 [ 2952.603019][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2952.603274][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2952.603586][ C2] tc_run+0x2e4/0x5d0 [ 2952.603793][ C2] ? __pfx_tc_run+0x10/0x10 [ 2952.604024][ C2] ? lock_acquire+0x1c1/0x220 [ 2952.604262][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2952.604523][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2952.604776][ C2] ? lock_acquire+0x1c1/0x220 [ 2952.605022][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2952.605287][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2952.605589][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2952.605862][ C2] ? neigh_hh_output+0x348/0x590 [ 2952.606116][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2952.606380][ C2] ip_finish_output2+0x786/0x18e0 [ 2952.606637][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2952.606973][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2952.607248][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2952.607500][ C2] ? __ip_finish_output+0x10f/0x770 [ 2952.607763][ C2] ip_output+0x16b/0x4f0 [ 2952.607981][ C2] ? __pfx_ip_output+0x10/0x10 [ 2952.608224][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2952.608500][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2952.608813][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2952.609090][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2952.609342][ C2] ? __alloc_skb+0xd4/0x280 [ 2952.609572][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2952.609842][ C2] ? tcp_fragment+0x168/0x1040 [ 2952.610086][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2952.610337][ C2] ? ip_local_out+0x114/0x3b0 [ 2952.610576][ C2] __ip_queue_xmit+0x672/0x1910 [ 2952.610824][ C2] ? __skb_clone+0x57a/0x760 [ 2952.611059][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2952.611328][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2952.611607][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2952.611853][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2952.612103][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2952.612403][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2952.612723][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2952.612967][ C2] tcp_send_loss_probe+0x348/0x830 [ 2952.613227][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2952.613497][ C2] tcp_write_timer+0x82/0x1d0 [ 2952.613737][ C2] call_timer_fn+0x173/0x430 [ 2952.613972][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2952.614234][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2952.614495][ C2] __run_timers.part.0+0x52d/0x890 [ 2952.614755][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2952.615036][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2952.615321][ C2] ? lock_acquire+0x1c1/0x220 [ 2952.615560][ C2] ? clockevents_program_event+0xf6/0x300 [ 2952.615848][ C2] ? lock_release+0x1d5/0x250 [ 2952.616094][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2952.616357][ C2] ? ktime_get+0xb3/0x190 [ 2952.616580][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2952.616875][ C2] run_timer_softirq+0x72/0x100 [ 2952.617122][ C2] __do_softirq+0x1b9/0x7ff [ 2952.617355][ C2] irq_exit_rcu+0x98/0xc0 [ 2952.617574][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2952.617861][ C2] [ 2952.618011][ C2] [ 2952.618160][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2952.618466][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2952.618722][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2952.619690][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2952.619997][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2952.620394][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2952.620793][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2952.621190][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2952.621587][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2952.621991][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2952.622281][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2952.622541][ C2] default_idle_call+0x69/0xa0 [ 2952.622785][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2952.623036][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2952.623313][ C2] ? lock_release+0x1d5/0x250 [ 2952.623553][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2952.623825][ C2] do_idle+0xfb/0x160 [ 2952.624028][ C2] cpu_startup_entry+0x55/0x60 [ 2952.624271][ C2] start_secondary+0x21c/0x2b0 [ 2952.624516][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2952.624792][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2952.625105][ C2] [ 2952.625261][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 558s! [perl:4135] [ 2952.625689][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2952.626963][ C1] irq event stamp: 209232 [ 2952.627186][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2952.627724][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2952.628215][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2952.628691][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2952.629161][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2952.629618][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2952.630249][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2952.630579][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2952.631568][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2952.631883][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2952.632290][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2952.632698][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2952.633105][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2952.633514][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2952.633922][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2952.634380][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2952.634719][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2952.635135][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2952.635544][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2952.635954][ C1] PKRU: 55555554 [ 2952.636140][ C1] Call Trace: [ 2952.636314][ C1] [ 2952.636466][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2952.636733][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2952.636983][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2952.637266][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2952.637543][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2952.637838][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2952.638107][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2952.638417][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2952.638681][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2952.638992][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2952.639291][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2952.639608][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2952.639901][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2952.640200][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2952.640492][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2952.640805][ C1] ? get_stack_info+0x36/0xc0 [ 2952.641045][ C1] ? lock_acquire+0x1c1/0x220 [ 2952.641289][ C1] ? lock_release+0x1d5/0x250 [ 2952.641531][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2952.641782][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2952.642056][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2952.642343][ C1] ? lock_acquire+0x1c1/0x220 [ 2952.642589][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2952.642832][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2952.643093][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2952.643331][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2952.643580][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2952.643843][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2952.644126][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2952.644406][ C1] ip_local_deliver+0x19d/0x480 [ 2952.644656][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2952.644935][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2952.645202][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2952.645554][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2952.645811][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2952.646136][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2952.646404][ C1] ip_rcv+0x564/0x740 [ 2952.646611][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2952.646843][ C1] ? set_track_prepare+0x8a/0xd0 [ 2952.647101][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2952.647384][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2952.647659][ C1] ? skb_clone+0x10b/0x330 [ 2952.647890][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2952.648217][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2952.648531][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2952.648818][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2952.649119][ C1] ? __tcf_classify+0x329/0x7d0 [ 2952.649373][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2952.649608][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2952.649914][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2952.650206][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2952.650537][ C1] ? lock_acquire+0x1c1/0x220 [ 2952.650779][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2952.651081][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2952.651375][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2952.651696][ C1] ? __copy_skb_header+0xaf/0x490 [ 2952.651961][ C1] ? __skb_clone+0x57a/0x760 [ 2952.652202][ C1] netif_receive_skb+0x55/0x280 [ 2952.652455][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2952.652775][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2952.653113][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2952.653418][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2952.653698][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2952.653991][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2952.654311][ C1] ? hlock_class+0x4e/0x130 [ 2952.654550][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2952.654837][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2952.655119][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2952.655387][ C1] ? hlock_class+0x4e/0x130 [ 2952.655626][ C1] ? mark_lock+0x38/0x3e0 [ 2952.655849][ C1] ? stack_access_ok+0xda/0x1f0 [ 2952.656103][ C1] ? __lock_acquire+0xb67/0x1610 [ 2952.656362][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2952.656646][ C1] ? get_stack_info+0x36/0xc0 [ 2952.656888][ C1] ? stack_access_ok+0xda/0x1f0 [ 2952.657141][ C1] ? get_reg+0x119/0x190 [ 2952.657361][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2952.657631][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2952.657943][ C1] __tcf_classify+0x329/0x7d0 [ 2952.658187][ C1] tcf_classify+0x283/0x930 [ 2952.658423][ C1] ? arch_stack_walk+0xa2/0x100 [ 2952.658675][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2952.658933][ C1] ? get_stack_info+0x36/0xc0 [ 2952.659179][ C1] tc_run+0x2e4/0x5d0 [ 2952.659387][ C1] ? __pfx_tc_run+0x10/0x10 [ 2952.659619][ C1] ? lock_acquire+0x1c1/0x220 [ 2952.659861][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2952.660125][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2952.660380][ C1] ? lock_acquire+0x1c1/0x220 [ 2952.660620][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2952.660887][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2952.661196][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2952.661470][ C1] ? neigh_hh_output+0x348/0x590 [ 2952.661727][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2952.661993][ C1] ip_finish_output2+0x786/0x18e0 [ 2952.662253][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2952.662533][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2952.662873][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2952.663153][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2952.663412][ C1] ? __ip_finish_output+0x10f/0x770 [ 2952.663681][ C1] ip_output+0x16b/0x4f0 [ 2952.663898][ C1] ? run_timer_softirq+0x72/0x100 [ 2952.664158][ C1] ? __pfx_ip_output+0x10/0x10 [ 2952.664403][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2952.664692][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2952.664955][ C1] ? ip_local_out+0x114/0x3b0 [ 2952.665199][ C1] __ip_queue_xmit+0x672/0x1910 [ 2952.665453][ C1] ? __create_object+0x5e/0xb0 [ 2952.665702][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2952.665973][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2952.666262][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2952.666541][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2952.666827][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2952.667104][ C1] tcp_delack_timer+0x84/0x240 [ 2952.667355][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2952.667631][ C1] call_timer_fn+0x173/0x430 [ 2952.667873][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2952.668139][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2952.668406][ C1] __run_timers.part.0+0x52d/0x890 [ 2952.668671][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2952.668950][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2952.669242][ C1] ? lock_acquire+0x1c1/0x220 [ 2952.669486][ C1] ? clockevents_program_event+0xf6/0x300 [ 2952.669782][ C1] ? lock_release+0x1d5/0x250 [ 2952.670026][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2952.670295][ C1] ? ktime_get+0xb3/0x190 [ 2952.670520][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2952.670823][ C1] run_timer_softirq+0x72/0x100 [ 2952.671077][ C1] __do_softirq+0x1b9/0x7ff [ 2952.671316][ C1] irq_exit_rcu+0x98/0xc0 [ 2952.671540][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2952.671833][ C1] [ 2952.671986][ C1] [ 2952.672140][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2952.672452][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2952.672784][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2952.673782][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2952.674099][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2952.674507][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2952.674923][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2952.675332][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2952.675740][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2952.676151][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2952.676458][ C1] pipe_read+0xa16/0xdf0 [ 2952.676682][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2952.676965][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2952.677210][ C1] ? iterate_tty_write+0x299/0x540 [ 2952.677476][ C1] ? lock_release+0x1d5/0x250 [ 2952.677720][ C1] vfs_read+0x911/0xc00 [ 2952.677936][ C1] ? lock_acquire+0x1c1/0x220 [ 2952.678178][ C1] ? __might_fault+0xc6/0x180 [ 2952.678423][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2952.678666][ C1] ? __might_fault+0xc6/0x180 [ 2952.678908][ C1] ? lock_release+0x1d5/0x250 [ 2952.679150][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2952.679417][ C1] ? __fget_light+0x54/0x1e0 [ 2952.679658][ C1] ksys_read+0x17a/0x1e0 [ 2952.679878][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2952.680127][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2952.680437][ C1] do_syscall_64+0xc9/0x1e0 [ 2952.680675][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2952.680977][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2952.681211][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2952.682193][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2952.682626][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2952.683033][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2952.683438][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2952.683841][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2952.684247][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2952.684660][ C1] [ 2980.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 584s! [perl:4135] [ 2980.569696][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2980.570958][ C1] irq event stamp: 209232 [ 2980.571176][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2980.571706][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 2980.572187][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 2980.572655][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 2980.573118][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 2980.573567][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2980.574183][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2980.574509][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2980.575489][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 2980.575799][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2980.576199][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 2980.576598][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 2980.577001][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 2980.577405][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 2980.577804][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 2980.578252][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2980.578585][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 2980.578990][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2980.579390][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2980.579794][ C1] PKRU: 55555554 [ 2980.579977][ C1] Call Trace: [ 2980.580149][ C1] [ 2980.580297][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2980.580559][ C1] ? __run_hrtimer+0x1c0/0x710 [ 2980.580803][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2980.581080][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 2980.581359][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2980.581648][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2980.581914][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2980.582222][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 2980.582486][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2980.582799][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2980.583095][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2980.583413][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2980.583709][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2980.584006][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2980.584299][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2980.584613][ C1] ? get_stack_info+0x36/0xc0 [ 2980.584865][ C1] ? lock_acquire+0x1c1/0x220 [ 2980.585105][ C1] ? lock_release+0x1d5/0x250 [ 2980.585349][ C1] do_raw_spin_lock+0x1ec/0x270 [ 2980.585603][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2980.585879][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2980.586172][ C1] ? lock_acquire+0x1c1/0x220 [ 2980.586411][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2980.586654][ C1] _raw_spin_lock_nested+0x65/0x80 [ 2980.586914][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 2980.587152][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2980.587404][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 2980.587666][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 2980.587948][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 2980.588231][ C1] ip_local_deliver+0x19d/0x480 [ 2980.588482][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 2980.588758][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2980.589030][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2980.589384][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2980.589641][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2980.589967][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2980.590235][ C1] ip_rcv+0x564/0x740 [ 2980.590443][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2980.590680][ C1] ? set_track_prepare+0x8a/0xd0 [ 2980.590937][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 2980.591219][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 2980.591496][ C1] ? skb_clone+0x10b/0x330 [ 2980.591727][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2980.592051][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2980.592361][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2980.592649][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2980.592949][ C1] ? __tcf_classify+0x329/0x7d0 [ 2980.593203][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 2980.593439][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 2980.593744][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2980.594035][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2980.594366][ C1] ? lock_acquire+0x1c1/0x220 [ 2980.594610][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 2980.594914][ C1] netif_receive_skb_internal+0xb0/0x300 [ 2980.595208][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2980.595529][ C1] ? __copy_skb_header+0xaf/0x490 [ 2980.595792][ C1] ? __skb_clone+0x57a/0x760 [ 2980.596029][ C1] netif_receive_skb+0x55/0x280 [ 2980.596282][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2980.596598][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2980.596935][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2980.597241][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 2980.597518][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 2980.597811][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2980.598128][ C1] ? hlock_class+0x4e/0x130 [ 2980.598365][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2980.598645][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2980.598925][ C1] ? __pfx_validate_chain+0x10/0x10 [ 2980.599193][ C1] ? hlock_class+0x4e/0x130 [ 2980.599423][ C1] ? mark_lock+0x38/0x3e0 [ 2980.599646][ C1] ? stack_access_ok+0xda/0x1f0 [ 2980.599895][ C1] ? __lock_acquire+0xb67/0x1610 [ 2980.600152][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 2980.600432][ C1] ? get_stack_info+0x36/0xc0 [ 2980.600673][ C1] ? stack_access_ok+0xda/0x1f0 [ 2980.600920][ C1] ? get_reg+0x119/0x190 [ 2980.601139][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 2980.601409][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2980.601720][ C1] __tcf_classify+0x329/0x7d0 [ 2980.601968][ C1] tcf_classify+0x283/0x930 [ 2980.602200][ C1] ? arch_stack_walk+0xa2/0x100 [ 2980.602456][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 2980.602713][ C1] ? get_stack_info+0x36/0xc0 [ 2980.602956][ C1] tc_run+0x2e4/0x5d0 [ 2980.603162][ C1] ? __pfx_tc_run+0x10/0x10 [ 2980.603397][ C1] ? lock_acquire+0x1c1/0x220 [ 2980.603635][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 2980.603900][ C1] __dev_queue_xmit+0x686/0x17e0 [ 2980.604154][ C1] ? lock_acquire+0x1c1/0x220 [ 2980.604395][ C1] ? ip_finish_output2+0x786/0x18e0 [ 2980.604667][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2980.604978][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2980.605253][ C1] ? neigh_hh_output+0x348/0x590 [ 2980.605513][ C1] ? ip_finish_output2+0x262/0x18e0 [ 2980.605778][ C1] ip_finish_output2+0x786/0x18e0 [ 2980.606035][ C1] ? stack_depot_save_flags+0x45/0x550 [ 2980.606318][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2980.606656][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 2980.606936][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2980.607194][ C1] ? __ip_finish_output+0x10f/0x770 [ 2980.607462][ C1] ip_output+0x16b/0x4f0 [ 2980.607683][ C1] ? run_timer_softirq+0x72/0x100 [ 2980.607944][ C1] ? __pfx_ip_output+0x10/0x10 [ 2980.608190][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2980.608482][ C1] ? rcu_read_lock_held+0xe/0x50 [ 2980.608740][ C1] ? ip_local_out+0x114/0x3b0 [ 2980.608983][ C1] __ip_queue_xmit+0x672/0x1910 [ 2980.609235][ C1] ? __create_object+0x5e/0xb0 [ 2980.609483][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 2980.609754][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2980.610042][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 2980.610321][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 2980.610606][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2980.610885][ C1] tcp_delack_timer+0x84/0x240 [ 2980.611132][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2980.611409][ C1] call_timer_fn+0x173/0x430 [ 2980.611649][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 2980.611913][ C1] ? next_expiry_recalc+0xcd/0x220 [ 2980.612181][ C1] __run_timers.part.0+0x52d/0x890 [ 2980.612446][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 2980.612725][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 2980.613014][ C1] ? lock_acquire+0x1c1/0x220 [ 2980.613258][ C1] ? clockevents_program_event+0xf6/0x300 [ 2980.613553][ C1] ? lock_release+0x1d5/0x250 [ 2980.613795][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2980.614066][ C1] ? ktime_get+0xb3/0x190 [ 2980.614293][ C1] ? clockevents_program_event+0x1ea/0x300 [ 2980.614592][ C1] run_timer_softirq+0x72/0x100 [ 2980.614852][ C1] __do_softirq+0x1b9/0x7ff [ 2980.615090][ C1] irq_exit_rcu+0x98/0xc0 [ 2980.615315][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 2980.615609][ C1] [ 2980.615761][ C1] [ 2980.615913][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2980.616224][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 2980.616553][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 2980.617539][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 2980.617851][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 2980.618259][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 2980.618662][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 2980.619063][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 2980.619463][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 2980.619866][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 2980.620163][ C1] pipe_read+0xa16/0xdf0 [ 2980.620386][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 2980.620667][ C1] ? __pfx_pipe_read+0x10/0x10 [ 2980.620912][ C1] ? iterate_tty_write+0x299/0x540 [ 2980.621175][ C1] ? lock_release+0x1d5/0x250 [ 2980.621417][ C1] vfs_read+0x911/0xc00 [ 2980.621632][ C1] ? lock_acquire+0x1c1/0x220 [ 2980.621872][ C1] ? __might_fault+0xc6/0x180 [ 2980.622112][ C1] ? __pfx_vfs_read+0x10/0x10 [ 2980.622354][ C1] ? __might_fault+0xc6/0x180 [ 2980.622596][ C1] ? lock_release+0x1d5/0x250 [ 2980.622836][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 2980.623103][ C1] ? __fget_light+0x54/0x1e0 [ 2980.623340][ C1] ksys_read+0x17a/0x1e0 [ 2980.623560][ C1] ? __pfx_ksys_read+0x10/0x10 [ 2980.623805][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2980.624111][ C1] do_syscall_64+0xc9/0x1e0 [ 2980.624350][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 2980.624662][ C1] RIP: 0033:0x7f08a1ea38b2 [ 2980.624892][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 2980.625868][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 2980.626299][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 2980.626704][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 2980.627108][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 2980.627514][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 2980.627920][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 2980.628334][ C1] [ 2980.628496][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 584s! [swapper/2:0] [ 2980.628914][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 2980.630171][ C2] irq event stamp: 44114564 [ 2980.630405][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 2980.630942][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 2980.631455][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 2980.631935][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 2980.632404][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 2980.632859][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 2980.633474][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 2980.633798][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 2980.634778][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 2980.635086][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 2980.635485][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 2980.635882][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 2980.636285][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 2980.636685][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 2980.637083][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 2980.637528][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 2980.637859][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 2980.638262][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 2980.638659][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 2980.639057][ C2] PKRU: 55555554 [ 2980.639239][ C2] Call Trace: [ 2980.639410][ C2] [ 2980.639556][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 2980.639818][ C2] ? __run_hrtimer+0x1c0/0x710 [ 2980.640061][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 2980.640338][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 2980.640611][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 2980.640899][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2980.641164][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 2980.641470][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 2980.641730][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 2980.641992][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 2980.642302][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 2980.642596][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2980.642909][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2980.643202][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 2980.643497][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 2980.643786][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 2980.644098][ C2] ? get_stack_info+0x36/0xc0 [ 2980.644339][ C2] ? lock_acquire+0x1c1/0x220 [ 2980.644576][ C2] ? lock_release+0x1d5/0x250 [ 2980.644824][ C2] do_raw_spin_lock+0x1ec/0x270 [ 2980.645073][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 2980.645346][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2980.645632][ C2] ? lock_acquire+0x1c1/0x220 [ 2980.645869][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 2980.646112][ C2] _raw_spin_lock_nested+0x65/0x80 [ 2980.646372][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 2980.646607][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 2980.646855][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 2980.647114][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 2980.647389][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 2980.647665][ C2] ip_local_deliver+0x19d/0x480 [ 2980.647914][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 2980.648185][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 2980.648450][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 2980.648798][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2980.649052][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 2980.649373][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 2980.649636][ C2] ip_rcv+0x564/0x740 [ 2980.649839][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2980.650071][ C2] ? set_track_prepare+0x8a/0xd0 [ 2980.650324][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2980.650601][ C2] ? start_secondary+0x21c/0x2b0 [ 2980.650853][ C2] ? skb_clone+0x10b/0x330 [ 2980.651080][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 2980.651400][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 2980.651708][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 2980.651989][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 2980.652284][ C2] ? __tcf_classify+0x329/0x7d0 [ 2980.652533][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 2980.652762][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 2980.653061][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2980.653347][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 2980.653673][ C2] ? lock_acquire+0x1c1/0x220 [ 2980.653910][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 2980.654209][ C2] netif_receive_skb_internal+0xb0/0x300 [ 2980.654494][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 2980.654817][ C2] ? __copy_skb_header+0xaf/0x490 [ 2980.655075][ C2] ? __skb_clone+0x57a/0x760 [ 2980.655311][ C2] netif_receive_skb+0x55/0x280 [ 2980.655559][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 2980.655873][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 2980.656206][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 2980.656504][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 2980.656777][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 2980.657064][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 2980.657376][ C2] ? get_stack_info+0x36/0xc0 [ 2980.657617][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 2980.657881][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2980.658199][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2980.658473][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 2980.658747][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 2980.659062][ C2] ? kernel_text_address+0x17/0xe0 [ 2980.659322][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2980.659634][ C2] ? arch_stack_walk+0x8c/0x100 [ 2980.659883][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 2980.660146][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 2980.660433][ C2] ? lock_acquire+0x1c1/0x220 [ 2980.660671][ C2] ? stack_depot_save_flags+0x281/0x550 [ 2980.660953][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2980.661258][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 2980.661534][ C2] ? get_stack_info+0x36/0xc0 [ 2980.661776][ C2] __tcf_classify+0x329/0x7d0 [ 2980.662015][ C2] tcf_classify+0x283/0x930 [ 2980.662249][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 2980.662506][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 2980.662819][ C2] tc_run+0x2e4/0x5d0 [ 2980.663023][ C2] ? __pfx_tc_run+0x10/0x10 [ 2980.663255][ C2] ? lock_acquire+0x1c1/0x220 [ 2980.663492][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 2980.663752][ C2] __dev_queue_xmit+0x686/0x17e0 [ 2980.664004][ C2] ? lock_acquire+0x1c1/0x220 [ 2980.664244][ C2] ? ip_finish_output2+0x786/0x18e0 [ 2980.664508][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 2980.664822][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 2980.665093][ C2] ? neigh_hh_output+0x348/0x590 [ 2980.665345][ C2] ? ip_finish_output2+0x262/0x18e0 [ 2980.665609][ C2] ip_finish_output2+0x786/0x18e0 [ 2980.665865][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 2980.666210][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 2980.666487][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2980.666740][ C2] ? __ip_finish_output+0x10f/0x770 [ 2980.667005][ C2] ip_output+0x16b/0x4f0 [ 2980.667221][ C2] ? __pfx_ip_output+0x10/0x10 [ 2980.667465][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 2980.667742][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2980.668053][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 2980.668332][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 2980.668583][ C2] ? __alloc_skb+0xd4/0x280 [ 2980.668813][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 2980.669081][ C2] ? tcp_fragment+0x168/0x1040 [ 2980.669326][ C2] ? rcu_read_lock_held+0xe/0x50 [ 2980.669577][ C2] ? ip_local_out+0x114/0x3b0 [ 2980.669818][ C2] __ip_queue_xmit+0x672/0x1910 [ 2980.670067][ C2] ? __skb_clone+0x57a/0x760 [ 2980.670306][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 2980.670573][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 2980.670854][ C2] ? ipv4_dst_check+0xe3/0x170 [ 2980.671099][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 2980.671350][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 2980.671648][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 2980.671969][ C2] ? tcp_fragment+0xb0e/0x1040 [ 2980.672215][ C2] tcp_send_loss_probe+0x348/0x830 [ 2980.672475][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2980.672742][ C2] tcp_write_timer+0x82/0x1d0 [ 2980.672983][ C2] call_timer_fn+0x173/0x430 [ 2980.673220][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 2980.673482][ C2] ? next_expiry_recalc+0xcd/0x220 [ 2980.673744][ C2] __run_timers.part.0+0x52d/0x890 [ 2980.674004][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 2980.674274][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 2980.674561][ C2] ? lock_acquire+0x1c1/0x220 [ 2980.674807][ C2] ? clockevents_program_event+0xf6/0x300 [ 2980.675100][ C2] ? lock_release+0x1d5/0x250 [ 2980.675339][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 2980.675604][ C2] ? ktime_get+0xb3/0x190 [ 2980.675823][ C2] ? clockevents_program_event+0x1ea/0x300 [ 2980.676120][ C2] run_timer_softirq+0x72/0x100 [ 2980.676367][ C2] __do_softirq+0x1b9/0x7ff [ 2980.676597][ C2] irq_exit_rcu+0x98/0xc0 [ 2980.676818][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 2980.677101][ C2] [ 2980.677252][ C2] [ 2980.677402][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 2980.677706][ C2] RIP: 0010:default_idle+0xf/0x20 [ 2980.677961][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 2980.678931][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 2980.679240][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 2980.679639][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 2980.680036][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 2980.680433][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 2980.680833][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 2980.681234][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 2980.681522][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 2980.681783][ C2] default_idle_call+0x69/0xa0 [ 2980.682025][ C2] cpuidle_idle_call+0x1f6/0x280 [ 2980.682276][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 2980.682552][ C2] ? lock_release+0x1d5/0x250 [ 2980.682790][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 2980.683064][ C2] do_idle+0xfb/0x160 [ 2980.683269][ C2] cpu_startup_entry+0x55/0x60 [ 2980.683512][ C2] start_secondary+0x21c/0x2b0 [ 2980.683755][ C2] ? __pfx_start_secondary+0x10/0x10 [ 2980.684025][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 2980.684336][ C2] [ 3005.367103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3005.367473][ C1] rcu: 1-....: (649449 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=159205 [ 3005.368027][ C1] rcu: (t=650480 jiffies g=1882453 q=694 ncpus=4) [ 3005.368357][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3005.368805][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3005.369418][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3005.369747][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3005.370718][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3005.371026][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3005.371427][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3005.371825][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3005.372223][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3005.372624][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3005.373024][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3005.373472][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3005.373805][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3005.374205][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3005.374612][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3005.375011][ C1] PKRU: 55555554 [ 3005.375194][ C1] Call Trace: [ 3005.375363][ C1] [ 3005.375515][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3005.375789][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3005.376042][ C1] ? check_cpu_stall+0x284/0x500 [ 3005.376295][ C1] ? rcu_pending+0x92/0x360 [ 3005.376524][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3005.376796][ C1] ? update_process_times+0xb9/0x110 [ 3005.377066][ C1] ? tick_sched_handle+0x67/0x130 [ 3005.377324][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3005.377608][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3005.377850][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3005.378163][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3005.378435][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3005.378724][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3005.378991][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3005.379296][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3005.379559][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3005.379868][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3005.380166][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3005.380481][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3005.380770][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3005.381066][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3005.381355][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3005.381665][ C1] ? get_stack_info+0x36/0xc0 [ 3005.381908][ C1] ? lock_acquire+0x1c1/0x220 [ 3005.382149][ C1] ? lock_release+0x1d5/0x250 [ 3005.382390][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3005.382638][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3005.382911][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3005.383195][ C1] ? lock_acquire+0x1c1/0x220 [ 3005.383433][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3005.383676][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3005.383936][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3005.384170][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3005.384418][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3005.384683][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3005.384960][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3005.385238][ C1] ip_local_deliver+0x19d/0x480 [ 3005.385486][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3005.385761][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3005.386026][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3005.386374][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3005.386627][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3005.386948][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3005.387211][ C1] ip_rcv+0x564/0x740 [ 3005.387418][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3005.387648][ C1] ? set_track_prepare+0x8a/0xd0 [ 3005.387901][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3005.388177][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3005.388452][ C1] ? skb_clone+0x10b/0x330 [ 3005.388679][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3005.388999][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3005.389306][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3005.389587][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3005.389883][ C1] ? __tcf_classify+0x329/0x7d0 [ 3005.390134][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3005.390362][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3005.390664][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3005.390950][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3005.391276][ C1] ? lock_acquire+0x1c1/0x220 [ 3005.391515][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3005.391813][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3005.392097][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3005.392414][ C1] ? __copy_skb_header+0xaf/0x490 [ 3005.392673][ C1] ? __skb_clone+0x57a/0x760 [ 3005.392909][ C1] netif_receive_skb+0x55/0x280 [ 3005.393158][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3005.393475][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3005.393809][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3005.394111][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3005.394390][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3005.394687][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3005.395005][ C1] ? hlock_class+0x4e/0x130 [ 3005.395241][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3005.395521][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3005.395799][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3005.396062][ C1] ? hlock_class+0x4e/0x130 [ 3005.396295][ C1] ? mark_lock+0x38/0x3e0 [ 3005.396514][ C1] ? stack_access_ok+0xda/0x1f0 [ 3005.396764][ C1] ? __lock_acquire+0xb67/0x1610 [ 3005.397019][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3005.397295][ C1] ? get_stack_info+0x36/0xc0 [ 3005.397537][ C1] ? stack_access_ok+0xda/0x1f0 [ 3005.397785][ C1] ? get_reg+0x119/0x190 [ 3005.398002][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3005.398274][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3005.398582][ C1] __tcf_classify+0x329/0x7d0 [ 3005.398826][ C1] tcf_classify+0x283/0x930 [ 3005.399060][ C1] ? arch_stack_walk+0xa2/0x100 [ 3005.399311][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3005.399569][ C1] ? get_stack_info+0x36/0xc0 [ 3005.399809][ C1] tc_run+0x2e4/0x5d0 [ 3005.400018][ C1] ? __pfx_tc_run+0x10/0x10 [ 3005.400248][ C1] ? lock_acquire+0x1c1/0x220 [ 3005.400489][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3005.400751][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3005.401006][ C1] ? lock_acquire+0x1c1/0x220 [ 3005.401248][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3005.401517][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3005.401828][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3005.402103][ C1] ? neigh_hh_output+0x348/0x590 [ 3005.402358][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3005.402628][ C1] ip_finish_output2+0x786/0x18e0 [ 3005.402885][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3005.403163][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3005.403505][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3005.403788][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3005.404044][ C1] ? __ip_finish_output+0x10f/0x770 [ 3005.404312][ C1] ip_output+0x16b/0x4f0 [ 3005.404536][ C1] ? run_timer_softirq+0x72/0x100 [ 3005.404797][ C1] ? __pfx_ip_output+0x10/0x10 [ 3005.405045][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3005.405334][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3005.405589][ C1] ? ip_local_out+0x114/0x3b0 [ 3005.405835][ C1] __ip_queue_xmit+0x672/0x1910 [ 3005.406087][ C1] ? __create_object+0x5e/0xb0 [ 3005.406334][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3005.406603][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3005.406887][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3005.407164][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3005.407451][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3005.407728][ C1] tcp_delack_timer+0x84/0x240 [ 3005.407976][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3005.408251][ C1] call_timer_fn+0x173/0x430 [ 3005.408491][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3005.408756][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3005.409020][ C1] __run_timers.part.0+0x52d/0x890 [ 3005.409285][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3005.409561][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3005.409852][ C1] ? lock_acquire+0x1c1/0x220 [ 3005.410094][ C1] ? clockevents_program_event+0xf6/0x300 [ 3005.410388][ C1] ? lock_release+0x1d5/0x250 [ 3005.410631][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3005.410899][ C1] ? ktime_get+0xb3/0x190 [ 3005.411124][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3005.411426][ C1] run_timer_softirq+0x72/0x100 [ 3005.411680][ C1] __do_softirq+0x1b9/0x7ff [ 3005.411915][ C1] irq_exit_rcu+0x98/0xc0 [ 3005.412140][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3005.412429][ C1] [ 3005.412584][ C1] [ 3005.412736][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3005.413045][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3005.413375][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3005.414362][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3005.414679][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3005.415085][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3005.415484][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3005.415886][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3005.416287][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3005.416689][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3005.416987][ C1] pipe_read+0xa16/0xdf0 [ 3005.417208][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3005.417485][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3005.417731][ C1] ? iterate_tty_write+0x299/0x540 [ 3005.417992][ C1] ? lock_release+0x1d5/0x250 [ 3005.418234][ C1] vfs_read+0x911/0xc00 [ 3005.418447][ C1] ? lock_acquire+0x1c1/0x220 [ 3005.418688][ C1] ? __might_fault+0xc6/0x180 [ 3005.418930][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3005.419172][ C1] ? __might_fault+0xc6/0x180 [ 3005.419412][ C1] ? lock_release+0x1d5/0x250 [ 3005.419653][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3005.419918][ C1] ? __fget_light+0x54/0x1e0 [ 3005.420157][ C1] ksys_read+0x17a/0x1e0 [ 3005.420375][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3005.420623][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3005.420932][ C1] do_syscall_64+0xc9/0x1e0 [ 3005.421168][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3005.421468][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3005.421699][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3005.422678][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3005.423103][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3005.423509][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3005.423912][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3005.424317][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3005.424727][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3005.425138][ C1] [ 3005.425298][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3005.425576][ C2] NMI backtrace for cpu 2 [ 3005.425583][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3005.425590][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3005.425594][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3005.425604][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3005.425610][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3005.425613][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3005.425615][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3005.425617][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3005.425618][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3005.425620][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3005.425622][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3005.425624][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3005.425627][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3005.425629][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3005.425630][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3005.425632][ C2] PKRU: 55555554 [ 3005.425633][ C2] Call Trace: [ 3005.425636][ C2] [ 3005.425638][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3005.425646][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3005.425651][ C2] ? nmi_handle+0x153/0x420 [ 3005.425656][ C2] ? default_do_nmi+0x41/0x100 [ 3005.425659][ C2] ? exc_nmi+0xf3/0x120 [ 3005.425662][ C2] ? end_repeat_nmi+0xf/0x60 [ 3005.425667][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3005.425670][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3005.425673][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3005.425677][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3005.425680][ C2] [ 3005.425680][ C2] [ 3005.425682][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3005.425684][ C2] ? get_stack_info+0x36/0xc0 [ 3005.425688][ C2] ? lock_acquire+0x1c1/0x220 [ 3005.425692][ C2] ? lock_release+0x1d5/0x250 [ 3005.425695][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3005.425699][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3005.425702][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3005.425705][ C2] ? lock_acquire+0x1c1/0x220 [ 3005.425707][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3005.425711][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3005.425714][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3005.425720][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3005.425723][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3005.425727][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3005.425732][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3005.425735][ C2] ip_local_deliver+0x19d/0x480 [ 3005.425738][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3005.425739][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3005.425742][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3005.425747][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3005.425751][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3005.425754][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3005.425763][ C2] ip_rcv+0x564/0x740 [ 3005.425765][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3005.425768][ C2] ? set_track_prepare+0x8a/0xd0 [ 3005.425772][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3005.425775][ C2] ? start_secondary+0x21c/0x2b0 [ 3005.425779][ C2] ? skb_clone+0x10b/0x330 [ 3005.425782][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3005.425788][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3005.425794][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3005.425797][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3005.425806][ C2] ? __tcf_classify+0x329/0x7d0 [ 3005.425809][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3005.425811][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3005.425814][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3005.425818][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3005.425822][ C2] ? lock_acquire+0x1c1/0x220 [ 3005.425824][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3005.425828][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3005.425831][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3005.425835][ C2] ? __copy_skb_header+0xaf/0x490 [ 3005.425839][ C2] ? __skb_clone+0x57a/0x760 [ 3005.425841][ C2] netif_receive_skb+0x55/0x280 [ 3005.425844][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3005.425852][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3005.425858][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3005.425864][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3005.425869][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3005.425879][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3005.425886][ C2] ? get_stack_info+0x36/0xc0 [ 3005.425891][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3005.425894][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3005.425897][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3005.425900][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3005.425903][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3005.425905][ C2] ? kernel_text_address+0x17/0xe0 [ 3005.425908][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3005.425912][ C2] ? arch_stack_walk+0x8c/0x100 [ 3005.425916][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3005.425919][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3005.425922][ C2] ? lock_acquire+0x1c1/0x220 [ 3005.425925][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3005.425929][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3005.425933][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3005.425936][ C2] ? get_stack_info+0x36/0xc0 [ 3005.425941][ C2] __tcf_classify+0x329/0x7d0 [ 3005.425946][ C2] tcf_classify+0x283/0x930 [ 3005.425950][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3005.425953][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3005.425958][ C2] tc_run+0x2e4/0x5d0 [ 3005.425962][ C2] ? __pfx_tc_run+0x10/0x10 [ 3005.425965][ C2] ? lock_acquire+0x1c1/0x220 [ 3005.425967][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3005.425971][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3005.425975][ C2] ? lock_acquire+0x1c1/0x220 [ 3005.425977][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3005.425980][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3005.425983][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3005.425986][ C2] ? neigh_hh_output+0x348/0x590 [ 3005.425990][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3005.425993][ C2] ip_finish_output2+0x786/0x18e0 [ 3005.425996][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3005.426004][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3005.426006][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3005.426010][ C2] ? __ip_finish_output+0x10f/0x770 [ 3005.426014][ C2] ip_output+0x16b/0x4f0 [ 3005.426017][ C2] ? __pfx_ip_output+0x10/0x10 [ 3005.426020][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3005.426022][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3005.426026][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3005.426028][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3005.426031][ C2] ? __alloc_skb+0xd4/0x280 [ 3005.426033][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3005.426038][ C2] ? tcp_fragment+0x168/0x1040 [ 3005.426041][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3005.426044][ C2] ? ip_local_out+0x114/0x3b0 [ 3005.426048][ C2] __ip_queue_xmit+0x672/0x1910 [ 3005.426051][ C2] ? __skb_clone+0x57a/0x760 [ 3005.426054][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3005.426060][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3005.426063][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3005.426066][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3005.426070][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3005.426075][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3005.426077][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3005.426081][ C2] tcp_send_loss_probe+0x348/0x830 [ 3005.426084][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3005.426087][ C2] tcp_write_timer+0x82/0x1d0 [ 3005.426090][ C2] call_timer_fn+0x173/0x430 [ 3005.426094][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3005.426098][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3005.426102][ C2] __run_timers.part.0+0x52d/0x890 [ 3005.426105][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3005.426109][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3005.426112][ C2] ? lock_acquire+0x1c1/0x220 [ 3005.426115][ C2] ? clockevents_program_event+0xf6/0x300 [ 3005.426119][ C2] ? lock_release+0x1d5/0x250 [ 3005.426121][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3005.426125][ C2] ? ktime_get+0xb3/0x190 [ 3005.426128][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3005.426132][ C2] run_timer_softirq+0x72/0x100 [ 3005.426136][ C2] __do_softirq+0x1b9/0x7ff [ 3005.426141][ C2] irq_exit_rcu+0x98/0xc0 [ 3005.426143][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3005.426147][ C2] [ 3005.426148][ C2] [ 3005.426149][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3005.426153][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3005.426156][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3005.426159][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3005.426161][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3005.426163][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3005.426164][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3005.426165][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3005.426167][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3005.426170][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3005.426173][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3005.426176][ C2] default_idle_call+0x69/0xa0 [ 3005.426179][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3005.426181][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3005.426185][ C2] ? lock_release+0x1d5/0x250 [ 3005.426188][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3005.426191][ C2] do_idle+0xfb/0x160 [ 3005.426194][ C2] cpu_startup_entry+0x55/0x60 [ 3005.426196][ C2] start_secondary+0x21c/0x2b0 [ 3005.426199][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3005.426203][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3005.426208][ C2] [ 3032.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 633s! [swapper/2:0] [ 3032.569711][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3032.570963][ C2] irq event stamp: 44114564 [ 3032.571192][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3032.571729][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3032.572239][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3032.572718][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3032.573189][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3032.573644][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3032.574254][ C2] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 3032.574548][ C2] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 3032.575515][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000246 [ 3032.575822][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3032.576220][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3032.576615][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3032.577011][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3032.577411][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3032.577808][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3032.578253][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3032.578583][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3032.578983][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3032.579382][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3032.579778][ C2] PKRU: 55555554 [ 3032.579960][ C2] Call Trace: [ 3032.580133][ C2] [ 3032.580282][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3032.580542][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3032.580785][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3032.581061][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3032.581333][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3032.581621][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3032.581885][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3032.582191][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3032.582451][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3032.582717][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3032.583025][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3032.583320][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3032.583635][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3032.583924][ C2] ? kasan_check_range+0x4/0x1c0 [ 3032.584176][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3032.584461][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3032.584772][ C2] ? get_stack_info+0x36/0xc0 [ 3032.585013][ C2] ? lock_acquire+0x1c1/0x220 [ 3032.585251][ C2] ? lock_release+0x1d5/0x250 [ 3032.585496][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3032.585743][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3032.586014][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3032.586301][ C2] ? lock_acquire+0x1c1/0x220 [ 3032.586538][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3032.586782][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3032.587041][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3032.587278][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3032.587525][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3032.587785][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3032.588059][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3032.588335][ C2] ip_local_deliver+0x19d/0x480 [ 3032.588582][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3032.588852][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3032.589117][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3032.589465][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3032.589718][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3032.590036][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3032.590301][ C2] ip_rcv+0x564/0x740 [ 3032.590504][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3032.590735][ C2] ? set_track_prepare+0x8a/0xd0 [ 3032.590988][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3032.591264][ C2] ? start_secondary+0x21c/0x2b0 [ 3032.591516][ C2] ? skb_clone+0x10b/0x330 [ 3032.591742][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3032.592060][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3032.592368][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3032.592649][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3032.592943][ C2] ? __tcf_classify+0x329/0x7d0 [ 3032.593195][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3032.593426][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3032.593725][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3032.594012][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3032.594338][ C2] ? lock_acquire+0x1c1/0x220 [ 3032.594585][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3032.594882][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3032.595168][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3032.595484][ C2] ? __copy_skb_header+0xaf/0x490 [ 3032.595742][ C2] ? __skb_clone+0x57a/0x760 [ 3032.595977][ C2] netif_receive_skb+0x55/0x280 [ 3032.596226][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3032.596539][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3032.596870][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3032.597171][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3032.597445][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3032.597732][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3032.598044][ C2] ? get_stack_info+0x36/0xc0 [ 3032.598288][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3032.598551][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3032.598869][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3032.599145][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3032.599422][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3032.599736][ C2] ? kernel_text_address+0x17/0xe0 [ 3032.599999][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3032.600311][ C2] ? arch_stack_walk+0x8c/0x100 [ 3032.600561][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3032.600825][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3032.601112][ C2] ? lock_acquire+0x1c1/0x220 [ 3032.601351][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3032.601634][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3032.601940][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3032.602217][ C2] ? get_stack_info+0x36/0xc0 [ 3032.602458][ C2] __tcf_classify+0x329/0x7d0 [ 3032.602699][ C2] tcf_classify+0x283/0x930 [ 3032.602931][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3032.603187][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3032.603500][ C2] tc_run+0x2e4/0x5d0 [ 3032.603705][ C2] ? __pfx_tc_run+0x10/0x10 [ 3032.603936][ C2] ? lock_acquire+0x1c1/0x220 [ 3032.604174][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3032.604442][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3032.604693][ C2] ? lock_acquire+0x1c1/0x220 [ 3032.604930][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3032.605199][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3032.605502][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3032.605771][ C2] ? neigh_hh_output+0x348/0x590 [ 3032.606023][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3032.606288][ C2] ip_finish_output2+0x786/0x18e0 [ 3032.606542][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3032.606880][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3032.607156][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3032.607408][ C2] ? __ip_finish_output+0x10f/0x770 [ 3032.607672][ C2] ip_output+0x16b/0x4f0 [ 3032.607888][ C2] ? __pfx_ip_output+0x10/0x10 [ 3032.608132][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3032.608410][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3032.608720][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3032.609001][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3032.609255][ C2] ? __alloc_skb+0xd4/0x280 [ 3032.609484][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3032.609758][ C2] ? tcp_fragment+0x168/0x1040 [ 3032.610002][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3032.610255][ C2] ? ip_local_out+0x114/0x3b0 [ 3032.610500][ C2] __ip_queue_xmit+0x672/0x1910 [ 3032.610749][ C2] ? __skb_clone+0x57a/0x760 [ 3032.610983][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3032.611253][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3032.611532][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3032.611778][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3032.612028][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3032.612328][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3032.612649][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3032.612893][ C2] tcp_send_loss_probe+0x348/0x830 [ 3032.613154][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3032.613424][ C2] tcp_write_timer+0x82/0x1d0 [ 3032.613664][ C2] call_timer_fn+0x173/0x430 [ 3032.613902][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3032.614164][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3032.614434][ C2] __run_timers.part.0+0x52d/0x890 [ 3032.614695][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3032.614963][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3032.615251][ C2] ? lock_acquire+0x1c1/0x220 [ 3032.615492][ C2] ? clockevents_program_event+0xf6/0x300 [ 3032.615784][ C2] ? lock_release+0x1d5/0x250 [ 3032.616022][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3032.616288][ C2] ? ktime_get+0xb3/0x190 [ 3032.616507][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3032.616803][ C2] run_timer_softirq+0x72/0x100 [ 3032.617052][ C2] __do_softirq+0x1b9/0x7ff [ 3032.617283][ C2] irq_exit_rcu+0x98/0xc0 [ 3032.617505][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3032.617790][ C2] [ 3032.617941][ C2] [ 3032.618091][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3032.618400][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3032.618657][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3032.619625][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3032.619933][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3032.620332][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3032.620731][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3032.621131][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3032.621529][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3032.621927][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3032.622215][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3032.622476][ C2] default_idle_call+0x69/0xa0 [ 3032.622718][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3032.622969][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3032.623248][ C2] ? lock_release+0x1d5/0x250 [ 3032.623484][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3032.623758][ C2] do_idle+0xfb/0x160 [ 3032.623961][ C2] cpu_startup_entry+0x55/0x60 [ 3032.624204][ C2] start_secondary+0x21c/0x2b0 [ 3032.624452][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3032.624723][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3032.625031][ C2] [ 3032.625192][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 633s! [perl:4135] [ 3032.625614][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3032.626878][ C1] irq event stamp: 209232 [ 3032.627098][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3032.627631][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3032.628110][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3032.628580][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3032.629046][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3032.629499][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3032.630120][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3032.630449][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3032.631434][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3032.631746][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3032.632151][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3032.632553][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3032.632960][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3032.633366][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3032.633772][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3032.634224][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3032.634564][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3032.634974][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3032.635379][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3032.635783][ C1] PKRU: 55555554 [ 3032.635968][ C1] Call Trace: [ 3032.636142][ C1] [ 3032.636293][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3032.636559][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3032.636806][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3032.637086][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3032.637361][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3032.637661][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3032.637930][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3032.638242][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3032.638508][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3032.638821][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3032.639119][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3032.639440][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3032.639732][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3032.640031][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3032.640321][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3032.640634][ C1] ? get_stack_info+0x36/0xc0 [ 3032.640874][ C1] ? lock_acquire+0x1c1/0x220 [ 3032.641116][ C1] ? lock_release+0x1d5/0x250 [ 3032.641358][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3032.641609][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3032.641882][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3032.642168][ C1] ? lock_acquire+0x1c1/0x220 [ 3032.642408][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3032.642652][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3032.642913][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3032.643149][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3032.643395][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3032.643654][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3032.643933][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3032.644210][ C1] ip_local_deliver+0x19d/0x480 [ 3032.644465][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3032.644737][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3032.645001][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3032.645350][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3032.645605][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3032.645927][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3032.646193][ C1] ip_rcv+0x564/0x740 [ 3032.646399][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3032.646629][ C1] ? set_track_prepare+0x8a/0xd0 [ 3032.646884][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3032.647163][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3032.647437][ C1] ? skb_clone+0x10b/0x330 [ 3032.647665][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3032.647985][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3032.648292][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3032.648577][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3032.648874][ C1] ? __tcf_classify+0x329/0x7d0 [ 3032.649127][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3032.649360][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3032.649664][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3032.649953][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3032.650282][ C1] ? lock_acquire+0x1c1/0x220 [ 3032.650522][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3032.650823][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3032.651112][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3032.651431][ C1] ? __copy_skb_header+0xaf/0x490 [ 3032.651690][ C1] ? __skb_clone+0x57a/0x760 [ 3032.651927][ C1] netif_receive_skb+0x55/0x280 [ 3032.652179][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3032.652494][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3032.652829][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3032.653134][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3032.653410][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3032.653705][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3032.654022][ C1] ? hlock_class+0x4e/0x130 [ 3032.654260][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3032.654547][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3032.654826][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3032.655092][ C1] ? hlock_class+0x4e/0x130 [ 3032.655328][ C1] ? mark_lock+0x38/0x3e0 [ 3032.655552][ C1] ? stack_access_ok+0xda/0x1f0 [ 3032.655802][ C1] ? __lock_acquire+0xb67/0x1610 [ 3032.656061][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3032.656342][ C1] ? get_stack_info+0x36/0xc0 [ 3032.656585][ C1] ? stack_access_ok+0xda/0x1f0 [ 3032.656835][ C1] ? get_reg+0x119/0x190 [ 3032.657056][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3032.657330][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3032.657643][ C1] __tcf_classify+0x329/0x7d0 [ 3032.657887][ C1] tcf_classify+0x283/0x930 [ 3032.658124][ C1] ? arch_stack_walk+0xa2/0x100 [ 3032.658376][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3032.658637][ C1] ? get_stack_info+0x36/0xc0 [ 3032.658883][ C1] tc_run+0x2e4/0x5d0 [ 3032.659092][ C1] ? __pfx_tc_run+0x10/0x10 [ 3032.659325][ C1] ? lock_acquire+0x1c1/0x220 [ 3032.659566][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3032.659827][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3032.660082][ C1] ? lock_acquire+0x1c1/0x220 [ 3032.660322][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3032.660587][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3032.660895][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3032.661168][ C1] ? neigh_hh_output+0x348/0x590 [ 3032.661422][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3032.661688][ C1] ip_finish_output2+0x786/0x18e0 [ 3032.661946][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3032.662224][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3032.662565][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3032.662844][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3032.663098][ C1] ? __ip_finish_output+0x10f/0x770 [ 3032.663364][ C1] ip_output+0x16b/0x4f0 [ 3032.663584][ C1] ? run_timer_softirq+0x72/0x100 [ 3032.663843][ C1] ? __pfx_ip_output+0x10/0x10 [ 3032.664088][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3032.664377][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3032.664637][ C1] ? ip_local_out+0x114/0x3b0 [ 3032.664880][ C1] __ip_queue_xmit+0x672/0x1910 [ 3032.665132][ C1] ? __create_object+0x5e/0xb0 [ 3032.665380][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3032.665651][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3032.665934][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3032.666210][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3032.666492][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3032.666763][ C1] tcp_delack_timer+0x84/0x240 [ 3032.667008][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3032.667282][ C1] call_timer_fn+0x173/0x430 [ 3032.667522][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3032.667788][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3032.668052][ C1] __run_timers.part.0+0x52d/0x890 [ 3032.668316][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3032.668597][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3032.668886][ C1] ? lock_acquire+0x1c1/0x220 [ 3032.669130][ C1] ? clockevents_program_event+0xf6/0x300 [ 3032.669423][ C1] ? lock_release+0x1d5/0x250 [ 3032.669666][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3032.669933][ C1] ? ktime_get+0xb3/0x190 [ 3032.670159][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3032.670459][ C1] run_timer_softirq+0x72/0x100 [ 3032.670711][ C1] __do_softirq+0x1b9/0x7ff [ 3032.670949][ C1] irq_exit_rcu+0x98/0xc0 [ 3032.671172][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3032.671463][ C1] [ 3032.671616][ C1] [ 3032.671768][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3032.672078][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3032.672409][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3032.673393][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3032.673706][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3032.674108][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3032.674520][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3032.674926][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3032.675331][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3032.675736][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3032.676039][ C1] pipe_read+0xa16/0xdf0 [ 3032.676262][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3032.676546][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3032.676790][ C1] ? iterate_tty_write+0x299/0x540 [ 3032.677058][ C1] ? lock_release+0x1d5/0x250 [ 3032.677301][ C1] vfs_read+0x911/0xc00 [ 3032.677519][ C1] ? lock_acquire+0x1c1/0x220 [ 3032.677759][ C1] ? __might_fault+0xc6/0x180 [ 3032.678003][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3032.678249][ C1] ? __might_fault+0xc6/0x180 [ 3032.678492][ C1] ? lock_release+0x1d5/0x250 [ 3032.678731][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3032.678997][ C1] ? __fget_light+0x54/0x1e0 [ 3032.679237][ C1] ksys_read+0x17a/0x1e0 [ 3032.679456][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3032.679702][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3032.680009][ C1] do_syscall_64+0xc9/0x1e0 [ 3032.680244][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3032.680544][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3032.680774][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3032.681748][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3032.682172][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3032.682573][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3032.682973][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3032.683372][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3032.683773][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3032.684179][ C1] [ 3060.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 659s! [swapper/2:0] [ 3060.569690][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3060.570939][ C2] irq event stamp: 44114564 [ 3060.571169][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3060.571701][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3060.572210][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3060.572686][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3060.573152][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3060.573605][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3060.574218][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3060.574548][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3060.575517][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3060.575824][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3060.576223][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3060.576620][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3060.577018][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3060.577420][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3060.577818][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3060.578264][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3060.578595][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3060.578995][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3060.579396][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3060.579794][ C2] PKRU: 55555554 [ 3060.579975][ C2] Call Trace: [ 3060.580148][ C2] [ 3060.580295][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3060.580556][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3060.580799][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3060.581074][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3060.581345][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3060.581634][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3060.581898][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3060.582203][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3060.582462][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3060.582723][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3060.583031][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3060.583324][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3060.583638][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3060.583926][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3060.584218][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3060.584516][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3060.584825][ C2] ? get_stack_info+0x36/0xc0 [ 3060.585064][ C2] ? lock_acquire+0x1c1/0x220 [ 3060.585304][ C2] ? lock_release+0x1d5/0x250 [ 3060.585543][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3060.585790][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3060.586060][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3060.586345][ C2] ? lock_acquire+0x1c1/0x220 [ 3060.586581][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3060.586821][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3060.587079][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3060.587314][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3060.587561][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3060.587819][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3060.588092][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3060.588368][ C2] ip_local_deliver+0x19d/0x480 [ 3060.588613][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3060.588882][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3060.589145][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3060.589492][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3060.589743][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3060.590063][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3060.590326][ C2] ip_rcv+0x564/0x740 [ 3060.590528][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3060.590758][ C2] ? set_track_prepare+0x8a/0xd0 [ 3060.591012][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3060.591294][ C2] ? start_secondary+0x21c/0x2b0 [ 3060.591545][ C2] ? skb_clone+0x10b/0x330 [ 3060.591770][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3060.592088][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3060.592395][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3060.592673][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3060.592973][ C2] ? __tcf_classify+0x329/0x7d0 [ 3060.593223][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3060.593451][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3060.593752][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3060.594036][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3060.594371][ C2] ? lock_acquire+0x1c1/0x220 [ 3060.594608][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3060.594905][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3060.595188][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3060.595505][ C2] ? __copy_skb_header+0xaf/0x490 [ 3060.595761][ C2] ? __skb_clone+0x57a/0x760 [ 3060.595996][ C2] netif_receive_skb+0x55/0x280 [ 3060.596245][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3060.596558][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3060.596890][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3060.597188][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3060.597463][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3060.597750][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3060.598062][ C2] ? get_stack_info+0x36/0xc0 [ 3060.598304][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3060.598567][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3060.598883][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3060.599159][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3060.599434][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3060.599749][ C2] ? kernel_text_address+0x17/0xe0 [ 3060.600008][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3060.600321][ C2] ? arch_stack_walk+0x8c/0x100 [ 3060.600570][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3060.600833][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3060.601118][ C2] ? lock_acquire+0x1c1/0x220 [ 3060.601354][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3060.601637][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3060.601945][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3060.602223][ C2] ? get_stack_info+0x36/0xc0 [ 3060.602462][ C2] __tcf_classify+0x329/0x7d0 [ 3060.602701][ C2] tcf_classify+0x283/0x930 [ 3060.602933][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3060.603188][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3060.603500][ C2] tc_run+0x2e4/0x5d0 [ 3060.603705][ C2] ? __pfx_tc_run+0x10/0x10 [ 3060.603935][ C2] ? lock_acquire+0x1c1/0x220 [ 3060.604171][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3060.604445][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3060.604697][ C2] ? lock_acquire+0x1c1/0x220 [ 3060.604935][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3060.605199][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3060.605501][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3060.605771][ C2] ? neigh_hh_output+0x348/0x590 [ 3060.606022][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3060.606285][ C2] ip_finish_output2+0x786/0x18e0 [ 3060.606541][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3060.606878][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3060.607155][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3060.607408][ C2] ? __ip_finish_output+0x10f/0x770 [ 3060.607671][ C2] ip_output+0x16b/0x4f0 [ 3060.607886][ C2] ? __pfx_ip_output+0x10/0x10 [ 3060.608129][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3060.608403][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3060.608714][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3060.608990][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3060.609242][ C2] ? __alloc_skb+0xd4/0x280 [ 3060.609471][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3060.609740][ C2] ? tcp_fragment+0x168/0x1040 [ 3060.609984][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3060.610236][ C2] ? ip_local_out+0x114/0x3b0 [ 3060.610476][ C2] __ip_queue_xmit+0x672/0x1910 [ 3060.610724][ C2] ? __skb_clone+0x57a/0x760 [ 3060.610956][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3060.611224][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3060.611507][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3060.611753][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3060.612000][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3060.612301][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3060.612619][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3060.612863][ C2] tcp_send_loss_probe+0x348/0x830 [ 3060.613124][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3060.613390][ C2] tcp_write_timer+0x82/0x1d0 [ 3060.613630][ C2] call_timer_fn+0x173/0x430 [ 3060.613868][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3060.614129][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3060.614399][ C2] __run_timers.part.0+0x52d/0x890 [ 3060.614660][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3060.614928][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3060.615213][ C2] ? lock_acquire+0x1c1/0x220 [ 3060.615451][ C2] ? clockevents_program_event+0xf6/0x300 [ 3060.615742][ C2] ? lock_release+0x1d5/0x250 [ 3060.615979][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3060.616245][ C2] ? ktime_get+0xb3/0x190 [ 3060.616464][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3060.616761][ C2] run_timer_softirq+0x72/0x100 [ 3060.617011][ C2] __do_softirq+0x1b9/0x7ff [ 3060.617242][ C2] irq_exit_rcu+0x98/0xc0 [ 3060.617464][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3060.617748][ C2] [ 3060.617899][ C2] [ 3060.618050][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3060.618356][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3060.618612][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3060.619580][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3060.619887][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3060.620286][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3060.620682][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3060.621077][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3060.621475][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3060.621875][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3060.622161][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3060.622420][ C2] default_idle_call+0x69/0xa0 [ 3060.622664][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3060.622914][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3060.623190][ C2] ? lock_release+0x1d5/0x250 [ 3060.623429][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3060.623699][ C2] do_idle+0xfb/0x160 [ 3060.623904][ C2] cpu_startup_entry+0x55/0x60 [ 3060.624145][ C2] start_secondary+0x21c/0x2b0 [ 3060.624398][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3060.624665][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3060.624974][ C2] [ 3060.625134][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 659s! [perl:4135] [ 3060.625559][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3060.626827][ C1] irq event stamp: 209232 [ 3060.627047][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3060.627577][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3060.628061][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3060.628537][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3060.629004][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3060.629459][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3060.630079][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 3060.630370][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 3060.631351][ C1] RSP: 0018:ffffc900001c7b60 EFLAGS: 00000282 [ 3060.631664][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3060.632067][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3060.632470][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3060.632874][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3060.633278][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3060.633679][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3060.634131][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3060.634474][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3060.634882][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3060.635283][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3060.635689][ C1] PKRU: 55555554 [ 3060.635873][ C1] Call Trace: [ 3060.636047][ C1] [ 3060.636198][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3060.636463][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3060.636710][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3060.636988][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3060.637265][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3060.637556][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3060.637826][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3060.638136][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3060.638402][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3060.638716][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3060.639012][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3060.639327][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3060.639619][ C1] ? kasan_check_range+0x1a/0x1c0 [ 3060.639877][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3060.640158][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3060.640470][ C1] ? get_stack_info+0x36/0xc0 [ 3060.640712][ C1] ? lock_acquire+0x1c1/0x220 [ 3060.640954][ C1] ? lock_release+0x1d5/0x250 [ 3060.641193][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3060.641443][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3060.641716][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3060.642008][ C1] ? lock_acquire+0x1c1/0x220 [ 3060.642248][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3060.642489][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3060.642750][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3060.642986][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3060.643234][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3060.643492][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3060.643768][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3060.644047][ C1] ip_local_deliver+0x19d/0x480 [ 3060.644302][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3060.644577][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3060.644844][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3060.645194][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3060.645447][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3060.645767][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3060.646030][ C1] ip_rcv+0x564/0x740 [ 3060.646234][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3060.646467][ C1] ? set_track_prepare+0x8a/0xd0 [ 3060.646721][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3060.647000][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3060.647275][ C1] ? skb_clone+0x10b/0x330 [ 3060.647506][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3060.647830][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3060.648141][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3060.648425][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3060.648723][ C1] ? __tcf_classify+0x329/0x7d0 [ 3060.648973][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3060.649208][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3060.649513][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3060.649800][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3060.650129][ C1] ? lock_acquire+0x1c1/0x220 [ 3060.650371][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3060.650672][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3060.650960][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3060.651281][ C1] ? __copy_skb_header+0xaf/0x490 [ 3060.651542][ C1] ? __skb_clone+0x57a/0x760 [ 3060.651781][ C1] netif_receive_skb+0x55/0x280 [ 3060.652032][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3060.652349][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3060.652686][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3060.652990][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3060.653266][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3060.653559][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3060.653874][ C1] ? hlock_class+0x4e/0x130 [ 3060.654109][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3060.654393][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3060.654674][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3060.654941][ C1] ? hlock_class+0x4e/0x130 [ 3060.655175][ C1] ? mark_lock+0x38/0x3e0 [ 3060.655398][ C1] ? stack_access_ok+0xda/0x1f0 [ 3060.655650][ C1] ? __lock_acquire+0xb67/0x1610 [ 3060.655907][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3060.656186][ C1] ? get_stack_info+0x36/0xc0 [ 3060.656430][ C1] ? stack_access_ok+0xda/0x1f0 [ 3060.656680][ C1] ? get_reg+0x119/0x190 [ 3060.656899][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3060.657169][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3060.657481][ C1] __tcf_classify+0x329/0x7d0 [ 3060.657727][ C1] tcf_classify+0x283/0x930 [ 3060.657960][ C1] ? arch_stack_walk+0xa2/0x100 [ 3060.658211][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3060.658467][ C1] ? get_stack_info+0x36/0xc0 [ 3060.658711][ C1] tc_run+0x2e4/0x5d0 [ 3060.658916][ C1] ? __pfx_tc_run+0x10/0x10 [ 3060.659150][ C1] ? lock_acquire+0x1c1/0x220 [ 3060.659390][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3060.659653][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3060.659906][ C1] ? lock_acquire+0x1c1/0x220 [ 3060.660144][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3060.660411][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3060.660717][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3060.660990][ C1] ? neigh_hh_output+0x348/0x590 [ 3060.661243][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3060.661510][ C1] ip_finish_output2+0x786/0x18e0 [ 3060.661767][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3060.662045][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3060.662384][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3060.662660][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3060.662913][ C1] ? __ip_finish_output+0x10f/0x770 [ 3060.663180][ C1] ip_output+0x16b/0x4f0 [ 3060.663398][ C1] ? run_timer_softirq+0x72/0x100 [ 3060.663658][ C1] ? __pfx_ip_output+0x10/0x10 [ 3060.663905][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3060.664195][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3060.664455][ C1] ? ip_local_out+0x114/0x3b0 [ 3060.664695][ C1] __ip_queue_xmit+0x672/0x1910 [ 3060.664945][ C1] ? __create_object+0x5e/0xb0 [ 3060.665188][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3060.665459][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3060.665742][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3060.666015][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3060.666301][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3060.666578][ C1] tcp_delack_timer+0x84/0x240 [ 3060.666825][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3060.667099][ C1] call_timer_fn+0x173/0x430 [ 3060.667338][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3060.667602][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3060.667867][ C1] __run_timers.part.0+0x52d/0x890 [ 3060.668130][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3060.668408][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3060.668695][ C1] ? lock_acquire+0x1c1/0x220 [ 3060.668937][ C1] ? clockevents_program_event+0xf6/0x300 [ 3060.669229][ C1] ? lock_release+0x1d5/0x250 [ 3060.669470][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3060.669738][ C1] ? ktime_get+0xb3/0x190 [ 3060.669960][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3060.670260][ C1] run_timer_softirq+0x72/0x100 [ 3060.670512][ C1] __do_softirq+0x1b9/0x7ff [ 3060.670747][ C1] irq_exit_rcu+0x98/0xc0 [ 3060.670970][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3060.671259][ C1] [ 3060.671410][ C1] [ 3060.671566][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3060.671874][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3060.672203][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3060.673185][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3060.673501][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3060.673906][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3060.674318][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3060.674721][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3060.675126][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3060.675534][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3060.675832][ C1] pipe_read+0xa16/0xdf0 [ 3060.676058][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3060.676338][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3060.676584][ C1] ? iterate_tty_write+0x299/0x540 [ 3060.676846][ C1] ? lock_release+0x1d5/0x250 [ 3060.677092][ C1] vfs_read+0x911/0xc00 [ 3060.677308][ C1] ? lock_acquire+0x1c1/0x220 [ 3060.677547][ C1] ? __might_fault+0xc6/0x180 [ 3060.677788][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3060.678027][ C1] ? __might_fault+0xc6/0x180 [ 3060.678269][ C1] ? lock_release+0x1d5/0x250 [ 3060.678510][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3060.678776][ C1] ? __fget_light+0x54/0x1e0 [ 3060.679013][ C1] ksys_read+0x17a/0x1e0 [ 3060.679232][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3060.679478][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3060.679784][ C1] do_syscall_64+0xc9/0x1e0 [ 3060.680017][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3060.680318][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3060.680545][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3060.681523][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3060.681946][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3060.682347][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3060.682750][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3060.683153][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3060.683556][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3060.683957][ C1] [ 3083.425104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3083.425475][ C1] rcu: 1-....: (727221 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=178515 [ 3083.426031][ C1] rcu: (t=728538 jiffies g=1882453 q=694 ncpus=4) [ 3083.426363][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3083.426813][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3083.427431][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3083.427762][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3083.428737][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3083.429048][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3083.429450][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3083.429855][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3083.430261][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3083.430668][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3083.431074][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3083.431530][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3083.431868][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3083.432276][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3083.432683][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3083.433087][ C1] PKRU: 55555554 [ 3083.433273][ C1] Call Trace: [ 3083.433446][ C1] [ 3083.433598][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3083.433876][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3083.434132][ C1] ? check_cpu_stall+0x284/0x500 [ 3083.434397][ C1] ? rcu_pending+0x92/0x360 [ 3083.434630][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3083.434903][ C1] ? update_process_times+0xb9/0x110 [ 3083.435179][ C1] ? tick_sched_handle+0x67/0x130 [ 3083.435439][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3083.435727][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3083.435974][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3083.436293][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3083.436568][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3083.436867][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3083.437137][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3083.437445][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3083.437711][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3083.438023][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3083.438322][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3083.438641][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3083.438937][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3083.439236][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3083.439527][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3083.439842][ C1] ? get_stack_info+0x36/0xc0 [ 3083.440083][ C1] ? lock_acquire+0x1c1/0x220 [ 3083.440328][ C1] ? lock_release+0x1d5/0x250 [ 3083.440570][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3083.440821][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3083.441094][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3083.441381][ C1] ? lock_acquire+0x1c1/0x220 [ 3083.441621][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3083.441865][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3083.442128][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3083.442365][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3083.442613][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3083.442875][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3083.443159][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3083.443440][ C1] ip_local_deliver+0x19d/0x480 [ 3083.443690][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3083.443963][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3083.444235][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3083.444584][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3083.444839][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3083.445162][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3083.445428][ C1] ip_rcv+0x564/0x740 [ 3083.445636][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3083.445867][ C1] ? set_track_prepare+0x8a/0xd0 [ 3083.446124][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3083.446406][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3083.446682][ C1] ? skb_clone+0x10b/0x330 [ 3083.446914][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3083.447238][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3083.447547][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3083.447833][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3083.448134][ C1] ? __tcf_classify+0x329/0x7d0 [ 3083.448390][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3083.448621][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3083.448925][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3083.449215][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3083.449545][ C1] ? lock_acquire+0x1c1/0x220 [ 3083.449784][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3083.450087][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3083.450377][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3083.450698][ C1] ? __copy_skb_header+0xaf/0x490 [ 3083.450959][ C1] ? __skb_clone+0x57a/0x760 [ 3083.451200][ C1] netif_receive_skb+0x55/0x280 [ 3083.451453][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3083.451772][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3083.452109][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3083.452413][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3083.452692][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3083.452985][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3083.453302][ C1] ? hlock_class+0x4e/0x130 [ 3083.453540][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3083.453820][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3083.454098][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3083.454378][ C1] ? hlock_class+0x4e/0x130 [ 3083.454615][ C1] ? mark_lock+0x38/0x3e0 [ 3083.454835][ C1] ? stack_access_ok+0xda/0x1f0 [ 3083.455087][ C1] ? __lock_acquire+0xb67/0x1610 [ 3083.455345][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3083.455624][ C1] ? get_stack_info+0x36/0xc0 [ 3083.455866][ C1] ? stack_access_ok+0xda/0x1f0 [ 3083.456116][ C1] ? get_reg+0x119/0x190 [ 3083.456334][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3083.456606][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3083.456915][ C1] __tcf_classify+0x329/0x7d0 [ 3083.457158][ C1] tcf_classify+0x283/0x930 [ 3083.457393][ C1] ? arch_stack_walk+0xa2/0x100 [ 3083.457644][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3083.457902][ C1] ? get_stack_info+0x36/0xc0 [ 3083.458145][ C1] tc_run+0x2e4/0x5d0 [ 3083.458352][ C1] ? __pfx_tc_run+0x10/0x10 [ 3083.458583][ C1] ? lock_acquire+0x1c1/0x220 [ 3083.458827][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3083.459089][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3083.459344][ C1] ? lock_acquire+0x1c1/0x220 [ 3083.459584][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3083.459851][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3083.460159][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3083.460433][ C1] ? neigh_hh_output+0x348/0x590 [ 3083.460688][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3083.460953][ C1] ip_finish_output2+0x786/0x18e0 [ 3083.461212][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3083.461492][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3083.461832][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3083.462112][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3083.462369][ C1] ? __ip_finish_output+0x10f/0x770 [ 3083.462637][ C1] ip_output+0x16b/0x4f0 [ 3083.462854][ C1] ? run_timer_softirq+0x72/0x100 [ 3083.463114][ C1] ? __pfx_ip_output+0x10/0x10 [ 3083.463358][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3083.463646][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3083.463898][ C1] ? ip_local_out+0x114/0x3b0 [ 3083.464139][ C1] __ip_queue_xmit+0x672/0x1910 [ 3083.464394][ C1] ? __create_object+0x5e/0xb0 [ 3083.464641][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3083.464912][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3083.465196][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3083.465475][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3083.465758][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3083.466033][ C1] tcp_delack_timer+0x84/0x240 [ 3083.466281][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3083.466555][ C1] call_timer_fn+0x173/0x430 [ 3083.466794][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3083.467060][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3083.467325][ C1] __run_timers.part.0+0x52d/0x890 [ 3083.467588][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3083.467865][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3083.468156][ C1] ? lock_acquire+0x1c1/0x220 [ 3083.468398][ C1] ? clockevents_program_event+0xf6/0x300 [ 3083.468691][ C1] ? lock_release+0x1d5/0x250 [ 3083.468934][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3083.469203][ C1] ? ktime_get+0xb3/0x190 [ 3083.469431][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3083.469735][ C1] run_timer_softirq+0x72/0x100 [ 3083.469986][ C1] __do_softirq+0x1b9/0x7ff [ 3083.470224][ C1] irq_exit_rcu+0x98/0xc0 [ 3083.470448][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3083.470737][ C1] [ 3083.470890][ C1] [ 3083.471042][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3083.471351][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3083.471681][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3083.472665][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3083.472979][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3083.473383][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3083.473787][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3083.474196][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3083.474600][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3083.475004][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3083.475305][ C1] pipe_read+0xa16/0xdf0 [ 3083.475527][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3083.475806][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3083.476050][ C1] ? iterate_tty_write+0x299/0x540 [ 3083.476313][ C1] ? lock_release+0x1d5/0x250 [ 3083.476554][ C1] vfs_read+0x911/0xc00 [ 3083.476769][ C1] ? lock_acquire+0x1c1/0x220 [ 3083.477009][ C1] ? __might_fault+0xc6/0x180 [ 3083.477251][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3083.477492][ C1] ? __might_fault+0xc6/0x180 [ 3083.477731][ C1] ? lock_release+0x1d5/0x250 [ 3083.477971][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3083.478236][ C1] ? __fget_light+0x54/0x1e0 [ 3083.478475][ C1] ksys_read+0x17a/0x1e0 [ 3083.478692][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3083.478938][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3083.479245][ C1] do_syscall_64+0xc9/0x1e0 [ 3083.479479][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3083.479779][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3083.480010][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3083.480985][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3083.481412][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3083.481817][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3083.482217][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3083.482616][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3083.483017][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3083.483423][ C1] [ 3083.483581][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3083.483857][ C2] NMI backtrace for cpu 2 [ 3083.483866][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3083.483872][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3083.483876][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3083.483882][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3083.483885][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3083.483888][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3083.483890][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3083.483892][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3083.483894][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3083.483895][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3083.483897][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3083.483899][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3083.483902][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3083.483904][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3083.483905][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3083.483907][ C2] PKRU: 55555554 [ 3083.483908][ C2] Call Trace: [ 3083.483911][ C2] [ 3083.483915][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3083.483922][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3083.483927][ C2] ? nmi_handle+0x153/0x420 [ 3083.483932][ C2] ? default_do_nmi+0x41/0x100 [ 3083.483936][ C2] ? exc_nmi+0xf3/0x120 [ 3083.483938][ C2] ? end_repeat_nmi+0xf/0x60 [ 3083.483943][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3083.483947][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3083.483950][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3083.483953][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3083.483956][ C2] [ 3083.483957][ C2] [ 3083.483958][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3083.483961][ C2] ? get_stack_info+0x36/0xc0 [ 3083.483965][ C2] ? lock_acquire+0x1c1/0x220 [ 3083.483969][ C2] ? lock_release+0x1d5/0x250 [ 3083.483972][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3083.483976][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3083.483979][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3083.483982][ C2] ? lock_acquire+0x1c1/0x220 [ 3083.483985][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3083.483989][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3083.483992][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3083.483998][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3083.484001][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3083.484006][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3083.484012][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3083.484015][ C2] ip_local_deliver+0x19d/0x480 [ 3083.484018][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3083.484020][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3083.484022][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3083.484028][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3083.484031][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3083.484034][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3083.484043][ C2] ip_rcv+0x564/0x740 [ 3083.484045][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3083.484048][ C2] ? set_track_prepare+0x8a/0xd0 [ 3083.484053][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3083.484056][ C2] ? start_secondary+0x21c/0x2b0 [ 3083.484059][ C2] ? skb_clone+0x10b/0x330 [ 3083.484063][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3083.484069][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3083.484074][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3083.484079][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3083.484087][ C2] ? __tcf_classify+0x329/0x7d0 [ 3083.484091][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3083.484093][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3083.484097][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3083.484100][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3083.484104][ C2] ? lock_acquire+0x1c1/0x220 [ 3083.484106][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3083.484110][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3083.484114][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3083.484118][ C2] ? __copy_skb_header+0xaf/0x490 [ 3083.484123][ C2] ? __skb_clone+0x57a/0x760 [ 3083.484125][ C2] netif_receive_skb+0x55/0x280 [ 3083.484128][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3083.484136][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3083.484143][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3083.484149][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3083.484161][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3083.484172][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3083.484179][ C2] ? get_stack_info+0x36/0xc0 [ 3083.484184][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3083.484187][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3083.484191][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3083.484194][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3083.484197][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3083.484199][ C2] ? kernel_text_address+0x17/0xe0 [ 3083.484203][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3083.484207][ C2] ? arch_stack_walk+0x8c/0x100 [ 3083.484212][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3083.484215][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3083.484218][ C2] ? lock_acquire+0x1c1/0x220 [ 3083.484220][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3083.484224][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3083.484229][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3083.484231][ C2] ? get_stack_info+0x36/0xc0 [ 3083.484236][ C2] __tcf_classify+0x329/0x7d0 [ 3083.484241][ C2] tcf_classify+0x283/0x930 [ 3083.484246][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3083.484249][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3083.484253][ C2] tc_run+0x2e4/0x5d0 [ 3083.484257][ C2] ? __pfx_tc_run+0x10/0x10 [ 3083.484260][ C2] ? lock_acquire+0x1c1/0x220 [ 3083.484263][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3083.484267][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3083.484271][ C2] ? lock_acquire+0x1c1/0x220 [ 3083.484273][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3083.484277][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3083.484280][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3083.484283][ C2] ? neigh_hh_output+0x348/0x590 [ 3083.484287][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3083.484290][ C2] ip_finish_output2+0x786/0x18e0 [ 3083.484293][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3083.484301][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3083.484303][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3083.484307][ C2] ? __ip_finish_output+0x10f/0x770 [ 3083.484311][ C2] ip_output+0x16b/0x4f0 [ 3083.484314][ C2] ? __pfx_ip_output+0x10/0x10 [ 3083.484316][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3083.484319][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3083.484322][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3083.484325][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3083.484327][ C2] ? __alloc_skb+0xd4/0x280 [ 3083.484330][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3083.484334][ C2] ? tcp_fragment+0x168/0x1040 [ 3083.484337][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3083.484341][ C2] ? ip_local_out+0x114/0x3b0 [ 3083.484344][ C2] __ip_queue_xmit+0x672/0x1910 [ 3083.484348][ C2] ? __skb_clone+0x57a/0x760 [ 3083.484351][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3083.484357][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3083.484360][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3083.484364][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3083.484368][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3083.484373][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3083.484375][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3083.484379][ C2] tcp_send_loss_probe+0x348/0x830 [ 3083.484383][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3083.484385][ C2] tcp_write_timer+0x82/0x1d0 [ 3083.484388][ C2] call_timer_fn+0x173/0x430 [ 3083.484392][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3083.484397][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3083.484401][ C2] __run_timers.part.0+0x52d/0x890 [ 3083.484404][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3083.484408][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3083.484411][ C2] ? lock_acquire+0x1c1/0x220 [ 3083.484413][ C2] ? clockevents_program_event+0xf6/0x300 [ 3083.484418][ C2] ? lock_release+0x1d5/0x250 [ 3083.484420][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3083.484424][ C2] ? ktime_get+0xb3/0x190 [ 3083.484427][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3083.484431][ C2] run_timer_softirq+0x72/0x100 [ 3083.484435][ C2] __do_softirq+0x1b9/0x7ff [ 3083.484439][ C2] irq_exit_rcu+0x98/0xc0 [ 3083.484442][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3083.484445][ C2] [ 3083.484446][ C2] [ 3083.484447][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3083.484450][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3083.484453][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3083.484455][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3083.484458][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3083.484460][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3083.484461][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3083.484462][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3083.484464][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3083.484467][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3083.484470][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3083.484473][ C2] default_idle_call+0x69/0xa0 [ 3083.484476][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3083.484479][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3083.484483][ C2] ? lock_release+0x1d5/0x250 [ 3083.484485][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3083.484489][ C2] do_idle+0xfb/0x160 [ 3083.484491][ C2] cpu_startup_entry+0x55/0x60 [ 3083.484493][ C2] start_secondary+0x21c/0x2b0 [ 3083.484496][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3083.484500][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3083.484506][ C2] [ 3108.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 704s! [perl:4135] [ 3108.569701][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3108.570963][ C1] irq event stamp: 209232 [ 3108.571181][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3108.571715][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3108.572197][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3108.572666][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3108.573131][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3108.573583][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3108.574210][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3108.574532][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3108.575511][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3108.575824][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3108.576228][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3108.576633][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3108.577040][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3108.577445][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3108.577852][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3108.578306][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3108.578643][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3108.579052][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3108.579460][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3108.579865][ C1] PKRU: 55555554 [ 3108.580048][ C1] Call Trace: [ 3108.580224][ C1] [ 3108.580374][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3108.580640][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3108.580888][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3108.581168][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3108.581446][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3108.581739][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3108.582007][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3108.582317][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3108.582585][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3108.582899][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3108.583198][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3108.583515][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3108.583812][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3108.584110][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3108.584406][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3108.584722][ C1] ? get_stack_info+0x36/0xc0 [ 3108.584965][ C1] ? lock_acquire+0x1c1/0x220 [ 3108.585209][ C1] ? lock_release+0x1d5/0x250 [ 3108.585453][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3108.585706][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3108.585980][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3108.586268][ C1] ? lock_acquire+0x1c1/0x220 [ 3108.586507][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3108.586750][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3108.587012][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3108.587249][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3108.587498][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3108.587756][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3108.588034][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3108.588312][ C1] ip_local_deliver+0x19d/0x480 [ 3108.588562][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3108.588834][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3108.589099][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3108.589451][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3108.589706][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3108.590029][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3108.590295][ C1] ip_rcv+0x564/0x740 [ 3108.590499][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3108.590731][ C1] ? set_track_prepare+0x8a/0xd0 [ 3108.590985][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3108.591269][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3108.591547][ C1] ? skb_clone+0x10b/0x330 [ 3108.591779][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3108.592102][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3108.592409][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3108.592695][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3108.592990][ C1] ? __tcf_classify+0x329/0x7d0 [ 3108.593241][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3108.593477][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3108.593780][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3108.594079][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3108.594410][ C1] ? lock_acquire+0x1c1/0x220 [ 3108.594652][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3108.594952][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3108.595245][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3108.595571][ C1] ? __copy_skb_header+0xaf/0x490 [ 3108.595832][ C1] ? __skb_clone+0x57a/0x760 [ 3108.596069][ C1] netif_receive_skb+0x55/0x280 [ 3108.596323][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3108.596639][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3108.596976][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3108.597282][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3108.597560][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3108.597853][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3108.598172][ C1] ? hlock_class+0x4e/0x130 [ 3108.598409][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3108.598689][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3108.598969][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3108.599239][ C1] ? hlock_class+0x4e/0x130 [ 3108.599474][ C1] ? mark_lock+0x38/0x3e0 [ 3108.599698][ C1] ? stack_access_ok+0xda/0x1f0 [ 3108.599949][ C1] ? __lock_acquire+0xb67/0x1610 [ 3108.600206][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3108.600488][ C1] ? get_stack_info+0x36/0xc0 [ 3108.600731][ C1] ? stack_access_ok+0xda/0x1f0 [ 3108.600980][ C1] ? get_reg+0x119/0x190 [ 3108.601202][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3108.601473][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3108.601789][ C1] __tcf_classify+0x329/0x7d0 [ 3108.602033][ C1] tcf_classify+0x283/0x930 [ 3108.602269][ C1] ? arch_stack_walk+0xa2/0x100 [ 3108.602525][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3108.602785][ C1] ? get_stack_info+0x36/0xc0 [ 3108.603031][ C1] tc_run+0x2e4/0x5d0 [ 3108.603239][ C1] ? __pfx_tc_run+0x10/0x10 [ 3108.603473][ C1] ? lock_acquire+0x1c1/0x220 [ 3108.603714][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3108.603978][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3108.604243][ C1] ? lock_acquire+0x1c1/0x220 [ 3108.604485][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3108.604752][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3108.605064][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3108.605336][ C1] ? neigh_hh_output+0x348/0x590 [ 3108.605590][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3108.605856][ C1] ip_finish_output2+0x786/0x18e0 [ 3108.606115][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3108.606398][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3108.606739][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3108.607015][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3108.607272][ C1] ? __ip_finish_output+0x10f/0x770 [ 3108.607538][ C1] ip_output+0x16b/0x4f0 [ 3108.607757][ C1] ? run_timer_softirq+0x72/0x100 [ 3108.608016][ C1] ? __pfx_ip_output+0x10/0x10 [ 3108.608260][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3108.608549][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3108.608802][ C1] ? ip_local_out+0x114/0x3b0 [ 3108.609042][ C1] __ip_queue_xmit+0x672/0x1910 [ 3108.609294][ C1] ? __create_object+0x5e/0xb0 [ 3108.609540][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3108.609807][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3108.610090][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3108.610366][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3108.610654][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3108.610931][ C1] tcp_delack_timer+0x84/0x240 [ 3108.611177][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3108.611453][ C1] call_timer_fn+0x173/0x430 [ 3108.611689][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3108.611951][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3108.612214][ C1] __run_timers.part.0+0x52d/0x890 [ 3108.612475][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3108.612753][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3108.613040][ C1] ? lock_acquire+0x1c1/0x220 [ 3108.613284][ C1] ? clockevents_program_event+0xf6/0x300 [ 3108.613578][ C1] ? lock_release+0x1d5/0x250 [ 3108.613821][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3108.614092][ C1] ? ktime_get+0xb3/0x190 [ 3108.614321][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3108.614620][ C1] run_timer_softirq+0x72/0x100 [ 3108.614873][ C1] __do_softirq+0x1b9/0x7ff [ 3108.615113][ C1] irq_exit_rcu+0x98/0xc0 [ 3108.615336][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3108.615628][ C1] [ 3108.615780][ C1] [ 3108.615933][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3108.616244][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3108.616574][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3108.617561][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3108.617874][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3108.618280][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3108.618687][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3108.619091][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3108.619496][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3108.619904][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3108.620208][ C1] pipe_read+0xa16/0xdf0 [ 3108.620431][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3108.620714][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3108.620959][ C1] ? iterate_tty_write+0x299/0x540 [ 3108.621231][ C1] ? lock_release+0x1d5/0x250 [ 3108.621473][ C1] vfs_read+0x911/0xc00 [ 3108.621692][ C1] ? lock_acquire+0x1c1/0x220 [ 3108.621932][ C1] ? __might_fault+0xc6/0x180 [ 3108.622177][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3108.622419][ C1] ? __might_fault+0xc6/0x180 [ 3108.622664][ C1] ? lock_release+0x1d5/0x250 [ 3108.622905][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3108.623174][ C1] ? __fget_light+0x54/0x1e0 [ 3108.623414][ C1] ksys_read+0x17a/0x1e0 [ 3108.623635][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3108.623881][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3108.624198][ C1] do_syscall_64+0xc9/0x1e0 [ 3108.624435][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3108.624737][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3108.624967][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3108.625941][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3108.626365][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3108.626766][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3108.627169][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3108.627569][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3108.627970][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3108.628374][ C1] [ 3108.628533][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 704s! [swapper/2:0] [ 3108.628952][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3108.630208][ C2] irq event stamp: 44114564 [ 3108.630435][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3108.630971][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3108.631486][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3108.631959][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3108.632428][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3108.632884][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3108.633494][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3108.633816][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3108.634793][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3108.635101][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3108.635500][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3108.635900][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3108.636298][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3108.636695][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3108.637092][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3108.637543][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3108.637878][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3108.638279][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3108.638676][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3108.639074][ C2] PKRU: 55555554 [ 3108.639255][ C2] Call Trace: [ 3108.639426][ C2] [ 3108.639573][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3108.639835][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3108.640079][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3108.640359][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3108.640631][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3108.640917][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3108.641184][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3108.641490][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3108.641749][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3108.642011][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3108.642322][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3108.642617][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3108.642931][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3108.643219][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3108.643513][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3108.643799][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3108.644116][ C2] ? get_stack_info+0x36/0xc0 [ 3108.644357][ C2] ? lock_acquire+0x1c1/0x220 [ 3108.644597][ C2] ? lock_release+0x1d5/0x250 [ 3108.644834][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3108.645082][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3108.645354][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3108.645639][ C2] ? lock_acquire+0x1c1/0x220 [ 3108.645876][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3108.646114][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3108.646375][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3108.646609][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3108.646854][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3108.647112][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3108.647385][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3108.647661][ C2] ip_local_deliver+0x19d/0x480 [ 3108.647908][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3108.648182][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3108.648445][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3108.648790][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3108.649042][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3108.649361][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3108.649622][ C2] ip_rcv+0x564/0x740 [ 3108.649824][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3108.650058][ C2] ? set_track_prepare+0x8a/0xd0 [ 3108.650312][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3108.650587][ C2] ? start_secondary+0x21c/0x2b0 [ 3108.650837][ C2] ? skb_clone+0x10b/0x330 [ 3108.651065][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3108.651386][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3108.651690][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3108.651973][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3108.652267][ C2] ? __tcf_classify+0x329/0x7d0 [ 3108.652515][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3108.652745][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3108.653042][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3108.653331][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3108.653656][ C2] ? lock_acquire+0x1c1/0x220 [ 3108.653895][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3108.654199][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3108.654486][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3108.654802][ C2] ? __copy_skb_header+0xaf/0x490 [ 3108.655059][ C2] ? __skb_clone+0x57a/0x760 [ 3108.655293][ C2] netif_receive_skb+0x55/0x280 [ 3108.655541][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3108.655852][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3108.656184][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3108.656483][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3108.656756][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3108.657042][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3108.657355][ C2] ? get_stack_info+0x36/0xc0 [ 3108.657597][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3108.657859][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3108.658178][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3108.658453][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3108.658731][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3108.659046][ C2] ? kernel_text_address+0x17/0xe0 [ 3108.659308][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3108.659619][ C2] ? arch_stack_walk+0x8c/0x100 [ 3108.659866][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3108.660132][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3108.660418][ C2] ? lock_acquire+0x1c1/0x220 [ 3108.660657][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3108.660938][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3108.661244][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3108.661519][ C2] ? get_stack_info+0x36/0xc0 [ 3108.661761][ C2] __tcf_classify+0x329/0x7d0 [ 3108.662002][ C2] tcf_classify+0x283/0x930 [ 3108.662234][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3108.662490][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3108.662802][ C2] tc_run+0x2e4/0x5d0 [ 3108.663007][ C2] ? __pfx_tc_run+0x10/0x10 [ 3108.663240][ C2] ? lock_acquire+0x1c1/0x220 [ 3108.663478][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3108.663738][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3108.663989][ C2] ? lock_acquire+0x1c1/0x220 [ 3108.664240][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3108.664505][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3108.664806][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3108.665079][ C2] ? neigh_hh_output+0x348/0x590 [ 3108.665332][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3108.665596][ C2] ip_finish_output2+0x786/0x18e0 [ 3108.665852][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3108.666198][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3108.666472][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3108.666723][ C2] ? __ip_finish_output+0x10f/0x770 [ 3108.666986][ C2] ip_output+0x16b/0x4f0 [ 3108.667203][ C2] ? __pfx_ip_output+0x10/0x10 [ 3108.667445][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3108.667723][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3108.668033][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3108.668311][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3108.668562][ C2] ? __alloc_skb+0xd4/0x280 [ 3108.668789][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3108.669060][ C2] ? tcp_fragment+0x168/0x1040 [ 3108.669303][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3108.669554][ C2] ? ip_local_out+0x114/0x3b0 [ 3108.669798][ C2] __ip_queue_xmit+0x672/0x1910 [ 3108.670046][ C2] ? __skb_clone+0x57a/0x760 [ 3108.670283][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3108.670549][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3108.670829][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3108.671073][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3108.671324][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3108.671623][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3108.671942][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3108.672186][ C2] tcp_send_loss_probe+0x348/0x830 [ 3108.672446][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3108.672716][ C2] tcp_write_timer+0x82/0x1d0 [ 3108.672955][ C2] call_timer_fn+0x173/0x430 [ 3108.673194][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3108.673455][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3108.673716][ C2] __run_timers.part.0+0x52d/0x890 [ 3108.673975][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3108.674252][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3108.674538][ C2] ? lock_acquire+0x1c1/0x220 [ 3108.674776][ C2] ? clockevents_program_event+0xf6/0x300 [ 3108.675065][ C2] ? lock_release+0x1d5/0x250 [ 3108.675305][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3108.675569][ C2] ? ktime_get+0xb3/0x190 [ 3108.675788][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3108.676085][ C2] run_timer_softirq+0x72/0x100 [ 3108.676334][ C2] __do_softirq+0x1b9/0x7ff [ 3108.676566][ C2] irq_exit_rcu+0x98/0xc0 [ 3108.676787][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3108.677070][ C2] [ 3108.677224][ C2] [ 3108.677373][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3108.677677][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3108.677934][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3108.678903][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3108.679212][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3108.679610][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3108.680006][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3108.680407][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3108.680804][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3108.681210][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3108.681498][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3108.681759][ C2] default_idle_call+0x69/0xa0 [ 3108.682001][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3108.682252][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3108.682530][ C2] ? lock_release+0x1d5/0x250 [ 3108.682767][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3108.683042][ C2] do_idle+0xfb/0x160 [ 3108.683246][ C2] cpu_startup_entry+0x55/0x60 [ 3108.683489][ C2] start_secondary+0x21c/0x2b0 [ 3108.683731][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3108.684000][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3108.684317][ C2] [ 3136.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 730s! [swapper/2:0] [ 3136.569694][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3136.570944][ C2] irq event stamp: 44114564 [ 3136.571172][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3136.571703][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3136.572216][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3136.572691][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3136.573157][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3136.573611][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3136.574230][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3136.574553][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3136.575520][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3136.575825][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3136.576221][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3136.576618][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3136.577016][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3136.577412][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3136.577809][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3136.578256][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3136.578587][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3136.578988][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3136.579387][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3136.579785][ C2] PKRU: 55555554 [ 3136.579967][ C2] Call Trace: [ 3136.580139][ C2] [ 3136.580287][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3136.580547][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3136.580789][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3136.581064][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3136.581338][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3136.581625][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3136.581889][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3136.582195][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3136.582455][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3136.582716][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3136.583024][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3136.583320][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3136.583632][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3136.583932][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3136.584226][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3136.584514][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3136.584823][ C2] ? get_stack_info+0x36/0xc0 [ 3136.585064][ C2] ? lock_acquire+0x1c1/0x220 [ 3136.585301][ C2] ? lock_release+0x1d5/0x250 [ 3136.585541][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3136.585788][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3136.586058][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3136.586346][ C2] ? lock_acquire+0x1c1/0x220 [ 3136.586582][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3136.586821][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3136.587079][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3136.587314][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3136.587561][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3136.587818][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3136.588090][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3136.588366][ C2] ip_local_deliver+0x19d/0x480 [ 3136.588613][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3136.588884][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3136.589147][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3136.589493][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3136.589745][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3136.590064][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3136.590326][ C2] ip_rcv+0x564/0x740 [ 3136.590529][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3136.590759][ C2] ? set_track_prepare+0x8a/0xd0 [ 3136.591011][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3136.591286][ C2] ? start_secondary+0x21c/0x2b0 [ 3136.591537][ C2] ? skb_clone+0x10b/0x330 [ 3136.591762][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3136.592078][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3136.592386][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3136.592667][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3136.592959][ C2] ? __tcf_classify+0x329/0x7d0 [ 3136.593209][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3136.593437][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3136.593736][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3136.594029][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3136.594355][ C2] ? lock_acquire+0x1c1/0x220 [ 3136.594593][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3136.594888][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3136.595174][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3136.595490][ C2] ? __copy_skb_header+0xaf/0x490 [ 3136.595746][ C2] ? __skb_clone+0x57a/0x760 [ 3136.595979][ C2] netif_receive_skb+0x55/0x280 [ 3136.596228][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3136.596539][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3136.596871][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3136.597170][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3136.597444][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3136.597730][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3136.598043][ C2] ? get_stack_info+0x36/0xc0 [ 3136.598285][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3136.598547][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3136.598863][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3136.599138][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3136.599415][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3136.599729][ C2] ? kernel_text_address+0x17/0xe0 [ 3136.599989][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3136.600301][ C2] ? arch_stack_walk+0x8c/0x100 [ 3136.600549][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3136.600813][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3136.601099][ C2] ? lock_acquire+0x1c1/0x220 [ 3136.601338][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3136.601620][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3136.601925][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3136.602201][ C2] ? get_stack_info+0x36/0xc0 [ 3136.602443][ C2] __tcf_classify+0x329/0x7d0 [ 3136.602683][ C2] tcf_classify+0x283/0x930 [ 3136.602915][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3136.603171][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3136.603482][ C2] tc_run+0x2e4/0x5d0 [ 3136.603686][ C2] ? __pfx_tc_run+0x10/0x10 [ 3136.603923][ C2] ? lock_acquire+0x1c1/0x220 [ 3136.604162][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3136.604422][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3136.604674][ C2] ? lock_acquire+0x1c1/0x220 [ 3136.604910][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3136.605175][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3136.605478][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3136.605750][ C2] ? neigh_hh_output+0x348/0x590 [ 3136.606001][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3136.606267][ C2] ip_finish_output2+0x786/0x18e0 [ 3136.606522][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3136.606858][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3136.607132][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3136.607384][ C2] ? __ip_finish_output+0x10f/0x770 [ 3136.607647][ C2] ip_output+0x16b/0x4f0 [ 3136.607862][ C2] ? __pfx_ip_output+0x10/0x10 [ 3136.608104][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3136.608380][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3136.608690][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3136.608968][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3136.609221][ C2] ? __alloc_skb+0xd4/0x280 [ 3136.609449][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3136.609719][ C2] ? tcp_fragment+0x168/0x1040 [ 3136.609960][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3136.610212][ C2] ? ip_local_out+0x114/0x3b0 [ 3136.610452][ C2] __ip_queue_xmit+0x672/0x1910 [ 3136.610699][ C2] ? __skb_clone+0x57a/0x760 [ 3136.610933][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3136.611200][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3136.611478][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3136.611724][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3136.611973][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3136.612273][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3136.612592][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3136.612835][ C2] tcp_send_loss_probe+0x348/0x830 [ 3136.613094][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3136.613363][ C2] tcp_write_timer+0x82/0x1d0 [ 3136.613601][ C2] call_timer_fn+0x173/0x430 [ 3136.613839][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3136.614108][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3136.614369][ C2] __run_timers.part.0+0x52d/0x890 [ 3136.614628][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3136.614897][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3136.615183][ C2] ? lock_acquire+0x1c1/0x220 [ 3136.615421][ C2] ? clockevents_program_event+0xf6/0x300 [ 3136.615712][ C2] ? lock_release+0x1d5/0x250 [ 3136.615952][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3136.616216][ C2] ? ktime_get+0xb3/0x190 [ 3136.616435][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3136.616733][ C2] run_timer_softirq+0x72/0x100 [ 3136.616981][ C2] __do_softirq+0x1b9/0x7ff [ 3136.617214][ C2] irq_exit_rcu+0x98/0xc0 [ 3136.617435][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3136.617719][ C2] [ 3136.617870][ C2] [ 3136.618019][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3136.618324][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3136.618582][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3136.619549][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3136.619857][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3136.620254][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3136.620651][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3136.621050][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3136.621448][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3136.621848][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3136.622136][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3136.622397][ C2] default_idle_call+0x69/0xa0 [ 3136.622638][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3136.622889][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3136.623169][ C2] ? lock_release+0x1d5/0x250 [ 3136.623404][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3136.623679][ C2] do_idle+0xfb/0x160 [ 3136.623882][ C2] cpu_startup_entry+0x55/0x60 [ 3136.624133][ C2] start_secondary+0x21c/0x2b0 [ 3136.624375][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3136.624644][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3136.624953][ C2] [ 3136.625111][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 730s! [perl:4135] [ 3136.625536][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3136.626801][ C1] irq event stamp: 209232 [ 3136.627019][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3136.627551][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3136.628037][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3136.628512][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3136.628974][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3136.629423][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3136.630041][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3136.630370][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3136.631353][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3136.631665][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3136.632069][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3136.632473][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3136.632878][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3136.633283][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3136.633686][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3136.634145][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3136.634481][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3136.634891][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3136.635297][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3136.635701][ C1] PKRU: 55555554 [ 3136.635886][ C1] Call Trace: [ 3136.636061][ C1] [ 3136.636211][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3136.636477][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3136.636724][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3136.637003][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3136.637280][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3136.637572][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3136.637840][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3136.638150][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3136.638415][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3136.638730][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3136.639026][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3136.639345][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3136.639640][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3136.639937][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3136.640231][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3136.640550][ C1] ? get_stack_info+0x36/0xc0 [ 3136.640793][ C1] ? lock_acquire+0x1c1/0x220 [ 3136.641037][ C1] ? lock_release+0x1d5/0x250 [ 3136.641280][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3136.641530][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3136.641804][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3136.642090][ C1] ? lock_acquire+0x1c1/0x220 [ 3136.642330][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3136.642572][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3136.642833][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3136.643069][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3136.643317][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3136.643575][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3136.643852][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3136.644137][ C1] ip_local_deliver+0x19d/0x480 [ 3136.644385][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3136.644657][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3136.644921][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3136.645273][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3136.645526][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3136.645848][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3136.646112][ C1] ip_rcv+0x564/0x740 [ 3136.646316][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3136.646549][ C1] ? set_track_prepare+0x8a/0xd0 [ 3136.646807][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3136.647088][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3136.647365][ C1] ? skb_clone+0x10b/0x330 [ 3136.647596][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3136.647915][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3136.648221][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3136.648504][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3136.648799][ C1] ? __tcf_classify+0x329/0x7d0 [ 3136.649050][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3136.649284][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3136.649585][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3136.649876][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3136.650204][ C1] ? lock_acquire+0x1c1/0x220 [ 3136.650445][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3136.650743][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3136.651032][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3136.651352][ C1] ? __copy_skb_header+0xaf/0x490 [ 3136.651612][ C1] ? __skb_clone+0x57a/0x760 [ 3136.651848][ C1] netif_receive_skb+0x55/0x280 [ 3136.652099][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3136.652416][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3136.652752][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3136.653054][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3136.653331][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3136.653621][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3136.653945][ C1] ? hlock_class+0x4e/0x130 [ 3136.654183][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3136.654462][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3136.654741][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3136.655012][ C1] ? hlock_class+0x4e/0x130 [ 3136.655246][ C1] ? mark_lock+0x38/0x3e0 [ 3136.655471][ C1] ? stack_access_ok+0xda/0x1f0 [ 3136.655720][ C1] ? __lock_acquire+0xb67/0x1610 [ 3136.655975][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3136.656258][ C1] ? get_stack_info+0x36/0xc0 [ 3136.656500][ C1] ? stack_access_ok+0xda/0x1f0 [ 3136.656748][ C1] ? get_reg+0x119/0x190 [ 3136.656968][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3136.657239][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3136.657553][ C1] __tcf_classify+0x329/0x7d0 [ 3136.657796][ C1] tcf_classify+0x283/0x930 [ 3136.658029][ C1] ? arch_stack_walk+0xa2/0x100 [ 3136.658281][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3136.658541][ C1] ? get_stack_info+0x36/0xc0 [ 3136.658785][ C1] tc_run+0x2e4/0x5d0 [ 3136.658993][ C1] ? __pfx_tc_run+0x10/0x10 [ 3136.659228][ C1] ? lock_acquire+0x1c1/0x220 [ 3136.659469][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3136.659732][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3136.659987][ C1] ? lock_acquire+0x1c1/0x220 [ 3136.660230][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3136.660495][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3136.660802][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3136.661075][ C1] ? neigh_hh_output+0x348/0x590 [ 3136.661329][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3136.661594][ C1] ip_finish_output2+0x786/0x18e0 [ 3136.661851][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3136.662132][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3136.662471][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3136.662747][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3136.663001][ C1] ? __ip_finish_output+0x10f/0x770 [ 3136.663266][ C1] ip_output+0x16b/0x4f0 [ 3136.663483][ C1] ? run_timer_softirq+0x72/0x100 [ 3136.663741][ C1] ? __pfx_ip_output+0x10/0x10 [ 3136.663991][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3136.664281][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3136.664533][ C1] ? ip_local_out+0x114/0x3b0 [ 3136.664772][ C1] __ip_queue_xmit+0x672/0x1910 [ 3136.665022][ C1] ? __create_object+0x5e/0xb0 [ 3136.665268][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3136.665535][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3136.665818][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3136.666095][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3136.666381][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3136.666656][ C1] tcp_delack_timer+0x84/0x240 [ 3136.666900][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3136.667174][ C1] call_timer_fn+0x173/0x430 [ 3136.667410][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3136.667672][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3136.667933][ C1] __run_timers.part.0+0x52d/0x890 [ 3136.668193][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3136.668470][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3136.668758][ C1] ? lock_acquire+0x1c1/0x220 [ 3136.668999][ C1] ? clockevents_program_event+0xf6/0x300 [ 3136.669292][ C1] ? lock_release+0x1d5/0x250 [ 3136.669535][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3136.669802][ C1] ? ktime_get+0xb3/0x190 [ 3136.670027][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3136.670327][ C1] run_timer_softirq+0x72/0x100 [ 3136.670577][ C1] __do_softirq+0x1b9/0x7ff [ 3136.670814][ C1] irq_exit_rcu+0x98/0xc0 [ 3136.671037][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3136.671329][ C1] [ 3136.671480][ C1] [ 3136.671632][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3136.671941][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3136.672269][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3136.673255][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3136.673568][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3136.673980][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3136.674388][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3136.674791][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3136.675194][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3136.675598][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3136.675899][ C1] pipe_read+0xa16/0xdf0 [ 3136.676122][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3136.676406][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3136.676652][ C1] ? iterate_tty_write+0x299/0x540 [ 3136.676918][ C1] ? lock_release+0x1d5/0x250 [ 3136.677160][ C1] vfs_read+0x911/0xc00 [ 3136.677379][ C1] ? lock_acquire+0x1c1/0x220 [ 3136.677618][ C1] ? __might_fault+0xc6/0x180 [ 3136.677864][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3136.678108][ C1] ? __might_fault+0xc6/0x180 [ 3136.678352][ C1] ? lock_release+0x1d5/0x250 [ 3136.678592][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3136.678861][ C1] ? __fget_light+0x54/0x1e0 [ 3136.679099][ C1] ksys_read+0x17a/0x1e0 [ 3136.679320][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3136.679564][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3136.679870][ C1] do_syscall_64+0xc9/0x1e0 [ 3136.680106][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3136.680405][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3136.680633][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3136.681605][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3136.682029][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3136.682429][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3136.682829][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3136.683227][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3136.683629][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3136.684038][ C1] [ 3161.483102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3161.483467][ C1] rcu: 1-....: (805049 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=197842 [ 3161.484027][ C1] rcu: (t=806596 jiffies g=1882453 q=694 ncpus=4) [ 3161.484356][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3161.484804][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3161.485416][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12b/0xb90 [ 3161.485744][ C1] Code: 24 80 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc 90 e9 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 [ 3161.486715][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3161.487024][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3161.487423][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3161.487824][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3161.488225][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3161.488623][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3161.489023][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3161.489470][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3161.489805][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3161.490205][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3161.490603][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3161.491003][ C1] PKRU: 55555554 [ 3161.491184][ C1] Call Trace: [ 3161.491355][ C1] [ 3161.491503][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3161.491778][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3161.492030][ C1] ? check_cpu_stall+0x284/0x500 [ 3161.492281][ C1] ? rcu_pending+0x92/0x360 [ 3161.492511][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3161.492780][ C1] ? update_process_times+0xb9/0x110 [ 3161.493051][ C1] ? tick_sched_handle+0x67/0x130 [ 3161.493308][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3161.493594][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3161.493844][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3161.494157][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3161.494429][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3161.494716][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3161.494982][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3161.495288][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3161.495550][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3161.495860][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3161.496157][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3161.496473][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3161.496761][ C1] ? queued_spin_lock_slowpath+0x12b/0xb90 [ 3161.497057][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3161.497345][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3161.497656][ C1] ? get_stack_info+0x36/0xc0 [ 3161.497898][ C1] ? lock_acquire+0x1c1/0x220 [ 3161.498139][ C1] ? lock_release+0x1d5/0x250 [ 3161.498378][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3161.498627][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3161.498900][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3161.499185][ C1] ? lock_acquire+0x1c1/0x220 [ 3161.499425][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3161.499667][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3161.499928][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3161.500163][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3161.500409][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3161.500668][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3161.500943][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3161.501222][ C1] ip_local_deliver+0x19d/0x480 [ 3161.501472][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3161.501748][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3161.502011][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3161.502358][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3161.502612][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3161.502930][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3161.503192][ C1] ip_rcv+0x564/0x740 [ 3161.503395][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3161.503626][ C1] ? set_track_prepare+0x8a/0xd0 [ 3161.503886][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3161.504162][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3161.504434][ C1] ? skb_clone+0x10b/0x330 [ 3161.504662][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3161.504981][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3161.505288][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3161.505570][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3161.505869][ C1] ? __tcf_classify+0x329/0x7d0 [ 3161.506117][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3161.506347][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3161.506649][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3161.506933][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3161.507262][ C1] ? lock_acquire+0x1c1/0x220 [ 3161.507504][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3161.507801][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3161.508087][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3161.508404][ C1] ? __copy_skb_header+0xaf/0x490 [ 3161.508665][ C1] ? __skb_clone+0x57a/0x760 [ 3161.508902][ C1] netif_receive_skb+0x55/0x280 [ 3161.509157][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3161.509471][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3161.509808][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3161.510109][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3161.510385][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3161.510680][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3161.510996][ C1] ? hlock_class+0x4e/0x130 [ 3161.511232][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3161.511511][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3161.511791][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3161.512059][ C1] ? hlock_class+0x4e/0x130 [ 3161.512293][ C1] ? mark_lock+0x38/0x3e0 [ 3161.512515][ C1] ? stack_access_ok+0xda/0x1f0 [ 3161.512769][ C1] ? __lock_acquire+0xb67/0x1610 [ 3161.513025][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3161.513303][ C1] ? get_stack_info+0x36/0xc0 [ 3161.513547][ C1] ? stack_access_ok+0xda/0x1f0 [ 3161.513802][ C1] ? get_reg+0x119/0x190 [ 3161.514019][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3161.514289][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3161.514602][ C1] __tcf_classify+0x329/0x7d0 [ 3161.514847][ C1] tcf_classify+0x283/0x930 [ 3161.515081][ C1] ? arch_stack_walk+0xa2/0x100 [ 3161.515332][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3161.515590][ C1] ? get_stack_info+0x36/0xc0 [ 3161.515834][ C1] tc_run+0x2e4/0x5d0 [ 3161.516042][ C1] ? __pfx_tc_run+0x10/0x10 [ 3161.516276][ C1] ? lock_acquire+0x1c1/0x220 [ 3161.516517][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3161.516778][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3161.517034][ C1] ? lock_acquire+0x1c1/0x220 [ 3161.517273][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3161.517539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3161.517844][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3161.518123][ C1] ? neigh_hh_output+0x348/0x590 [ 3161.518375][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3161.518642][ C1] ip_finish_output2+0x786/0x18e0 [ 3161.518898][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3161.519177][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3161.519515][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3161.519793][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3161.520045][ C1] ? __ip_finish_output+0x10f/0x770 [ 3161.520313][ C1] ip_output+0x16b/0x4f0 [ 3161.520530][ C1] ? run_timer_softirq+0x72/0x100 [ 3161.520787][ C1] ? __pfx_ip_output+0x10/0x10 [ 3161.521033][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3161.521319][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3161.521572][ C1] ? ip_local_out+0x114/0x3b0 [ 3161.521814][ C1] __ip_queue_xmit+0x672/0x1910 [ 3161.522063][ C1] ? __create_object+0x5e/0xb0 [ 3161.522309][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3161.522579][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3161.522860][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3161.523134][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3161.523417][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3161.523688][ C1] tcp_delack_timer+0x84/0x240 [ 3161.523941][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3161.524217][ C1] call_timer_fn+0x173/0x430 [ 3161.524458][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3161.524723][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3161.524988][ C1] __run_timers.part.0+0x52d/0x890 [ 3161.525251][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3161.525528][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3161.525818][ C1] ? lock_acquire+0x1c1/0x220 [ 3161.526059][ C1] ? clockevents_program_event+0xf6/0x300 [ 3161.526355][ C1] ? lock_release+0x1d5/0x250 [ 3161.526596][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3161.526865][ C1] ? ktime_get+0xb3/0x190 [ 3161.527088][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3161.527390][ C1] run_timer_softirq+0x72/0x100 [ 3161.527642][ C1] __do_softirq+0x1b9/0x7ff [ 3161.527877][ C1] irq_exit_rcu+0x98/0xc0 [ 3161.528100][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3161.528389][ C1] [ 3161.528541][ C1] [ 3161.528694][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3161.529002][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3161.529330][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3161.530313][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3161.530626][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3161.531030][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3161.531434][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3161.531841][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3161.532246][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3161.532651][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3161.532950][ C1] pipe_read+0xa16/0xdf0 [ 3161.533174][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3161.533454][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3161.533700][ C1] ? iterate_tty_write+0x299/0x540 [ 3161.533972][ C1] ? lock_release+0x1d5/0x250 [ 3161.534216][ C1] vfs_read+0x911/0xc00 [ 3161.534431][ C1] ? lock_acquire+0x1c1/0x220 [ 3161.534673][ C1] ? __might_fault+0xc6/0x180 [ 3161.534915][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3161.535155][ C1] ? __might_fault+0xc6/0x180 [ 3161.535399][ C1] ? lock_release+0x1d5/0x250 [ 3161.535639][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3161.535904][ C1] ? __fget_light+0x54/0x1e0 [ 3161.536143][ C1] ksys_read+0x17a/0x1e0 [ 3161.536360][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3161.536606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3161.536913][ C1] do_syscall_64+0xc9/0x1e0 [ 3161.537145][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3161.537446][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3161.537674][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3161.538649][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3161.539070][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3161.539469][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3161.539869][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3161.540270][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3161.540669][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3161.541070][ C1] [ 3161.541230][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3161.541504][ C2] NMI backtrace for cpu 2 [ 3161.541512][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3161.541517][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3161.541520][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 3161.541527][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 3161.541530][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 3161.541533][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3161.541535][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3161.541536][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3161.541538][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3161.541540][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3161.541541][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3161.541543][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3161.541547][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3161.541548][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3161.541550][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3161.541551][ C2] PKRU: 55555554 [ 3161.541552][ C2] Call Trace: [ 3161.541555][ C2] [ 3161.541556][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3161.541564][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3161.541570][ C2] ? nmi_handle+0x153/0x420 [ 3161.541574][ C2] ? default_do_nmi+0x41/0x100 [ 3161.541577][ C2] ? exc_nmi+0xf3/0x120 [ 3161.541579][ C2] ? end_repeat_nmi+0xf/0x60 [ 3161.541584][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3161.541588][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 3161.541592][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 3161.541595][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 3161.541599][ C2] [ 3161.541599][ C2] [ 3161.541601][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3161.541604][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3161.541607][ C2] ? get_stack_info+0x36/0xc0 [ 3161.541611][ C2] ? lock_acquire+0x1c1/0x220 [ 3161.541615][ C2] ? lock_release+0x1d5/0x250 [ 3161.541618][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3161.541622][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3161.541625][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3161.541628][ C2] ? lock_acquire+0x1c1/0x220 [ 3161.541630][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3161.541634][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3161.541637][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3161.541643][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3161.541646][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3161.541650][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3161.541655][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3161.541659][ C2] ip_local_deliver+0x19d/0x480 [ 3161.541661][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3161.541663][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3161.541666][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3161.541672][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3161.541676][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3161.541679][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3161.541688][ C2] ip_rcv+0x564/0x740 [ 3161.541690][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3161.541693][ C2] ? set_track_prepare+0x8a/0xd0 [ 3161.541697][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3161.541700][ C2] ? start_secondary+0x21c/0x2b0 [ 3161.541703][ C2] ? skb_clone+0x10b/0x330 [ 3161.541706][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3161.541712][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3161.541718][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3161.541722][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3161.541730][ C2] ? __tcf_classify+0x329/0x7d0 [ 3161.541734][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3161.541736][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3161.541740][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3161.541743][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3161.541747][ C2] ? lock_acquire+0x1c1/0x220 [ 3161.541750][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3161.541754][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3161.541758][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3161.541762][ C2] ? __copy_skb_header+0xaf/0x490 [ 3161.541766][ C2] ? __skb_clone+0x57a/0x760 [ 3161.541768][ C2] netif_receive_skb+0x55/0x280 [ 3161.541771][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3161.541779][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3161.541785][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3161.541792][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3161.541796][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3161.541807][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3161.541814][ C2] ? get_stack_info+0x36/0xc0 [ 3161.541818][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3161.541821][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3161.541825][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3161.541827][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3161.541831][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3161.541833][ C2] ? kernel_text_address+0x17/0xe0 [ 3161.541835][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3161.541839][ C2] ? arch_stack_walk+0x8c/0x100 [ 3161.541843][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3161.541846][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3161.541849][ C2] ? lock_acquire+0x1c1/0x220 [ 3161.541851][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3161.541855][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3161.541859][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3161.541862][ C2] ? get_stack_info+0x36/0xc0 [ 3161.541866][ C2] __tcf_classify+0x329/0x7d0 [ 3161.541871][ C2] tcf_classify+0x283/0x930 [ 3161.541876][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3161.541879][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3161.541883][ C2] tc_run+0x2e4/0x5d0 [ 3161.541887][ C2] ? __pfx_tc_run+0x10/0x10 [ 3161.541890][ C2] ? lock_acquire+0x1c1/0x220 [ 3161.541892][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3161.541896][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3161.541900][ C2] ? lock_acquire+0x1c1/0x220 [ 3161.541902][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3161.541905][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3161.541908][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3161.541911][ C2] ? neigh_hh_output+0x348/0x590 [ 3161.541914][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3161.541918][ C2] ip_finish_output2+0x786/0x18e0 [ 3161.541921][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3161.541928][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3161.541931][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3161.541935][ C2] ? __ip_finish_output+0x10f/0x770 [ 3161.541938][ C2] ip_output+0x16b/0x4f0 [ 3161.541941][ C2] ? __pfx_ip_output+0x10/0x10 [ 3161.541944][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3161.541947][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3161.541950][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3161.541952][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3161.541955][ C2] ? __alloc_skb+0xd4/0x280 [ 3161.541957][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3161.541960][ C2] ? tcp_fragment+0x168/0x1040 [ 3161.541964][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3161.541966][ C2] ? ip_local_out+0x114/0x3b0 [ 3161.541970][ C2] __ip_queue_xmit+0x672/0x1910 [ 3161.541973][ C2] ? __skb_clone+0x57a/0x760 [ 3161.541976][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3161.541982][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3161.541984][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3161.541988][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3161.541992][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3161.541996][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3161.541999][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3161.542002][ C2] tcp_send_loss_probe+0x348/0x830 [ 3161.542005][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3161.542008][ C2] tcp_write_timer+0x82/0x1d0 [ 3161.542011][ C2] call_timer_fn+0x173/0x430 [ 3161.542014][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3161.542019][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3161.542023][ C2] __run_timers.part.0+0x52d/0x890 [ 3161.542026][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3161.542030][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3161.542033][ C2] ? lock_acquire+0x1c1/0x220 [ 3161.542036][ C2] ? clockevents_program_event+0xf6/0x300 [ 3161.542040][ C2] ? lock_release+0x1d5/0x250 [ 3161.542043][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3161.542046][ C2] ? ktime_get+0xb3/0x190 [ 3161.542050][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3161.542054][ C2] run_timer_softirq+0x72/0x100 [ 3161.542058][ C2] __do_softirq+0x1b9/0x7ff [ 3161.542062][ C2] irq_exit_rcu+0x98/0xc0 [ 3161.542065][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3161.542067][ C2] [ 3161.542068][ C2] [ 3161.542069][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3161.542072][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3161.542075][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3161.542078][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3161.542079][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3161.542081][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3161.542082][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3161.542084][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3161.542085][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3161.542088][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3161.542091][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3161.542094][ C2] default_idle_call+0x69/0xa0 [ 3161.542097][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3161.542099][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3161.542103][ C2] ? lock_release+0x1d5/0x250 [ 3161.542105][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3161.542109][ C2] do_idle+0xfb/0x160 [ 3161.542111][ C2] cpu_startup_entry+0x55/0x60 [ 3161.542113][ C2] start_secondary+0x21c/0x2b0 [ 3161.542117][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3161.542121][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3161.542126][ C2] [ 3184.777030][ T75] kmemleak: 44 new suspected memory leaks (see /sys/kernel/debug/kmemleak) [ 3188.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 778s! [perl:4135] [ 3188.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3188.570963][ C1] irq event stamp: 209232 [ 3188.571184][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3188.571716][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3188.572196][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3188.572668][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3188.573132][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3188.573582][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3188.574204][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3188.574533][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3188.575511][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3188.575820][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3188.576222][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3188.576623][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3188.577023][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3188.577427][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3188.577829][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3188.578280][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3188.578615][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3188.579017][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3188.579421][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3188.579821][ C1] PKRU: 55555554 [ 3188.580004][ C1] Call Trace: [ 3188.580175][ C1] [ 3188.580325][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3188.580588][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3188.580833][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3188.581111][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3188.581384][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3188.581676][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3188.581944][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3188.582254][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3188.582518][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3188.582829][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3188.583127][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3188.583444][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3188.583740][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3188.584037][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3188.584329][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3188.584641][ C1] ? get_stack_info+0x36/0xc0 [ 3188.584883][ C1] ? lock_acquire+0x1c1/0x220 [ 3188.585126][ C1] ? lock_release+0x1d5/0x250 [ 3188.585369][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3188.585620][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3188.585894][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3188.586181][ C1] ? lock_acquire+0x1c1/0x220 [ 3188.586422][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3188.586665][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3188.586928][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3188.587165][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3188.587413][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3188.587673][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3188.587952][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3188.588231][ C1] ip_local_deliver+0x19d/0x480 [ 3188.588481][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3188.588754][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3188.589020][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3188.589371][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3188.589627][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3188.589950][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3188.590214][ C1] ip_rcv+0x564/0x740 [ 3188.590421][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3188.590655][ C1] ? set_track_prepare+0x8a/0xd0 [ 3188.590912][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3188.591193][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3188.591468][ C1] ? skb_clone+0x10b/0x330 [ 3188.591695][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3188.592017][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3188.592328][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3188.592613][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3188.592913][ C1] ? __tcf_classify+0x329/0x7d0 [ 3188.593166][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3188.593400][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3188.593709][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3188.593997][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3188.594327][ C1] ? lock_acquire+0x1c1/0x220 [ 3188.594565][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3188.594865][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3188.595154][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3188.595475][ C1] ? __copy_skb_header+0xaf/0x490 [ 3188.595737][ C1] ? __skb_clone+0x57a/0x760 [ 3188.595976][ C1] netif_receive_skb+0x55/0x280 [ 3188.596229][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3188.596548][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3188.596886][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3188.597190][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3188.597470][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3188.597761][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3188.598078][ C1] ? hlock_class+0x4e/0x130 [ 3188.598316][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3188.598596][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3188.598877][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3188.599146][ C1] ? hlock_class+0x4e/0x130 [ 3188.599383][ C1] ? mark_lock+0x38/0x3e0 [ 3188.599604][ C1] ? stack_access_ok+0xda/0x1f0 [ 3188.599857][ C1] ? __lock_acquire+0xb67/0x1610 [ 3188.600115][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3188.600396][ C1] ? get_stack_info+0x36/0xc0 [ 3188.600639][ C1] ? stack_access_ok+0xda/0x1f0 [ 3188.600889][ C1] ? get_reg+0x119/0x190 [ 3188.601110][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3188.601382][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3188.601694][ C1] __tcf_classify+0x329/0x7d0 [ 3188.601939][ C1] tcf_classify+0x283/0x930 [ 3188.602176][ C1] ? arch_stack_walk+0xa2/0x100 [ 3188.602429][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3188.602690][ C1] ? get_stack_info+0x36/0xc0 [ 3188.602933][ C1] tc_run+0x2e4/0x5d0 [ 3188.603143][ C1] ? __pfx_tc_run+0x10/0x10 [ 3188.603376][ C1] ? lock_acquire+0x1c1/0x220 [ 3188.603619][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3188.603888][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3188.604146][ C1] ? lock_acquire+0x1c1/0x220 [ 3188.604391][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3188.604660][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3188.604970][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3188.605246][ C1] ? neigh_hh_output+0x348/0x590 [ 3188.605504][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3188.605773][ C1] ip_finish_output2+0x786/0x18e0 [ 3188.606033][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3188.606314][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3188.606656][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3188.606934][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3188.607191][ C1] ? __ip_finish_output+0x10f/0x770 [ 3188.607458][ C1] ip_output+0x16b/0x4f0 [ 3188.607674][ C1] ? run_timer_softirq+0x72/0x100 [ 3188.607932][ C1] ? __pfx_ip_output+0x10/0x10 [ 3188.608180][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3188.608469][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3188.608723][ C1] ? ip_local_out+0x114/0x3b0 [ 3188.608966][ C1] __ip_queue_xmit+0x672/0x1910 [ 3188.609216][ C1] ? __create_object+0x5e/0xb0 [ 3188.609464][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3188.609734][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3188.610016][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3188.610294][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3188.610577][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3188.610851][ C1] tcp_delack_timer+0x84/0x240 [ 3188.611096][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3188.611371][ C1] call_timer_fn+0x173/0x430 [ 3188.611609][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3188.611873][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3188.612137][ C1] __run_timers.part.0+0x52d/0x890 [ 3188.612400][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3188.612677][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3188.612965][ C1] ? lock_acquire+0x1c1/0x220 [ 3188.613210][ C1] ? clockevents_program_event+0xf6/0x300 [ 3188.613502][ C1] ? lock_release+0x1d5/0x250 [ 3188.613753][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3188.614021][ C1] ? ktime_get+0xb3/0x190 [ 3188.614245][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3188.614547][ C1] run_timer_softirq+0x72/0x100 [ 3188.614800][ C1] __do_softirq+0x1b9/0x7ff [ 3188.615037][ C1] irq_exit_rcu+0x98/0xc0 [ 3188.615259][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3188.615553][ C1] [ 3188.615711][ C1] [ 3188.615862][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3188.616172][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3188.616501][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3188.617486][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3188.617800][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3188.618204][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3188.618608][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3188.619014][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3188.619418][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3188.619823][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3188.620125][ C1] pipe_read+0xa16/0xdf0 [ 3188.620349][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3188.620631][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3188.620876][ C1] ? iterate_tty_write+0x299/0x540 [ 3188.621142][ C1] ? lock_release+0x1d5/0x250 [ 3188.621386][ C1] vfs_read+0x911/0xc00 [ 3188.621603][ C1] ? lock_acquire+0x1c1/0x220 [ 3188.621843][ C1] ? __might_fault+0xc6/0x180 [ 3188.622086][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3188.622330][ C1] ? __might_fault+0xc6/0x180 [ 3188.622573][ C1] ? lock_release+0x1d5/0x250 [ 3188.622816][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3188.623083][ C1] ? __fget_light+0x54/0x1e0 [ 3188.623324][ C1] ksys_read+0x17a/0x1e0 [ 3188.623543][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3188.623799][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3188.624108][ C1] do_syscall_64+0xc9/0x1e0 [ 3188.624346][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3188.624648][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3188.624883][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3188.625866][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3188.626290][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3188.626693][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3188.627093][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3188.627494][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3188.627894][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3188.628301][ C1] [ 3188.628459][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 778s! [swapper/2:0] [ 3188.628876][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3188.630130][ C2] irq event stamp: 44114564 [ 3188.630360][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3188.630893][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3188.631405][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3188.631881][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3188.632351][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3188.632805][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3188.633416][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3188.633750][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3188.634720][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3188.635028][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3188.635427][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3188.635824][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3188.636222][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3188.636622][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3188.637019][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3188.637466][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3188.637798][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3188.638198][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3188.638599][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3188.638996][ C2] PKRU: 55555554 [ 3188.639179][ C2] Call Trace: [ 3188.639350][ C2] [ 3188.639498][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3188.639764][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3188.640009][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3188.640285][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3188.640556][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3188.640846][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3188.641110][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3188.641417][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3188.641678][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3188.641939][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3188.642250][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3188.642545][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3188.642860][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3188.643150][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3188.643443][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3188.643741][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3188.644051][ C2] ? get_stack_info+0x36/0xc0 [ 3188.644290][ C2] ? lock_acquire+0x1c1/0x220 [ 3188.644530][ C2] ? lock_release+0x1d5/0x250 [ 3188.644769][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3188.645018][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3188.645291][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3188.645574][ C2] ? lock_acquire+0x1c1/0x220 [ 3188.645812][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3188.646053][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3188.646313][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3188.646548][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3188.646795][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3188.647052][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3188.647328][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3188.647604][ C2] ip_local_deliver+0x19d/0x480 [ 3188.647851][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3188.648122][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3188.648384][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3188.648733][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3188.648985][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3188.649305][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3188.649568][ C2] ip_rcv+0x564/0x740 [ 3188.649771][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3188.650001][ C2] ? set_track_prepare+0x8a/0xd0 [ 3188.650254][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3188.650534][ C2] ? start_secondary+0x21c/0x2b0 [ 3188.650786][ C2] ? skb_clone+0x10b/0x330 [ 3188.651011][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3188.651330][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3188.651636][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3188.651915][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3188.652212][ C2] ? __tcf_classify+0x329/0x7d0 [ 3188.652461][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3188.652692][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3188.652994][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3188.653278][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3188.653604][ C2] ? lock_acquire+0x1c1/0x220 [ 3188.653858][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3188.654157][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3188.654441][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3188.654757][ C2] ? __copy_skb_header+0xaf/0x490 [ 3188.655016][ C2] ? __skb_clone+0x57a/0x760 [ 3188.655251][ C2] netif_receive_skb+0x55/0x280 [ 3188.655501][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3188.655813][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3188.656147][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3188.656445][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3188.656721][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3188.657008][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3188.657322][ C2] ? get_stack_info+0x36/0xc0 [ 3188.657563][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3188.657828][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3188.658146][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3188.658422][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3188.658698][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3188.659013][ C2] ? kernel_text_address+0x17/0xe0 [ 3188.659274][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3188.659587][ C2] ? arch_stack_walk+0x8c/0x100 [ 3188.659837][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3188.660101][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3188.660386][ C2] ? lock_acquire+0x1c1/0x220 [ 3188.660624][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3188.660909][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3188.661212][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3188.661492][ C2] ? get_stack_info+0x36/0xc0 [ 3188.661731][ C2] __tcf_classify+0x329/0x7d0 [ 3188.661972][ C2] tcf_classify+0x283/0x930 [ 3188.662208][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3188.662464][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3188.662778][ C2] tc_run+0x2e4/0x5d0 [ 3188.662984][ C2] ? __pfx_tc_run+0x10/0x10 [ 3188.663215][ C2] ? lock_acquire+0x1c1/0x220 [ 3188.663452][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3188.663725][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3188.663978][ C2] ? lock_acquire+0x1c1/0x220 [ 3188.664218][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3188.664481][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3188.664784][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3188.665054][ C2] ? neigh_hh_output+0x348/0x590 [ 3188.665307][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3188.665571][ C2] ip_finish_output2+0x786/0x18e0 [ 3188.665827][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3188.666163][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3188.666441][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3188.666693][ C2] ? __ip_finish_output+0x10f/0x770 [ 3188.666957][ C2] ip_output+0x16b/0x4f0 [ 3188.667174][ C2] ? __pfx_ip_output+0x10/0x10 [ 3188.667417][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3188.667696][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3188.668007][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3188.668284][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3188.668534][ C2] ? __alloc_skb+0xd4/0x280 [ 3188.668766][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3188.669034][ C2] ? tcp_fragment+0x168/0x1040 [ 3188.669279][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3188.669530][ C2] ? ip_local_out+0x114/0x3b0 [ 3188.669770][ C2] __ip_queue_xmit+0x672/0x1910 [ 3188.670017][ C2] ? __skb_clone+0x57a/0x760 [ 3188.670252][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3188.670517][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3188.670804][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3188.671049][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3188.671298][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3188.671598][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3188.671917][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3188.672161][ C2] tcp_send_loss_probe+0x348/0x830 [ 3188.672421][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3188.672689][ C2] tcp_write_timer+0x82/0x1d0 [ 3188.672928][ C2] call_timer_fn+0x173/0x430 [ 3188.673167][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3188.673429][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3188.673697][ C2] __run_timers.part.0+0x52d/0x890 [ 3188.673957][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3188.674226][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3188.674510][ C2] ? lock_acquire+0x1c1/0x220 [ 3188.674748][ C2] ? clockevents_program_event+0xf6/0x300 [ 3188.675039][ C2] ? lock_release+0x1d5/0x250 [ 3188.675278][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3188.675543][ C2] ? ktime_get+0xb3/0x190 [ 3188.675763][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3188.676059][ C2] run_timer_softirq+0x72/0x100 [ 3188.676307][ C2] __do_softirq+0x1b9/0x7ff [ 3188.676539][ C2] irq_exit_rcu+0x98/0xc0 [ 3188.676761][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3188.677045][ C2] [ 3188.677194][ C2] [ 3188.677347][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3188.677650][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3188.677906][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3188.678878][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3188.679186][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3188.679585][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3188.679982][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3188.680379][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3188.680779][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3188.681183][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3188.681471][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3188.681731][ C2] default_idle_call+0x69/0xa0 [ 3188.681975][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3188.682227][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3188.682504][ C2] ? lock_release+0x1d5/0x250 [ 3188.682743][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3188.683015][ C2] do_idle+0xfb/0x160 [ 3188.683220][ C2] cpu_startup_entry+0x55/0x60 [ 3188.683461][ C2] start_secondary+0x21c/0x2b0 [ 3188.683712][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3188.683979][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3188.684289][ C2] [ 3216.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 804s! [perl:4135] [ 3216.569707][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3216.570979][ C1] irq event stamp: 209232 [ 3216.571203][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3216.571735][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3216.572215][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3216.572689][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3216.573155][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3216.573611][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3216.574226][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3216.574553][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3216.575530][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3216.575838][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3216.576241][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3216.576641][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3216.577040][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3216.577447][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3216.577850][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3216.578304][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3216.578639][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3216.579043][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3216.579450][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3216.579854][ C1] PKRU: 55555554 [ 3216.580039][ C1] Call Trace: [ 3216.580211][ C1] [ 3216.580366][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3216.580632][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3216.580879][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3216.581162][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3216.581438][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3216.581731][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3216.581999][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3216.582311][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3216.582578][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3216.582894][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3216.583197][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3216.583522][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3216.583816][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3216.584117][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3216.584413][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3216.584728][ C1] ? get_stack_info+0x36/0xc0 [ 3216.584973][ C1] ? lock_acquire+0x1c1/0x220 [ 3216.585218][ C1] ? lock_release+0x1d5/0x250 [ 3216.585463][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3216.585717][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3216.585991][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3216.586278][ C1] ? lock_acquire+0x1c1/0x220 [ 3216.586519][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3216.586761][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3216.587023][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3216.587260][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3216.587508][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3216.587767][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3216.588045][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3216.588324][ C1] ip_local_deliver+0x19d/0x480 [ 3216.588573][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3216.588845][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3216.589111][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3216.589461][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3216.589716][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3216.590037][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3216.590303][ C1] ip_rcv+0x564/0x740 [ 3216.590509][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3216.590740][ C1] ? set_track_prepare+0x8a/0xd0 [ 3216.590995][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3216.591275][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3216.591552][ C1] ? skb_clone+0x10b/0x330 [ 3216.591780][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3216.592104][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3216.592417][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3216.592699][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3216.592997][ C1] ? __tcf_classify+0x329/0x7d0 [ 3216.593249][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3216.593479][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3216.593789][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3216.594076][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3216.594406][ C1] ? lock_acquire+0x1c1/0x220 [ 3216.594646][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3216.594948][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3216.595237][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3216.595559][ C1] ? __copy_skb_header+0xaf/0x490 [ 3216.595819][ C1] ? __skb_clone+0x57a/0x760 [ 3216.596057][ C1] netif_receive_skb+0x55/0x280 [ 3216.596310][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3216.596626][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3216.596965][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3216.597270][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3216.597549][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3216.597841][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3216.598158][ C1] ? hlock_class+0x4e/0x130 [ 3216.598394][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3216.598675][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3216.598952][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3216.599220][ C1] ? hlock_class+0x4e/0x130 [ 3216.599454][ C1] ? mark_lock+0x38/0x3e0 [ 3216.599676][ C1] ? stack_access_ok+0xda/0x1f0 [ 3216.599928][ C1] ? __lock_acquire+0xb67/0x1610 [ 3216.600185][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3216.600464][ C1] ? get_stack_info+0x36/0xc0 [ 3216.600708][ C1] ? stack_access_ok+0xda/0x1f0 [ 3216.600957][ C1] ? get_reg+0x119/0x190 [ 3216.601178][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3216.601450][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3216.601761][ C1] __tcf_classify+0x329/0x7d0 [ 3216.602004][ C1] tcf_classify+0x283/0x930 [ 3216.602241][ C1] ? arch_stack_walk+0xa2/0x100 [ 3216.602495][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3216.602754][ C1] ? get_stack_info+0x36/0xc0 [ 3216.602997][ C1] tc_run+0x2e4/0x5d0 [ 3216.603207][ C1] ? __pfx_tc_run+0x10/0x10 [ 3216.603439][ C1] ? lock_acquire+0x1c1/0x220 [ 3216.603688][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3216.603954][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3216.604211][ C1] ? lock_acquire+0x1c1/0x220 [ 3216.604455][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3216.604722][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3216.605031][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3216.605310][ C1] ? neigh_hh_output+0x348/0x590 [ 3216.605564][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3216.605831][ C1] ip_finish_output2+0x786/0x18e0 [ 3216.606089][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3216.606369][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3216.606708][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3216.606988][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3216.607243][ C1] ? __ip_finish_output+0x10f/0x770 [ 3216.607511][ C1] ip_output+0x16b/0x4f0 [ 3216.607728][ C1] ? run_timer_softirq+0x72/0x100 [ 3216.607986][ C1] ? __pfx_ip_output+0x10/0x10 [ 3216.608231][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3216.608520][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3216.608772][ C1] ? ip_local_out+0x114/0x3b0 [ 3216.609014][ C1] __ip_queue_xmit+0x672/0x1910 [ 3216.609266][ C1] ? __create_object+0x5e/0xb0 [ 3216.609512][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3216.609780][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3216.610063][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3216.610341][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3216.610624][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3216.610899][ C1] tcp_delack_timer+0x84/0x240 [ 3216.611147][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3216.611421][ C1] call_timer_fn+0x173/0x430 [ 3216.611661][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3216.611924][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3216.612187][ C1] __run_timers.part.0+0x52d/0x890 [ 3216.612449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3216.612724][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3216.613012][ C1] ? lock_acquire+0x1c1/0x220 [ 3216.613253][ C1] ? clockevents_program_event+0xf6/0x300 [ 3216.613550][ C1] ? lock_release+0x1d5/0x250 [ 3216.613793][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3216.614062][ C1] ? ktime_get+0xb3/0x190 [ 3216.614286][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3216.614589][ C1] run_timer_softirq+0x72/0x100 [ 3216.614841][ C1] __do_softirq+0x1b9/0x7ff [ 3216.615076][ C1] irq_exit_rcu+0x98/0xc0 [ 3216.615301][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3216.615588][ C1] [ 3216.615743][ C1] [ 3216.615893][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3216.616202][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3216.616530][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3216.617512][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3216.617824][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3216.618229][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3216.618632][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3216.619037][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3216.619443][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3216.619849][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3216.620155][ C1] pipe_read+0xa16/0xdf0 [ 3216.620377][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3216.620659][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3216.620905][ C1] ? iterate_tty_write+0x299/0x540 [ 3216.621169][ C1] ? lock_release+0x1d5/0x250 [ 3216.621412][ C1] vfs_read+0x911/0xc00 [ 3216.621629][ C1] ? lock_acquire+0x1c1/0x220 [ 3216.621872][ C1] ? __might_fault+0xc6/0x180 [ 3216.622117][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3216.622361][ C1] ? __might_fault+0xc6/0x180 [ 3216.622601][ C1] ? lock_release+0x1d5/0x250 [ 3216.622846][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3216.623115][ C1] ? __fget_light+0x54/0x1e0 [ 3216.623356][ C1] ksys_read+0x17a/0x1e0 [ 3216.623583][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3216.623831][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3216.624141][ C1] do_syscall_64+0xc9/0x1e0 [ 3216.624379][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3216.624685][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3216.624914][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3216.625893][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3216.626317][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3216.626719][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3216.627121][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3216.627519][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3216.627923][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3216.628330][ C1] [ 3216.628488][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 804s! [swapper/2:0] [ 3216.628913][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3216.630168][ C2] irq event stamp: 44114564 [ 3216.630394][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3216.630935][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3216.631445][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3216.631919][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3216.632387][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3216.632849][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3216.633460][ C2] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 3216.633755][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 3216.634725][ C2] RSP: 0018:ffffc9000021fa80 EFLAGS: 00000286 [ 3216.635030][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3216.635431][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3216.635827][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3216.636224][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3216.636623][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3216.637022][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3216.637470][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3216.637802][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3216.638202][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3216.638601][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3216.639004][ C2] PKRU: 55555554 [ 3216.639186][ C2] Call Trace: [ 3216.639356][ C2] [ 3216.639506][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3216.639768][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3216.640012][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3216.640291][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3216.640563][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3216.640852][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3216.641119][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3216.641423][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3216.641685][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3216.641948][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3216.642254][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3216.642551][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3216.642866][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3216.643153][ C2] ? kasan_check_range+0x1a/0x1c0 [ 3216.643409][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3216.643701][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3216.644012][ C2] ? get_stack_info+0x36/0xc0 [ 3216.644251][ C2] ? lock_acquire+0x1c1/0x220 [ 3216.644493][ C2] ? lock_release+0x1d5/0x250 [ 3216.644732][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3216.644980][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3216.645251][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3216.645535][ C2] ? lock_acquire+0x1c1/0x220 [ 3216.645773][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3216.646013][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3216.646273][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3216.646509][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3216.646755][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3216.647013][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3216.647288][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3216.647563][ C2] ip_local_deliver+0x19d/0x480 [ 3216.647810][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3216.648080][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3216.648343][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3216.648691][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3216.648944][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3216.649266][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3216.649528][ C2] ip_rcv+0x564/0x740 [ 3216.649732][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3216.649961][ C2] ? set_track_prepare+0x8a/0xd0 [ 3216.650214][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3216.650492][ C2] ? start_secondary+0x21c/0x2b0 [ 3216.650743][ C2] ? skb_clone+0x10b/0x330 [ 3216.650969][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3216.651288][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3216.651594][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3216.651874][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3216.652172][ C2] ? __tcf_classify+0x329/0x7d0 [ 3216.652421][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3216.652649][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3216.652950][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3216.653234][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3216.653571][ C2] ? lock_acquire+0x1c1/0x220 [ 3216.653810][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3216.654107][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3216.654391][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3216.654708][ C2] ? __copy_skb_header+0xaf/0x490 [ 3216.654966][ C2] ? __skb_clone+0x57a/0x760 [ 3216.655202][ C2] netif_receive_skb+0x55/0x280 [ 3216.655451][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3216.655761][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3216.656093][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3216.656390][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3216.656666][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3216.656953][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3216.657267][ C2] ? get_stack_info+0x36/0xc0 [ 3216.657512][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3216.657776][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3216.658094][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3216.658371][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3216.658647][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3216.658963][ C2] ? kernel_text_address+0x17/0xe0 [ 3216.659224][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3216.659542][ C2] ? arch_stack_walk+0x8c/0x100 [ 3216.659791][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3216.660056][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3216.660341][ C2] ? lock_acquire+0x1c1/0x220 [ 3216.660580][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3216.660864][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3216.661167][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3216.661446][ C2] ? get_stack_info+0x36/0xc0 [ 3216.661685][ C2] __tcf_classify+0x329/0x7d0 [ 3216.661927][ C2] tcf_classify+0x283/0x930 [ 3216.662161][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3216.662417][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3216.662729][ C2] tc_run+0x2e4/0x5d0 [ 3216.662935][ C2] ? __pfx_tc_run+0x10/0x10 [ 3216.663166][ C2] ? lock_acquire+0x1c1/0x220 [ 3216.663403][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3216.663671][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3216.663923][ C2] ? lock_acquire+0x1c1/0x220 [ 3216.664163][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3216.664427][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3216.664732][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3216.665002][ C2] ? neigh_hh_output+0x348/0x590 [ 3216.665258][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3216.665521][ C2] ip_finish_output2+0x786/0x18e0 [ 3216.665781][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3216.666118][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3216.666395][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3216.666647][ C2] ? __ip_finish_output+0x10f/0x770 [ 3216.666911][ C2] ip_output+0x16b/0x4f0 [ 3216.667127][ C2] ? __pfx_ip_output+0x10/0x10 [ 3216.667370][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3216.667645][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3216.667957][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3216.668235][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3216.668484][ C2] ? __alloc_skb+0xd4/0x280 [ 3216.668717][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3216.668986][ C2] ? tcp_fragment+0x168/0x1040 [ 3216.669230][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3216.669482][ C2] ? ip_local_out+0x114/0x3b0 [ 3216.669722][ C2] __ip_queue_xmit+0x672/0x1910 [ 3216.669974][ C2] ? __skb_clone+0x57a/0x760 [ 3216.670207][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3216.670474][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3216.670756][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3216.671001][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3216.671250][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3216.671550][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3216.671870][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3216.672115][ C2] tcp_send_loss_probe+0x348/0x830 [ 3216.672375][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3216.672642][ C2] tcp_write_timer+0x82/0x1d0 [ 3216.672882][ C2] call_timer_fn+0x173/0x430 [ 3216.673119][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3216.673380][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3216.673649][ C2] __run_timers.part.0+0x52d/0x890 [ 3216.673909][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3216.674179][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3216.674464][ C2] ? lock_acquire+0x1c1/0x220 [ 3216.674702][ C2] ? clockevents_program_event+0xf6/0x300 [ 3216.674995][ C2] ? lock_release+0x1d5/0x250 [ 3216.675234][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3216.675500][ C2] ? ktime_get+0xb3/0x190 [ 3216.675721][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3216.676017][ C2] run_timer_softirq+0x72/0x100 [ 3216.676265][ C2] __do_softirq+0x1b9/0x7ff [ 3216.676497][ C2] irq_exit_rcu+0x98/0xc0 [ 3216.676718][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3216.677003][ C2] [ 3216.677153][ C2] [ 3216.677306][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3216.677609][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3216.677865][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3216.678834][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3216.679141][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3216.679542][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3216.679939][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3216.680337][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3216.680736][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3216.681138][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3216.681426][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3216.681687][ C2] default_idle_call+0x69/0xa0 [ 3216.681931][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3216.682182][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3216.682458][ C2] ? lock_release+0x1d5/0x250 [ 3216.682697][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3216.682970][ C2] do_idle+0xfb/0x160 [ 3216.683175][ C2] cpu_startup_entry+0x55/0x60 [ 3216.683417][ C2] start_secondary+0x21c/0x2b0 [ 3216.683671][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3216.683939][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3216.684251][ C2] [ 3239.541103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3239.541470][ C1] rcu: 1-....: (882933 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=216475 [ 3239.542021][ C1] rcu: (t=884654 jiffies g=1882453 q=694 ncpus=4) [ 3239.542350][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3239.542798][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3239.543423][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3239.543751][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3239.544720][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3239.545028][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3239.545428][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3239.545825][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3239.546228][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3239.546627][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3239.547026][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3239.547473][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3239.547805][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3239.548209][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3239.548609][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3239.549009][ C1] PKRU: 55555554 [ 3239.549192][ C1] Call Trace: [ 3239.549364][ C1] [ 3239.549512][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3239.549786][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3239.550042][ C1] ? check_cpu_stall+0x284/0x500 [ 3239.550296][ C1] ? rcu_pending+0x92/0x360 [ 3239.550528][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3239.550798][ C1] ? update_process_times+0xb9/0x110 [ 3239.551069][ C1] ? tick_sched_handle+0x67/0x130 [ 3239.551330][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3239.551623][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3239.551866][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3239.552182][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3239.552458][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3239.552749][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3239.553016][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3239.553325][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3239.553596][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3239.553911][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3239.554208][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3239.554526][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3239.554818][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3239.555114][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3239.555407][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3239.555723][ C1] ? get_stack_info+0x36/0xc0 [ 3239.555966][ C1] ? lock_acquire+0x1c1/0x220 [ 3239.556208][ C1] ? lock_release+0x1d5/0x250 [ 3239.556450][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3239.556701][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3239.556975][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3239.557262][ C1] ? lock_acquire+0x1c1/0x220 [ 3239.557500][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3239.557742][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3239.558002][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3239.558240][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3239.558488][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3239.558746][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3239.559022][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3239.559299][ C1] ip_local_deliver+0x19d/0x480 [ 3239.559547][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3239.559819][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3239.560084][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3239.560435][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3239.560689][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3239.561011][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3239.561277][ C1] ip_rcv+0x564/0x740 [ 3239.561481][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3239.561713][ C1] ? set_track_prepare+0x8a/0xd0 [ 3239.561966][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3239.562244][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3239.562520][ C1] ? skb_clone+0x10b/0x330 [ 3239.562751][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3239.563074][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3239.563381][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3239.563671][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3239.563965][ C1] ? __tcf_classify+0x329/0x7d0 [ 3239.564215][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3239.564448][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3239.564748][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3239.565038][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3239.565366][ C1] ? lock_acquire+0x1c1/0x220 [ 3239.565607][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3239.565905][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3239.566195][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3239.566518][ C1] ? __copy_skb_header+0xaf/0x490 [ 3239.566778][ C1] ? __skb_clone+0x57a/0x760 [ 3239.567013][ C1] netif_receive_skb+0x55/0x280 [ 3239.567264][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3239.567582][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3239.567916][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3239.568220][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3239.568497][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3239.568786][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3239.569104][ C1] ? hlock_class+0x4e/0x130 [ 3239.569340][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3239.569620][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3239.569897][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3239.570167][ C1] ? hlock_class+0x4e/0x130 [ 3239.570398][ C1] ? mark_lock+0x38/0x3e0 [ 3239.570621][ C1] ? stack_access_ok+0xda/0x1f0 [ 3239.570870][ C1] ? __lock_acquire+0xb67/0x1610 [ 3239.571126][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3239.571405][ C1] ? get_stack_info+0x36/0xc0 [ 3239.571647][ C1] ? stack_access_ok+0xda/0x1f0 [ 3239.571894][ C1] ? get_reg+0x119/0x190 [ 3239.572116][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3239.572390][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3239.572703][ C1] __tcf_classify+0x329/0x7d0 [ 3239.572946][ C1] tcf_classify+0x283/0x930 [ 3239.573182][ C1] ? arch_stack_walk+0xa2/0x100 [ 3239.573439][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3239.573699][ C1] ? get_stack_info+0x36/0xc0 [ 3239.573946][ C1] tc_run+0x2e4/0x5d0 [ 3239.574154][ C1] ? __pfx_tc_run+0x10/0x10 [ 3239.574389][ C1] ? lock_acquire+0x1c1/0x220 [ 3239.574628][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3239.574891][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3239.575148][ C1] ? lock_acquire+0x1c1/0x220 [ 3239.575389][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3239.575655][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3239.575964][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3239.576237][ C1] ? neigh_hh_output+0x348/0x590 [ 3239.576489][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3239.576755][ C1] ip_finish_output2+0x786/0x18e0 [ 3239.577011][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3239.577292][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3239.577630][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3239.577906][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3239.578161][ C1] ? __ip_finish_output+0x10f/0x770 [ 3239.578428][ C1] ip_output+0x16b/0x4f0 [ 3239.578645][ C1] ? run_timer_softirq+0x72/0x100 [ 3239.578903][ C1] ? __pfx_ip_output+0x10/0x10 [ 3239.579147][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3239.579437][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3239.579689][ C1] ? ip_local_out+0x114/0x3b0 [ 3239.579928][ C1] __ip_queue_xmit+0x672/0x1910 [ 3239.580177][ C1] ? __create_object+0x5e/0xb0 [ 3239.580421][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3239.580688][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3239.580973][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3239.581248][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3239.581532][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3239.581808][ C1] tcp_delack_timer+0x84/0x240 [ 3239.582053][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3239.582330][ C1] call_timer_fn+0x173/0x430 [ 3239.582566][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3239.582829][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3239.583091][ C1] __run_timers.part.0+0x52d/0x890 [ 3239.583354][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3239.583636][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3239.583922][ C1] ? lock_acquire+0x1c1/0x220 [ 3239.584163][ C1] ? clockevents_program_event+0xf6/0x300 [ 3239.584453][ C1] ? lock_release+0x1d5/0x250 [ 3239.584695][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3239.584961][ C1] ? ktime_get+0xb3/0x190 [ 3239.585186][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3239.585484][ C1] run_timer_softirq+0x72/0x100 [ 3239.585734][ C1] __do_softirq+0x1b9/0x7ff [ 3239.585969][ C1] irq_exit_rcu+0x98/0xc0 [ 3239.586192][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3239.586482][ C1] [ 3239.586633][ C1] [ 3239.586786][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3239.587093][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3239.587422][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3239.588403][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3239.588717][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3239.589121][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3239.589524][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3239.589927][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3239.590332][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3239.590737][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3239.591038][ C1] pipe_read+0xa16/0xdf0 [ 3239.591262][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3239.591544][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3239.591789][ C1] ? iterate_tty_write+0x299/0x540 [ 3239.592053][ C1] ? lock_release+0x1d5/0x250 [ 3239.592295][ C1] vfs_read+0x911/0xc00 [ 3239.592512][ C1] ? lock_acquire+0x1c1/0x220 [ 3239.592753][ C1] ? __might_fault+0xc6/0x180 [ 3239.592994][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3239.593237][ C1] ? __might_fault+0xc6/0x180 [ 3239.593487][ C1] ? lock_release+0x1d5/0x250 [ 3239.593727][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3239.593995][ C1] ? __fget_light+0x54/0x1e0 [ 3239.594235][ C1] ksys_read+0x17a/0x1e0 [ 3239.594456][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3239.594700][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3239.595007][ C1] do_syscall_64+0xc9/0x1e0 [ 3239.595243][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3239.595543][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3239.595771][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3239.596742][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3239.597165][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3239.597564][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3239.597964][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3239.598365][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3239.598766][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3239.599170][ C1] [ 3239.599328][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3239.599604][ C2] NMI backtrace for cpu 2 [ 3239.599611][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3239.599615][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3239.599617][ C2] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 3239.599622][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 3239.599625][ C2] RSP: 0018:ffffc9000021fa80 EFLAGS: 00000286 [ 3239.599628][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3239.599630][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3239.599631][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3239.599633][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3239.599634][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3239.599636][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3239.599638][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3239.599641][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3239.599643][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3239.599644][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3239.599645][ C2] PKRU: 55555554 [ 3239.599647][ C2] Call Trace: [ 3239.599650][ C2] [ 3239.599652][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3239.599660][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3239.599666][ C2] ? nmi_handle+0x153/0x420 [ 3239.599670][ C2] ? default_do_nmi+0x41/0x100 [ 3239.599673][ C2] ? exc_nmi+0xf3/0x120 [ 3239.599676][ C2] ? end_repeat_nmi+0xf/0x60 [ 3239.599681][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3239.599685][ C2] ? kasan_check_range+0x1a/0x1c0 [ 3239.599688][ C2] ? kasan_check_range+0x1a/0x1c0 [ 3239.599691][ C2] ? kasan_check_range+0x1a/0x1c0 [ 3239.599694][ C2] [ 3239.599695][ C2] [ 3239.599696][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3239.599699][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3239.599702][ C2] ? get_stack_info+0x36/0xc0 [ 3239.599706][ C2] ? lock_acquire+0x1c1/0x220 [ 3239.599709][ C2] ? lock_release+0x1d5/0x250 [ 3239.599712][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3239.599716][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3239.599719][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3239.599722][ C2] ? lock_acquire+0x1c1/0x220 [ 3239.599724][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3239.599728][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3239.599731][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3239.599737][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3239.599740][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3239.599745][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3239.599749][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3239.599753][ C2] ip_local_deliver+0x19d/0x480 [ 3239.599755][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3239.599757][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3239.599760][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3239.599764][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3239.599767][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3239.599770][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3239.599778][ C2] ip_rcv+0x564/0x740 [ 3239.599781][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3239.599783][ C2] ? set_track_prepare+0x8a/0xd0 [ 3239.599787][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3239.599790][ C2] ? start_secondary+0x21c/0x2b0 [ 3239.599793][ C2] ? skb_clone+0x10b/0x330 [ 3239.599796][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3239.599802][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3239.599808][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3239.599812][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3239.599819][ C2] ? __tcf_classify+0x329/0x7d0 [ 3239.599823][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3239.599825][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3239.599828][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3239.599831][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3239.599835][ C2] ? lock_acquire+0x1c1/0x220 [ 3239.599837][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3239.599841][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3239.599845][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3239.599849][ C2] ? __copy_skb_header+0xaf/0x490 [ 3239.599853][ C2] ? __skb_clone+0x57a/0x760 [ 3239.599855][ C2] netif_receive_skb+0x55/0x280 [ 3239.599859][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3239.599866][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3239.599872][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3239.599879][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3239.599883][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3239.599893][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3239.599901][ C2] ? get_stack_info+0x36/0xc0 [ 3239.599905][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3239.599908][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3239.599911][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3239.599914][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3239.599917][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3239.599919][ C2] ? kernel_text_address+0x17/0xe0 [ 3239.599922][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3239.599926][ C2] ? arch_stack_walk+0x8c/0x100 [ 3239.599929][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3239.599932][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3239.599935][ C2] ? lock_acquire+0x1c1/0x220 [ 3239.599938][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3239.599942][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3239.599946][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3239.599949][ C2] ? get_stack_info+0x36/0xc0 [ 3239.599953][ C2] __tcf_classify+0x329/0x7d0 [ 3239.599958][ C2] tcf_classify+0x283/0x930 [ 3239.599963][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3239.599966][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3239.599970][ C2] tc_run+0x2e4/0x5d0 [ 3239.599973][ C2] ? __pfx_tc_run+0x10/0x10 [ 3239.599976][ C2] ? lock_acquire+0x1c1/0x220 [ 3239.599979][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3239.599982][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3239.599986][ C2] ? lock_acquire+0x1c1/0x220 [ 3239.599989][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3239.599992][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3239.599995][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3239.599997][ C2] ? neigh_hh_output+0x348/0x590 [ 3239.600001][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3239.600004][ C2] ip_finish_output2+0x786/0x18e0 [ 3239.600008][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3239.600015][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3239.600018][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3239.600022][ C2] ? __ip_finish_output+0x10f/0x770 [ 3239.600025][ C2] ip_output+0x16b/0x4f0 [ 3239.600028][ C2] ? __pfx_ip_output+0x10/0x10 [ 3239.600030][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3239.600033][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3239.600036][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3239.600039][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3239.600041][ C2] ? __alloc_skb+0xd4/0x280 [ 3239.600043][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3239.600047][ C2] ? tcp_fragment+0x168/0x1040 [ 3239.600050][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3239.600053][ C2] ? ip_local_out+0x114/0x3b0 [ 3239.600056][ C2] __ip_queue_xmit+0x672/0x1910 [ 3239.600060][ C2] ? __skb_clone+0x57a/0x760 [ 3239.600063][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3239.600068][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3239.600071][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3239.600075][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3239.600079][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3239.600083][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3239.600086][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3239.600089][ C2] tcp_send_loss_probe+0x348/0x830 [ 3239.600092][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3239.600095][ C2] tcp_write_timer+0x82/0x1d0 [ 3239.600098][ C2] call_timer_fn+0x173/0x430 [ 3239.600102][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3239.600107][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3239.600110][ C2] __run_timers.part.0+0x52d/0x890 [ 3239.600113][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3239.600117][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3239.600120][ C2] ? lock_acquire+0x1c1/0x220 [ 3239.600122][ C2] ? clockevents_program_event+0xf6/0x300 [ 3239.600126][ C2] ? lock_release+0x1d5/0x250 [ 3239.600129][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3239.600132][ C2] ? ktime_get+0xb3/0x190 [ 3239.600135][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3239.600139][ C2] run_timer_softirq+0x72/0x100 [ 3239.600142][ C2] __do_softirq+0x1b9/0x7ff [ 3239.600147][ C2] irq_exit_rcu+0x98/0xc0 [ 3239.600150][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3239.600153][ C2] [ 3239.600154][ C2] [ 3239.600154][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3239.600158][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3239.600162][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3239.600164][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3239.600166][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3239.600167][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3239.600169][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3239.600170][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3239.600172][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3239.600175][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3239.600178][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3239.600181][ C2] default_idle_call+0x69/0xa0 [ 3239.600184][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3239.600186][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3239.600190][ C2] ? lock_release+0x1d5/0x250 [ 3239.600193][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3239.600196][ C2] do_idle+0xfb/0x160 [ 3239.600199][ C2] cpu_startup_entry+0x55/0x60 [ 3239.600202][ C2] start_secondary+0x21c/0x2b0 [ 3239.600204][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3239.600209][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3239.600215][ C2] [ 3264.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 849s! [perl:4135] [ 3264.569695][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3264.570956][ C1] irq event stamp: 209232 [ 3264.571175][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3264.571707][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3264.572185][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3264.572653][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3264.573116][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3264.573570][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3264.574185][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3264.574509][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3264.575481][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3264.575789][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3264.576189][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3264.576590][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3264.576989][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3264.577390][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3264.577788][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3264.578236][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3264.578570][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3264.578975][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3264.579376][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3264.579774][ C1] PKRU: 55555554 [ 3264.579957][ C1] Call Trace: [ 3264.580129][ C1] [ 3264.580277][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3264.580541][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3264.580785][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3264.581062][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3264.581337][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3264.581624][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3264.581891][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3264.582199][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3264.582461][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3264.582773][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3264.583069][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3264.583392][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3264.583683][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3264.583980][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3264.584270][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3264.584582][ C1] ? get_stack_info+0x36/0xc0 [ 3264.584825][ C1] ? lock_acquire+0x1c1/0x220 [ 3264.585065][ C1] ? lock_release+0x1d5/0x250 [ 3264.585305][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3264.585555][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3264.585827][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3264.586115][ C1] ? lock_acquire+0x1c1/0x220 [ 3264.586355][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3264.586594][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3264.586854][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3264.587091][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3264.587341][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3264.587600][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3264.587878][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3264.588154][ C1] ip_local_deliver+0x19d/0x480 [ 3264.588402][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3264.588675][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3264.588941][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3264.589289][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3264.589544][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3264.589866][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3264.590128][ C1] ip_rcv+0x564/0x740 [ 3264.590333][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3264.590565][ C1] ? set_track_prepare+0x8a/0xd0 [ 3264.590820][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3264.591097][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3264.591370][ C1] ? skb_clone+0x10b/0x330 [ 3264.591600][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3264.591921][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3264.592229][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3264.592511][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3264.592807][ C1] ? __tcf_classify+0x329/0x7d0 [ 3264.593057][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3264.593298][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3264.593600][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3264.593886][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3264.594214][ C1] ? lock_acquire+0x1c1/0x220 [ 3264.594454][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3264.594753][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3264.595043][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3264.595363][ C1] ? __copy_skb_header+0xaf/0x490 [ 3264.595623][ C1] ? __skb_clone+0x57a/0x760 [ 3264.595860][ C1] netif_receive_skb+0x55/0x280 [ 3264.596109][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3264.596423][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3264.596757][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3264.597060][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3264.597338][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3264.597630][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3264.597946][ C1] ? hlock_class+0x4e/0x130 [ 3264.598183][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3264.598459][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3264.598740][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3264.599012][ C1] ? hlock_class+0x4e/0x130 [ 3264.599245][ C1] ? mark_lock+0x38/0x3e0 [ 3264.599469][ C1] ? stack_access_ok+0xda/0x1f0 [ 3264.599721][ C1] ? __lock_acquire+0xb67/0x1610 [ 3264.599978][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3264.600257][ C1] ? get_stack_info+0x36/0xc0 [ 3264.600501][ C1] ? stack_access_ok+0xda/0x1f0 [ 3264.600752][ C1] ? get_reg+0x119/0x190 [ 3264.600970][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3264.601242][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3264.601555][ C1] __tcf_classify+0x329/0x7d0 [ 3264.601800][ C1] tcf_classify+0x283/0x930 [ 3264.602032][ C1] ? arch_stack_walk+0xa2/0x100 [ 3264.602285][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3264.602544][ C1] ? get_stack_info+0x36/0xc0 [ 3264.602788][ C1] tc_run+0x2e4/0x5d0 [ 3264.602995][ C1] ? __pfx_tc_run+0x10/0x10 [ 3264.603230][ C1] ? lock_acquire+0x1c1/0x220 [ 3264.603477][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3264.603744][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3264.603999][ C1] ? lock_acquire+0x1c1/0x220 [ 3264.604239][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3264.604510][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3264.604818][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3264.605092][ C1] ? neigh_hh_output+0x348/0x590 [ 3264.605346][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3264.605617][ C1] ip_finish_output2+0x786/0x18e0 [ 3264.605879][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3264.606163][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3264.606504][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3264.606784][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3264.607039][ C1] ? __ip_finish_output+0x10f/0x770 [ 3264.607306][ C1] ip_output+0x16b/0x4f0 [ 3264.607528][ C1] ? run_timer_softirq+0x72/0x100 [ 3264.607787][ C1] ? __pfx_ip_output+0x10/0x10 [ 3264.608035][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3264.608324][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3264.608579][ C1] ? ip_local_out+0x114/0x3b0 [ 3264.608821][ C1] __ip_queue_xmit+0x672/0x1910 [ 3264.609070][ C1] ? __create_object+0x5e/0xb0 [ 3264.609314][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3264.609583][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3264.609869][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3264.610143][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3264.610426][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3264.610702][ C1] tcp_delack_timer+0x84/0x240 [ 3264.610947][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3264.611222][ C1] call_timer_fn+0x173/0x430 [ 3264.611458][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3264.611721][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3264.611984][ C1] __run_timers.part.0+0x52d/0x890 [ 3264.612251][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3264.612525][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3264.612810][ C1] ? lock_acquire+0x1c1/0x220 [ 3264.613051][ C1] ? clockevents_program_event+0xf6/0x300 [ 3264.613358][ C1] ? lock_release+0x1d5/0x250 [ 3264.613597][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3264.613863][ C1] ? ktime_get+0xb3/0x190 [ 3264.614086][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3264.614387][ C1] run_timer_softirq+0x72/0x100 [ 3264.614642][ C1] __do_softirq+0x1b9/0x7ff [ 3264.614878][ C1] irq_exit_rcu+0x98/0xc0 [ 3264.615099][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3264.615387][ C1] [ 3264.615537][ C1] [ 3264.615691][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3264.615999][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3264.616326][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3264.617305][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3264.617615][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3264.618020][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3264.618422][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3264.618824][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3264.619228][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3264.619636][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3264.619934][ C1] pipe_read+0xa16/0xdf0 [ 3264.620158][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3264.620439][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3264.620686][ C1] ? iterate_tty_write+0x299/0x540 [ 3264.620951][ C1] ? lock_release+0x1d5/0x250 [ 3264.621197][ C1] vfs_read+0x911/0xc00 [ 3264.621413][ C1] ? lock_acquire+0x1c1/0x220 [ 3264.621656][ C1] ? __might_fault+0xc6/0x180 [ 3264.621897][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3264.622141][ C1] ? __might_fault+0xc6/0x180 [ 3264.622384][ C1] ? lock_release+0x1d5/0x250 [ 3264.622628][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3264.622895][ C1] ? __fget_light+0x54/0x1e0 [ 3264.623136][ C1] ksys_read+0x17a/0x1e0 [ 3264.623362][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3264.623610][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3264.623917][ C1] do_syscall_64+0xc9/0x1e0 [ 3264.624152][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3264.624455][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3264.624684][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3264.625670][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3264.626097][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3264.626501][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3264.626903][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3264.627306][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3264.627707][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3264.628113][ C1] [ 3264.628274][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 849s! [swapper/2:0] [ 3264.628701][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3264.629959][ C2] irq event stamp: 44114564 [ 3264.630190][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3264.630723][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3264.631234][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3264.631713][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3264.632184][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3264.632639][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3264.633252][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3264.633588][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3264.634560][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3264.634868][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3264.635266][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3264.635664][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3264.636063][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3264.636465][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3264.636869][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3264.637317][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3264.637649][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3264.638050][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3264.638452][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3264.638850][ C2] PKRU: 55555554 [ 3264.639032][ C2] Call Trace: [ 3264.639204][ C2] [ 3264.639353][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3264.639615][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3264.639858][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3264.640135][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3264.640406][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3264.640697][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3264.640961][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3264.641269][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3264.641530][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3264.641793][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3264.642104][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3264.642399][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3264.642713][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3264.643002][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3264.643306][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3264.643597][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3264.643908][ C2] ? get_stack_info+0x36/0xc0 [ 3264.644149][ C2] ? lock_acquire+0x1c1/0x220 [ 3264.644390][ C2] ? lock_release+0x1d5/0x250 [ 3264.644630][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3264.644880][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3264.645152][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3264.645436][ C2] ? lock_acquire+0x1c1/0x220 [ 3264.645674][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3264.645915][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3264.646175][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3264.646411][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3264.646656][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3264.646913][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3264.647188][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3264.647464][ C2] ip_local_deliver+0x19d/0x480 [ 3264.647711][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3264.647981][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3264.648244][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3264.648591][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3264.648843][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3264.649163][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3264.649425][ C2] ip_rcv+0x564/0x740 [ 3264.649629][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3264.649858][ C2] ? set_track_prepare+0x8a/0xd0 [ 3264.650109][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3264.650388][ C2] ? start_secondary+0x21c/0x2b0 [ 3264.650639][ C2] ? skb_clone+0x10b/0x330 [ 3264.650863][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3264.651181][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3264.651487][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3264.651767][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3264.652068][ C2] ? __tcf_classify+0x329/0x7d0 [ 3264.652316][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3264.652545][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3264.652846][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3264.653130][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3264.653469][ C2] ? lock_acquire+0x1c1/0x220 [ 3264.653707][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3264.654003][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3264.654287][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3264.654605][ C2] ? __copy_skb_header+0xaf/0x490 [ 3264.654861][ C2] ? __skb_clone+0x57a/0x760 [ 3264.655096][ C2] netif_receive_skb+0x55/0x280 [ 3264.655345][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3264.655657][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3264.655988][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3264.656286][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3264.656561][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3264.656849][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3264.657163][ C2] ? get_stack_info+0x36/0xc0 [ 3264.657403][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3264.657668][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3264.657984][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3264.658264][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3264.658539][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3264.658854][ C2] ? kernel_text_address+0x17/0xe0 [ 3264.659114][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3264.659426][ C2] ? arch_stack_walk+0x8c/0x100 [ 3264.659674][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3264.659938][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3264.660223][ C2] ? lock_acquire+0x1c1/0x220 [ 3264.660461][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3264.660745][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3264.661046][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3264.661326][ C2] ? get_stack_info+0x36/0xc0 [ 3264.661566][ C2] __tcf_classify+0x329/0x7d0 [ 3264.661807][ C2] tcf_classify+0x283/0x930 [ 3264.662040][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3264.662297][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3264.662610][ C2] tc_run+0x2e4/0x5d0 [ 3264.662814][ C2] ? __pfx_tc_run+0x10/0x10 [ 3264.663045][ C2] ? lock_acquire+0x1c1/0x220 [ 3264.663288][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3264.663549][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3264.663802][ C2] ? lock_acquire+0x1c1/0x220 [ 3264.664040][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3264.664304][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3264.664608][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3264.664883][ C2] ? neigh_hh_output+0x348/0x590 [ 3264.665136][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3264.665400][ C2] ip_finish_output2+0x786/0x18e0 [ 3264.665659][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3264.665996][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3264.666274][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3264.666525][ C2] ? __ip_finish_output+0x10f/0x770 [ 3264.666789][ C2] ip_output+0x16b/0x4f0 [ 3264.667004][ C2] ? __pfx_ip_output+0x10/0x10 [ 3264.667247][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3264.667522][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3264.667833][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3264.668114][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3264.668364][ C2] ? __alloc_skb+0xd4/0x280 [ 3264.668594][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3264.668861][ C2] ? tcp_fragment+0x168/0x1040 [ 3264.669105][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3264.669357][ C2] ? ip_local_out+0x114/0x3b0 [ 3264.669597][ C2] __ip_queue_xmit+0x672/0x1910 [ 3264.669845][ C2] ? __skb_clone+0x57a/0x760 [ 3264.670077][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3264.670344][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3264.670626][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3264.670869][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3264.671119][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3264.671419][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3264.671738][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3264.671981][ C2] tcp_send_loss_probe+0x348/0x830 [ 3264.672241][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3264.672507][ C2] tcp_write_timer+0x82/0x1d0 [ 3264.672747][ C2] call_timer_fn+0x173/0x430 [ 3264.672984][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3264.673245][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3264.673509][ C2] __run_timers.part.0+0x52d/0x890 [ 3264.673769][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3264.674038][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3264.674322][ C2] ? lock_acquire+0x1c1/0x220 [ 3264.674564][ C2] ? clockevents_program_event+0xf6/0x300 [ 3264.674854][ C2] ? lock_release+0x1d5/0x250 [ 3264.675091][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3264.675356][ C2] ? ktime_get+0xb3/0x190 [ 3264.675576][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3264.675871][ C2] run_timer_softirq+0x72/0x100 [ 3264.676119][ C2] __do_softirq+0x1b9/0x7ff [ 3264.676351][ C2] irq_exit_rcu+0x98/0xc0 [ 3264.676571][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3264.676855][ C2] [ 3264.677005][ C2] [ 3264.677158][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3264.677461][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3264.677717][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3264.678685][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3264.678991][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3264.679390][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3264.679790][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3264.680186][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3264.680585][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3264.680984][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3264.681271][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3264.681532][ C2] default_idle_call+0x69/0xa0 [ 3264.681776][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3264.682027][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3264.682304][ C2] ? lock_release+0x1d5/0x250 [ 3264.682544][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3264.682815][ C2] do_idle+0xfb/0x160 [ 3264.683021][ C2] cpu_startup_entry+0x55/0x60 [ 3264.683262][ C2] start_secondary+0x21c/0x2b0 [ 3264.683512][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3264.683780][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3264.684092][ C2] [ 3292.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 875s! [perl:4135] [ 3292.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3292.570951][ C1] irq event stamp: 209232 [ 3292.571171][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3292.571700][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3292.572179][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3292.572649][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3292.573112][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3292.573567][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3292.574181][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3292.574503][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3292.575478][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3292.575785][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3292.576187][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3292.576586][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3292.576984][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3292.577387][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3292.577787][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3292.578237][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3292.578569][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3292.578969][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3292.579371][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3292.579771][ C1] PKRU: 55555554 [ 3292.579954][ C1] Call Trace: [ 3292.580124][ C1] [ 3292.580275][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3292.580538][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3292.580782][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3292.581061][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3292.581335][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3292.581624][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3292.581891][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3292.582198][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3292.582461][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3292.582769][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3292.583067][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3292.583391][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3292.583680][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3292.583971][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3292.584259][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3292.584572][ C1] ? get_stack_info+0x36/0xc0 [ 3292.584814][ C1] ? lock_acquire+0x1c1/0x220 [ 3292.585056][ C1] ? lock_release+0x1d5/0x250 [ 3292.585296][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3292.585545][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3292.585819][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3292.586105][ C1] ? lock_acquire+0x1c1/0x220 [ 3292.586345][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3292.586587][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3292.586848][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3292.587082][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3292.587330][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3292.587588][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3292.587868][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3292.588148][ C1] ip_local_deliver+0x19d/0x480 [ 3292.588396][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3292.588668][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3292.588932][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3292.589280][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3292.589535][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3292.589856][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3292.590119][ C1] ip_rcv+0x564/0x740 [ 3292.590325][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3292.590556][ C1] ? set_track_prepare+0x8a/0xd0 [ 3292.590811][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3292.591088][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3292.591365][ C1] ? skb_clone+0x10b/0x330 [ 3292.591593][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3292.591914][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3292.592223][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3292.592505][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3292.592803][ C1] ? __tcf_classify+0x329/0x7d0 [ 3292.593052][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3292.593288][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3292.593590][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3292.593877][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3292.594204][ C1] ? lock_acquire+0x1c1/0x220 [ 3292.594446][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3292.594744][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3292.595030][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3292.595349][ C1] ? __copy_skb_header+0xaf/0x490 [ 3292.595607][ C1] ? __skb_clone+0x57a/0x760 [ 3292.595847][ C1] netif_receive_skb+0x55/0x280 [ 3292.596096][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3292.596410][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3292.596745][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3292.597044][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3292.597323][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3292.597615][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3292.597931][ C1] ? hlock_class+0x4e/0x130 [ 3292.598166][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3292.598446][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3292.598724][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3292.598990][ C1] ? hlock_class+0x4e/0x130 [ 3292.599226][ C1] ? mark_lock+0x38/0x3e0 [ 3292.599447][ C1] ? stack_access_ok+0xda/0x1f0 [ 3292.599699][ C1] ? __lock_acquire+0xb67/0x1610 [ 3292.599955][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3292.600235][ C1] ? get_stack_info+0x36/0xc0 [ 3292.600477][ C1] ? stack_access_ok+0xda/0x1f0 [ 3292.600726][ C1] ? get_reg+0x119/0x190 [ 3292.600943][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3292.601215][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3292.601528][ C1] __tcf_classify+0x329/0x7d0 [ 3292.601773][ C1] tcf_classify+0x283/0x930 [ 3292.602007][ C1] ? arch_stack_walk+0xa2/0x100 [ 3292.602258][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3292.602517][ C1] ? get_stack_info+0x36/0xc0 [ 3292.602759][ C1] tc_run+0x2e4/0x5d0 [ 3292.602966][ C1] ? __pfx_tc_run+0x10/0x10 [ 3292.603207][ C1] ? lock_acquire+0x1c1/0x220 [ 3292.603449][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3292.603711][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3292.603967][ C1] ? lock_acquire+0x1c1/0x220 [ 3292.604208][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3292.604475][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3292.604781][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3292.605057][ C1] ? neigh_hh_output+0x348/0x590 [ 3292.605313][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3292.605579][ C1] ip_finish_output2+0x786/0x18e0 [ 3292.605837][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3292.606117][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3292.606457][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3292.606736][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3292.606990][ C1] ? __ip_finish_output+0x10f/0x770 [ 3292.607258][ C1] ip_output+0x16b/0x4f0 [ 3292.607475][ C1] ? run_timer_softirq+0x72/0x100 [ 3292.607732][ C1] ? __pfx_ip_output+0x10/0x10 [ 3292.607977][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3292.608264][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3292.608518][ C1] ? ip_local_out+0x114/0x3b0 [ 3292.608758][ C1] __ip_queue_xmit+0x672/0x1910 [ 3292.609008][ C1] ? __create_object+0x5e/0xb0 [ 3292.609255][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3292.609527][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3292.609808][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3292.610081][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3292.610366][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3292.610639][ C1] tcp_delack_timer+0x84/0x240 [ 3292.610884][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3292.611157][ C1] call_timer_fn+0x173/0x430 [ 3292.611395][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3292.611657][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3292.611920][ C1] __run_timers.part.0+0x52d/0x890 [ 3292.612182][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3292.612455][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3292.612743][ C1] ? lock_acquire+0x1c1/0x220 [ 3292.612983][ C1] ? clockevents_program_event+0xf6/0x300 [ 3292.613285][ C1] ? lock_release+0x1d5/0x250 [ 3292.613527][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3292.613793][ C1] ? ktime_get+0xb3/0x190 [ 3292.614012][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3292.614311][ C1] run_timer_softirq+0x72/0x100 [ 3292.614563][ C1] __do_softirq+0x1b9/0x7ff [ 3292.614793][ C1] irq_exit_rcu+0x98/0xc0 [ 3292.615016][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3292.615302][ C1] [ 3292.615455][ C1] [ 3292.615606][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3292.615914][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3292.616242][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3292.617224][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3292.617535][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3292.617938][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3292.618339][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3292.618740][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3292.619144][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3292.619547][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3292.619846][ C1] pipe_read+0xa16/0xdf0 [ 3292.620067][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3292.620349][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3292.620595][ C1] ? iterate_tty_write+0x299/0x540 [ 3292.620858][ C1] ? lock_release+0x1d5/0x250 [ 3292.621102][ C1] vfs_read+0x911/0xc00 [ 3292.621317][ C1] ? lock_acquire+0x1c1/0x220 [ 3292.621558][ C1] ? __might_fault+0xc6/0x180 [ 3292.621801][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3292.622040][ C1] ? __might_fault+0xc6/0x180 [ 3292.622285][ C1] ? lock_release+0x1d5/0x250 [ 3292.622527][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3292.622794][ C1] ? __fget_light+0x54/0x1e0 [ 3292.623033][ C1] ksys_read+0x17a/0x1e0 [ 3292.623257][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3292.623504][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3292.623812][ C1] do_syscall_64+0xc9/0x1e0 [ 3292.624045][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3292.624348][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3292.624579][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3292.625559][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3292.625983][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3292.626386][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3292.626787][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3292.627187][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3292.627585][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3292.627987][ C1] [ 3292.628147][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 875s! [swapper/2:0] [ 3292.628561][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3292.629809][ C2] irq event stamp: 44114564 [ 3292.630038][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3292.630571][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3292.631081][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3292.631558][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3292.632025][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3292.632481][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3292.633092][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 3292.633386][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 3292.634355][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [ 3292.634660][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3292.635061][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3292.635462][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3292.635858][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3292.636255][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3292.636660][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3292.637105][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3292.637439][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3292.637840][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3292.638238][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3292.638638][ C2] PKRU: 55555554 [ 3292.638818][ C2] Call Trace: [ 3292.638988][ C2] [ 3292.639136][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3292.639397][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3292.639639][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3292.639918][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3292.640191][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3292.640477][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3292.640742][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3292.641047][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3292.641308][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3292.641574][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3292.641883][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3292.642185][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3292.642499][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3292.642786][ C2] ? kasan_check_range+0x12/0x1c0 [ 3292.643043][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3292.643332][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3292.643642][ C2] ? get_stack_info+0x36/0xc0 [ 3292.643881][ C2] ? lock_acquire+0x1c1/0x220 [ 3292.644122][ C2] ? lock_release+0x1d5/0x250 [ 3292.644362][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3292.644610][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3292.644881][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3292.645164][ C2] ? lock_acquire+0x1c1/0x220 [ 3292.645403][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3292.645643][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3292.645902][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3292.646137][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3292.646383][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3292.646640][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3292.646919][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3292.647196][ C2] ip_local_deliver+0x19d/0x480 [ 3292.647442][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3292.647712][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3292.647974][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3292.648319][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3292.648571][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3292.648889][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3292.649152][ C2] ip_rcv+0x564/0x740 [ 3292.649356][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3292.649584][ C2] ? set_track_prepare+0x8a/0xd0 [ 3292.649836][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3292.650113][ C2] ? start_secondary+0x21c/0x2b0 [ 3292.650364][ C2] ? skb_clone+0x10b/0x330 [ 3292.650591][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3292.650909][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3292.651216][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3292.651495][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3292.651790][ C2] ? __tcf_classify+0x329/0x7d0 [ 3292.652037][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3292.652268][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3292.652571][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3292.652853][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3292.653186][ C2] ? lock_acquire+0x1c1/0x220 [ 3292.653426][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3292.653722][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3292.654007][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3292.654323][ C2] ? __copy_skb_header+0xaf/0x490 [ 3292.654579][ C2] ? __skb_clone+0x57a/0x760 [ 3292.654814][ C2] netif_receive_skb+0x55/0x280 [ 3292.655063][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3292.655373][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3292.655706][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3292.656004][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3292.656278][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3292.656569][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3292.656881][ C2] ? get_stack_info+0x36/0xc0 [ 3292.657121][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3292.657385][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3292.657701][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3292.657978][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3292.658254][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3292.658568][ C2] ? kernel_text_address+0x17/0xe0 [ 3292.658827][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3292.659140][ C2] ? arch_stack_walk+0x8c/0x100 [ 3292.659390][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3292.659655][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3292.659938][ C2] ? lock_acquire+0x1c1/0x220 [ 3292.660178][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3292.660460][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3292.660764][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3292.661040][ C2] ? get_stack_info+0x36/0xc0 [ 3292.661281][ C2] __tcf_classify+0x329/0x7d0 [ 3292.661522][ C2] tcf_classify+0x283/0x930 [ 3292.661755][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3292.662010][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3292.662323][ C2] tc_run+0x2e4/0x5d0 [ 3292.662528][ C2] ? __pfx_tc_run+0x10/0x10 [ 3292.662757][ C2] ? lock_acquire+0x1c1/0x220 [ 3292.662996][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3292.663264][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3292.663517][ C2] ? lock_acquire+0x1c1/0x220 [ 3292.663756][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3292.664020][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3292.664325][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3292.664596][ C2] ? neigh_hh_output+0x348/0x590 [ 3292.664847][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3292.665112][ C2] ip_finish_output2+0x786/0x18e0 [ 3292.665368][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3292.665702][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3292.665978][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3292.666231][ C2] ? __ip_finish_output+0x10f/0x770 [ 3292.666496][ C2] ip_output+0x16b/0x4f0 [ 3292.666713][ C2] ? __pfx_ip_output+0x10/0x10 [ 3292.666956][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3292.667232][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3292.667542][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3292.667818][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3292.668069][ C2] ? __alloc_skb+0xd4/0x280 [ 3292.668300][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3292.668569][ C2] ? tcp_fragment+0x168/0x1040 [ 3292.668813][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3292.669064][ C2] ? ip_local_out+0x114/0x3b0 [ 3292.669304][ C2] __ip_queue_xmit+0x672/0x1910 [ 3292.669551][ C2] ? __skb_clone+0x57a/0x760 [ 3292.669787][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3292.670053][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3292.670335][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3292.670577][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3292.670826][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3292.671128][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3292.671446][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3292.671690][ C2] tcp_send_loss_probe+0x348/0x830 [ 3292.671950][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3292.672218][ C2] tcp_write_timer+0x82/0x1d0 [ 3292.672458][ C2] call_timer_fn+0x173/0x430 [ 3292.672694][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3292.672956][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3292.673228][ C2] __run_timers.part.0+0x52d/0x890 [ 3292.673488][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3292.673757][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3292.674040][ C2] ? lock_acquire+0x1c1/0x220 [ 3292.674281][ C2] ? clockevents_program_event+0xf6/0x300 [ 3292.674570][ C2] ? lock_release+0x1d5/0x250 [ 3292.674809][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3292.675073][ C2] ? ktime_get+0xb3/0x190 [ 3292.675296][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3292.675591][ C2] run_timer_softirq+0x72/0x100 [ 3292.675838][ C2] __do_softirq+0x1b9/0x7ff [ 3292.676071][ C2] irq_exit_rcu+0x98/0xc0 [ 3292.676291][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3292.676577][ C2] [ 3292.676726][ C2] [ 3292.676877][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3292.677181][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3292.677437][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3292.678407][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3292.678714][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3292.679113][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3292.679511][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3292.679908][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3292.680305][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3292.680705][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3292.680994][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3292.681254][ C2] default_idle_call+0x69/0xa0 [ 3292.681498][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3292.681750][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3292.682026][ C2] ? lock_release+0x1d5/0x250 [ 3292.682266][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3292.682537][ C2] do_idle+0xfb/0x160 [ 3292.682740][ C2] cpu_startup_entry+0x55/0x60 [ 3292.682982][ C2] start_secondary+0x21c/0x2b0 [ 3292.683233][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3292.683507][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3292.683817][ C2] [ 3317.599105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3317.599482][ C1] rcu: 1-....: (960817 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=235449 [ 3317.600034][ C1] rcu: (t=962712 jiffies g=1882453 q=697 ncpus=4) [ 3317.600369][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3317.600820][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3317.601440][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3317.601770][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3317.602746][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3317.603065][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3317.603467][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3317.603870][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3317.604272][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3317.604673][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3317.605074][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3317.605525][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3317.605862][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3317.606267][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3317.606669][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3317.607069][ C1] PKRU: 55555554 [ 3317.607252][ C1] Call Trace: [ 3317.607425][ C1] [ 3317.607575][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3317.607849][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3317.608105][ C1] ? check_cpu_stall+0x284/0x500 [ 3317.608359][ C1] ? rcu_pending+0x92/0x360 [ 3317.608591][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3317.608862][ C1] ? update_process_times+0xb9/0x110 [ 3317.609133][ C1] ? tick_sched_handle+0x67/0x130 [ 3317.609391][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3317.609679][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3317.609923][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3317.610236][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3317.610512][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3317.610800][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3317.611067][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3317.611376][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3317.611639][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3317.611950][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3317.612249][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3317.612566][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3317.612856][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3317.613160][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3317.613449][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3317.613762][ C1] ? get_stack_info+0x36/0xc0 [ 3317.614005][ C1] ? lock_acquire+0x1c1/0x220 [ 3317.614246][ C1] ? lock_release+0x1d5/0x250 [ 3317.614487][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3317.614737][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3317.615009][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3317.615300][ C1] ? lock_acquire+0x1c1/0x220 [ 3317.615539][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3317.615780][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3317.616041][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3317.616278][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3317.616528][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3317.616787][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3317.617064][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3317.617341][ C1] ip_local_deliver+0x19d/0x480 [ 3317.617591][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3317.617865][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3317.618131][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3317.618480][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3317.618735][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3317.619057][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3317.619321][ C1] ip_rcv+0x564/0x740 [ 3317.619524][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3317.619757][ C1] ? set_track_prepare+0x8a/0xd0 [ 3317.620011][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3317.620289][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3317.620562][ C1] ? skb_clone+0x10b/0x330 [ 3317.620794][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3317.621116][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3317.621422][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3317.621706][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3317.622000][ C1] ? __tcf_classify+0x329/0x7d0 [ 3317.622252][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3317.622483][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3317.622785][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3317.623077][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3317.623403][ C1] ? lock_acquire+0x1c1/0x220 [ 3317.623644][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3317.623941][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3317.624228][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3317.624549][ C1] ? __copy_skb_header+0xaf/0x490 [ 3317.624807][ C1] ? __skb_clone+0x57a/0x760 [ 3317.625042][ C1] netif_receive_skb+0x55/0x280 [ 3317.625291][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3317.625606][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3317.625938][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3317.626241][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3317.626517][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3317.626808][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3317.627121][ C1] ? hlock_class+0x4e/0x130 [ 3317.627356][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3317.627632][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3317.627913][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3317.628180][ C1] ? hlock_class+0x4e/0x130 [ 3317.628412][ C1] ? mark_lock+0x38/0x3e0 [ 3317.628638][ C1] ? stack_access_ok+0xda/0x1f0 [ 3317.628890][ C1] ? __lock_acquire+0xb67/0x1610 [ 3317.629149][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3317.629429][ C1] ? get_stack_info+0x36/0xc0 [ 3317.629672][ C1] ? stack_access_ok+0xda/0x1f0 [ 3317.629922][ C1] ? get_reg+0x119/0x190 [ 3317.630143][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3317.630414][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3317.630727][ C1] __tcf_classify+0x329/0x7d0 [ 3317.630973][ C1] tcf_classify+0x283/0x930 [ 3317.631206][ C1] ? arch_stack_walk+0xa2/0x100 [ 3317.631459][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3317.631718][ C1] ? get_stack_info+0x36/0xc0 [ 3317.631962][ C1] tc_run+0x2e4/0x5d0 [ 3317.632171][ C1] ? __pfx_tc_run+0x10/0x10 [ 3317.632407][ C1] ? lock_acquire+0x1c1/0x220 [ 3317.632648][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3317.632913][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3317.633175][ C1] ? lock_acquire+0x1c1/0x220 [ 3317.633416][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3317.633683][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3317.633992][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3317.634267][ C1] ? neigh_hh_output+0x348/0x590 [ 3317.634523][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3317.634791][ C1] ip_finish_output2+0x786/0x18e0 [ 3317.635051][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3317.635336][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3317.635677][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3317.635956][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3317.636212][ C1] ? __ip_finish_output+0x10f/0x770 [ 3317.636478][ C1] ip_output+0x16b/0x4f0 [ 3317.636698][ C1] ? run_timer_softirq+0x72/0x100 [ 3317.636956][ C1] ? __pfx_ip_output+0x10/0x10 [ 3317.637201][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3317.637489][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3317.637745][ C1] ? ip_local_out+0x114/0x3b0 [ 3317.637987][ C1] __ip_queue_xmit+0x672/0x1910 [ 3317.638236][ C1] ? __create_object+0x5e/0xb0 [ 3317.638482][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3317.638752][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3317.639036][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3317.639311][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3317.639593][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3317.639869][ C1] tcp_delack_timer+0x84/0x240 [ 3317.640115][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3317.640390][ C1] call_timer_fn+0x173/0x430 [ 3317.640629][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3317.640892][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3317.641156][ C1] __run_timers.part.0+0x52d/0x890 [ 3317.641419][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3317.641694][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3317.641981][ C1] ? lock_acquire+0x1c1/0x220 [ 3317.642224][ C1] ? clockevents_program_event+0xf6/0x300 [ 3317.642517][ C1] ? lock_release+0x1d5/0x250 [ 3317.642758][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3317.643028][ C1] ? ktime_get+0xb3/0x190 [ 3317.643252][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3317.643550][ C1] run_timer_softirq+0x72/0x100 [ 3317.643799][ C1] __do_softirq+0x1b9/0x7ff [ 3317.644034][ C1] irq_exit_rcu+0x98/0xc0 [ 3317.644257][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3317.644546][ C1] [ 3317.644697][ C1] [ 3317.644850][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3317.645161][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3317.645490][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3317.646475][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3317.646785][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3317.647192][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3317.647595][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3317.647997][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3317.648400][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3317.648809][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3317.649108][ C1] pipe_read+0xa16/0xdf0 [ 3317.649334][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3317.649615][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3317.649862][ C1] ? iterate_tty_write+0x299/0x540 [ 3317.650127][ C1] ? lock_release+0x1d5/0x250 [ 3317.650371][ C1] vfs_read+0x911/0xc00 [ 3317.650587][ C1] ? lock_acquire+0x1c1/0x220 [ 3317.650829][ C1] ? __might_fault+0xc6/0x180 [ 3317.651070][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3317.651312][ C1] ? __might_fault+0xc6/0x180 [ 3317.651555][ C1] ? lock_release+0x1d5/0x250 [ 3317.651798][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3317.652066][ C1] ? __fget_light+0x54/0x1e0 [ 3317.652305][ C1] ksys_read+0x17a/0x1e0 [ 3317.652525][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3317.652774][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3317.653084][ C1] do_syscall_64+0xc9/0x1e0 [ 3317.653323][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3317.653627][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3317.653856][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3317.654836][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3317.655264][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3317.655666][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3317.656068][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3317.656471][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3317.656871][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3317.657275][ C1] [ 3317.657435][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3317.657711][ C2] NMI backtrace for cpu 2 [ 3317.657719][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3317.657725][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3317.657729][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3317.657735][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3317.657737][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3317.657740][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3317.657742][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3317.657743][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3317.657745][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3317.657746][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3317.657748][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3317.657750][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3317.657753][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3317.657755][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3317.657756][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3317.657758][ C2] PKRU: 55555554 [ 3317.657759][ C2] Call Trace: [ 3317.657762][ C2] [ 3317.657765][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3317.657773][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3317.657778][ C2] ? nmi_handle+0x153/0x420 [ 3317.657783][ C2] ? default_do_nmi+0x41/0x100 [ 3317.657786][ C2] ? exc_nmi+0xf3/0x120 [ 3317.657789][ C2] ? end_repeat_nmi+0xf/0x60 [ 3317.657794][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3317.657797][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3317.657800][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3317.657803][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3317.657806][ C2] [ 3317.657807][ C2] [ 3317.657809][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3317.657811][ C2] ? get_stack_info+0x36/0xc0 [ 3317.657816][ C2] ? lock_acquire+0x1c1/0x220 [ 3317.657819][ C2] ? lock_release+0x1d5/0x250 [ 3317.657822][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3317.657826][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3317.657829][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3317.657832][ C2] ? lock_acquire+0x1c1/0x220 [ 3317.657835][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3317.657838][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3317.657841][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3317.657847][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3317.657850][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3317.657855][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3317.657860][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3317.657864][ C2] ip_local_deliver+0x19d/0x480 [ 3317.657866][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3317.657868][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3317.657871][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3317.657876][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3317.657879][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3317.657882][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3317.657891][ C2] ip_rcv+0x564/0x740 [ 3317.657894][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3317.657897][ C2] ? set_track_prepare+0x8a/0xd0 [ 3317.657901][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3317.657904][ C2] ? start_secondary+0x21c/0x2b0 [ 3317.657907][ C2] ? skb_clone+0x10b/0x330 [ 3317.657910][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3317.657917][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3317.657922][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3317.657925][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3317.657933][ C2] ? __tcf_classify+0x329/0x7d0 [ 3317.657937][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3317.657939][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3317.657942][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3317.657945][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3317.657949][ C2] ? lock_acquire+0x1c1/0x220 [ 3317.657951][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3317.657956][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3317.657959][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3317.657963][ C2] ? __copy_skb_header+0xaf/0x490 [ 3317.657967][ C2] ? __skb_clone+0x57a/0x760 [ 3317.657969][ C2] netif_receive_skb+0x55/0x280 [ 3317.657972][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3317.657980][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3317.657987][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3317.657994][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3317.657998][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3317.658008][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3317.658016][ C2] ? get_stack_info+0x36/0xc0 [ 3317.658020][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3317.658023][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3317.658027][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3317.658029][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3317.658032][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3317.658035][ C2] ? kernel_text_address+0x17/0xe0 [ 3317.658038][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3317.658042][ C2] ? arch_stack_walk+0x8c/0x100 [ 3317.658045][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3317.658049][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3317.658052][ C2] ? lock_acquire+0x1c1/0x220 [ 3317.658054][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3317.658058][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3317.658062][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3317.658065][ C2] ? get_stack_info+0x36/0xc0 [ 3317.658069][ C2] __tcf_classify+0x329/0x7d0 [ 3317.658074][ C2] tcf_classify+0x283/0x930 [ 3317.658079][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3317.658082][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3317.658086][ C2] tc_run+0x2e4/0x5d0 [ 3317.658089][ C2] ? __pfx_tc_run+0x10/0x10 [ 3317.658092][ C2] ? lock_acquire+0x1c1/0x220 [ 3317.658095][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3317.658098][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3317.658102][ C2] ? lock_acquire+0x1c1/0x220 [ 3317.658105][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3317.658108][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3317.658111][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3317.658114][ C2] ? neigh_hh_output+0x348/0x590 [ 3317.658118][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3317.658121][ C2] ip_finish_output2+0x786/0x18e0 [ 3317.658125][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3317.658132][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3317.658135][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3317.658139][ C2] ? __ip_finish_output+0x10f/0x770 [ 3317.658142][ C2] ip_output+0x16b/0x4f0 [ 3317.658145][ C2] ? __pfx_ip_output+0x10/0x10 [ 3317.658147][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3317.658150][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3317.658153][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3317.658156][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3317.658159][ C2] ? __alloc_skb+0xd4/0x280 [ 3317.658161][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3317.658165][ C2] ? tcp_fragment+0x168/0x1040 [ 3317.658168][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3317.658171][ C2] ? ip_local_out+0x114/0x3b0 [ 3317.658175][ C2] __ip_queue_xmit+0x672/0x1910 [ 3317.658179][ C2] ? __skb_clone+0x57a/0x760 [ 3317.658181][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3317.658187][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3317.658190][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3317.658194][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3317.658198][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3317.658202][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3317.658205][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3317.658208][ C2] tcp_send_loss_probe+0x348/0x830 [ 3317.658212][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3317.658214][ C2] tcp_write_timer+0x82/0x1d0 [ 3317.658217][ C2] call_timer_fn+0x173/0x430 [ 3317.658221][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3317.658226][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3317.658230][ C2] __run_timers.part.0+0x52d/0x890 [ 3317.658232][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3317.658236][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3317.658239][ C2] ? lock_acquire+0x1c1/0x220 [ 3317.658241][ C2] ? clockevents_program_event+0xf6/0x300 [ 3317.658245][ C2] ? lock_release+0x1d5/0x250 [ 3317.658248][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3317.658251][ C2] ? ktime_get+0xb3/0x190 [ 3317.658254][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3317.658259][ C2] run_timer_softirq+0x72/0x100 [ 3317.658262][ C2] __do_softirq+0x1b9/0x7ff [ 3317.658266][ C2] irq_exit_rcu+0x98/0xc0 [ 3317.658269][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3317.658272][ C2] [ 3317.658273][ C2] [ 3317.658274][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3317.658277][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3317.658280][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3317.658282][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3317.658285][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3317.658286][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3317.658288][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3317.658289][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3317.658291][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3317.658294][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3317.658298][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3317.658301][ C2] default_idle_call+0x69/0xa0 [ 3317.658304][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3317.658306][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3317.658311][ C2] ? lock_release+0x1d5/0x250 [ 3317.658313][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3317.658317][ C2] do_idle+0xfb/0x160 [ 3317.658320][ C2] cpu_startup_entry+0x55/0x60 [ 3317.658322][ C2] start_secondary+0x21c/0x2b0 [ 3317.658325][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3317.658329][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3317.658335][ C2] [ 3344.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 923s! [swapper/2:0] [ 3344.569690][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3344.570941][ C2] irq event stamp: 44114564 [ 3344.571166][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3344.571703][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3344.572213][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3344.572688][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3344.573166][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3344.573621][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3344.574230][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3344.574553][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3344.575519][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3344.575825][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3344.576221][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3344.576621][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3344.577018][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3344.577415][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3344.577811][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3344.578256][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3344.578590][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3344.578988][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3344.579384][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3344.579781][ C2] PKRU: 55555554 [ 3344.579961][ C2] Call Trace: [ 3344.580133][ C2] [ 3344.580280][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3344.580540][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3344.580783][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3344.581059][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3344.581331][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3344.581616][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3344.581879][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3344.582189][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3344.582448][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3344.582709][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3344.583025][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3344.583321][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3344.583635][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3344.583922][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3344.584223][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3344.584509][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3344.584819][ C2] ? get_stack_info+0x36/0xc0 [ 3344.585060][ C2] ? lock_acquire+0x1c1/0x220 [ 3344.585300][ C2] ? lock_release+0x1d5/0x250 [ 3344.585536][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3344.585783][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3344.586055][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3344.586340][ C2] ? lock_acquire+0x1c1/0x220 [ 3344.586579][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3344.586817][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3344.587076][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3344.587311][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3344.587562][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3344.587818][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3344.588093][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3344.588370][ C2] ip_local_deliver+0x19d/0x480 [ 3344.588614][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3344.588887][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3344.589150][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3344.589495][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3344.589748][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3344.590066][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3344.590328][ C2] ip_rcv+0x564/0x740 [ 3344.590530][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3344.590762][ C2] ? set_track_prepare+0x8a/0xd0 [ 3344.591014][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3344.591289][ C2] ? start_secondary+0x21c/0x2b0 [ 3344.591539][ C2] ? skb_clone+0x10b/0x330 [ 3344.591765][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3344.592082][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3344.592385][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3344.592667][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3344.592966][ C2] ? __tcf_classify+0x329/0x7d0 [ 3344.593213][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3344.593443][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3344.593739][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3344.594025][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3344.594349][ C2] ? lock_acquire+0x1c1/0x220 [ 3344.594586][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3344.594879][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3344.595165][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3344.595480][ C2] ? __copy_skb_header+0xaf/0x490 [ 3344.595736][ C2] ? __skb_clone+0x57a/0x760 [ 3344.595968][ C2] netif_receive_skb+0x55/0x280 [ 3344.596216][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3344.596527][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3344.596857][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3344.597156][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3344.597428][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3344.597714][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3344.598025][ C2] ? get_stack_info+0x36/0xc0 [ 3344.598266][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3344.598529][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3344.598845][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3344.599119][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3344.599397][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3344.599711][ C2] ? kernel_text_address+0x17/0xe0 [ 3344.599970][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3344.600287][ C2] ? arch_stack_walk+0x8c/0x100 [ 3344.600535][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3344.600799][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3344.601085][ C2] ? lock_acquire+0x1c1/0x220 [ 3344.601324][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3344.601607][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3344.601911][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3344.602186][ C2] ? get_stack_info+0x36/0xc0 [ 3344.602427][ C2] __tcf_classify+0x329/0x7d0 [ 3344.602668][ C2] tcf_classify+0x283/0x930 [ 3344.602905][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3344.603160][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3344.603473][ C2] tc_run+0x2e4/0x5d0 [ 3344.603677][ C2] ? __pfx_tc_run+0x10/0x10 [ 3344.603908][ C2] ? lock_acquire+0x1c1/0x220 [ 3344.604147][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3344.604407][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3344.604659][ C2] ? lock_acquire+0x1c1/0x220 [ 3344.604896][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3344.605161][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3344.605462][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3344.605735][ C2] ? neigh_hh_output+0x348/0x590 [ 3344.605986][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3344.606251][ C2] ip_finish_output2+0x786/0x18e0 [ 3344.606507][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3344.606843][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3344.607116][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3344.607368][ C2] ? __ip_finish_output+0x10f/0x770 [ 3344.607630][ C2] ip_output+0x16b/0x4f0 [ 3344.607847][ C2] ? __pfx_ip_output+0x10/0x10 [ 3344.608087][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3344.608365][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3344.608676][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3344.608952][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3344.609203][ C2] ? __alloc_skb+0xd4/0x280 [ 3344.609432][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3344.609702][ C2] ? tcp_fragment+0x168/0x1040 [ 3344.609944][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3344.610194][ C2] ? ip_local_out+0x114/0x3b0 [ 3344.610434][ C2] __ip_queue_xmit+0x672/0x1910 [ 3344.610682][ C2] ? __skb_clone+0x57a/0x760 [ 3344.610916][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3344.611182][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3344.611460][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3344.611704][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3344.611953][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3344.612253][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3344.612570][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3344.612811][ C2] tcp_send_loss_probe+0x348/0x830 [ 3344.613080][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3344.613349][ C2] tcp_write_timer+0x82/0x1d0 [ 3344.613585][ C2] call_timer_fn+0x173/0x430 [ 3344.613823][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3344.614082][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3344.614342][ C2] __run_timers.part.0+0x52d/0x890 [ 3344.614601][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3344.614870][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3344.615154][ C2] ? lock_acquire+0x1c1/0x220 [ 3344.615393][ C2] ? clockevents_program_event+0xf6/0x300 [ 3344.615681][ C2] ? lock_release+0x1d5/0x250 [ 3344.615919][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3344.616183][ C2] ? ktime_get+0xb3/0x190 [ 3344.616403][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3344.616699][ C2] run_timer_softirq+0x72/0x100 [ 3344.616946][ C2] __do_softirq+0x1b9/0x7ff [ 3344.617177][ C2] irq_exit_rcu+0x98/0xc0 [ 3344.617396][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3344.617680][ C2] [ 3344.617831][ C2] [ 3344.617980][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3344.618284][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3344.618540][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3344.619505][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3344.619812][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3344.620210][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3344.620606][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3344.621005][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3344.621403][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3344.621801][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3344.622090][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3344.622351][ C2] default_idle_call+0x69/0xa0 [ 3344.622593][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3344.622843][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3344.623128][ C2] ? lock_release+0x1d5/0x250 [ 3344.623365][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3344.623637][ C2] do_idle+0xfb/0x160 [ 3344.623840][ C2] cpu_startup_entry+0x55/0x60 [ 3344.624083][ C2] start_secondary+0x21c/0x2b0 [ 3344.624326][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3344.624595][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3344.624906][ C2] [ 3344.625062][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 923s! [perl:4135] [ 3344.625492][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3344.626760][ C1] irq event stamp: 209232 [ 3344.626982][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3344.627520][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3344.628000][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3344.628470][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3344.628939][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3344.629390][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3344.630004][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3344.630331][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3344.631308][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3344.631617][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3344.632017][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3344.632420][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3344.632820][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3344.633227][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3344.633626][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3344.634076][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3344.634415][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3344.634818][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3344.635219][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3344.635621][ C1] PKRU: 55555554 [ 3344.635803][ C1] Call Trace: [ 3344.635976][ C1] [ 3344.636124][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3344.636392][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3344.636638][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3344.636917][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3344.637193][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3344.637486][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3344.637753][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3344.638062][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3344.638327][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3344.638639][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3344.638937][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3344.639256][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3344.639548][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3344.639847][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3344.640139][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3344.640453][ C1] ? get_stack_info+0x36/0xc0 [ 3344.640698][ C1] ? lock_acquire+0x1c1/0x220 [ 3344.640940][ C1] ? lock_release+0x1d5/0x250 [ 3344.641182][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3344.641433][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3344.641708][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3344.641996][ C1] ? lock_acquire+0x1c1/0x220 [ 3344.642238][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3344.642481][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3344.642743][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3344.642987][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3344.643238][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3344.643499][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3344.643778][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3344.644058][ C1] ip_local_deliver+0x19d/0x480 [ 3344.644309][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3344.644584][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3344.644850][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3344.645200][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3344.645455][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3344.645778][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3344.646047][ C1] ip_rcv+0x564/0x740 [ 3344.646254][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3344.646488][ C1] ? set_track_prepare+0x8a/0xd0 [ 3344.646745][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3344.647023][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3344.647299][ C1] ? skb_clone+0x10b/0x330 [ 3344.647530][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3344.647852][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3344.648161][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3344.648444][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3344.648740][ C1] ? __tcf_classify+0x329/0x7d0 [ 3344.648989][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3344.649224][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3344.649527][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3344.649812][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3344.650138][ C1] ? lock_acquire+0x1c1/0x220 [ 3344.650379][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3344.650676][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3344.650964][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3344.651284][ C1] ? __copy_skb_header+0xaf/0x490 [ 3344.651543][ C1] ? __skb_clone+0x57a/0x760 [ 3344.651778][ C1] netif_receive_skb+0x55/0x280 [ 3344.652026][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3344.652341][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3344.652673][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3344.652982][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3344.653258][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3344.653549][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3344.653862][ C1] ? hlock_class+0x4e/0x130 [ 3344.654097][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3344.654376][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3344.654658][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3344.654922][ C1] ? hlock_class+0x4e/0x130 [ 3344.655154][ C1] ? mark_lock+0x38/0x3e0 [ 3344.655376][ C1] ? stack_access_ok+0xda/0x1f0 [ 3344.655626][ C1] ? __lock_acquire+0xb67/0x1610 [ 3344.655881][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3344.656160][ C1] ? get_stack_info+0x36/0xc0 [ 3344.656400][ C1] ? stack_access_ok+0xda/0x1f0 [ 3344.656649][ C1] ? get_reg+0x119/0x190 [ 3344.656867][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3344.657139][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3344.657453][ C1] __tcf_classify+0x329/0x7d0 [ 3344.657698][ C1] tcf_classify+0x283/0x930 [ 3344.657929][ C1] ? arch_stack_walk+0xa2/0x100 [ 3344.658182][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3344.658441][ C1] ? get_stack_info+0x36/0xc0 [ 3344.658684][ C1] tc_run+0x2e4/0x5d0 [ 3344.658891][ C1] ? __pfx_tc_run+0x10/0x10 [ 3344.659127][ C1] ? lock_acquire+0x1c1/0x220 [ 3344.659369][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3344.659632][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3344.659888][ C1] ? lock_acquire+0x1c1/0x220 [ 3344.660128][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3344.660396][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3344.660707][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3344.660980][ C1] ? neigh_hh_output+0x348/0x590 [ 3344.661235][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3344.661504][ C1] ip_finish_output2+0x786/0x18e0 [ 3344.661761][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3344.662044][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3344.662385][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3344.662662][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3344.662926][ C1] ? __ip_finish_output+0x10f/0x770 [ 3344.663196][ C1] ip_output+0x16b/0x4f0 [ 3344.663417][ C1] ? run_timer_softirq+0x72/0x100 [ 3344.663677][ C1] ? __pfx_ip_output+0x10/0x10 [ 3344.663922][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3344.664211][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3344.664465][ C1] ? ip_local_out+0x114/0x3b0 [ 3344.664709][ C1] __ip_queue_xmit+0x672/0x1910 [ 3344.664959][ C1] ? __create_object+0x5e/0xb0 [ 3344.665205][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3344.665477][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3344.665761][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3344.666036][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3344.666321][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3344.666596][ C1] tcp_delack_timer+0x84/0x240 [ 3344.666846][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3344.667122][ C1] call_timer_fn+0x173/0x430 [ 3344.667359][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3344.667622][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3344.667885][ C1] __run_timers.part.0+0x52d/0x890 [ 3344.668147][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3344.668421][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3344.668705][ C1] ? lock_acquire+0x1c1/0x220 [ 3344.668947][ C1] ? clockevents_program_event+0xf6/0x300 [ 3344.669239][ C1] ? lock_release+0x1d5/0x250 [ 3344.669477][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3344.669745][ C1] ? ktime_get+0xb3/0x190 [ 3344.669967][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3344.670266][ C1] run_timer_softirq+0x72/0x100 [ 3344.670514][ C1] __do_softirq+0x1b9/0x7ff [ 3344.670747][ C1] irq_exit_rcu+0x98/0xc0 [ 3344.670969][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3344.671257][ C1] [ 3344.671407][ C1] [ 3344.671560][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3344.671865][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3344.672194][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3344.673176][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3344.673485][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3344.673889][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3344.674290][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3344.674690][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3344.675093][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3344.675500][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3344.675797][ C1] pipe_read+0xa16/0xdf0 [ 3344.676022][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3344.676303][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3344.676551][ C1] ? iterate_tty_write+0x299/0x540 [ 3344.676814][ C1] ? lock_release+0x1d5/0x250 [ 3344.677057][ C1] vfs_read+0x911/0xc00 [ 3344.677274][ C1] ? lock_acquire+0x1c1/0x220 [ 3344.677515][ C1] ? __might_fault+0xc6/0x180 [ 3344.677756][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3344.677997][ C1] ? __might_fault+0xc6/0x180 [ 3344.678240][ C1] ? lock_release+0x1d5/0x250 [ 3344.678483][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3344.678749][ C1] ? __fget_light+0x54/0x1e0 [ 3344.678988][ C1] ksys_read+0x17a/0x1e0 [ 3344.679209][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3344.679458][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3344.679763][ C1] do_syscall_64+0xc9/0x1e0 [ 3344.679998][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3344.680302][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3344.680531][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3344.681513][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3344.681938][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3344.682341][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3344.682743][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3344.683158][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3344.683560][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3344.683965][ C1] [ 3372.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 949s! [perl:4135] [ 3372.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3372.570961][ C1] irq event stamp: 209232 [ 3372.571183][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3372.571715][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3372.572198][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3372.572675][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3372.573156][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3372.573613][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3372.574232][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3372.574559][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3372.575545][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3372.575859][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3372.576264][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3372.576673][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3372.577083][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3372.577485][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3372.577894][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3372.578348][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3372.578683][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3372.579086][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3372.579491][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3372.579899][ C1] PKRU: 55555554 [ 3372.580081][ C1] Call Trace: [ 3372.580253][ C1] [ 3372.580405][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3372.580675][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3372.580925][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3372.581207][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3372.581482][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3372.581779][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3372.582052][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3372.582360][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3372.582625][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3372.582944][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3372.583245][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3372.583571][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3372.583867][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3372.584166][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3372.584457][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3372.584780][ C1] ? get_stack_info+0x36/0xc0 [ 3372.585032][ C1] ? lock_acquire+0x1c1/0x220 [ 3372.585282][ C1] ? lock_release+0x1d5/0x250 [ 3372.585524][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3372.585777][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3372.586055][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3372.586344][ C1] ? lock_acquire+0x1c1/0x220 [ 3372.586587][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3372.586830][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3372.587093][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3372.587331][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3372.587582][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3372.587844][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3372.588122][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3372.588405][ C1] ip_local_deliver+0x19d/0x480 [ 3372.588655][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3372.588930][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3372.589198][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3372.589548][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3372.589804][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3372.590128][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3372.590392][ C1] ip_rcv+0x564/0x740 [ 3372.590600][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3372.590832][ C1] ? set_track_prepare+0x8a/0xd0 [ 3372.591087][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3372.591370][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3372.591646][ C1] ? skb_clone+0x10b/0x330 [ 3372.591882][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3372.592205][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3372.592514][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3372.592810][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3372.593119][ C1] ? __tcf_classify+0x329/0x7d0 [ 3372.593372][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3372.593604][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3372.593908][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3372.594195][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3372.594522][ C1] ? lock_acquire+0x1c1/0x220 [ 3372.594763][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3372.595069][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3372.595356][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3372.595693][ C1] ? __copy_skb_header+0xaf/0x490 [ 3372.595953][ C1] ? __skb_clone+0x57a/0x760 [ 3372.596196][ C1] netif_receive_skb+0x55/0x280 [ 3372.596447][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3372.596770][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3372.597108][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3372.597407][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3372.597687][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3372.597984][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3372.598306][ C1] ? hlock_class+0x4e/0x130 [ 3372.598538][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3372.598819][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3372.599112][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3372.599378][ C1] ? hlock_class+0x4e/0x130 [ 3372.599612][ C1] ? mark_lock+0x38/0x3e0 [ 3372.599837][ C1] ? stack_access_ok+0xda/0x1f0 [ 3372.600088][ C1] ? __lock_acquire+0xb67/0x1610 [ 3372.600345][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3372.600628][ C1] ? get_stack_info+0x36/0xc0 [ 3372.600879][ C1] ? stack_access_ok+0xda/0x1f0 [ 3372.601129][ C1] ? get_reg+0x119/0x190 [ 3372.601346][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3372.601617][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3372.601928][ C1] __tcf_classify+0x329/0x7d0 [ 3372.602182][ C1] tcf_classify+0x283/0x930 [ 3372.602415][ C1] ? arch_stack_walk+0xa2/0x100 [ 3372.602666][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3372.602939][ C1] ? get_stack_info+0x36/0xc0 [ 3372.603182][ C1] tc_run+0x2e4/0x5d0 [ 3372.603391][ C1] ? __pfx_tc_run+0x10/0x10 [ 3372.603624][ C1] ? lock_acquire+0x1c1/0x220 [ 3372.603875][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3372.604139][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3372.604408][ C1] ? lock_acquire+0x1c1/0x220 [ 3372.604649][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3372.604918][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3372.605231][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3372.605517][ C1] ? neigh_hh_output+0x348/0x590 [ 3372.605774][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3372.606042][ C1] ip_finish_output2+0x786/0x18e0 [ 3372.606305][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3372.606587][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3372.606928][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3372.607211][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3372.607467][ C1] ? __ip_finish_output+0x10f/0x770 [ 3372.607737][ C1] ip_output+0x16b/0x4f0 [ 3372.607956][ C1] ? run_timer_softirq+0x72/0x100 [ 3372.608217][ C1] ? __pfx_ip_output+0x10/0x10 [ 3372.608467][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3372.608757][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3372.609012][ C1] ? ip_local_out+0x114/0x3b0 [ 3372.609256][ C1] __ip_queue_xmit+0x672/0x1910 [ 3372.609509][ C1] ? __create_object+0x5e/0xb0 [ 3372.609758][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3372.610029][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3372.610313][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3372.610587][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3372.610873][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3372.611148][ C1] tcp_delack_timer+0x84/0x240 [ 3372.611395][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3372.611669][ C1] call_timer_fn+0x173/0x430 [ 3372.611909][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3372.612177][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3372.612441][ C1] __run_timers.part.0+0x52d/0x890 [ 3372.612703][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3372.612986][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3372.613275][ C1] ? lock_acquire+0x1c1/0x220 [ 3372.613514][ C1] ? clockevents_program_event+0xf6/0x300 [ 3372.613808][ C1] ? lock_release+0x1d5/0x250 [ 3372.614050][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3372.614319][ C1] ? ktime_get+0xb3/0x190 [ 3372.614543][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3372.614843][ C1] run_timer_softirq+0x72/0x100 [ 3372.615094][ C1] __do_softirq+0x1b9/0x7ff [ 3372.615329][ C1] irq_exit_rcu+0x98/0xc0 [ 3372.615554][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3372.615842][ C1] [ 3372.615995][ C1] [ 3372.616149][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3372.616459][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3372.616790][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3372.617771][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3372.618085][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3372.618489][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3372.618893][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3372.619298][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3372.619707][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3372.620112][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3372.620417][ C1] pipe_read+0xa16/0xdf0 [ 3372.620639][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3372.620919][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3372.621167][ C1] ? iterate_tty_write+0x299/0x540 [ 3372.621432][ C1] ? lock_release+0x1d5/0x250 [ 3372.621676][ C1] vfs_read+0x911/0xc00 [ 3372.621893][ C1] ? lock_acquire+0x1c1/0x220 [ 3372.622135][ C1] ? __might_fault+0xc6/0x180 [ 3372.622380][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3372.622621][ C1] ? __might_fault+0xc6/0x180 [ 3372.622870][ C1] ? lock_release+0x1d5/0x250 [ 3372.623114][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3372.623382][ C1] ? __fget_light+0x54/0x1e0 [ 3372.623623][ C1] ksys_read+0x17a/0x1e0 [ 3372.623841][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3372.624089][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3372.624399][ C1] do_syscall_64+0xc9/0x1e0 [ 3372.624632][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3372.624936][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3372.625178][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3372.626175][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3372.626600][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3372.627007][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3372.627415][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3372.627824][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3372.628227][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3372.628634][ C1] [ 3372.628810][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 949s! [swapper/2:0] [ 3372.629228][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3372.630477][ C2] irq event stamp: 44114564 [ 3372.630707][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3372.631239][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3372.631747][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3372.632225][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3372.632692][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3372.633154][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3372.633764][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3372.634087][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3372.635051][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3372.635359][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3372.635756][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3372.636153][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3372.636548][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3372.636948][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3372.637347][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3372.637791][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3372.638122][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3372.638521][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3372.638920][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3372.639317][ C2] PKRU: 55555554 [ 3372.639499][ C2] Call Trace: [ 3372.639669][ C2] [ 3372.639816][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3372.640077][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3372.640321][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3372.640596][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3372.640866][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3372.641156][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3372.641420][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3372.641727][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3372.641986][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3372.642249][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3372.642556][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3372.642856][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3372.643169][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3372.643461][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3372.643753][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3372.644042][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3372.644352][ C2] ? get_stack_info+0x36/0xc0 [ 3372.644590][ C2] ? lock_acquire+0x1c1/0x220 [ 3372.644830][ C2] ? lock_release+0x1d5/0x250 [ 3372.645069][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3372.645317][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3372.645588][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3372.645870][ C2] ? lock_acquire+0x1c1/0x220 [ 3372.646108][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3372.646349][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3372.646608][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3372.646843][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3372.647088][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3372.647346][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3372.647621][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3372.647903][ C2] ip_local_deliver+0x19d/0x480 [ 3372.648150][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3372.648419][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3372.648681][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3372.649027][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3372.649279][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3372.649597][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3372.649858][ C2] ip_rcv+0x564/0x740 [ 3372.650061][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3372.650289][ C2] ? set_track_prepare+0x8a/0xd0 [ 3372.650542][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3372.650819][ C2] ? start_secondary+0x21c/0x2b0 [ 3372.651069][ C2] ? skb_clone+0x10b/0x330 [ 3372.651295][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3372.651611][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3372.651916][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3372.652195][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3372.652488][ C2] ? __tcf_classify+0x329/0x7d0 [ 3372.652736][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3372.652972][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3372.653272][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3372.653556][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3372.653880][ C2] ? lock_acquire+0x1c1/0x220 [ 3372.654119][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3372.654414][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3372.654697][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3372.655013][ C2] ? __copy_skb_header+0xaf/0x490 [ 3372.655270][ C2] ? __skb_clone+0x57a/0x760 [ 3372.655504][ C2] netif_receive_skb+0x55/0x280 [ 3372.655751][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3372.656062][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3372.656395][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3372.656691][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3372.656965][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3372.657254][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3372.657565][ C2] ? get_stack_info+0x36/0xc0 [ 3372.657804][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3372.658069][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3372.658385][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3372.658662][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3372.658938][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3372.659252][ C2] ? kernel_text_address+0x17/0xe0 [ 3372.659512][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3372.659824][ C2] ? arch_stack_walk+0x8c/0x100 [ 3372.660071][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3372.660335][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3372.660618][ C2] ? lock_acquire+0x1c1/0x220 [ 3372.660855][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3372.661138][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3372.661439][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3372.661716][ C2] ? get_stack_info+0x36/0xc0 [ 3372.661954][ C2] __tcf_classify+0x329/0x7d0 [ 3372.662197][ C2] tcf_classify+0x283/0x930 [ 3372.662429][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3372.662684][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3372.663002][ C2] tc_run+0x2e4/0x5d0 [ 3372.663207][ C2] ? __pfx_tc_run+0x10/0x10 [ 3372.663436][ C2] ? lock_acquire+0x1c1/0x220 [ 3372.663674][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3372.663933][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3372.664186][ C2] ? lock_acquire+0x1c1/0x220 [ 3372.664427][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3372.664689][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3372.664993][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3372.665265][ C2] ? neigh_hh_output+0x348/0x590 [ 3372.665517][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3372.665781][ C2] ip_finish_output2+0x786/0x18e0 [ 3372.666036][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3372.666372][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3372.666650][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3372.666902][ C2] ? __ip_finish_output+0x10f/0x770 [ 3372.667167][ C2] ip_output+0x16b/0x4f0 [ 3372.667382][ C2] ? __pfx_ip_output+0x10/0x10 [ 3372.667624][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3372.667899][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3372.668210][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3372.668485][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3372.668735][ C2] ? __alloc_skb+0xd4/0x280 [ 3372.668965][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3372.669234][ C2] ? tcp_fragment+0x168/0x1040 [ 3372.669477][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3372.669728][ C2] ? ip_local_out+0x114/0x3b0 [ 3372.669968][ C2] __ip_queue_xmit+0x672/0x1910 [ 3372.670216][ C2] ? __skb_clone+0x57a/0x760 [ 3372.670449][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3372.670713][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3372.670994][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3372.671238][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3372.671485][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3372.671787][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3372.672106][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3372.672348][ C2] tcp_send_loss_probe+0x348/0x830 [ 3372.672608][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3372.672881][ C2] tcp_write_timer+0x82/0x1d0 [ 3372.673122][ C2] call_timer_fn+0x173/0x430 [ 3372.673358][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3372.673620][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3372.673879][ C2] __run_timers.part.0+0x52d/0x890 [ 3372.674139][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3372.674408][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3372.674691][ C2] ? lock_acquire+0x1c1/0x220 [ 3372.674929][ C2] ? clockevents_program_event+0xf6/0x300 [ 3372.675220][ C2] ? lock_release+0x1d5/0x250 [ 3372.675456][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3372.675721][ C2] ? ktime_get+0xb3/0x190 [ 3372.675941][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3372.676238][ C2] run_timer_softirq+0x72/0x100 [ 3372.676485][ C2] __do_softirq+0x1b9/0x7ff [ 3372.676717][ C2] irq_exit_rcu+0x98/0xc0 [ 3372.676936][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3372.677222][ C2] [ 3372.677370][ C2] [ 3372.677522][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3372.677825][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3372.678081][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3372.679050][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3372.679357][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3372.679756][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3372.680154][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3372.680551][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3372.680947][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3372.681350][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3372.681637][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3372.681895][ C2] default_idle_call+0x69/0xa0 [ 3372.682143][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3372.682394][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3372.682670][ C2] ? lock_release+0x1d5/0x250 [ 3372.682916][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3372.683188][ C2] do_idle+0xfb/0x160 [ 3372.683392][ C2] cpu_startup_entry+0x55/0x60 [ 3372.683634][ C2] start_secondary+0x21c/0x2b0 [ 3372.683881][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3372.684149][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3372.684460][ C2] [ 3395.658104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3395.658475][ C1] rcu: 1-....: (1038646 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=254354 [ 3395.659032][ C1] rcu: (t=1040771 jiffies g=1882453 q=697 ncpus=4) [ 3395.659367][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3395.659818][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3395.660433][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3395.660764][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3395.661735][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3395.662049][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3395.662450][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3395.662856][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3395.663255][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3395.663657][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3395.664057][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3395.664506][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3395.664839][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3395.665241][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3395.665644][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3395.666042][ C1] PKRU: 55555554 [ 3395.666225][ C1] Call Trace: [ 3395.666396][ C1] [ 3395.666547][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3395.666821][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3395.667075][ C1] ? check_cpu_stall+0x284/0x500 [ 3395.667328][ C1] ? rcu_pending+0x92/0x360 [ 3395.667560][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3395.667831][ C1] ? update_process_times+0xb9/0x110 [ 3395.668101][ C1] ? tick_sched_handle+0x67/0x130 [ 3395.668359][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3395.668644][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3395.668888][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3395.669201][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3395.669474][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3395.669765][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3395.670030][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3395.670338][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3395.670601][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3395.670910][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3395.671207][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3395.671522][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3395.671812][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3395.672108][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3395.672398][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3395.672716][ C1] ? get_stack_info+0x36/0xc0 [ 3395.672957][ C1] ? lock_acquire+0x1c1/0x220 [ 3395.673199][ C1] ? lock_release+0x1d5/0x250 [ 3395.673440][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3395.673691][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3395.673963][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3395.674248][ C1] ? lock_acquire+0x1c1/0x220 [ 3395.674488][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3395.674730][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3395.674992][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3395.675228][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3395.675474][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3395.675733][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3395.676013][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3395.676290][ C1] ip_local_deliver+0x19d/0x480 [ 3395.676539][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3395.676814][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3395.677077][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3395.677428][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3395.677681][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3395.678002][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3395.678266][ C1] ip_rcv+0x564/0x740 [ 3395.678471][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3395.678701][ C1] ? set_track_prepare+0x8a/0xd0 [ 3395.678955][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3395.679234][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3395.679507][ C1] ? skb_clone+0x10b/0x330 [ 3395.679735][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3395.680056][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3395.680363][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3395.680646][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3395.680944][ C1] ? __tcf_classify+0x329/0x7d0 [ 3395.681195][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3395.681425][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3395.681726][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3395.682012][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3395.682339][ C1] ? lock_acquire+0x1c1/0x220 [ 3395.682576][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3395.682879][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3395.683166][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3395.683485][ C1] ? __copy_skb_header+0xaf/0x490 [ 3395.683742][ C1] ? __skb_clone+0x57a/0x760 [ 3395.683979][ C1] netif_receive_skb+0x55/0x280 [ 3395.684229][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3395.684545][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3395.684879][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3395.685181][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3395.685457][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3395.685747][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3395.686062][ C1] ? hlock_class+0x4e/0x130 [ 3395.686297][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3395.686575][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3395.686851][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3395.687116][ C1] ? hlock_class+0x4e/0x130 [ 3395.687349][ C1] ? mark_lock+0x38/0x3e0 [ 3395.687569][ C1] ? stack_access_ok+0xda/0x1f0 [ 3395.687819][ C1] ? __lock_acquire+0xb67/0x1610 [ 3395.688074][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3395.688352][ C1] ? get_stack_info+0x36/0xc0 [ 3395.688592][ C1] ? stack_access_ok+0xda/0x1f0 [ 3395.688841][ C1] ? get_reg+0x119/0x190 [ 3395.689060][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3395.689331][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3395.689642][ C1] __tcf_classify+0x329/0x7d0 [ 3395.689885][ C1] tcf_classify+0x283/0x930 [ 3395.690120][ C1] ? arch_stack_walk+0xa2/0x100 [ 3395.690372][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3395.690630][ C1] ? get_stack_info+0x36/0xc0 [ 3395.690872][ C1] tc_run+0x2e4/0x5d0 [ 3395.691080][ C1] ? __pfx_tc_run+0x10/0x10 [ 3395.691311][ C1] ? lock_acquire+0x1c1/0x220 [ 3395.691552][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3395.691815][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3395.692070][ C1] ? lock_acquire+0x1c1/0x220 [ 3395.692316][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3395.692582][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3395.692896][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3395.693170][ C1] ? neigh_hh_output+0x348/0x590 [ 3395.693425][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3395.693691][ C1] ip_finish_output2+0x786/0x18e0 [ 3395.693949][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3395.694228][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3395.694568][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3395.694846][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3395.695101][ C1] ? __ip_finish_output+0x10f/0x770 [ 3395.695369][ C1] ip_output+0x16b/0x4f0 [ 3395.695586][ C1] ? run_timer_softirq+0x72/0x100 [ 3395.695844][ C1] ? __pfx_ip_output+0x10/0x10 [ 3395.696088][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3395.696376][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3395.696629][ C1] ? ip_local_out+0x114/0x3b0 [ 3395.696870][ C1] __ip_queue_xmit+0x672/0x1910 [ 3395.697120][ C1] ? __create_object+0x5e/0xb0 [ 3395.697366][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3395.697634][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3395.697914][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3395.698191][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3395.698473][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3395.698747][ C1] tcp_delack_timer+0x84/0x240 [ 3395.698993][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3395.699265][ C1] call_timer_fn+0x173/0x430 [ 3395.699503][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3395.699765][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3395.700028][ C1] __run_timers.part.0+0x52d/0x890 [ 3395.700288][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3395.700563][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3395.700849][ C1] ? lock_acquire+0x1c1/0x220 [ 3395.701089][ C1] ? clockevents_program_event+0xf6/0x300 [ 3395.701380][ C1] ? lock_release+0x1d5/0x250 [ 3395.701623][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3395.701889][ C1] ? ktime_get+0xb3/0x190 [ 3395.702111][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3395.702409][ C1] run_timer_softirq+0x72/0x100 [ 3395.702662][ C1] __do_softirq+0x1b9/0x7ff [ 3395.702896][ C1] irq_exit_rcu+0x98/0xc0 [ 3395.703118][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3395.703406][ C1] [ 3395.703559][ C1] [ 3395.703709][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3395.704017][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3395.704343][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3395.705318][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3395.705628][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3395.706031][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3395.706430][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3395.706832][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3395.707238][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3395.707640][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3395.707939][ C1] pipe_read+0xa16/0xdf0 [ 3395.708163][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3395.708443][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3395.708686][ C1] ? iterate_tty_write+0x299/0x540 [ 3395.708949][ C1] ? lock_release+0x1d5/0x250 [ 3395.709191][ C1] vfs_read+0x911/0xc00 [ 3395.709407][ C1] ? lock_acquire+0x1c1/0x220 [ 3395.709646][ C1] ? __might_fault+0xc6/0x180 [ 3395.709889][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3395.710132][ C1] ? __might_fault+0xc6/0x180 [ 3395.710371][ C1] ? lock_release+0x1d5/0x250 [ 3395.710612][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3395.710878][ C1] ? __fget_light+0x54/0x1e0 [ 3395.711118][ C1] ksys_read+0x17a/0x1e0 [ 3395.711335][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3395.711581][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3395.711887][ C1] do_syscall_64+0xc9/0x1e0 [ 3395.712122][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3395.712421][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3395.712655][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3395.713636][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3395.714061][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3395.714468][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3395.714869][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3395.715270][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3395.715674][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3395.716081][ C1] [ 3395.716238][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3395.716515][ C2] NMI backtrace for cpu 2 [ 3395.716522][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3395.716528][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3395.716533][ C2] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 3395.716542][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 3395.716548][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000286 [ 3395.716553][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3395.716557][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3395.716560][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3395.716564][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3395.716568][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3395.716572][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3395.716576][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3395.716582][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3395.716586][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3395.716589][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3395.716592][ C2] PKRU: 55555554 [ 3395.716595][ C2] Call Trace: [ 3395.716599][ C2] [ 3395.716604][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3395.716616][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3395.716625][ C2] ? nmi_handle+0x153/0x420 [ 3395.716636][ C2] ? default_do_nmi+0x41/0x100 [ 3395.716643][ C2] ? exc_nmi+0xf3/0x120 [ 3395.716649][ C2] ? end_repeat_nmi+0xf/0x60 [ 3395.716660][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3395.716669][ C2] ? kasan_check_range+0x1b/0x1c0 [ 3395.716677][ C2] ? kasan_check_range+0x1b/0x1c0 [ 3395.716685][ C2] ? kasan_check_range+0x1b/0x1c0 [ 3395.716693][ C2] [ 3395.716695][ C2] [ 3395.716698][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3395.716706][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3395.716712][ C2] ? get_stack_info+0x36/0xc0 [ 3395.716721][ C2] ? lock_acquire+0x1c1/0x220 [ 3395.716729][ C2] ? lock_release+0x1d5/0x250 [ 3395.716738][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3395.716746][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3395.716753][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3395.716761][ C2] ? lock_acquire+0x1c1/0x220 [ 3395.716767][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3395.716776][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3395.716783][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3395.716799][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3395.716806][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3395.716818][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3395.716829][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3395.716837][ C2] ip_local_deliver+0x19d/0x480 [ 3395.716843][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3395.716849][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3395.716855][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3395.716866][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3395.716874][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3395.716881][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3395.716902][ C2] ip_rcv+0x564/0x740 [ 3395.716908][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3395.716914][ C2] ? set_track_prepare+0x8a/0xd0 [ 3395.716923][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3395.716930][ C2] ? start_secondary+0x21c/0x2b0 [ 3395.716937][ C2] ? skb_clone+0x10b/0x330 [ 3395.716943][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3395.716958][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3395.716973][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3395.716981][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3395.717001][ C2] ? __tcf_classify+0x329/0x7d0 [ 3395.717010][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3395.717015][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3395.717023][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3395.717031][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3395.717042][ C2] ? lock_acquire+0x1c1/0x220 [ 3395.717048][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3395.717058][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3395.717067][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3395.717077][ C2] ? __copy_skb_header+0xaf/0x490 [ 3395.717087][ C2] ? __skb_clone+0x57a/0x760 [ 3395.717093][ C2] netif_receive_skb+0x55/0x280 [ 3395.717100][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3395.717119][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3395.717137][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3395.717154][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3395.717166][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3395.717193][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3395.717213][ C2] ? get_stack_info+0x36/0xc0 [ 3395.717225][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3395.717231][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3395.717240][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3395.717246][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3395.717255][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3395.717261][ C2] ? kernel_text_address+0x17/0xe0 [ 3395.717268][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3395.717274][ C2] ? arch_stack_walk+0x8c/0x100 [ 3395.717278][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3395.717281][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3395.717284][ C2] ? lock_acquire+0x1c1/0x220 [ 3395.717287][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3395.717291][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3395.717296][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3395.717299][ C2] ? get_stack_info+0x36/0xc0 [ 3395.717303][ C2] __tcf_classify+0x329/0x7d0 [ 3395.717308][ C2] tcf_classify+0x283/0x930 [ 3395.717312][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3395.717316][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3395.717320][ C2] tc_run+0x2e4/0x5d0 [ 3395.717324][ C2] ? __pfx_tc_run+0x10/0x10 [ 3395.717327][ C2] ? lock_acquire+0x1c1/0x220 [ 3395.717329][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3395.717333][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3395.717337][ C2] ? lock_acquire+0x1c1/0x220 [ 3395.717339][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3395.717342][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3395.717346][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3395.717348][ C2] ? neigh_hh_output+0x348/0x590 [ 3395.717352][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3395.717355][ C2] ip_finish_output2+0x786/0x18e0 [ 3395.717359][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3395.717366][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3395.717369][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3395.717372][ C2] ? __ip_finish_output+0x10f/0x770 [ 3395.717376][ C2] ip_output+0x16b/0x4f0 [ 3395.717379][ C2] ? __pfx_ip_output+0x10/0x10 [ 3395.717382][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3395.717384][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3395.717387][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3395.717390][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3395.717393][ C2] ? __alloc_skb+0xd4/0x280 [ 3395.717395][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3395.717399][ C2] ? tcp_fragment+0x168/0x1040 [ 3395.717402][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3395.717405][ C2] ? ip_local_out+0x114/0x3b0 [ 3395.717409][ C2] __ip_queue_xmit+0x672/0x1910 [ 3395.717412][ C2] ? __skb_clone+0x57a/0x760 [ 3395.717415][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3395.717420][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3395.717423][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3395.717427][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3395.717431][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3395.717435][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3395.717438][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3395.717442][ C2] tcp_send_loss_probe+0x348/0x830 [ 3395.717445][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3395.717447][ C2] tcp_write_timer+0x82/0x1d0 [ 3395.717451][ C2] call_timer_fn+0x173/0x430 [ 3395.717454][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3395.717459][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3395.717463][ C2] __run_timers.part.0+0x52d/0x890 [ 3395.717466][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3395.717470][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3395.717473][ C2] ? lock_acquire+0x1c1/0x220 [ 3395.717475][ C2] ? clockevents_program_event+0xf6/0x300 [ 3395.717478][ C2] ? lock_release+0x1d5/0x250 [ 3395.717481][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3395.717484][ C2] ? ktime_get+0xb3/0x190 [ 3395.717487][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3395.717491][ C2] run_timer_softirq+0x72/0x100 [ 3395.717494][ C2] __do_softirq+0x1b9/0x7ff [ 3395.717499][ C2] irq_exit_rcu+0x98/0xc0 [ 3395.717501][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3395.717504][ C2] [ 3395.717505][ C2] [ 3395.717506][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3395.717510][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3395.717513][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3395.717515][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3395.717517][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3395.717518][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3395.717520][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3395.717521][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3395.717522][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3395.717525][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3395.717528][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3395.717531][ C2] default_idle_call+0x69/0xa0 [ 3395.717534][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3395.717536][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3395.717540][ C2] ? lock_release+0x1d5/0x250 [ 3395.717542][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3395.717546][ C2] do_idle+0xfb/0x160 [ 3395.717548][ C2] cpu_startup_entry+0x55/0x60 [ 3395.717551][ C2] start_secondary+0x21c/0x2b0 [ 3395.717554][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3395.717558][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3395.717564][ C2] [ 3395.717574][ C2] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.052 msecs [ 3420.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 994s! [perl:4135] [ 3420.569696][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3420.570960][ C1] irq event stamp: 209232 [ 3420.571178][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3420.571709][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3420.572190][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3420.572664][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3420.573129][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3420.573577][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3420.574194][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3420.574521][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3420.575496][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3420.575806][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3420.576206][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3420.576605][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3420.577007][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3420.577410][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3420.577811][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3420.578260][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3420.578593][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3420.579001][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3420.579404][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3420.579803][ C1] PKRU: 55555554 [ 3420.579987][ C1] Call Trace: [ 3420.580161][ C1] [ 3420.580310][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3420.580573][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3420.580818][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3420.581095][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3420.581369][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3420.581661][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3420.581928][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3420.582237][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3420.582500][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3420.582817][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3420.583113][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3420.583430][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3420.583723][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3420.584017][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3420.584309][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3420.584622][ C1] ? get_stack_info+0x36/0xc0 [ 3420.584863][ C1] ? lock_acquire+0x1c1/0x220 [ 3420.585106][ C1] ? lock_release+0x1d5/0x250 [ 3420.585348][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3420.585598][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3420.585871][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3420.586158][ C1] ? lock_acquire+0x1c1/0x220 [ 3420.586398][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3420.586641][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3420.586902][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3420.587140][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3420.587387][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3420.587646][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3420.587927][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3420.588206][ C1] ip_local_deliver+0x19d/0x480 [ 3420.588456][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3420.588729][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3420.588994][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3420.589347][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3420.589602][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3420.589927][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3420.590193][ C1] ip_rcv+0x564/0x740 [ 3420.590399][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3420.590631][ C1] ? set_track_prepare+0x8a/0xd0 [ 3420.590886][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3420.591168][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3420.591444][ C1] ? skb_clone+0x10b/0x330 [ 3420.591673][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3420.591994][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3420.592302][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3420.592593][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3420.592891][ C1] ? __tcf_classify+0x329/0x7d0 [ 3420.593144][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3420.593378][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3420.593679][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3420.593968][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3420.594298][ C1] ? lock_acquire+0x1c1/0x220 [ 3420.594539][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3420.594837][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3420.595127][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3420.595446][ C1] ? __copy_skb_header+0xaf/0x490 [ 3420.595706][ C1] ? __skb_clone+0x57a/0x760 [ 3420.595944][ C1] netif_receive_skb+0x55/0x280 [ 3420.596195][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3420.596512][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3420.596848][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3420.597151][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3420.597426][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3420.597717][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3420.598033][ C1] ? hlock_class+0x4e/0x130 [ 3420.598270][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3420.598547][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3420.598825][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3420.599090][ C1] ? hlock_class+0x4e/0x130 [ 3420.599328][ C1] ? mark_lock+0x38/0x3e0 [ 3420.599550][ C1] ? stack_access_ok+0xda/0x1f0 [ 3420.599801][ C1] ? __lock_acquire+0xb67/0x1610 [ 3420.600057][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3420.600337][ C1] ? get_stack_info+0x36/0xc0 [ 3420.600580][ C1] ? stack_access_ok+0xda/0x1f0 [ 3420.600828][ C1] ? get_reg+0x119/0x190 [ 3420.601049][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3420.601319][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3420.601632][ C1] __tcf_classify+0x329/0x7d0 [ 3420.601875][ C1] tcf_classify+0x283/0x930 [ 3420.602112][ C1] ? arch_stack_walk+0xa2/0x100 [ 3420.602365][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3420.602629][ C1] ? get_stack_info+0x36/0xc0 [ 3420.602873][ C1] tc_run+0x2e4/0x5d0 [ 3420.603081][ C1] ? __pfx_tc_run+0x10/0x10 [ 3420.603315][ C1] ? lock_acquire+0x1c1/0x220 [ 3420.603556][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3420.603820][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3420.604076][ C1] ? lock_acquire+0x1c1/0x220 [ 3420.604320][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3420.604587][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3420.604897][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3420.605172][ C1] ? neigh_hh_output+0x348/0x590 [ 3420.605428][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3420.605695][ C1] ip_finish_output2+0x786/0x18e0 [ 3420.605953][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3420.606235][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3420.606577][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3420.606856][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3420.607112][ C1] ? __ip_finish_output+0x10f/0x770 [ 3420.607384][ C1] ip_output+0x16b/0x4f0 [ 3420.607602][ C1] ? run_timer_softirq+0x72/0x100 [ 3420.607861][ C1] ? __pfx_ip_output+0x10/0x10 [ 3420.608108][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3420.608399][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3420.608655][ C1] ? ip_local_out+0x114/0x3b0 [ 3420.608897][ C1] __ip_queue_xmit+0x672/0x1910 [ 3420.609149][ C1] ? __create_object+0x5e/0xb0 [ 3420.609396][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3420.609665][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3420.609950][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3420.610228][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3420.610512][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3420.610784][ C1] tcp_delack_timer+0x84/0x240 [ 3420.611032][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3420.611308][ C1] call_timer_fn+0x173/0x430 [ 3420.611546][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3420.611811][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3420.612073][ C1] __run_timers.part.0+0x52d/0x890 [ 3420.612336][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3420.612623][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3420.612910][ C1] ? lock_acquire+0x1c1/0x220 [ 3420.613152][ C1] ? clockevents_program_event+0xf6/0x300 [ 3420.613442][ C1] ? lock_release+0x1d5/0x250 [ 3420.613684][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3420.613951][ C1] ? ktime_get+0xb3/0x190 [ 3420.614176][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3420.614474][ C1] run_timer_softirq+0x72/0x100 [ 3420.614724][ C1] __do_softirq+0x1b9/0x7ff [ 3420.614960][ C1] irq_exit_rcu+0x98/0xc0 [ 3420.615182][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3420.615469][ C1] [ 3420.615620][ C1] [ 3420.615771][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3420.616078][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3420.616406][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3420.617383][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3420.617697][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3420.618098][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3420.618502][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3420.618904][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3420.619306][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3420.619709][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3420.620010][ C1] pipe_read+0xa16/0xdf0 [ 3420.620231][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3420.620512][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3420.620756][ C1] ? iterate_tty_write+0x299/0x540 [ 3420.621022][ C1] ? lock_release+0x1d5/0x250 [ 3420.621264][ C1] vfs_read+0x911/0xc00 [ 3420.621484][ C1] ? lock_acquire+0x1c1/0x220 [ 3420.621724][ C1] ? __might_fault+0xc6/0x180 [ 3420.621967][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3420.622210][ C1] ? __might_fault+0xc6/0x180 [ 3420.622452][ C1] ? lock_release+0x1d5/0x250 [ 3420.622698][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3420.622966][ C1] ? __fget_light+0x54/0x1e0 [ 3420.623206][ C1] ksys_read+0x17a/0x1e0 [ 3420.623428][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3420.623674][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3420.623983][ C1] do_syscall_64+0xc9/0x1e0 [ 3420.624219][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3420.624522][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3420.624754][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3420.625734][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3420.626160][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3420.626563][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3420.626966][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3420.627368][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3420.627774][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3420.628181][ C1] [ 3420.628339][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 994s! [swapper/2:0] [ 3420.628760][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3420.630014][ C2] irq event stamp: 44114564 [ 3420.630242][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3420.630776][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3420.631287][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3420.631763][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3420.632230][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3420.632690][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3420.633302][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3420.633626][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3420.634594][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3420.634905][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3420.635301][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3420.635698][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3420.636098][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3420.636498][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3420.636895][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3420.637341][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3420.637672][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3420.638073][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3420.638472][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3420.638868][ C2] PKRU: 55555554 [ 3420.639049][ C2] Call Trace: [ 3420.639220][ C2] [ 3420.639366][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3420.639625][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3420.639868][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3420.640144][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3420.640420][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3420.640706][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3420.640970][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3420.641276][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3420.641535][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3420.641797][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3420.642105][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3420.642400][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3420.642719][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3420.643013][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3420.643307][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3420.643594][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3420.643905][ C2] ? get_stack_info+0x36/0xc0 [ 3420.644146][ C2] ? lock_acquire+0x1c1/0x220 [ 3420.644384][ C2] ? lock_release+0x1d5/0x250 [ 3420.644628][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3420.644876][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3420.645147][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3420.645433][ C2] ? lock_acquire+0x1c1/0x220 [ 3420.645670][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3420.645909][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3420.646169][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3420.646403][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3420.646649][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3420.646906][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3420.647181][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3420.647456][ C2] ip_local_deliver+0x19d/0x480 [ 3420.647703][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3420.647974][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3420.648239][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3420.648585][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3420.648838][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3420.649158][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3420.649420][ C2] ip_rcv+0x564/0x740 [ 3420.649623][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3420.649853][ C2] ? set_track_prepare+0x8a/0xd0 [ 3420.650106][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3420.650382][ C2] ? start_secondary+0x21c/0x2b0 [ 3420.650632][ C2] ? skb_clone+0x10b/0x330 [ 3420.650859][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3420.651177][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3420.651483][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3420.651763][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3420.652056][ C2] ? __tcf_classify+0x329/0x7d0 [ 3420.652305][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3420.652534][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3420.652841][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3420.653127][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3420.653450][ C2] ? lock_acquire+0x1c1/0x220 [ 3420.653687][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3420.653984][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3420.654271][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3420.654586][ C2] ? __copy_skb_header+0xaf/0x490 [ 3420.654843][ C2] ? __skb_clone+0x57a/0x760 [ 3420.655076][ C2] netif_receive_skb+0x55/0x280 [ 3420.655323][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3420.655634][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3420.655965][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3420.656267][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3420.656541][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3420.656826][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3420.657138][ C2] ? get_stack_info+0x36/0xc0 [ 3420.657379][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3420.657642][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3420.657958][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3420.658233][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3420.658510][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3420.658822][ C2] ? kernel_text_address+0x17/0xe0 [ 3420.659083][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3420.659395][ C2] ? arch_stack_walk+0x8c/0x100 [ 3420.659643][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3420.659906][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3420.660194][ C2] ? lock_acquire+0x1c1/0x220 [ 3420.660431][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3420.660713][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3420.661018][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3420.661294][ C2] ? get_stack_info+0x36/0xc0 [ 3420.661534][ C2] __tcf_classify+0x329/0x7d0 [ 3420.661775][ C2] tcf_classify+0x283/0x930 [ 3420.662006][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3420.662261][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3420.662580][ C2] tc_run+0x2e4/0x5d0 [ 3420.662785][ C2] ? __pfx_tc_run+0x10/0x10 [ 3420.663016][ C2] ? lock_acquire+0x1c1/0x220 [ 3420.663255][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3420.663516][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3420.663768][ C2] ? lock_acquire+0x1c1/0x220 [ 3420.664004][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3420.664269][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3420.664572][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3420.664842][ C2] ? neigh_hh_output+0x348/0x590 [ 3420.665093][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3420.665359][ C2] ip_finish_output2+0x786/0x18e0 [ 3420.665615][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3420.665951][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3420.666237][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3420.666489][ C2] ? __ip_finish_output+0x10f/0x770 [ 3420.666753][ C2] ip_output+0x16b/0x4f0 [ 3420.666968][ C2] ? __pfx_ip_output+0x10/0x10 [ 3420.667211][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3420.667488][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3420.667798][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3420.668076][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3420.668329][ C2] ? __alloc_skb+0xd4/0x280 [ 3420.668557][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3420.668825][ C2] ? tcp_fragment+0x168/0x1040 [ 3420.669066][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3420.669319][ C2] ? ip_local_out+0x114/0x3b0 [ 3420.669559][ C2] __ip_queue_xmit+0x672/0x1910 [ 3420.669808][ C2] ? __skb_clone+0x57a/0x760 [ 3420.670042][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3420.670309][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3420.670588][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3420.670833][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3420.671082][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3420.671381][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3420.671700][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3420.671942][ C2] tcp_send_loss_probe+0x348/0x830 [ 3420.672202][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3420.672471][ C2] tcp_write_timer+0x82/0x1d0 [ 3420.672714][ C2] call_timer_fn+0x173/0x430 [ 3420.672956][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3420.673218][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3420.673477][ C2] __run_timers.part.0+0x52d/0x890 [ 3420.673736][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3420.674003][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3420.674290][ C2] ? lock_acquire+0x1c1/0x220 [ 3420.674527][ C2] ? clockevents_program_event+0xf6/0x300 [ 3420.674822][ C2] ? lock_release+0x1d5/0x250 [ 3420.675061][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3420.675325][ C2] ? ktime_get+0xb3/0x190 [ 3420.675544][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3420.675841][ C2] run_timer_softirq+0x72/0x100 [ 3420.676088][ C2] __do_softirq+0x1b9/0x7ff [ 3420.676320][ C2] irq_exit_rcu+0x98/0xc0 [ 3420.676541][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3420.676823][ C2] [ 3420.676974][ C2] [ 3420.677124][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3420.677428][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3420.677685][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3420.678651][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3420.678959][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3420.679356][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3420.679752][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3420.680151][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3420.680554][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3420.680953][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3420.681242][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3420.681502][ C2] default_idle_call+0x69/0xa0 [ 3420.681743][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3420.681994][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3420.682274][ C2] ? lock_release+0x1d5/0x250 [ 3420.682510][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3420.682792][ C2] do_idle+0xfb/0x160 [ 3420.682996][ C2] cpu_startup_entry+0x55/0x60 [ 3420.683239][ C2] start_secondary+0x21c/0x2b0 [ 3420.683481][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3420.683751][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3420.684059][ C2] [ 3448.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1020s! [perl:4135] [ 3448.569704][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3448.570968][ C1] irq event stamp: 209232 [ 3448.571188][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3448.571720][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3448.572199][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3448.572675][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3448.573142][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3448.573596][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3448.574210][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3448.574536][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3448.575511][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3448.575819][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3448.576219][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3448.576620][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3448.577020][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3448.577420][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3448.577819][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3448.578269][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3448.578604][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3448.579006][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3448.579406][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3448.579805][ C1] PKRU: 55555554 [ 3448.579987][ C1] Call Trace: [ 3448.580159][ C1] [ 3448.580308][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3448.580570][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3448.580815][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3448.581092][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3448.581369][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3448.581656][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3448.581922][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3448.582231][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3448.582497][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3448.582806][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3448.583103][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3448.583418][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3448.583709][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3448.584010][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3448.584299][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3448.584611][ C1] ? get_stack_info+0x36/0xc0 [ 3448.584853][ C1] ? lock_acquire+0x1c1/0x220 [ 3448.585094][ C1] ? lock_release+0x1d5/0x250 [ 3448.585334][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3448.585584][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3448.585856][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3448.586144][ C1] ? lock_acquire+0x1c1/0x220 [ 3448.586384][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3448.586624][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3448.586885][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3448.587122][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3448.587371][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3448.587629][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3448.587908][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3448.588186][ C1] ip_local_deliver+0x19d/0x480 [ 3448.588433][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3448.588707][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3448.588971][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3448.589318][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3448.589572][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3448.589892][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3448.590156][ C1] ip_rcv+0x564/0x740 [ 3448.590360][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3448.590591][ C1] ? set_track_prepare+0x8a/0xd0 [ 3448.590845][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3448.591121][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3448.591393][ C1] ? skb_clone+0x10b/0x330 [ 3448.591623][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3448.591943][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3448.592254][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3448.592541][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3448.592836][ C1] ? __tcf_classify+0x329/0x7d0 [ 3448.593085][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3448.593318][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3448.593619][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3448.593903][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3448.594234][ C1] ? lock_acquire+0x1c1/0x220 [ 3448.594474][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3448.594770][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3448.595056][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3448.595375][ C1] ? __copy_skb_header+0xaf/0x490 [ 3448.595635][ C1] ? __skb_clone+0x57a/0x760 [ 3448.595871][ C1] netif_receive_skb+0x55/0x280 [ 3448.596119][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3448.596433][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3448.596767][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3448.597072][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3448.597347][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3448.597638][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3448.597951][ C1] ? hlock_class+0x4e/0x130 [ 3448.598186][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3448.598464][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3448.598745][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3448.599009][ C1] ? hlock_class+0x4e/0x130 [ 3448.599241][ C1] ? mark_lock+0x38/0x3e0 [ 3448.599463][ C1] ? stack_access_ok+0xda/0x1f0 [ 3448.599712][ C1] ? __lock_acquire+0xb67/0x1610 [ 3448.599968][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3448.600245][ C1] ? get_stack_info+0x36/0xc0 [ 3448.600487][ C1] ? stack_access_ok+0xda/0x1f0 [ 3448.600736][ C1] ? get_reg+0x119/0x190 [ 3448.600954][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3448.601224][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3448.601535][ C1] __tcf_classify+0x329/0x7d0 [ 3448.601780][ C1] tcf_classify+0x283/0x930 [ 3448.602011][ C1] ? arch_stack_walk+0xa2/0x100 [ 3448.602262][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3448.602528][ C1] ? get_stack_info+0x36/0xc0 [ 3448.602772][ C1] tc_run+0x2e4/0x5d0 [ 3448.602978][ C1] ? __pfx_tc_run+0x10/0x10 [ 3448.603214][ C1] ? lock_acquire+0x1c1/0x220 [ 3448.603454][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3448.603717][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3448.603972][ C1] ? lock_acquire+0x1c1/0x220 [ 3448.604210][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3448.604481][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3448.604787][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3448.605061][ C1] ? neigh_hh_output+0x348/0x590 [ 3448.605315][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3448.605584][ C1] ip_finish_output2+0x786/0x18e0 [ 3448.605842][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3448.606124][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3448.606463][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3448.606741][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3448.606994][ C1] ? __ip_finish_output+0x10f/0x770 [ 3448.607260][ C1] ip_output+0x16b/0x4f0 [ 3448.607480][ C1] ? run_timer_softirq+0x72/0x100 [ 3448.607738][ C1] ? __pfx_ip_output+0x10/0x10 [ 3448.607983][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3448.608270][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3448.608525][ C1] ? ip_local_out+0x114/0x3b0 [ 3448.608767][ C1] __ip_queue_xmit+0x672/0x1910 [ 3448.609016][ C1] ? __create_object+0x5e/0xb0 [ 3448.609261][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3448.609531][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3448.609815][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3448.610089][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3448.610373][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3448.610647][ C1] tcp_delack_timer+0x84/0x240 [ 3448.610893][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3448.611166][ C1] call_timer_fn+0x173/0x430 [ 3448.611404][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3448.611667][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3448.611930][ C1] __run_timers.part.0+0x52d/0x890 [ 3448.612192][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3448.612471][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3448.612755][ C1] ? lock_acquire+0x1c1/0x220 [ 3448.612997][ C1] ? clockevents_program_event+0xf6/0x300 [ 3448.613291][ C1] ? lock_release+0x1d5/0x250 [ 3448.613529][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3448.613796][ C1] ? ktime_get+0xb3/0x190 [ 3448.614018][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3448.614318][ C1] run_timer_softirq+0x72/0x100 [ 3448.614565][ C1] __do_softirq+0x1b9/0x7ff [ 3448.614799][ C1] irq_exit_rcu+0x98/0xc0 [ 3448.615021][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3448.615309][ C1] [ 3448.615460][ C1] [ 3448.615614][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3448.615918][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3448.616249][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3448.617230][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3448.617539][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3448.617942][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3448.618342][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3448.618743][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3448.619144][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3448.619549][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3448.619846][ C1] pipe_read+0xa16/0xdf0 [ 3448.620070][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3448.620350][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3448.620597][ C1] ? iterate_tty_write+0x299/0x540 [ 3448.620860][ C1] ? lock_release+0x1d5/0x250 [ 3448.621104][ C1] vfs_read+0x911/0xc00 [ 3448.621319][ C1] ? lock_acquire+0x1c1/0x220 [ 3448.621561][ C1] ? __might_fault+0xc6/0x180 [ 3448.621805][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3448.622046][ C1] ? __might_fault+0xc6/0x180 [ 3448.622290][ C1] ? lock_release+0x1d5/0x250 [ 3448.622537][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3448.622806][ C1] ? __fget_light+0x54/0x1e0 [ 3448.623044][ C1] ksys_read+0x17a/0x1e0 [ 3448.623263][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3448.623510][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3448.623815][ C1] do_syscall_64+0xc9/0x1e0 [ 3448.624049][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3448.624353][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3448.624580][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3448.625558][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3448.625982][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3448.626384][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3448.626786][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3448.627188][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3448.627588][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3448.627992][ C1] [ 3448.628154][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1020s! [swapper/2:0] [ 3448.628580][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3448.629833][ C2] irq event stamp: 44114564 [ 3448.630063][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3448.630596][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3448.631106][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3448.631586][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3448.632057][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3448.632518][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3448.633129][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3448.633453][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3448.634418][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3448.634725][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3448.635122][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3448.635518][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3448.635917][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3448.636315][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3448.636712][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3448.637159][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3448.637490][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3448.637890][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3448.638288][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3448.638685][ C2] PKRU: 55555554 [ 3448.638867][ C2] Call Trace: [ 3448.639037][ C2] [ 3448.639186][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3448.639447][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3448.639689][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3448.639964][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3448.640235][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3448.640524][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3448.640788][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3448.641092][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3448.641354][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3448.641615][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3448.641923][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3448.642216][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3448.642535][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3448.642825][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3448.643117][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3448.643410][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3448.643721][ C2] ? get_stack_info+0x36/0xc0 [ 3448.643959][ C2] ? lock_acquire+0x1c1/0x220 [ 3448.644200][ C2] ? lock_release+0x1d5/0x250 [ 3448.644439][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3448.644687][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3448.644958][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3448.645243][ C2] ? lock_acquire+0x1c1/0x220 [ 3448.645480][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3448.645720][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3448.645979][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3448.646214][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3448.646461][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3448.646718][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3448.646991][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3448.647268][ C2] ip_local_deliver+0x19d/0x480 [ 3448.647515][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3448.647783][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3448.648045][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3448.648396][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3448.648647][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3448.648966][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3448.649228][ C2] ip_rcv+0x564/0x740 [ 3448.649431][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3448.649660][ C2] ? set_track_prepare+0x8a/0xd0 [ 3448.649911][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3448.650189][ C2] ? start_secondary+0x21c/0x2b0 [ 3448.650439][ C2] ? skb_clone+0x10b/0x330 [ 3448.650664][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3448.650982][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3448.651289][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3448.651567][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3448.651863][ C2] ? __tcf_classify+0x329/0x7d0 [ 3448.652112][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3448.652340][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3448.652644][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3448.652927][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3448.653252][ C2] ? lock_acquire+0x1c1/0x220 [ 3448.653489][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3448.653786][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3448.654069][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3448.654385][ C2] ? __copy_skb_header+0xaf/0x490 [ 3448.654641][ C2] ? __skb_clone+0x57a/0x760 [ 3448.654876][ C2] netif_receive_skb+0x55/0x280 [ 3448.655124][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3448.655436][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3448.655766][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3448.656060][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3448.656337][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3448.656623][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3448.656934][ C2] ? get_stack_info+0x36/0xc0 [ 3448.657176][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3448.657438][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3448.657753][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3448.658027][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3448.658302][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3448.658615][ C2] ? kernel_text_address+0x17/0xe0 [ 3448.658874][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3448.659187][ C2] ? arch_stack_walk+0x8c/0x100 [ 3448.659434][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3448.659697][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3448.659983][ C2] ? lock_acquire+0x1c1/0x220 [ 3448.660220][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3448.660504][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3448.660806][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3448.661081][ C2] ? get_stack_info+0x36/0xc0 [ 3448.661322][ C2] __tcf_classify+0x329/0x7d0 [ 3448.661563][ C2] tcf_classify+0x283/0x930 [ 3448.661797][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3448.662051][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3448.662365][ C2] tc_run+0x2e4/0x5d0 [ 3448.662580][ C2] ? __pfx_tc_run+0x10/0x10 [ 3448.662813][ C2] ? lock_acquire+0x1c1/0x220 [ 3448.663049][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3448.663310][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3448.663562][ C2] ? lock_acquire+0x1c1/0x220 [ 3448.663801][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3448.664063][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3448.664367][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3448.664637][ C2] ? neigh_hh_output+0x348/0x590 [ 3448.664887][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3448.665151][ C2] ip_finish_output2+0x786/0x18e0 [ 3448.665406][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3448.665742][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3448.666018][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3448.666271][ C2] ? __ip_finish_output+0x10f/0x770 [ 3448.666534][ C2] ip_output+0x16b/0x4f0 [ 3448.666749][ C2] ? __pfx_ip_output+0x10/0x10 [ 3448.666991][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3448.667266][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3448.667577][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3448.667853][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3448.668104][ C2] ? __alloc_skb+0xd4/0x280 [ 3448.668335][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3448.668601][ C2] ? tcp_fragment+0x168/0x1040 [ 3448.668845][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3448.669095][ C2] ? ip_local_out+0x114/0x3b0 [ 3448.669336][ C2] __ip_queue_xmit+0x672/0x1910 [ 3448.669583][ C2] ? __skb_clone+0x57a/0x760 [ 3448.669815][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3448.670081][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3448.670362][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3448.670609][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3448.670856][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3448.671160][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3448.671479][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3448.671721][ C2] tcp_send_loss_probe+0x348/0x830 [ 3448.671980][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3448.672248][ C2] tcp_write_timer+0x82/0x1d0 [ 3448.672495][ C2] call_timer_fn+0x173/0x430 [ 3448.672731][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3448.672992][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3448.673252][ C2] __run_timers.part.0+0x52d/0x890 [ 3448.673511][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3448.673779][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3448.674062][ C2] ? lock_acquire+0x1c1/0x220 [ 3448.674301][ C2] ? clockevents_program_event+0xf6/0x300 [ 3448.674591][ C2] ? lock_release+0x1d5/0x250 [ 3448.674829][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3448.675092][ C2] ? ktime_get+0xb3/0x190 [ 3448.675312][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3448.675608][ C2] run_timer_softirq+0x72/0x100 [ 3448.675859][ C2] __do_softirq+0x1b9/0x7ff [ 3448.676089][ C2] irq_exit_rcu+0x98/0xc0 [ 3448.676310][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3448.676593][ C2] [ 3448.676743][ C2] [ 3448.676894][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3448.677199][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3448.677455][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3448.678420][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3448.678727][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3448.679125][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3448.679522][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3448.679917][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3448.680318][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3448.680719][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3448.681006][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3448.681267][ C2] default_idle_call+0x69/0xa0 [ 3448.681510][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3448.681760][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3448.682034][ C2] ? lock_release+0x1d5/0x250 [ 3448.682274][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3448.682551][ C2] do_idle+0xfb/0x160 [ 3448.682757][ C2] cpu_startup_entry+0x55/0x60 [ 3448.682996][ C2] start_secondary+0x21c/0x2b0 [ 3448.683241][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3448.683508][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3448.683819][ C2] [ 3473.721103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3473.721476][ C1] rcu: 1-....: (1116534 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=273354 [ 3473.722032][ C1] rcu: (t=1118834 jiffies g=1882453 q=700 ncpus=4) [ 3473.722373][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3473.722825][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3473.723442][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3473.723771][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3473.724747][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3473.725059][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3473.725459][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3473.725861][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3473.726262][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3473.726663][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3473.727063][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3473.727512][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3473.727849][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3473.728251][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3473.728651][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3473.729053][ C1] PKRU: 55555554 [ 3473.729234][ C1] Call Trace: [ 3473.729409][ C1] [ 3473.729557][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3473.729838][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3473.730091][ C1] ? check_cpu_stall+0x284/0x500 [ 3473.730343][ C1] ? rcu_pending+0x92/0x360 [ 3473.730575][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3473.730845][ C1] ? update_process_times+0xb9/0x110 [ 3473.731116][ C1] ? tick_sched_handle+0x67/0x130 [ 3473.731377][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3473.731664][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3473.731909][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3473.732224][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3473.732505][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3473.732793][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3473.733061][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3473.733370][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3473.733633][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3473.733945][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3473.734245][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3473.734562][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3473.734854][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3473.735153][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3473.735443][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3473.735757][ C1] ? get_stack_info+0x36/0xc0 [ 3473.735999][ C1] ? lock_acquire+0x1c1/0x220 [ 3473.736242][ C1] ? lock_release+0x1d5/0x250 [ 3473.736486][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3473.736737][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3473.737011][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3473.737298][ C1] ? lock_acquire+0x1c1/0x220 [ 3473.737539][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3473.737779][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3473.738042][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3473.738278][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3473.738527][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3473.738786][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3473.739065][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3473.739344][ C1] ip_local_deliver+0x19d/0x480 [ 3473.739591][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3473.739867][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3473.740133][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3473.740482][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3473.740736][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3473.741059][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3473.741325][ C1] ip_rcv+0x564/0x740 [ 3473.741529][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3473.741763][ C1] ? set_track_prepare+0x8a/0xd0 [ 3473.742018][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3473.742303][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3473.742576][ C1] ? skb_clone+0x10b/0x330 [ 3473.742808][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3473.743130][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3473.743440][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3473.743721][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3473.744017][ C1] ? __tcf_classify+0x329/0x7d0 [ 3473.744267][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3473.744499][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3473.744803][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3473.745088][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3473.745414][ C1] ? lock_acquire+0x1c1/0x220 [ 3473.745655][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3473.745954][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3473.746240][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3473.746559][ C1] ? __copy_skb_header+0xaf/0x490 [ 3473.746819][ C1] ? __skb_clone+0x57a/0x760 [ 3473.747056][ C1] netif_receive_skb+0x55/0x280 [ 3473.747304][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3473.747617][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3473.747952][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3473.748254][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3473.748528][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3473.748821][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3473.749135][ C1] ? hlock_class+0x4e/0x130 [ 3473.749368][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3473.749645][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3473.749927][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3473.750193][ C1] ? hlock_class+0x4e/0x130 [ 3473.750425][ C1] ? mark_lock+0x38/0x3e0 [ 3473.750646][ C1] ? stack_access_ok+0xda/0x1f0 [ 3473.750896][ C1] ? __lock_acquire+0xb67/0x1610 [ 3473.751152][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3473.751428][ C1] ? get_stack_info+0x36/0xc0 [ 3473.751670][ C1] ? stack_access_ok+0xda/0x1f0 [ 3473.751918][ C1] ? get_reg+0x119/0x190 [ 3473.752134][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3473.752417][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3473.752730][ C1] __tcf_classify+0x329/0x7d0 [ 3473.752974][ C1] tcf_classify+0x283/0x930 [ 3473.753209][ C1] ? arch_stack_walk+0xa2/0x100 [ 3473.753457][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3473.753716][ C1] ? get_stack_info+0x36/0xc0 [ 3473.753960][ C1] tc_run+0x2e4/0x5d0 [ 3473.754168][ C1] ? __pfx_tc_run+0x10/0x10 [ 3473.754401][ C1] ? lock_acquire+0x1c1/0x220 [ 3473.754642][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3473.754904][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3473.755159][ C1] ? lock_acquire+0x1c1/0x220 [ 3473.755398][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3473.755665][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3473.755973][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3473.756248][ C1] ? neigh_hh_output+0x348/0x590 [ 3473.756500][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3473.756768][ C1] ip_finish_output2+0x786/0x18e0 [ 3473.757026][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3473.757306][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3473.757645][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3473.757921][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3473.758175][ C1] ? __ip_finish_output+0x10f/0x770 [ 3473.758443][ C1] ip_output+0x16b/0x4f0 [ 3473.758662][ C1] ? run_timer_softirq+0x72/0x100 [ 3473.758925][ C1] ? __pfx_ip_output+0x10/0x10 [ 3473.759170][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3473.759458][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3473.759711][ C1] ? ip_local_out+0x114/0x3b0 [ 3473.759954][ C1] __ip_queue_xmit+0x672/0x1910 [ 3473.760205][ C1] ? __create_object+0x5e/0xb0 [ 3473.760449][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3473.760718][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3473.761001][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3473.761274][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3473.761559][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3473.761833][ C1] tcp_delack_timer+0x84/0x240 [ 3473.762079][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3473.762359][ C1] call_timer_fn+0x173/0x430 [ 3473.762596][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3473.762859][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3473.763121][ C1] __run_timers.part.0+0x52d/0x890 [ 3473.763387][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3473.763662][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3473.763947][ C1] ? lock_acquire+0x1c1/0x220 [ 3473.764189][ C1] ? clockevents_program_event+0xf6/0x300 [ 3473.764480][ C1] ? lock_release+0x1d5/0x250 [ 3473.764719][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3473.764986][ C1] ? ktime_get+0xb3/0x190 [ 3473.765207][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3473.765506][ C1] run_timer_softirq+0x72/0x100 [ 3473.765754][ C1] __do_softirq+0x1b9/0x7ff [ 3473.765988][ C1] irq_exit_rcu+0x98/0xc0 [ 3473.766210][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3473.766497][ C1] [ 3473.766647][ C1] [ 3473.766800][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3473.767105][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3473.767432][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3473.768408][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3473.768716][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3473.769117][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3473.769518][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3473.769917][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3473.770317][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3473.770720][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3473.771015][ C1] pipe_read+0xa16/0xdf0 [ 3473.771240][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3473.771519][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3473.771764][ C1] ? iterate_tty_write+0x299/0x540 [ 3473.772027][ C1] ? lock_release+0x1d5/0x250 [ 3473.772271][ C1] vfs_read+0x911/0xc00 [ 3473.772492][ C1] ? lock_acquire+0x1c1/0x220 [ 3473.772733][ C1] ? __might_fault+0xc6/0x180 [ 3473.772976][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3473.773216][ C1] ? __might_fault+0xc6/0x180 [ 3473.773458][ C1] ? lock_release+0x1d5/0x250 [ 3473.773701][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3473.773969][ C1] ? __fget_light+0x54/0x1e0 [ 3473.774209][ C1] ksys_read+0x17a/0x1e0 [ 3473.774427][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3473.774674][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3473.774980][ C1] do_syscall_64+0xc9/0x1e0 [ 3473.775213][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3473.775515][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3473.775743][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3473.776721][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3473.777145][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3473.777546][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3473.777948][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3473.778349][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3473.778748][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3473.779151][ C1] [ 3473.779311][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3473.779587][ C2] NMI backtrace for cpu 2 [ 3473.779593][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3473.779599][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3473.779603][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3473.779611][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3473.779617][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3473.779620][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3473.779621][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3473.779623][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3473.779624][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3473.779626][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3473.779628][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3473.779629][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3473.779633][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3473.779634][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3473.779636][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3473.779637][ C2] PKRU: 55555554 [ 3473.779638][ C2] Call Trace: [ 3473.779641][ C2] [ 3473.779643][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3473.779650][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3473.779655][ C2] ? nmi_handle+0x153/0x420 [ 3473.779660][ C2] ? default_do_nmi+0x41/0x100 [ 3473.779663][ C2] ? exc_nmi+0xf3/0x120 [ 3473.779666][ C2] ? end_repeat_nmi+0xf/0x60 [ 3473.779670][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3473.779674][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3473.779677][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3473.779680][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3473.779683][ C2] [ 3473.779684][ C2] [ 3473.779685][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3473.779688][ C2] ? get_stack_info+0x36/0xc0 [ 3473.779691][ C2] ? lock_acquire+0x1c1/0x220 [ 3473.779695][ C2] ? lock_release+0x1d5/0x250 [ 3473.779698][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3473.779702][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3473.779704][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3473.779708][ C2] ? lock_acquire+0x1c1/0x220 [ 3473.779710][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3473.779714][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3473.779717][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3473.779723][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3473.779726][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3473.779730][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3473.779735][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3473.779738][ C2] ip_local_deliver+0x19d/0x480 [ 3473.779741][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3473.779743][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3473.779745][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3473.779751][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3473.779754][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3473.779757][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3473.779766][ C2] ip_rcv+0x564/0x740 [ 3473.779768][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3473.779771][ C2] ? set_track_prepare+0x8a/0xd0 [ 3473.779775][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3473.779778][ C2] ? start_secondary+0x21c/0x2b0 [ 3473.779781][ C2] ? skb_clone+0x10b/0x330 [ 3473.779784][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3473.779789][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3473.779795][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3473.779799][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3473.779807][ C2] ? __tcf_classify+0x329/0x7d0 [ 3473.779811][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3473.779813][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3473.779816][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3473.779820][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3473.779824][ C2] ? lock_acquire+0x1c1/0x220 [ 3473.779827][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3473.779831][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3473.779834][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3473.779838][ C2] ? __copy_skb_header+0xaf/0x490 [ 3473.779842][ C2] ? __skb_clone+0x57a/0x760 [ 3473.779845][ C2] netif_receive_skb+0x55/0x280 [ 3473.779848][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3473.779855][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3473.779862][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3473.779868][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3473.779873][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3473.779883][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3473.779890][ C2] ? get_stack_info+0x36/0xc0 [ 3473.779895][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3473.779898][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3473.779901][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3473.779903][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3473.779907][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3473.779909][ C2] ? kernel_text_address+0x17/0xe0 [ 3473.779912][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3473.779916][ C2] ? arch_stack_walk+0x8c/0x100 [ 3473.779919][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3473.779922][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3473.779925][ C2] ? lock_acquire+0x1c1/0x220 [ 3473.779927][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3473.779931][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3473.779935][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3473.779938][ C2] ? get_stack_info+0x36/0xc0 [ 3473.779942][ C2] __tcf_classify+0x329/0x7d0 [ 3473.779947][ C2] tcf_classify+0x283/0x930 [ 3473.779951][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3473.779954][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3473.779959][ C2] tc_run+0x2e4/0x5d0 [ 3473.779962][ C2] ? __pfx_tc_run+0x10/0x10 [ 3473.779965][ C2] ? lock_acquire+0x1c1/0x220 [ 3473.779967][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3473.779971][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3473.779975][ C2] ? lock_acquire+0x1c1/0x220 [ 3473.779977][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3473.779980][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3473.779983][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3473.779986][ C2] ? neigh_hh_output+0x348/0x590 [ 3473.779990][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3473.779993][ C2] ip_finish_output2+0x786/0x18e0 [ 3473.779997][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3473.780004][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3473.780007][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3473.780011][ C2] ? __ip_finish_output+0x10f/0x770 [ 3473.780014][ C2] ip_output+0x16b/0x4f0 [ 3473.780018][ C2] ? __pfx_ip_output+0x10/0x10 [ 3473.780020][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3473.780023][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3473.780026][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3473.780029][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3473.780031][ C2] ? __alloc_skb+0xd4/0x280 [ 3473.780033][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3473.780038][ C2] ? tcp_fragment+0x168/0x1040 [ 3473.780041][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3473.780044][ C2] ? ip_local_out+0x114/0x3b0 [ 3473.780047][ C2] __ip_queue_xmit+0x672/0x1910 [ 3473.780051][ C2] ? __skb_clone+0x57a/0x760 [ 3473.780054][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3473.780059][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3473.780062][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3473.780066][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3473.780070][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3473.780074][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3473.780077][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3473.780080][ C2] tcp_send_loss_probe+0x348/0x830 [ 3473.780084][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3473.780086][ C2] tcp_write_timer+0x82/0x1d0 [ 3473.780090][ C2] call_timer_fn+0x173/0x430 [ 3473.780093][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3473.780098][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3473.780101][ C2] __run_timers.part.0+0x52d/0x890 [ 3473.780104][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3473.780108][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3473.780111][ C2] ? lock_acquire+0x1c1/0x220 [ 3473.780114][ C2] ? clockevents_program_event+0xf6/0x300 [ 3473.780118][ C2] ? lock_release+0x1d5/0x250 [ 3473.780120][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3473.780123][ C2] ? ktime_get+0xb3/0x190 [ 3473.780127][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3473.780131][ C2] run_timer_softirq+0x72/0x100 [ 3473.780135][ C2] __do_softirq+0x1b9/0x7ff [ 3473.780139][ C2] irq_exit_rcu+0x98/0xc0 [ 3473.780142][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3473.780145][ C2] [ 3473.780147][ C2] [ 3473.780148][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3473.780152][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3473.780155][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3473.780157][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3473.780159][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3473.780161][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3473.780162][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3473.780163][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3473.780165][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3473.780167][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3473.780171][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3473.780174][ C2] default_idle_call+0x69/0xa0 [ 3473.780177][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3473.780179][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3473.780183][ C2] ? lock_release+0x1d5/0x250 [ 3473.780185][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3473.780189][ C2] do_idle+0xfb/0x160 [ 3473.780191][ C2] cpu_startup_entry+0x55/0x60 [ 3473.780194][ C2] start_secondary+0x21c/0x2b0 [ 3473.780196][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3473.780200][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3473.780206][ C2] [ 3500.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1069s! [swapper/2:0] [ 3500.569688][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3500.570937][ C2] irq event stamp: 44114564 [ 3500.571164][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3500.571699][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3500.572218][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3500.572690][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3500.573158][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3500.573614][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3500.574223][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3500.574546][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3500.575511][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3500.575818][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3500.576217][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3500.576616][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3500.577013][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3500.577410][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3500.577805][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3500.578251][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3500.578583][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3500.578982][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3500.579377][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3500.579774][ C2] PKRU: 55555554 [ 3500.579954][ C2] Call Trace: [ 3500.580126][ C2] [ 3500.580273][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3500.580534][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3500.580778][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3500.581053][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3500.581328][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3500.581613][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3500.581876][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3500.582199][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3500.582459][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3500.582719][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3500.583028][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3500.583324][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3500.583638][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3500.583925][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3500.584220][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3500.584506][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3500.584818][ C2] ? get_stack_info+0x36/0xc0 [ 3500.585059][ C2] ? lock_acquire+0x1c1/0x220 [ 3500.585299][ C2] ? lock_release+0x1d5/0x250 [ 3500.585536][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3500.585784][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3500.586055][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3500.586342][ C2] ? lock_acquire+0x1c1/0x220 [ 3500.586580][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3500.586817][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3500.587078][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3500.587313][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3500.587559][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3500.587816][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3500.588089][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3500.588366][ C2] ip_local_deliver+0x19d/0x480 [ 3500.588610][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3500.588883][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3500.589146][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3500.589492][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3500.589745][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3500.590062][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3500.590324][ C2] ip_rcv+0x564/0x740 [ 3500.590526][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3500.590758][ C2] ? set_track_prepare+0x8a/0xd0 [ 3500.591010][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3500.591286][ C2] ? start_secondary+0x21c/0x2b0 [ 3500.591537][ C2] ? skb_clone+0x10b/0x330 [ 3500.591763][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3500.592080][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3500.592392][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3500.592674][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3500.592965][ C2] ? __tcf_classify+0x329/0x7d0 [ 3500.593214][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3500.593444][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3500.593740][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3500.594026][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3500.594350][ C2] ? lock_acquire+0x1c1/0x220 [ 3500.594588][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3500.594881][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3500.595168][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3500.595482][ C2] ? __copy_skb_header+0xaf/0x490 [ 3500.595739][ C2] ? __skb_clone+0x57a/0x760 [ 3500.595970][ C2] netif_receive_skb+0x55/0x280 [ 3500.596219][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3500.596529][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3500.596859][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3500.597158][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3500.597430][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3500.597716][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3500.598028][ C2] ? get_stack_info+0x36/0xc0 [ 3500.598268][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3500.598532][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3500.598848][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3500.599127][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3500.599404][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3500.599718][ C2] ? kernel_text_address+0x17/0xe0 [ 3500.599976][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3500.600288][ C2] ? arch_stack_walk+0x8c/0x100 [ 3500.600535][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3500.600799][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3500.601083][ C2] ? lock_acquire+0x1c1/0x220 [ 3500.601323][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3500.601603][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3500.601907][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3500.602188][ C2] ? get_stack_info+0x36/0xc0 [ 3500.602429][ C2] __tcf_classify+0x329/0x7d0 [ 3500.602669][ C2] tcf_classify+0x283/0x930 [ 3500.602899][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3500.603153][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3500.603465][ C2] tc_run+0x2e4/0x5d0 [ 3500.603669][ C2] ? __pfx_tc_run+0x10/0x10 [ 3500.603901][ C2] ? lock_acquire+0x1c1/0x220 [ 3500.604140][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3500.604401][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3500.604653][ C2] ? lock_acquire+0x1c1/0x220 [ 3500.604891][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3500.605157][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3500.605456][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3500.605733][ C2] ? neigh_hh_output+0x348/0x590 [ 3500.605983][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3500.606248][ C2] ip_finish_output2+0x786/0x18e0 [ 3500.606504][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3500.606839][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3500.607114][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3500.607366][ C2] ? __ip_finish_output+0x10f/0x770 [ 3500.607628][ C2] ip_output+0x16b/0x4f0 [ 3500.607845][ C2] ? __pfx_ip_output+0x10/0x10 [ 3500.608085][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3500.608363][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3500.608674][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3500.608950][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3500.609202][ C2] ? __alloc_skb+0xd4/0x280 [ 3500.609430][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3500.609700][ C2] ? tcp_fragment+0x168/0x1040 [ 3500.609942][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3500.610192][ C2] ? ip_local_out+0x114/0x3b0 [ 3500.610432][ C2] __ip_queue_xmit+0x672/0x1910 [ 3500.610679][ C2] ? __skb_clone+0x57a/0x760 [ 3500.610913][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3500.611180][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3500.611458][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3500.611702][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3500.611951][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3500.612271][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3500.612589][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3500.612830][ C2] tcp_send_loss_probe+0x348/0x830 [ 3500.613091][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3500.613361][ C2] tcp_write_timer+0x82/0x1d0 [ 3500.613597][ C2] call_timer_fn+0x173/0x430 [ 3500.613835][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3500.614094][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3500.614355][ C2] __run_timers.part.0+0x52d/0x890 [ 3500.614612][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3500.614881][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3500.615166][ C2] ? lock_acquire+0x1c1/0x220 [ 3500.615403][ C2] ? clockevents_program_event+0xf6/0x300 [ 3500.615692][ C2] ? lock_release+0x1d5/0x250 [ 3500.615931][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3500.616194][ C2] ? ktime_get+0xb3/0x190 [ 3500.616413][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3500.616708][ C2] run_timer_softirq+0x72/0x100 [ 3500.616956][ C2] __do_softirq+0x1b9/0x7ff [ 3500.617188][ C2] irq_exit_rcu+0x98/0xc0 [ 3500.617407][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3500.617690][ C2] [ 3500.617841][ C2] [ 3500.617989][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3500.618294][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3500.618550][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3500.619515][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3500.619822][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3500.620218][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3500.620614][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3500.621012][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3500.621410][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3500.621807][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3500.622095][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3500.622365][ C2] default_idle_call+0x69/0xa0 [ 3500.622607][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3500.622856][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3500.623135][ C2] ? lock_release+0x1d5/0x250 [ 3500.623373][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3500.623646][ C2] do_idle+0xfb/0x160 [ 3500.623849][ C2] cpu_startup_entry+0x55/0x60 [ 3500.624091][ C2] start_secondary+0x21c/0x2b0 [ 3500.624334][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3500.624603][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3500.624911][ C2] [ 3500.625068][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1069s! [perl:4135] [ 3500.625495][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3500.626766][ C1] irq event stamp: 209232 [ 3500.626988][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3500.627520][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3500.627999][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3500.628471][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3500.628936][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3500.629388][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3500.630003][ C1] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 3500.630299][ C1] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 3500.631270][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000246 [ 3500.631580][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 3500.631984][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3500.632394][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 3500.632796][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3500.633196][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3500.633593][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3500.634040][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3500.634372][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3500.634776][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3500.635175][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3500.635573][ C1] PKRU: 55555554 [ 3500.635756][ C1] Call Trace: [ 3500.635929][ C1] [ 3500.636078][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3500.636339][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3500.636583][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3500.636859][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3500.637134][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3500.637422][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3500.637686][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3500.637993][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3500.638252][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 3500.638518][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3500.638829][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3500.639127][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3500.639442][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3500.639734][ C1] ? kasan_check_range+0x158/0x1c0 [ 3500.639995][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3500.640275][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3500.640587][ C1] ? get_stack_info+0x36/0xc0 [ 3500.640828][ C1] ? lock_acquire+0x1c1/0x220 [ 3500.641072][ C1] ? lock_release+0x1d5/0x250 [ 3500.641312][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3500.641560][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3500.641835][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3500.642121][ C1] ? lock_acquire+0x1c1/0x220 [ 3500.642367][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3500.642608][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3500.642869][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3500.643103][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3500.643352][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3500.643610][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3500.643887][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3500.644167][ C1] ip_local_deliver+0x19d/0x480 [ 3500.644415][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3500.644688][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3500.644952][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3500.645299][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3500.645555][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3500.645874][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3500.646140][ C1] ip_rcv+0x564/0x740 [ 3500.646343][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3500.646575][ C1] ? set_track_prepare+0x8a/0xd0 [ 3500.646830][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3500.647107][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3500.647381][ C1] ? skb_clone+0x10b/0x330 [ 3500.647609][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3500.647929][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3500.648237][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3500.648519][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3500.648816][ C1] ? __tcf_classify+0x329/0x7d0 [ 3500.649066][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3500.649297][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3500.649599][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3500.649884][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3500.650212][ C1] ? lock_acquire+0x1c1/0x220 [ 3500.650451][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3500.650751][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3500.651037][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3500.651356][ C1] ? __copy_skb_header+0xaf/0x490 [ 3500.651615][ C1] ? __skb_clone+0x57a/0x760 [ 3500.651851][ C1] netif_receive_skb+0x55/0x280 [ 3500.652100][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3500.652420][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3500.652753][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3500.653052][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3500.653326][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3500.653616][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3500.653928][ C1] ? hlock_class+0x4e/0x130 [ 3500.654161][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3500.654437][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3500.654713][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3500.654978][ C1] ? hlock_class+0x4e/0x130 [ 3500.655209][ C1] ? mark_lock+0x38/0x3e0 [ 3500.655429][ C1] ? stack_access_ok+0xda/0x1f0 [ 3500.655678][ C1] ? __lock_acquire+0xb67/0x1610 [ 3500.655932][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3500.656209][ C1] ? get_stack_info+0x36/0xc0 [ 3500.656449][ C1] ? stack_access_ok+0xda/0x1f0 [ 3500.656697][ C1] ? get_reg+0x119/0x190 [ 3500.656912][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3500.657180][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3500.657492][ C1] __tcf_classify+0x329/0x7d0 [ 3500.657735][ C1] tcf_classify+0x283/0x930 [ 3500.657968][ C1] ? arch_stack_walk+0xa2/0x100 [ 3500.658216][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3500.658474][ C1] ? get_stack_info+0x36/0xc0 [ 3500.658714][ C1] tc_run+0x2e4/0x5d0 [ 3500.658917][ C1] ? __pfx_tc_run+0x10/0x10 [ 3500.659151][ C1] ? lock_acquire+0x1c1/0x220 [ 3500.659390][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3500.659652][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3500.659906][ C1] ? lock_acquire+0x1c1/0x220 [ 3500.660144][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3500.660409][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3500.660712][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3500.660988][ C1] ? neigh_hh_output+0x348/0x590 [ 3500.661242][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3500.661508][ C1] ip_finish_output2+0x786/0x18e0 [ 3500.661765][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3500.662042][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3500.662386][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3500.662664][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3500.662916][ C1] ? __ip_finish_output+0x10f/0x770 [ 3500.663183][ C1] ip_output+0x16b/0x4f0 [ 3500.663401][ C1] ? run_timer_softirq+0x72/0x100 [ 3500.663659][ C1] ? __pfx_ip_output+0x10/0x10 [ 3500.663903][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3500.664189][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3500.664441][ C1] ? ip_local_out+0x114/0x3b0 [ 3500.664683][ C1] __ip_queue_xmit+0x672/0x1910 [ 3500.664935][ C1] ? __create_object+0x5e/0xb0 [ 3500.665180][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3500.665448][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3500.665730][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3500.666002][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3500.666286][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3500.666559][ C1] tcp_delack_timer+0x84/0x240 [ 3500.666804][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3500.667076][ C1] call_timer_fn+0x173/0x430 [ 3500.667314][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3500.667577][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3500.667839][ C1] __run_timers.part.0+0x52d/0x890 [ 3500.668103][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3500.668377][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3500.668664][ C1] ? lock_acquire+0x1c1/0x220 [ 3500.668901][ C1] ? clockevents_program_event+0xf6/0x300 [ 3500.669195][ C1] ? lock_release+0x1d5/0x250 [ 3500.669435][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3500.669701][ C1] ? ktime_get+0xb3/0x190 [ 3500.669921][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3500.670219][ C1] run_timer_softirq+0x72/0x100 [ 3500.670469][ C1] __do_softirq+0x1b9/0x7ff [ 3500.670700][ C1] irq_exit_rcu+0x98/0xc0 [ 3500.670924][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3500.671208][ C1] [ 3500.671359][ C1] [ 3500.671510][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3500.671815][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3500.672141][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3500.673119][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3500.673428][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3500.673826][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3500.674225][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3500.674623][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3500.675024][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3500.675425][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3500.675720][ C1] pipe_read+0xa16/0xdf0 [ 3500.675941][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3500.676220][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3500.676464][ C1] ? iterate_tty_write+0x299/0x540 [ 3500.676726][ C1] ? lock_release+0x1d5/0x250 [ 3500.676968][ C1] vfs_read+0x911/0xc00 [ 3500.677183][ C1] ? lock_acquire+0x1c1/0x220 [ 3500.677424][ C1] ? __might_fault+0xc6/0x180 [ 3500.677664][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3500.677901][ C1] ? __might_fault+0xc6/0x180 [ 3500.678143][ C1] ? lock_release+0x1d5/0x250 [ 3500.678383][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3500.678648][ C1] ? __fget_light+0x54/0x1e0 [ 3500.678884][ C1] ksys_read+0x17a/0x1e0 [ 3500.679101][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3500.679347][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3500.679652][ C1] do_syscall_64+0xc9/0x1e0 [ 3500.679885][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3500.680186][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3500.680415][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3500.681388][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3500.681808][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3500.682219][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3500.682621][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3500.683019][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3500.683418][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3500.683822][ C1] [ 3528.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1095s! [swapper/2:0] [ 3528.569687][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3528.570945][ C2] irq event stamp: 44114564 [ 3528.571174][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3528.571704][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3528.572222][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3528.572703][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3528.573169][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3528.573625][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3528.574235][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3528.574558][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3528.575524][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3528.575830][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3528.576227][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3528.576623][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3528.577021][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3528.577420][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3528.577817][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3528.578262][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3528.578592][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3528.578992][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3528.579390][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3528.579786][ C2] PKRU: 55555554 [ 3528.579967][ C2] Call Trace: [ 3528.580139][ C2] [ 3528.580286][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3528.580546][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3528.580789][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3528.581063][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3528.581335][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3528.581624][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3528.581887][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3528.582198][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3528.582458][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3528.582718][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3528.583026][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3528.583319][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3528.583634][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3528.583923][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3528.584217][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3528.584506][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3528.584816][ C2] ? get_stack_info+0x36/0xc0 [ 3528.585055][ C2] ? lock_acquire+0x1c1/0x220 [ 3528.585294][ C2] ? lock_release+0x1d5/0x250 [ 3528.585534][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3528.585782][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3528.586052][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3528.586337][ C2] ? lock_acquire+0x1c1/0x220 [ 3528.586573][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3528.586813][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3528.587072][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3528.587308][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3528.587555][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3528.587811][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3528.588084][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3528.588360][ C2] ip_local_deliver+0x19d/0x480 [ 3528.588607][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3528.588876][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3528.589141][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3528.589490][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3528.589748][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3528.590067][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3528.590329][ C2] ip_rcv+0x564/0x740 [ 3528.590531][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3528.590762][ C2] ? set_track_prepare+0x8a/0xd0 [ 3528.591013][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3528.591289][ C2] ? start_secondary+0x21c/0x2b0 [ 3528.591539][ C2] ? skb_clone+0x10b/0x330 [ 3528.591763][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3528.592089][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3528.592395][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3528.592674][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3528.592969][ C2] ? __tcf_classify+0x329/0x7d0 [ 3528.593219][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3528.593446][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3528.593746][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3528.594029][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3528.594355][ C2] ? lock_acquire+0x1c1/0x220 [ 3528.594591][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3528.594887][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3528.595170][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3528.595486][ C2] ? __copy_skb_header+0xaf/0x490 [ 3528.595742][ C2] ? __skb_clone+0x57a/0x760 [ 3528.595977][ C2] netif_receive_skb+0x55/0x280 [ 3528.596226][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3528.596536][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3528.596867][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3528.597165][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3528.597439][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3528.597725][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3528.598036][ C2] ? get_stack_info+0x36/0xc0 [ 3528.598277][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3528.598539][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3528.598854][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3528.599129][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3528.599404][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3528.599718][ C2] ? kernel_text_address+0x17/0xe0 [ 3528.599978][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3528.600289][ C2] ? arch_stack_walk+0x8c/0x100 [ 3528.600536][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3528.600799][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3528.601083][ C2] ? lock_acquire+0x1c1/0x220 [ 3528.601319][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3528.601603][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3528.601904][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3528.602186][ C2] ? get_stack_info+0x36/0xc0 [ 3528.602426][ C2] __tcf_classify+0x329/0x7d0 [ 3528.602664][ C2] tcf_classify+0x283/0x930 [ 3528.602897][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3528.603152][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3528.603464][ C2] tc_run+0x2e4/0x5d0 [ 3528.603667][ C2] ? __pfx_tc_run+0x10/0x10 [ 3528.603898][ C2] ? lock_acquire+0x1c1/0x220 [ 3528.604135][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3528.604396][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3528.604647][ C2] ? lock_acquire+0x1c1/0x220 [ 3528.604885][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3528.605149][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3528.605452][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3528.605721][ C2] ? neigh_hh_output+0x348/0x590 [ 3528.605973][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3528.606237][ C2] ip_finish_output2+0x786/0x18e0 [ 3528.606493][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3528.606830][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3528.607108][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3528.607360][ C2] ? __ip_finish_output+0x10f/0x770 [ 3528.607624][ C2] ip_output+0x16b/0x4f0 [ 3528.607839][ C2] ? __pfx_ip_output+0x10/0x10 [ 3528.608082][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3528.608358][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3528.608668][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3528.608946][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3528.609197][ C2] ? __alloc_skb+0xd4/0x280 [ 3528.609427][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3528.609695][ C2] ? tcp_fragment+0x168/0x1040 [ 3528.609939][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3528.610191][ C2] ? ip_local_out+0x114/0x3b0 [ 3528.610431][ C2] __ip_queue_xmit+0x672/0x1910 [ 3528.610680][ C2] ? __skb_clone+0x57a/0x760 [ 3528.610912][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3528.611180][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3528.611460][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3528.611705][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3528.611953][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3528.612259][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3528.612579][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3528.612823][ C2] tcp_send_loss_probe+0x348/0x830 [ 3528.613083][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3528.613349][ C2] tcp_write_timer+0x82/0x1d0 [ 3528.613589][ C2] call_timer_fn+0x173/0x430 [ 3528.613825][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3528.614086][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3528.614352][ C2] __run_timers.part.0+0x52d/0x890 [ 3528.614611][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3528.614878][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3528.615163][ C2] ? lock_acquire+0x1c1/0x220 [ 3528.615400][ C2] ? clockevents_program_event+0xf6/0x300 [ 3528.615691][ C2] ? lock_release+0x1d5/0x250 [ 3528.615929][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3528.616194][ C2] ? ktime_get+0xb3/0x190 [ 3528.616413][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3528.616710][ C2] run_timer_softirq+0x72/0x100 [ 3528.616957][ C2] __do_softirq+0x1b9/0x7ff [ 3528.617188][ C2] irq_exit_rcu+0x98/0xc0 [ 3528.617409][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3528.617692][ C2] [ 3528.617843][ C2] [ 3528.617994][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3528.618298][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3528.618554][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3528.619522][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3528.619828][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3528.620227][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3528.620623][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3528.621024][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3528.621423][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3528.621828][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3528.622122][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3528.622381][ C2] default_idle_call+0x69/0xa0 [ 3528.622626][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3528.622881][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3528.623158][ C2] ? lock_release+0x1d5/0x250 [ 3528.623396][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3528.623668][ C2] do_idle+0xfb/0x160 [ 3528.623872][ C2] cpu_startup_entry+0x55/0x60 [ 3528.624114][ C2] start_secondary+0x21c/0x2b0 [ 3528.624356][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3528.624624][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3528.624933][ C2] [ 3528.625092][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1095s! [perl:4135] [ 3528.625520][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3528.626783][ C1] irq event stamp: 209232 [ 3528.627002][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3528.627531][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3528.628011][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3528.628482][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3528.628946][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3528.629394][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3528.630009][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 3528.630293][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 3528.631277][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 3528.631587][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3528.631985][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3528.632394][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3528.632795][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3528.633197][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3528.633596][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3528.634044][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3528.634379][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3528.634781][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3528.635181][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3528.635580][ C1] PKRU: 55555554 [ 3528.635763][ C1] Call Trace: [ 3528.635934][ C1] [ 3528.636082][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3528.636345][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3528.636589][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3528.636866][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3528.637143][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3528.637432][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3528.637698][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3528.638004][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3528.638269][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3528.638580][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3528.638876][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3528.639191][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3528.639484][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 3528.639765][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3528.640049][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3528.640361][ C1] ? get_stack_info+0x36/0xc0 [ 3528.640604][ C1] ? lock_acquire+0x1c1/0x220 [ 3528.640847][ C1] ? lock_release+0x1d5/0x250 [ 3528.641089][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3528.641339][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3528.641613][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3528.641899][ C1] ? lock_acquire+0x1c1/0x220 [ 3528.642152][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3528.642394][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3528.642656][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3528.642891][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3528.643138][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3528.643397][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3528.643676][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3528.643955][ C1] ip_local_deliver+0x19d/0x480 [ 3528.644204][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3528.644477][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3528.644741][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3528.645090][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3528.645344][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3528.645666][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3528.645929][ C1] ip_rcv+0x564/0x740 [ 3528.646135][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3528.646365][ C1] ? set_track_prepare+0x8a/0xd0 [ 3528.646619][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3528.646898][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3528.647173][ C1] ? skb_clone+0x10b/0x330 [ 3528.647400][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3528.647720][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3528.648030][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3528.648314][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3528.648611][ C1] ? __tcf_classify+0x329/0x7d0 [ 3528.648861][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3528.649093][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3528.649393][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3528.649680][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3528.650006][ C1] ? lock_acquire+0x1c1/0x220 [ 3528.650244][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3528.650544][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3528.650830][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3528.651147][ C1] ? __copy_skb_header+0xaf/0x490 [ 3528.651406][ C1] ? __skb_clone+0x57a/0x760 [ 3528.651643][ C1] netif_receive_skb+0x55/0x280 [ 3528.651892][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3528.652215][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3528.652548][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3528.652847][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3528.653123][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3528.653412][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3528.653725][ C1] ? hlock_class+0x4e/0x130 [ 3528.653961][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3528.654237][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3528.654513][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3528.654777][ C1] ? hlock_class+0x4e/0x130 [ 3528.655010][ C1] ? mark_lock+0x38/0x3e0 [ 3528.655230][ C1] ? stack_access_ok+0xda/0x1f0 [ 3528.655479][ C1] ? __lock_acquire+0xb67/0x1610 [ 3528.655734][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3528.656011][ C1] ? get_stack_info+0x36/0xc0 [ 3528.656251][ C1] ? stack_access_ok+0xda/0x1f0 [ 3528.656499][ C1] ? get_reg+0x119/0x190 [ 3528.656718][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3528.656989][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3528.657299][ C1] __tcf_classify+0x329/0x7d0 [ 3528.657540][ C1] tcf_classify+0x283/0x930 [ 3528.657772][ C1] ? arch_stack_walk+0xa2/0x100 [ 3528.658023][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3528.658279][ C1] ? get_stack_info+0x36/0xc0 [ 3528.658521][ C1] tc_run+0x2e4/0x5d0 [ 3528.658727][ C1] ? __pfx_tc_run+0x10/0x10 [ 3528.658957][ C1] ? lock_acquire+0x1c1/0x220 [ 3528.659202][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3528.659464][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3528.659718][ C1] ? lock_acquire+0x1c1/0x220 [ 3528.659959][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3528.660224][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3528.660532][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3528.660806][ C1] ? neigh_hh_output+0x348/0x590 [ 3528.661059][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3528.661325][ C1] ip_finish_output2+0x786/0x18e0 [ 3528.661583][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3528.661862][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3528.662208][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3528.662487][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3528.662740][ C1] ? __ip_finish_output+0x10f/0x770 [ 3528.663008][ C1] ip_output+0x16b/0x4f0 [ 3528.663225][ C1] ? run_timer_softirq+0x72/0x100 [ 3528.663483][ C1] ? __pfx_ip_output+0x10/0x10 [ 3528.663729][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3528.664016][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3528.664269][ C1] ? ip_local_out+0x114/0x3b0 [ 3528.664510][ C1] __ip_queue_xmit+0x672/0x1910 [ 3528.664760][ C1] ? __create_object+0x5e/0xb0 [ 3528.665006][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3528.665275][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3528.665557][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3528.665833][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3528.666116][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3528.666389][ C1] tcp_delack_timer+0x84/0x240 [ 3528.666640][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3528.666914][ C1] call_timer_fn+0x173/0x430 [ 3528.667153][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3528.667415][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3528.667677][ C1] __run_timers.part.0+0x52d/0x890 [ 3528.667938][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3528.668217][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3528.668505][ C1] ? lock_acquire+0x1c1/0x220 [ 3528.668746][ C1] ? clockevents_program_event+0xf6/0x300 [ 3528.669041][ C1] ? lock_release+0x1d5/0x250 [ 3528.669281][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3528.669547][ C1] ? ktime_get+0xb3/0x190 [ 3528.669769][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3528.670067][ C1] run_timer_softirq+0x72/0x100 [ 3528.670317][ C1] __do_softirq+0x1b9/0x7ff [ 3528.670551][ C1] irq_exit_rcu+0x98/0xc0 [ 3528.670771][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3528.671058][ C1] [ 3528.671210][ C1] [ 3528.671360][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3528.671670][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3528.671995][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3528.672979][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3528.673288][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3528.673688][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3528.674092][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3528.674493][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3528.674893][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3528.675293][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3528.675591][ C1] pipe_read+0xa16/0xdf0 [ 3528.675816][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3528.676096][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3528.676339][ C1] ? iterate_tty_write+0x299/0x540 [ 3528.676600][ C1] ? lock_release+0x1d5/0x250 [ 3528.676843][ C1] vfs_read+0x911/0xc00 [ 3528.677057][ C1] ? lock_acquire+0x1c1/0x220 [ 3528.677296][ C1] ? __might_fault+0xc6/0x180 [ 3528.677538][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3528.677779][ C1] ? __might_fault+0xc6/0x180 [ 3528.678020][ C1] ? lock_release+0x1d5/0x250 [ 3528.678260][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3528.678523][ C1] ? __fget_light+0x54/0x1e0 [ 3528.678763][ C1] ksys_read+0x17a/0x1e0 [ 3528.678980][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3528.679226][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3528.679533][ C1] do_syscall_64+0xc9/0x1e0 [ 3528.679769][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3528.680070][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3528.680301][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3528.681276][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3528.681699][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3528.682105][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3528.682506][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3528.682906][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3528.683308][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3528.683712][ C1] [ 3551.779104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3551.779473][ C1] rcu: 1-....: (1194308 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=292642 [ 3551.780032][ C1] rcu: (t=1196892 jiffies g=1882453 q=703 ncpus=4) [ 3551.780371][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3551.780820][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3551.781435][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3551.781763][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3551.782746][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3551.783055][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3551.783463][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3551.783864][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3551.784264][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3551.784665][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3551.785067][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3551.785519][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3551.785852][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3551.786255][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3551.786658][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3551.787059][ C1] PKRU: 55555554 [ 3551.787246][ C1] Call Trace: [ 3551.787417][ C1] [ 3551.787569][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3551.787842][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3551.788096][ C1] ? check_cpu_stall+0x284/0x500 [ 3551.788351][ C1] ? rcu_pending+0x92/0x360 [ 3551.788580][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3551.788853][ C1] ? update_process_times+0xb9/0x110 [ 3551.789125][ C1] ? tick_sched_handle+0x67/0x130 [ 3551.789383][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3551.789667][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3551.789911][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3551.790226][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3551.790500][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3551.790790][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3551.791056][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3551.791362][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3551.791626][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3551.791939][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3551.792239][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3551.792555][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3551.792843][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3551.793140][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3551.793430][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3551.793741][ C1] ? get_stack_info+0x36/0xc0 [ 3551.793984][ C1] ? lock_acquire+0x1c1/0x220 [ 3551.794227][ C1] ? lock_release+0x1d5/0x250 [ 3551.794469][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3551.794717][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3551.794991][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3551.795281][ C1] ? lock_acquire+0x1c1/0x220 [ 3551.795521][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3551.795763][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3551.796025][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3551.796259][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3551.796507][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3551.796765][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3551.797045][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3551.797324][ C1] ip_local_deliver+0x19d/0x480 [ 3551.797573][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3551.797850][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3551.798116][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3551.798467][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3551.798721][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3551.799043][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3551.799308][ C1] ip_rcv+0x564/0x740 [ 3551.799516][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3551.799746][ C1] ? set_track_prepare+0x8a/0xd0 [ 3551.800003][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3551.800281][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3551.800557][ C1] ? skb_clone+0x10b/0x330 [ 3551.800785][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3551.801107][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3551.801417][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3551.801700][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3551.802004][ C1] ? __tcf_classify+0x329/0x7d0 [ 3551.802257][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3551.802487][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3551.802790][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3551.803078][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3551.803407][ C1] ? lock_acquire+0x1c1/0x220 [ 3551.803647][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3551.803947][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3551.804234][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3551.804553][ C1] ? __copy_skb_header+0xaf/0x490 [ 3551.804813][ C1] ? __skb_clone+0x57a/0x760 [ 3551.805050][ C1] netif_receive_skb+0x55/0x280 [ 3551.805302][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3551.805618][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3551.805955][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3551.806254][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3551.806533][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3551.806823][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3551.807141][ C1] ? hlock_class+0x4e/0x130 [ 3551.807375][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3551.807654][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3551.807930][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3551.808196][ C1] ? hlock_class+0x4e/0x130 [ 3551.808430][ C1] ? mark_lock+0x38/0x3e0 [ 3551.808650][ C1] ? stack_access_ok+0xda/0x1f0 [ 3551.808902][ C1] ? __lock_acquire+0xb67/0x1610 [ 3551.809158][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3551.809436][ C1] ? get_stack_info+0x36/0xc0 [ 3551.809678][ C1] ? stack_access_ok+0xda/0x1f0 [ 3551.809927][ C1] ? get_reg+0x119/0x190 [ 3551.810145][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3551.810417][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3551.810726][ C1] __tcf_classify+0x329/0x7d0 [ 3551.810970][ C1] tcf_classify+0x283/0x930 [ 3551.811205][ C1] ? arch_stack_walk+0xa2/0x100 [ 3551.811457][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3551.811716][ C1] ? get_stack_info+0x36/0xc0 [ 3551.811962][ C1] tc_run+0x2e4/0x5d0 [ 3551.812172][ C1] ? __pfx_tc_run+0x10/0x10 [ 3551.812404][ C1] ? lock_acquire+0x1c1/0x220 [ 3551.812645][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3551.812908][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3551.813163][ C1] ? lock_acquire+0x1c1/0x220 [ 3551.813405][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3551.813675][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3551.813981][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3551.814257][ C1] ? neigh_hh_output+0x348/0x590 [ 3551.814513][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3551.814780][ C1] ip_finish_output2+0x786/0x18e0 [ 3551.815039][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3551.815319][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3551.815658][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3551.815939][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3551.816196][ C1] ? __ip_finish_output+0x10f/0x770 [ 3551.816463][ C1] ip_output+0x16b/0x4f0 [ 3551.816681][ C1] ? run_timer_softirq+0x72/0x100 [ 3551.816940][ C1] ? __pfx_ip_output+0x10/0x10 [ 3551.817186][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3551.817475][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3551.817731][ C1] ? ip_local_out+0x114/0x3b0 [ 3551.817975][ C1] __ip_queue_xmit+0x672/0x1910 [ 3551.818227][ C1] ? __create_object+0x5e/0xb0 [ 3551.818474][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3551.818746][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3551.819028][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3551.819305][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3551.819592][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3551.819866][ C1] tcp_delack_timer+0x84/0x240 [ 3551.820114][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3551.820388][ C1] call_timer_fn+0x173/0x430 [ 3551.820627][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3551.820891][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3551.821155][ C1] __run_timers.part.0+0x52d/0x890 [ 3551.821422][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3551.821698][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3551.821992][ C1] ? lock_acquire+0x1c1/0x220 [ 3551.822233][ C1] ? clockevents_program_event+0xf6/0x300 [ 3551.822526][ C1] ? lock_release+0x1d5/0x250 [ 3551.822769][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3551.823035][ C1] ? ktime_get+0xb3/0x190 [ 3551.823258][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3551.823558][ C1] run_timer_softirq+0x72/0x100 [ 3551.823808][ C1] __do_softirq+0x1b9/0x7ff [ 3551.824042][ C1] irq_exit_rcu+0x98/0xc0 [ 3551.824265][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3551.824555][ C1] [ 3551.824710][ C1] [ 3551.824861][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3551.825169][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3551.825495][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3551.826479][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3551.826790][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3551.827193][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3551.827592][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3551.827997][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3551.828398][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3551.828802][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3551.829100][ C1] pipe_read+0xa16/0xdf0 [ 3551.829322][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3551.829601][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3551.829847][ C1] ? iterate_tty_write+0x299/0x540 [ 3551.830110][ C1] ? lock_release+0x1d5/0x250 [ 3551.830353][ C1] vfs_read+0x911/0xc00 [ 3551.830568][ C1] ? lock_acquire+0x1c1/0x220 [ 3551.830809][ C1] ? __might_fault+0xc6/0x180 [ 3551.831052][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3551.831297][ C1] ? __might_fault+0xc6/0x180 [ 3551.831537][ C1] ? lock_release+0x1d5/0x250 [ 3551.831778][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3551.832067][ C1] ? __fget_light+0x54/0x1e0 [ 3551.832309][ C1] ksys_read+0x17a/0x1e0 [ 3551.832527][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3551.832774][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3551.833082][ C1] do_syscall_64+0xc9/0x1e0 [ 3551.833318][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3551.833620][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3551.833853][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3551.834836][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3551.835261][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3551.835665][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3551.836068][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3551.836474][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3551.836878][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3551.837286][ C1] [ 3551.837445][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3551.837721][ C2] NMI backtrace for cpu 2 [ 3551.837727][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3551.837733][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3551.837738][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3551.837745][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3551.837751][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3551.837756][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3551.837760][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3551.837764][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3551.837768][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3551.837772][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3551.837776][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3551.837780][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3551.837786][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3551.837790][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3551.837793][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3551.837796][ C2] PKRU: 55555554 [ 3551.837798][ C2] Call Trace: [ 3551.837803][ C2] [ 3551.837806][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3551.837818][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3551.837827][ C2] ? nmi_handle+0x153/0x420 [ 3551.837838][ C2] ? default_do_nmi+0x41/0x100 [ 3551.837844][ C2] ? exc_nmi+0xf3/0x120 [ 3551.837850][ C2] ? end_repeat_nmi+0xf/0x60 [ 3551.837862][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3551.837870][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3551.837878][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3551.837886][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3551.837894][ C2] [ 3551.837896][ C2] [ 3551.837899][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3551.837906][ C2] ? get_stack_info+0x36/0xc0 [ 3551.837914][ C2] ? lock_acquire+0x1c1/0x220 [ 3551.837922][ C2] ? lock_release+0x1d5/0x250 [ 3551.837931][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3551.837939][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3551.837946][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3551.837954][ C2] ? lock_acquire+0x1c1/0x220 [ 3551.837960][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3551.837968][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3551.837975][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3551.837992][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3551.837998][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3551.838009][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3551.838019][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3551.838027][ C2] ip_local_deliver+0x19d/0x480 [ 3551.838033][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3551.838039][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3551.838044][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3551.838055][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3551.838062][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3551.838069][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3551.838090][ C2] ip_rcv+0x564/0x740 [ 3551.838096][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3551.838103][ C2] ? set_track_prepare+0x8a/0xd0 [ 3551.838111][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3551.838118][ C2] ? start_secondary+0x21c/0x2b0 [ 3551.838124][ C2] ? skb_clone+0x10b/0x330 [ 3551.838131][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3551.838146][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3551.838160][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3551.838167][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3551.838187][ C2] ? __tcf_classify+0x329/0x7d0 [ 3551.838196][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3551.838201][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3551.838209][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3551.838217][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3551.838228][ C2] ? lock_acquire+0x1c1/0x220 [ 3551.838234][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3551.838244][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3551.838253][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3551.838263][ C2] ? __copy_skb_header+0xaf/0x490 [ 3551.838272][ C2] ? __skb_clone+0x57a/0x760 [ 3551.838278][ C2] netif_receive_skb+0x55/0x280 [ 3551.838287][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3551.838305][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3551.838322][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3551.838340][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3551.838352][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3551.838378][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3551.838398][ C2] ? get_stack_info+0x36/0xc0 [ 3551.838410][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3551.838417][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3551.838425][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3551.838431][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3551.838441][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3551.838447][ C2] ? kernel_text_address+0x17/0xe0 [ 3551.838454][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3551.838463][ C2] ? arch_stack_walk+0x8c/0x100 [ 3551.838470][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3551.838478][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3551.838486][ C2] ? lock_acquire+0x1c1/0x220 [ 3551.838492][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3551.838500][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3551.838509][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3551.838516][ C2] ? get_stack_info+0x36/0xc0 [ 3551.838527][ C2] __tcf_classify+0x329/0x7d0 [ 3551.838540][ C2] tcf_classify+0x283/0x930 [ 3551.838551][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3551.838558][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3551.838570][ C2] tc_run+0x2e4/0x5d0 [ 3551.838577][ C2] ? __pfx_tc_run+0x10/0x10 [ 3551.838585][ C2] ? lock_acquire+0x1c1/0x220 [ 3551.838590][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3551.838600][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3551.838611][ C2] ? lock_acquire+0x1c1/0x220 [ 3551.838616][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3551.838623][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3551.838631][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3551.838638][ C2] ? neigh_hh_output+0x348/0x590 [ 3551.838648][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3551.838657][ C2] ip_finish_output2+0x786/0x18e0 [ 3551.838666][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3551.838686][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3551.838690][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3551.838694][ C2] ? __ip_finish_output+0x10f/0x770 [ 3551.838698][ C2] ip_output+0x16b/0x4f0 [ 3551.838701][ C2] ? __pfx_ip_output+0x10/0x10 [ 3551.838704][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3551.838707][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3551.838710][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3551.838712][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3551.838714][ C2] ? __alloc_skb+0xd4/0x280 [ 3551.838717][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3551.838720][ C2] ? tcp_fragment+0x168/0x1040 [ 3551.838723][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3551.838726][ C2] ? ip_local_out+0x114/0x3b0 [ 3551.838730][ C2] __ip_queue_xmit+0x672/0x1910 [ 3551.838734][ C2] ? __skb_clone+0x57a/0x760 [ 3551.838737][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3551.838742][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3551.838745][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3551.838749][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3551.838753][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3551.838757][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3551.838760][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3551.838763][ C2] tcp_send_loss_probe+0x348/0x830 [ 3551.838767][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3551.838769][ C2] tcp_write_timer+0x82/0x1d0 [ 3551.838773][ C2] call_timer_fn+0x173/0x430 [ 3551.838776][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3551.838781][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3551.838785][ C2] __run_timers.part.0+0x52d/0x890 [ 3551.838788][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3551.838792][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3551.838795][ C2] ? lock_acquire+0x1c1/0x220 [ 3551.838797][ C2] ? clockevents_program_event+0xf6/0x300 [ 3551.838801][ C2] ? lock_release+0x1d5/0x250 [ 3551.838803][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3551.838806][ C2] ? ktime_get+0xb3/0x190 [ 3551.838809][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3551.838814][ C2] run_timer_softirq+0x72/0x100 [ 3551.838817][ C2] __do_softirq+0x1b9/0x7ff [ 3551.838821][ C2] irq_exit_rcu+0x98/0xc0 [ 3551.838824][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3551.838827][ C2] [ 3551.838828][ C2] [ 3551.838829][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3551.838833][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3551.838835][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3551.838837][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3551.838839][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3551.838841][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3551.838842][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3551.838843][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3551.838845][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3551.838848][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3551.838851][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3551.838855][ C2] default_idle_call+0x69/0xa0 [ 3551.838858][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3551.838860][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3551.838864][ C2] ? lock_release+0x1d5/0x250 [ 3551.838867][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3551.838871][ C2] do_idle+0xfb/0x160 [ 3551.838874][ C2] cpu_startup_entry+0x55/0x60 [ 3551.838877][ C2] start_secondary+0x21c/0x2b0 [ 3551.838880][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3551.838884][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3551.838890][ C2] [ 3551.838892][ C2] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.171 msecs [ 3576.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1139s! [perl:4135] [ 3576.569705][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3576.570969][ C1] irq event stamp: 209232 [ 3576.571191][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3576.571724][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3576.572207][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3576.572679][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3576.573146][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3576.573596][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3576.574211][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3576.574538][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3576.575518][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3576.575828][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3576.576233][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3576.576635][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3576.577036][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3576.577438][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3576.577841][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3576.578292][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3576.578627][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3576.579030][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3576.579431][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3576.579833][ C1] PKRU: 55555554 [ 3576.580016][ C1] Call Trace: [ 3576.580188][ C1] [ 3576.580338][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3576.580602][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3576.580846][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3576.581126][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3576.581401][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3576.581690][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3576.581964][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3576.582271][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3576.582534][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3576.582846][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3576.583146][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3576.583462][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3576.583751][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3576.584050][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3576.584341][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3576.584654][ C1] ? get_stack_info+0x36/0xc0 [ 3576.584897][ C1] ? lock_acquire+0x1c1/0x220 [ 3576.585142][ C1] ? lock_release+0x1d5/0x250 [ 3576.585385][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3576.585635][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3576.585910][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3576.586197][ C1] ? lock_acquire+0x1c1/0x220 [ 3576.586439][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3576.586682][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3576.586945][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3576.587182][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3576.587431][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3576.587691][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3576.587967][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3576.588250][ C1] ip_local_deliver+0x19d/0x480 [ 3576.588500][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3576.588775][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3576.589041][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3576.589392][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3576.589648][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3576.589971][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3576.590235][ C1] ip_rcv+0x564/0x740 [ 3576.590440][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3576.590674][ C1] ? set_track_prepare+0x8a/0xd0 [ 3576.590929][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3576.591209][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3576.591485][ C1] ? skb_clone+0x10b/0x330 [ 3576.591715][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3576.592042][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3576.592353][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3576.592636][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3576.592934][ C1] ? __tcf_classify+0x329/0x7d0 [ 3576.593184][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3576.593416][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3576.593720][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3576.594007][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3576.594335][ C1] ? lock_acquire+0x1c1/0x220 [ 3576.594576][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3576.594876][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3576.595167][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3576.595487][ C1] ? __copy_skb_header+0xaf/0x490 [ 3576.595747][ C1] ? __skb_clone+0x57a/0x760 [ 3576.595984][ C1] netif_receive_skb+0x55/0x280 [ 3576.596238][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3576.596551][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3576.596887][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3576.597188][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3576.597465][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3576.597756][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3576.598072][ C1] ? hlock_class+0x4e/0x130 [ 3576.598304][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3576.598583][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3576.598861][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3576.599127][ C1] ? hlock_class+0x4e/0x130 [ 3576.599361][ C1] ? mark_lock+0x38/0x3e0 [ 3576.599581][ C1] ? stack_access_ok+0xda/0x1f0 [ 3576.599832][ C1] ? __lock_acquire+0xb67/0x1610 [ 3576.600090][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3576.600367][ C1] ? get_stack_info+0x36/0xc0 [ 3576.600610][ C1] ? stack_access_ok+0xda/0x1f0 [ 3576.600858][ C1] ? get_reg+0x119/0x190 [ 3576.601075][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3576.601343][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3576.601654][ C1] __tcf_classify+0x329/0x7d0 [ 3576.601908][ C1] tcf_classify+0x283/0x930 [ 3576.602142][ C1] ? arch_stack_walk+0xa2/0x100 [ 3576.602391][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3576.602650][ C1] ? get_stack_info+0x36/0xc0 [ 3576.602893][ C1] tc_run+0x2e4/0x5d0 [ 3576.603099][ C1] ? __pfx_tc_run+0x10/0x10 [ 3576.603333][ C1] ? lock_acquire+0x1c1/0x220 [ 3576.603576][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3576.603838][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3576.604093][ C1] ? lock_acquire+0x1c1/0x220 [ 3576.604334][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3576.604602][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3576.604906][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3576.605182][ C1] ? neigh_hh_output+0x348/0x590 [ 3576.605436][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3576.605703][ C1] ip_finish_output2+0x786/0x18e0 [ 3576.605960][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3576.606241][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3576.606579][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3576.606859][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3576.607115][ C1] ? __ip_finish_output+0x10f/0x770 [ 3576.607382][ C1] ip_output+0x16b/0x4f0 [ 3576.607600][ C1] ? run_timer_softirq+0x72/0x100 [ 3576.607860][ C1] ? __pfx_ip_output+0x10/0x10 [ 3576.608106][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3576.608394][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3576.608648][ C1] ? ip_local_out+0x114/0x3b0 [ 3576.608889][ C1] __ip_queue_xmit+0x672/0x1910 [ 3576.609141][ C1] ? __create_object+0x5e/0xb0 [ 3576.609386][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3576.609656][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3576.609939][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3576.610214][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3576.610500][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3576.610774][ C1] tcp_delack_timer+0x84/0x240 [ 3576.611020][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3576.611295][ C1] call_timer_fn+0x173/0x430 [ 3576.611537][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3576.611806][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3576.612070][ C1] __run_timers.part.0+0x52d/0x890 [ 3576.612332][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3576.612608][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3576.612901][ C1] ? lock_acquire+0x1c1/0x220 [ 3576.613140][ C1] ? clockevents_program_event+0xf6/0x300 [ 3576.613433][ C1] ? lock_release+0x1d5/0x250 [ 3576.613673][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3576.613941][ C1] ? ktime_get+0xb3/0x190 [ 3576.614168][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3576.614467][ C1] run_timer_softirq+0x72/0x100 [ 3576.614718][ C1] __do_softirq+0x1b9/0x7ff [ 3576.614950][ C1] irq_exit_rcu+0x98/0xc0 [ 3576.615175][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3576.615462][ C1] [ 3576.615614][ C1] [ 3576.615767][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3576.616074][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3576.616400][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3576.617378][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3576.617689][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3576.618091][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3576.618492][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3576.618891][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3576.619295][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3576.619699][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3576.619998][ C1] pipe_read+0xa16/0xdf0 [ 3576.620221][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3576.620502][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3576.620747][ C1] ? iterate_tty_write+0x299/0x540 [ 3576.621009][ C1] ? lock_release+0x1d5/0x250 [ 3576.621253][ C1] vfs_read+0x911/0xc00 [ 3576.621467][ C1] ? lock_acquire+0x1c1/0x220 [ 3576.621709][ C1] ? __might_fault+0xc6/0x180 [ 3576.621957][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3576.622198][ C1] ? __might_fault+0xc6/0x180 [ 3576.622440][ C1] ? lock_release+0x1d5/0x250 [ 3576.622682][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3576.622948][ C1] ? __fget_light+0x54/0x1e0 [ 3576.623187][ C1] ksys_read+0x17a/0x1e0 [ 3576.623404][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3576.623651][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3576.623957][ C1] do_syscall_64+0xc9/0x1e0 [ 3576.624191][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3576.624494][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3576.624724][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3576.625700][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3576.626128][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3576.626529][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3576.626931][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3576.627332][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3576.627733][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3576.628140][ C1] [ 3576.628299][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1139s! [swapper/2:0] [ 3576.628729][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3576.629983][ C2] irq event stamp: 44114564 [ 3576.630213][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3576.630751][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3576.631261][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3576.631738][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3576.632216][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3576.632669][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3576.633281][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3576.633606][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3576.634572][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3576.634879][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3576.635278][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3576.635675][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3576.636071][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3576.636472][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3576.636869][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3576.637317][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3576.637647][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3576.638046][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3576.638446][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3576.638843][ C2] PKRU: 55555554 [ 3576.639024][ C2] Call Trace: [ 3576.639194][ C2] [ 3576.639344][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3576.639604][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3576.639846][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3576.640123][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3576.640393][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3576.640682][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3576.640945][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3576.641251][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3576.641511][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3576.641773][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3576.642087][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3576.642381][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3576.642695][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3576.642983][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3576.643278][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3576.643566][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3576.643875][ C2] ? get_stack_info+0x36/0xc0 [ 3576.644115][ C2] ? lock_acquire+0x1c1/0x220 [ 3576.644355][ C2] ? lock_release+0x1d5/0x250 [ 3576.644594][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3576.644842][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3576.645113][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3576.645396][ C2] ? lock_acquire+0x1c1/0x220 [ 3576.645634][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3576.645879][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3576.646139][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3576.646372][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3576.646617][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3576.646875][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3576.647152][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3576.647427][ C2] ip_local_deliver+0x19d/0x480 [ 3576.647673][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3576.647943][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3576.648206][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3576.648554][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3576.648805][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3576.649125][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3576.649385][ C2] ip_rcv+0x564/0x740 [ 3576.649589][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3576.649817][ C2] ? set_track_prepare+0x8a/0xd0 [ 3576.650070][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3576.650348][ C2] ? start_secondary+0x21c/0x2b0 [ 3576.650598][ C2] ? skb_clone+0x10b/0x330 [ 3576.650824][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3576.651142][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3576.651448][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3576.651727][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3576.652030][ C2] ? __tcf_classify+0x329/0x7d0 [ 3576.652278][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3576.652507][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3576.652807][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3576.653090][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3576.653415][ C2] ? lock_acquire+0x1c1/0x220 [ 3576.653653][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3576.653949][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3576.654233][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3576.654549][ C2] ? __copy_skb_header+0xaf/0x490 [ 3576.654805][ C2] ? __skb_clone+0x57a/0x760 [ 3576.655039][ C2] netif_receive_skb+0x55/0x280 [ 3576.655287][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3576.655597][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3576.655929][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3576.656227][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3576.656500][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3576.656788][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3576.657099][ C2] ? get_stack_info+0x36/0xc0 [ 3576.657338][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3576.657603][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3576.657918][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3576.658195][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3576.658470][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3576.658783][ C2] ? kernel_text_address+0x17/0xe0 [ 3576.659043][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3576.659356][ C2] ? arch_stack_walk+0x8c/0x100 [ 3576.659604][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3576.659867][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3576.660150][ C2] ? lock_acquire+0x1c1/0x220 [ 3576.660389][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3576.660671][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3576.660973][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3576.661250][ C2] ? get_stack_info+0x36/0xc0 [ 3576.661488][ C2] __tcf_classify+0x329/0x7d0 [ 3576.661729][ C2] tcf_classify+0x283/0x930 [ 3576.661968][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3576.662225][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3576.662538][ C2] tc_run+0x2e4/0x5d0 [ 3576.662743][ C2] ? __pfx_tc_run+0x10/0x10 [ 3576.662971][ C2] ? lock_acquire+0x1c1/0x220 [ 3576.663211][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3576.663471][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3576.663724][ C2] ? lock_acquire+0x1c1/0x220 [ 3576.663962][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3576.664225][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3576.664528][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3576.664799][ C2] ? neigh_hh_output+0x348/0x590 [ 3576.665051][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3576.665316][ C2] ip_finish_output2+0x786/0x18e0 [ 3576.665572][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3576.665906][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3576.666184][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3576.666435][ C2] ? __ip_finish_output+0x10f/0x770 [ 3576.666700][ C2] ip_output+0x16b/0x4f0 [ 3576.666916][ C2] ? __pfx_ip_output+0x10/0x10 [ 3576.667159][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3576.667434][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3576.667746][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3576.668020][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3576.668272][ C2] ? __alloc_skb+0xd4/0x280 [ 3576.668503][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3576.668771][ C2] ? tcp_fragment+0x168/0x1040 [ 3576.669014][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3576.669266][ C2] ? ip_local_out+0x114/0x3b0 [ 3576.669505][ C2] __ip_queue_xmit+0x672/0x1910 [ 3576.669752][ C2] ? __skb_clone+0x57a/0x760 [ 3576.669985][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3576.670251][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3576.670532][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3576.670775][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3576.671023][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3576.671325][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3576.671644][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3576.671894][ C2] tcp_send_loss_probe+0x348/0x830 [ 3576.672158][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3576.672424][ C2] tcp_write_timer+0x82/0x1d0 [ 3576.672664][ C2] call_timer_fn+0x173/0x430 [ 3576.672899][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3576.673163][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3576.673423][ C2] __run_timers.part.0+0x52d/0x890 [ 3576.673682][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3576.673950][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3576.674233][ C2] ? lock_acquire+0x1c1/0x220 [ 3576.674472][ C2] ? clockevents_program_event+0xf6/0x300 [ 3576.674761][ C2] ? lock_release+0x1d5/0x250 [ 3576.674997][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3576.675262][ C2] ? ktime_get+0xb3/0x190 [ 3576.675482][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3576.675777][ C2] run_timer_softirq+0x72/0x100 [ 3576.676023][ C2] __do_softirq+0x1b9/0x7ff [ 3576.676257][ C2] irq_exit_rcu+0x98/0xc0 [ 3576.676476][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3576.676762][ C2] [ 3576.676911][ C2] [ 3576.677063][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3576.677364][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3576.677620][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3576.678585][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3576.678891][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3576.679291][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3576.679688][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3576.680084][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3576.680482][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3576.680881][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3576.681169][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3576.681428][ C2] default_idle_call+0x69/0xa0 [ 3576.681672][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3576.681928][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3576.682204][ C2] ? lock_release+0x1d5/0x250 [ 3576.682442][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3576.682715][ C2] do_idle+0xfb/0x160 [ 3576.682917][ C2] cpu_startup_entry+0x55/0x60 [ 3576.683161][ C2] start_secondary+0x21c/0x2b0 [ 3576.683404][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3576.683672][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3576.683982][ C2] [ 3604.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1166s! [perl:4135] [ 3604.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3604.570960][ C1] irq event stamp: 209232 [ 3604.571178][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3604.571712][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3604.572193][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3604.572661][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3604.573125][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3604.573574][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3604.574188][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3604.574522][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3604.575500][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3604.575810][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3604.576213][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3604.576611][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3604.577014][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3604.577415][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3604.577815][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3604.578264][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3604.578595][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3604.579000][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3604.579400][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3604.579798][ C1] PKRU: 55555554 [ 3604.579980][ C1] Call Trace: [ 3604.580154][ C1] [ 3604.580302][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3604.580564][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3604.580809][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3604.581086][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3604.581361][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3604.581655][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3604.581924][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3604.582233][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3604.582497][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3604.582810][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3604.583107][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3604.583421][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3604.583712][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3604.584008][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3604.584298][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3604.584612][ C1] ? get_stack_info+0x36/0xc0 [ 3604.584854][ C1] ? lock_acquire+0x1c1/0x220 [ 3604.585094][ C1] ? lock_release+0x1d5/0x250 [ 3604.585335][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3604.585585][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3604.585858][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3604.586146][ C1] ? lock_acquire+0x1c1/0x220 [ 3604.586385][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3604.586627][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3604.586889][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3604.587127][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3604.587377][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3604.587637][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3604.587914][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3604.588190][ C1] ip_local_deliver+0x19d/0x480 [ 3604.588439][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3604.588710][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3604.588977][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3604.589326][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3604.589581][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3604.589904][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3604.590168][ C1] ip_rcv+0x564/0x740 [ 3604.590373][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3604.590606][ C1] ? set_track_prepare+0x8a/0xd0 [ 3604.590860][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3604.591138][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3604.591411][ C1] ? skb_clone+0x10b/0x330 [ 3604.591641][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3604.591972][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3604.592279][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3604.592563][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3604.592856][ C1] ? __tcf_classify+0x329/0x7d0 [ 3604.593106][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3604.593339][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3604.593638][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3604.593926][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3604.594254][ C1] ? lock_acquire+0x1c1/0x220 [ 3604.594494][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3604.594790][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3604.595078][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3604.595398][ C1] ? __copy_skb_header+0xaf/0x490 [ 3604.595657][ C1] ? __skb_clone+0x57a/0x760 [ 3604.595891][ C1] netif_receive_skb+0x55/0x280 [ 3604.596140][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3604.596455][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3604.596786][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3604.597086][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3604.597362][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3604.597650][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3604.597961][ C1] ? hlock_class+0x4e/0x130 [ 3604.598197][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3604.598473][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3604.598750][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3604.599016][ C1] ? hlock_class+0x4e/0x130 [ 3604.599247][ C1] ? mark_lock+0x38/0x3e0 [ 3604.599470][ C1] ? stack_access_ok+0xda/0x1f0 [ 3604.599719][ C1] ? __lock_acquire+0xb67/0x1610 [ 3604.599975][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3604.600254][ C1] ? get_stack_info+0x36/0xc0 [ 3604.600495][ C1] ? stack_access_ok+0xda/0x1f0 [ 3604.600741][ C1] ? get_reg+0x119/0x190 [ 3604.600959][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3604.601228][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3604.601538][ C1] __tcf_classify+0x329/0x7d0 [ 3604.601786][ C1] tcf_classify+0x283/0x930 [ 3604.602019][ C1] ? arch_stack_walk+0xa2/0x100 [ 3604.602270][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3604.602527][ C1] ? get_stack_info+0x36/0xc0 [ 3604.602768][ C1] tc_run+0x2e4/0x5d0 [ 3604.602973][ C1] ? __pfx_tc_run+0x10/0x10 [ 3604.603207][ C1] ? lock_acquire+0x1c1/0x220 [ 3604.603444][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3604.603706][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3604.603959][ C1] ? lock_acquire+0x1c1/0x220 [ 3604.604199][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3604.604464][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3604.604771][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3604.605043][ C1] ? neigh_hh_output+0x348/0x590 [ 3604.605297][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3604.605563][ C1] ip_finish_output2+0x786/0x18e0 [ 3604.605819][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3604.606100][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3604.606440][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3604.606716][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3604.606970][ C1] ? __ip_finish_output+0x10f/0x770 [ 3604.607237][ C1] ip_output+0x16b/0x4f0 [ 3604.607455][ C1] ? run_timer_softirq+0x72/0x100 [ 3604.607714][ C1] ? __pfx_ip_output+0x10/0x10 [ 3604.607956][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3604.608249][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3604.608501][ C1] ? ip_local_out+0x114/0x3b0 [ 3604.608742][ C1] __ip_queue_xmit+0x672/0x1910 [ 3604.608990][ C1] ? __create_object+0x5e/0xb0 [ 3604.609237][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3604.609504][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3604.609788][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3604.610062][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3604.610344][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3604.610619][ C1] tcp_delack_timer+0x84/0x240 [ 3604.610861][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3604.611137][ C1] call_timer_fn+0x173/0x430 [ 3604.611372][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3604.611635][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3604.611906][ C1] __run_timers.part.0+0x52d/0x890 [ 3604.612168][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3604.612444][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3604.612728][ C1] ? lock_acquire+0x1c1/0x220 [ 3604.612970][ C1] ? clockevents_program_event+0xf6/0x300 [ 3604.613261][ C1] ? lock_release+0x1d5/0x250 [ 3604.613500][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3604.613765][ C1] ? ktime_get+0xb3/0x190 [ 3604.613988][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3604.614283][ C1] run_timer_softirq+0x72/0x100 [ 3604.614533][ C1] __do_softirq+0x1b9/0x7ff [ 3604.614768][ C1] irq_exit_rcu+0x98/0xc0 [ 3604.614988][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3604.615277][ C1] [ 3604.615427][ C1] [ 3604.615577][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3604.615881][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3604.616207][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3604.617183][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3604.617491][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3604.617890][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3604.618291][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3604.618690][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3604.619088][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3604.619491][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3604.619788][ C1] pipe_read+0xa16/0xdf0 [ 3604.620010][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3604.620289][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3604.620535][ C1] ? iterate_tty_write+0x299/0x540 [ 3604.620797][ C1] ? lock_release+0x1d5/0x250 [ 3604.621038][ C1] vfs_read+0x911/0xc00 [ 3604.621255][ C1] ? lock_acquire+0x1c1/0x220 [ 3604.621492][ C1] ? __might_fault+0xc6/0x180 [ 3604.621738][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3604.621979][ C1] ? __might_fault+0xc6/0x180 [ 3604.622221][ C1] ? lock_release+0x1d5/0x250 [ 3604.622460][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3604.622726][ C1] ? __fget_light+0x54/0x1e0 [ 3604.622960][ C1] ksys_read+0x17a/0x1e0 [ 3604.623181][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3604.623428][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3604.623732][ C1] do_syscall_64+0xc9/0x1e0 [ 3604.623967][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3604.624270][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3604.624498][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3604.625472][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3604.625895][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3604.626296][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3604.626695][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3604.627096][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3604.627497][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3604.627900][ C1] [ 3604.628060][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1166s! [swapper/2:0] [ 3604.628478][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3604.629726][ C2] irq event stamp: 44114564 [ 3604.629954][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3604.630489][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3604.630998][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3604.631477][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3604.631953][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3604.632409][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3604.633019][ C2] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 3604.633307][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 3604.634275][ C2] RSP: 0018:ffffc9000021fa80 EFLAGS: 00000286 [ 3604.634582][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3604.634979][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3604.635377][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3604.635775][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3604.636177][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3604.636575][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3604.637021][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3604.637353][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3604.637754][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3604.638155][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3604.638552][ C2] PKRU: 55555554 [ 3604.638734][ C2] Call Trace: [ 3604.638904][ C2] [ 3604.639052][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3604.639314][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3604.639556][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3604.639835][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3604.640106][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3604.640394][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3604.640657][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3604.640961][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3604.641223][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3604.641485][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3604.641799][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3604.642093][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3604.642407][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3604.642696][ C2] ? kasan_check_range+0x1a/0x1c0 [ 3604.642952][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3604.643232][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3604.643544][ C2] ? get_stack_info+0x36/0xc0 [ 3604.643783][ C2] ? lock_acquire+0x1c1/0x220 [ 3604.644020][ C2] ? lock_release+0x1d5/0x250 [ 3604.644261][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3604.644509][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3604.644779][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3604.645064][ C2] ? lock_acquire+0x1c1/0x220 [ 3604.645301][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3604.645540][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3604.645799][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3604.646034][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3604.646282][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3604.646541][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3604.646814][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3604.647094][ C2] ip_local_deliver+0x19d/0x480 [ 3604.647344][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3604.647614][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3604.647878][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3604.648226][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3604.648478][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3604.648797][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3604.649058][ C2] ip_rcv+0x564/0x740 [ 3604.649263][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3604.649494][ C2] ? set_track_prepare+0x8a/0xd0 [ 3604.649746][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3604.650022][ C2] ? start_secondary+0x21c/0x2b0 [ 3604.650277][ C2] ? skb_clone+0x10b/0x330 [ 3604.650502][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3604.650821][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3604.651128][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3604.651408][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3604.651708][ C2] ? __tcf_classify+0x329/0x7d0 [ 3604.651957][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3604.652187][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3604.652486][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3604.652771][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3604.653095][ C2] ? lock_acquire+0x1c1/0x220 [ 3604.653332][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3604.653629][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3604.653914][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3604.654231][ C2] ? __copy_skb_header+0xaf/0x490 [ 3604.654488][ C2] ? __skb_clone+0x57a/0x760 [ 3604.654723][ C2] netif_receive_skb+0x55/0x280 [ 3604.654969][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3604.655282][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3604.655616][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3604.655913][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3604.656189][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3604.656476][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3604.656788][ C2] ? get_stack_info+0x36/0xc0 [ 3604.657030][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3604.657294][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3604.657610][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3604.657884][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3604.658163][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3604.658477][ C2] ? kernel_text_address+0x17/0xe0 [ 3604.658738][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3604.659050][ C2] ? arch_stack_walk+0x8c/0x100 [ 3604.659299][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3604.659562][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3604.659848][ C2] ? lock_acquire+0x1c1/0x220 [ 3604.660085][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3604.660368][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3604.660673][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3604.660948][ C2] ? get_stack_info+0x36/0xc0 [ 3604.661190][ C2] __tcf_classify+0x329/0x7d0 [ 3604.661429][ C2] tcf_classify+0x283/0x930 [ 3604.661668][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3604.661924][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3604.662237][ C2] tc_run+0x2e4/0x5d0 [ 3604.662440][ C2] ? __pfx_tc_run+0x10/0x10 [ 3604.662672][ C2] ? lock_acquire+0x1c1/0x220 [ 3604.662909][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3604.663170][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3604.663421][ C2] ? lock_acquire+0x1c1/0x220 [ 3604.663659][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3604.663921][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3604.664229][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3604.664499][ C2] ? neigh_hh_output+0x348/0x590 [ 3604.664751][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3604.665014][ C2] ip_finish_output2+0x786/0x18e0 [ 3604.665271][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3604.665610][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3604.665884][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3604.666138][ C2] ? __ip_finish_output+0x10f/0x770 [ 3604.666401][ C2] ip_output+0x16b/0x4f0 [ 3604.666616][ C2] ? __pfx_ip_output+0x10/0x10 [ 3604.666860][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3604.667136][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3604.667445][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3604.667724][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3604.667974][ C2] ? __alloc_skb+0xd4/0x280 [ 3604.668203][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3604.668470][ C2] ? tcp_fragment+0x168/0x1040 [ 3604.668715][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3604.668965][ C2] ? ip_local_out+0x114/0x3b0 [ 3604.669206][ C2] __ip_queue_xmit+0x672/0x1910 [ 3604.669454][ C2] ? __skb_clone+0x57a/0x760 [ 3604.669686][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3604.669953][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3604.670234][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3604.670478][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3604.670732][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3604.671030][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3604.671350][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3604.671593][ C2] tcp_send_loss_probe+0x348/0x830 [ 3604.671863][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3604.672132][ C2] tcp_write_timer+0x82/0x1d0 [ 3604.672371][ C2] call_timer_fn+0x173/0x430 [ 3604.672608][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3604.672869][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3604.673130][ C2] __run_timers.part.0+0x52d/0x890 [ 3604.673390][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3604.673662][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3604.673946][ C2] ? lock_acquire+0x1c1/0x220 [ 3604.674182][ C2] ? clockevents_program_event+0xf6/0x300 [ 3604.674473][ C2] ? lock_release+0x1d5/0x250 [ 3604.674712][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3604.674976][ C2] ? ktime_get+0xb3/0x190 [ 3604.675195][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3604.675490][ C2] run_timer_softirq+0x72/0x100 [ 3604.675738][ C2] __do_softirq+0x1b9/0x7ff [ 3604.675967][ C2] irq_exit_rcu+0x98/0xc0 [ 3604.676190][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3604.676473][ C2] [ 3604.676624][ C2] [ 3604.676779][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3604.677082][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3604.677340][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3604.678306][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3604.678613][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3604.679010][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3604.679407][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3604.679801][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3604.680201][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3604.680601][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3604.680887][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3604.681149][ C2] default_idle_call+0x69/0xa0 [ 3604.681391][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3604.681642][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3604.681925][ C2] ? lock_release+0x1d5/0x250 [ 3604.682163][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3604.682436][ C2] do_idle+0xfb/0x160 [ 3604.682641][ C2] cpu_startup_entry+0x55/0x60 [ 3604.682882][ C2] start_secondary+0x21c/0x2b0 [ 3604.683125][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3604.683394][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3604.683702][ C2] [ 3629.838104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3629.838473][ C1] rcu: 1-....: (1272193 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=311454 [ 3629.839028][ C1] rcu: (t=1274951 jiffies g=1882453 q=703 ncpus=4) [ 3629.839361][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3629.839808][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3629.840422][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3629.840750][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3629.841722][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3629.842031][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3629.842430][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3629.842828][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3629.843228][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3629.843628][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3629.844026][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3629.844473][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3629.844804][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3629.845206][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3629.845605][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3629.846002][ C1] PKRU: 55555554 [ 3629.846186][ C1] Call Trace: [ 3629.846358][ C1] [ 3629.846506][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3629.846777][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3629.847029][ C1] ? check_cpu_stall+0x284/0x500 [ 3629.847282][ C1] ? rcu_pending+0x92/0x360 [ 3629.847514][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3629.847784][ C1] ? update_process_times+0xb9/0x110 [ 3629.848054][ C1] ? tick_sched_handle+0x67/0x130 [ 3629.848311][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3629.848595][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3629.848836][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3629.849150][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3629.849421][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3629.849711][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3629.849976][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3629.850282][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3629.850548][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3629.850857][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3629.851151][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3629.851466][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3629.851763][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3629.852057][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3629.852348][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3629.852659][ C1] ? get_stack_info+0x36/0xc0 [ 3629.852898][ C1] ? lock_acquire+0x1c1/0x220 [ 3629.853140][ C1] ? lock_release+0x1d5/0x250 [ 3629.853381][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3629.853630][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3629.853902][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3629.854191][ C1] ? lock_acquire+0x1c1/0x220 [ 3629.854429][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3629.854670][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3629.854930][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3629.855166][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3629.855413][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3629.855671][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3629.855947][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3629.856223][ C1] ip_local_deliver+0x19d/0x480 [ 3629.856470][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3629.856741][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3629.857003][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3629.857353][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3629.857606][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3629.857926][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3629.858190][ C1] ip_rcv+0x564/0x740 [ 3629.858395][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3629.858625][ C1] ? set_track_prepare+0x8a/0xd0 [ 3629.858879][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3629.859158][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3629.859429][ C1] ? skb_clone+0x10b/0x330 [ 3629.859660][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3629.859979][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3629.860287][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3629.860574][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3629.860869][ C1] ? __tcf_classify+0x329/0x7d0 [ 3629.861119][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3629.861350][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3629.861655][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3629.861942][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3629.862268][ C1] ? lock_acquire+0x1c1/0x220 [ 3629.862506][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3629.862802][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3629.863088][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3629.863406][ C1] ? __copy_skb_header+0xaf/0x490 [ 3629.863663][ C1] ? __skb_clone+0x57a/0x760 [ 3629.863900][ C1] netif_receive_skb+0x55/0x280 [ 3629.864148][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3629.864463][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3629.864794][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3629.865094][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3629.865369][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3629.865656][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3629.865968][ C1] ? hlock_class+0x4e/0x130 [ 3629.866202][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3629.866478][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3629.866753][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3629.867016][ C1] ? hlock_class+0x4e/0x130 [ 3629.867248][ C1] ? mark_lock+0x38/0x3e0 [ 3629.867467][ C1] ? stack_access_ok+0xda/0x1f0 [ 3629.867714][ C1] ? __lock_acquire+0xb67/0x1610 [ 3629.867969][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3629.868246][ C1] ? get_stack_info+0x36/0xc0 [ 3629.868484][ C1] ? stack_access_ok+0xda/0x1f0 [ 3629.868731][ C1] ? get_reg+0x119/0x190 [ 3629.868948][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3629.869217][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3629.869527][ C1] __tcf_classify+0x329/0x7d0 [ 3629.869767][ C1] tcf_classify+0x283/0x930 [ 3629.870001][ C1] ? arch_stack_walk+0xa2/0x100 [ 3629.870251][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3629.870506][ C1] ? get_stack_info+0x36/0xc0 [ 3629.870748][ C1] tc_run+0x2e4/0x5d0 [ 3629.870953][ C1] ? __pfx_tc_run+0x10/0x10 [ 3629.871184][ C1] ? lock_acquire+0x1c1/0x220 [ 3629.871423][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3629.871689][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3629.871941][ C1] ? lock_acquire+0x1c1/0x220 [ 3629.872181][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3629.872446][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3629.872752][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3629.873024][ C1] ? neigh_hh_output+0x348/0x590 [ 3629.873278][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3629.873542][ C1] ip_finish_output2+0x786/0x18e0 [ 3629.873798][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3629.874077][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3629.874416][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3629.874691][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3629.874945][ C1] ? __ip_finish_output+0x10f/0x770 [ 3629.875210][ C1] ip_output+0x16b/0x4f0 [ 3629.875426][ C1] ? run_timer_softirq+0x72/0x100 [ 3629.875682][ C1] ? __pfx_ip_output+0x10/0x10 [ 3629.875927][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3629.876214][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3629.876467][ C1] ? ip_local_out+0x114/0x3b0 [ 3629.876706][ C1] __ip_queue_xmit+0x672/0x1910 [ 3629.876954][ C1] ? __create_object+0x5e/0xb0 [ 3629.877199][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3629.877466][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3629.877751][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3629.878025][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3629.878309][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3629.878579][ C1] tcp_delack_timer+0x84/0x240 [ 3629.878826][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3629.879098][ C1] call_timer_fn+0x173/0x430 [ 3629.879335][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3629.879598][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3629.879858][ C1] __run_timers.part.0+0x52d/0x890 [ 3629.880118][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3629.880393][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3629.880678][ C1] ? lock_acquire+0x1c1/0x220 [ 3629.880918][ C1] ? clockevents_program_event+0xf6/0x300 [ 3629.881208][ C1] ? lock_release+0x1d5/0x250 [ 3629.881450][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3629.881719][ C1] ? ktime_get+0xb3/0x190 [ 3629.881941][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3629.882237][ C1] run_timer_softirq+0x72/0x100 [ 3629.882486][ C1] __do_softirq+0x1b9/0x7ff [ 3629.882719][ C1] irq_exit_rcu+0x98/0xc0 [ 3629.882940][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3629.883228][ C1] [ 3629.883378][ C1] [ 3629.883527][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3629.883835][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3629.884159][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3629.885130][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3629.885436][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3629.885836][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3629.886236][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3629.886636][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3629.887033][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3629.887433][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3629.887730][ C1] pipe_read+0xa16/0xdf0 [ 3629.887949][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3629.888228][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3629.888471][ C1] ? iterate_tty_write+0x299/0x540 [ 3629.888733][ C1] ? lock_release+0x1d5/0x250 [ 3629.888971][ C1] vfs_read+0x911/0xc00 [ 3629.889187][ C1] ? lock_acquire+0x1c1/0x220 [ 3629.889424][ C1] ? __might_fault+0xc6/0x180 [ 3629.889668][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3629.889907][ C1] ? __might_fault+0xc6/0x180 [ 3629.890148][ C1] ? lock_release+0x1d5/0x250 [ 3629.890385][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3629.890650][ C1] ? __fget_light+0x54/0x1e0 [ 3629.890887][ C1] ksys_read+0x17a/0x1e0 [ 3629.891104][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3629.891349][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3629.891661][ C1] do_syscall_64+0xc9/0x1e0 [ 3629.891894][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3629.892193][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3629.892423][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3629.893396][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3629.893817][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3629.894215][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3629.894614][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3629.895012][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3629.895413][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3629.895816][ C1] [ 3629.895972][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3629.896248][ C2] NMI backtrace for cpu 2 [ 3629.896256][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3629.896262][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3629.896267][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3629.896275][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3629.896280][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3629.896285][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3629.896288][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3629.896292][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3629.896296][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3629.896300][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3629.896303][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3629.896308][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3629.896313][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3629.896317][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3629.896321][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3629.896324][ C2] PKRU: 55555554 [ 3629.896326][ C2] Call Trace: [ 3629.896330][ C2] [ 3629.896334][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3629.896347][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3629.896355][ C2] ? nmi_handle+0x153/0x420 [ 3629.896365][ C2] ? default_do_nmi+0x41/0x100 [ 3629.896372][ C2] ? exc_nmi+0xf3/0x120 [ 3629.896378][ C2] ? end_repeat_nmi+0xf/0x60 [ 3629.896389][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3629.896397][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3629.896405][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3629.896414][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3629.896422][ C2] [ 3629.896424][ C2] [ 3629.896427][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3629.896433][ C2] ? get_stack_info+0x36/0xc0 [ 3629.896442][ C2] ? lock_acquire+0x1c1/0x220 [ 3629.896450][ C2] ? lock_release+0x1d5/0x250 [ 3629.896459][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3629.896468][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3629.896475][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3629.896483][ C2] ? lock_acquire+0x1c1/0x220 [ 3629.896489][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3629.896497][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3629.896504][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3629.896521][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3629.896527][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3629.896539][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3629.896550][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3629.896558][ C2] ip_local_deliver+0x19d/0x480 [ 3629.896564][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3629.896569][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3629.896575][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3629.896586][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3629.896593][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3629.896601][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3629.896622][ C2] ip_rcv+0x564/0x740 [ 3629.896628][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3629.896635][ C2] ? set_track_prepare+0x8a/0xd0 [ 3629.896643][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3629.896650][ C2] ? start_secondary+0x21c/0x2b0 [ 3629.896657][ C2] ? skb_clone+0x10b/0x330 [ 3629.896663][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3629.896678][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3629.896693][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3629.896700][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3629.896721][ C2] ? __tcf_classify+0x329/0x7d0 [ 3629.896730][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3629.896735][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3629.896743][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3629.896751][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3629.896762][ C2] ? lock_acquire+0x1c1/0x220 [ 3629.896768][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3629.896778][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3629.896787][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3629.896797][ C2] ? __copy_skb_header+0xaf/0x490 [ 3629.896807][ C2] ? __skb_clone+0x57a/0x760 [ 3629.896813][ C2] netif_receive_skb+0x55/0x280 [ 3629.896821][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3629.896839][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3629.896857][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3629.896875][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3629.896886][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3629.896913][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3629.896932][ C2] ? get_stack_info+0x36/0xc0 [ 3629.896944][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3629.896951][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3629.896959][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3629.896966][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3629.896975][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3629.896981][ C2] ? kernel_text_address+0x17/0xe0 [ 3629.896988][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3629.896997][ C2] ? arch_stack_walk+0x8c/0x100 [ 3629.897005][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3629.897012][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3629.897020][ C2] ? lock_acquire+0x1c1/0x220 [ 3629.897026][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3629.897035][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3629.897041][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3629.897043][ C2] ? get_stack_info+0x36/0xc0 [ 3629.897048][ C2] __tcf_classify+0x329/0x7d0 [ 3629.897053][ C2] tcf_classify+0x283/0x930 [ 3629.897057][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3629.897061][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3629.897065][ C2] tc_run+0x2e4/0x5d0 [ 3629.897069][ C2] ? __pfx_tc_run+0x10/0x10 [ 3629.897072][ C2] ? lock_acquire+0x1c1/0x220 [ 3629.897074][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3629.897078][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3629.897082][ C2] ? lock_acquire+0x1c1/0x220 [ 3629.897084][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3629.897087][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3629.897090][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3629.897092][ C2] ? neigh_hh_output+0x348/0x590 [ 3629.897096][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3629.897099][ C2] ip_finish_output2+0x786/0x18e0 [ 3629.897103][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3629.897110][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3629.897113][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3629.897116][ C2] ? __ip_finish_output+0x10f/0x770 [ 3629.897120][ C2] ip_output+0x16b/0x4f0 [ 3629.897123][ C2] ? __pfx_ip_output+0x10/0x10 [ 3629.897126][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3629.897129][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3629.897132][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3629.897134][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3629.897137][ C2] ? __alloc_skb+0xd4/0x280 [ 3629.897139][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3629.897144][ C2] ? tcp_fragment+0x168/0x1040 [ 3629.897147][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3629.897150][ C2] ? ip_local_out+0x114/0x3b0 [ 3629.897153][ C2] __ip_queue_xmit+0x672/0x1910 [ 3629.897156][ C2] ? __skb_clone+0x57a/0x760 [ 3629.897159][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3629.897165][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3629.897168][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3629.897171][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3629.897175][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3629.897179][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3629.897182][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3629.897186][ C2] tcp_send_loss_probe+0x348/0x830 [ 3629.897189][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3629.897191][ C2] tcp_write_timer+0x82/0x1d0 [ 3629.897195][ C2] call_timer_fn+0x173/0x430 [ 3629.897198][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3629.897203][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3629.897207][ C2] __run_timers.part.0+0x52d/0x890 [ 3629.897209][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3629.897214][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3629.897217][ C2] ? lock_acquire+0x1c1/0x220 [ 3629.897219][ C2] ? clockevents_program_event+0xf6/0x300 [ 3629.897223][ C2] ? lock_release+0x1d5/0x250 [ 3629.897226][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3629.897229][ C2] ? ktime_get+0xb3/0x190 [ 3629.897232][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3629.897237][ C2] run_timer_softirq+0x72/0x100 [ 3629.897240][ C2] __do_softirq+0x1b9/0x7ff [ 3629.897244][ C2] irq_exit_rcu+0x98/0xc0 [ 3629.897246][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3629.897250][ C2] [ 3629.897251][ C2] [ 3629.897252][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3629.897255][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3629.897258][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3629.897260][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3629.897262][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3629.897263][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3629.897265][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3629.897266][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3629.897267][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3629.897270][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3629.897273][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3629.897276][ C2] default_idle_call+0x69/0xa0 [ 3629.897279][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3629.897281][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3629.897285][ C2] ? lock_release+0x1d5/0x250 [ 3629.897287][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3629.897291][ C2] do_idle+0xfb/0x160 [ 3629.897294][ C2] cpu_startup_entry+0x55/0x60 [ 3629.897296][ C2] start_secondary+0x21c/0x2b0 [ 3629.897299][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3629.897303][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3629.897308][ C2] [ 3656.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1214s! [perl:4135] [ 3656.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3656.570951][ C1] irq event stamp: 209232 [ 3656.571172][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3656.571707][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3656.572186][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3656.572658][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3656.573121][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3656.573570][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3656.574185][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 3656.574471][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 3656.575443][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 3656.575752][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3656.576151][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3656.576549][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3656.576950][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3656.577350][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3656.577750][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3656.578198][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3656.578530][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3656.578932][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3656.579332][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3656.579730][ C1] PKRU: 55555554 [ 3656.579912][ C1] Call Trace: [ 3656.580084][ C1] [ 3656.580233][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3656.580494][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3656.580738][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3656.581014][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3656.581290][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3656.581587][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3656.581852][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3656.582161][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3656.582423][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3656.582733][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3656.583027][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3656.583343][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3656.583633][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 3656.583914][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3656.584196][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3656.584510][ C1] ? get_stack_info+0x36/0xc0 [ 3656.584752][ C1] ? lock_acquire+0x1c1/0x220 [ 3656.584994][ C1] ? lock_release+0x1d5/0x250 [ 3656.585235][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3656.585483][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3656.585756][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3656.586041][ C1] ? lock_acquire+0x1c1/0x220 [ 3656.586281][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3656.586522][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3656.586782][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3656.587015][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3656.587264][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3656.587521][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3656.587800][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3656.588078][ C1] ip_local_deliver+0x19d/0x480 [ 3656.588325][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3656.588597][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3656.588860][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3656.589211][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3656.589464][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3656.589784][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3656.590046][ C1] ip_rcv+0x564/0x740 [ 3656.590252][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3656.590482][ C1] ? set_track_prepare+0x8a/0xd0 [ 3656.590736][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3656.591011][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3656.591286][ C1] ? skb_clone+0x10b/0x330 [ 3656.591523][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3656.591841][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3656.592149][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3656.592430][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3656.592727][ C1] ? __tcf_classify+0x329/0x7d0 [ 3656.592979][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3656.593209][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3656.593508][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3656.593792][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3656.594119][ C1] ? lock_acquire+0x1c1/0x220 [ 3656.594357][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3656.594655][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3656.594938][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3656.595255][ C1] ? __copy_skb_header+0xaf/0x490 [ 3656.595512][ C1] ? __skb_clone+0x57a/0x760 [ 3656.595747][ C1] netif_receive_skb+0x55/0x280 [ 3656.595996][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3656.596311][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3656.596643][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3656.596941][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3656.597219][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3656.597508][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3656.597821][ C1] ? hlock_class+0x4e/0x130 [ 3656.598052][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3656.598332][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3656.598608][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3656.598871][ C1] ? hlock_class+0x4e/0x130 [ 3656.599102][ C1] ? mark_lock+0x38/0x3e0 [ 3656.599322][ C1] ? stack_access_ok+0xda/0x1f0 [ 3656.599571][ C1] ? __lock_acquire+0xb67/0x1610 [ 3656.599826][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3656.600100][ C1] ? get_stack_info+0x36/0xc0 [ 3656.600342][ C1] ? stack_access_ok+0xda/0x1f0 [ 3656.600588][ C1] ? get_reg+0x119/0x190 [ 3656.600804][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3656.601072][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3656.601381][ C1] __tcf_classify+0x329/0x7d0 [ 3656.601630][ C1] tcf_classify+0x283/0x930 [ 3656.601864][ C1] ? arch_stack_walk+0xa2/0x100 [ 3656.602114][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3656.602374][ C1] ? get_stack_info+0x36/0xc0 [ 3656.602616][ C1] tc_run+0x2e4/0x5d0 [ 3656.602823][ C1] ? __pfx_tc_run+0x10/0x10 [ 3656.603054][ C1] ? lock_acquire+0x1c1/0x220 [ 3656.603294][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3656.603556][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3656.603810][ C1] ? lock_acquire+0x1c1/0x220 [ 3656.604050][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3656.604316][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3656.604622][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3656.604897][ C1] ? neigh_hh_output+0x348/0x590 [ 3656.605151][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3656.605416][ C1] ip_finish_output2+0x786/0x18e0 [ 3656.605673][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3656.605950][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3656.606287][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3656.606564][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3656.606817][ C1] ? __ip_finish_output+0x10f/0x770 [ 3656.607082][ C1] ip_output+0x16b/0x4f0 [ 3656.607298][ C1] ? run_timer_softirq+0x72/0x100 [ 3656.607555][ C1] ? __pfx_ip_output+0x10/0x10 [ 3656.607800][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3656.608084][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3656.608336][ C1] ? ip_local_out+0x114/0x3b0 [ 3656.608579][ C1] __ip_queue_xmit+0x672/0x1910 [ 3656.608828][ C1] ? __create_object+0x5e/0xb0 [ 3656.609072][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3656.609341][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3656.609622][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3656.609896][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3656.610181][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3656.610454][ C1] tcp_delack_timer+0x84/0x240 [ 3656.610699][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3656.610970][ C1] call_timer_fn+0x173/0x430 [ 3656.611209][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3656.611476][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3656.611739][ C1] __run_timers.part.0+0x52d/0x890 [ 3656.612001][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3656.612275][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3656.612563][ C1] ? lock_acquire+0x1c1/0x220 [ 3656.612802][ C1] ? clockevents_program_event+0xf6/0x300 [ 3656.613094][ C1] ? lock_release+0x1d5/0x250 [ 3656.613336][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3656.613601][ C1] ? ktime_get+0xb3/0x190 [ 3656.613821][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3656.614121][ C1] run_timer_softirq+0x72/0x100 [ 3656.614372][ C1] __do_softirq+0x1b9/0x7ff [ 3656.614603][ C1] irq_exit_rcu+0x98/0xc0 [ 3656.614826][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3656.615112][ C1] [ 3656.615265][ C1] [ 3656.615416][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3656.615722][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3656.616046][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3656.617021][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3656.617332][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3656.617732][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3656.618130][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3656.618530][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3656.618931][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3656.619332][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3656.619629][ C1] pipe_read+0xa16/0xdf0 [ 3656.619853][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3656.620130][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3656.620375][ C1] ? iterate_tty_write+0x299/0x540 [ 3656.620635][ C1] ? lock_release+0x1d5/0x250 [ 3656.620876][ C1] vfs_read+0x911/0xc00 [ 3656.621089][ C1] ? lock_acquire+0x1c1/0x220 [ 3656.621329][ C1] ? __might_fault+0xc6/0x180 [ 3656.621575][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3656.621814][ C1] ? __might_fault+0xc6/0x180 [ 3656.622052][ C1] ? lock_release+0x1d5/0x250 [ 3656.622294][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3656.622559][ C1] ? __fget_light+0x54/0x1e0 [ 3656.622799][ C1] ksys_read+0x17a/0x1e0 [ 3656.623016][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3656.623262][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3656.623567][ C1] do_syscall_64+0xc9/0x1e0 [ 3656.623799][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3656.624100][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3656.624329][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3656.625300][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3656.625720][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3656.626122][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3656.626521][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3656.626923][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3656.627321][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3656.627725][ C1] [ 3656.627882][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1214s! [swapper/2:0] [ 3656.628301][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3656.629553][ C2] irq event stamp: 44114564 [ 3656.629783][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3656.630317][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3656.630827][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3656.631305][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3656.631782][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3656.632238][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3656.632849][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3656.633175][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3656.634147][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3656.634453][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3656.634852][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3656.635249][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3656.635647][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3656.636046][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3656.636444][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3656.636888][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3656.637222][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3656.637620][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3656.638018][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3656.638417][ C2] PKRU: 55555554 [ 3656.638598][ C2] Call Trace: [ 3656.638768][ C2] [ 3656.638916][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3656.639177][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3656.639421][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3656.639696][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3656.639965][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3656.640255][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3656.640519][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3656.640826][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3656.641085][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3656.641349][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3656.641663][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3656.641958][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3656.642272][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3656.642561][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3656.642853][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3656.643143][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3656.643453][ C2] ? get_stack_info+0x36/0xc0 [ 3656.643691][ C2] ? lock_acquire+0x1c1/0x220 [ 3656.643931][ C2] ? lock_release+0x1d5/0x250 [ 3656.644171][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3656.644419][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3656.644689][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3656.644971][ C2] ? lock_acquire+0x1c1/0x220 [ 3656.645210][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3656.645450][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3656.645708][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3656.645942][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3656.646189][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3656.646445][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3656.646720][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3656.646995][ C2] ip_local_deliver+0x19d/0x480 [ 3656.647242][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3656.647512][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3656.647773][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3656.648120][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3656.648372][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3656.648691][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3656.648952][ C2] ip_rcv+0x564/0x740 [ 3656.649156][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3656.649386][ C2] ? set_track_prepare+0x8a/0xd0 [ 3656.649639][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3656.649917][ C2] ? start_secondary+0x21c/0x2b0 [ 3656.650168][ C2] ? skb_clone+0x10b/0x330 [ 3656.650394][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3656.650711][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3656.651016][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3656.651296][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3656.651596][ C2] ? __tcf_classify+0x329/0x7d0 [ 3656.651844][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3656.652076][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3656.652377][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3656.652663][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3656.652988][ C2] ? lock_acquire+0x1c1/0x220 [ 3656.653227][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3656.653523][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3656.653805][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3656.654122][ C2] ? __copy_skb_header+0xaf/0x490 [ 3656.654378][ C2] ? __skb_clone+0x57a/0x760 [ 3656.654612][ C2] netif_receive_skb+0x55/0x280 [ 3656.654860][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3656.655173][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3656.655505][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3656.655801][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3656.656076][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3656.656363][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3656.656673][ C2] ? get_stack_info+0x36/0xc0 [ 3656.656912][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3656.657177][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3656.657492][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3656.657766][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3656.658040][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3656.658353][ C2] ? kernel_text_address+0x17/0xe0 [ 3656.658612][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3656.658922][ C2] ? arch_stack_walk+0x8c/0x100 [ 3656.659171][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3656.659433][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3656.659716][ C2] ? lock_acquire+0x1c1/0x220 [ 3656.659953][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3656.660235][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3656.660536][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3656.660813][ C2] ? get_stack_info+0x36/0xc0 [ 3656.661051][ C2] __tcf_classify+0x329/0x7d0 [ 3656.661292][ C2] tcf_classify+0x283/0x930 [ 3656.661530][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3656.661786][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3656.662098][ C2] tc_run+0x2e4/0x5d0 [ 3656.662302][ C2] ? __pfx_tc_run+0x10/0x10 [ 3656.662533][ C2] ? lock_acquire+0x1c1/0x220 [ 3656.662769][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3656.663029][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3656.663281][ C2] ? lock_acquire+0x1c1/0x220 [ 3656.663520][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3656.663782][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3656.664085][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3656.664355][ C2] ? neigh_hh_output+0x348/0x590 [ 3656.664606][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3656.664869][ C2] ip_finish_output2+0x786/0x18e0 [ 3656.665125][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3656.665459][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3656.665736][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3656.665987][ C2] ? __ip_finish_output+0x10f/0x770 [ 3656.666252][ C2] ip_output+0x16b/0x4f0 [ 3656.666467][ C2] ? __pfx_ip_output+0x10/0x10 [ 3656.666709][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3656.666984][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3656.667300][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3656.667575][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3656.667825][ C2] ? __alloc_skb+0xd4/0x280 [ 3656.668057][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3656.668326][ C2] ? tcp_fragment+0x168/0x1040 [ 3656.668570][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3656.668821][ C2] ? ip_local_out+0x114/0x3b0 [ 3656.669062][ C2] __ip_queue_xmit+0x672/0x1910 [ 3656.669310][ C2] ? __skb_clone+0x57a/0x760 [ 3656.669543][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3656.669809][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3656.670091][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3656.670336][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3656.670584][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3656.670884][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3656.671203][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3656.671453][ C2] tcp_send_loss_probe+0x348/0x830 [ 3656.671713][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3656.671979][ C2] tcp_write_timer+0x82/0x1d0 [ 3656.672219][ C2] call_timer_fn+0x173/0x430 [ 3656.672455][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3656.672716][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3656.672977][ C2] __run_timers.part.0+0x52d/0x890 [ 3656.673237][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3656.673506][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3656.673789][ C2] ? lock_acquire+0x1c1/0x220 [ 3656.674026][ C2] ? clockevents_program_event+0xf6/0x300 [ 3656.674318][ C2] ? lock_release+0x1d5/0x250 [ 3656.674556][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3656.674820][ C2] ? ktime_get+0xb3/0x190 [ 3656.675040][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3656.675337][ C2] run_timer_softirq+0x72/0x100 [ 3656.675589][ C2] __do_softirq+0x1b9/0x7ff [ 3656.675820][ C2] irq_exit_rcu+0x98/0xc0 [ 3656.676040][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3656.676326][ C2] [ 3656.676474][ C2] [ 3656.676625][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3656.676928][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3656.677184][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3656.678151][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3656.678456][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3656.678855][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3656.679253][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3656.679648][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3656.680046][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3656.680446][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3656.680732][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3656.680991][ C2] default_idle_call+0x69/0xa0 [ 3656.681236][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3656.681497][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3656.681772][ C2] ? lock_release+0x1d5/0x250 [ 3656.682011][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3656.682283][ C2] do_idle+0xfb/0x160 [ 3656.682487][ C2] cpu_startup_entry+0x55/0x60 [ 3656.682728][ C2] start_secondary+0x21c/0x2b0 [ 3656.682972][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3656.683240][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3656.683550][ C2] [ 3684.569272][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1240s! [swapper/2:0] [ 3684.569692][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3684.570939][ C2] irq event stamp: 44114564 [ 3684.571169][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3684.571705][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3684.572215][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3684.572689][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3684.573157][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3684.573611][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3684.574225][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3684.574548][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3684.575515][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3684.575818][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3684.576222][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3684.576618][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3684.577013][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3684.577412][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3684.577809][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3684.578254][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3684.578585][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3684.578982][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3684.579382][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3684.579778][ C2] PKRU: 55555554 [ 3684.579964][ C2] Call Trace: [ 3684.580132][ C2] [ 3684.580281][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3684.580542][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3684.580784][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3684.581060][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3684.581338][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3684.581626][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3684.581890][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3684.582200][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3684.582460][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3684.582721][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3684.583027][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3684.583321][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3684.583633][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3684.583920][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3684.584216][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3684.584503][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3684.584812][ C2] ? get_stack_info+0x36/0xc0 [ 3684.585052][ C2] ? lock_acquire+0x1c1/0x220 [ 3684.585292][ C2] ? lock_release+0x1d5/0x250 [ 3684.585532][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3684.585778][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3684.586048][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3684.586332][ C2] ? lock_acquire+0x1c1/0x220 [ 3684.586570][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3684.586809][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3684.587068][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3684.587301][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3684.587546][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3684.587806][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3684.588080][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3684.588357][ C2] ip_local_deliver+0x19d/0x480 [ 3684.588604][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3684.588873][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3684.589135][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3684.589481][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3684.589732][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3684.590050][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3684.590312][ C2] ip_rcv+0x564/0x740 [ 3684.590517][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3684.590744][ C2] ? set_track_prepare+0x8a/0xd0 [ 3684.590995][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3684.591279][ C2] ? start_secondary+0x21c/0x2b0 [ 3684.591528][ C2] ? skb_clone+0x10b/0x330 [ 3684.591754][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3684.592071][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3684.592376][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3684.592655][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3684.592948][ C2] ? __tcf_classify+0x329/0x7d0 [ 3684.593200][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3684.593429][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3684.593727][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3684.594008][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3684.594332][ C2] ? lock_acquire+0x1c1/0x220 [ 3684.594571][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3684.594866][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3684.595149][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3684.595464][ C2] ? __copy_skb_header+0xaf/0x490 [ 3684.595720][ C2] ? __skb_clone+0x57a/0x760 [ 3684.595955][ C2] netif_receive_skb+0x55/0x280 [ 3684.596202][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3684.596511][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3684.596842][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3684.597140][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3684.597412][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3684.597701][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3684.598012][ C2] ? get_stack_info+0x36/0xc0 [ 3684.598251][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3684.598515][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3684.598831][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3684.599108][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3684.599384][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3684.599697][ C2] ? kernel_text_address+0x17/0xe0 [ 3684.599957][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3684.600272][ C2] ? arch_stack_walk+0x8c/0x100 [ 3684.600521][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3684.600784][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3684.601066][ C2] ? lock_acquire+0x1c1/0x220 [ 3684.601311][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3684.601593][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3684.601895][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3684.602171][ C2] ? get_stack_info+0x36/0xc0 [ 3684.602410][ C2] __tcf_classify+0x329/0x7d0 [ 3684.602652][ C2] tcf_classify+0x283/0x930 [ 3684.602884][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3684.603139][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3684.603450][ C2] tc_run+0x2e4/0x5d0 [ 3684.603656][ C2] ? __pfx_tc_run+0x10/0x10 [ 3684.603883][ C2] ? lock_acquire+0x1c1/0x220 [ 3684.604123][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3684.604381][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3684.604632][ C2] ? lock_acquire+0x1c1/0x220 [ 3684.604870][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3684.605134][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3684.605435][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3684.605706][ C2] ? neigh_hh_output+0x348/0x590 [ 3684.605957][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3684.606221][ C2] ip_finish_output2+0x786/0x18e0 [ 3684.606476][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3684.606810][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3684.607085][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3684.607336][ C2] ? __ip_finish_output+0x10f/0x770 [ 3684.607601][ C2] ip_output+0x16b/0x4f0 [ 3684.607816][ C2] ? __pfx_ip_output+0x10/0x10 [ 3684.608059][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3684.608334][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3684.608649][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3684.608925][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3684.609176][ C2] ? __alloc_skb+0xd4/0x280 [ 3684.609407][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3684.609676][ C2] ? tcp_fragment+0x168/0x1040 [ 3684.609919][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3684.610171][ C2] ? ip_local_out+0x114/0x3b0 [ 3684.610409][ C2] __ip_queue_xmit+0x672/0x1910 [ 3684.610655][ C2] ? __skb_clone+0x57a/0x760 [ 3684.610890][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3684.611156][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3684.611444][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3684.611687][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3684.611936][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3684.612237][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3684.612555][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3684.612799][ C2] tcp_send_loss_probe+0x348/0x830 [ 3684.613058][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3684.613325][ C2] tcp_write_timer+0x82/0x1d0 [ 3684.613565][ C2] call_timer_fn+0x173/0x430 [ 3684.613800][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3684.614061][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3684.614323][ C2] __run_timers.part.0+0x52d/0x890 [ 3684.614586][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3684.614855][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3684.615138][ C2] ? lock_acquire+0x1c1/0x220 [ 3684.615377][ C2] ? clockevents_program_event+0xf6/0x300 [ 3684.615666][ C2] ? lock_release+0x1d5/0x250 [ 3684.615904][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3684.616172][ C2] ? ktime_get+0xb3/0x190 [ 3684.616394][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3684.616689][ C2] run_timer_softirq+0x72/0x100 [ 3684.616935][ C2] __do_softirq+0x1b9/0x7ff [ 3684.617168][ C2] irq_exit_rcu+0x98/0xc0 [ 3684.617386][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3684.617672][ C2] [ 3684.617820][ C2] [ 3684.617971][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3684.618273][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3684.618530][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3684.619496][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3684.619802][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3684.620200][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3684.620598][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3684.620993][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3684.621397][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3684.621797][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3684.622085][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3684.622344][ C2] default_idle_call+0x69/0xa0 [ 3684.622587][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3684.622837][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3684.623113][ C2] ? lock_release+0x1d5/0x250 [ 3684.623352][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3684.623623][ C2] do_idle+0xfb/0x160 [ 3684.623825][ C2] cpu_startup_entry+0x55/0x60 [ 3684.624068][ C2] start_secondary+0x21c/0x2b0 [ 3684.624311][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3684.624578][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3684.624888][ C2] [ 3684.625045][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1240s! [perl:4135] [ 3684.625475][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3684.626737][ C1] irq event stamp: 209232 [ 3684.626957][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3684.627491][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3684.627971][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3684.628446][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3684.628911][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3684.629363][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3684.629978][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3684.630306][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3684.631292][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3684.631599][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3684.632003][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3684.632405][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3684.632807][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3684.633208][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3684.633609][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3684.634059][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3684.634394][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3684.634797][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3684.635198][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3684.635601][ C1] PKRU: 55555554 [ 3684.635783][ C1] Call Trace: [ 3684.635954][ C1] [ 3684.636105][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3684.636369][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3684.636611][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3684.636893][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3684.637171][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3684.637460][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3684.637728][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3684.638033][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3684.638296][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3684.638610][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3684.638908][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3684.639226][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3684.639516][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3684.639813][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3684.640102][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3684.640416][ C1] ? get_stack_info+0x36/0xc0 [ 3684.640659][ C1] ? lock_acquire+0x1c1/0x220 [ 3684.640902][ C1] ? lock_release+0x1d5/0x250 [ 3684.641143][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3684.641398][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3684.641675][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3684.641963][ C1] ? lock_acquire+0x1c1/0x220 [ 3684.642204][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3684.642445][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3684.642706][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3684.642941][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3684.643189][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3684.643448][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3684.643724][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3684.644008][ C1] ip_local_deliver+0x19d/0x480 [ 3684.644256][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3684.644529][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3684.644794][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3684.645143][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3684.645397][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3684.645719][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3684.645983][ C1] ip_rcv+0x564/0x740 [ 3684.646188][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3684.646421][ C1] ? set_track_prepare+0x8a/0xd0 [ 3684.646677][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3684.646954][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3684.647230][ C1] ? skb_clone+0x10b/0x330 [ 3684.647458][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3684.647779][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3684.648088][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3684.648371][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3684.648669][ C1] ? __tcf_classify+0x329/0x7d0 [ 3684.648918][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3684.649150][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3684.649452][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3684.649738][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3684.650063][ C1] ? lock_acquire+0x1c1/0x220 [ 3684.650305][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3684.650604][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3684.650889][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3684.651208][ C1] ? __copy_skb_header+0xaf/0x490 [ 3684.651473][ C1] ? __skb_clone+0x57a/0x760 [ 3684.651710][ C1] netif_receive_skb+0x55/0x280 [ 3684.651961][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3684.652274][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3684.652609][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3684.652909][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3684.653186][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3684.653477][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3684.653792][ C1] ? hlock_class+0x4e/0x130 [ 3684.654025][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3684.654303][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3684.654580][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3684.654846][ C1] ? hlock_class+0x4e/0x130 [ 3684.655078][ C1] ? mark_lock+0x38/0x3e0 [ 3684.655298][ C1] ? stack_access_ok+0xda/0x1f0 [ 3684.655548][ C1] ? __lock_acquire+0xb67/0x1610 [ 3684.655803][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3684.656080][ C1] ? get_stack_info+0x36/0xc0 [ 3684.656323][ C1] ? stack_access_ok+0xda/0x1f0 [ 3684.656571][ C1] ? get_reg+0x119/0x190 [ 3684.656786][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3684.657055][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3684.657365][ C1] __tcf_classify+0x329/0x7d0 [ 3684.657613][ C1] tcf_classify+0x283/0x930 [ 3684.657847][ C1] ? arch_stack_walk+0xa2/0x100 [ 3684.658096][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3684.658354][ C1] ? get_stack_info+0x36/0xc0 [ 3684.658595][ C1] tc_run+0x2e4/0x5d0 [ 3684.658801][ C1] ? __pfx_tc_run+0x10/0x10 [ 3684.659035][ C1] ? lock_acquire+0x1c1/0x220 [ 3684.659276][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3684.659538][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3684.659793][ C1] ? lock_acquire+0x1c1/0x220 [ 3684.660034][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3684.660301][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3684.660606][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3684.660882][ C1] ? neigh_hh_output+0x348/0x590 [ 3684.661136][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3684.661409][ C1] ip_finish_output2+0x786/0x18e0 [ 3684.661666][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3684.661946][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3684.662284][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3684.662561][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3684.662815][ C1] ? __ip_finish_output+0x10f/0x770 [ 3684.663083][ C1] ip_output+0x16b/0x4f0 [ 3684.663301][ C1] ? run_timer_softirq+0x72/0x100 [ 3684.663559][ C1] ? __pfx_ip_output+0x10/0x10 [ 3684.663804][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3684.664089][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3684.664343][ C1] ? ip_local_out+0x114/0x3b0 [ 3684.664585][ C1] __ip_queue_xmit+0x672/0x1910 [ 3684.664836][ C1] ? __create_object+0x5e/0xb0 [ 3684.665081][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3684.665350][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3684.665632][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3684.665906][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3684.666191][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3684.666464][ C1] tcp_delack_timer+0x84/0x240 [ 3684.666710][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3684.666983][ C1] call_timer_fn+0x173/0x430 [ 3684.667222][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3684.667486][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3684.667749][ C1] __run_timers.part.0+0x52d/0x890 [ 3684.668011][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3684.668286][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3684.668574][ C1] ? lock_acquire+0x1c1/0x220 [ 3684.668812][ C1] ? clockevents_program_event+0xf6/0x300 [ 3684.669107][ C1] ? lock_release+0x1d5/0x250 [ 3684.669347][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3684.669614][ C1] ? ktime_get+0xb3/0x190 [ 3684.669836][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3684.670135][ C1] run_timer_softirq+0x72/0x100 [ 3684.670385][ C1] __do_softirq+0x1b9/0x7ff [ 3684.670617][ C1] irq_exit_rcu+0x98/0xc0 [ 3684.670840][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3684.671127][ C1] [ 3684.671284][ C1] [ 3684.671436][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3684.671743][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3684.672071][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3684.673046][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3684.673357][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3684.673760][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3684.674161][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3684.674559][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3684.674961][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3684.675364][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3684.675662][ C1] pipe_read+0xa16/0xdf0 [ 3684.675884][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3684.676163][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3684.676408][ C1] ? iterate_tty_write+0x299/0x540 [ 3684.676671][ C1] ? lock_release+0x1d5/0x250 [ 3684.676913][ C1] vfs_read+0x911/0xc00 [ 3684.677127][ C1] ? lock_acquire+0x1c1/0x220 [ 3684.677367][ C1] ? __might_fault+0xc6/0x180 [ 3684.677608][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3684.677846][ C1] ? __might_fault+0xc6/0x180 [ 3684.678088][ C1] ? lock_release+0x1d5/0x250 [ 3684.678329][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3684.678594][ C1] ? __fget_light+0x54/0x1e0 [ 3684.678833][ C1] ksys_read+0x17a/0x1e0 [ 3684.679050][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3684.679296][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3684.679602][ C1] do_syscall_64+0xc9/0x1e0 [ 3684.679833][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3684.680135][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3684.680364][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3684.681353][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3684.681774][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3684.682176][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3684.682578][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3684.682981][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3684.683381][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3684.683784][ C1] [ 3707.901104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3707.901480][ C1] rcu: 1-....: (1350027 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=330380 [ 3707.902039][ C1] rcu: (t=1353014 jiffies g=1882453 q=703 ncpus=4) [ 3707.902376][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3707.902827][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3707.903444][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3707.903775][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3707.904753][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3707.905061][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3707.905465][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3707.905866][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3707.906267][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3707.906669][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3707.907071][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3707.907523][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3707.907858][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3707.908261][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3707.908662][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3707.909065][ C1] PKRU: 55555554 [ 3707.909248][ C1] Call Trace: [ 3707.909418][ C1] [ 3707.909570][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3707.909845][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3707.910100][ C1] ? check_cpu_stall+0x284/0x500 [ 3707.910353][ C1] ? rcu_pending+0x92/0x360 [ 3707.910585][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3707.910857][ C1] ? update_process_times+0xb9/0x110 [ 3707.911131][ C1] ? tick_sched_handle+0x67/0x130 [ 3707.911398][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3707.911683][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3707.911928][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3707.912247][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3707.912524][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3707.912815][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3707.913083][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3707.913390][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3707.913654][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3707.913964][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3707.914265][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3707.914583][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3707.914872][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3707.915171][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3707.915462][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3707.915774][ C1] ? get_stack_info+0x36/0xc0 [ 3707.916017][ C1] ? lock_acquire+0x1c1/0x220 [ 3707.916261][ C1] ? lock_release+0x1d5/0x250 [ 3707.916502][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3707.916752][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3707.917027][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3707.917313][ C1] ? lock_acquire+0x1c1/0x220 [ 3707.917554][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3707.917798][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3707.918059][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3707.918295][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3707.918544][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3707.918803][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3707.919083][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3707.919362][ C1] ip_local_deliver+0x19d/0x480 [ 3707.919611][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3707.919888][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3707.920155][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3707.920505][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3707.920760][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3707.921083][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3707.921353][ C1] ip_rcv+0x564/0x740 [ 3707.921560][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3707.921792][ C1] ? set_track_prepare+0x8a/0xd0 [ 3707.922048][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3707.922327][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3707.922604][ C1] ? skb_clone+0x10b/0x330 [ 3707.922834][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3707.923156][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3707.923466][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3707.923750][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3707.924050][ C1] ? __tcf_classify+0x329/0x7d0 [ 3707.924303][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3707.924535][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3707.924839][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3707.925130][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3707.925459][ C1] ? lock_acquire+0x1c1/0x220 [ 3707.925700][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3707.926001][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3707.926290][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3707.926610][ C1] ? __copy_skb_header+0xaf/0x490 [ 3707.926870][ C1] ? __skb_clone+0x57a/0x760 [ 3707.927112][ C1] netif_receive_skb+0x55/0x280 [ 3707.927365][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3707.927688][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3707.928026][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3707.928330][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3707.928609][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3707.928900][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3707.929217][ C1] ? hlock_class+0x4e/0x130 [ 3707.929453][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3707.929733][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3707.930011][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3707.930279][ C1] ? hlock_class+0x4e/0x130 [ 3707.930515][ C1] ? mark_lock+0x38/0x3e0 [ 3707.930736][ C1] ? stack_access_ok+0xda/0x1f0 [ 3707.930987][ C1] ? __lock_acquire+0xb67/0x1610 [ 3707.931251][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3707.931529][ C1] ? get_stack_info+0x36/0xc0 [ 3707.931776][ C1] ? stack_access_ok+0xda/0x1f0 [ 3707.932026][ C1] ? get_reg+0x119/0x190 [ 3707.932246][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3707.932517][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3707.932829][ C1] __tcf_classify+0x329/0x7d0 [ 3707.933073][ C1] tcf_classify+0x283/0x930 [ 3707.933310][ C1] ? arch_stack_walk+0xa2/0x100 [ 3707.933563][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3707.933821][ C1] ? get_stack_info+0x36/0xc0 [ 3707.934063][ C1] tc_run+0x2e4/0x5d0 [ 3707.934273][ C1] ? __pfx_tc_run+0x10/0x10 [ 3707.934504][ C1] ? lock_acquire+0x1c1/0x220 [ 3707.934747][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3707.935012][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3707.935271][ C1] ? lock_acquire+0x1c1/0x220 [ 3707.935513][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3707.935780][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3707.936091][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3707.936367][ C1] ? neigh_hh_output+0x348/0x590 [ 3707.936621][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3707.936888][ C1] ip_finish_output2+0x786/0x18e0 [ 3707.937152][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3707.937435][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3707.937776][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3707.938058][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3707.938315][ C1] ? __ip_finish_output+0x10f/0x770 [ 3707.938583][ C1] ip_output+0x16b/0x4f0 [ 3707.938802][ C1] ? run_timer_softirq+0x72/0x100 [ 3707.939061][ C1] ? __pfx_ip_output+0x10/0x10 [ 3707.939308][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3707.939597][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3707.939851][ C1] ? ip_local_out+0x114/0x3b0 [ 3707.940095][ C1] __ip_queue_xmit+0x672/0x1910 [ 3707.940348][ C1] ? __create_object+0x5e/0xb0 [ 3707.940602][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3707.940872][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3707.941161][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3707.941438][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3707.941723][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3707.941998][ C1] tcp_delack_timer+0x84/0x240 [ 3707.942246][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3707.942521][ C1] call_timer_fn+0x173/0x430 [ 3707.942761][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3707.943026][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3707.943291][ C1] __run_timers.part.0+0x52d/0x890 [ 3707.943554][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3707.943830][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3707.944123][ C1] ? lock_acquire+0x1c1/0x220 [ 3707.944365][ C1] ? clockevents_program_event+0xf6/0x300 [ 3707.944658][ C1] ? lock_release+0x1d5/0x250 [ 3707.944901][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3707.945168][ C1] ? ktime_get+0xb3/0x190 [ 3707.945390][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3707.945693][ C1] run_timer_softirq+0x72/0x100 [ 3707.945944][ C1] __do_softirq+0x1b9/0x7ff [ 3707.946182][ C1] irq_exit_rcu+0x98/0xc0 [ 3707.946405][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3707.946694][ C1] [ 3707.946849][ C1] [ 3707.947000][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3707.947310][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3707.947639][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3707.948622][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3707.948935][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3707.949338][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3707.949741][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3707.950146][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3707.950550][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3707.950953][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3707.951262][ C1] pipe_read+0xa16/0xdf0 [ 3707.951484][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3707.951764][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3707.952010][ C1] ? iterate_tty_write+0x299/0x540 [ 3707.952274][ C1] ? lock_release+0x1d5/0x250 [ 3707.952518][ C1] vfs_read+0x911/0xc00 [ 3707.952733][ C1] ? lock_acquire+0x1c1/0x220 [ 3707.952974][ C1] ? __might_fault+0xc6/0x180 [ 3707.953218][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3707.953462][ C1] ? __might_fault+0xc6/0x180 [ 3707.953702][ C1] ? lock_release+0x1d5/0x250 [ 3707.953944][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3707.954212][ C1] ? __fget_light+0x54/0x1e0 [ 3707.954452][ C1] ksys_read+0x17a/0x1e0 [ 3707.954671][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3707.954917][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3707.955225][ C1] do_syscall_64+0xc9/0x1e0 [ 3707.955459][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3707.955762][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3707.955993][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3707.956971][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3707.957395][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3707.957800][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3707.958202][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3707.958605][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3707.959007][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3707.959415][ C1] [ 3707.959573][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3707.959848][ C2] NMI backtrace for cpu 2 [ 3707.959854][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3707.959860][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3707.959864][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3707.959869][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3707.959871][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3707.959874][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3707.959875][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3707.959877][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3707.959878][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3707.959880][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3707.959881][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3707.959883][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3707.959887][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3707.959888][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3707.959889][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3707.959891][ C2] PKRU: 55555554 [ 3707.959892][ C2] Call Trace: [ 3707.959894][ C2] [ 3707.959898][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3707.959905][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3707.959910][ C2] ? nmi_handle+0x153/0x420 [ 3707.959915][ C2] ? default_do_nmi+0x41/0x100 [ 3707.959918][ C2] ? exc_nmi+0xf3/0x120 [ 3707.959921][ C2] ? end_repeat_nmi+0xf/0x60 [ 3707.959925][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3707.959929][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3707.959932][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3707.959935][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3707.959938][ C2] [ 3707.959939][ C2] [ 3707.959940][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3707.959942][ C2] ? get_stack_info+0x36/0xc0 [ 3707.959946][ C2] ? lock_acquire+0x1c1/0x220 [ 3707.959950][ C2] ? lock_release+0x1d5/0x250 [ 3707.959953][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3707.959957][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3707.959959][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3707.959963][ C2] ? lock_acquire+0x1c1/0x220 [ 3707.959965][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3707.959968][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3707.959971][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3707.959977][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3707.959980][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3707.959984][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3707.959990][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3707.959994][ C2] ip_local_deliver+0x19d/0x480 [ 3707.959996][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3707.959998][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3707.960000][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3707.960005][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3707.960008][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3707.960010][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3707.960019][ C2] ip_rcv+0x564/0x740 [ 3707.960021][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3707.960024][ C2] ? set_track_prepare+0x8a/0xd0 [ 3707.960027][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3707.960030][ C2] ? start_secondary+0x21c/0x2b0 [ 3707.960033][ C2] ? skb_clone+0x10b/0x330 [ 3707.960036][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3707.960042][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3707.960048][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3707.960051][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3707.960059][ C2] ? __tcf_classify+0x329/0x7d0 [ 3707.960063][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3707.960065][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3707.960068][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3707.960072][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3707.960076][ C2] ? lock_acquire+0x1c1/0x220 [ 3707.960078][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3707.960082][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3707.960085][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3707.960089][ C2] ? __copy_skb_header+0xaf/0x490 [ 3707.960093][ C2] ? __skb_clone+0x57a/0x760 [ 3707.960095][ C2] netif_receive_skb+0x55/0x280 [ 3707.960099][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3707.960106][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3707.960113][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3707.960120][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3707.960124][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3707.960134][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3707.960141][ C2] ? get_stack_info+0x36/0xc0 [ 3707.960146][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3707.960149][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3707.960152][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3707.960154][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3707.960158][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3707.960160][ C2] ? kernel_text_address+0x17/0xe0 [ 3707.960163][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3707.960166][ C2] ? arch_stack_walk+0x8c/0x100 [ 3707.960170][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3707.960173][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3707.960176][ C2] ? lock_acquire+0x1c1/0x220 [ 3707.960178][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3707.960182][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3707.960186][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3707.960188][ C2] ? get_stack_info+0x36/0xc0 [ 3707.960193][ C2] __tcf_classify+0x329/0x7d0 [ 3707.960198][ C2] tcf_classify+0x283/0x930 [ 3707.960202][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3707.960205][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3707.960209][ C2] tc_run+0x2e4/0x5d0 [ 3707.960213][ C2] ? __pfx_tc_run+0x10/0x10 [ 3707.960216][ C2] ? lock_acquire+0x1c1/0x220 [ 3707.960218][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3707.960222][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3707.960226][ C2] ? lock_acquire+0x1c1/0x220 [ 3707.960228][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3707.960231][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3707.960234][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3707.960237][ C2] ? neigh_hh_output+0x348/0x590 [ 3707.960240][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3707.960244][ C2] ip_finish_output2+0x786/0x18e0 [ 3707.960247][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3707.960255][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3707.960257][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3707.960261][ C2] ? __ip_finish_output+0x10f/0x770 [ 3707.960265][ C2] ip_output+0x16b/0x4f0 [ 3707.960268][ C2] ? __pfx_ip_output+0x10/0x10 [ 3707.960271][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3707.960274][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3707.960277][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3707.960280][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3707.960282][ C2] ? __alloc_skb+0xd4/0x280 [ 3707.960285][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3707.960289][ C2] ? tcp_fragment+0x168/0x1040 [ 3707.960291][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3707.960294][ C2] ? ip_local_out+0x114/0x3b0 [ 3707.960297][ C2] __ip_queue_xmit+0x672/0x1910 [ 3707.960301][ C2] ? __skb_clone+0x57a/0x760 [ 3707.960304][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3707.960309][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3707.960312][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3707.960315][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3707.960320][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3707.960323][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3707.960326][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3707.960330][ C2] tcp_send_loss_probe+0x348/0x830 [ 3707.960333][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3707.960335][ C2] tcp_write_timer+0x82/0x1d0 [ 3707.960338][ C2] call_timer_fn+0x173/0x430 [ 3707.960342][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3707.960346][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3707.960350][ C2] __run_timers.part.0+0x52d/0x890 [ 3707.960353][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3707.960357][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3707.960360][ C2] ? lock_acquire+0x1c1/0x220 [ 3707.960362][ C2] ? clockevents_program_event+0xf6/0x300 [ 3707.960366][ C2] ? lock_release+0x1d5/0x250 [ 3707.960369][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3707.960372][ C2] ? ktime_get+0xb3/0x190 [ 3707.960375][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3707.960379][ C2] run_timer_softirq+0x72/0x100 [ 3707.960382][ C2] __do_softirq+0x1b9/0x7ff [ 3707.960386][ C2] irq_exit_rcu+0x98/0xc0 [ 3707.960389][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3707.960392][ C2] [ 3707.960393][ C2] [ 3707.960394][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3707.960397][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3707.960400][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3707.960402][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3707.960405][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3707.960406][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3707.960408][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3707.960409][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3707.960410][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3707.960413][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3707.960416][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3707.960419][ C2] default_idle_call+0x69/0xa0 [ 3707.960422][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3707.960424][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3707.960428][ C2] ? lock_release+0x1d5/0x250 [ 3707.960430][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3707.960434][ C2] do_idle+0xfb/0x160 [ 3707.960437][ C2] cpu_startup_entry+0x55/0x60 [ 3707.960439][ C2] start_secondary+0x21c/0x2b0 [ 3707.960442][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3707.960446][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3707.960451][ C2] [ 3732.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1285s! [perl:4135] [ 3732.569699][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3732.570967][ C1] irq event stamp: 209232 [ 3732.571194][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3732.571723][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3732.572202][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3732.572675][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3732.573141][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3732.573592][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3732.574206][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3732.574533][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3732.575510][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3732.575818][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3732.576221][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3732.576623][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3732.577024][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3732.577426][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3732.577831][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3732.578282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3732.578618][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3732.579019][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3732.579422][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3732.579826][ C1] PKRU: 55555554 [ 3732.580009][ C1] Call Trace: [ 3732.580180][ C1] [ 3732.580332][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3732.580596][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3732.580841][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3732.581127][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3732.581403][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3732.581695][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3732.581962][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3732.582271][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3732.582534][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3732.582844][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3732.583144][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3732.583463][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3732.583758][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3732.584056][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3732.584347][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3732.584659][ C1] ? get_stack_info+0x36/0xc0 [ 3732.584903][ C1] ? lock_acquire+0x1c1/0x220 [ 3732.585146][ C1] ? lock_release+0x1d5/0x250 [ 3732.585389][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3732.585640][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3732.585916][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3732.586202][ C1] ? lock_acquire+0x1c1/0x220 [ 3732.586443][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3732.586686][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3732.586948][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3732.587183][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3732.587432][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3732.587695][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3732.587972][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3732.588253][ C1] ip_local_deliver+0x19d/0x480 [ 3732.588502][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3732.588775][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3732.589042][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3732.589390][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3732.589646][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3732.589968][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3732.590231][ C1] ip_rcv+0x564/0x740 [ 3732.590437][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3732.590669][ C1] ? set_track_prepare+0x8a/0xd0 [ 3732.590923][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3732.591212][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3732.591489][ C1] ? skb_clone+0x10b/0x330 [ 3732.591716][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3732.592039][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3732.592348][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3732.592632][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3732.592931][ C1] ? __tcf_classify+0x329/0x7d0 [ 3732.593186][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3732.593417][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3732.593725][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3732.594013][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3732.594343][ C1] ? lock_acquire+0x1c1/0x220 [ 3732.594582][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3732.594883][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3732.595170][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3732.595490][ C1] ? __copy_skb_header+0xaf/0x490 [ 3732.595749][ C1] ? __skb_clone+0x57a/0x760 [ 3732.595986][ C1] netif_receive_skb+0x55/0x280 [ 3732.596240][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3732.596555][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3732.596890][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3732.597190][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3732.597469][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3732.597759][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3732.598075][ C1] ? hlock_class+0x4e/0x130 [ 3732.598310][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3732.598590][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3732.598867][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3732.599134][ C1] ? hlock_class+0x4e/0x130 [ 3732.599367][ C1] ? mark_lock+0x38/0x3e0 [ 3732.599587][ C1] ? stack_access_ok+0xda/0x1f0 [ 3732.599839][ C1] ? __lock_acquire+0xb67/0x1610 [ 3732.600096][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3732.600373][ C1] ? get_stack_info+0x36/0xc0 [ 3732.600618][ C1] ? stack_access_ok+0xda/0x1f0 [ 3732.600868][ C1] ? get_reg+0x119/0x190 [ 3732.601092][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3732.601364][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3732.601674][ C1] __tcf_classify+0x329/0x7d0 [ 3732.601918][ C1] tcf_classify+0x283/0x930 [ 3732.602152][ C1] ? arch_stack_walk+0xa2/0x100 [ 3732.602403][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3732.602661][ C1] ? get_stack_info+0x36/0xc0 [ 3732.602901][ C1] tc_run+0x2e4/0x5d0 [ 3732.603109][ C1] ? __pfx_tc_run+0x10/0x10 [ 3732.603340][ C1] ? lock_acquire+0x1c1/0x220 [ 3732.603581][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3732.603843][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3732.604098][ C1] ? lock_acquire+0x1c1/0x220 [ 3732.604340][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3732.604606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3732.604917][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3732.605193][ C1] ? neigh_hh_output+0x348/0x590 [ 3732.605449][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3732.605720][ C1] ip_finish_output2+0x786/0x18e0 [ 3732.605977][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3732.606256][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3732.606596][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3732.606874][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3732.607130][ C1] ? __ip_finish_output+0x10f/0x770 [ 3732.607395][ C1] ip_output+0x16b/0x4f0 [ 3732.607611][ C1] ? run_timer_softirq+0x72/0x100 [ 3732.607869][ C1] ? __pfx_ip_output+0x10/0x10 [ 3732.608116][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3732.608404][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3732.608656][ C1] ? ip_local_out+0x114/0x3b0 [ 3732.608898][ C1] __ip_queue_xmit+0x672/0x1910 [ 3732.609150][ C1] ? __create_object+0x5e/0xb0 [ 3732.609397][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3732.609665][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3732.609948][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3732.610225][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3732.610511][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3732.610784][ C1] tcp_delack_timer+0x84/0x240 [ 3732.611038][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3732.611310][ C1] call_timer_fn+0x173/0x430 [ 3732.611548][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3732.611812][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3732.612075][ C1] __run_timers.part.0+0x52d/0x890 [ 3732.612338][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3732.612614][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3732.612902][ C1] ? lock_acquire+0x1c1/0x220 [ 3732.613143][ C1] ? clockevents_program_event+0xf6/0x300 [ 3732.613435][ C1] ? lock_release+0x1d5/0x250 [ 3732.613676][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3732.613944][ C1] ? ktime_get+0xb3/0x190 [ 3732.614167][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3732.614466][ C1] run_timer_softirq+0x72/0x100 [ 3732.614717][ C1] __do_softirq+0x1b9/0x7ff [ 3732.614953][ C1] irq_exit_rcu+0x98/0xc0 [ 3732.615175][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3732.615464][ C1] [ 3732.615616][ C1] [ 3732.615767][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3732.616075][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3732.616403][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3732.617384][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3732.617694][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3732.618096][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3732.618498][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3732.618902][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3732.619305][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3732.619709][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3732.620008][ C1] pipe_read+0xa16/0xdf0 [ 3732.620231][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3732.620512][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3732.620756][ C1] ? iterate_tty_write+0x299/0x540 [ 3732.621022][ C1] ? lock_release+0x1d5/0x250 [ 3732.621266][ C1] vfs_read+0x911/0xc00 [ 3732.621481][ C1] ? lock_acquire+0x1c1/0x220 [ 3732.621721][ C1] ? __might_fault+0xc6/0x180 [ 3732.621964][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3732.622206][ C1] ? __might_fault+0xc6/0x180 [ 3732.622447][ C1] ? lock_release+0x1d5/0x250 [ 3732.622689][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3732.622955][ C1] ? __fget_light+0x54/0x1e0 [ 3732.623195][ C1] ksys_read+0x17a/0x1e0 [ 3732.623412][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3732.623658][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3732.623965][ C1] do_syscall_64+0xc9/0x1e0 [ 3732.624202][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3732.624501][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3732.624730][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3732.625707][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3732.626131][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3732.626532][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3732.626933][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3732.627335][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3732.627736][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3732.628142][ C1] [ 3732.628299][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1285s! [swapper/2:0] [ 3732.628717][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3732.629960][ C2] irq event stamp: 44114564 [ 3732.630188][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3732.630717][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3732.631230][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3732.631703][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3732.632170][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3732.632621][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3732.633228][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3732.633551][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3732.634514][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3732.634820][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3732.635217][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3732.635612][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3732.636006][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3732.636403][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3732.636799][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3732.637246][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3732.637574][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3732.637974][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3732.638371][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3732.638767][ C2] PKRU: 55555554 [ 3732.638948][ C2] Call Trace: [ 3732.639115][ C2] [ 3732.639264][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3732.639524][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3732.639766][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3732.640040][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3732.640312][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3732.640598][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3732.640860][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3732.641170][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3732.641434][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3732.641695][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3732.642001][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3732.642294][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3732.642607][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3732.642893][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3732.643187][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3732.643474][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3732.643782][ C2] ? get_stack_info+0x36/0xc0 [ 3732.644020][ C2] ? lock_acquire+0x1c1/0x220 [ 3732.644259][ C2] ? lock_release+0x1d5/0x250 [ 3732.644497][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3732.644742][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3732.645012][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3732.645293][ C2] ? lock_acquire+0x1c1/0x220 [ 3732.645531][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3732.645770][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3732.646029][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3732.646261][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3732.646506][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3732.646761][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3732.647034][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3732.647309][ C2] ip_local_deliver+0x19d/0x480 [ 3732.647554][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3732.647822][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3732.648083][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3732.648429][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3732.648680][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3732.648998][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3732.649259][ C2] ip_rcv+0x564/0x740 [ 3732.649463][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3732.649690][ C2] ? set_track_prepare+0x8a/0xd0 [ 3732.649941][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3732.650216][ C2] ? start_secondary+0x21c/0x2b0 [ 3732.650465][ C2] ? skb_clone+0x10b/0x330 [ 3732.650691][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3732.651007][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3732.651321][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3732.651599][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3732.651892][ C2] ? __tcf_classify+0x329/0x7d0 [ 3732.652139][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3732.652367][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3732.652664][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3732.652945][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3732.653267][ C2] ? lock_acquire+0x1c1/0x220 [ 3732.653505][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3732.653799][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3732.654081][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3732.654395][ C2] ? __copy_skb_header+0xaf/0x490 [ 3732.654651][ C2] ? __skb_clone+0x57a/0x760 [ 3732.654884][ C2] netif_receive_skb+0x55/0x280 [ 3732.655132][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3732.655440][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3732.655771][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3732.656066][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3732.656339][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3732.656626][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3732.656935][ C2] ? get_stack_info+0x36/0xc0 [ 3732.657174][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3732.657438][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3732.657753][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3732.658028][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3732.658302][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3732.658614][ C2] ? kernel_text_address+0x17/0xe0 [ 3732.658873][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3732.659184][ C2] ? arch_stack_walk+0x8c/0x100 [ 3732.659430][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3732.659692][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3732.659973][ C2] ? lock_acquire+0x1c1/0x220 [ 3732.660210][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3732.660491][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3732.660792][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3732.661072][ C2] ? get_stack_info+0x36/0xc0 [ 3732.661312][ C2] __tcf_classify+0x329/0x7d0 [ 3732.661552][ C2] tcf_classify+0x283/0x930 [ 3732.661783][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3732.662038][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3732.662350][ C2] tc_run+0x2e4/0x5d0 [ 3732.662553][ C2] ? __pfx_tc_run+0x10/0x10 [ 3732.662781][ C2] ? lock_acquire+0x1c1/0x220 [ 3732.663018][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3732.663277][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3732.663528][ C2] ? lock_acquire+0x1c1/0x220 [ 3732.663766][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3732.664028][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3732.664331][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3732.664600][ C2] ? neigh_hh_output+0x348/0x590 [ 3732.664851][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3732.665114][ C2] ip_finish_output2+0x786/0x18e0 [ 3732.665369][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3732.665702][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3732.665978][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3732.666229][ C2] ? __ip_finish_output+0x10f/0x770 [ 3732.666492][ C2] ip_output+0x16b/0x4f0 [ 3732.666707][ C2] ? __pfx_ip_output+0x10/0x10 [ 3732.666949][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3732.667224][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3732.667533][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3732.667808][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3732.668058][ C2] ? __alloc_skb+0xd4/0x280 [ 3732.668288][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3732.668556][ C2] ? tcp_fragment+0x168/0x1040 [ 3732.668798][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3732.669048][ C2] ? ip_local_out+0x114/0x3b0 [ 3732.669288][ C2] __ip_queue_xmit+0x672/0x1910 [ 3732.669536][ C2] ? __skb_clone+0x57a/0x760 [ 3732.669768][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3732.670033][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3732.670319][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3732.670562][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3732.670810][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3732.671115][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3732.671433][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3732.671676][ C2] tcp_send_loss_probe+0x348/0x830 [ 3732.671935][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3732.672202][ C2] tcp_write_timer+0x82/0x1d0 [ 3732.672442][ C2] call_timer_fn+0x173/0x430 [ 3732.672676][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3732.672936][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3732.673197][ C2] __run_timers.part.0+0x52d/0x890 [ 3732.673456][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3732.673724][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3732.674007][ C2] ? lock_acquire+0x1c1/0x220 [ 3732.674246][ C2] ? clockevents_program_event+0xf6/0x300 [ 3732.674535][ C2] ? lock_release+0x1d5/0x250 [ 3732.674771][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3732.675034][ C2] ? ktime_get+0xb3/0x190 [ 3732.675256][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3732.675551][ C2] run_timer_softirq+0x72/0x100 [ 3732.675796][ C2] __do_softirq+0x1b9/0x7ff [ 3732.676030][ C2] irq_exit_rcu+0x98/0xc0 [ 3732.676251][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3732.676535][ C2] [ 3732.676683][ C2] [ 3732.676835][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3732.677136][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3732.677393][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3732.678357][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3732.678663][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3732.679062][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3732.679459][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3732.679854][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3732.680250][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3732.680649][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3732.680936][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3732.681209][ C2] default_idle_call+0x69/0xa0 [ 3732.681453][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3732.681704][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3732.681978][ C2] ? lock_release+0x1d5/0x250 [ 3732.682217][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3732.682488][ C2] do_idle+0xfb/0x160 [ 3732.682690][ C2] cpu_startup_entry+0x55/0x60 [ 3732.682933][ C2] start_secondary+0x21c/0x2b0 [ 3732.683176][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3732.683444][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3732.683753][ C2] [ 3760.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1311s! [perl:4135] [ 3760.569702][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3760.570973][ C1] irq event stamp: 209232 [ 3760.571194][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3760.571725][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3760.572204][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3760.572677][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3760.573143][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3760.573593][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3760.574205][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 3760.574491][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 3760.575467][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 3760.575776][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3760.576177][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3760.576578][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3760.576977][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3760.577381][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3760.577781][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3760.578231][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3760.578565][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3760.578966][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3760.579369][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3760.579769][ C1] PKRU: 55555554 [ 3760.579951][ C1] Call Trace: [ 3760.580123][ C1] [ 3760.580273][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3760.580536][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3760.580781][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3760.581064][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3760.581337][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3760.581627][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3760.581893][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3760.582201][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3760.582465][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3760.582774][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3760.583071][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3760.583387][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3760.583678][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 3760.583961][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3760.584244][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3760.584558][ C1] ? get_stack_info+0x36/0xc0 [ 3760.584801][ C1] ? lock_acquire+0x1c1/0x220 [ 3760.585042][ C1] ? lock_release+0x1d5/0x250 [ 3760.585281][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3760.585532][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3760.585805][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3760.586090][ C1] ? lock_acquire+0x1c1/0x220 [ 3760.586332][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3760.586571][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3760.586833][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3760.587067][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3760.587315][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3760.587574][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3760.587853][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3760.588134][ C1] ip_local_deliver+0x19d/0x480 [ 3760.588381][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3760.588654][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3760.588918][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3760.589266][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3760.589520][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3760.589840][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3760.590103][ C1] ip_rcv+0x564/0x740 [ 3760.590307][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3760.590540][ C1] ? set_track_prepare+0x8a/0xd0 [ 3760.590794][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3760.591079][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3760.591353][ C1] ? skb_clone+0x10b/0x330 [ 3760.591581][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3760.591901][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3760.592210][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3760.592492][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3760.592789][ C1] ? __tcf_classify+0x329/0x7d0 [ 3760.593037][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3760.593269][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3760.593570][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3760.593854][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3760.594181][ C1] ? lock_acquire+0x1c1/0x220 [ 3760.594422][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3760.594719][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3760.595004][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3760.595325][ C1] ? __copy_skb_header+0xaf/0x490 [ 3760.595584][ C1] ? __skb_clone+0x57a/0x760 [ 3760.595820][ C1] netif_receive_skb+0x55/0x280 [ 3760.596069][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3760.596382][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3760.596716][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3760.597018][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3760.597292][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3760.597583][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3760.597897][ C1] ? hlock_class+0x4e/0x130 [ 3760.598130][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3760.598407][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3760.598684][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3760.598949][ C1] ? hlock_class+0x4e/0x130 [ 3760.599182][ C1] ? mark_lock+0x38/0x3e0 [ 3760.599403][ C1] ? stack_access_ok+0xda/0x1f0 [ 3760.599654][ C1] ? __lock_acquire+0xb67/0x1610 [ 3760.599909][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3760.600190][ C1] ? get_stack_info+0x36/0xc0 [ 3760.600432][ C1] ? stack_access_ok+0xda/0x1f0 [ 3760.600680][ C1] ? get_reg+0x119/0x190 [ 3760.600902][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3760.601172][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3760.601485][ C1] __tcf_classify+0x329/0x7d0 [ 3760.601728][ C1] tcf_classify+0x283/0x930 [ 3760.601960][ C1] ? arch_stack_walk+0xa2/0x100 [ 3760.602211][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3760.602468][ C1] ? get_stack_info+0x36/0xc0 [ 3760.602710][ C1] tc_run+0x2e4/0x5d0 [ 3760.602917][ C1] ? __pfx_tc_run+0x10/0x10 [ 3760.603152][ C1] ? lock_acquire+0x1c1/0x220 [ 3760.603393][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3760.603659][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3760.603915][ C1] ? lock_acquire+0x1c1/0x220 [ 3760.604155][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3760.604422][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3760.604728][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3760.605002][ C1] ? neigh_hh_output+0x348/0x590 [ 3760.605255][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3760.605523][ C1] ip_finish_output2+0x786/0x18e0 [ 3760.605780][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3760.606059][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3760.606399][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3760.606675][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3760.606933][ C1] ? __ip_finish_output+0x10f/0x770 [ 3760.607201][ C1] ip_output+0x16b/0x4f0 [ 3760.607418][ C1] ? run_timer_softirq+0x72/0x100 [ 3760.607677][ C1] ? __pfx_ip_output+0x10/0x10 [ 3760.607921][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3760.608208][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3760.608460][ C1] ? ip_local_out+0x114/0x3b0 [ 3760.608702][ C1] __ip_queue_xmit+0x672/0x1910 [ 3760.608953][ C1] ? __create_object+0x5e/0xb0 [ 3760.609198][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3760.609468][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3760.609750][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3760.610024][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3760.610311][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3760.610584][ C1] tcp_delack_timer+0x84/0x240 [ 3760.610830][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3760.611111][ C1] call_timer_fn+0x173/0x430 [ 3760.611350][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3760.611616][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3760.611878][ C1] __run_timers.part.0+0x52d/0x890 [ 3760.612141][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3760.612415][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3760.612709][ C1] ? lock_acquire+0x1c1/0x220 [ 3760.612947][ C1] ? clockevents_program_event+0xf6/0x300 [ 3760.613242][ C1] ? lock_release+0x1d5/0x250 [ 3760.613482][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3760.613747][ C1] ? ktime_get+0xb3/0x190 [ 3760.613969][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3760.614269][ C1] run_timer_softirq+0x72/0x100 [ 3760.614519][ C1] __do_softirq+0x1b9/0x7ff [ 3760.614752][ C1] irq_exit_rcu+0x98/0xc0 [ 3760.614974][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3760.615262][ C1] [ 3760.615414][ C1] [ 3760.615566][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3760.615872][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3760.616199][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3760.617176][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3760.617487][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3760.617889][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3760.618290][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3760.618689][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3760.619090][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3760.619495][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3760.619791][ C1] pipe_read+0xa16/0xdf0 [ 3760.620014][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3760.620294][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3760.620538][ C1] ? iterate_tty_write+0x299/0x540 [ 3760.620800][ C1] ? lock_release+0x1d5/0x250 [ 3760.621050][ C1] vfs_read+0x911/0xc00 [ 3760.621266][ C1] ? lock_acquire+0x1c1/0x220 [ 3760.621506][ C1] ? __might_fault+0xc6/0x180 [ 3760.621747][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3760.621985][ C1] ? __might_fault+0xc6/0x180 [ 3760.622226][ C1] ? lock_release+0x1d5/0x250 [ 3760.622468][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3760.622734][ C1] ? __fget_light+0x54/0x1e0 [ 3760.622972][ C1] ksys_read+0x17a/0x1e0 [ 3760.623189][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3760.623435][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3760.623740][ C1] do_syscall_64+0xc9/0x1e0 [ 3760.623972][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3760.624275][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3760.624503][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3760.625480][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3760.625902][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3760.626303][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3760.626704][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3760.627104][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3760.627504][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3760.627907][ C1] [ 3760.628067][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1311s! [swapper/2:0] [ 3760.628492][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3760.629749][ C2] irq event stamp: 44114564 [ 3760.629977][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3760.630507][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3760.631023][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3760.631500][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3760.631965][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3760.632419][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3760.633033][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3760.633357][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3760.634322][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3760.634627][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3760.635023][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3760.635418][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3760.635815][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3760.636213][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3760.636610][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3760.637054][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3760.637384][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3760.637787][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3760.638186][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3760.638582][ C2] PKRU: 55555554 [ 3760.638763][ C2] Call Trace: [ 3760.638933][ C2] [ 3760.639079][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3760.639340][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3760.639581][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3760.639855][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3760.640127][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3760.640415][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3760.640677][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3760.640985][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3760.641246][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3760.641506][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3760.641814][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3760.642106][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3760.642418][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3760.642712][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3760.643004][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3760.643294][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3760.643604][ C2] ? get_stack_info+0x36/0xc0 [ 3760.643842][ C2] ? lock_acquire+0x1c1/0x220 [ 3760.644080][ C2] ? lock_release+0x1d5/0x250 [ 3760.644320][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3760.644567][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3760.644836][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3760.645121][ C2] ? lock_acquire+0x1c1/0x220 [ 3760.645357][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3760.645596][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3760.645853][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3760.646087][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3760.646334][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3760.646590][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3760.646862][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3760.647140][ C2] ip_local_deliver+0x19d/0x480 [ 3760.647386][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3760.647656][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3760.647919][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3760.648265][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3760.648517][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3760.648834][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3760.649095][ C2] ip_rcv+0x564/0x740 [ 3760.649298][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3760.649528][ C2] ? set_track_prepare+0x8a/0xd0 [ 3760.649779][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3760.650055][ C2] ? start_secondary+0x21c/0x2b0 [ 3760.650305][ C2] ? skb_clone+0x10b/0x330 [ 3760.650529][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3760.650846][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3760.651159][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3760.651437][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3760.651730][ C2] ? __tcf_classify+0x329/0x7d0 [ 3760.651978][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3760.652206][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3760.652506][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3760.652788][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3760.653112][ C2] ? lock_acquire+0x1c1/0x220 [ 3760.653348][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3760.653643][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3760.653925][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3760.654241][ C2] ? __copy_skb_header+0xaf/0x490 [ 3760.654497][ C2] ? __skb_clone+0x57a/0x760 [ 3760.654731][ C2] netif_receive_skb+0x55/0x280 [ 3760.654979][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3760.655291][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3760.655625][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3760.655921][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3760.656196][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3760.656481][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3760.656793][ C2] ? get_stack_info+0x36/0xc0 [ 3760.657033][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3760.657298][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3760.657614][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3760.657887][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3760.658163][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3760.658475][ C2] ? kernel_text_address+0x17/0xe0 [ 3760.658733][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3760.659045][ C2] ? arch_stack_walk+0x8c/0x100 [ 3760.659292][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3760.659554][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3760.659839][ C2] ? lock_acquire+0x1c1/0x220 [ 3760.660074][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3760.660360][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3760.660662][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3760.660942][ C2] ? get_stack_info+0x36/0xc0 [ 3760.661183][ C2] __tcf_classify+0x329/0x7d0 [ 3760.661422][ C2] tcf_classify+0x283/0x930 [ 3760.661655][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3760.661908][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3760.662221][ C2] tc_run+0x2e4/0x5d0 [ 3760.662424][ C2] ? __pfx_tc_run+0x10/0x10 [ 3760.662654][ C2] ? lock_acquire+0x1c1/0x220 [ 3760.662889][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3760.663151][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3760.663401][ C2] ? lock_acquire+0x1c1/0x220 [ 3760.663639][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3760.663901][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3760.664203][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3760.664473][ C2] ? neigh_hh_output+0x348/0x590 [ 3760.664723][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3760.664985][ C2] ip_finish_output2+0x786/0x18e0 [ 3760.665242][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3760.665578][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3760.665853][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3760.666105][ C2] ? __ip_finish_output+0x10f/0x770 [ 3760.666369][ C2] ip_output+0x16b/0x4f0 [ 3760.666583][ C2] ? __pfx_ip_output+0x10/0x10 [ 3760.666825][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3760.667099][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3760.667410][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3760.667686][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3760.667935][ C2] ? __alloc_skb+0xd4/0x280 [ 3760.668164][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3760.668429][ C2] ? tcp_fragment+0x168/0x1040 [ 3760.668672][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3760.668922][ C2] ? ip_local_out+0x114/0x3b0 [ 3760.669161][ C2] __ip_queue_xmit+0x672/0x1910 [ 3760.669413][ C2] ? __skb_clone+0x57a/0x760 [ 3760.669644][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3760.669910][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3760.670190][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3760.670434][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3760.670682][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3760.670989][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3760.671309][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3760.671551][ C2] tcp_send_loss_probe+0x348/0x830 [ 3760.671809][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3760.672074][ C2] tcp_write_timer+0x82/0x1d0 [ 3760.672314][ C2] call_timer_fn+0x173/0x430 [ 3760.672550][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3760.672810][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3760.673069][ C2] __run_timers.part.0+0x52d/0x890 [ 3760.673328][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3760.673595][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3760.673879][ C2] ? lock_acquire+0x1c1/0x220 [ 3760.674115][ C2] ? clockevents_program_event+0xf6/0x300 [ 3760.674405][ C2] ? lock_release+0x1d5/0x250 [ 3760.674642][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3760.674905][ C2] ? ktime_get+0xb3/0x190 [ 3760.675123][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3760.675418][ C2] run_timer_softirq+0x72/0x100 [ 3760.675666][ C2] __do_softirq+0x1b9/0x7ff [ 3760.675895][ C2] irq_exit_rcu+0x98/0xc0 [ 3760.676116][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3760.676398][ C2] [ 3760.676548][ C2] [ 3760.676698][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3760.677001][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3760.677257][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3760.678220][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3760.678526][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3760.678923][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3760.679319][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3760.679717][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3760.680116][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3760.680513][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3760.680799][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3760.681063][ C2] default_idle_call+0x69/0xa0 [ 3760.681308][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3760.681558][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3760.681833][ C2] ? lock_release+0x1d5/0x250 [ 3760.682070][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3760.682343][ C2] do_idle+0xfb/0x160 [ 3760.682547][ C2] cpu_startup_entry+0x55/0x60 [ 3760.682787][ C2] start_secondary+0x21c/0x2b0 [ 3760.683029][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3760.683298][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3760.683606][ C2] [ 3785.960103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3785.960469][ C1] rcu: 1-....: (1427913 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=348815 [ 3785.961030][ C1] rcu: (t=1431073 jiffies g=1882453 q=703 ncpus=4) [ 3785.961367][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3785.961816][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3785.962429][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3785.962757][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3785.963730][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3785.964038][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3785.964438][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3785.964839][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3785.965243][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3785.965643][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3785.966043][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3785.966494][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3785.966830][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3785.967232][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3785.967631][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3785.968029][ C1] PKRU: 55555554 [ 3785.968212][ C1] Call Trace: [ 3785.968383][ C1] [ 3785.968531][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3785.968804][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3785.969057][ C1] ? check_cpu_stall+0x284/0x500 [ 3785.969309][ C1] ? rcu_pending+0x92/0x360 [ 3785.969542][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3785.969812][ C1] ? update_process_times+0xb9/0x110 [ 3785.970082][ C1] ? tick_sched_handle+0x67/0x130 [ 3785.970340][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3785.970627][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3785.970876][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3785.971190][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3785.971464][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3785.971751][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3785.972017][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3785.972325][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3785.972587][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3785.972898][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3785.973195][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3785.973510][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3785.973800][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3785.974096][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3785.974384][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3785.974697][ C1] ? get_stack_info+0x36/0xc0 [ 3785.974940][ C1] ? lock_acquire+0x1c1/0x220 [ 3785.975184][ C1] ? lock_release+0x1d5/0x250 [ 3785.975424][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3785.975673][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3785.975945][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3785.976233][ C1] ? lock_acquire+0x1c1/0x220 [ 3785.976473][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3785.976713][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3785.976974][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3785.977212][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3785.977461][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3785.977720][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3785.977998][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3785.978276][ C1] ip_local_deliver+0x19d/0x480 [ 3785.978525][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3785.978798][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3785.979062][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3785.979410][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3785.979664][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3785.979986][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3785.980249][ C1] ip_rcv+0x564/0x740 [ 3785.980454][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3785.980685][ C1] ? set_track_prepare+0x8a/0xd0 [ 3785.980946][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3785.981225][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3785.981497][ C1] ? skb_clone+0x10b/0x330 [ 3785.981728][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3785.982049][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3785.982357][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3785.982640][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3785.982936][ C1] ? __tcf_classify+0x329/0x7d0 [ 3785.983186][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3785.983419][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3785.983720][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3785.984006][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3785.984332][ C1] ? lock_acquire+0x1c1/0x220 [ 3785.984571][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3785.984870][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3785.985156][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3785.985474][ C1] ? __copy_skb_header+0xaf/0x490 [ 3785.985733][ C1] ? __skb_clone+0x57a/0x760 [ 3785.985970][ C1] netif_receive_skb+0x55/0x280 [ 3785.986217][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3785.986532][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3785.986864][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3785.987166][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3785.987440][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3785.987732][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3785.988049][ C1] ? hlock_class+0x4e/0x130 [ 3785.988284][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3785.988562][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3785.988842][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3785.989108][ C1] ? hlock_class+0x4e/0x130 [ 3785.989339][ C1] ? mark_lock+0x38/0x3e0 [ 3785.989560][ C1] ? stack_access_ok+0xda/0x1f0 [ 3785.989812][ C1] ? __lock_acquire+0xb67/0x1610 [ 3785.990066][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3785.990343][ C1] ? get_stack_info+0x36/0xc0 [ 3785.990586][ C1] ? stack_access_ok+0xda/0x1f0 [ 3785.990841][ C1] ? get_reg+0x119/0x190 [ 3785.991057][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3785.991326][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3785.991636][ C1] __tcf_classify+0x329/0x7d0 [ 3785.991879][ C1] tcf_classify+0x283/0x930 [ 3785.992110][ C1] ? arch_stack_walk+0xa2/0x100 [ 3785.992360][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3785.992618][ C1] ? get_stack_info+0x36/0xc0 [ 3785.992860][ C1] tc_run+0x2e4/0x5d0 [ 3785.993065][ C1] ? __pfx_tc_run+0x10/0x10 [ 3785.993298][ C1] ? lock_acquire+0x1c1/0x220 [ 3785.993537][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3785.993799][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3785.994055][ C1] ? lock_acquire+0x1c1/0x220 [ 3785.994292][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3785.994558][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3785.994864][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3785.995136][ C1] ? neigh_hh_output+0x348/0x590 [ 3785.995389][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3785.995656][ C1] ip_finish_output2+0x786/0x18e0 [ 3785.995913][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3785.996193][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3785.996531][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3785.996807][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3785.997061][ C1] ? __ip_finish_output+0x10f/0x770 [ 3785.997326][ C1] ip_output+0x16b/0x4f0 [ 3785.997546][ C1] ? run_timer_softirq+0x72/0x100 [ 3785.997804][ C1] ? __pfx_ip_output+0x10/0x10 [ 3785.998048][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3785.998335][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3785.998587][ C1] ? ip_local_out+0x114/0x3b0 [ 3785.998829][ C1] __ip_queue_xmit+0x672/0x1910 [ 3785.999078][ C1] ? __create_object+0x5e/0xb0 [ 3785.999320][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3785.999590][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3785.999873][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3786.000146][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3786.000429][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3786.000703][ C1] tcp_delack_timer+0x84/0x240 [ 3786.000953][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3786.001227][ C1] call_timer_fn+0x173/0x430 [ 3786.001463][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3786.001728][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3786.001991][ C1] __run_timers.part.0+0x52d/0x890 [ 3786.002252][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3786.002527][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3786.002813][ C1] ? lock_acquire+0x1c1/0x220 [ 3786.003054][ C1] ? clockevents_program_event+0xf6/0x300 [ 3786.003347][ C1] ? lock_release+0x1d5/0x250 [ 3786.003585][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3786.003852][ C1] ? ktime_get+0xb3/0x190 [ 3786.004075][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3786.004374][ C1] run_timer_softirq+0x72/0x100 [ 3786.004623][ C1] __do_softirq+0x1b9/0x7ff [ 3786.004859][ C1] irq_exit_rcu+0x98/0xc0 [ 3786.005079][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3786.005367][ C1] [ 3786.005518][ C1] [ 3786.005671][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3786.005976][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3786.006303][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3786.007278][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3786.007588][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3786.007990][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3786.008393][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3786.008793][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3786.009194][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3786.009597][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3786.009895][ C1] pipe_read+0xa16/0xdf0 [ 3786.010118][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3786.010395][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3786.010641][ C1] ? iterate_tty_write+0x299/0x540 [ 3786.010909][ C1] ? lock_release+0x1d5/0x250 [ 3786.011151][ C1] vfs_read+0x911/0xc00 [ 3786.011367][ C1] ? lock_acquire+0x1c1/0x220 [ 3786.011608][ C1] ? __might_fault+0xc6/0x180 [ 3786.011848][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3786.012088][ C1] ? __might_fault+0xc6/0x180 [ 3786.012329][ C1] ? lock_release+0x1d5/0x250 [ 3786.012570][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3786.012836][ C1] ? __fget_light+0x54/0x1e0 [ 3786.013080][ C1] ksys_read+0x17a/0x1e0 [ 3786.013299][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3786.013545][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3786.013850][ C1] do_syscall_64+0xc9/0x1e0 [ 3786.014085][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3786.014387][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3786.014614][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3786.015596][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3786.016018][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3786.016417][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3786.016817][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3786.017220][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3786.017619][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3786.018021][ C1] [ 3786.018180][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3786.018455][ C2] NMI backtrace for cpu 2 [ 3786.018462][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3786.018468][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3786.018472][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3786.018480][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3786.018485][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3786.018490][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3786.018494][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3786.018497][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3786.018498][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3786.018500][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3786.018501][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3786.018503][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3786.018506][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3786.018508][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3786.018509][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3786.018510][ C2] PKRU: 55555554 [ 3786.018512][ C2] Call Trace: [ 3786.018515][ C2] [ 3786.018517][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3786.018523][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3786.018529][ C2] ? nmi_handle+0x153/0x420 [ 3786.018533][ C2] ? default_do_nmi+0x41/0x100 [ 3786.018536][ C2] ? exc_nmi+0xf3/0x120 [ 3786.018538][ C2] ? end_repeat_nmi+0xf/0x60 [ 3786.018543][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3786.018546][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3786.018549][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3786.018552][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3786.018555][ C2] [ 3786.018556][ C2] [ 3786.018557][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3786.018560][ C2] ? get_stack_info+0x36/0xc0 [ 3786.018564][ C2] ? lock_acquire+0x1c1/0x220 [ 3786.018567][ C2] ? lock_release+0x1d5/0x250 [ 3786.018571][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3786.018574][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3786.018577][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3786.018581][ C2] ? lock_acquire+0x1c1/0x220 [ 3786.018583][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3786.018587][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3786.018589][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3786.018596][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3786.018599][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3786.018603][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3786.018608][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3786.018611][ C2] ip_local_deliver+0x19d/0x480 [ 3786.018614][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3786.018616][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3786.018618][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3786.018623][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3786.018627][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3786.018630][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3786.018639][ C2] ip_rcv+0x564/0x740 [ 3786.018642][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3786.018644][ C2] ? set_track_prepare+0x8a/0xd0 [ 3786.018648][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3786.018651][ C2] ? start_secondary+0x21c/0x2b0 [ 3786.018654][ C2] ? skb_clone+0x10b/0x330 [ 3786.018657][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3786.018663][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3786.018668][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3786.018671][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3786.018679][ C2] ? __tcf_classify+0x329/0x7d0 [ 3786.018683][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3786.018686][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3786.018689][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3786.018692][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3786.018696][ C2] ? lock_acquire+0x1c1/0x220 [ 3786.018698][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3786.018702][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3786.018706][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3786.018710][ C2] ? __copy_skb_header+0xaf/0x490 [ 3786.018714][ C2] ? __skb_clone+0x57a/0x760 [ 3786.018716][ C2] netif_receive_skb+0x55/0x280 [ 3786.018720][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3786.018727][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3786.018733][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3786.018740][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3786.018744][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3786.018754][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3786.018761][ C2] ? get_stack_info+0x36/0xc0 [ 3786.018766][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3786.018769][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3786.018772][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3786.018775][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3786.018778][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3786.018780][ C2] ? kernel_text_address+0x17/0xe0 [ 3786.018783][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3786.018787][ C2] ? arch_stack_walk+0x8c/0x100 [ 3786.018790][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3786.018793][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3786.018796][ C2] ? lock_acquire+0x1c1/0x220 [ 3786.018799][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3786.018803][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3786.018806][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3786.018809][ C2] ? get_stack_info+0x36/0xc0 [ 3786.018813][ C2] __tcf_classify+0x329/0x7d0 [ 3786.018818][ C2] tcf_classify+0x283/0x930 [ 3786.018822][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3786.018825][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3786.018829][ C2] tc_run+0x2e4/0x5d0 [ 3786.018832][ C2] ? __pfx_tc_run+0x10/0x10 [ 3786.018835][ C2] ? lock_acquire+0x1c1/0x220 [ 3786.018837][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3786.018841][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3786.018845][ C2] ? lock_acquire+0x1c1/0x220 [ 3786.018847][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3786.018850][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3786.018854][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3786.018856][ C2] ? neigh_hh_output+0x348/0x590 [ 3786.018860][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3786.018863][ C2] ip_finish_output2+0x786/0x18e0 [ 3786.018867][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3786.018874][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3786.018877][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3786.018880][ C2] ? __ip_finish_output+0x10f/0x770 [ 3786.018884][ C2] ip_output+0x16b/0x4f0 [ 3786.018887][ C2] ? __pfx_ip_output+0x10/0x10 [ 3786.018889][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3786.018892][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3786.018895][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3786.018898][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3786.018900][ C2] ? __alloc_skb+0xd4/0x280 [ 3786.018903][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3786.018907][ C2] ? tcp_fragment+0x168/0x1040 [ 3786.018910][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3786.018913][ C2] ? ip_local_out+0x114/0x3b0 [ 3786.018917][ C2] __ip_queue_xmit+0x672/0x1910 [ 3786.018920][ C2] ? __skb_clone+0x57a/0x760 [ 3786.018923][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3786.018928][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3786.018931][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3786.018934][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3786.018938][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3786.018942][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3786.018945][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3786.018949][ C2] tcp_send_loss_probe+0x348/0x830 [ 3786.018952][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3786.018954][ C2] tcp_write_timer+0x82/0x1d0 [ 3786.018957][ C2] call_timer_fn+0x173/0x430 [ 3786.018961][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3786.018966][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3786.018970][ C2] __run_timers.part.0+0x52d/0x890 [ 3786.018972][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3786.018976][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3786.018979][ C2] ? lock_acquire+0x1c1/0x220 [ 3786.018981][ C2] ? clockevents_program_event+0xf6/0x300 [ 3786.018985][ C2] ? lock_release+0x1d5/0x250 [ 3786.018988][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3786.018991][ C2] ? ktime_get+0xb3/0x190 [ 3786.018994][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3786.018998][ C2] run_timer_softirq+0x72/0x100 [ 3786.019001][ C2] __do_softirq+0x1b9/0x7ff [ 3786.019005][ C2] irq_exit_rcu+0x98/0xc0 [ 3786.019008][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3786.019011][ C2] [ 3786.019012][ C2] [ 3786.019013][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3786.019016][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3786.019019][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3786.019021][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3786.019023][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3786.019024][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3786.019026][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3786.019027][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3786.019028][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3786.019031][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3786.019034][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3786.019038][ C2] default_idle_call+0x69/0xa0 [ 3786.019041][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3786.019043][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3786.019047][ C2] ? lock_release+0x1d5/0x250 [ 3786.019050][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3786.019053][ C2] do_idle+0xfb/0x160 [ 3786.019056][ C2] cpu_startup_entry+0x55/0x60 [ 3786.019058][ C2] start_secondary+0x21c/0x2b0 [ 3786.019061][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3786.019065][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3786.019071][ C2] [ 3807.319766][ T75] kmemleak: 1 new suspected memory leaks (see /sys/kernel/debug/kmemleak) [ 3812.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1359s! [perl:4135] [ 3812.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3812.570969][ C1] irq event stamp: 209232 [ 3812.571187][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3812.571717][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3812.572197][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3812.572667][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3812.573130][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3812.573579][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3812.574196][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3812.574522][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3812.575495][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3812.575804][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3812.576206][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3812.576605][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3812.577006][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3812.577408][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3812.577808][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3812.578257][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3812.578589][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3812.578993][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3812.579394][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3812.579794][ C1] PKRU: 55555554 [ 3812.579976][ C1] Call Trace: [ 3812.580150][ C1] [ 3812.580298][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3812.580561][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3812.580809][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3812.581086][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3812.581359][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3812.581650][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3812.581915][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3812.582223][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3812.582485][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3812.582796][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3812.583090][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3812.583406][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3812.583697][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3812.583991][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3812.584284][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3812.584597][ C1] ? get_stack_info+0x36/0xc0 [ 3812.584837][ C1] ? lock_acquire+0x1c1/0x220 [ 3812.585078][ C1] ? lock_release+0x1d5/0x250 [ 3812.585320][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3812.585570][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3812.585844][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3812.586131][ C1] ? lock_acquire+0x1c1/0x220 [ 3812.586369][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3812.586611][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3812.586871][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3812.587108][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3812.587355][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3812.587613][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3812.587895][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3812.588173][ C1] ip_local_deliver+0x19d/0x480 [ 3812.588421][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3812.588697][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3812.588960][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3812.589313][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3812.589567][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3812.589888][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3812.590153][ C1] ip_rcv+0x564/0x740 [ 3812.590358][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3812.590590][ C1] ? set_track_prepare+0x8a/0xd0 [ 3812.590848][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3812.591130][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3812.591403][ C1] ? skb_clone+0x10b/0x330 [ 3812.591632][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3812.591952][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3812.592260][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3812.592545][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3812.592840][ C1] ? __tcf_classify+0x329/0x7d0 [ 3812.593090][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3812.593324][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3812.593624][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3812.593915][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3812.594242][ C1] ? lock_acquire+0x1c1/0x220 [ 3812.594482][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3812.594779][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3812.595067][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3812.595386][ C1] ? __copy_skb_header+0xaf/0x490 [ 3812.595648][ C1] ? __skb_clone+0x57a/0x760 [ 3812.595882][ C1] netif_receive_skb+0x55/0x280 [ 3812.596133][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3812.596447][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3812.596782][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3812.597083][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3812.597359][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3812.597647][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3812.597961][ C1] ? hlock_class+0x4e/0x130 [ 3812.598197][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3812.598475][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3812.598752][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3812.599017][ C1] ? hlock_class+0x4e/0x130 [ 3812.599251][ C1] ? mark_lock+0x38/0x3e0 [ 3812.599472][ C1] ? stack_access_ok+0xda/0x1f0 [ 3812.599722][ C1] ? __lock_acquire+0xb67/0x1610 [ 3812.599979][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3812.600260][ C1] ? get_stack_info+0x36/0xc0 [ 3812.600500][ C1] ? stack_access_ok+0xda/0x1f0 [ 3812.600756][ C1] ? get_reg+0x119/0x190 [ 3812.600976][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3812.601245][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3812.601558][ C1] __tcf_classify+0x329/0x7d0 [ 3812.601800][ C1] tcf_classify+0x283/0x930 [ 3812.602032][ C1] ? arch_stack_walk+0xa2/0x100 [ 3812.602284][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3812.602542][ C1] ? get_stack_info+0x36/0xc0 [ 3812.602785][ C1] tc_run+0x2e4/0x5d0 [ 3812.602991][ C1] ? __pfx_tc_run+0x10/0x10 [ 3812.603224][ C1] ? lock_acquire+0x1c1/0x220 [ 3812.603463][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3812.603726][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3812.603980][ C1] ? lock_acquire+0x1c1/0x220 [ 3812.604222][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3812.604488][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3812.604794][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3812.605068][ C1] ? neigh_hh_output+0x348/0x590 [ 3812.605325][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3812.605590][ C1] ip_finish_output2+0x786/0x18e0 [ 3812.605847][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3812.606128][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3812.606467][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3812.606744][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3812.606999][ C1] ? __ip_finish_output+0x10f/0x770 [ 3812.607266][ C1] ip_output+0x16b/0x4f0 [ 3812.607483][ C1] ? run_timer_softirq+0x72/0x100 [ 3812.607742][ C1] ? __pfx_ip_output+0x10/0x10 [ 3812.607984][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3812.608276][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3812.608530][ C1] ? ip_local_out+0x114/0x3b0 [ 3812.608770][ C1] __ip_queue_xmit+0x672/0x1910 [ 3812.609021][ C1] ? __create_object+0x5e/0xb0 [ 3812.609268][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3812.609535][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3812.609821][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3812.610094][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3812.610377][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3812.610656][ C1] tcp_delack_timer+0x84/0x240 [ 3812.610901][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3812.611176][ C1] call_timer_fn+0x173/0x430 [ 3812.611411][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3812.611674][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3812.611935][ C1] __run_timers.part.0+0x52d/0x890 [ 3812.612197][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3812.612474][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3812.612759][ C1] ? lock_acquire+0x1c1/0x220 [ 3812.612999][ C1] ? clockevents_program_event+0xf6/0x300 [ 3812.613291][ C1] ? lock_release+0x1d5/0x250 [ 3812.613532][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3812.613797][ C1] ? ktime_get+0xb3/0x190 [ 3812.614020][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3812.614320][ C1] run_timer_softirq+0x72/0x100 [ 3812.614570][ C1] __do_softirq+0x1b9/0x7ff [ 3812.614805][ C1] irq_exit_rcu+0x98/0xc0 [ 3812.615025][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3812.615315][ C1] [ 3812.615466][ C1] [ 3812.615617][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3812.615923][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3812.616251][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3812.617232][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3812.617542][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3812.617941][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3812.618344][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3812.618745][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3812.619150][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3812.619552][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3812.619853][ C1] pipe_read+0xa16/0xdf0 [ 3812.620073][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3812.620356][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3812.620600][ C1] ? iterate_tty_write+0x299/0x540 [ 3812.620867][ C1] ? lock_release+0x1d5/0x250 [ 3812.621108][ C1] vfs_read+0x911/0xc00 [ 3812.621326][ C1] ? lock_acquire+0x1c1/0x220 [ 3812.621564][ C1] ? __might_fault+0xc6/0x180 [ 3812.621807][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3812.622048][ C1] ? __might_fault+0xc6/0x180 [ 3812.622291][ C1] ? lock_release+0x1d5/0x250 [ 3812.622530][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3812.622796][ C1] ? __fget_light+0x54/0x1e0 [ 3812.623033][ C1] ksys_read+0x17a/0x1e0 [ 3812.623253][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3812.623497][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3812.623802][ C1] do_syscall_64+0xc9/0x1e0 [ 3812.624036][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3812.624338][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3812.624567][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3812.625542][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3812.625966][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3812.626367][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3812.626767][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3812.627165][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3812.627568][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3812.627973][ C1] [ 3812.628133][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1359s! [swapper/2:0] [ 3812.628558][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3812.629805][ C2] irq event stamp: 44114564 [ 3812.630033][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3812.630567][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3812.631082][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3812.631555][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3812.632023][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3812.632477][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3812.633083][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3812.633406][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3812.634373][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3812.634679][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3812.635076][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3812.635474][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3812.635870][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3812.636266][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3812.636664][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3812.637108][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3812.637440][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3812.637838][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3812.638235][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3812.638634][ C2] PKRU: 55555554 [ 3812.638813][ C2] Call Trace: [ 3812.638984][ C2] [ 3812.639132][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3812.639393][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3812.639635][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3812.639911][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3812.640183][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3812.640468][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3812.640740][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3812.641042][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3812.641303][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3812.641563][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3812.641872][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3812.642168][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3812.642481][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3812.642767][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3812.643062][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3812.643348][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3812.643658][ C2] ? get_stack_info+0x36/0xc0 [ 3812.643898][ C2] ? lock_acquire+0x1c1/0x220 [ 3812.644139][ C2] ? lock_release+0x1d5/0x250 [ 3812.644376][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3812.644624][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3812.644897][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3812.645182][ C2] ? lock_acquire+0x1c1/0x220 [ 3812.645420][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3812.645658][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3812.645916][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3812.646149][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3812.646395][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3812.646650][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3812.646923][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3812.647201][ C2] ip_local_deliver+0x19d/0x480 [ 3812.647446][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3812.647717][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3812.647980][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3812.648326][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3812.648578][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3812.648896][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3812.649157][ C2] ip_rcv+0x564/0x740 [ 3812.649358][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3812.649589][ C2] ? set_track_prepare+0x8a/0xd0 [ 3812.649841][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3812.650116][ C2] ? start_secondary+0x21c/0x2b0 [ 3812.650367][ C2] ? skb_clone+0x10b/0x330 [ 3812.650593][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3812.650919][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3812.651224][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3812.651510][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3812.651802][ C2] ? __tcf_classify+0x329/0x7d0 [ 3812.652049][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3812.652280][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3812.652577][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3812.652861][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3812.653185][ C2] ? lock_acquire+0x1c1/0x220 [ 3812.653423][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3812.653716][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3812.654002][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3812.654318][ C2] ? __copy_skb_header+0xaf/0x490 [ 3812.654575][ C2] ? __skb_clone+0x57a/0x760 [ 3812.654807][ C2] netif_receive_skb+0x55/0x280 [ 3812.655053][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3812.655366][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3812.655696][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3812.655994][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3812.656271][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3812.656558][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3812.656868][ C2] ? get_stack_info+0x36/0xc0 [ 3812.657110][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3812.657372][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3812.657686][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3812.657961][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3812.658239][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3812.658553][ C2] ? kernel_text_address+0x17/0xe0 [ 3812.658813][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3812.659126][ C2] ? arch_stack_walk+0x8c/0x100 [ 3812.659373][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3812.659637][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3812.659920][ C2] ? lock_acquire+0x1c1/0x220 [ 3812.660158][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3812.660438][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3812.660759][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3812.661034][ C2] ? get_stack_info+0x36/0xc0 [ 3812.661275][ C2] __tcf_classify+0x329/0x7d0 [ 3812.661517][ C2] tcf_classify+0x283/0x930 [ 3812.661746][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3812.662003][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3812.662316][ C2] tc_run+0x2e4/0x5d0 [ 3812.662520][ C2] ? __pfx_tc_run+0x10/0x10 [ 3812.662749][ C2] ? lock_acquire+0x1c1/0x220 [ 3812.662987][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3812.663247][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3812.663500][ C2] ? lock_acquire+0x1c1/0x220 [ 3812.663746][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3812.664010][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3812.664310][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3812.664582][ C2] ? neigh_hh_output+0x348/0x590 [ 3812.664834][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3812.665097][ C2] ip_finish_output2+0x786/0x18e0 [ 3812.665354][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3812.665689][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3812.665962][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3812.666214][ C2] ? __ip_finish_output+0x10f/0x770 [ 3812.666476][ C2] ip_output+0x16b/0x4f0 [ 3812.666694][ C2] ? __pfx_ip_output+0x10/0x10 [ 3812.666934][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3812.667211][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3812.667521][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3812.667796][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3812.668047][ C2] ? __alloc_skb+0xd4/0x280 [ 3812.668278][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3812.668546][ C2] ? tcp_fragment+0x168/0x1040 [ 3812.668789][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3812.669038][ C2] ? ip_local_out+0x114/0x3b0 [ 3812.669276][ C2] __ip_queue_xmit+0x672/0x1910 [ 3812.669533][ C2] ? __skb_clone+0x57a/0x760 [ 3812.669767][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3812.670032][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3812.670311][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3812.670555][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3812.670809][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3812.671109][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3812.671430][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3812.671671][ C2] tcp_send_loss_probe+0x348/0x830 [ 3812.671931][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3812.672199][ C2] tcp_write_timer+0x82/0x1d0 [ 3812.672436][ C2] call_timer_fn+0x173/0x430 [ 3812.672672][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3812.672932][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3812.673194][ C2] __run_timers.part.0+0x52d/0x890 [ 3812.673453][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3812.673724][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3812.674006][ C2] ? lock_acquire+0x1c1/0x220 [ 3812.674246][ C2] ? clockevents_program_event+0xf6/0x300 [ 3812.674533][ C2] ? lock_release+0x1d5/0x250 [ 3812.674772][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3812.675034][ C2] ? ktime_get+0xb3/0x190 [ 3812.675256][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3812.675550][ C2] run_timer_softirq+0x72/0x100 [ 3812.675797][ C2] __do_softirq+0x1b9/0x7ff [ 3812.676029][ C2] irq_exit_rcu+0x98/0xc0 [ 3812.676248][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3812.676535][ C2] [ 3812.676684][ C2] [ 3812.676834][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3812.677138][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3812.677393][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3812.678359][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3812.678665][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3812.679061][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3812.679458][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3812.679856][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3812.680258][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3812.680661][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3812.680951][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3812.681212][ C2] default_idle_call+0x69/0xa0 [ 3812.681455][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3812.681704][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3812.681979][ C2] ? lock_release+0x1d5/0x250 [ 3812.682218][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3812.682490][ C2] do_idle+0xfb/0x160 [ 3812.682691][ C2] cpu_startup_entry+0x55/0x60 [ 3812.682932][ C2] start_secondary+0x21c/0x2b0 [ 3812.683176][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3812.683442][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3812.683752][ C2] [ 3840.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1385s! [perl:4135] [ 3840.569704][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3840.570988][ C1] irq event stamp: 209232 [ 3840.571207][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3840.571735][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3840.572218][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3840.572688][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3840.573151][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3840.573601][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3840.574218][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 3840.574542][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 3840.575519][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3840.575829][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3840.576231][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3840.576630][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3840.577030][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3840.577432][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3840.577832][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3840.578282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3840.578615][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3840.579018][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3840.579421][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3840.579820][ C1] PKRU: 55555554 [ 3840.580003][ C1] Call Trace: [ 3840.580177][ C1] [ 3840.580327][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3840.580597][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3840.580842][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3840.581120][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3840.581392][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3840.581683][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3840.581950][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3840.582257][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3840.582520][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3840.582832][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3840.583128][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3840.583444][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3840.583738][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 3840.584027][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3840.584318][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3840.584629][ C1] ? get_stack_info+0x36/0xc0 [ 3840.584870][ C1] ? lock_acquire+0x1c1/0x220 [ 3840.585113][ C1] ? lock_release+0x1d5/0x250 [ 3840.585354][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3840.585603][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3840.585876][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3840.586162][ C1] ? lock_acquire+0x1c1/0x220 [ 3840.586403][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3840.586645][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3840.586907][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3840.587143][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3840.587391][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3840.587650][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3840.587931][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3840.588210][ C1] ip_local_deliver+0x19d/0x480 [ 3840.588459][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3840.588731][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3840.588998][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3840.589359][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3840.589613][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3840.589935][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3840.590199][ C1] ip_rcv+0x564/0x740 [ 3840.590404][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3840.590638][ C1] ? set_track_prepare+0x8a/0xd0 [ 3840.590893][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3840.591176][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3840.591450][ C1] ? skb_clone+0x10b/0x330 [ 3840.591680][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3840.591999][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3840.592309][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3840.592591][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3840.592889][ C1] ? __tcf_classify+0x329/0x7d0 [ 3840.593140][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3840.593372][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3840.593673][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3840.593959][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3840.594287][ C1] ? lock_acquire+0x1c1/0x220 [ 3840.594524][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3840.594823][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3840.595110][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3840.595426][ C1] ? __copy_skb_header+0xaf/0x490 [ 3840.595685][ C1] ? __skb_clone+0x57a/0x760 [ 3840.595922][ C1] netif_receive_skb+0x55/0x280 [ 3840.596172][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3840.596489][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3840.596822][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3840.597122][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3840.597398][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3840.597687][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3840.598001][ C1] ? hlock_class+0x4e/0x130 [ 3840.598239][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3840.598516][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3840.598792][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3840.599055][ C1] ? hlock_class+0x4e/0x130 [ 3840.599289][ C1] ? mark_lock+0x38/0x3e0 [ 3840.599511][ C1] ? stack_access_ok+0xda/0x1f0 [ 3840.599762][ C1] ? __lock_acquire+0xb67/0x1610 [ 3840.600017][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3840.600295][ C1] ? get_stack_info+0x36/0xc0 [ 3840.600540][ C1] ? stack_access_ok+0xda/0x1f0 [ 3840.600788][ C1] ? get_reg+0x119/0x190 [ 3840.601006][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3840.601278][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3840.601588][ C1] __tcf_classify+0x329/0x7d0 [ 3840.601830][ C1] tcf_classify+0x283/0x930 [ 3840.602065][ C1] ? arch_stack_walk+0xa2/0x100 [ 3840.602317][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3840.602575][ C1] ? get_stack_info+0x36/0xc0 [ 3840.602816][ C1] tc_run+0x2e4/0x5d0 [ 3840.603023][ C1] ? __pfx_tc_run+0x10/0x10 [ 3840.603254][ C1] ? lock_acquire+0x1c1/0x220 [ 3840.603493][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3840.603754][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3840.604009][ C1] ? lock_acquire+0x1c1/0x220 [ 3840.604250][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3840.604517][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3840.604823][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3840.605098][ C1] ? neigh_hh_output+0x348/0x590 [ 3840.605352][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3840.605618][ C1] ip_finish_output2+0x786/0x18e0 [ 3840.605878][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3840.606159][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3840.606500][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3840.606777][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3840.607031][ C1] ? __ip_finish_output+0x10f/0x770 [ 3840.607297][ C1] ip_output+0x16b/0x4f0 [ 3840.607513][ C1] ? run_timer_softirq+0x72/0x100 [ 3840.607775][ C1] ? __pfx_ip_output+0x10/0x10 [ 3840.608020][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3840.608309][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3840.608563][ C1] ? ip_local_out+0x114/0x3b0 [ 3840.608804][ C1] __ip_queue_xmit+0x672/0x1910 [ 3840.609053][ C1] ? __create_object+0x5e/0xb0 [ 3840.609300][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3840.609568][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3840.609851][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3840.610128][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3840.610410][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3840.610691][ C1] tcp_delack_timer+0x84/0x240 [ 3840.610938][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3840.611210][ C1] call_timer_fn+0x173/0x430 [ 3840.611448][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3840.611710][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3840.611972][ C1] __run_timers.part.0+0x52d/0x890 [ 3840.612237][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3840.612512][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3840.612800][ C1] ? lock_acquire+0x1c1/0x220 [ 3840.613041][ C1] ? clockevents_program_event+0xf6/0x300 [ 3840.613332][ C1] ? lock_release+0x1d5/0x250 [ 3840.613573][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3840.613839][ C1] ? ktime_get+0xb3/0x190 [ 3840.614062][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3840.614362][ C1] run_timer_softirq+0x72/0x100 [ 3840.614613][ C1] __do_softirq+0x1b9/0x7ff [ 3840.614847][ C1] irq_exit_rcu+0x98/0xc0 [ 3840.615069][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3840.615357][ C1] [ 3840.615510][ C1] [ 3840.615661][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3840.615970][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3840.616298][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3840.617276][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3840.617586][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3840.617988][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3840.618390][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3840.618792][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3840.619193][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3840.619596][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3840.619896][ C1] pipe_read+0xa16/0xdf0 [ 3840.620118][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3840.620398][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3840.620656][ C1] ? iterate_tty_write+0x299/0x540 [ 3840.620918][ C1] ? lock_release+0x1d5/0x250 [ 3840.621161][ C1] vfs_read+0x911/0xc00 [ 3840.621377][ C1] ? lock_acquire+0x1c1/0x220 [ 3840.621617][ C1] ? __might_fault+0xc6/0x180 [ 3840.621859][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3840.622100][ C1] ? __might_fault+0xc6/0x180 [ 3840.622340][ C1] ? lock_release+0x1d5/0x250 [ 3840.622580][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3840.622845][ C1] ? __fget_light+0x54/0x1e0 [ 3840.623084][ C1] ksys_read+0x17a/0x1e0 [ 3840.623303][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3840.623550][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3840.623856][ C1] do_syscall_64+0xc9/0x1e0 [ 3840.624089][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3840.624391][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3840.624621][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3840.625597][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3840.626020][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3840.626424][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3840.626824][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3840.627225][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3840.627626][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3840.628030][ C1] [ 3840.628187][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1385s! [swapper/2:0] [ 3840.628608][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3840.629857][ C2] irq event stamp: 44114564 [ 3840.630085][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3840.630622][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3840.631132][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3840.631605][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3840.632071][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3840.632525][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3840.633134][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3840.633458][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3840.634422][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3840.634727][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3840.635124][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3840.635520][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3840.635915][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3840.636314][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3840.636710][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3840.637155][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3840.637484][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3840.637881][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3840.638280][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3840.638676][ C2] PKRU: 55555554 [ 3840.638857][ C2] Call Trace: [ 3840.639025][ C2] [ 3840.639174][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3840.639435][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3840.639675][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3840.639950][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3840.640222][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3840.640516][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3840.640780][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3840.641084][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3840.641345][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3840.641605][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3840.641911][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3840.642204][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3840.642516][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3840.642802][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3840.643096][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3840.643390][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3840.643698][ C2] ? get_stack_info+0x36/0xc0 [ 3840.643936][ C2] ? lock_acquire+0x1c1/0x220 [ 3840.644176][ C2] ? lock_release+0x1d5/0x250 [ 3840.644415][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3840.644662][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3840.644932][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3840.645215][ C2] ? lock_acquire+0x1c1/0x220 [ 3840.645454][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3840.645692][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3840.645951][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3840.646184][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3840.646428][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3840.646686][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3840.646960][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3840.647236][ C2] ip_local_deliver+0x19d/0x480 [ 3840.647482][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3840.647751][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3840.648012][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3840.648358][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3840.648608][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3840.648926][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3840.649187][ C2] ip_rcv+0x564/0x740 [ 3840.649390][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3840.649617][ C2] ? set_track_prepare+0x8a/0xd0 [ 3840.649868][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3840.650145][ C2] ? start_secondary+0x21c/0x2b0 [ 3840.650394][ C2] ? skb_clone+0x10b/0x330 [ 3840.650629][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3840.650948][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3840.651253][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3840.651531][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3840.651826][ C2] ? __tcf_classify+0x329/0x7d0 [ 3840.652072][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3840.652301][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3840.652600][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3840.652882][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3840.653207][ C2] ? lock_acquire+0x1c1/0x220 [ 3840.653446][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3840.653741][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3840.654023][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3840.654338][ C2] ? __copy_skb_header+0xaf/0x490 [ 3840.654599][ C2] ? __skb_clone+0x57a/0x760 [ 3840.654832][ C2] netif_receive_skb+0x55/0x280 [ 3840.655079][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3840.655388][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3840.655718][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3840.656015][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3840.656288][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3840.656576][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3840.656887][ C2] ? get_stack_info+0x36/0xc0 [ 3840.657125][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3840.657389][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3840.657703][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3840.657980][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3840.658255][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3840.658568][ C2] ? kernel_text_address+0x17/0xe0 [ 3840.658826][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3840.659138][ C2] ? arch_stack_walk+0x8c/0x100 [ 3840.659389][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3840.659652][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3840.659934][ C2] ? lock_acquire+0x1c1/0x220 [ 3840.660174][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3840.660454][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3840.660761][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3840.661038][ C2] ? get_stack_info+0x36/0xc0 [ 3840.661277][ C2] __tcf_classify+0x329/0x7d0 [ 3840.661519][ C2] tcf_classify+0x283/0x930 [ 3840.661750][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3840.662005][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3840.662316][ C2] tc_run+0x2e4/0x5d0 [ 3840.662520][ C2] ? __pfx_tc_run+0x10/0x10 [ 3840.662748][ C2] ? lock_acquire+0x1c1/0x220 [ 3840.662986][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3840.663245][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3840.663497][ C2] ? lock_acquire+0x1c1/0x220 [ 3840.663734][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3840.663996][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3840.664299][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3840.664569][ C2] ? neigh_hh_output+0x348/0x590 [ 3840.664821][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3840.665083][ C2] ip_finish_output2+0x786/0x18e0 [ 3840.665338][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3840.665673][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3840.665949][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3840.666200][ C2] ? __ip_finish_output+0x10f/0x770 [ 3840.666464][ C2] ip_output+0x16b/0x4f0 [ 3840.666679][ C2] ? __pfx_ip_output+0x10/0x10 [ 3840.666922][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3840.667201][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3840.667511][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3840.667786][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3840.668035][ C2] ? __alloc_skb+0xd4/0x280 [ 3840.668266][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3840.668534][ C2] ? tcp_fragment+0x168/0x1040 [ 3840.668776][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3840.669026][ C2] ? ip_local_out+0x114/0x3b0 [ 3840.669266][ C2] __ip_queue_xmit+0x672/0x1910 [ 3840.669512][ C2] ? __skb_clone+0x57a/0x760 [ 3840.669745][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3840.670010][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3840.670292][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3840.670541][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3840.670788][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3840.671088][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3840.671407][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3840.671650][ C2] tcp_send_loss_probe+0x348/0x830 [ 3840.671909][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3840.672175][ C2] tcp_write_timer+0x82/0x1d0 [ 3840.672414][ C2] call_timer_fn+0x173/0x430 [ 3840.672649][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3840.672910][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3840.673170][ C2] __run_timers.part.0+0x52d/0x890 [ 3840.673429][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3840.673697][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3840.673979][ C2] ? lock_acquire+0x1c1/0x220 [ 3840.674217][ C2] ? clockevents_program_event+0xf6/0x300 [ 3840.674507][ C2] ? lock_release+0x1d5/0x250 [ 3840.674743][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3840.675007][ C2] ? ktime_get+0xb3/0x190 [ 3840.675228][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3840.675522][ C2] run_timer_softirq+0x72/0x100 [ 3840.675768][ C2] __do_softirq+0x1b9/0x7ff [ 3840.676000][ C2] irq_exit_rcu+0x98/0xc0 [ 3840.676219][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3840.676504][ C2] [ 3840.676652][ C2] [ 3840.676803][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3840.677105][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3840.677360][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3840.678325][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3840.678629][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3840.679027][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3840.679425][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3840.679824][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3840.680221][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3840.680628][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3840.680914][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3840.681174][ C2] default_idle_call+0x69/0xa0 [ 3840.681420][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3840.681669][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3840.681945][ C2] ? lock_release+0x1d5/0x250 [ 3840.682184][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3840.682455][ C2] do_idle+0xfb/0x160 [ 3840.682657][ C2] cpu_startup_entry+0x55/0x60 [ 3840.682899][ C2] start_secondary+0x21c/0x2b0 [ 3840.683142][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3840.683409][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3840.683718][ C2] [ 3864.018104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3864.018473][ C1] rcu: 1-....: (1505797 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=367515 [ 3864.019031][ C1] rcu: (t=1509131 jiffies g=1882453 q=703 ncpus=4) [ 3864.019366][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3864.019816][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3864.020442][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3864.020771][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3864.021749][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3864.022060][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3864.022469][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3864.022869][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3864.023277][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3864.023680][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3864.024081][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3864.024530][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3864.024865][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3864.025271][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3864.025673][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3864.026074][ C1] PKRU: 55555554 [ 3864.026257][ C1] Call Trace: [ 3864.026430][ C1] [ 3864.026579][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3864.026853][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3864.027107][ C1] ? check_cpu_stall+0x284/0x500 [ 3864.027361][ C1] ? rcu_pending+0x92/0x360 [ 3864.027593][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3864.027865][ C1] ? update_process_times+0xb9/0x110 [ 3864.028137][ C1] ? tick_sched_handle+0x67/0x130 [ 3864.028395][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3864.028683][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3864.028926][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3864.029242][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3864.029517][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3864.029807][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3864.030073][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3864.030387][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3864.030657][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3864.030971][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3864.031266][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3864.031584][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3864.031876][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3864.032171][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3864.032464][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3864.032777][ C1] ? get_stack_info+0x36/0xc0 [ 3864.033018][ C1] ? lock_acquire+0x1c1/0x220 [ 3864.033259][ C1] ? lock_release+0x1d5/0x250 [ 3864.033501][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3864.033753][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3864.034027][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3864.034314][ C1] ? lock_acquire+0x1c1/0x220 [ 3864.034553][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3864.034796][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3864.035058][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3864.035295][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3864.035545][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3864.035804][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3864.036082][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3864.036361][ C1] ip_local_deliver+0x19d/0x480 [ 3864.036610][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3864.036883][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3864.037151][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3864.037501][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3864.037756][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3864.038079][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3864.038344][ C1] ip_rcv+0x564/0x740 [ 3864.038550][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3864.038783][ C1] ? set_track_prepare+0x8a/0xd0 [ 3864.039038][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3864.039317][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3864.039592][ C1] ? skb_clone+0x10b/0x330 [ 3864.039823][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3864.040144][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3864.040456][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3864.040741][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3864.041038][ C1] ? __tcf_classify+0x329/0x7d0 [ 3864.041288][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3864.041521][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3864.041822][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3864.042114][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3864.042443][ C1] ? lock_acquire+0x1c1/0x220 [ 3864.042685][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3864.042982][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3864.043273][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3864.043593][ C1] ? __copy_skb_header+0xaf/0x490 [ 3864.043852][ C1] ? __skb_clone+0x57a/0x760 [ 3864.044087][ C1] netif_receive_skb+0x55/0x280 [ 3864.044337][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3864.044653][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3864.044987][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3864.045292][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3864.045568][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3864.045857][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3864.046173][ C1] ? hlock_class+0x4e/0x130 [ 3864.046409][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3864.046687][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3864.046964][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3864.047231][ C1] ? hlock_class+0x4e/0x130 [ 3864.047464][ C1] ? mark_lock+0x38/0x3e0 [ 3864.047687][ C1] ? stack_access_ok+0xda/0x1f0 [ 3864.047937][ C1] ? __lock_acquire+0xb67/0x1610 [ 3864.048192][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3864.048472][ C1] ? get_stack_info+0x36/0xc0 [ 3864.048713][ C1] ? stack_access_ok+0xda/0x1f0 [ 3864.048962][ C1] ? get_reg+0x119/0x190 [ 3864.049184][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3864.049454][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3864.049768][ C1] __tcf_classify+0x329/0x7d0 [ 3864.050011][ C1] tcf_classify+0x283/0x930 [ 3864.050245][ C1] ? arch_stack_walk+0xa2/0x100 [ 3864.050501][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3864.050760][ C1] ? get_stack_info+0x36/0xc0 [ 3864.051003][ C1] tc_run+0x2e4/0x5d0 [ 3864.051209][ C1] ? __pfx_tc_run+0x10/0x10 [ 3864.051443][ C1] ? lock_acquire+0x1c1/0x220 [ 3864.051682][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3864.051947][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3864.052200][ C1] ? lock_acquire+0x1c1/0x220 [ 3864.052442][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3864.052707][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3864.053015][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3864.053288][ C1] ? neigh_hh_output+0x348/0x590 [ 3864.053543][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3864.053808][ C1] ip_finish_output2+0x786/0x18e0 [ 3864.054066][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3864.054348][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3864.054688][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3864.054966][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3864.055221][ C1] ? __ip_finish_output+0x10f/0x770 [ 3864.055487][ C1] ip_output+0x16b/0x4f0 [ 3864.055706][ C1] ? run_timer_softirq+0x72/0x100 [ 3864.055964][ C1] ? __pfx_ip_output+0x10/0x10 [ 3864.056207][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3864.056497][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3864.056754][ C1] ? ip_local_out+0x114/0x3b0 [ 3864.056995][ C1] __ip_queue_xmit+0x672/0x1910 [ 3864.057243][ C1] ? __create_object+0x5e/0xb0 [ 3864.057490][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3864.057758][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3864.058043][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3864.058321][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3864.058604][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3864.058879][ C1] tcp_delack_timer+0x84/0x240 [ 3864.059123][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3864.059400][ C1] call_timer_fn+0x173/0x430 [ 3864.059636][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3864.059900][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3864.060164][ C1] __run_timers.part.0+0x52d/0x890 [ 3864.060432][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3864.060708][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3864.060994][ C1] ? lock_acquire+0x1c1/0x220 [ 3864.061237][ C1] ? clockevents_program_event+0xf6/0x300 [ 3864.061530][ C1] ? lock_release+0x1d5/0x250 [ 3864.061770][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3864.062036][ C1] ? ktime_get+0xb3/0x190 [ 3864.062260][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3864.062556][ C1] run_timer_softirq+0x72/0x100 [ 3864.062807][ C1] __do_softirq+0x1b9/0x7ff [ 3864.063042][ C1] irq_exit_rcu+0x98/0xc0 [ 3864.063263][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3864.063553][ C1] [ 3864.063703][ C1] [ 3864.063859][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3864.064165][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3864.064491][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3864.065473][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3864.065782][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3864.066185][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3864.066587][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3864.066989][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3864.067390][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3864.067795][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3864.068092][ C1] pipe_read+0xa16/0xdf0 [ 3864.068316][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3864.068598][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3864.068844][ C1] ? iterate_tty_write+0x299/0x540 [ 3864.069106][ C1] ? lock_release+0x1d5/0x250 [ 3864.069348][ C1] vfs_read+0x911/0xc00 [ 3864.069564][ C1] ? lock_acquire+0x1c1/0x220 [ 3864.069804][ C1] ? __might_fault+0xc6/0x180 [ 3864.070044][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3864.070285][ C1] ? __might_fault+0xc6/0x180 [ 3864.070533][ C1] ? lock_release+0x1d5/0x250 [ 3864.070773][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3864.071040][ C1] ? __fget_light+0x54/0x1e0 [ 3864.071277][ C1] ksys_read+0x17a/0x1e0 [ 3864.071497][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3864.071743][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3864.072048][ C1] do_syscall_64+0xc9/0x1e0 [ 3864.072283][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3864.072584][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3864.072812][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3864.073785][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3864.074211][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3864.074613][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3864.075013][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3864.075416][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3864.075816][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3864.076221][ C1] [ 3864.076380][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3864.076655][ C2] NMI backtrace for cpu 2 [ 3864.076660][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3864.076667][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3864.076671][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3864.076678][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3864.076684][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3864.076687][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3864.076688][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3864.076690][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3864.076692][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3864.076693][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3864.076695][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3864.076697][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3864.076701][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3864.076702][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3864.076703][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3864.076705][ C2] PKRU: 55555554 [ 3864.076707][ C2] Call Trace: [ 3864.076710][ C2] [ 3864.076712][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3864.076719][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3864.076724][ C2] ? nmi_handle+0x153/0x420 [ 3864.076729][ C2] ? default_do_nmi+0x41/0x100 [ 3864.076731][ C2] ? exc_nmi+0xf3/0x120 [ 3864.076734][ C2] ? end_repeat_nmi+0xf/0x60 [ 3864.076738][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3864.076741][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3864.076744][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3864.076748][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3864.076751][ C2] [ 3864.076751][ C2] [ 3864.076752][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3864.076755][ C2] ? get_stack_info+0x36/0xc0 [ 3864.076759][ C2] ? lock_acquire+0x1c1/0x220 [ 3864.076762][ C2] ? lock_release+0x1d5/0x250 [ 3864.076765][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3864.076769][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3864.076772][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3864.076775][ C2] ? lock_acquire+0x1c1/0x220 [ 3864.076778][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3864.076781][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3864.076784][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3864.076790][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3864.076792][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3864.076797][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3864.076802][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3864.076806][ C2] ip_local_deliver+0x19d/0x480 [ 3864.076808][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3864.076810][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3864.076813][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3864.076818][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3864.076821][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3864.076824][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3864.076833][ C2] ip_rcv+0x564/0x740 [ 3864.076836][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3864.076839][ C2] ? set_track_prepare+0x8a/0xd0 [ 3864.076842][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3864.076845][ C2] ? start_secondary+0x21c/0x2b0 [ 3864.076848][ C2] ? skb_clone+0x10b/0x330 [ 3864.076851][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3864.076857][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3864.076862][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3864.076866][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3864.076874][ C2] ? __tcf_classify+0x329/0x7d0 [ 3864.076878][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3864.076880][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3864.076883][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3864.076886][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3864.076890][ C2] ? lock_acquire+0x1c1/0x220 [ 3864.076893][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3864.076897][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3864.076900][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3864.076904][ C2] ? __copy_skb_header+0xaf/0x490 [ 3864.076909][ C2] ? __skb_clone+0x57a/0x760 [ 3864.076912][ C2] netif_receive_skb+0x55/0x280 [ 3864.076915][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3864.076923][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3864.076930][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3864.076936][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3864.076940][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3864.076951][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3864.076958][ C2] ? get_stack_info+0x36/0xc0 [ 3864.076963][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3864.076965][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3864.076969][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3864.076971][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3864.076974][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3864.076977][ C2] ? kernel_text_address+0x17/0xe0 [ 3864.076979][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3864.076983][ C2] ? arch_stack_walk+0x8c/0x100 [ 3864.076987][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3864.076990][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3864.076993][ C2] ? lock_acquire+0x1c1/0x220 [ 3864.076995][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3864.076999][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3864.077002][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3864.077005][ C2] ? get_stack_info+0x36/0xc0 [ 3864.077009][ C2] __tcf_classify+0x329/0x7d0 [ 3864.077014][ C2] tcf_classify+0x283/0x930 [ 3864.077019][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3864.077022][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3864.077026][ C2] tc_run+0x2e4/0x5d0 [ 3864.077030][ C2] ? __pfx_tc_run+0x10/0x10 [ 3864.077033][ C2] ? lock_acquire+0x1c1/0x220 [ 3864.077035][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3864.077039][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3864.077043][ C2] ? lock_acquire+0x1c1/0x220 [ 3864.077045][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3864.077048][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3864.077051][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3864.077053][ C2] ? neigh_hh_output+0x348/0x590 [ 3864.077057][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3864.077061][ C2] ip_finish_output2+0x786/0x18e0 [ 3864.077064][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3864.077072][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3864.077074][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3864.077078][ C2] ? __ip_finish_output+0x10f/0x770 [ 3864.077082][ C2] ip_output+0x16b/0x4f0 [ 3864.077085][ C2] ? __pfx_ip_output+0x10/0x10 [ 3864.077087][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3864.077090][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3864.077093][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3864.077096][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3864.077098][ C2] ? __alloc_skb+0xd4/0x280 [ 3864.077100][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3864.077104][ C2] ? tcp_fragment+0x168/0x1040 [ 3864.077107][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3864.077110][ C2] ? ip_local_out+0x114/0x3b0 [ 3864.077113][ C2] __ip_queue_xmit+0x672/0x1910 [ 3864.077117][ C2] ? __skb_clone+0x57a/0x760 [ 3864.077119][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3864.077124][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3864.077127][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3864.077131][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3864.077135][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3864.077139][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3864.077142][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3864.077145][ C2] tcp_send_loss_probe+0x348/0x830 [ 3864.077148][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3864.077151][ C2] tcp_write_timer+0x82/0x1d0 [ 3864.077154][ C2] call_timer_fn+0x173/0x430 [ 3864.077158][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3864.077163][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3864.077167][ C2] __run_timers.part.0+0x52d/0x890 [ 3864.077170][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3864.077174][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3864.077177][ C2] ? lock_acquire+0x1c1/0x220 [ 3864.077180][ C2] ? clockevents_program_event+0xf6/0x300 [ 3864.077184][ C2] ? lock_release+0x1d5/0x250 [ 3864.077186][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3864.077190][ C2] ? ktime_get+0xb3/0x190 [ 3864.077193][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3864.077197][ C2] run_timer_softirq+0x72/0x100 [ 3864.077200][ C2] __do_softirq+0x1b9/0x7ff [ 3864.077205][ C2] irq_exit_rcu+0x98/0xc0 [ 3864.077207][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3864.077210][ C2] [ 3864.077211][ C2] [ 3864.077212][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3864.077216][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3864.077219][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3864.077221][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3864.077223][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3864.077225][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3864.077226][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3864.077227][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3864.077229][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3864.077232][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3864.077236][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3864.077239][ C2] default_idle_call+0x69/0xa0 [ 3864.077242][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3864.077244][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3864.077248][ C2] ? lock_release+0x1d5/0x250 [ 3864.077251][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3864.077254][ C2] do_idle+0xfb/0x160 [ 3864.077257][ C2] cpu_startup_entry+0x55/0x60 [ 3864.077260][ C2] start_secondary+0x21c/0x2b0 [ 3864.077263][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3864.077267][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3864.077273][ C2] [ 3888.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1430s! [perl:4135] [ 3888.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3888.570980][ C1] irq event stamp: 209232 [ 3888.571200][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3888.571731][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3888.572211][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3888.572682][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3888.573146][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3888.573597][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3888.574215][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3888.574542][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3888.575518][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3888.575828][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3888.576230][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3888.576631][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3888.577031][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3888.577433][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3888.577835][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3888.578286][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3888.578620][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3888.579023][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3888.579427][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3888.579827][ C1] PKRU: 55555554 [ 3888.580010][ C1] Call Trace: [ 3888.580183][ C1] [ 3888.580338][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3888.580601][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3888.580846][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3888.581123][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3888.581396][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3888.581687][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3888.581954][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3888.582262][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3888.582525][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3888.582836][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3888.583131][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3888.583448][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3888.583739][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3888.584034][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3888.584327][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3888.584639][ C1] ? get_stack_info+0x36/0xc0 [ 3888.584880][ C1] ? lock_acquire+0x1c1/0x220 [ 3888.585122][ C1] ? lock_release+0x1d5/0x250 [ 3888.585363][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3888.585613][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3888.585886][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3888.586171][ C1] ? lock_acquire+0x1c1/0x220 [ 3888.586412][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3888.586655][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3888.586917][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3888.587155][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3888.587402][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3888.587661][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3888.587941][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3888.588219][ C1] ip_local_deliver+0x19d/0x480 [ 3888.588466][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3888.588738][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3888.589002][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3888.589352][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3888.589607][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3888.589928][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3888.590197][ C1] ip_rcv+0x564/0x740 [ 3888.590406][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3888.590635][ C1] ? set_track_prepare+0x8a/0xd0 [ 3888.590889][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3888.591168][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3888.591441][ C1] ? skb_clone+0x10b/0x330 [ 3888.591668][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3888.591987][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3888.592295][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3888.592578][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3888.592872][ C1] ? __tcf_classify+0x329/0x7d0 [ 3888.593123][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3888.593354][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3888.593655][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3888.593942][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3888.594269][ C1] ? lock_acquire+0x1c1/0x220 [ 3888.594507][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3888.594804][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3888.595090][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3888.595408][ C1] ? __copy_skb_header+0xaf/0x490 [ 3888.595667][ C1] ? __skb_clone+0x57a/0x760 [ 3888.595902][ C1] netif_receive_skb+0x55/0x280 [ 3888.596152][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3888.596467][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3888.596800][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3888.597100][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3888.597376][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3888.597664][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3888.597980][ C1] ? hlock_class+0x4e/0x130 [ 3888.598218][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3888.598495][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3888.598770][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3888.599034][ C1] ? hlock_class+0x4e/0x130 [ 3888.599269][ C1] ? mark_lock+0x38/0x3e0 [ 3888.599490][ C1] ? stack_access_ok+0xda/0x1f0 [ 3888.599739][ C1] ? __lock_acquire+0xb67/0x1610 [ 3888.599994][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3888.600275][ C1] ? get_stack_info+0x36/0xc0 [ 3888.600518][ C1] ? stack_access_ok+0xda/0x1f0 [ 3888.600766][ C1] ? get_reg+0x119/0x190 [ 3888.600984][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3888.601255][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3888.601565][ C1] __tcf_classify+0x329/0x7d0 [ 3888.601806][ C1] tcf_classify+0x283/0x930 [ 3888.602040][ C1] ? arch_stack_walk+0xa2/0x100 [ 3888.602291][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3888.602549][ C1] ? get_stack_info+0x36/0xc0 [ 3888.602791][ C1] tc_run+0x2e4/0x5d0 [ 3888.602999][ C1] ? __pfx_tc_run+0x10/0x10 [ 3888.603230][ C1] ? lock_acquire+0x1c1/0x220 [ 3888.603471][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3888.603734][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3888.603988][ C1] ? lock_acquire+0x1c1/0x220 [ 3888.604229][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3888.604495][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3888.604802][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3888.605076][ C1] ? neigh_hh_output+0x348/0x590 [ 3888.605331][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3888.605599][ C1] ip_finish_output2+0x786/0x18e0 [ 3888.605856][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3888.606136][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3888.606477][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3888.606754][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3888.607008][ C1] ? __ip_finish_output+0x10f/0x770 [ 3888.607275][ C1] ip_output+0x16b/0x4f0 [ 3888.607490][ C1] ? run_timer_softirq+0x72/0x100 [ 3888.607748][ C1] ? __pfx_ip_output+0x10/0x10 [ 3888.607993][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3888.608281][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3888.608534][ C1] ? ip_local_out+0x114/0x3b0 [ 3888.608774][ C1] __ip_queue_xmit+0x672/0x1910 [ 3888.609024][ C1] ? __create_object+0x5e/0xb0 [ 3888.609272][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3888.609539][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3888.609822][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3888.610097][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3888.610385][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3888.610658][ C1] tcp_delack_timer+0x84/0x240 [ 3888.610903][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3888.611176][ C1] call_timer_fn+0x173/0x430 [ 3888.611414][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3888.611677][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3888.611940][ C1] __run_timers.part.0+0x52d/0x890 [ 3888.612201][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3888.612476][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3888.612764][ C1] ? lock_acquire+0x1c1/0x220 [ 3888.613005][ C1] ? clockevents_program_event+0xf6/0x300 [ 3888.613295][ C1] ? lock_release+0x1d5/0x250 [ 3888.613536][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3888.613801][ C1] ? ktime_get+0xb3/0x190 [ 3888.614022][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3888.614321][ C1] run_timer_softirq+0x72/0x100 [ 3888.614571][ C1] __do_softirq+0x1b9/0x7ff [ 3888.614806][ C1] irq_exit_rcu+0x98/0xc0 [ 3888.615026][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3888.615318][ C1] [ 3888.615471][ C1] [ 3888.615621][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3888.615928][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3888.616255][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3888.617235][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3888.617544][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3888.617946][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3888.618349][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3888.618751][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3888.619152][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3888.619555][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3888.619854][ C1] pipe_read+0xa16/0xdf0 [ 3888.620075][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3888.620362][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3888.620605][ C1] ? iterate_tty_write+0x299/0x540 [ 3888.620871][ C1] ? lock_release+0x1d5/0x250 [ 3888.621116][ C1] vfs_read+0x911/0xc00 [ 3888.621331][ C1] ? lock_acquire+0x1c1/0x220 [ 3888.621570][ C1] ? __might_fault+0xc6/0x180 [ 3888.621812][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3888.622053][ C1] ? __might_fault+0xc6/0x180 [ 3888.622294][ C1] ? lock_release+0x1d5/0x250 [ 3888.622535][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3888.622799][ C1] ? __fget_light+0x54/0x1e0 [ 3888.623038][ C1] ksys_read+0x17a/0x1e0 [ 3888.623258][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3888.623503][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3888.623809][ C1] do_syscall_64+0xc9/0x1e0 [ 3888.624044][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3888.624345][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3888.624575][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3888.625549][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3888.625972][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3888.626373][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3888.626773][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3888.627172][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3888.627574][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3888.627977][ C1] [ 3888.628134][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1430s! [swapper/2:0] [ 3888.628556][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3888.629803][ C2] irq event stamp: 44114564 [ 3888.630029][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3888.630570][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3888.631078][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3888.631551][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3888.632020][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3888.632474][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3888.633080][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3888.633403][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3888.634369][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3888.634678][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3888.635075][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3888.635474][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3888.635869][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3888.636264][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3888.636662][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3888.637106][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3888.637437][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3888.637834][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3888.638229][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3888.638631][ C2] PKRU: 55555554 [ 3888.638811][ C2] Call Trace: [ 3888.638981][ C2] [ 3888.639129][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3888.639391][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3888.639631][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3888.639909][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3888.640180][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3888.640475][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3888.640739][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3888.641043][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3888.641302][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3888.641563][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3888.641870][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3888.642164][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3888.642477][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3888.642762][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3888.643055][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3888.643342][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3888.643652][ C2] ? get_stack_info+0x36/0xc0 [ 3888.643892][ C2] ? lock_acquire+0x1c1/0x220 [ 3888.644132][ C2] ? lock_release+0x1d5/0x250 [ 3888.644369][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3888.644614][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3888.644886][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3888.645169][ C2] ? lock_acquire+0x1c1/0x220 [ 3888.645407][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3888.645645][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3888.645904][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3888.646135][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3888.646381][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3888.646636][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3888.646907][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3888.647185][ C2] ip_local_deliver+0x19d/0x480 [ 3888.647430][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3888.647700][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3888.647961][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3888.648305][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3888.648556][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3888.648874][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3888.649134][ C2] ip_rcv+0x564/0x740 [ 3888.649336][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3888.649567][ C2] ? set_track_prepare+0x8a/0xd0 [ 3888.649818][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3888.650092][ C2] ? start_secondary+0x21c/0x2b0 [ 3888.650351][ C2] ? skb_clone+0x10b/0x330 [ 3888.650578][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3888.650895][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3888.651198][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3888.651479][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3888.651770][ C2] ? __tcf_classify+0x329/0x7d0 [ 3888.652017][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3888.652248][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3888.652545][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3888.652827][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3888.653151][ C2] ? lock_acquire+0x1c1/0x220 [ 3888.653390][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3888.653682][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3888.653968][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3888.654283][ C2] ? __copy_skb_header+0xaf/0x490 [ 3888.654539][ C2] ? __skb_clone+0x57a/0x760 [ 3888.654772][ C2] netif_receive_skb+0x55/0x280 [ 3888.655019][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3888.655330][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3888.655658][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3888.655956][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3888.656229][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3888.656515][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3888.656824][ C2] ? get_stack_info+0x36/0xc0 [ 3888.657064][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3888.657327][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3888.657641][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3888.657915][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3888.658194][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3888.658510][ C2] ? kernel_text_address+0x17/0xe0 [ 3888.658769][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3888.659079][ C2] ? arch_stack_walk+0x8c/0x100 [ 3888.659325][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3888.659588][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3888.659870][ C2] ? lock_acquire+0x1c1/0x220 [ 3888.660108][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3888.660392][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3888.660696][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3888.660969][ C2] ? get_stack_info+0x36/0xc0 [ 3888.661209][ C2] __tcf_classify+0x329/0x7d0 [ 3888.661451][ C2] tcf_classify+0x283/0x930 [ 3888.661680][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3888.661934][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3888.662248][ C2] tc_run+0x2e4/0x5d0 [ 3888.662451][ C2] ? __pfx_tc_run+0x10/0x10 [ 3888.662682][ C2] ? lock_acquire+0x1c1/0x220 [ 3888.662920][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3888.663179][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3888.663431][ C2] ? lock_acquire+0x1c1/0x220 [ 3888.663668][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3888.663930][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3888.664230][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3888.664502][ C2] ? neigh_hh_output+0x348/0x590 [ 3888.664753][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3888.665016][ C2] ip_finish_output2+0x786/0x18e0 [ 3888.665272][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3888.665606][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3888.665880][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3888.666131][ C2] ? __ip_finish_output+0x10f/0x770 [ 3888.666393][ C2] ip_output+0x16b/0x4f0 [ 3888.666611][ C2] ? __pfx_ip_output+0x10/0x10 [ 3888.666851][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3888.667127][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3888.667436][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3888.667710][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3888.667960][ C2] ? __alloc_skb+0xd4/0x280 [ 3888.668190][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3888.668458][ C2] ? tcp_fragment+0x168/0x1040 [ 3888.668699][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3888.668947][ C2] ? ip_local_out+0x114/0x3b0 [ 3888.669185][ C2] __ip_queue_xmit+0x672/0x1910 [ 3888.669432][ C2] ? __skb_clone+0x57a/0x760 [ 3888.669666][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3888.669931][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3888.670209][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3888.670458][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3888.670706][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3888.671005][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3888.671323][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3888.671565][ C2] tcp_send_loss_probe+0x348/0x830 [ 3888.671824][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3888.672090][ C2] tcp_write_timer+0x82/0x1d0 [ 3888.672329][ C2] call_timer_fn+0x173/0x430 [ 3888.672563][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3888.672823][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3888.673082][ C2] __run_timers.part.0+0x52d/0x890 [ 3888.673341][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3888.673611][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3888.673894][ C2] ? lock_acquire+0x1c1/0x220 [ 3888.674133][ C2] ? clockevents_program_event+0xf6/0x300 [ 3888.674419][ C2] ? lock_release+0x1d5/0x250 [ 3888.674657][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3888.674923][ C2] ? ktime_get+0xb3/0x190 [ 3888.675144][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3888.675438][ C2] run_timer_softirq+0x72/0x100 [ 3888.675684][ C2] __do_softirq+0x1b9/0x7ff [ 3888.675915][ C2] irq_exit_rcu+0x98/0xc0 [ 3888.676134][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3888.676419][ C2] [ 3888.676567][ C2] [ 3888.676715][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3888.677018][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3888.677273][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3888.678240][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3888.678547][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3888.678941][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3888.679343][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3888.679740][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3888.680136][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3888.680539][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3888.680828][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3888.681086][ C2] default_idle_call+0x69/0xa0 [ 3888.681329][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3888.681579][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3888.681854][ C2] ? lock_release+0x1d5/0x250 [ 3888.682092][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3888.682364][ C2] do_idle+0xfb/0x160 [ 3888.682566][ C2] cpu_startup_entry+0x55/0x60 [ 3888.682807][ C2] start_secondary+0x21c/0x2b0 [ 3888.683050][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3888.683319][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3888.683628][ C2] [ 3916.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1456s! [perl:4135] [ 3916.569698][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3916.570960][ C1] irq event stamp: 209232 [ 3916.571180][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3916.571708][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3916.572186][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3916.572655][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3916.573116][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3916.573564][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3916.574176][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3916.574501][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3916.575470][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3916.575778][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3916.576178][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3916.576574][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3916.576972][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3916.577372][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3916.577771][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3916.578220][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3916.578552][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3916.578951][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3916.579353][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3916.579751][ C1] PKRU: 55555554 [ 3916.579933][ C1] Call Trace: [ 3916.580102][ C1] [ 3916.580258][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3916.580520][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3916.580765][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3916.581041][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3916.581315][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3916.581604][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3916.581868][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3916.582175][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3916.582436][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3916.582744][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3916.583039][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3916.583354][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3916.583641][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3916.583936][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3916.584225][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3916.584535][ C1] ? get_stack_info+0x36/0xc0 [ 3916.584777][ C1] ? lock_acquire+0x1c1/0x220 [ 3916.585016][ C1] ? lock_release+0x1d5/0x250 [ 3916.585257][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3916.585505][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3916.585778][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3916.586065][ C1] ? lock_acquire+0x1c1/0x220 [ 3916.586304][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3916.586546][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3916.586805][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3916.587038][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3916.587285][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3916.587542][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3916.587822][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3916.588099][ C1] ip_local_deliver+0x19d/0x480 [ 3916.588351][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3916.588621][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3916.588884][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3916.589232][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3916.589486][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3916.589806][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3916.590068][ C1] ip_rcv+0x564/0x740 [ 3916.590280][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3916.590509][ C1] ? set_track_prepare+0x8a/0xd0 [ 3916.590762][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3916.591040][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3916.591314][ C1] ? skb_clone+0x10b/0x330 [ 3916.591539][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3916.591859][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3916.592167][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3916.592448][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3916.592744][ C1] ? __tcf_classify+0x329/0x7d0 [ 3916.592993][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3916.593222][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3916.593523][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3916.593809][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3916.594135][ C1] ? lock_acquire+0x1c1/0x220 [ 3916.594372][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3916.594670][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3916.594953][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3916.595271][ C1] ? __copy_skb_header+0xaf/0x490 [ 3916.595529][ C1] ? __skb_clone+0x57a/0x760 [ 3916.595767][ C1] netif_receive_skb+0x55/0x280 [ 3916.596015][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3916.596329][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3916.596660][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3916.596960][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3916.597235][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3916.597523][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3916.597836][ C1] ? hlock_class+0x4e/0x130 [ 3916.598068][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3916.598347][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3916.598622][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3916.598885][ C1] ? hlock_class+0x4e/0x130 [ 3916.599117][ C1] ? mark_lock+0x38/0x3e0 [ 3916.599337][ C1] ? stack_access_ok+0xda/0x1f0 [ 3916.599586][ C1] ? __lock_acquire+0xb67/0x1610 [ 3916.599840][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3916.600117][ C1] ? get_stack_info+0x36/0xc0 [ 3916.600364][ C1] ? stack_access_ok+0xda/0x1f0 [ 3916.600610][ C1] ? get_reg+0x119/0x190 [ 3916.600827][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3916.601097][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3916.601405][ C1] __tcf_classify+0x329/0x7d0 [ 3916.601646][ C1] tcf_classify+0x283/0x930 [ 3916.601879][ C1] ? arch_stack_walk+0xa2/0x100 [ 3916.602128][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3916.602386][ C1] ? get_stack_info+0x36/0xc0 [ 3916.602626][ C1] tc_run+0x2e4/0x5d0 [ 3916.602833][ C1] ? __pfx_tc_run+0x10/0x10 [ 3916.603065][ C1] ? lock_acquire+0x1c1/0x220 [ 3916.603306][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3916.603566][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3916.603819][ C1] ? lock_acquire+0x1c1/0x220 [ 3916.604059][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3916.604327][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3916.604634][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3916.604905][ C1] ? neigh_hh_output+0x348/0x590 [ 3916.605159][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3916.605424][ C1] ip_finish_output2+0x786/0x18e0 [ 3916.605679][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3916.605956][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3916.606294][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3916.606570][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3916.606823][ C1] ? __ip_finish_output+0x10f/0x770 [ 3916.607088][ C1] ip_output+0x16b/0x4f0 [ 3916.607303][ C1] ? run_timer_softirq+0x72/0x100 [ 3916.607559][ C1] ? __pfx_ip_output+0x10/0x10 [ 3916.607803][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3916.608087][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3916.608339][ C1] ? ip_local_out+0x114/0x3b0 [ 3916.608580][ C1] __ip_queue_xmit+0x672/0x1910 [ 3916.608827][ C1] ? __create_object+0x5e/0xb0 [ 3916.609072][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3916.609340][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3916.609621][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3916.609896][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3916.610185][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3916.610457][ C1] tcp_delack_timer+0x84/0x240 [ 3916.610701][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3916.610971][ C1] call_timer_fn+0x173/0x430 [ 3916.611209][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3916.611471][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3916.611733][ C1] __run_timers.part.0+0x52d/0x890 [ 3916.611993][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3916.612266][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3916.612553][ C1] ? lock_acquire+0x1c1/0x220 [ 3916.612792][ C1] ? clockevents_program_event+0xf6/0x300 [ 3916.613082][ C1] ? lock_release+0x1d5/0x250 [ 3916.613323][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3916.613587][ C1] ? ktime_get+0xb3/0x190 [ 3916.613806][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3916.614106][ C1] run_timer_softirq+0x72/0x100 [ 3916.614356][ C1] __do_softirq+0x1b9/0x7ff [ 3916.614589][ C1] irq_exit_rcu+0x98/0xc0 [ 3916.614810][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3916.615095][ C1] [ 3916.615249][ C1] [ 3916.615397][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3916.615703][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3916.616029][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3916.617001][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3916.617313][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3916.617711][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3916.618108][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3916.618510][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3916.618913][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3916.619315][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3916.619611][ C1] pipe_read+0xa16/0xdf0 [ 3916.619831][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3916.620110][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3916.620359][ C1] ? iterate_tty_write+0x299/0x540 [ 3916.620620][ C1] ? lock_release+0x1d5/0x250 [ 3916.620861][ C1] vfs_read+0x911/0xc00 [ 3916.621074][ C1] ? lock_acquire+0x1c1/0x220 [ 3916.621314][ C1] ? __might_fault+0xc6/0x180 [ 3916.621555][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3916.621795][ C1] ? __might_fault+0xc6/0x180 [ 3916.622033][ C1] ? lock_release+0x1d5/0x250 [ 3916.622274][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3916.622538][ C1] ? __fget_light+0x54/0x1e0 [ 3916.622776][ C1] ksys_read+0x17a/0x1e0 [ 3916.622992][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3916.623239][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3916.623544][ C1] do_syscall_64+0xc9/0x1e0 [ 3916.623776][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3916.624075][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3916.624305][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3916.625276][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3916.625697][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3916.626096][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3916.626495][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3916.626892][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3916.627290][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3916.627692][ C1] [ 3916.627848][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1456s! [swapper/2:0] [ 3916.628265][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3916.629513][ C2] irq event stamp: 44114564 [ 3916.629741][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3916.630277][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3916.630787][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3916.631266][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3916.631731][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3916.632185][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3916.632797][ C2] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 3916.633086][ C2] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 3916.634053][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000246 [ 3916.634360][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [ 3916.634757][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3916.635156][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [ 3916.635553][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3916.635948][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3916.636347][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3916.636792][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3916.637127][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3916.637524][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3916.637920][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3916.638321][ C2] PKRU: 55555554 [ 3916.638500][ C2] Call Trace: [ 3916.638670][ C2] [ 3916.638817][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3916.639079][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3916.639320][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3916.639598][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3916.639869][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3916.640160][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3916.640426][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3916.640729][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3916.640987][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 3916.641247][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3916.641508][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3916.641815][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3916.642111][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3916.642423][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3916.642713][ C2] ? kasan_check_range+0x158/0x1c0 [ 3916.642972][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 3916.643254][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3916.643565][ C2] ? get_stack_info+0x36/0xc0 [ 3916.643803][ C2] ? lock_acquire+0x1c1/0x220 [ 3916.644043][ C2] ? lock_release+0x1d5/0x250 [ 3916.644284][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3916.644531][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3916.644802][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3916.645084][ C2] ? lock_acquire+0x1c1/0x220 [ 3916.645324][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3916.645563][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3916.645821][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3916.646055][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3916.646301][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3916.646557][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3916.646833][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3916.647108][ C2] ip_local_deliver+0x19d/0x480 [ 3916.647354][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3916.647623][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3916.647888][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3916.648236][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3916.648487][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3916.648805][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3916.649066][ C2] ip_rcv+0x564/0x740 [ 3916.649276][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3916.649504][ C2] ? set_track_prepare+0x8a/0xd0 [ 3916.649759][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3916.650036][ C2] ? start_secondary+0x21c/0x2b0 [ 3916.650293][ C2] ? skb_clone+0x10b/0x330 [ 3916.650518][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3916.650836][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3916.651141][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3916.651420][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3916.651713][ C2] ? __tcf_classify+0x329/0x7d0 [ 3916.651960][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3916.652188][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3916.652488][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3916.652770][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3916.653094][ C2] ? lock_acquire+0x1c1/0x220 [ 3916.653333][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3916.653629][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3916.653912][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3916.654229][ C2] ? __copy_skb_header+0xaf/0x490 [ 3916.654484][ C2] ? __skb_clone+0x57a/0x760 [ 3916.654718][ C2] netif_receive_skb+0x55/0x280 [ 3916.654965][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3916.655276][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3916.655607][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3916.655903][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3916.656177][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3916.656465][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3916.656777][ C2] ? get_stack_info+0x36/0xc0 [ 3916.657017][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3916.657282][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3916.657596][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3916.657872][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3916.658147][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3916.658460][ C2] ? kernel_text_address+0x17/0xe0 [ 3916.658719][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3916.659030][ C2] ? arch_stack_walk+0x8c/0x100 [ 3916.659277][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3916.659540][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3916.659823][ C2] ? lock_acquire+0x1c1/0x220 [ 3916.660060][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3916.660347][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3916.660649][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3916.660925][ C2] ? get_stack_info+0x36/0xc0 [ 3916.661163][ C2] __tcf_classify+0x329/0x7d0 [ 3916.661405][ C2] tcf_classify+0x283/0x930 [ 3916.661637][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3916.661892][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3916.662204][ C2] tc_run+0x2e4/0x5d0 [ 3916.662407][ C2] ? __pfx_tc_run+0x10/0x10 [ 3916.662636][ C2] ? lock_acquire+0x1c1/0x220 [ 3916.662874][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3916.663135][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3916.663387][ C2] ? lock_acquire+0x1c1/0x220 [ 3916.663625][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3916.663888][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3916.664192][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3916.664461][ C2] ? neigh_hh_output+0x348/0x590 [ 3916.664712][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3916.664975][ C2] ip_finish_output2+0x786/0x18e0 [ 3916.665231][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3916.665564][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3916.665841][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3916.666093][ C2] ? __ip_finish_output+0x10f/0x770 [ 3916.666357][ C2] ip_output+0x16b/0x4f0 [ 3916.666572][ C2] ? __pfx_ip_output+0x10/0x10 [ 3916.666814][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3916.667088][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3916.667404][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3916.667676][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3916.667927][ C2] ? __alloc_skb+0xd4/0x280 [ 3916.668158][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3916.668425][ C2] ? tcp_fragment+0x168/0x1040 [ 3916.668667][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3916.668918][ C2] ? ip_local_out+0x114/0x3b0 [ 3916.669159][ C2] __ip_queue_xmit+0x672/0x1910 [ 3916.669404][ C2] ? __skb_clone+0x57a/0x760 [ 3916.669637][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3916.669901][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3916.670191][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3916.670435][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3916.670681][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3916.670981][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3916.671301][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3916.671543][ C2] tcp_send_loss_probe+0x348/0x830 [ 3916.671802][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3916.672068][ C2] tcp_write_timer+0x82/0x1d0 [ 3916.672309][ C2] call_timer_fn+0x173/0x430 [ 3916.672545][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3916.672806][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3916.673066][ C2] __run_timers.part.0+0x52d/0x890 [ 3916.673326][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3916.673594][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3916.673877][ C2] ? lock_acquire+0x1c1/0x220 [ 3916.674116][ C2] ? clockevents_program_event+0xf6/0x300 [ 3916.674406][ C2] ? lock_release+0x1d5/0x250 [ 3916.674642][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3916.674906][ C2] ? ktime_get+0xb3/0x190 [ 3916.675127][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3916.675424][ C2] run_timer_softirq+0x72/0x100 [ 3916.675669][ C2] __do_softirq+0x1b9/0x7ff [ 3916.675902][ C2] irq_exit_rcu+0x98/0xc0 [ 3916.676121][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3916.676405][ C2] [ 3916.676555][ C2] [ 3916.676707][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3916.677007][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3916.677264][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3916.678230][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3916.678534][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3916.678934][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3916.679331][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3916.679726][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3916.680122][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3916.680536][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3916.680822][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3916.681081][ C2] default_idle_call+0x69/0xa0 [ 3916.681325][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3916.681576][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3916.681853][ C2] ? lock_release+0x1d5/0x250 [ 3916.682091][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3916.682362][ C2] do_idle+0xfb/0x160 [ 3916.682566][ C2] cpu_startup_entry+0x55/0x60 [ 3916.682808][ C2] start_secondary+0x21c/0x2b0 [ 3916.683051][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3916.683319][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3916.683629][ C2] [ 3942.077105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 3942.077478][ C1] rcu: 1-....: (1583683 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=385936 [ 3942.078034][ C1] rcu: (t=1587190 jiffies g=1882453 q=703 ncpus=4) [ 3942.078369][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3942.078819][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3942.079432][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3942.079760][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3942.080743][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3942.081051][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3942.081455][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3942.081854][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3942.082254][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3942.082652][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3942.083054][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3942.083509][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3942.083843][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3942.084245][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3942.084643][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3942.085047][ C1] PKRU: 55555554 [ 3942.085229][ C1] Call Trace: [ 3942.085399][ C1] [ 3942.085549][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 3942.085823][ C1] ? print_cpu_stall+0x263/0x6a0 [ 3942.086075][ C1] ? check_cpu_stall+0x284/0x500 [ 3942.086328][ C1] ? rcu_pending+0x92/0x360 [ 3942.086558][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 3942.086827][ C1] ? update_process_times+0xb9/0x110 [ 3942.087099][ C1] ? tick_sched_handle+0x67/0x130 [ 3942.087357][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 3942.087641][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3942.087885][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 3942.088198][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3942.088471][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3942.088759][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3942.089026][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3942.089331][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3942.089592][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3942.089901][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3942.090205][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3942.090520][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3942.090813][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3942.091110][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3942.091397][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3942.091708][ C1] ? get_stack_info+0x36/0xc0 [ 3942.091950][ C1] ? lock_acquire+0x1c1/0x220 [ 3942.092192][ C1] ? lock_release+0x1d5/0x250 [ 3942.092430][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3942.092678][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3942.092953][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3942.093238][ C1] ? lock_acquire+0x1c1/0x220 [ 3942.093477][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3942.093718][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3942.093980][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3942.094214][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3942.094461][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3942.094720][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3942.094995][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3942.095275][ C1] ip_local_deliver+0x19d/0x480 [ 3942.095521][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3942.095796][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3942.096059][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3942.096406][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3942.096658][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3942.096977][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3942.097238][ C1] ip_rcv+0x564/0x740 [ 3942.097441][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3942.097672][ C1] ? set_track_prepare+0x8a/0xd0 [ 3942.097924][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3942.098200][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3942.098473][ C1] ? skb_clone+0x10b/0x330 [ 3942.098700][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3942.099017][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3942.099324][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3942.099603][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3942.099898][ C1] ? __tcf_classify+0x329/0x7d0 [ 3942.100152][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3942.100382][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3942.100681][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3942.100968][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3942.101292][ C1] ? lock_acquire+0x1c1/0x220 [ 3942.101530][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3942.101826][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3942.102110][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3942.102426][ C1] ? __copy_skb_header+0xaf/0x490 [ 3942.102683][ C1] ? __skb_clone+0x57a/0x760 [ 3942.102919][ C1] netif_receive_skb+0x55/0x280 [ 3942.103168][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3942.103480][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3942.103812][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3942.104110][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3942.104385][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3942.104675][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3942.104986][ C1] ? hlock_class+0x4e/0x130 [ 3942.105218][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3942.105495][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3942.105771][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3942.106034][ C1] ? hlock_class+0x4e/0x130 [ 3942.106266][ C1] ? mark_lock+0x38/0x3e0 [ 3942.106485][ C1] ? stack_access_ok+0xda/0x1f0 [ 3942.106734][ C1] ? __lock_acquire+0xb67/0x1610 [ 3942.106988][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3942.107263][ C1] ? get_stack_info+0x36/0xc0 [ 3942.107504][ C1] ? stack_access_ok+0xda/0x1f0 [ 3942.107756][ C1] ? get_reg+0x119/0x190 [ 3942.107971][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3942.108239][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3942.108548][ C1] __tcf_classify+0x329/0x7d0 [ 3942.108791][ C1] tcf_classify+0x283/0x930 [ 3942.109024][ C1] ? arch_stack_walk+0xa2/0x100 [ 3942.109273][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3942.109529][ C1] ? get_stack_info+0x36/0xc0 [ 3942.109769][ C1] tc_run+0x2e4/0x5d0 [ 3942.109973][ C1] ? __pfx_tc_run+0x10/0x10 [ 3942.110216][ C1] ? lock_acquire+0x1c1/0x220 [ 3942.110455][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3942.110717][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3942.110970][ C1] ? lock_acquire+0x1c1/0x220 [ 3942.111208][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3942.111473][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3942.111775][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3942.112050][ C1] ? neigh_hh_output+0x348/0x590 [ 3942.112302][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3942.112566][ C1] ip_finish_output2+0x786/0x18e0 [ 3942.112821][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3942.113100][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3942.113436][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3942.113712][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3942.113967][ C1] ? __ip_finish_output+0x10f/0x770 [ 3942.114232][ C1] ip_output+0x16b/0x4f0 [ 3942.114448][ C1] ? run_timer_softirq+0x72/0x100 [ 3942.114705][ C1] ? __pfx_ip_output+0x10/0x10 [ 3942.114948][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3942.115234][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3942.115486][ C1] ? ip_local_out+0x114/0x3b0 [ 3942.115726][ C1] __ip_queue_xmit+0x672/0x1910 [ 3942.115974][ C1] ? __create_object+0x5e/0xb0 [ 3942.116218][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3942.116487][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3942.116767][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3942.117038][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3942.117322][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3942.117593][ C1] tcp_delack_timer+0x84/0x240 [ 3942.117837][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3942.118108][ C1] call_timer_fn+0x173/0x430 [ 3942.118346][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3942.118607][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3942.118868][ C1] __run_timers.part.0+0x52d/0x890 [ 3942.119129][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3942.119403][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3942.119687][ C1] ? lock_acquire+0x1c1/0x220 [ 3942.119924][ C1] ? clockevents_program_event+0xf6/0x300 [ 3942.120222][ C1] ? lock_release+0x1d5/0x250 [ 3942.120461][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3942.120726][ C1] ? ktime_get+0xb3/0x190 [ 3942.120946][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3942.121244][ C1] run_timer_softirq+0x72/0x100 [ 3942.121493][ C1] __do_softirq+0x1b9/0x7ff [ 3942.121725][ C1] irq_exit_rcu+0x98/0xc0 [ 3942.121947][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3942.122233][ C1] [ 3942.122384][ C1] [ 3942.122534][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3942.122840][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3942.123165][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3942.124139][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3942.124447][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3942.124847][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3942.125247][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3942.125646][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3942.126049][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3942.126450][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3942.126748][ C1] pipe_read+0xa16/0xdf0 [ 3942.126970][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3942.127250][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3942.127495][ C1] ? iterate_tty_write+0x299/0x540 [ 3942.127756][ C1] ? lock_release+0x1d5/0x250 [ 3942.127998][ C1] vfs_read+0x911/0xc00 [ 3942.128212][ C1] ? lock_acquire+0x1c1/0x220 [ 3942.128453][ C1] ? __might_fault+0xc6/0x180 [ 3942.128695][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3942.128932][ C1] ? __might_fault+0xc6/0x180 [ 3942.129174][ C1] ? lock_release+0x1d5/0x250 [ 3942.129415][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3942.129679][ C1] ? __fget_light+0x54/0x1e0 [ 3942.129917][ C1] ksys_read+0x17a/0x1e0 [ 3942.130139][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3942.130384][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3942.130689][ C1] do_syscall_64+0xc9/0x1e0 [ 3942.130920][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3942.131221][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3942.131449][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3942.132420][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3942.132840][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3942.133240][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3942.133640][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3942.134037][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3942.134436][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3942.134838][ C1] [ 3942.134996][ C1] Sending NMI from CPU 1 to CPUs 2: [ 3942.135276][ C2] NMI backtrace for cpu 2 [ 3942.135283][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3942.135289][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3942.135293][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3942.135301][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3942.135306][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3942.135311][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3942.135314][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3942.135319][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3942.135323][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3942.135327][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3942.135331][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3942.135335][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3942.135341][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3942.135345][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3942.135348][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3942.135352][ C2] PKRU: 55555554 [ 3942.135354][ C2] Call Trace: [ 3942.135358][ C2] [ 3942.135363][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 3942.135372][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 3942.135378][ C2] ? nmi_handle+0x153/0x420 [ 3942.135383][ C2] ? default_do_nmi+0x41/0x100 [ 3942.135385][ C2] ? exc_nmi+0xf3/0x120 [ 3942.135388][ C2] ? end_repeat_nmi+0xf/0x60 [ 3942.135393][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3942.135397][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3942.135400][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3942.135403][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3942.135406][ C2] [ 3942.135407][ C2] [ 3942.135408][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3942.135411][ C2] ? get_stack_info+0x36/0xc0 [ 3942.135415][ C2] ? lock_acquire+0x1c1/0x220 [ 3942.135418][ C2] ? lock_release+0x1d5/0x250 [ 3942.135421][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3942.135425][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3942.135428][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3942.135431][ C2] ? lock_acquire+0x1c1/0x220 [ 3942.135433][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3942.135437][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3942.135440][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3942.135446][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3942.135448][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3942.135453][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3942.135458][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3942.135461][ C2] ip_local_deliver+0x19d/0x480 [ 3942.135464][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3942.135466][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3942.135468][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3942.135473][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3942.135476][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3942.135479][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3942.135487][ C2] ip_rcv+0x564/0x740 [ 3942.135490][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3942.135492][ C2] ? set_track_prepare+0x8a/0xd0 [ 3942.135496][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3942.135499][ C2] ? start_secondary+0x21c/0x2b0 [ 3942.135501][ C2] ? skb_clone+0x10b/0x330 [ 3942.135505][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3942.135511][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3942.135516][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3942.135519][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3942.135528][ C2] ? __tcf_classify+0x329/0x7d0 [ 3942.135531][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3942.135533][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3942.135537][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3942.135540][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3942.135545][ C2] ? lock_acquire+0x1c1/0x220 [ 3942.135547][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3942.135551][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3942.135554][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3942.135558][ C2] ? __copy_skb_header+0xaf/0x490 [ 3942.135562][ C2] ? __skb_clone+0x57a/0x760 [ 3942.135564][ C2] netif_receive_skb+0x55/0x280 [ 3942.135568][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3942.135575][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3942.135581][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3942.135588][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3942.135592][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3942.135603][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3942.135610][ C2] ? get_stack_info+0x36/0xc0 [ 3942.135614][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3942.135617][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3942.135620][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3942.135623][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3942.135626][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3942.135628][ C2] ? kernel_text_address+0x17/0xe0 [ 3942.135631][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3942.135635][ C2] ? arch_stack_walk+0x8c/0x100 [ 3942.135638][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3942.135642][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3942.135645][ C2] ? lock_acquire+0x1c1/0x220 [ 3942.135647][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3942.135651][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3942.135655][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3942.135658][ C2] ? get_stack_info+0x36/0xc0 [ 3942.135662][ C2] __tcf_classify+0x329/0x7d0 [ 3942.135667][ C2] tcf_classify+0x283/0x930 [ 3942.135671][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3942.135675][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3942.135679][ C2] tc_run+0x2e4/0x5d0 [ 3942.135682][ C2] ? __pfx_tc_run+0x10/0x10 [ 3942.135685][ C2] ? lock_acquire+0x1c1/0x220 [ 3942.135688][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3942.135691][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3942.135695][ C2] ? lock_acquire+0x1c1/0x220 [ 3942.135698][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3942.135701][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3942.135704][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3942.135706][ C2] ? neigh_hh_output+0x348/0x590 [ 3942.135710][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3942.135714][ C2] ip_finish_output2+0x786/0x18e0 [ 3942.135717][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3942.135725][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3942.135728][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3942.135731][ C2] ? __ip_finish_output+0x10f/0x770 [ 3942.135735][ C2] ip_output+0x16b/0x4f0 [ 3942.135738][ C2] ? __pfx_ip_output+0x10/0x10 [ 3942.135741][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3942.135744][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3942.135747][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3942.135749][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3942.135752][ C2] ? __alloc_skb+0xd4/0x280 [ 3942.135754][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3942.135758][ C2] ? tcp_fragment+0x168/0x1040 [ 3942.135761][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3942.135764][ C2] ? ip_local_out+0x114/0x3b0 [ 3942.135767][ C2] __ip_queue_xmit+0x672/0x1910 [ 3942.135771][ C2] ? __skb_clone+0x57a/0x760 [ 3942.135773][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3942.135779][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3942.135782][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3942.135785][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3942.135789][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3942.135793][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3942.135796][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3942.135799][ C2] tcp_send_loss_probe+0x348/0x830 [ 3942.135803][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3942.135805][ C2] tcp_write_timer+0x82/0x1d0 [ 3942.135809][ C2] call_timer_fn+0x173/0x430 [ 3942.135812][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3942.135817][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3942.135821][ C2] __run_timers.part.0+0x52d/0x890 [ 3942.135824][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3942.135828][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3942.135831][ C2] ? lock_acquire+0x1c1/0x220 [ 3942.135833][ C2] ? clockevents_program_event+0xf6/0x300 [ 3942.135837][ C2] ? lock_release+0x1d5/0x250 [ 3942.135840][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3942.135842][ C2] ? ktime_get+0xb3/0x190 [ 3942.135845][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3942.135850][ C2] run_timer_softirq+0x72/0x100 [ 3942.135853][ C2] __do_softirq+0x1b9/0x7ff [ 3942.135857][ C2] irq_exit_rcu+0x98/0xc0 [ 3942.135860][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3942.135864][ C2] [ 3942.135864][ C2] [ 3942.135865][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3942.135869][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3942.135872][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3942.135874][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3942.135877][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3942.135878][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3942.135880][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3942.135881][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3942.135883][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3942.135886][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3942.135889][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3942.135893][ C2] default_idle_call+0x69/0xa0 [ 3942.135895][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3942.135898][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3942.135902][ C2] ? lock_release+0x1d5/0x250 [ 3942.135905][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3942.135908][ C2] do_idle+0xfb/0x160 [ 3942.135911][ C2] cpu_startup_entry+0x55/0x60 [ 3942.135913][ C2] start_secondary+0x21c/0x2b0 [ 3942.135916][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3942.135921][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3942.135927][ C2] [ 3968.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1505s! [swapper/2:0] [ 3968.569689][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3968.570952][ C2] irq event stamp: 44114564 [ 3968.571180][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3968.571716][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3968.572227][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3968.572702][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3968.573170][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3968.573626][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3968.574238][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3968.574562][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3968.575531][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3968.575839][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3968.576237][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3968.576635][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3968.577033][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3968.577431][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3968.577827][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3968.578272][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3968.578604][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3968.579004][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3968.579401][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3968.579798][ C2] PKRU: 55555554 [ 3968.579984][ C2] Call Trace: [ 3968.580154][ C2] [ 3968.580301][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3968.580561][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3968.580805][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3968.581080][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3968.581355][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3968.581642][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3968.581906][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3968.582213][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3968.582475][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3968.582737][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3968.583047][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3968.583343][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3968.583658][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3968.583948][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3968.584245][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3968.584533][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3968.584845][ C2] ? get_stack_info+0x36/0xc0 [ 3968.585087][ C2] ? lock_acquire+0x1c1/0x220 [ 3968.585327][ C2] ? lock_release+0x1d5/0x250 [ 3968.585567][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3968.585816][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3968.586087][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3968.586374][ C2] ? lock_acquire+0x1c1/0x220 [ 3968.586612][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3968.586852][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3968.587112][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3968.587349][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3968.587597][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3968.587858][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3968.588132][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3968.588408][ C2] ip_local_deliver+0x19d/0x480 [ 3968.588655][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3968.588928][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3968.589193][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3968.589540][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3968.589794][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3968.590121][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3968.590383][ C2] ip_rcv+0x564/0x740 [ 3968.590587][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3968.590819][ C2] ? set_track_prepare+0x8a/0xd0 [ 3968.591072][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3968.591348][ C2] ? start_secondary+0x21c/0x2b0 [ 3968.591600][ C2] ? skb_clone+0x10b/0x330 [ 3968.591828][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3968.592146][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3968.592452][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3968.592735][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3968.593028][ C2] ? __tcf_classify+0x329/0x7d0 [ 3968.593278][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3968.593508][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3968.593806][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3968.594093][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3968.594419][ C2] ? lock_acquire+0x1c1/0x220 [ 3968.594657][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3968.594953][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3968.595239][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3968.595555][ C2] ? __copy_skb_header+0xaf/0x490 [ 3968.595813][ C2] ? __skb_clone+0x57a/0x760 [ 3968.596048][ C2] netif_receive_skb+0x55/0x280 [ 3968.596296][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3968.596608][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3968.596939][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3968.597239][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3968.597513][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3968.597799][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3968.598112][ C2] ? get_stack_info+0x36/0xc0 [ 3968.598354][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3968.598619][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3968.598936][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3968.599211][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3968.599488][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3968.599804][ C2] ? kernel_text_address+0x17/0xe0 [ 3968.600072][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3968.600384][ C2] ? arch_stack_walk+0x8c/0x100 [ 3968.600634][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3968.600898][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3968.601189][ C2] ? lock_acquire+0x1c1/0x220 [ 3968.601432][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3968.601715][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3968.602021][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3968.602296][ C2] ? get_stack_info+0x36/0xc0 [ 3968.602538][ C2] __tcf_classify+0x329/0x7d0 [ 3968.602780][ C2] tcf_classify+0x283/0x930 [ 3968.603012][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3968.603268][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3968.603581][ C2] tc_run+0x2e4/0x5d0 [ 3968.603786][ C2] ? __pfx_tc_run+0x10/0x10 [ 3968.604017][ C2] ? lock_acquire+0x1c1/0x220 [ 3968.604256][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3968.604519][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3968.604771][ C2] ? lock_acquire+0x1c1/0x220 [ 3968.605008][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3968.605274][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3968.605578][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3968.605851][ C2] ? neigh_hh_output+0x348/0x590 [ 3968.606103][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3968.606369][ C2] ip_finish_output2+0x786/0x18e0 [ 3968.606626][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3968.606965][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3968.607241][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3968.607495][ C2] ? __ip_finish_output+0x10f/0x770 [ 3968.607760][ C2] ip_output+0x16b/0x4f0 [ 3968.607976][ C2] ? __pfx_ip_output+0x10/0x10 [ 3968.608219][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3968.608497][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3968.608808][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3968.609086][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3968.609339][ C2] ? __alloc_skb+0xd4/0x280 [ 3968.609567][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3968.609838][ C2] ? tcp_fragment+0x168/0x1040 [ 3968.610088][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3968.610339][ C2] ? ip_local_out+0x114/0x3b0 [ 3968.610580][ C2] __ip_queue_xmit+0x672/0x1910 [ 3968.610829][ C2] ? __skb_clone+0x57a/0x760 [ 3968.611065][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3968.611332][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3968.611612][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3968.611856][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3968.612106][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3968.612406][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3968.612727][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3968.612971][ C2] tcp_send_loss_probe+0x348/0x830 [ 3968.613234][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3968.613504][ C2] tcp_write_timer+0x82/0x1d0 [ 3968.613742][ C2] call_timer_fn+0x173/0x430 [ 3968.613980][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3968.614241][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3968.614502][ C2] __run_timers.part.0+0x52d/0x890 [ 3968.614762][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3968.615030][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3968.615317][ C2] ? lock_acquire+0x1c1/0x220 [ 3968.615555][ C2] ? clockevents_program_event+0xf6/0x300 [ 3968.615846][ C2] ? lock_release+0x1d5/0x250 [ 3968.616086][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3968.616351][ C2] ? ktime_get+0xb3/0x190 [ 3968.616571][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3968.616869][ C2] run_timer_softirq+0x72/0x100 [ 3968.617118][ C2] __do_softirq+0x1b9/0x7ff [ 3968.617351][ C2] irq_exit_rcu+0x98/0xc0 [ 3968.617572][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3968.617857][ C2] [ 3968.618010][ C2] [ 3968.618159][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3968.618464][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3968.618721][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3968.619695][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3968.620009][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3968.620409][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3968.620806][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3968.621206][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3968.621606][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3968.622005][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3968.622300][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3968.622561][ C2] default_idle_call+0x69/0xa0 [ 3968.622803][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3968.623055][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3968.623335][ C2] ? lock_release+0x1d5/0x250 [ 3968.623572][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3968.623847][ C2] do_idle+0xfb/0x160 [ 3968.624051][ C2] cpu_startup_entry+0x55/0x60 [ 3968.624294][ C2] start_secondary+0x21c/0x2b0 [ 3968.624537][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3968.624807][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3968.625118][ C2] [ 3968.625276][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1505s! [perl:4135] [ 3968.625706][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3968.626965][ C1] irq event stamp: 209232 [ 3968.627186][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3968.627721][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3968.628199][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3968.628668][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3968.629133][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3968.629583][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3968.630202][ C1] RIP: 0010:kasan_check_range+0x16/0x1c0 [ 3968.630491][ C1] Code: 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 <48> 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe [ 3968.631466][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 3968.631774][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3968.632175][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3968.632574][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3968.632972][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3968.633373][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3968.633774][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3968.634221][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3968.634553][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3968.634952][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3968.635356][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3968.635755][ C1] PKRU: 55555554 [ 3968.635938][ C1] Call Trace: [ 3968.636108][ C1] [ 3968.636260][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3968.636522][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3968.636767][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3968.637044][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3968.637317][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3968.637608][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3968.637873][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3968.638180][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3968.638443][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3968.638752][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3968.639050][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3968.639365][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3968.639653][ C1] ? kasan_check_range+0x16/0x1c0 [ 3968.639915][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 3968.640200][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3968.640512][ C1] ? get_stack_info+0x36/0xc0 [ 3968.640751][ C1] ? lock_acquire+0x1c1/0x220 [ 3968.640993][ C1] ? lock_release+0x1d5/0x250 [ 3968.641235][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3968.641485][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3968.641759][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3968.642043][ C1] ? lock_acquire+0x1c1/0x220 [ 3968.642282][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3968.642524][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3968.642790][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3968.643027][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3968.643274][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3968.643533][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3968.643810][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3968.644087][ C1] ip_local_deliver+0x19d/0x480 [ 3968.644336][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3968.644607][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3968.644870][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3968.645221][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3968.645475][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3968.645795][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3968.646063][ C1] ip_rcv+0x564/0x740 [ 3968.646268][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3968.646498][ C1] ? set_track_prepare+0x8a/0xd0 [ 3968.646751][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3968.647031][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3968.647304][ C1] ? skb_clone+0x10b/0x330 [ 3968.647532][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3968.647850][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3968.648157][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3968.648439][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3968.648734][ C1] ? __tcf_classify+0x329/0x7d0 [ 3968.648984][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3968.649216][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3968.649515][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3968.649801][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3968.650137][ C1] ? lock_acquire+0x1c1/0x220 [ 3968.650376][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3968.650672][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3968.650958][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3968.651276][ C1] ? __copy_skb_header+0xaf/0x490 [ 3968.651535][ C1] ? __skb_clone+0x57a/0x760 [ 3968.651768][ C1] netif_receive_skb+0x55/0x280 [ 3968.652016][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3968.652332][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3968.652665][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3968.652964][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3968.653240][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3968.653527][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3968.653840][ C1] ? hlock_class+0x4e/0x130 [ 3968.654075][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3968.654351][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3968.654628][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3968.654892][ C1] ? hlock_class+0x4e/0x130 [ 3968.655125][ C1] ? mark_lock+0x38/0x3e0 [ 3968.655345][ C1] ? stack_access_ok+0xda/0x1f0 [ 3968.655594][ C1] ? __lock_acquire+0xb67/0x1610 [ 3968.655849][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3968.656129][ C1] ? get_stack_info+0x36/0xc0 [ 3968.656366][ C1] ? stack_access_ok+0xda/0x1f0 [ 3968.656615][ C1] ? get_reg+0x119/0x190 [ 3968.656834][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3968.657103][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3968.657414][ C1] __tcf_classify+0x329/0x7d0 [ 3968.657654][ C1] tcf_classify+0x283/0x930 [ 3968.657888][ C1] ? arch_stack_walk+0xa2/0x100 [ 3968.658140][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3968.658398][ C1] ? get_stack_info+0x36/0xc0 [ 3968.658641][ C1] tc_run+0x2e4/0x5d0 [ 3968.658846][ C1] ? __pfx_tc_run+0x10/0x10 [ 3968.659077][ C1] ? lock_acquire+0x1c1/0x220 [ 3968.659318][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3968.659579][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3968.659832][ C1] ? lock_acquire+0x1c1/0x220 [ 3968.660075][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3968.660341][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3968.660646][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3968.660918][ C1] ? neigh_hh_output+0x348/0x590 [ 3968.661172][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3968.661440][ C1] ip_finish_output2+0x786/0x18e0 [ 3968.661696][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3968.661975][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3968.662316][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3968.662592][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3968.662845][ C1] ? __ip_finish_output+0x10f/0x770 [ 3968.663111][ C1] ip_output+0x16b/0x4f0 [ 3968.663327][ C1] ? run_timer_softirq+0x72/0x100 [ 3968.663584][ C1] ? __pfx_ip_output+0x10/0x10 [ 3968.663828][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3968.664118][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3968.664369][ C1] ? ip_local_out+0x114/0x3b0 [ 3968.664606][ C1] __ip_queue_xmit+0x672/0x1910 [ 3968.664855][ C1] ? __create_object+0x5e/0xb0 [ 3968.665100][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3968.665369][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3968.665650][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3968.665923][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3968.666205][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3968.666479][ C1] tcp_delack_timer+0x84/0x240 [ 3968.666724][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3968.666996][ C1] call_timer_fn+0x173/0x430 [ 3968.667232][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3968.667493][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3968.667754][ C1] __run_timers.part.0+0x52d/0x890 [ 3968.668014][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3968.668290][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3968.668575][ C1] ? lock_acquire+0x1c1/0x220 [ 3968.668815][ C1] ? clockevents_program_event+0xf6/0x300 [ 3968.669105][ C1] ? lock_release+0x1d5/0x250 [ 3968.669346][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3968.669610][ C1] ? ktime_get+0xb3/0x190 [ 3968.669832][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3968.670134][ C1] run_timer_softirq+0x72/0x100 [ 3968.670382][ C1] __do_softirq+0x1b9/0x7ff [ 3968.670616][ C1] irq_exit_rcu+0x98/0xc0 [ 3968.670836][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3968.671123][ C1] [ 3968.671274][ C1] [ 3968.671424][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3968.671731][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3968.672056][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3968.673031][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3968.673343][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3968.673749][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3968.674152][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3968.674555][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3968.674955][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3968.675361][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3968.675661][ C1] pipe_read+0xa16/0xdf0 [ 3968.675882][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3968.676164][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3968.676407][ C1] ? iterate_tty_write+0x299/0x540 [ 3968.676671][ C1] ? lock_release+0x1d5/0x250 [ 3968.676912][ C1] vfs_read+0x911/0xc00 [ 3968.677130][ C1] ? lock_acquire+0x1c1/0x220 [ 3968.677368][ C1] ? __might_fault+0xc6/0x180 [ 3968.677611][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3968.677852][ C1] ? __might_fault+0xc6/0x180 [ 3968.678093][ C1] ? lock_release+0x1d5/0x250 [ 3968.678333][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3968.678601][ C1] ? __fget_light+0x54/0x1e0 [ 3968.678841][ C1] ksys_read+0x17a/0x1e0 [ 3968.679059][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3968.679305][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3968.679611][ C1] do_syscall_64+0xc9/0x1e0 [ 3968.679846][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3968.680150][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3968.680381][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3968.681356][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3968.681780][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3968.682183][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3968.682583][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3968.682983][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3968.683388][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3968.683791][ C1] [ 3996.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1531s! [swapper/2:0] [ 3996.569696][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3996.570948][ C2] irq event stamp: 44114564 [ 3996.571177][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3996.571709][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 3996.572218][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 3996.572694][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 3996.573161][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 3996.573614][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3996.574225][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3996.574548][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3996.575513][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 3996.575821][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3996.576217][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 3996.576612][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 3996.577010][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 3996.577407][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 3996.577803][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 3996.578248][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3996.578577][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 3996.578976][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3996.579373][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3996.579773][ C2] PKRU: 55555554 [ 3996.579955][ C2] Call Trace: [ 3996.580125][ C2] [ 3996.580272][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3996.580532][ C2] ? __run_hrtimer+0x1c0/0x710 [ 3996.580773][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3996.581048][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 3996.581318][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3996.581610][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3996.581872][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3996.582176][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 3996.582434][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 3996.582695][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3996.583006][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3996.583298][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3996.583610][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3996.583898][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3996.584189][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3996.584478][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3996.584788][ C2] ? get_stack_info+0x36/0xc0 [ 3996.585026][ C2] ? lock_acquire+0x1c1/0x220 [ 3996.585264][ C2] ? lock_release+0x1d5/0x250 [ 3996.585503][ C2] do_raw_spin_lock+0x1ec/0x270 [ 3996.585750][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3996.586020][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3996.586303][ C2] ? lock_acquire+0x1c1/0x220 [ 3996.586539][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3996.586778][ C2] _raw_spin_lock_nested+0x65/0x80 [ 3996.587036][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 3996.587270][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3996.587516][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 3996.587777][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 3996.588050][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 3996.588325][ C2] ip_local_deliver+0x19d/0x480 [ 3996.588571][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 3996.588839][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3996.589100][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3996.589447][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3996.589697][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3996.590022][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3996.590284][ C2] ip_rcv+0x564/0x740 [ 3996.590486][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3996.590714][ C2] ? set_track_prepare+0x8a/0xd0 [ 3996.590965][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3996.591241][ C2] ? start_secondary+0x21c/0x2b0 [ 3996.591491][ C2] ? skb_clone+0x10b/0x330 [ 3996.591715][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3996.592032][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3996.592337][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3996.592615][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3996.592909][ C2] ? __tcf_classify+0x329/0x7d0 [ 3996.593158][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 3996.593385][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 3996.593682][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3996.593965][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3996.594289][ C2] ? lock_acquire+0x1c1/0x220 [ 3996.594525][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 3996.594820][ C2] netif_receive_skb_internal+0xb0/0x300 [ 3996.595106][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3996.595420][ C2] ? __copy_skb_header+0xaf/0x490 [ 3996.595676][ C2] ? __skb_clone+0x57a/0x760 [ 3996.595914][ C2] netif_receive_skb+0x55/0x280 [ 3996.596162][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3996.596477][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3996.596807][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3996.597102][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 3996.597377][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 3996.597665][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3996.597981][ C2] ? get_stack_info+0x36/0xc0 [ 3996.598221][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 3996.598484][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3996.598800][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3996.599077][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 3996.599352][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 3996.599666][ C2] ? kernel_text_address+0x17/0xe0 [ 3996.599929][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3996.600241][ C2] ? arch_stack_walk+0x8c/0x100 [ 3996.600487][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 3996.600749][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3996.601033][ C2] ? lock_acquire+0x1c1/0x220 [ 3996.601269][ C2] ? stack_depot_save_flags+0x281/0x550 [ 3996.601551][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3996.601853][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 3996.602129][ C2] ? get_stack_info+0x36/0xc0 [ 3996.602371][ C2] __tcf_classify+0x329/0x7d0 [ 3996.602611][ C2] tcf_classify+0x283/0x930 [ 3996.602844][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 3996.603099][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 3996.603410][ C2] tc_run+0x2e4/0x5d0 [ 3996.603613][ C2] ? __pfx_tc_run+0x10/0x10 [ 3996.603843][ C2] ? lock_acquire+0x1c1/0x220 [ 3996.604079][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 3996.604338][ C2] __dev_queue_xmit+0x686/0x17e0 [ 3996.604591][ C2] ? lock_acquire+0x1c1/0x220 [ 3996.604829][ C2] ? ip_finish_output2+0x786/0x18e0 [ 3996.605091][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3996.605393][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3996.605663][ C2] ? neigh_hh_output+0x348/0x590 [ 3996.605914][ C2] ? ip_finish_output2+0x262/0x18e0 [ 3996.606181][ C2] ip_finish_output2+0x786/0x18e0 [ 3996.606436][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3996.606771][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 3996.607046][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3996.607297][ C2] ? __ip_finish_output+0x10f/0x770 [ 3996.607560][ C2] ip_output+0x16b/0x4f0 [ 3996.607774][ C2] ? __pfx_ip_output+0x10/0x10 [ 3996.608016][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 3996.608289][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3996.608600][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 3996.608875][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 3996.609124][ C2] ? __alloc_skb+0xd4/0x280 [ 3996.609354][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 3996.609620][ C2] ? tcp_fragment+0x168/0x1040 [ 3996.609867][ C2] ? rcu_read_lock_held+0xe/0x50 [ 3996.610116][ C2] ? ip_local_out+0x114/0x3b0 [ 3996.610356][ C2] __ip_queue_xmit+0x672/0x1910 [ 3996.610603][ C2] ? __skb_clone+0x57a/0x760 [ 3996.610834][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 3996.611102][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3996.611384][ C2] ? ipv4_dst_check+0xe3/0x170 [ 3996.611628][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 3996.611876][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 3996.612179][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 3996.612496][ C2] ? tcp_fragment+0xb0e/0x1040 [ 3996.612738][ C2] tcp_send_loss_probe+0x348/0x830 [ 3996.612997][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3996.613263][ C2] tcp_write_timer+0x82/0x1d0 [ 3996.613503][ C2] call_timer_fn+0x173/0x430 [ 3996.613739][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 3996.613999][ C2] ? next_expiry_recalc+0xcd/0x220 [ 3996.614258][ C2] __run_timers.part.0+0x52d/0x890 [ 3996.614516][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 3996.614784][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 3996.615066][ C2] ? lock_acquire+0x1c1/0x220 [ 3996.615302][ C2] ? clockevents_program_event+0xf6/0x300 [ 3996.615593][ C2] ? lock_release+0x1d5/0x250 [ 3996.615829][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 3996.616092][ C2] ? ktime_get+0xb3/0x190 [ 3996.616311][ C2] ? clockevents_program_event+0x1ea/0x300 [ 3996.616607][ C2] run_timer_softirq+0x72/0x100 [ 3996.616853][ C2] __do_softirq+0x1b9/0x7ff [ 3996.617083][ C2] irq_exit_rcu+0x98/0xc0 [ 3996.617302][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 3996.617585][ C2] [ 3996.617734][ C2] [ 3996.617889][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3996.618191][ C2] RIP: 0010:default_idle+0xf/0x20 [ 3996.618447][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 3996.619410][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 3996.619716][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 3996.620118][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 3996.620514][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 3996.620909][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 3996.621306][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 3996.621704][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 3996.621991][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 3996.622250][ C2] default_idle_call+0x69/0xa0 [ 3996.622493][ C2] cpuidle_idle_call+0x1f6/0x280 [ 3996.622743][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 3996.623017][ C2] ? lock_release+0x1d5/0x250 [ 3996.623256][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 3996.623526][ C2] do_idle+0xfb/0x160 [ 3996.623731][ C2] cpu_startup_entry+0x55/0x60 [ 3996.623970][ C2] start_secondary+0x21c/0x2b0 [ 3996.624213][ C2] ? __pfx_start_secondary+0x10/0x10 [ 3996.624479][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 3996.624787][ C2] [ 3996.624945][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1531s! [perl:4135] [ 3996.625376][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 3996.626633][ C1] irq event stamp: 209232 [ 3996.626849][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 3996.627377][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 3996.627855][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 3996.628325][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 3996.628785][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 3996.629233][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 3996.629851][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 3996.630178][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 3996.631150][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 3996.631459][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 3996.631858][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 3996.632256][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 3996.632655][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 3996.633055][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 3996.633455][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 3996.633901][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 3996.634232][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 3996.634635][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 3996.635036][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 3996.635436][ C1] PKRU: 55555554 [ 3996.635618][ C1] Call Trace: [ 3996.635789][ C1] [ 3996.635938][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 3996.636201][ C1] ? __run_hrtimer+0x1c0/0x710 [ 3996.636445][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 3996.636723][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 3996.636994][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 3996.637285][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3996.637550][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 3996.637855][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 3996.638119][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 3996.638429][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 3996.638723][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3996.639037][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3996.639329][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 3996.639623][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 3996.639920][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 3996.640233][ C1] ? get_stack_info+0x36/0xc0 [ 3996.640473][ C1] ? lock_acquire+0x1c1/0x220 [ 3996.640715][ C1] ? lock_release+0x1d5/0x250 [ 3996.640956][ C1] do_raw_spin_lock+0x1ec/0x270 [ 3996.641208][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 3996.641481][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3996.641766][ C1] ? lock_acquire+0x1c1/0x220 [ 3996.642005][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 3996.642248][ C1] _raw_spin_lock_nested+0x65/0x80 [ 3996.642508][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 3996.642744][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 3996.642991][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 3996.643251][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 3996.643527][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 3996.643804][ C1] ip_local_deliver+0x19d/0x480 [ 3996.644051][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 3996.644322][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 3996.644585][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 3996.644933][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3996.645187][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 3996.645508][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 3996.645770][ C1] ip_rcv+0x564/0x740 [ 3996.645974][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3996.646205][ C1] ? set_track_prepare+0x8a/0xd0 [ 3996.646458][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 3996.646736][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 3996.647007][ C1] ? skb_clone+0x10b/0x330 [ 3996.647236][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 3996.647555][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 3996.647861][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 3996.648144][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 3996.648437][ C1] ? __tcf_classify+0x329/0x7d0 [ 3996.648687][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 3996.648918][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 3996.649221][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3996.649508][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 3996.649837][ C1] ? lock_acquire+0x1c1/0x220 [ 3996.650076][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 3996.650374][ C1] netif_receive_skb_internal+0xb0/0x300 [ 3996.650660][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 3996.650976][ C1] ? __copy_skb_header+0xaf/0x490 [ 3996.651235][ C1] ? __skb_clone+0x57a/0x760 [ 3996.651469][ C1] netif_receive_skb+0x55/0x280 [ 3996.651716][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 3996.652028][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 3996.652362][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 3996.652661][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 3996.652935][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 3996.653224][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 3996.653545][ C1] ? hlock_class+0x4e/0x130 [ 3996.653779][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3996.654062][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3996.654331][ C1] ? __pfx_validate_chain+0x10/0x10 [ 3996.654612][ C1] ? hlock_class+0x4e/0x130 [ 3996.654843][ C1] ? mark_lock+0x38/0x3e0 [ 3996.655063][ C1] ? stack_access_ok+0xda/0x1f0 [ 3996.655312][ C1] ? __lock_acquire+0xb67/0x1610 [ 3996.655567][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 3996.655847][ C1] ? get_stack_info+0x36/0xc0 [ 3996.656085][ C1] ? stack_access_ok+0xda/0x1f0 [ 3996.656333][ C1] ? get_reg+0x119/0x190 [ 3996.656551][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 3996.656818][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3996.657129][ C1] __tcf_classify+0x329/0x7d0 [ 3996.657369][ C1] tcf_classify+0x283/0x930 [ 3996.657602][ C1] ? arch_stack_walk+0xa2/0x100 [ 3996.657851][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 3996.658109][ C1] ? get_stack_info+0x36/0xc0 [ 3996.658350][ C1] tc_run+0x2e4/0x5d0 [ 3996.658556][ C1] ? __pfx_tc_run+0x10/0x10 [ 3996.658787][ C1] ? lock_acquire+0x1c1/0x220 [ 3996.659026][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 3996.659289][ C1] __dev_queue_xmit+0x686/0x17e0 [ 3996.659542][ C1] ? lock_acquire+0x1c1/0x220 [ 3996.659785][ C1] ? ip_finish_output2+0x786/0x18e0 [ 3996.660049][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3996.660358][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 3996.660630][ C1] ? neigh_hh_output+0x348/0x590 [ 3996.660883][ C1] ? ip_finish_output2+0x262/0x18e0 [ 3996.661148][ C1] ip_finish_output2+0x786/0x18e0 [ 3996.661404][ C1] ? stack_depot_save_flags+0x45/0x550 [ 3996.661682][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 3996.662021][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 3996.662297][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3996.662550][ C1] ? __ip_finish_output+0x10f/0x770 [ 3996.662815][ C1] ip_output+0x16b/0x4f0 [ 3996.663030][ C1] ? run_timer_softirq+0x72/0x100 [ 3996.663288][ C1] ? __pfx_ip_output+0x10/0x10 [ 3996.663532][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 3996.663823][ C1] ? rcu_read_lock_held+0xe/0x50 [ 3996.664074][ C1] ? ip_local_out+0x114/0x3b0 [ 3996.664314][ C1] __ip_queue_xmit+0x672/0x1910 [ 3996.664561][ C1] ? __create_object+0x5e/0xb0 [ 3996.664805][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 3996.665072][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 3996.665356][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 3996.665629][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 3996.665908][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3996.666182][ C1] tcp_delack_timer+0x84/0x240 [ 3996.666429][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3996.666701][ C1] call_timer_fn+0x173/0x430 [ 3996.666937][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 3996.667198][ C1] ? next_expiry_recalc+0xcd/0x220 [ 3996.667459][ C1] __run_timers.part.0+0x52d/0x890 [ 3996.667720][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 3996.667995][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 3996.668282][ C1] ? lock_acquire+0x1c1/0x220 [ 3996.668522][ C1] ? clockevents_program_event+0xf6/0x300 [ 3996.668811][ C1] ? lock_release+0x1d5/0x250 [ 3996.669051][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3996.669316][ C1] ? ktime_get+0xb3/0x190 [ 3996.669537][ C1] ? clockevents_program_event+0x1ea/0x300 [ 3996.669838][ C1] run_timer_softirq+0x72/0x100 [ 3996.670086][ C1] __do_softirq+0x1b9/0x7ff [ 3996.670321][ C1] irq_exit_rcu+0x98/0xc0 [ 3996.670540][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 3996.670825][ C1] [ 3996.670976][ C1] [ 3996.671127][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 3996.671433][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 3996.671786][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 3996.672765][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 3996.673080][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 3996.673493][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 3996.673895][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 3996.674297][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 3996.674696][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 3996.675100][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 3996.675400][ C1] pipe_read+0xa16/0xdf0 [ 3996.675621][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 3996.675903][ C1] ? __pfx_pipe_read+0x10/0x10 [ 3996.676147][ C1] ? iterate_tty_write+0x299/0x540 [ 3996.676412][ C1] ? lock_release+0x1d5/0x250 [ 3996.676652][ C1] vfs_read+0x911/0xc00 [ 3996.676869][ C1] ? lock_acquire+0x1c1/0x220 [ 3996.677108][ C1] ? __might_fault+0xc6/0x180 [ 3996.677351][ C1] ? __pfx_vfs_read+0x10/0x10 [ 3996.677592][ C1] ? __might_fault+0xc6/0x180 [ 3996.677834][ C1] ? lock_release+0x1d5/0x250 [ 3996.678073][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 3996.678341][ C1] ? __fget_light+0x54/0x1e0 [ 3996.678580][ C1] ksys_read+0x17a/0x1e0 [ 3996.678798][ C1] ? __pfx_ksys_read+0x10/0x10 [ 3996.679043][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 3996.679354][ C1] do_syscall_64+0xc9/0x1e0 [ 3996.679589][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 3996.679892][ C1] RIP: 0033:0x7f08a1ea38b2 [ 3996.680125][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 3996.681101][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 3996.681524][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 3996.681926][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 3996.682326][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 3996.682724][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 3996.683127][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 3996.683529][ C1] [ 4020.135103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4020.135472][ C1] rcu: 1-....: (1661457 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=403000 [ 4020.136012][ C1] rcu: (t=1665248 jiffies g=1882453 q=703 ncpus=4) [ 4020.136337][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4020.136799][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4020.137411][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4020.137747][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4020.138642][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4020.138927][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4020.139297][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4020.139668][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4020.140081][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4020.140485][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4020.140885][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4020.141330][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4020.141661][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4020.142032][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4020.142404][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4020.142772][ C1] PKRU: 55555554 [ 4020.142941][ C1] Call Trace: [ 4020.143098][ C1] [ 4020.143237][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4020.143488][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4020.143722][ C1] ? check_cpu_stall+0x284/0x500 [ 4020.143955][ C1] ? rcu_pending+0x92/0x360 [ 4020.144168][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4020.144438][ C1] ? update_process_times+0xb9/0x110 [ 4020.144699][ C1] ? tick_sched_handle+0x67/0x130 [ 4020.144948][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4020.145224][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4020.145461][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4020.145765][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4020.146017][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4020.146305][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4020.146561][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4020.146858][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4020.147113][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4020.147413][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4020.147701][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4020.148006][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4020.148287][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4020.148605][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4020.148886][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4020.149188][ C1] ? get_stack_info+0x36/0xc0 [ 4020.149441][ C1] ? lock_acquire+0x1c1/0x220 [ 4020.149684][ C1] ? lock_release+0x1d5/0x250 [ 4020.149929][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4020.150179][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4020.150451][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4020.150734][ C1] ? lock_acquire+0x1c1/0x220 [ 4020.150973][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4020.151215][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4020.151474][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4020.151708][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4020.151953][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4020.152211][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4020.152488][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4020.152763][ C1] ip_local_deliver+0x19d/0x480 [ 4020.153010][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4020.153284][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4020.153547][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4020.153897][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4020.154142][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4020.154452][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4020.154707][ C1] ip_rcv+0x564/0x740 [ 4020.154907][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4020.155135][ C1] ? set_track_prepare+0x8a/0xd0 [ 4020.155399][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4020.155674][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4020.155947][ C1] ? skb_clone+0x10b/0x330 [ 4020.156174][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4020.156493][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4020.156798][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4020.157079][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4020.157374][ C1] ? __tcf_classify+0x329/0x7d0 [ 4020.157623][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4020.157851][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4020.158159][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4020.158443][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4020.158768][ C1] ? lock_acquire+0x1c1/0x220 [ 4020.159004][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4020.159302][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4020.159586][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4020.159909][ C1] ? __copy_skb_header+0xaf/0x490 [ 4020.160168][ C1] ? __skb_clone+0x57a/0x760 [ 4020.160404][ C1] netif_receive_skb+0x55/0x280 [ 4020.160652][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4020.160966][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4020.161299][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4020.161596][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4020.161870][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4020.162158][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4020.162469][ C1] ? hlock_class+0x4e/0x130 [ 4020.162701][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4020.162976][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4020.163251][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4020.163513][ C1] ? hlock_class+0x4e/0x130 [ 4020.163744][ C1] ? mark_lock+0x38/0x3e0 [ 4020.163961][ C1] ? stack_access_ok+0xda/0x1f0 [ 4020.164211][ C1] ? __lock_acquire+0xb67/0x1610 [ 4020.164463][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4020.164738][ C1] ? get_stack_info+0x36/0xc0 [ 4020.164977][ C1] ? stack_access_ok+0xda/0x1f0 [ 4020.165222][ C1] ? get_reg+0x119/0x190 [ 4020.165438][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4020.165706][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4020.166012][ C1] __tcf_classify+0x329/0x7d0 [ 4020.166254][ C1] tcf_classify+0x283/0x930 [ 4020.166484][ C1] ? arch_stack_walk+0xa2/0x100 [ 4020.166732][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4020.166989][ C1] ? get_stack_info+0x36/0xc0 [ 4020.167228][ C1] tc_run+0x2e4/0x5d0 [ 4020.167435][ C1] ? __pfx_tc_run+0x10/0x10 [ 4020.167664][ C1] ? lock_acquire+0x1c1/0x220 [ 4020.167902][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4020.168163][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4020.168416][ C1] ? lock_acquire+0x1c1/0x220 [ 4020.168653][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4020.168917][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4020.169222][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4020.169493][ C1] ? neigh_hh_output+0x348/0x590 [ 4020.169750][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4020.170014][ C1] ip_finish_output2+0x786/0x18e0 [ 4020.170273][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4020.170549][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4020.170887][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4020.171163][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4020.171415][ C1] ? __ip_finish_output+0x10f/0x770 [ 4020.171681][ C1] ip_output+0x16b/0x4f0 [ 4020.171896][ C1] ? run_timer_softirq+0x72/0x100 [ 4020.172151][ C1] ? __pfx_ip_output+0x10/0x10 [ 4020.172394][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4020.172680][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4020.172929][ C1] ? ip_local_out+0x114/0x3b0 [ 4020.173170][ C1] __ip_queue_xmit+0x672/0x1910 [ 4020.173418][ C1] ? __create_object+0x5e/0xb0 [ 4020.173661][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4020.173926][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4020.174206][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4020.174480][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4020.174760][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4020.175030][ C1] tcp_delack_timer+0x84/0x240 [ 4020.175275][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4020.175544][ C1] call_timer_fn+0x173/0x430 [ 4020.175781][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4020.176042][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4020.176303][ C1] __run_timers.part.0+0x52d/0x890 [ 4020.176564][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4020.176837][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4020.177122][ C1] ? lock_acquire+0x1c1/0x220 [ 4020.177361][ C1] ? clockevents_program_event+0xf6/0x300 [ 4020.177649][ C1] ? lock_release+0x1d5/0x250 [ 4020.177889][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4020.178152][ C1] ? ktime_get+0xb3/0x190 [ 4020.178371][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4020.178669][ C1] run_timer_softirq+0x72/0x100 [ 4020.178916][ C1] __do_softirq+0x1b9/0x7ff [ 4020.179148][ C1] irq_exit_rcu+0x98/0xc0 [ 4020.179368][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4020.179651][ C1] [ 4020.179809][ C1] [ 4020.179958][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4020.180262][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4020.180586][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4020.181556][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4020.181863][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4020.182261][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4020.182658][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4020.183057][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4020.183455][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4020.183856][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4020.184153][ C1] pipe_read+0xa16/0xdf0 [ 4020.184372][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4020.184649][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4020.184891][ C1] ? iterate_tty_write+0x299/0x540 [ 4020.185152][ C1] ? lock_release+0x1d5/0x250 [ 4020.185394][ C1] vfs_read+0x911/0xc00 [ 4020.185608][ C1] ? lock_acquire+0x1c1/0x220 [ 4020.185846][ C1] ? __might_fault+0xc6/0x180 [ 4020.186085][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4020.186325][ C1] ? __might_fault+0xc6/0x180 [ 4020.186563][ C1] ? lock_release+0x1d5/0x250 [ 4020.186801][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4020.187065][ C1] ? __fget_light+0x54/0x1e0 [ 4020.187304][ C1] ksys_read+0x17a/0x1e0 [ 4020.187521][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4020.187766][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4020.188070][ C1] do_syscall_64+0xc9/0x1e0 [ 4020.188304][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4020.188602][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4020.188831][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4020.189802][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4020.190224][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4020.190622][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4020.191019][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4020.191416][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4020.191813][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4020.192214][ C1] [ 4020.192378][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4020.192668][ C2] NMI backtrace for cpu 2 [ 4020.192674][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4020.192681][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4020.192685][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4020.192693][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4020.192698][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4020.192701][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4020.192703][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4020.192704][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4020.192705][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4020.192707][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4020.192709][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4020.192710][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4020.192714][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4020.192715][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4020.192717][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4020.192718][ C2] PKRU: 55555554 [ 4020.192719][ C2] Call Trace: [ 4020.192721][ C2] [ 4020.192724][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4020.192731][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4020.192736][ C2] ? nmi_handle+0x153/0x420 [ 4020.192742][ C2] ? default_do_nmi+0x41/0x100 [ 4020.192744][ C2] ? exc_nmi+0xf3/0x120 [ 4020.192746][ C2] ? end_repeat_nmi+0xf/0x60 [ 4020.192751][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4020.192754][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4020.192757][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4020.192760][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4020.192763][ C2] [ 4020.192764][ C2] [ 4020.192765][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4020.192768][ C2] ? get_stack_info+0x36/0xc0 [ 4020.192772][ C2] ? lock_acquire+0x1c1/0x220 [ 4020.192775][ C2] ? lock_release+0x1d5/0x250 [ 4020.192778][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4020.192782][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4020.192785][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4020.192788][ C2] ? lock_acquire+0x1c1/0x220 [ 4020.192791][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4020.192794][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4020.192797][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4020.192804][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4020.192806][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4020.192811][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4020.192817][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4020.192820][ C2] ip_local_deliver+0x19d/0x480 [ 4020.192823][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4020.192825][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4020.192827][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4020.192832][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4020.192836][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4020.192839][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4020.192848][ C2] ip_rcv+0x564/0x740 [ 4020.192851][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4020.192853][ C2] ? set_track_prepare+0x8a/0xd0 [ 4020.192857][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4020.192860][ C2] ? start_secondary+0x21c/0x2b0 [ 4020.192863][ C2] ? skb_clone+0x10b/0x330 [ 4020.192866][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4020.192873][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4020.192878][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4020.192882][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4020.192890][ C2] ? __tcf_classify+0x329/0x7d0 [ 4020.192894][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4020.192896][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4020.192899][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4020.192902][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4020.192906][ C2] ? lock_acquire+0x1c1/0x220 [ 4020.192909][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4020.192913][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4020.192916][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4020.192920][ C2] ? __copy_skb_header+0xaf/0x490 [ 4020.192924][ C2] ? __skb_clone+0x57a/0x760 [ 4020.192927][ C2] netif_receive_skb+0x55/0x280 [ 4020.192930][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4020.192937][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4020.192943][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4020.192950][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4020.192954][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4020.192964][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4020.192971][ C2] ? get_stack_info+0x36/0xc0 [ 4020.192976][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4020.192979][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4020.192983][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4020.192985][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4020.192989][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4020.192991][ C2] ? kernel_text_address+0x17/0xe0 [ 4020.192995][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4020.192999][ C2] ? arch_stack_walk+0x8c/0x100 [ 4020.193003][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4020.193006][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4020.193009][ C2] ? lock_acquire+0x1c1/0x220 [ 4020.193011][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4020.193016][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4020.193020][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4020.193023][ C2] ? get_stack_info+0x36/0xc0 [ 4020.193027][ C2] __tcf_classify+0x329/0x7d0 [ 4020.193032][ C2] tcf_classify+0x283/0x930 [ 4020.193036][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4020.193039][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4020.193044][ C2] tc_run+0x2e4/0x5d0 [ 4020.193047][ C2] ? __pfx_tc_run+0x10/0x10 [ 4020.193050][ C2] ? lock_acquire+0x1c1/0x220 [ 4020.193053][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4020.193057][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4020.193061][ C2] ? lock_acquire+0x1c1/0x220 [ 4020.193063][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4020.193066][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4020.193069][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4020.193071][ C2] ? neigh_hh_output+0x348/0x590 [ 4020.193075][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4020.193078][ C2] ip_finish_output2+0x786/0x18e0 [ 4020.193082][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4020.193089][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4020.193091][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4020.193095][ C2] ? __ip_finish_output+0x10f/0x770 [ 4020.193099][ C2] ip_output+0x16b/0x4f0 [ 4020.193101][ C2] ? __pfx_ip_output+0x10/0x10 [ 4020.193104][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4020.193107][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4020.193110][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4020.193112][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4020.193115][ C2] ? __alloc_skb+0xd4/0x280 [ 4020.193117][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4020.193121][ C2] ? tcp_fragment+0x168/0x1040 [ 4020.193124][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4020.193127][ C2] ? ip_local_out+0x114/0x3b0 [ 4020.193130][ C2] __ip_queue_xmit+0x672/0x1910 [ 4020.193134][ C2] ? __skb_clone+0x57a/0x760 [ 4020.193137][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4020.193142][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4020.193145][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4020.193149][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4020.193154][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4020.193158][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4020.193160][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4020.193164][ C2] tcp_send_loss_probe+0x348/0x830 [ 4020.193167][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4020.193170][ C2] tcp_write_timer+0x82/0x1d0 [ 4020.193173][ C2] call_timer_fn+0x173/0x430 [ 4020.193177][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4020.193181][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4020.193185][ C2] __run_timers.part.0+0x52d/0x890 [ 4020.193188][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4020.193192][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4020.193195][ C2] ? lock_acquire+0x1c1/0x220 [ 4020.193197][ C2] ? clockevents_program_event+0xf6/0x300 [ 4020.193202][ C2] ? lock_release+0x1d5/0x250 [ 4020.193204][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4020.193208][ C2] ? ktime_get+0xb3/0x190 [ 4020.193211][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4020.193215][ C2] run_timer_softirq+0x72/0x100 [ 4020.193218][ C2] __do_softirq+0x1b9/0x7ff [ 4020.193222][ C2] irq_exit_rcu+0x98/0xc0 [ 4020.193225][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4020.193228][ C2] [ 4020.193229][ C2] [ 4020.193230][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4020.193233][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4020.193237][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4020.193239][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4020.193241][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4020.193242][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4020.193244][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4020.193245][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4020.193247][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4020.193250][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4020.193253][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4020.193256][ C2] default_idle_call+0x69/0xa0 [ 4020.193260][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4020.193262][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4020.193266][ C2] ? lock_release+0x1d5/0x250 [ 4020.193268][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4020.193272][ C2] do_idle+0xfb/0x160 [ 4020.193274][ C2] cpu_startup_entry+0x55/0x60 [ 4020.193276][ C2] start_secondary+0x21c/0x2b0 [ 4020.193279][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4020.193283][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4020.193289][ C2] [ 4044.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1575s! [swapper/2:0] [ 4044.569695][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4044.570944][ C2] irq event stamp: 44114564 [ 4044.571170][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4044.571705][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4044.572214][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4044.572686][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4044.573153][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4044.573607][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4044.574216][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4044.574538][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4044.575501][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4044.575807][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4044.576202][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4044.576600][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4044.576997][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4044.577393][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4044.577788][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4044.578233][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4044.578564][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4044.578963][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4044.579359][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4044.579760][ C2] PKRU: 55555554 [ 4044.579941][ C2] Call Trace: [ 4044.580112][ C2] [ 4044.580258][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4044.580519][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4044.580764][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4044.581038][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4044.581311][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4044.581596][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4044.581859][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4044.582164][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4044.582423][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4044.582684][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4044.582992][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4044.583287][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4044.583600][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4044.583887][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4044.584181][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4044.584468][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4044.584777][ C2] ? get_stack_info+0x36/0xc0 [ 4044.585018][ C2] ? lock_acquire+0x1c1/0x220 [ 4044.585256][ C2] ? lock_release+0x1d5/0x250 [ 4044.585493][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4044.585747][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4044.586017][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4044.586303][ C2] ? lock_acquire+0x1c1/0x220 [ 4044.586540][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4044.586778][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4044.587037][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4044.587273][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4044.587518][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4044.587781][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4044.588055][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4044.588330][ C2] ip_local_deliver+0x19d/0x480 [ 4044.588576][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4044.588849][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4044.589112][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4044.589457][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4044.589715][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4044.590037][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4044.590300][ C2] ip_rcv+0x564/0x740 [ 4044.590502][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4044.590732][ C2] ? set_track_prepare+0x8a/0xd0 [ 4044.590984][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4044.591259][ C2] ? start_secondary+0x21c/0x2b0 [ 4044.591507][ C2] ? skb_clone+0x10b/0x330 [ 4044.591735][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4044.592051][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4044.592355][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4044.592638][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4044.592929][ C2] ? __tcf_classify+0x329/0x7d0 [ 4044.593176][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4044.593405][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4044.593702][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4044.593992][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4044.594316][ C2] ? lock_acquire+0x1c1/0x220 [ 4044.594553][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4044.594846][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4044.595133][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4044.595448][ C2] ? __copy_skb_header+0xaf/0x490 [ 4044.595705][ C2] ? __skb_clone+0x57a/0x760 [ 4044.595937][ C2] netif_receive_skb+0x55/0x280 [ 4044.596185][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4044.596495][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4044.596825][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4044.597123][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4044.597396][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4044.597682][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4044.597993][ C2] ? get_stack_info+0x36/0xc0 [ 4044.598234][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4044.598497][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4044.598814][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4044.599088][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4044.599365][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4044.599684][ C2] ? kernel_text_address+0x17/0xe0 [ 4044.599945][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4044.600260][ C2] ? arch_stack_walk+0x8c/0x100 [ 4044.600508][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4044.600772][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4044.601057][ C2] ? lock_acquire+0x1c1/0x220 [ 4044.601295][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4044.601575][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4044.601879][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4044.602152][ C2] ? get_stack_info+0x36/0xc0 [ 4044.602393][ C2] __tcf_classify+0x329/0x7d0 [ 4044.602634][ C2] tcf_classify+0x283/0x930 [ 4044.602864][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4044.603118][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4044.603429][ C2] tc_run+0x2e4/0x5d0 [ 4044.603633][ C2] ? __pfx_tc_run+0x10/0x10 [ 4044.603864][ C2] ? lock_acquire+0x1c1/0x220 [ 4044.604102][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4044.604362][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4044.604613][ C2] ? lock_acquire+0x1c1/0x220 [ 4044.604848][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4044.605113][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4044.605414][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4044.605685][ C2] ? neigh_hh_output+0x348/0x590 [ 4044.605937][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4044.606201][ C2] ip_finish_output2+0x786/0x18e0 [ 4044.606457][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4044.606793][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4044.607066][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4044.607319][ C2] ? __ip_finish_output+0x10f/0x770 [ 4044.607582][ C2] ip_output+0x16b/0x4f0 [ 4044.607798][ C2] ? __pfx_ip_output+0x10/0x10 [ 4044.608038][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4044.608315][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4044.608624][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4044.608900][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4044.609151][ C2] ? __alloc_skb+0xd4/0x280 [ 4044.609378][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4044.609662][ C2] ? tcp_fragment+0x168/0x1040 [ 4044.609903][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4044.610155][ C2] ? ip_local_out+0x114/0x3b0 [ 4044.610395][ C2] __ip_queue_xmit+0x672/0x1910 [ 4044.610642][ C2] ? __skb_clone+0x57a/0x760 [ 4044.610876][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4044.611142][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4044.611420][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4044.611664][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4044.611912][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4044.612210][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4044.612528][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4044.612770][ C2] tcp_send_loss_probe+0x348/0x830 [ 4044.613028][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4044.613298][ C2] tcp_write_timer+0x82/0x1d0 [ 4044.613534][ C2] call_timer_fn+0x173/0x430 [ 4044.613772][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4044.614035][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4044.614294][ C2] __run_timers.part.0+0x52d/0x890 [ 4044.614553][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4044.614820][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4044.615106][ C2] ? lock_acquire+0x1c1/0x220 [ 4044.615343][ C2] ? clockevents_program_event+0xf6/0x300 [ 4044.615633][ C2] ? lock_release+0x1d5/0x250 [ 4044.615872][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4044.616134][ C2] ? ktime_get+0xb3/0x190 [ 4044.616352][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4044.616649][ C2] run_timer_softirq+0x72/0x100 [ 4044.616897][ C2] __do_softirq+0x1b9/0x7ff [ 4044.617128][ C2] irq_exit_rcu+0x98/0xc0 [ 4044.617347][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4044.617629][ C2] [ 4044.617782][ C2] [ 4044.617930][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4044.618234][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4044.618489][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4044.619454][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4044.619765][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4044.620163][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4044.620560][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4044.620959][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4044.621356][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4044.621754][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4044.622042][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4044.622302][ C2] default_idle_call+0x69/0xa0 [ 4044.622544][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4044.622793][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4044.623071][ C2] ? lock_release+0x1d5/0x250 [ 4044.623308][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4044.623580][ C2] do_idle+0xfb/0x160 [ 4044.623782][ C2] cpu_startup_entry+0x55/0x60 [ 4044.624024][ C2] start_secondary+0x21c/0x2b0 [ 4044.624266][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4044.624535][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4044.624844][ C2] [ 4044.625001][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1575s! [perl:4135] [ 4044.625430][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4044.626690][ C1] irq event stamp: 209232 [ 4044.626909][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4044.627439][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4044.627915][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4044.628383][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4044.628847][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4044.629296][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4044.629911][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4044.630235][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4044.631204][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4044.631512][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4044.631910][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4044.632311][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4044.632710][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4044.633107][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4044.633507][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4044.633954][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4044.634289][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4044.634691][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4044.635087][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4044.635488][ C1] PKRU: 55555554 [ 4044.635668][ C1] Call Trace: [ 4044.635840][ C1] [ 4044.635987][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4044.636252][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4044.636499][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4044.636777][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4044.637049][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4044.637336][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4044.637607][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4044.637912][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4044.638174][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4044.638483][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4044.638780][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4044.639095][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4044.639384][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4044.639685][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4044.639973][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4044.640285][ C1] ? get_stack_info+0x36/0xc0 [ 4044.640526][ C1] ? lock_acquire+0x1c1/0x220 [ 4044.640767][ C1] ? lock_release+0x1d5/0x250 [ 4044.641005][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4044.641255][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4044.641527][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4044.641813][ C1] ? lock_acquire+0x1c1/0x220 [ 4044.642052][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4044.642293][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4044.642554][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4044.642789][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4044.643036][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4044.643296][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4044.643573][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4044.643851][ C1] ip_local_deliver+0x19d/0x480 [ 4044.644096][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4044.644371][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4044.644635][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4044.644980][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4044.645235][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4044.645555][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4044.645818][ C1] ip_rcv+0x564/0x740 [ 4044.646021][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4044.646254][ C1] ? set_track_prepare+0x8a/0xd0 [ 4044.646508][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4044.646784][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4044.647055][ C1] ? skb_clone+0x10b/0x330 [ 4044.647286][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4044.647605][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4044.647911][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4044.648193][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4044.648487][ C1] ? __tcf_classify+0x329/0x7d0 [ 4044.648734][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4044.648966][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4044.649267][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4044.649554][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4044.649879][ C1] ? lock_acquire+0x1c1/0x220 [ 4044.650119][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4044.650415][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4044.650701][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4044.651017][ C1] ? __copy_skb_header+0xaf/0x490 [ 4044.651275][ C1] ? __skb_clone+0x57a/0x760 [ 4044.651509][ C1] netif_receive_skb+0x55/0x280 [ 4044.651757][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4044.652067][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4044.652401][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4044.652699][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4044.652971][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4044.653266][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4044.653577][ C1] ? hlock_class+0x4e/0x130 [ 4044.653808][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4044.654084][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4044.654362][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4044.654624][ C1] ? hlock_class+0x4e/0x130 [ 4044.654855][ C1] ? mark_lock+0x38/0x3e0 [ 4044.655074][ C1] ? stack_access_ok+0xda/0x1f0 [ 4044.655324][ C1] ? __lock_acquire+0xb67/0x1610 [ 4044.655577][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4044.655852][ C1] ? get_stack_info+0x36/0xc0 [ 4044.656092][ C1] ? stack_access_ok+0xda/0x1f0 [ 4044.656340][ C1] ? get_reg+0x119/0x190 [ 4044.656555][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4044.656822][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4044.657132][ C1] __tcf_classify+0x329/0x7d0 [ 4044.657374][ C1] tcf_classify+0x283/0x930 [ 4044.657606][ C1] ? arch_stack_walk+0xa2/0x100 [ 4044.657853][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4044.658110][ C1] ? get_stack_info+0x36/0xc0 [ 4044.658355][ C1] tc_run+0x2e4/0x5d0 [ 4044.658560][ C1] ? __pfx_tc_run+0x10/0x10 [ 4044.658793][ C1] ? lock_acquire+0x1c1/0x220 [ 4044.659032][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4044.659295][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4044.659548][ C1] ? lock_acquire+0x1c1/0x220 [ 4044.659791][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4044.660057][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4044.660360][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4044.660634][ C1] ? neigh_hh_output+0x348/0x590 [ 4044.660886][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4044.661153][ C1] ip_finish_output2+0x786/0x18e0 [ 4044.661409][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4044.661686][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4044.662022][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4044.662300][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4044.662552][ C1] ? __ip_finish_output+0x10f/0x770 [ 4044.662817][ C1] ip_output+0x16b/0x4f0 [ 4044.663033][ C1] ? run_timer_softirq+0x72/0x100 [ 4044.663291][ C1] ? __pfx_ip_output+0x10/0x10 [ 4044.663535][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4044.663820][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4044.664071][ C1] ? ip_local_out+0x114/0x3b0 [ 4044.664312][ C1] __ip_queue_xmit+0x672/0x1910 [ 4044.664561][ C1] ? __create_object+0x5e/0xb0 [ 4044.664805][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4044.665072][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4044.665353][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4044.665624][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4044.665909][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4044.666182][ C1] tcp_delack_timer+0x84/0x240 [ 4044.666427][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4044.666697][ C1] call_timer_fn+0x173/0x430 [ 4044.666933][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4044.667195][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4044.667456][ C1] __run_timers.part.0+0x52d/0x890 [ 4044.667716][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4044.667988][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4044.668275][ C1] ? lock_acquire+0x1c1/0x220 [ 4044.668511][ C1] ? clockevents_program_event+0xf6/0x300 [ 4044.668802][ C1] ? lock_release+0x1d5/0x250 [ 4044.669041][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4044.669305][ C1] ? ktime_get+0xb3/0x190 [ 4044.669524][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4044.669827][ C1] run_timer_softirq+0x72/0x100 [ 4044.670075][ C1] __do_softirq+0x1b9/0x7ff [ 4044.670306][ C1] irq_exit_rcu+0x98/0xc0 [ 4044.670527][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4044.670811][ C1] [ 4044.670961][ C1] [ 4044.671112][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4044.671417][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4044.671741][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4044.672711][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4044.673019][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4044.673419][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4044.673815][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4044.674214][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4044.674615][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4044.675017][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4044.675314][ C1] pipe_read+0xa16/0xdf0 [ 4044.675535][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4044.675811][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4044.676054][ C1] ? iterate_tty_write+0x299/0x540 [ 4044.676317][ C1] ? lock_release+0x1d5/0x250 [ 4044.676558][ C1] vfs_read+0x911/0xc00 [ 4044.676771][ C1] ? lock_acquire+0x1c1/0x220 [ 4044.677010][ C1] ? __might_fault+0xc6/0x180 [ 4044.677256][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4044.677493][ C1] ? __might_fault+0xc6/0x180 [ 4044.677733][ C1] ? lock_release+0x1d5/0x250 [ 4044.677973][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4044.678238][ C1] ? __fget_light+0x54/0x1e0 [ 4044.678476][ C1] ksys_read+0x17a/0x1e0 [ 4044.678693][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4044.678938][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4044.679244][ C1] do_syscall_64+0xc9/0x1e0 [ 4044.679474][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4044.679780][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4044.680008][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4044.680977][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4044.681399][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4044.681797][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4044.682197][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4044.682600][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4044.682998][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4044.683400][ C1] [ 4072.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1601s! [swapper/2:0] [ 4072.569695][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4072.570949][ C2] irq event stamp: 44114564 [ 4072.571178][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4072.571710][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4072.572219][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4072.572692][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4072.573161][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4072.573616][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4072.574225][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4072.574548][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4072.575515][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4072.575819][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4072.576218][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4072.576615][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4072.577011][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4072.577407][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4072.577805][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4072.578250][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4072.578582][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4072.578980][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4072.579375][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4072.579778][ C2] PKRU: 55555554 [ 4072.579959][ C2] Call Trace: [ 4072.580127][ C2] [ 4072.580277][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4072.580538][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4072.580778][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4072.581055][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4072.581326][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4072.581614][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4072.581879][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4072.582182][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4072.582443][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4072.582704][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4072.583010][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4072.583306][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4072.583619][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4072.583904][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4072.584204][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4072.584490][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4072.584799][ C2] ? get_stack_info+0x36/0xc0 [ 4072.585041][ C2] ? lock_acquire+0x1c1/0x220 [ 4072.585280][ C2] ? lock_release+0x1d5/0x250 [ 4072.585519][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4072.585765][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4072.586037][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4072.586319][ C2] ? lock_acquire+0x1c1/0x220 [ 4072.586557][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4072.586796][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4072.587056][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4072.587288][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4072.587535][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4072.587791][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4072.588065][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4072.588342][ C2] ip_local_deliver+0x19d/0x480 [ 4072.588588][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4072.588859][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4072.589121][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4072.589470][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4072.589723][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4072.590042][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4072.590303][ C2] ip_rcv+0x564/0x740 [ 4072.590506][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4072.590735][ C2] ? set_track_prepare+0x8a/0xd0 [ 4072.590986][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4072.591260][ C2] ? start_secondary+0x21c/0x2b0 [ 4072.591512][ C2] ? skb_clone+0x10b/0x330 [ 4072.591739][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4072.592057][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4072.592361][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4072.592640][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4072.592933][ C2] ? __tcf_classify+0x329/0x7d0 [ 4072.593179][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4072.593409][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4072.593708][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4072.593990][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4072.594313][ C2] ? lock_acquire+0x1c1/0x220 [ 4072.594551][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4072.594845][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4072.595130][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4072.595445][ C2] ? __copy_skb_header+0xaf/0x490 [ 4072.595701][ C2] ? __skb_clone+0x57a/0x760 [ 4072.595935][ C2] netif_receive_skb+0x55/0x280 [ 4072.596181][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4072.596492][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4072.596824][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4072.597123][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4072.597393][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4072.597681][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4072.597991][ C2] ? get_stack_info+0x36/0xc0 [ 4072.598230][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4072.598492][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4072.598807][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4072.599083][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4072.599358][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4072.599677][ C2] ? kernel_text_address+0x17/0xe0 [ 4072.599937][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4072.600249][ C2] ? arch_stack_walk+0x8c/0x100 [ 4072.600497][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4072.600759][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4072.601041][ C2] ? lock_acquire+0x1c1/0x220 [ 4072.601280][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4072.601559][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4072.601863][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4072.602136][ C2] ? get_stack_info+0x36/0xc0 [ 4072.602377][ C2] __tcf_classify+0x329/0x7d0 [ 4072.602617][ C2] tcf_classify+0x283/0x930 [ 4072.602848][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4072.603103][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4072.603414][ C2] tc_run+0x2e4/0x5d0 [ 4072.603619][ C2] ? __pfx_tc_run+0x10/0x10 [ 4072.603848][ C2] ? lock_acquire+0x1c1/0x220 [ 4072.604085][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4072.604345][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4072.604596][ C2] ? lock_acquire+0x1c1/0x220 [ 4072.604835][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4072.605098][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4072.605399][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4072.605670][ C2] ? neigh_hh_output+0x348/0x590 [ 4072.605922][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4072.606184][ C2] ip_finish_output2+0x786/0x18e0 [ 4072.606439][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4072.606773][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4072.607045][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4072.607298][ C2] ? __ip_finish_output+0x10f/0x770 [ 4072.607563][ C2] ip_output+0x16b/0x4f0 [ 4072.607780][ C2] ? __pfx_ip_output+0x10/0x10 [ 4072.608022][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4072.608301][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4072.608611][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4072.608886][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4072.609136][ C2] ? __alloc_skb+0xd4/0x280 [ 4072.609366][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4072.609641][ C2] ? tcp_fragment+0x168/0x1040 [ 4072.609884][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4072.610135][ C2] ? ip_local_out+0x114/0x3b0 [ 4072.610371][ C2] __ip_queue_xmit+0x672/0x1910 [ 4072.610619][ C2] ? __skb_clone+0x57a/0x760 [ 4072.610854][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4072.611119][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4072.611396][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4072.611639][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4072.611887][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4072.612187][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4072.612505][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4072.612748][ C2] tcp_send_loss_probe+0x348/0x830 [ 4072.613007][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4072.613273][ C2] tcp_write_timer+0x82/0x1d0 [ 4072.613511][ C2] call_timer_fn+0x173/0x430 [ 4072.613745][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4072.614007][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4072.614267][ C2] __run_timers.part.0+0x52d/0x890 [ 4072.614526][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4072.614795][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4072.615077][ C2] ? lock_acquire+0x1c1/0x220 [ 4072.615315][ C2] ? clockevents_program_event+0xf6/0x300 [ 4072.615602][ C2] ? lock_release+0x1d5/0x250 [ 4072.615841][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4072.616102][ C2] ? ktime_get+0xb3/0x190 [ 4072.616323][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4072.616615][ C2] run_timer_softirq+0x72/0x100 [ 4072.616863][ C2] __do_softirq+0x1b9/0x7ff [ 4072.617095][ C2] irq_exit_rcu+0x98/0xc0 [ 4072.617312][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4072.617597][ C2] [ 4072.617746][ C2] [ 4072.617895][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4072.618197][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4072.618451][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4072.619414][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4072.619725][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4072.620120][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4072.620519][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4072.620916][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4072.621312][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4072.621710][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4072.621999][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4072.622259][ C2] default_idle_call+0x69/0xa0 [ 4072.622501][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4072.622750][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4072.623025][ C2] ? lock_release+0x1d5/0x250 [ 4072.623263][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4072.623534][ C2] do_idle+0xfb/0x160 [ 4072.623736][ C2] cpu_startup_entry+0x55/0x60 [ 4072.623978][ C2] start_secondary+0x21c/0x2b0 [ 4072.624222][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4072.624489][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4072.624799][ C2] [ 4072.624959][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1601s! [perl:4135] [ 4072.625382][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4072.626635][ C1] irq event stamp: 209232 [ 4072.626853][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4072.627380][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4072.627856][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4072.628327][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4072.628785][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4072.629232][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4072.629853][ C1] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 4072.630138][ C1] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 4072.631105][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 4072.631417][ C1] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4072.631802][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4072.632192][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4072.632598][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4072.633018][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4072.633415][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4072.633868][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4072.634228][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4072.634617][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4072.635027][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4072.635423][ C1] PKRU: 55555554 [ 4072.635604][ C1] Call Trace: [ 4072.635774][ C1] [ 4072.635922][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4072.636184][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4072.636428][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4072.636704][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4072.636977][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4072.637264][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4072.637529][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4072.637838][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4072.638090][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 4072.638343][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4072.638666][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4072.638961][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4072.639284][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4072.639590][ C1] ? kasan_check_range+0x54/0x1c0 [ 4072.639845][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4072.640126][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4072.640437][ C1] ? get_stack_info+0x36/0xc0 [ 4072.640679][ C1] ? lock_acquire+0x1c1/0x220 [ 4072.640927][ C1] ? lock_release+0x1d5/0x250 [ 4072.641159][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4072.641400][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4072.641667][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4072.641962][ C1] ? lock_acquire+0x1c1/0x220 [ 4072.642195][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4072.642429][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4072.642682][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4072.642909][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4072.643150][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4072.643399][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4072.643652][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4072.643909][ C1] ip_local_deliver+0x19d/0x480 [ 4072.644139][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4072.644390][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4072.644655][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4072.644991][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4072.645238][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4072.645547][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4072.645803][ C1] ip_rcv+0x564/0x740 [ 4072.646001][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4072.646227][ C1] ? set_track_prepare+0x8a/0xd0 [ 4072.646473][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4072.646759][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4072.647030][ C1] ? skb_clone+0x10b/0x330 [ 4072.647257][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4072.647575][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4072.647881][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4072.648162][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4072.648456][ C1] ? __tcf_classify+0x329/0x7d0 [ 4072.648703][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4072.648933][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4072.649234][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4072.649524][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4072.649847][ C1] ? lock_acquire+0x1c1/0x220 [ 4072.650086][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4072.650384][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4072.650668][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4072.650985][ C1] ? __copy_skb_header+0xaf/0x490 [ 4072.651236][ C1] ? __skb_clone+0x57a/0x760 [ 4072.651464][ C1] netif_receive_skb+0x55/0x280 [ 4072.651705][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4072.652025][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4072.652359][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4072.652656][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4072.652936][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4072.653218][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4072.653520][ C1] ? hlock_class+0x4e/0x130 [ 4072.653743][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4072.654031][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4072.654308][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4072.654570][ C1] ? hlock_class+0x4e/0x130 [ 4072.654801][ C1] ? mark_lock+0x38/0x3e0 [ 4072.655019][ C1] ? stack_access_ok+0xda/0x1f0 [ 4072.655269][ C1] ? __lock_acquire+0xb67/0x1610 [ 4072.655522][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4072.655797][ C1] ? get_stack_info+0x36/0xc0 [ 4072.656035][ C1] ? stack_access_ok+0xda/0x1f0 [ 4072.656284][ C1] ? get_reg+0x119/0x190 [ 4072.656498][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4072.656767][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4072.657075][ C1] __tcf_classify+0x329/0x7d0 [ 4072.657319][ C1] tcf_classify+0x283/0x930 [ 4072.657553][ C1] ? arch_stack_walk+0xa2/0x100 [ 4072.657800][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4072.658055][ C1] ? get_stack_info+0x36/0xc0 [ 4072.658295][ C1] tc_run+0x2e4/0x5d0 [ 4072.658499][ C1] ? __pfx_tc_run+0x10/0x10 [ 4072.658732][ C1] ? lock_acquire+0x1c1/0x220 [ 4072.658970][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4072.659232][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4072.659494][ C1] ? lock_acquire+0x1c1/0x220 [ 4072.659730][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4072.659995][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4072.660298][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4072.660572][ C1] ? neigh_hh_output+0x348/0x590 [ 4072.660824][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4072.661089][ C1] ip_finish_output2+0x786/0x18e0 [ 4072.661351][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4072.661619][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4072.661964][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4072.662241][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4072.662494][ C1] ? __ip_finish_output+0x10f/0x770 [ 4072.662760][ C1] ip_output+0x16b/0x4f0 [ 4072.662974][ C1] ? run_timer_softirq+0x72/0x100 [ 4072.663232][ C1] ? __pfx_ip_output+0x10/0x10 [ 4072.663475][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4072.663769][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4072.664013][ C1] ? ip_local_out+0x114/0x3b0 [ 4072.664248][ C1] __ip_queue_xmit+0x672/0x1910 [ 4072.664510][ C1] ? __create_object+0x5e/0xb0 [ 4072.664752][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4072.665019][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4072.665301][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4072.665571][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4072.665853][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4072.666125][ C1] tcp_delack_timer+0x84/0x240 [ 4072.666368][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4072.666639][ C1] call_timer_fn+0x173/0x430 [ 4072.666875][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4072.667137][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4072.667398][ C1] __run_timers.part.0+0x52d/0x890 [ 4072.667658][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4072.667934][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4072.668211][ C1] ? lock_acquire+0x1c1/0x220 [ 4072.668441][ C1] ? clockevents_program_event+0xf6/0x300 [ 4072.668724][ C1] ? lock_release+0x1d5/0x250 [ 4072.668977][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4072.669242][ C1] ? ktime_get+0xb3/0x190 [ 4072.669465][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4072.669761][ C1] run_timer_softirq+0x72/0x100 [ 4072.670012][ C1] __do_softirq+0x1b9/0x7ff [ 4072.670244][ C1] irq_exit_rcu+0x98/0xc0 [ 4072.670465][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4072.670748][ C1] [ 4072.670899][ C1] [ 4072.671048][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4072.671354][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4072.671685][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4072.672623][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4072.672923][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4072.673310][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4072.673695][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4072.674082][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4072.674496][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4072.674893][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4072.675189][ C1] pipe_read+0xa16/0xdf0 [ 4072.675409][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4072.675684][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4072.675928][ C1] ? iterate_tty_write+0x299/0x540 [ 4072.676189][ C1] ? lock_release+0x1d5/0x250 [ 4072.676429][ C1] vfs_read+0x911/0xc00 [ 4072.676641][ C1] ? lock_acquire+0x1c1/0x220 [ 4072.676879][ C1] ? __might_fault+0xc6/0x180 [ 4072.677121][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4072.677359][ C1] ? __might_fault+0xc6/0x180 [ 4072.677598][ C1] ? lock_release+0x1d5/0x250 [ 4072.677836][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4072.678099][ C1] ? __fget_light+0x54/0x1e0 [ 4072.678337][ C1] ksys_read+0x17a/0x1e0 [ 4072.678552][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4072.678796][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4072.679100][ C1] do_syscall_64+0xc9/0x1e0 [ 4072.679335][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4072.679637][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4072.679865][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4072.680835][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4072.681255][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4072.681653][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4072.682051][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4072.682450][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4072.682846][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4072.683257][ C1] [ 4098.193104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4098.193465][ C1] rcu: 1-....: (1739232 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=420328 [ 4098.194020][ C1] rcu: (t=1743306 jiffies g=1882453 q=703 ncpus=4) [ 4098.194357][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4098.194837][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4098.195465][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 4098.195749][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 4098.196740][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 4098.197048][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4098.197446][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4098.197847][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4098.198247][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4098.198645][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4098.199046][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4098.199509][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4098.199842][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4098.200243][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4098.200639][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4098.201038][ C1] PKRU: 55555554 [ 4098.201219][ C1] Call Trace: [ 4098.201390][ C1] [ 4098.201538][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4098.201811][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4098.202063][ C1] ? check_cpu_stall+0x284/0x500 [ 4098.202317][ C1] ? rcu_pending+0x92/0x360 [ 4098.202548][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4098.202816][ C1] ? update_process_times+0xb9/0x110 [ 4098.203085][ C1] ? tick_sched_handle+0x67/0x130 [ 4098.203341][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4098.203628][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4098.203870][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4098.204182][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4098.204455][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4098.204741][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4098.205007][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4098.205314][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4098.205575][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4098.205884][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4098.206181][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4098.206495][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4098.206783][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 4098.207063][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4098.207347][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4098.207658][ C1] ? get_stack_info+0x36/0xc0 [ 4098.207897][ C1] ? lock_acquire+0x1c1/0x220 [ 4098.208137][ C1] ? lock_release+0x1d5/0x250 [ 4098.208378][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4098.208626][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4098.208897][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4098.209182][ C1] ? lock_acquire+0x1c1/0x220 [ 4098.209429][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4098.209669][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4098.209929][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4098.210164][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4098.210411][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4098.210669][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4098.210946][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4098.211222][ C1] ip_local_deliver+0x19d/0x480 [ 4098.211470][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4098.211742][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4098.212005][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4098.212358][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4098.212610][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4098.212929][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4098.213192][ C1] ip_rcv+0x564/0x740 [ 4098.213396][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4098.213625][ C1] ? set_track_prepare+0x8a/0xd0 [ 4098.213878][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4098.214157][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4098.214428][ C1] ? skb_clone+0x10b/0x330 [ 4098.214655][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4098.214974][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4098.215279][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4098.215562][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4098.215856][ C1] ? __tcf_classify+0x329/0x7d0 [ 4098.216104][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4098.216338][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4098.216637][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4098.216924][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4098.217250][ C1] ? lock_acquire+0x1c1/0x220 [ 4098.217487][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4098.217783][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4098.218072][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4098.218389][ C1] ? __copy_skb_header+0xaf/0x490 [ 4098.218646][ C1] ? __skb_clone+0x57a/0x760 [ 4098.218881][ C1] netif_receive_skb+0x55/0x280 [ 4098.219129][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4098.219447][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4098.219778][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4098.220083][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4098.220358][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4098.220644][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4098.220957][ C1] ? hlock_class+0x4e/0x130 [ 4098.221190][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4098.221466][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4098.221741][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4098.222006][ C1] ? hlock_class+0x4e/0x130 [ 4098.222237][ C1] ? mark_lock+0x38/0x3e0 [ 4098.222458][ C1] ? stack_access_ok+0xda/0x1f0 [ 4098.222703][ C1] ? __lock_acquire+0xb67/0x1610 [ 4098.222957][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4098.223236][ C1] ? get_stack_info+0x36/0xc0 [ 4098.223476][ C1] ? stack_access_ok+0xda/0x1f0 [ 4098.223726][ C1] ? get_reg+0x119/0x190 [ 4098.223944][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4098.224213][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4098.224524][ C1] __tcf_classify+0x329/0x7d0 [ 4098.224764][ C1] tcf_classify+0x283/0x930 [ 4098.224997][ C1] ? arch_stack_walk+0xa2/0x100 [ 4098.225247][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4098.225504][ C1] ? get_stack_info+0x36/0xc0 [ 4098.225745][ C1] tc_run+0x2e4/0x5d0 [ 4098.225950][ C1] ? __pfx_tc_run+0x10/0x10 [ 4098.226181][ C1] ? lock_acquire+0x1c1/0x220 [ 4098.226420][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4098.226680][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4098.226935][ C1] ? lock_acquire+0x1c1/0x220 [ 4098.227174][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4098.227439][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4098.227746][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4098.228017][ C1] ? neigh_hh_output+0x348/0x590 [ 4098.228270][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4098.228535][ C1] ip_finish_output2+0x786/0x18e0 [ 4098.228790][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4098.229068][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4098.229415][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4098.229691][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4098.229944][ C1] ? __ip_finish_output+0x10f/0x770 [ 4098.230210][ C1] ip_output+0x16b/0x4f0 [ 4098.230425][ C1] ? run_timer_softirq+0x72/0x100 [ 4098.230681][ C1] ? __pfx_ip_output+0x10/0x10 [ 4098.230926][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4098.231214][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4098.231466][ C1] ? ip_local_out+0x114/0x3b0 [ 4098.231704][ C1] __ip_queue_xmit+0x672/0x1910 [ 4098.231953][ C1] ? __create_object+0x5e/0xb0 [ 4098.232197][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4098.232463][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4098.232744][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4098.233018][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4098.233299][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4098.233569][ C1] tcp_delack_timer+0x84/0x240 [ 4098.233813][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4098.234085][ C1] call_timer_fn+0x173/0x430 [ 4098.234322][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4098.234582][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4098.234843][ C1] __run_timers.part.0+0x52d/0x890 [ 4098.235103][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4098.235379][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4098.235661][ C1] ? lock_acquire+0x1c1/0x220 [ 4098.235901][ C1] ? clockevents_program_event+0xf6/0x300 [ 4098.236190][ C1] ? lock_release+0x1d5/0x250 [ 4098.236431][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4098.236694][ C1] ? ktime_get+0xb3/0x190 [ 4098.236915][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4098.237211][ C1] run_timer_softirq+0x72/0x100 [ 4098.237458][ C1] __do_softirq+0x1b9/0x7ff [ 4098.237692][ C1] irq_exit_rcu+0x98/0xc0 [ 4098.237911][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4098.238198][ C1] [ 4098.238349][ C1] [ 4098.238498][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4098.238801][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4098.239126][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4098.240099][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4098.240409][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4098.240809][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4098.241209][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4098.241608][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4098.242007][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4098.242408][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4098.242705][ C1] pipe_read+0xa16/0xdf0 [ 4098.242925][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4098.243206][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4098.243448][ C1] ? iterate_tty_write+0x299/0x540 [ 4098.243710][ C1] ? lock_release+0x1d5/0x250 [ 4098.243949][ C1] vfs_read+0x911/0xc00 [ 4098.244166][ C1] ? lock_acquire+0x1c1/0x220 [ 4098.244403][ C1] ? __might_fault+0xc6/0x180 [ 4098.244645][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4098.244884][ C1] ? __might_fault+0xc6/0x180 [ 4098.245126][ C1] ? lock_release+0x1d5/0x250 [ 4098.245366][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4098.245632][ C1] ? __fget_light+0x54/0x1e0 [ 4098.245869][ C1] ksys_read+0x17a/0x1e0 [ 4098.246087][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4098.246332][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4098.246638][ C1] do_syscall_64+0xc9/0x1e0 [ 4098.246871][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4098.247170][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4098.247400][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4098.248368][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4098.248792][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4098.249191][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4098.249593][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4098.249990][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4098.250392][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4098.250793][ C1] [ 4098.250948][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4098.251225][ C2] NMI backtrace for cpu 2 [ 4098.251231][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4098.251238][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4098.251242][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4098.251249][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4098.251255][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4098.251258][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4098.251260][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4098.251262][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4098.251263][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4098.251265][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4098.251266][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4098.251268][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4098.251272][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4098.251273][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4098.251274][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4098.251276][ C2] PKRU: 55555554 [ 4098.251277][ C2] Call Trace: [ 4098.251280][ C2] [ 4098.251283][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4098.251290][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4098.251295][ C2] ? nmi_handle+0x153/0x420 [ 4098.251299][ C2] ? default_do_nmi+0x41/0x100 [ 4098.251302][ C2] ? exc_nmi+0xf3/0x120 [ 4098.251304][ C2] ? end_repeat_nmi+0xf/0x60 [ 4098.251309][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4098.251312][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4098.251315][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4098.251318][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4098.251321][ C2] [ 4098.251322][ C2] [ 4098.251324][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4098.251326][ C2] ? get_stack_info+0x36/0xc0 [ 4098.251330][ C2] ? lock_acquire+0x1c1/0x220 [ 4098.251334][ C2] ? lock_release+0x1d5/0x250 [ 4098.251337][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4098.251341][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4098.251343][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4098.251347][ C2] ? lock_acquire+0x1c1/0x220 [ 4098.251349][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4098.251352][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4098.251355][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4098.251361][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4098.251363][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4098.251368][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4098.251373][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4098.251377][ C2] ip_local_deliver+0x19d/0x480 [ 4098.251379][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4098.251381][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4098.251383][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4098.251388][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4098.251392][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4098.251395][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4098.251404][ C2] ip_rcv+0x564/0x740 [ 4098.251406][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4098.251409][ C2] ? set_track_prepare+0x8a/0xd0 [ 4098.251413][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4098.251416][ C2] ? start_secondary+0x21c/0x2b0 [ 4098.251419][ C2] ? skb_clone+0x10b/0x330 [ 4098.251422][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4098.251428][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4098.251434][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4098.251437][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4098.251445][ C2] ? __tcf_classify+0x329/0x7d0 [ 4098.251449][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4098.251451][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4098.251454][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4098.251458][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4098.251462][ C2] ? lock_acquire+0x1c1/0x220 [ 4098.251464][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4098.251468][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4098.251471][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4098.251475][ C2] ? __copy_skb_header+0xaf/0x490 [ 4098.251479][ C2] ? __skb_clone+0x57a/0x760 [ 4098.251481][ C2] netif_receive_skb+0x55/0x280 [ 4098.251484][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4098.251491][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4098.251498][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4098.251504][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4098.251509][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4098.251519][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4098.251526][ C2] ? get_stack_info+0x36/0xc0 [ 4098.251531][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4098.251533][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4098.251537][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4098.251540][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4098.251543][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4098.251545][ C2] ? kernel_text_address+0x17/0xe0 [ 4098.251549][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4098.251553][ C2] ? arch_stack_walk+0x8c/0x100 [ 4098.251556][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4098.251559][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4098.251562][ C2] ? lock_acquire+0x1c1/0x220 [ 4098.251565][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4098.251569][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4098.251573][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4098.251576][ C2] ? get_stack_info+0x36/0xc0 [ 4098.251580][ C2] __tcf_classify+0x329/0x7d0 [ 4098.251585][ C2] tcf_classify+0x283/0x930 [ 4098.251590][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4098.251593][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4098.251597][ C2] tc_run+0x2e4/0x5d0 [ 4098.251601][ C2] ? __pfx_tc_run+0x10/0x10 [ 4098.251604][ C2] ? lock_acquire+0x1c1/0x220 [ 4098.251606][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4098.251610][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4098.251614][ C2] ? lock_acquire+0x1c1/0x220 [ 4098.251617][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4098.251620][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4098.251622][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4098.251625][ C2] ? neigh_hh_output+0x348/0x590 [ 4098.251629][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4098.251632][ C2] ip_finish_output2+0x786/0x18e0 [ 4098.251636][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4098.251644][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4098.251646][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4098.251650][ C2] ? __ip_finish_output+0x10f/0x770 [ 4098.251654][ C2] ip_output+0x16b/0x4f0 [ 4098.251657][ C2] ? __pfx_ip_output+0x10/0x10 [ 4098.251659][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4098.251662][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4098.251665][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4098.251668][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4098.251671][ C2] ? __alloc_skb+0xd4/0x280 [ 4098.251673][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4098.251677][ C2] ? tcp_fragment+0x168/0x1040 [ 4098.251680][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4098.251683][ C2] ? ip_local_out+0x114/0x3b0 [ 4098.251687][ C2] __ip_queue_xmit+0x672/0x1910 [ 4098.251690][ C2] ? __skb_clone+0x57a/0x760 [ 4098.251693][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4098.251698][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4098.251701][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4098.251705][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4098.251709][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4098.251713][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4098.251715][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4098.251719][ C2] tcp_send_loss_probe+0x348/0x830 [ 4098.251722][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4098.251724][ C2] tcp_write_timer+0x82/0x1d0 [ 4098.251728][ C2] call_timer_fn+0x173/0x430 [ 4098.251732][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4098.251736][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4098.251741][ C2] __run_timers.part.0+0x52d/0x890 [ 4098.251743][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4098.251748][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4098.251751][ C2] ? lock_acquire+0x1c1/0x220 [ 4098.251753][ C2] ? clockevents_program_event+0xf6/0x300 [ 4098.251757][ C2] ? lock_release+0x1d5/0x250 [ 4098.251759][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4098.251763][ C2] ? ktime_get+0xb3/0x190 [ 4098.251766][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4098.251770][ C2] run_timer_softirq+0x72/0x100 [ 4098.251774][ C2] __do_softirq+0x1b9/0x7ff [ 4098.251778][ C2] irq_exit_rcu+0x98/0xc0 [ 4098.251781][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4098.251784][ C2] [ 4098.251785][ C2] [ 4098.251787][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4098.251790][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4098.251794][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4098.251796][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4098.251798][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4098.251799][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4098.251801][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4098.251802][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4098.251804][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4098.251807][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4098.251810][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4098.251813][ C2] default_idle_call+0x69/0xa0 [ 4098.251816][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4098.251819][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4098.251822][ C2] ? lock_release+0x1d5/0x250 [ 4098.251825][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4098.251828][ C2] do_idle+0xfb/0x160 [ 4098.251831][ C2] cpu_startup_entry+0x55/0x60 [ 4098.251833][ C2] start_secondary+0x21c/0x2b0 [ 4098.251837][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4098.251841][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4098.251846][ C2] [ 4124.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1650s! [perl:4135] [ 4124.569699][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4124.570956][ C1] irq event stamp: 209232 [ 4124.571176][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4124.571704][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4124.572183][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4124.572653][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4124.573115][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4124.573563][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4124.574176][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4124.574501][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4124.575469][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4124.575775][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4124.576175][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4124.576572][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4124.576969][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4124.577367][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4124.577767][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4124.578215][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4124.578547][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4124.578946][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4124.579350][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4124.579749][ C1] PKRU: 55555554 [ 4124.579931][ C1] Call Trace: [ 4124.580100][ C1] [ 4124.580250][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4124.580512][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4124.580755][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4124.581031][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4124.581303][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4124.581592][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4124.581856][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4124.582161][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4124.582423][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4124.582731][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4124.583026][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4124.583341][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4124.583627][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4124.583923][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4124.584215][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4124.584525][ C1] ? get_stack_info+0x36/0xc0 [ 4124.584766][ C1] ? lock_acquire+0x1c1/0x220 [ 4124.585007][ C1] ? lock_release+0x1d5/0x250 [ 4124.585246][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4124.585494][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4124.585768][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4124.586051][ C1] ? lock_acquire+0x1c1/0x220 [ 4124.586290][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4124.586531][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4124.586790][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4124.587023][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4124.587270][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4124.587527][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4124.587804][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4124.588082][ C1] ip_local_deliver+0x19d/0x480 [ 4124.588329][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4124.588599][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4124.588862][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4124.589211][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4124.589463][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4124.589783][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4124.590044][ C1] ip_rcv+0x564/0x740 [ 4124.590249][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4124.590479][ C1] ? set_track_prepare+0x8a/0xd0 [ 4124.590731][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4124.591005][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4124.591285][ C1] ? skb_clone+0x10b/0x330 [ 4124.591510][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4124.591828][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4124.592133][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4124.592413][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4124.592709][ C1] ? __tcf_classify+0x329/0x7d0 [ 4124.592957][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4124.593185][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4124.593485][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4124.593767][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4124.594093][ C1] ? lock_acquire+0x1c1/0x220 [ 4124.594331][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4124.594628][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4124.594914][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4124.595231][ C1] ? __copy_skb_header+0xaf/0x490 [ 4124.595487][ C1] ? __skb_clone+0x57a/0x760 [ 4124.595722][ C1] netif_receive_skb+0x55/0x280 [ 4124.595970][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4124.596282][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4124.596613][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4124.596910][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4124.597185][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4124.597473][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4124.597785][ C1] ? hlock_class+0x4e/0x130 [ 4124.598015][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4124.598293][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4124.598568][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4124.598831][ C1] ? hlock_class+0x4e/0x130 [ 4124.599063][ C1] ? mark_lock+0x38/0x3e0 [ 4124.599287][ C1] ? stack_access_ok+0xda/0x1f0 [ 4124.599535][ C1] ? __lock_acquire+0xb67/0x1610 [ 4124.599787][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4124.600062][ C1] ? get_stack_info+0x36/0xc0 [ 4124.600305][ C1] ? stack_access_ok+0xda/0x1f0 [ 4124.600551][ C1] ? get_reg+0x119/0x190 [ 4124.600766][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4124.601034][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4124.601342][ C1] __tcf_classify+0x329/0x7d0 [ 4124.601583][ C1] tcf_classify+0x283/0x930 [ 4124.601816][ C1] ? arch_stack_walk+0xa2/0x100 [ 4124.602064][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4124.602320][ C1] ? get_stack_info+0x36/0xc0 [ 4124.602558][ C1] tc_run+0x2e4/0x5d0 [ 4124.602764][ C1] ? __pfx_tc_run+0x10/0x10 [ 4124.602995][ C1] ? lock_acquire+0x1c1/0x220 [ 4124.603234][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4124.603495][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4124.603748][ C1] ? lock_acquire+0x1c1/0x220 [ 4124.603986][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4124.604251][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4124.604554][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4124.604826][ C1] ? neigh_hh_output+0x348/0x590 [ 4124.605079][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4124.605344][ C1] ip_finish_output2+0x786/0x18e0 [ 4124.605599][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4124.605876][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4124.606211][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4124.606488][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4124.606741][ C1] ? __ip_finish_output+0x10f/0x770 [ 4124.607006][ C1] ip_output+0x16b/0x4f0 [ 4124.607222][ C1] ? run_timer_softirq+0x72/0x100 [ 4124.607479][ C1] ? __pfx_ip_output+0x10/0x10 [ 4124.607722][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4124.608007][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4124.608259][ C1] ? ip_local_out+0x114/0x3b0 [ 4124.608500][ C1] __ip_queue_xmit+0x672/0x1910 [ 4124.608749][ C1] ? __create_object+0x5e/0xb0 [ 4124.608993][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4124.609267][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4124.609547][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4124.609820][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4124.610103][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4124.610374][ C1] tcp_delack_timer+0x84/0x240 [ 4124.610618][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4124.610890][ C1] call_timer_fn+0x173/0x430 [ 4124.611126][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4124.611389][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4124.611649][ C1] __run_timers.part.0+0x52d/0x890 [ 4124.611909][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4124.612181][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4124.612467][ C1] ? lock_acquire+0x1c1/0x220 [ 4124.612704][ C1] ? clockevents_program_event+0xf6/0x300 [ 4124.612994][ C1] ? lock_release+0x1d5/0x250 [ 4124.613233][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4124.613497][ C1] ? ktime_get+0xb3/0x190 [ 4124.613716][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4124.614014][ C1] run_timer_softirq+0x72/0x100 [ 4124.614262][ C1] __do_softirq+0x1b9/0x7ff [ 4124.614492][ C1] irq_exit_rcu+0x98/0xc0 [ 4124.614714][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4124.614999][ C1] [ 4124.615151][ C1] [ 4124.615301][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4124.615606][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4124.615930][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4124.616897][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4124.617207][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4124.617605][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4124.618001][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4124.618399][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4124.618798][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4124.619202][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4124.619498][ C1] pipe_read+0xa16/0xdf0 [ 4124.619718][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4124.619994][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4124.620238][ C1] ? iterate_tty_write+0x299/0x540 [ 4124.620501][ C1] ? lock_release+0x1d5/0x250 [ 4124.620742][ C1] vfs_read+0x911/0xc00 [ 4124.620954][ C1] ? lock_acquire+0x1c1/0x220 [ 4124.621193][ C1] ? __might_fault+0xc6/0x180 [ 4124.621434][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4124.621672][ C1] ? __might_fault+0xc6/0x180 [ 4124.621909][ C1] ? lock_release+0x1d5/0x250 [ 4124.622149][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4124.622413][ C1] ? __fget_light+0x54/0x1e0 [ 4124.622650][ C1] ksys_read+0x17a/0x1e0 [ 4124.622866][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4124.623111][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4124.623415][ C1] do_syscall_64+0xc9/0x1e0 [ 4124.623649][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4124.623950][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4124.624179][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4124.625154][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4124.625573][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4124.625974][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4124.626373][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4124.626771][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4124.627169][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4124.627573][ C1] [ 4124.627729][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1650s! [swapper/2:0] [ 4124.628172][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4124.629434][ C2] irq event stamp: 44114564 [ 4124.629666][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4124.630204][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4124.630715][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4124.631187][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4124.631645][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4124.632090][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4124.632694][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4124.633011][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4124.633957][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4124.634259][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4124.634647][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4124.635034][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4124.635425][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4124.635814][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4124.636204][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4124.636639][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4124.636962][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4124.637355][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4124.637746][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4124.638135][ C2] PKRU: 55555554 [ 4124.638313][ C2] Call Trace: [ 4124.638481][ C2] [ 4124.638626][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4124.638883][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4124.639123][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4124.639427][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4124.639698][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4124.639990][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4124.640255][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4124.640574][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4124.640833][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4124.641090][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4124.641395][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4124.641683][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4124.641989][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4124.642274][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4124.642560][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4124.642842][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4124.643148][ C2] ? get_stack_info+0x36/0xc0 [ 4124.643382][ C2] ? lock_acquire+0x1c1/0x220 [ 4124.643616][ C2] ? lock_release+0x1d5/0x250 [ 4124.643850][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4124.644092][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4124.644358][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4124.644635][ C2] ? lock_acquire+0x1c1/0x220 [ 4124.644866][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4124.645102][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4124.645356][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4124.645585][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4124.645826][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4124.646076][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4124.646347][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4124.646617][ C2] ip_local_deliver+0x19d/0x480 [ 4124.646857][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4124.647121][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4124.647377][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4124.647718][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4124.647964][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4124.648277][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4124.648534][ C2] ip_rcv+0x564/0x740 [ 4124.648732][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4124.648957][ C2] ? set_track_prepare+0x8a/0xd0 [ 4124.649231][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4124.649508][ C2] ? start_secondary+0x21c/0x2b0 [ 4124.649759][ C2] ? skb_clone+0x10b/0x330 [ 4124.649985][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4124.650305][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4124.650615][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4124.650889][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4124.651202][ C2] ? __tcf_classify+0x329/0x7d0 [ 4124.651462][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4124.651687][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4124.651979][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4124.652257][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4124.652574][ C2] ? lock_acquire+0x1c1/0x220 [ 4124.652804][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4124.653093][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4124.653370][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4124.653678][ C2] ? __copy_skb_header+0xaf/0x490 [ 4124.653928][ C2] ? __skb_clone+0x57a/0x760 [ 4124.654158][ C2] netif_receive_skb+0x55/0x280 [ 4124.654400][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4124.654704][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4124.655027][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4124.655318][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4124.655587][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4124.655867][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4124.656172][ C2] ? get_stack_info+0x36/0xc0 [ 4124.656406][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4124.656663][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4124.656973][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4124.657242][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4124.657510][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4124.657816][ C2] ? kernel_text_address+0x17/0xe0 [ 4124.658069][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4124.658375][ C2] ? arch_stack_walk+0x8c/0x100 [ 4124.658617][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4124.658874][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4124.659170][ C2] ? lock_acquire+0x1c1/0x220 [ 4124.659419][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4124.659704][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4124.660008][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4124.660286][ C2] ? get_stack_info+0x36/0xc0 [ 4124.660534][ C2] __tcf_classify+0x329/0x7d0 [ 4124.660767][ C2] tcf_classify+0x283/0x930 [ 4124.660995][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4124.661245][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4124.661551][ C2] tc_run+0x2e4/0x5d0 [ 4124.661750][ C2] ? __pfx_tc_run+0x10/0x10 [ 4124.661975][ C2] ? lock_acquire+0x1c1/0x220 [ 4124.662205][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4124.662459][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4124.662705][ C2] ? lock_acquire+0x1c1/0x220 [ 4124.662938][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4124.663195][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4124.663490][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4124.663754][ C2] ? neigh_hh_output+0x348/0x590 [ 4124.663998][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4124.664256][ C2] ip_finish_output2+0x786/0x18e0 [ 4124.664505][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4124.664834][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4124.665103][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4124.665350][ C2] ? __ip_finish_output+0x10f/0x770 [ 4124.665607][ C2] ip_output+0x16b/0x4f0 [ 4124.665816][ C2] ? __pfx_ip_output+0x10/0x10 [ 4124.666057][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4124.666326][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4124.666629][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4124.666898][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4124.667143][ C2] ? __alloc_skb+0xd4/0x280 [ 4124.667367][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4124.667628][ C2] ? tcp_fragment+0x168/0x1040 [ 4124.667866][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4124.668110][ C2] ? ip_local_out+0x114/0x3b0 [ 4124.668345][ C2] __ip_queue_xmit+0x672/0x1910 [ 4124.668587][ C2] ? __skb_clone+0x57a/0x760 [ 4124.668813][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4124.669074][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4124.669382][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4124.669627][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4124.669876][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4124.670177][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4124.670501][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4124.670738][ C2] tcp_send_loss_probe+0x348/0x830 [ 4124.670991][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4124.671253][ C2] tcp_write_timer+0x82/0x1d0 [ 4124.671491][ C2] call_timer_fn+0x173/0x430 [ 4124.671723][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4124.671978][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4124.672234][ C2] __run_timers.part.0+0x52d/0x890 [ 4124.672490][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4124.672752][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4124.673029][ C2] ? lock_acquire+0x1c1/0x220 [ 4124.673260][ C2] ? clockevents_program_event+0xf6/0x300 [ 4124.673544][ C2] ? lock_release+0x1d5/0x250 [ 4124.673775][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4124.674033][ C2] ? ktime_get+0xb3/0x190 [ 4124.674248][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4124.674537][ C2] run_timer_softirq+0x72/0x100 [ 4124.674779][ C2] __do_softirq+0x1b9/0x7ff [ 4124.675003][ C2] irq_exit_rcu+0x98/0xc0 [ 4124.675221][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4124.675497][ C2] [ 4124.675643][ C2] [ 4124.675790][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4124.676087][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4124.676339][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4124.677286][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4124.677586][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4124.677975][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4124.678363][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4124.678748][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4124.679155][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4124.679563][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4124.679851][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4124.680112][ C2] default_idle_call+0x69/0xa0 [ 4124.680356][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4124.680618][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4124.680886][ C2] ? lock_release+0x1d5/0x250 [ 4124.681121][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4124.681386][ C2] do_idle+0xfb/0x160 [ 4124.681585][ C2] cpu_startup_entry+0x55/0x60 [ 4124.681820][ C2] start_secondary+0x21c/0x2b0 [ 4124.682057][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4124.682318][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4124.682621][ C2] [ 4152.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1676s! [perl:4135] [ 4152.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4152.570955][ C1] irq event stamp: 209232 [ 4152.571172][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4152.571701][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4152.572178][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4152.572645][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4152.573106][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4152.573553][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4152.574165][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4152.574488][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4152.575454][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4152.575761][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4152.576159][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4152.576558][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4152.576956][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4152.577354][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4152.577751][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4152.578198][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4152.578534][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4152.578935][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4152.579336][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4152.579733][ C1] PKRU: 55555554 [ 4152.579915][ C1] Call Trace: [ 4152.580086][ C1] [ 4152.580233][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4152.580494][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4152.580737][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4152.581011][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4152.581286][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4152.581573][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4152.581837][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4152.582144][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4152.582405][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4152.582713][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4152.583009][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4152.583321][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4152.583611][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4152.583905][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4152.584193][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4152.584506][ C1] ? get_stack_info+0x36/0xc0 [ 4152.584747][ C1] ? lock_acquire+0x1c1/0x220 [ 4152.584985][ C1] ? lock_release+0x1d5/0x250 [ 4152.585226][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4152.585474][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4152.585744][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4152.586031][ C1] ? lock_acquire+0x1c1/0x220 [ 4152.586268][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4152.586507][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4152.586766][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4152.587002][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4152.587249][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4152.587507][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4152.587783][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4152.588058][ C1] ip_local_deliver+0x19d/0x480 [ 4152.588305][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4152.588575][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4152.588839][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4152.589189][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4152.589441][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4152.589760][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4152.590024][ C1] ip_rcv+0x564/0x740 [ 4152.590226][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4152.590457][ C1] ? set_track_prepare+0x8a/0xd0 [ 4152.590711][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4152.590986][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4152.591257][ C1] ? skb_clone+0x10b/0x330 [ 4152.591485][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4152.591805][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4152.592114][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4152.592397][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4152.592690][ C1] ? __tcf_classify+0x329/0x7d0 [ 4152.592938][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4152.593168][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4152.593466][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4152.593751][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4152.594075][ C1] ? lock_acquire+0x1c1/0x220 [ 4152.594315][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4152.594609][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4152.594896][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4152.595212][ C1] ? __copy_skb_header+0xaf/0x490 [ 4152.595470][ C1] ? __skb_clone+0x57a/0x760 [ 4152.595703][ C1] netif_receive_skb+0x55/0x280 [ 4152.595950][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4152.596263][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4152.596594][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4152.596894][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4152.597168][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4152.597456][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4152.597767][ C1] ? hlock_class+0x4e/0x130 [ 4152.598001][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4152.598274][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4152.598550][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4152.598813][ C1] ? hlock_class+0x4e/0x130 [ 4152.599046][ C1] ? mark_lock+0x38/0x3e0 [ 4152.599267][ C1] ? stack_access_ok+0xda/0x1f0 [ 4152.599515][ C1] ? __lock_acquire+0xb67/0x1610 [ 4152.599767][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4152.600042][ C1] ? get_stack_info+0x36/0xc0 [ 4152.600283][ C1] ? stack_access_ok+0xda/0x1f0 [ 4152.600529][ C1] ? get_reg+0x119/0x190 [ 4152.600745][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4152.601011][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4152.601320][ C1] __tcf_classify+0x329/0x7d0 [ 4152.601563][ C1] tcf_classify+0x283/0x930 [ 4152.601793][ C1] ? arch_stack_walk+0xa2/0x100 [ 4152.602041][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4152.602297][ C1] ? get_stack_info+0x36/0xc0 [ 4152.602537][ C1] tc_run+0x2e4/0x5d0 [ 4152.602742][ C1] ? __pfx_tc_run+0x10/0x10 [ 4152.602973][ C1] ? lock_acquire+0x1c1/0x220 [ 4152.603211][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4152.603471][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4152.603724][ C1] ? lock_acquire+0x1c1/0x220 [ 4152.603962][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4152.604224][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4152.604529][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4152.604799][ C1] ? neigh_hh_output+0x348/0x590 [ 4152.605052][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4152.605315][ C1] ip_finish_output2+0x786/0x18e0 [ 4152.605571][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4152.605849][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4152.606186][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4152.606459][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4152.606712][ C1] ? __ip_finish_output+0x10f/0x770 [ 4152.606975][ C1] ip_output+0x16b/0x4f0 [ 4152.607193][ C1] ? run_timer_softirq+0x72/0x100 [ 4152.607448][ C1] ? __pfx_ip_output+0x10/0x10 [ 4152.607690][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4152.607976][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4152.608232][ C1] ? ip_local_out+0x114/0x3b0 [ 4152.608472][ C1] __ip_queue_xmit+0x672/0x1910 [ 4152.608720][ C1] ? __create_object+0x5e/0xb0 [ 4152.608963][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4152.609234][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4152.609518][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4152.609789][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4152.610069][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4152.610348][ C1] tcp_delack_timer+0x84/0x240 [ 4152.610591][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4152.610863][ C1] call_timer_fn+0x173/0x430 [ 4152.611097][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4152.611359][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4152.611621][ C1] __run_timers.part.0+0x52d/0x890 [ 4152.611882][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4152.612156][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4152.612439][ C1] ? lock_acquire+0x1c1/0x220 [ 4152.612678][ C1] ? clockevents_program_event+0xf6/0x300 [ 4152.612971][ C1] ? lock_release+0x1d5/0x250 [ 4152.613209][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4152.613473][ C1] ? ktime_get+0xb3/0x190 [ 4152.613696][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4152.613992][ C1] run_timer_softirq+0x72/0x100 [ 4152.614239][ C1] __do_softirq+0x1b9/0x7ff [ 4152.614473][ C1] irq_exit_rcu+0x98/0xc0 [ 4152.614692][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4152.614978][ C1] [ 4152.615128][ C1] [ 4152.615280][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4152.615582][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4152.615909][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4152.616879][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4152.617185][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4152.617586][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4152.617983][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4152.618381][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4152.618779][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4152.619186][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4152.619481][ C1] pipe_read+0xa16/0xdf0 [ 4152.619702][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4152.619978][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4152.620222][ C1] ? iterate_tty_write+0x299/0x540 [ 4152.620483][ C1] ? lock_release+0x1d5/0x250 [ 4152.620725][ C1] vfs_read+0x911/0xc00 [ 4152.620940][ C1] ? lock_acquire+0x1c1/0x220 [ 4152.621179][ C1] ? __might_fault+0xc6/0x180 [ 4152.621417][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4152.621657][ C1] ? __might_fault+0xc6/0x180 [ 4152.621897][ C1] ? lock_release+0x1d5/0x250 [ 4152.622136][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4152.622401][ C1] ? __fget_light+0x54/0x1e0 [ 4152.622636][ C1] ksys_read+0x17a/0x1e0 [ 4152.622855][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4152.623099][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4152.623401][ C1] do_syscall_64+0xc9/0x1e0 [ 4152.623635][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4152.623938][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4152.624166][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4152.625135][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4152.625557][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4152.625954][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4152.626352][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4152.626752][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4152.627149][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4152.627550][ C1] [ 4152.627712][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1676s! [swapper/2:0] [ 4152.628174][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4152.629445][ C2] irq event stamp: 44114564 [ 4152.629676][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4152.630217][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4152.630728][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4152.631206][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4152.631678][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4152.632138][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4152.632748][ C2] RIP: 0010:__kasan_check_read+0x8/0x20 [ 4152.633035][ C2] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 4152.634006][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 4152.634315][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4152.634715][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4152.635113][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4152.635509][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4152.635909][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4152.636309][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4152.636756][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4152.637088][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4152.637488][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4152.637889][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4152.638288][ C2] PKRU: 55555554 [ 4152.638471][ C2] Call Trace: [ 4152.638640][ C2] [ 4152.638792][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4152.639063][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4152.639308][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4152.639584][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4152.639857][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4152.640147][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4152.640414][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4152.640722][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4152.640983][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4152.641247][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4152.641556][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4152.641852][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4152.642170][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4152.642459][ C2] ? __kasan_check_read+0x8/0x20 [ 4152.642713][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4152.642996][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4152.643308][ C2] ? get_stack_info+0x36/0xc0 [ 4152.643549][ C2] ? lock_acquire+0x1c1/0x220 [ 4152.643789][ C2] ? lock_release+0x1d5/0x250 [ 4152.644030][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4152.644282][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4152.644553][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4152.644839][ C2] ? lock_acquire+0x1c1/0x220 [ 4152.645078][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4152.645321][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4152.645581][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4152.645818][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4152.646064][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4152.646324][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4152.646602][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4152.646878][ C2] ip_local_deliver+0x19d/0x480 [ 4152.647127][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4152.647398][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4152.647661][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4152.648011][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4152.648266][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4152.648585][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4152.648847][ C2] ip_rcv+0x564/0x740 [ 4152.649058][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4152.649289][ C2] ? set_track_prepare+0x8a/0xd0 [ 4152.649543][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4152.649820][ C2] ? start_secondary+0x21c/0x2b0 [ 4152.650071][ C2] ? skb_clone+0x10b/0x330 [ 4152.650303][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4152.650624][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4152.650930][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4152.651211][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4152.651509][ C2] ? __tcf_classify+0x329/0x7d0 [ 4152.651758][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4152.651985][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4152.652286][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4152.652570][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4152.652895][ C2] ? lock_acquire+0x1c1/0x220 [ 4152.653133][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4152.653431][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4152.653715][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4152.654031][ C2] ? __copy_skb_header+0xaf/0x490 [ 4152.654290][ C2] ? __skb_clone+0x57a/0x760 [ 4152.654524][ C2] netif_receive_skb+0x55/0x280 [ 4152.654773][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4152.655086][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4152.655419][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4152.655715][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4152.655991][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4152.656278][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4152.656590][ C2] ? get_stack_info+0x36/0xc0 [ 4152.656831][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4152.657095][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4152.657413][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4152.657687][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4152.657962][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4152.658278][ C2] ? kernel_text_address+0x17/0xe0 [ 4152.658538][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4152.658850][ C2] ? arch_stack_walk+0x8c/0x100 [ 4152.659107][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4152.659371][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4152.659657][ C2] ? lock_acquire+0x1c1/0x220 [ 4152.659893][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4152.660180][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4152.660482][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4152.660760][ C2] ? get_stack_info+0x36/0xc0 [ 4152.660999][ C2] __tcf_classify+0x329/0x7d0 [ 4152.661240][ C2] tcf_classify+0x283/0x930 [ 4152.661473][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4152.661729][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4152.662043][ C2] tc_run+0x2e4/0x5d0 [ 4152.662250][ C2] ? __pfx_tc_run+0x10/0x10 [ 4152.662481][ C2] ? lock_acquire+0x1c1/0x220 [ 4152.662719][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4152.662979][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4152.663234][ C2] ? lock_acquire+0x1c1/0x220 [ 4152.663473][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4152.663737][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4152.664041][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4152.664314][ C2] ? neigh_hh_output+0x348/0x590 [ 4152.664565][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4152.664828][ C2] ip_finish_output2+0x786/0x18e0 [ 4152.665084][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4152.665423][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4152.665699][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4152.665952][ C2] ? __ip_finish_output+0x10f/0x770 [ 4152.666216][ C2] ip_output+0x16b/0x4f0 [ 4152.666432][ C2] ? __pfx_ip_output+0x10/0x10 [ 4152.666675][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4152.666950][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4152.667265][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4152.667542][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4152.667792][ C2] ? __alloc_skb+0xd4/0x280 [ 4152.668024][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4152.668295][ C2] ? tcp_fragment+0x168/0x1040 [ 4152.668539][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4152.668790][ C2] ? ip_local_out+0x114/0x3b0 [ 4152.669039][ C2] __ip_queue_xmit+0x672/0x1910 [ 4152.669290][ C2] ? __skb_clone+0x57a/0x760 [ 4152.669521][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4152.669788][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4152.670067][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4152.670313][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4152.670561][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4152.670861][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4152.671180][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4152.671423][ C2] tcp_send_loss_probe+0x348/0x830 [ 4152.671683][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4152.671948][ C2] tcp_write_timer+0x82/0x1d0 [ 4152.672190][ C2] call_timer_fn+0x173/0x430 [ 4152.672426][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4152.672687][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4152.672947][ C2] __run_timers.part.0+0x52d/0x890 [ 4152.673207][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4152.673477][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4152.673762][ C2] ? lock_acquire+0x1c1/0x220 [ 4152.673999][ C2] ? clockevents_program_event+0xf6/0x300 [ 4152.674292][ C2] ? lock_release+0x1d5/0x250 [ 4152.674530][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4152.674795][ C2] ? ktime_get+0xb3/0x190 [ 4152.675015][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4152.675314][ C2] run_timer_softirq+0x72/0x100 [ 4152.675562][ C2] __do_softirq+0x1b9/0x7ff [ 4152.675796][ C2] irq_exit_rcu+0x98/0xc0 [ 4152.676018][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4152.676304][ C2] [ 4152.676456][ C2] [ 4152.676606][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4152.676912][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4152.677171][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4152.678141][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4152.678449][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4152.678848][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4152.679264][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4152.679663][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4152.680063][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4152.680464][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4152.680752][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4152.681012][ C2] default_idle_call+0x69/0xa0 [ 4152.681258][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4152.681508][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4152.681784][ C2] ? lock_release+0x1d5/0x250 [ 4152.682021][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4152.682295][ C2] do_idle+0xfb/0x160 [ 4152.682499][ C2] cpu_startup_entry+0x55/0x60 [ 4152.682740][ C2] start_secondary+0x21c/0x2b0 [ 4152.682983][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4152.683254][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4152.683565][ C2] [ 4176.252103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4176.252478][ C1] rcu: 1-....: (1817119 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=439635 [ 4176.253032][ C1] rcu: (t=1821365 jiffies g=1882453 q=706 ncpus=4) [ 4176.253365][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4176.253810][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4176.254425][ C1] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 4176.254709][ C1] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 4176.255672][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000246 [ 4176.255980][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4176.256376][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4176.256776][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4176.257173][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4176.257570][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4176.257966][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4176.258412][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4176.258747][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4176.259155][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4176.259551][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4176.259949][ C1] PKRU: 55555554 [ 4176.260130][ C1] Call Trace: [ 4176.260303][ C1] [ 4176.260449][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4176.260723][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4176.260974][ C1] ? check_cpu_stall+0x284/0x500 [ 4176.261224][ C1] ? rcu_pending+0x92/0x360 [ 4176.261455][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4176.261724][ C1] ? update_process_times+0xb9/0x110 [ 4176.261994][ C1] ? tick_sched_handle+0x67/0x130 [ 4176.262250][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4176.262535][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4176.262777][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4176.263088][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4176.263361][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4176.263647][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4176.263915][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4176.264222][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4176.264483][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4176.264792][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4176.265088][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4176.265404][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4176.265692][ C1] ? kasan_check_range+0x4/0x1c0 [ 4176.265943][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4176.266223][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4176.266535][ C1] ? get_stack_info+0x36/0xc0 [ 4176.266776][ C1] ? lock_acquire+0x1c1/0x220 [ 4176.267017][ C1] ? lock_release+0x1d5/0x250 [ 4176.267255][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4176.267502][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4176.267775][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4176.268058][ C1] ? lock_acquire+0x1c1/0x220 [ 4176.268297][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4176.268536][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4176.268796][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4176.269033][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4176.269279][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4176.269536][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4176.269811][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4176.270091][ C1] ip_local_deliver+0x19d/0x480 [ 4176.270336][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4176.270607][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4176.270871][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4176.271215][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4176.271468][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4176.271786][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4176.272051][ C1] ip_rcv+0x564/0x740 [ 4176.272254][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4176.272484][ C1] ? set_track_prepare+0x8a/0xd0 [ 4176.272737][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4176.273013][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4176.273285][ C1] ? skb_clone+0x10b/0x330 [ 4176.273514][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4176.273833][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4176.274139][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4176.274419][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4176.274714][ C1] ? __tcf_classify+0x329/0x7d0 [ 4176.274962][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4176.275191][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4176.275491][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4176.275775][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4176.276105][ C1] ? lock_acquire+0x1c1/0x220 [ 4176.276344][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4176.276639][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4176.276922][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4176.277238][ C1] ? __copy_skb_header+0xaf/0x490 [ 4176.277494][ C1] ? __skb_clone+0x57a/0x760 [ 4176.277728][ C1] netif_receive_skb+0x55/0x280 [ 4176.277976][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4176.278288][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4176.278619][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4176.278917][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4176.279194][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4176.279484][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4176.279796][ C1] ? hlock_class+0x4e/0x130 [ 4176.280026][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4176.280302][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4176.280577][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4176.280839][ C1] ? hlock_class+0x4e/0x130 [ 4176.281070][ C1] ? mark_lock+0x38/0x3e0 [ 4176.281288][ C1] ? stack_access_ok+0xda/0x1f0 [ 4176.281537][ C1] ? __lock_acquire+0xb67/0x1610 [ 4176.281789][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4176.282063][ C1] ? get_stack_info+0x36/0xc0 [ 4176.282303][ C1] ? stack_access_ok+0xda/0x1f0 [ 4176.282550][ C1] ? get_reg+0x119/0x190 [ 4176.282764][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4176.283031][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4176.283339][ C1] __tcf_classify+0x329/0x7d0 [ 4176.283582][ C1] tcf_classify+0x283/0x930 [ 4176.283813][ C1] ? arch_stack_walk+0xa2/0x100 [ 4176.284062][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4176.284319][ C1] ? get_stack_info+0x36/0xc0 [ 4176.284559][ C1] tc_run+0x2e4/0x5d0 [ 4176.284762][ C1] ? __pfx_tc_run+0x10/0x10 [ 4176.284994][ C1] ? lock_acquire+0x1c1/0x220 [ 4176.285233][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4176.285496][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4176.285749][ C1] ? lock_acquire+0x1c1/0x220 [ 4176.285987][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4176.286252][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4176.286554][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4176.286828][ C1] ? neigh_hh_output+0x348/0x590 [ 4176.287079][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4176.287347][ C1] ip_finish_output2+0x786/0x18e0 [ 4176.287602][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4176.287879][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4176.288215][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4176.288491][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4176.288742][ C1] ? __ip_finish_output+0x10f/0x770 [ 4176.289014][ C1] ip_output+0x16b/0x4f0 [ 4176.289230][ C1] ? run_timer_softirq+0x72/0x100 [ 4176.289486][ C1] ? __pfx_ip_output+0x10/0x10 [ 4176.289729][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4176.290014][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4176.290265][ C1] ? ip_local_out+0x114/0x3b0 [ 4176.290505][ C1] __ip_queue_xmit+0x672/0x1910 [ 4176.290754][ C1] ? __create_object+0x5e/0xb0 [ 4176.290997][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4176.291263][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4176.291543][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4176.291814][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4176.292097][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4176.292367][ C1] tcp_delack_timer+0x84/0x240 [ 4176.292612][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4176.292881][ C1] call_timer_fn+0x173/0x430 [ 4176.293119][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4176.293380][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4176.293641][ C1] __run_timers.part.0+0x52d/0x890 [ 4176.293900][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4176.294173][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4176.294457][ C1] ? lock_acquire+0x1c1/0x220 [ 4176.294693][ C1] ? clockevents_program_event+0xf6/0x300 [ 4176.294985][ C1] ? lock_release+0x1d5/0x250 [ 4176.295226][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4176.295489][ C1] ? ktime_get+0xb3/0x190 [ 4176.295708][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4176.296004][ C1] run_timer_softirq+0x72/0x100 [ 4176.296252][ C1] __do_softirq+0x1b9/0x7ff [ 4176.296483][ C1] irq_exit_rcu+0x98/0xc0 [ 4176.296705][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4176.296989][ C1] [ 4176.297140][ C1] [ 4176.297290][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4176.297593][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4176.297917][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4176.298884][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4176.299197][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4176.299595][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4176.299991][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4176.300388][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4176.300789][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4176.301188][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4176.301483][ C1] pipe_read+0xa16/0xdf0 [ 4176.301706][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4176.301982][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4176.302225][ C1] ? iterate_tty_write+0x299/0x540 [ 4176.302485][ C1] ? lock_release+0x1d5/0x250 [ 4176.302726][ C1] vfs_read+0x911/0xc00 [ 4176.302937][ C1] ? lock_acquire+0x1c1/0x220 [ 4176.303176][ C1] ? __might_fault+0xc6/0x180 [ 4176.303416][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4176.303652][ C1] ? __might_fault+0xc6/0x180 [ 4176.303892][ C1] ? lock_release+0x1d5/0x250 [ 4176.304131][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4176.304395][ C1] ? __fget_light+0x54/0x1e0 [ 4176.304633][ C1] ksys_read+0x17a/0x1e0 [ 4176.304848][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4176.305092][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4176.305396][ C1] do_syscall_64+0xc9/0x1e0 [ 4176.305626][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4176.305926][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4176.306152][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4176.307119][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4176.307539][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4176.307938][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4176.308336][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4176.308733][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4176.309134][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4176.309534][ C1] [ 4176.309692][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4176.309971][ C2] NMI backtrace for cpu 2 [ 4176.309982][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4176.309990][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4176.309995][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4176.310008][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4176.310012][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4176.310016][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4176.310018][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4176.310020][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4176.310022][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4176.310024][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4176.310026][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4176.310028][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4176.310032][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4176.310034][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4176.310035][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4176.310037][ C2] PKRU: 55555554 [ 4176.310038][ C2] Call Trace: [ 4176.310042][ C2] [ 4176.310048][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4176.310056][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4176.310063][ C2] ? nmi_handle+0x153/0x420 [ 4176.310068][ C2] ? default_do_nmi+0x41/0x100 [ 4176.310072][ C2] ? exc_nmi+0xf3/0x120 [ 4176.310075][ C2] ? end_repeat_nmi+0xf/0x60 [ 4176.310082][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4176.310085][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4176.310088][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4176.310092][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4176.310095][ C2] [ 4176.310095][ C2] [ 4176.310097][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4176.310099][ C2] ? get_stack_info+0x36/0xc0 [ 4176.310104][ C2] ? lock_acquire+0x1c1/0x220 [ 4176.310109][ C2] ? lock_release+0x1d5/0x250 [ 4176.310113][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4176.310117][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4176.310120][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4176.310123][ C2] ? lock_acquire+0x1c1/0x220 [ 4176.310125][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4176.310131][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4176.310134][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4176.310141][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4176.310143][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4176.310149][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4176.310157][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4176.310160][ C2] ip_local_deliver+0x19d/0x480 [ 4176.310163][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4176.310166][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4176.310168][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4176.310175][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4176.310181][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4176.310184][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4176.310195][ C2] ip_rcv+0x564/0x740 [ 4176.310198][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4176.310200][ C2] ? set_track_prepare+0x8a/0xd0 [ 4176.310205][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4176.310209][ C2] ? start_secondary+0x21c/0x2b0 [ 4176.310213][ C2] ? skb_clone+0x10b/0x330 [ 4176.310219][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4176.310225][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4176.310231][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4176.310237][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4176.310247][ C2] ? __tcf_classify+0x329/0x7d0 [ 4176.310251][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4176.310253][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4176.310257][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4176.310261][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4176.310265][ C2] ? lock_acquire+0x1c1/0x220 [ 4176.310267][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4176.310272][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4176.310276][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4176.310280][ C2] ? __copy_skb_header+0xaf/0x490 [ 4176.310286][ C2] ? __skb_clone+0x57a/0x760 [ 4176.310288][ C2] netif_receive_skb+0x55/0x280 [ 4176.310292][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4176.310302][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4176.310308][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4176.310316][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4176.310321][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4176.310332][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4176.310339][ C2] ? get_stack_info+0x36/0xc0 [ 4176.310344][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4176.310348][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4176.310354][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4176.310356][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4176.310360][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4176.310363][ C2] ? kernel_text_address+0x17/0xe0 [ 4176.310367][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4176.310373][ C2] ? arch_stack_walk+0x8c/0x100 [ 4176.310378][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4176.310381][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4176.310384][ C2] ? lock_acquire+0x1c1/0x220 [ 4176.310387][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4176.310393][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4176.310399][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4176.310401][ C2] ? get_stack_info+0x36/0xc0 [ 4176.310405][ C2] __tcf_classify+0x329/0x7d0 [ 4176.310411][ C2] tcf_classify+0x283/0x930 [ 4176.310416][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4176.310419][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4176.310423][ C2] tc_run+0x2e4/0x5d0 [ 4176.310428][ C2] ? __pfx_tc_run+0x10/0x10 [ 4176.310432][ C2] ? lock_acquire+0x1c1/0x220 [ 4176.310434][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4176.310438][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4176.310442][ C2] ? lock_acquire+0x1c1/0x220 [ 4176.310444][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4176.310448][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4176.310451][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4176.310454][ C2] ? neigh_hh_output+0x348/0x590 [ 4176.310458][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4176.310461][ C2] ip_finish_output2+0x786/0x18e0 [ 4176.310465][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4176.310473][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4176.310476][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4176.310480][ C2] ? __ip_finish_output+0x10f/0x770 [ 4176.310483][ C2] ip_output+0x16b/0x4f0 [ 4176.310487][ C2] ? __pfx_ip_output+0x10/0x10 [ 4176.310489][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4176.310492][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4176.310496][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4176.310500][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4176.310503][ C2] ? __alloc_skb+0xd4/0x280 [ 4176.310505][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4176.310510][ C2] ? tcp_fragment+0x168/0x1040 [ 4176.310514][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4176.310517][ C2] ? ip_local_out+0x114/0x3b0 [ 4176.310521][ C2] __ip_queue_xmit+0x672/0x1910 [ 4176.310525][ C2] ? __skb_clone+0x57a/0x760 [ 4176.310527][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4176.310533][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4176.310536][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4176.310541][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4176.310546][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4176.310550][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4176.310553][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4176.310556][ C2] tcp_send_loss_probe+0x348/0x830 [ 4176.310560][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4176.310562][ C2] tcp_write_timer+0x82/0x1d0 [ 4176.310565][ C2] call_timer_fn+0x173/0x430 [ 4176.310570][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4176.310575][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4176.310579][ C2] __run_timers.part.0+0x52d/0x890 [ 4176.310582][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4176.310587][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4176.310590][ C2] ? lock_acquire+0x1c1/0x220 [ 4176.310592][ C2] ? clockevents_program_event+0xf6/0x300 [ 4176.310599][ C2] ? lock_release+0x1d5/0x250 [ 4176.310601][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4176.310606][ C2] ? ktime_get+0xb3/0x190 [ 4176.310610][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4176.310614][ C2] run_timer_softirq+0x72/0x100 [ 4176.310618][ C2] __do_softirq+0x1b9/0x7ff [ 4176.310622][ C2] irq_exit_rcu+0x98/0xc0 [ 4176.310625][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4176.310629][ C2] [ 4176.310630][ C2] [ 4176.310631][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4176.310635][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4176.310638][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4176.310641][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4176.310644][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4176.310646][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4176.310647][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4176.310649][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4176.310651][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4176.310654][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4176.310657][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4176.310661][ C2] default_idle_call+0x69/0xa0 [ 4176.310665][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4176.310667][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4176.310671][ C2] ? lock_release+0x1d5/0x250 [ 4176.310674][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4176.310678][ C2] do_idle+0xfb/0x160 [ 4176.310681][ C2] cpu_startup_entry+0x55/0x60 [ 4176.310683][ C2] start_secondary+0x21c/0x2b0 [ 4176.310686][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4176.310690][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4176.310697][ C2] [ 4200.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1721s! [perl:4135] [ 4200.569717][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4200.570981][ C1] irq event stamp: 209232 [ 4200.571198][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4200.571730][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4200.572210][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4200.572678][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4200.573141][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4200.573590][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4200.574205][ C1] RIP: 0010:kasan_check_range+0x4f/0x1c0 [ 4200.574492][ C1] Code: ff ff ff ff ff ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff <48> 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff [ 4200.575464][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000282 [ 4200.575771][ C1] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4200.576172][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4200.576572][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4200.576971][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4200.577371][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4200.577772][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4200.578220][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4200.578555][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4200.578963][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4200.579360][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4200.579761][ C1] PKRU: 55555554 [ 4200.579942][ C1] Call Trace: [ 4200.580112][ C1] [ 4200.580261][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4200.580524][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4200.580766][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4200.581046][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4200.581319][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4200.581608][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4200.581877][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4200.582182][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4200.582442][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 4200.582706][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4200.583015][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4200.583312][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4200.583628][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4200.583916][ C1] ? kasan_check_range+0x4f/0x1c0 [ 4200.584173][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4200.584457][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4200.584767][ C1] ? get_stack_info+0x36/0xc0 [ 4200.585007][ C1] ? lock_acquire+0x1c1/0x220 [ 4200.585249][ C1] ? lock_release+0x1d5/0x250 [ 4200.585492][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4200.585741][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4200.586014][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4200.586298][ C1] ? lock_acquire+0x1c1/0x220 [ 4200.586538][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4200.586782][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4200.587042][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4200.587277][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4200.587523][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4200.587782][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4200.588059][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4200.588337][ C1] ip_local_deliver+0x19d/0x480 [ 4200.588585][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4200.588860][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4200.589124][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4200.589473][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4200.589725][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4200.590046][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4200.590309][ C1] ip_rcv+0x564/0x740 [ 4200.590514][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4200.590744][ C1] ? set_track_prepare+0x8a/0xd0 [ 4200.590997][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4200.591275][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4200.591549][ C1] ? skb_clone+0x10b/0x330 [ 4200.591775][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4200.592095][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4200.592402][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4200.592685][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4200.592983][ C1] ? __tcf_classify+0x329/0x7d0 [ 4200.593234][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4200.593464][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4200.593765][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4200.594052][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4200.594378][ C1] ? lock_acquire+0x1c1/0x220 [ 4200.594615][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4200.594913][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4200.595199][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4200.595515][ C1] ? __copy_skb_header+0xaf/0x490 [ 4200.595772][ C1] ? __skb_clone+0x57a/0x760 [ 4200.596012][ C1] netif_receive_skb+0x55/0x280 [ 4200.596261][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4200.596576][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4200.596909][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4200.597210][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4200.597488][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4200.597777][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4200.598089][ C1] ? hlock_class+0x4e/0x130 [ 4200.598323][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4200.598599][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4200.598879][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4200.599142][ C1] ? hlock_class+0x4e/0x130 [ 4200.599375][ C1] ? mark_lock+0x38/0x3e0 [ 4200.599593][ C1] ? stack_access_ok+0xda/0x1f0 [ 4200.599842][ C1] ? __lock_acquire+0xb67/0x1610 [ 4200.600097][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4200.600374][ C1] ? get_stack_info+0x36/0xc0 [ 4200.600613][ C1] ? stack_access_ok+0xda/0x1f0 [ 4200.600861][ C1] ? get_reg+0x119/0x190 [ 4200.601077][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4200.601346][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4200.601655][ C1] __tcf_classify+0x329/0x7d0 [ 4200.601896][ C1] tcf_classify+0x283/0x930 [ 4200.602129][ C1] ? arch_stack_walk+0xa2/0x100 [ 4200.602378][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4200.602636][ C1] ? get_stack_info+0x36/0xc0 [ 4200.602876][ C1] tc_run+0x2e4/0x5d0 [ 4200.603082][ C1] ? __pfx_tc_run+0x10/0x10 [ 4200.603312][ C1] ? lock_acquire+0x1c1/0x220 [ 4200.603551][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4200.603813][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4200.604067][ C1] ? lock_acquire+0x1c1/0x220 [ 4200.604309][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4200.604573][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4200.604880][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4200.605151][ C1] ? neigh_hh_output+0x348/0x590 [ 4200.605408][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4200.605673][ C1] ip_finish_output2+0x786/0x18e0 [ 4200.605929][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4200.606206][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4200.606545][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4200.606821][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4200.607075][ C1] ? __ip_finish_output+0x10f/0x770 [ 4200.607340][ C1] ip_output+0x16b/0x4f0 [ 4200.607556][ C1] ? run_timer_softirq+0x72/0x100 [ 4200.607813][ C1] ? __pfx_ip_output+0x10/0x10 [ 4200.608057][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4200.608346][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4200.608598][ C1] ? ip_local_out+0x114/0x3b0 [ 4200.608841][ C1] __ip_queue_xmit+0x672/0x1910 [ 4200.609090][ C1] ? __create_object+0x5e/0xb0 [ 4200.609335][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4200.609603][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4200.609883][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4200.610159][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4200.610441][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4200.610712][ C1] tcp_delack_timer+0x84/0x240 [ 4200.610956][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4200.611228][ C1] call_timer_fn+0x173/0x430 [ 4200.611466][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4200.611728][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4200.611989][ C1] __run_timers.part.0+0x52d/0x890 [ 4200.612250][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4200.612525][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4200.612815][ C1] ? lock_acquire+0x1c1/0x220 [ 4200.613054][ C1] ? clockevents_program_event+0xf6/0x300 [ 4200.613344][ C1] ? lock_release+0x1d5/0x250 [ 4200.613583][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4200.613848][ C1] ? ktime_get+0xb3/0x190 [ 4200.614069][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4200.614365][ C1] run_timer_softirq+0x72/0x100 [ 4200.614615][ C1] __do_softirq+0x1b9/0x7ff [ 4200.614848][ C1] irq_exit_rcu+0x98/0xc0 [ 4200.615069][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4200.615356][ C1] [ 4200.615509][ C1] [ 4200.615658][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4200.615964][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4200.616289][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4200.617259][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4200.617568][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4200.617967][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4200.618365][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4200.618765][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4200.619173][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4200.619574][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4200.619872][ C1] pipe_read+0xa16/0xdf0 [ 4200.620092][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4200.620371][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4200.620614][ C1] ? iterate_tty_write+0x299/0x540 [ 4200.620875][ C1] ? lock_release+0x1d5/0x250 [ 4200.621118][ C1] vfs_read+0x911/0xc00 [ 4200.621332][ C1] ? lock_acquire+0x1c1/0x220 [ 4200.621572][ C1] ? __might_fault+0xc6/0x180 [ 4200.621813][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4200.622053][ C1] ? __might_fault+0xc6/0x180 [ 4200.622293][ C1] ? lock_release+0x1d5/0x250 [ 4200.622533][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4200.622797][ C1] ? __fget_light+0x54/0x1e0 [ 4200.623035][ C1] ksys_read+0x17a/0x1e0 [ 4200.623252][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4200.623497][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4200.623803][ C1] do_syscall_64+0xc9/0x1e0 [ 4200.624037][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4200.624336][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4200.624566][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4200.625534][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4200.625956][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4200.626357][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4200.626756][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4200.627154][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4200.627555][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4200.627957][ C1] [ 4200.628116][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1721s! [swapper/2:0] [ 4200.628598][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4200.629888][ C2] irq event stamp: 44114564 [ 4200.630120][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4200.630667][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4200.631187][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4200.631668][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4200.632144][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4200.632610][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4200.633231][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4200.633564][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4200.634551][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4200.634864][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4200.635268][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4200.635672][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4200.636075][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4200.636481][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4200.636884][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4200.637338][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4200.637675][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4200.638084][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4200.638489][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4200.638903][ C2] PKRU: 55555554 [ 4200.639087][ C2] Call Trace: [ 4200.639263][ C2] [ 4200.639415][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4200.639682][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4200.639927][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4200.640206][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4200.640484][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4200.640779][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4200.641048][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4200.641361][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4200.641627][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4200.641892][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4200.642206][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4200.642505][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4200.642822][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4200.643120][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4200.643418][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4200.643709][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4200.644024][ C2] ? get_stack_info+0x36/0xc0 [ 4200.644269][ C2] ? lock_acquire+0x1c1/0x220 [ 4200.644511][ C2] ? lock_release+0x1d5/0x250 [ 4200.644754][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4200.645006][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4200.645281][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4200.645570][ C2] ? lock_acquire+0x1c1/0x220 [ 4200.645808][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4200.646053][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4200.646317][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4200.646556][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4200.646808][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4200.647069][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4200.647350][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4200.647629][ C2] ip_local_deliver+0x19d/0x480 [ 4200.647880][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4200.648154][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4200.648421][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4200.648774][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4200.649051][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4200.649380][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4200.649647][ C2] ip_rcv+0x564/0x740 [ 4200.649853][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4200.650086][ C2] ? set_track_prepare+0x8a/0xd0 [ 4200.650346][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4200.650627][ C2] ? start_secondary+0x21c/0x2b0 [ 4200.650882][ C2] ? skb_clone+0x10b/0x330 [ 4200.651113][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4200.651441][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4200.651752][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4200.652036][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4200.652339][ C2] ? __tcf_classify+0x329/0x7d0 [ 4200.652593][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4200.652823][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4200.653130][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4200.653420][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4200.653749][ C2] ? lock_acquire+0x1c1/0x220 [ 4200.653988][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4200.654289][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4200.654578][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4200.654897][ C2] ? __copy_skb_header+0xaf/0x490 [ 4200.655157][ C2] ? __skb_clone+0x57a/0x760 [ 4200.655396][ C2] netif_receive_skb+0x55/0x280 [ 4200.655655][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4200.655976][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4200.656312][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4200.656613][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4200.656893][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4200.657190][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4200.657507][ C2] ? get_stack_info+0x36/0xc0 [ 4200.657752][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4200.658022][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4200.658343][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4200.658623][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4200.658948][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4200.659269][ C2] ? kernel_text_address+0x17/0xe0 [ 4200.659532][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4200.659850][ C2] ? arch_stack_walk+0x8c/0x100 [ 4200.660103][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4200.660376][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4200.660664][ C2] ? lock_acquire+0x1c1/0x220 [ 4200.660906][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4200.661196][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4200.661503][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4200.661786][ C2] ? get_stack_info+0x36/0xc0 [ 4200.662028][ C2] __tcf_classify+0x329/0x7d0 [ 4200.662277][ C2] tcf_classify+0x283/0x930 [ 4200.662515][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4200.662775][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4200.663091][ C2] tc_run+0x2e4/0x5d0 [ 4200.663301][ C2] ? __pfx_tc_run+0x10/0x10 [ 4200.663534][ C2] ? lock_acquire+0x1c1/0x220 [ 4200.663775][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4200.664043][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4200.664301][ C2] ? lock_acquire+0x1c1/0x220 [ 4200.664545][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4200.664815][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4200.665125][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4200.665403][ C2] ? neigh_hh_output+0x348/0x590 [ 4200.665660][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4200.665930][ C2] ip_finish_output2+0x786/0x18e0 [ 4200.666193][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4200.666542][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4200.666824][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4200.667083][ C2] ? __ip_finish_output+0x10f/0x770 [ 4200.667354][ C2] ip_output+0x16b/0x4f0 [ 4200.667573][ C2] ? __pfx_ip_output+0x10/0x10 [ 4200.667820][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4200.668101][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4200.668419][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4200.668698][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4200.668967][ C2] ? __alloc_skb+0xd4/0x280 [ 4200.669203][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4200.669474][ C2] ? tcp_fragment+0x168/0x1040 [ 4200.669723][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4200.669978][ C2] ? ip_local_out+0x114/0x3b0 [ 4200.670229][ C2] __ip_queue_xmit+0x672/0x1910 [ 4200.670482][ C2] ? __skb_clone+0x57a/0x760 [ 4200.670722][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4200.670993][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4200.671280][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4200.671526][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4200.671779][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4200.672085][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4200.672410][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4200.672659][ C2] tcp_send_loss_probe+0x348/0x830 [ 4200.672924][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4200.673197][ C2] tcp_write_timer+0x82/0x1d0 [ 4200.673439][ C2] call_timer_fn+0x173/0x430 [ 4200.673679][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4200.673944][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4200.674213][ C2] __run_timers.part.0+0x52d/0x890 [ 4200.674475][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4200.674749][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4200.675036][ C2] ? lock_acquire+0x1c1/0x220 [ 4200.675281][ C2] ? clockevents_program_event+0xf6/0x300 [ 4200.675574][ C2] ? lock_release+0x1d5/0x250 [ 4200.675818][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4200.676090][ C2] ? ktime_get+0xb3/0x190 [ 4200.676317][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4200.676618][ C2] run_timer_softirq+0x72/0x100 [ 4200.676870][ C2] __do_softirq+0x1b9/0x7ff [ 4200.677110][ C2] irq_exit_rcu+0x98/0xc0 [ 4200.677333][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4200.677625][ C2] [ 4200.677776][ C2] [ 4200.677929][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4200.678240][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4200.678498][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4200.679496][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4200.679809][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4200.680216][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4200.680623][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4200.681028][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4200.681433][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4200.681838][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4200.682137][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4200.682405][ C2] default_idle_call+0x69/0xa0 [ 4200.682654][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4200.682910][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4200.683190][ C2] ? lock_release+0x1d5/0x250 [ 4200.683434][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4200.683711][ C2] do_idle+0xfb/0x160 [ 4200.683918][ C2] cpu_startup_entry+0x55/0x60 [ 4200.684168][ C2] start_secondary+0x21c/0x2b0 [ 4200.684414][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4200.684686][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4200.685005][ C2] [ 4228.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1747s! [perl:4135] [ 4228.569701][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4228.570974][ C1] irq event stamp: 209232 [ 4228.571196][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4228.571725][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4228.572204][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4228.572675][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4228.573139][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4228.573589][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4228.574203][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4228.574530][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4228.575502][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4228.575810][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4228.576211][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4228.576611][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4228.577010][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4228.577410][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4228.577812][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4228.578260][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4228.578592][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4228.579000][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4228.579402][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4228.579802][ C1] PKRU: 55555554 [ 4228.579985][ C1] Call Trace: [ 4228.580154][ C1] [ 4228.580305][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4228.580568][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4228.580813][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4228.581091][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4228.581363][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4228.581654][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4228.581920][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4228.582226][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4228.582489][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4228.582797][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4228.583108][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4228.583426][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4228.583716][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4228.584014][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4228.584304][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4228.584617][ C1] ? get_stack_info+0x36/0xc0 [ 4228.584861][ C1] ? lock_acquire+0x1c1/0x220 [ 4228.585103][ C1] ? lock_release+0x1d5/0x250 [ 4228.585344][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4228.585594][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4228.585868][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4228.586153][ C1] ? lock_acquire+0x1c1/0x220 [ 4228.586394][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4228.586638][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4228.586900][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4228.587135][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4228.587385][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4228.587643][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4228.587921][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4228.588201][ C1] ip_local_deliver+0x19d/0x480 [ 4228.588450][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4228.588730][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4228.589003][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4228.589351][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4228.589607][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4228.589927][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4228.590192][ C1] ip_rcv+0x564/0x740 [ 4228.590400][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4228.590632][ C1] ? set_track_prepare+0x8a/0xd0 [ 4228.590887][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4228.591164][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4228.591441][ C1] ? skb_clone+0x10b/0x330 [ 4228.591668][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4228.591989][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4228.592298][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4228.592580][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4228.592878][ C1] ? __tcf_classify+0x329/0x7d0 [ 4228.593130][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4228.593360][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4228.593663][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4228.593948][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4228.594276][ C1] ? lock_acquire+0x1c1/0x220 [ 4228.594516][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4228.594816][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4228.595102][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4228.595421][ C1] ? __copy_skb_header+0xaf/0x490 [ 4228.595689][ C1] ? __skb_clone+0x57a/0x760 [ 4228.595926][ C1] netif_receive_skb+0x55/0x280 [ 4228.596198][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4228.596512][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4228.596848][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4228.597150][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4228.597428][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4228.597719][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4228.598037][ C1] ? hlock_class+0x4e/0x130 [ 4228.598270][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4228.598555][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4228.598838][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4228.599102][ C1] ? hlock_class+0x4e/0x130 [ 4228.599335][ C1] ? mark_lock+0x38/0x3e0 [ 4228.599558][ C1] ? stack_access_ok+0xda/0x1f0 [ 4228.599808][ C1] ? __lock_acquire+0xb67/0x1610 [ 4228.600064][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4228.600342][ C1] ? get_stack_info+0x36/0xc0 [ 4228.600584][ C1] ? stack_access_ok+0xda/0x1f0 [ 4228.600832][ C1] ? get_reg+0x119/0x190 [ 4228.601049][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4228.601319][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4228.601629][ C1] __tcf_classify+0x329/0x7d0 [ 4228.601872][ C1] tcf_classify+0x283/0x930 [ 4228.602106][ C1] ? arch_stack_walk+0xa2/0x100 [ 4228.602357][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4228.602615][ C1] ? get_stack_info+0x36/0xc0 [ 4228.602855][ C1] tc_run+0x2e4/0x5d0 [ 4228.603062][ C1] ? __pfx_tc_run+0x10/0x10 [ 4228.603294][ C1] ? lock_acquire+0x1c1/0x220 [ 4228.603534][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4228.603799][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4228.604054][ C1] ? lock_acquire+0x1c1/0x220 [ 4228.604295][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4228.604563][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4228.604870][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4228.605145][ C1] ? neigh_hh_output+0x348/0x590 [ 4228.605403][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4228.605670][ C1] ip_finish_output2+0x786/0x18e0 [ 4228.605928][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4228.606213][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4228.606551][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4228.606829][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4228.607083][ C1] ? __ip_finish_output+0x10f/0x770 [ 4228.607350][ C1] ip_output+0x16b/0x4f0 [ 4228.607567][ C1] ? run_timer_softirq+0x72/0x100 [ 4228.607826][ C1] ? __pfx_ip_output+0x10/0x10 [ 4228.608071][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4228.608358][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4228.608610][ C1] ? ip_local_out+0x114/0x3b0 [ 4228.608863][ C1] __ip_queue_xmit+0x672/0x1910 [ 4228.609117][ C1] ? __create_object+0x5e/0xb0 [ 4228.609363][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4228.609632][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4228.609918][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4228.610191][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4228.610477][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4228.610750][ C1] tcp_delack_timer+0x84/0x240 [ 4228.610997][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4228.611271][ C1] call_timer_fn+0x173/0x430 [ 4228.611509][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4228.611773][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4228.612037][ C1] __run_timers.part.0+0x52d/0x890 [ 4228.612300][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4228.612574][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4228.612862][ C1] ? lock_acquire+0x1c1/0x220 [ 4228.613101][ C1] ? clockevents_program_event+0xf6/0x300 [ 4228.613396][ C1] ? lock_release+0x1d5/0x250 [ 4228.613637][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4228.613904][ C1] ? ktime_get+0xb3/0x190 [ 4228.614125][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4228.614428][ C1] run_timer_softirq+0x72/0x100 [ 4228.614679][ C1] __do_softirq+0x1b9/0x7ff [ 4228.614913][ C1] irq_exit_rcu+0x98/0xc0 [ 4228.615138][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4228.615426][ C1] [ 4228.615579][ C1] [ 4228.615731][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4228.616039][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4228.616370][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4228.617347][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4228.617657][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4228.618058][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4228.618463][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4228.618871][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4228.619273][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4228.619678][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4228.619977][ C1] pipe_read+0xa16/0xdf0 [ 4228.620199][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4228.620478][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4228.620725][ C1] ? iterate_tty_write+0x299/0x540 [ 4228.620986][ C1] ? lock_release+0x1d5/0x250 [ 4228.621229][ C1] vfs_read+0x911/0xc00 [ 4228.621446][ C1] ? lock_acquire+0x1c1/0x220 [ 4228.621686][ C1] ? __might_fault+0xc6/0x180 [ 4228.621928][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4228.622168][ C1] ? __might_fault+0xc6/0x180 [ 4228.622408][ C1] ? lock_release+0x1d5/0x250 [ 4228.622650][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4228.622915][ C1] ? __fget_light+0x54/0x1e0 [ 4228.623155][ C1] ksys_read+0x17a/0x1e0 [ 4228.623373][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4228.623619][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4228.623926][ C1] do_syscall_64+0xc9/0x1e0 [ 4228.624165][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4228.624467][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4228.624698][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4228.625675][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4228.626098][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4228.626500][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4228.626902][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4228.627302][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4228.627701][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4228.628107][ C1] [ 4228.628267][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1747s! [swapper/2:0] [ 4228.628724][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4228.629993][ C2] irq event stamp: 44114564 [ 4228.630222][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4228.630764][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4228.631279][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4228.631756][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4228.632228][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4228.632687][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4228.633303][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4228.633628][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4228.634600][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4228.634907][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4228.635306][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4228.635705][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4228.636105][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4228.636505][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4228.636901][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4228.637351][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4228.637684][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4228.638086][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4228.638486][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4228.638890][ C2] PKRU: 55555554 [ 4228.639072][ C2] Call Trace: [ 4228.639246][ C2] [ 4228.639396][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4228.639657][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4228.639904][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4228.640181][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4228.640456][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4228.640744][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4228.641009][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4228.641316][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4228.641578][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4228.641841][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4228.642158][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4228.642447][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4228.642753][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4228.643034][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4228.643322][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4228.643603][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4228.643905][ C2] ? get_stack_info+0x36/0xc0 [ 4228.644142][ C2] ? lock_acquire+0x1c1/0x220 [ 4228.644376][ C2] ? lock_release+0x1d5/0x250 [ 4228.644610][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4228.644852][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4228.645117][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4228.645396][ C2] ? lock_acquire+0x1c1/0x220 [ 4228.645628][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4228.645862][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4228.646115][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4228.646345][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4228.646586][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4228.646837][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4228.647105][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4228.647375][ C2] ip_local_deliver+0x19d/0x480 [ 4228.647634][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4228.647905][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4228.648171][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4228.648519][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4228.648778][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4228.649099][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4228.649363][ C2] ip_rcv+0x564/0x740 [ 4228.649566][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4228.649797][ C2] ? set_track_prepare+0x8a/0xd0 [ 4228.650050][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4228.650327][ C2] ? start_secondary+0x21c/0x2b0 [ 4228.650579][ C2] ? skb_clone+0x10b/0x330 [ 4228.650806][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4228.651124][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4228.651429][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4228.651711][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4228.652004][ C2] ? __tcf_classify+0x329/0x7d0 [ 4228.652254][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4228.652485][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4228.652783][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4228.653069][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4228.653399][ C2] ? lock_acquire+0x1c1/0x220 [ 4228.653636][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4228.653932][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4228.654218][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4228.654533][ C2] ? __copy_skb_header+0xaf/0x490 [ 4228.654791][ C2] ? __skb_clone+0x57a/0x760 [ 4228.655024][ C2] netif_receive_skb+0x55/0x280 [ 4228.655272][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4228.655595][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4228.655918][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4228.656210][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4228.656476][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4228.656755][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4228.657060][ C2] ? get_stack_info+0x36/0xc0 [ 4228.657297][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4228.657554][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4228.657863][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4228.658131][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4228.658402][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4228.658731][ C2] ? kernel_text_address+0x17/0xe0 [ 4228.658993][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4228.659305][ C2] ? arch_stack_walk+0x8c/0x100 [ 4228.659553][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4228.659816][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4228.660103][ C2] ? lock_acquire+0x1c1/0x220 [ 4228.660342][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4228.660623][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4228.660929][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4228.661204][ C2] ? get_stack_info+0x36/0xc0 [ 4228.661446][ C2] __tcf_classify+0x329/0x7d0 [ 4228.661686][ C2] tcf_classify+0x283/0x930 [ 4228.661918][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4228.662175][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4228.662487][ C2] tc_run+0x2e4/0x5d0 [ 4228.662692][ C2] ? __pfx_tc_run+0x10/0x10 [ 4228.662924][ C2] ? lock_acquire+0x1c1/0x220 [ 4228.663163][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4228.663424][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4228.663676][ C2] ? lock_acquire+0x1c1/0x220 [ 4228.663913][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4228.664179][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4228.664484][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4228.664755][ C2] ? neigh_hh_output+0x348/0x590 [ 4228.665006][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4228.665282][ C2] ip_finish_output2+0x786/0x18e0 [ 4228.665533][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4228.665861][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4228.666129][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4228.666376][ C2] ? __ip_finish_output+0x10f/0x770 [ 4228.666633][ C2] ip_output+0x16b/0x4f0 [ 4228.666845][ C2] ? __pfx_ip_output+0x10/0x10 [ 4228.667081][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4228.667352][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4228.667655][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4228.667926][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4228.668177][ C2] ? __alloc_skb+0xd4/0x280 [ 4228.668399][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4228.668688][ C2] ? tcp_fragment+0x168/0x1040 [ 4228.668931][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4228.669184][ C2] ? ip_local_out+0x114/0x3b0 [ 4228.669423][ C2] __ip_queue_xmit+0x672/0x1910 [ 4228.669672][ C2] ? __skb_clone+0x57a/0x760 [ 4228.669918][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4228.670178][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4228.670455][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4228.670694][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4228.670937][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4228.671230][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4228.671545][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4228.671782][ C2] tcp_send_loss_probe+0x348/0x830 [ 4228.672035][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4228.672298][ C2] tcp_write_timer+0x82/0x1d0 [ 4228.672529][ C2] call_timer_fn+0x173/0x430 [ 4228.672761][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4228.673015][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4228.673270][ C2] __run_timers.part.0+0x52d/0x890 [ 4228.673522][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4228.673784][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4228.674063][ C2] ? lock_acquire+0x1c1/0x220 [ 4228.674297][ C2] ? clockevents_program_event+0xf6/0x300 [ 4228.674581][ C2] ? lock_release+0x1d5/0x250 [ 4228.674815][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4228.675091][ C2] ? ktime_get+0xb3/0x190 [ 4228.675316][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4228.675606][ C2] run_timer_softirq+0x72/0x100 [ 4228.675847][ C2] __do_softirq+0x1b9/0x7ff [ 4228.676074][ C2] irq_exit_rcu+0x98/0xc0 [ 4228.676289][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4228.676566][ C2] [ 4228.676715][ C2] [ 4228.676859][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4228.677158][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4228.677409][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4228.678357][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4228.678675][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4228.679076][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4228.679475][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4228.679883][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4228.680271][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4228.680662][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4228.680950][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4228.681206][ C2] default_idle_call+0x69/0xa0 [ 4228.681442][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4228.681686][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4228.681963][ C2] ? lock_release+0x1d5/0x250 [ 4228.682195][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4228.682463][ C2] do_idle+0xfb/0x160 [ 4228.682661][ C2] cpu_startup_entry+0x55/0x60 [ 4228.682918][ C2] start_secondary+0x21c/0x2b0 [ 4228.683163][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4228.683434][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4228.683743][ C2] [ 4254.310103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4254.310467][ C1] rcu: 1-....: (1895004 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=458909 [ 4254.311025][ C1] rcu: (t=1899423 jiffies g=1882453 q=706 ncpus=4) [ 4254.311359][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4254.311807][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4254.312425][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4254.312754][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4254.313726][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4254.314037][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4254.314436][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4254.314834][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4254.315237][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4254.315636][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4254.316035][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4254.316484][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4254.316816][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4254.317222][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4254.317622][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4254.318021][ C1] PKRU: 55555554 [ 4254.318204][ C1] Call Trace: [ 4254.318377][ C1] [ 4254.318524][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4254.318802][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4254.319056][ C1] ? check_cpu_stall+0x284/0x500 [ 4254.319308][ C1] ? rcu_pending+0x92/0x360 [ 4254.319541][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4254.319812][ C1] ? update_process_times+0xb9/0x110 [ 4254.320083][ C1] ? tick_sched_handle+0x67/0x130 [ 4254.320340][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4254.320626][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4254.320867][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4254.321181][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4254.321455][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4254.321744][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4254.322009][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4254.322317][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4254.322580][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4254.322890][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4254.323186][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4254.323503][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4254.323795][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4254.324089][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4254.324381][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4254.324694][ C1] ? get_stack_info+0x36/0xc0 [ 4254.324935][ C1] ? lock_acquire+0x1c1/0x220 [ 4254.325175][ C1] ? lock_release+0x1d5/0x250 [ 4254.325416][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4254.325666][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4254.325938][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4254.326226][ C1] ? lock_acquire+0x1c1/0x220 [ 4254.326464][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4254.326707][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4254.326967][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4254.327204][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4254.327452][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4254.327712][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4254.327990][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4254.328267][ C1] ip_local_deliver+0x19d/0x480 [ 4254.328515][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4254.328799][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4254.329064][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4254.329414][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4254.329669][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4254.329990][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4254.330254][ C1] ip_rcv+0x564/0x740 [ 4254.330458][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4254.330690][ C1] ? set_track_prepare+0x8a/0xd0 [ 4254.330943][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4254.331221][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4254.331494][ C1] ? skb_clone+0x10b/0x330 [ 4254.331723][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4254.332045][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4254.332349][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4254.332634][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4254.332928][ C1] ? __tcf_classify+0x329/0x7d0 [ 4254.333178][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4254.333410][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4254.333709][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4254.333996][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4254.334323][ C1] ? lock_acquire+0x1c1/0x220 [ 4254.334563][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4254.334858][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4254.335146][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4254.335464][ C1] ? __copy_skb_header+0xaf/0x490 [ 4254.335722][ C1] ? __skb_clone+0x57a/0x760 [ 4254.335955][ C1] netif_receive_skb+0x55/0x280 [ 4254.336205][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4254.336519][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4254.336852][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4254.337153][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4254.337428][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4254.337716][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4254.338029][ C1] ? hlock_class+0x4e/0x130 [ 4254.338264][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4254.338540][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4254.338831][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4254.339096][ C1] ? hlock_class+0x4e/0x130 [ 4254.339327][ C1] ? mark_lock+0x38/0x3e0 [ 4254.339549][ C1] ? stack_access_ok+0xda/0x1f0 [ 4254.339801][ C1] ? __lock_acquire+0xb67/0x1610 [ 4254.340055][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4254.340334][ C1] ? get_stack_info+0x36/0xc0 [ 4254.340574][ C1] ? stack_access_ok+0xda/0x1f0 [ 4254.340820][ C1] ? get_reg+0x119/0x190 [ 4254.341039][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4254.341307][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4254.341618][ C1] __tcf_classify+0x329/0x7d0 [ 4254.341860][ C1] tcf_classify+0x283/0x930 [ 4254.342091][ C1] ? arch_stack_walk+0xa2/0x100 [ 4254.342341][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4254.342603][ C1] ? get_stack_info+0x36/0xc0 [ 4254.342845][ C1] tc_run+0x2e4/0x5d0 [ 4254.343051][ C1] ? __pfx_tc_run+0x10/0x10 [ 4254.343284][ C1] ? lock_acquire+0x1c1/0x220 [ 4254.343521][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4254.343782][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4254.344037][ C1] ? lock_acquire+0x1c1/0x220 [ 4254.344277][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4254.344542][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4254.344849][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4254.345121][ C1] ? neigh_hh_output+0x348/0x590 [ 4254.345374][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4254.345639][ C1] ip_finish_output2+0x786/0x18e0 [ 4254.345895][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4254.346176][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4254.346515][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4254.346791][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4254.347044][ C1] ? __ip_finish_output+0x10f/0x770 [ 4254.347315][ C1] ip_output+0x16b/0x4f0 [ 4254.347532][ C1] ? run_timer_softirq+0x72/0x100 [ 4254.347788][ C1] ? __pfx_ip_output+0x10/0x10 [ 4254.348031][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4254.348319][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4254.348575][ C1] ? ip_local_out+0x114/0x3b0 [ 4254.348826][ C1] __ip_queue_xmit+0x672/0x1910 [ 4254.349074][ C1] ? __create_object+0x5e/0xb0 [ 4254.349319][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4254.349586][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4254.349870][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4254.350144][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4254.350425][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4254.350699][ C1] tcp_delack_timer+0x84/0x240 [ 4254.350943][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4254.351217][ C1] call_timer_fn+0x173/0x430 [ 4254.351452][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4254.351714][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4254.351975][ C1] __run_timers.part.0+0x52d/0x890 [ 4254.352238][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4254.352514][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4254.352799][ C1] ? lock_acquire+0x1c1/0x220 [ 4254.353040][ C1] ? clockevents_program_event+0xf6/0x300 [ 4254.353329][ C1] ? lock_release+0x1d5/0x250 [ 4254.353572][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4254.353842][ C1] ? ktime_get+0xb3/0x190 [ 4254.354066][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4254.354363][ C1] run_timer_softirq+0x72/0x100 [ 4254.354611][ C1] __do_softirq+0x1b9/0x7ff [ 4254.354846][ C1] irq_exit_rcu+0x98/0xc0 [ 4254.355066][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4254.355355][ C1] [ 4254.355505][ C1] [ 4254.355656][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4254.355962][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4254.356287][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4254.357261][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4254.357571][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4254.357971][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4254.358372][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4254.358780][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4254.359177][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4254.359578][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4254.359879][ C1] pipe_read+0xa16/0xdf0 [ 4254.360101][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4254.360381][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4254.360626][ C1] ? iterate_tty_write+0x299/0x540 [ 4254.360888][ C1] ? lock_release+0x1d5/0x250 [ 4254.361128][ C1] vfs_read+0x911/0xc00 [ 4254.361355][ C1] ? lock_acquire+0x1c1/0x220 [ 4254.361594][ C1] ? __might_fault+0xc6/0x180 [ 4254.361836][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4254.362078][ C1] ? __might_fault+0xc6/0x180 [ 4254.362324][ C1] ? lock_release+0x1d5/0x250 [ 4254.362565][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4254.362835][ C1] ? __fget_light+0x54/0x1e0 [ 4254.363072][ C1] ksys_read+0x17a/0x1e0 [ 4254.363294][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4254.363539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4254.363853][ C1] do_syscall_64+0xc9/0x1e0 [ 4254.364089][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4254.364390][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4254.364621][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4254.365598][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4254.366024][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4254.366425][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4254.366826][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4254.367228][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4254.367630][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4254.368034][ C1] [ 4254.368193][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4254.368472][ C2] NMI backtrace for cpu 2 [ 4254.368483][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4254.368490][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4254.368496][ C2] RIP: 0010:__kasan_check_read+0x8/0x20 [ 4254.368509][ C2] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 4254.368512][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 4254.368516][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4254.368518][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4254.368520][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4254.368522][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4254.368524][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4254.368525][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4254.368527][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4254.368530][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4254.368532][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4254.368533][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4254.368535][ C2] PKRU: 55555554 [ 4254.368535][ C2] Call Trace: [ 4254.368539][ C2] [ 4254.368545][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4254.368553][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4254.368559][ C2] ? nmi_handle+0x153/0x420 [ 4254.368569][ C2] ? default_do_nmi+0x41/0x100 [ 4254.368574][ C2] ? exc_nmi+0xf3/0x120 [ 4254.368576][ C2] ? end_repeat_nmi+0xf/0x60 [ 4254.368583][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4254.368587][ C2] ? __kasan_check_read+0x8/0x20 [ 4254.368607][ C2] ? __kasan_check_read+0x8/0x20 [ 4254.368610][ C2] ? __kasan_check_read+0x8/0x20 [ 4254.368614][ C2] [ 4254.368615][ C2] [ 4254.368616][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4254.368620][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4254.368622][ C2] ? get_stack_info+0x36/0xc0 [ 4254.368627][ C2] ? lock_acquire+0x1c1/0x220 [ 4254.368632][ C2] ? lock_release+0x1d5/0x250 [ 4254.368636][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4254.368640][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4254.368643][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4254.368646][ C2] ? lock_acquire+0x1c1/0x220 [ 4254.368649][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4254.368654][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4254.368657][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4254.368665][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4254.368668][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4254.368673][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4254.368680][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4254.368684][ C2] ip_local_deliver+0x19d/0x480 [ 4254.368687][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4254.368689][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4254.368692][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4254.368698][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4254.368704][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4254.368707][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4254.368717][ C2] ip_rcv+0x564/0x740 [ 4254.368721][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4254.368723][ C2] ? set_track_prepare+0x8a/0xd0 [ 4254.368728][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4254.368732][ C2] ? start_secondary+0x21c/0x2b0 [ 4254.368736][ C2] ? skb_clone+0x10b/0x330 [ 4254.368740][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4254.368746][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4254.368752][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4254.368757][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4254.368765][ C2] ? __tcf_classify+0x329/0x7d0 [ 4254.368769][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4254.368771][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4254.368774][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4254.368778][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4254.368782][ C2] ? lock_acquire+0x1c1/0x220 [ 4254.368784][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4254.368789][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4254.368793][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4254.368797][ C2] ? __copy_skb_header+0xaf/0x490 [ 4254.368802][ C2] ? __skb_clone+0x57a/0x760 [ 4254.368805][ C2] netif_receive_skb+0x55/0x280 [ 4254.368808][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4254.368817][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4254.368824][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4254.368831][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4254.368835][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4254.368846][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4254.368853][ C2] ? get_stack_info+0x36/0xc0 [ 4254.368858][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4254.368863][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4254.368868][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4254.368871][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4254.368875][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4254.368877][ C2] ? kernel_text_address+0x17/0xe0 [ 4254.368881][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4254.368887][ C2] ? arch_stack_walk+0x8c/0x100 [ 4254.368892][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4254.368895][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4254.368898][ C2] ? lock_acquire+0x1c1/0x220 [ 4254.368901][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4254.368906][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4254.368912][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4254.368914][ C2] ? get_stack_info+0x36/0xc0 [ 4254.368919][ C2] __tcf_classify+0x329/0x7d0 [ 4254.368924][ C2] tcf_classify+0x283/0x930 [ 4254.368929][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4254.368933][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4254.368937][ C2] tc_run+0x2e4/0x5d0 [ 4254.368942][ C2] ? __pfx_tc_run+0x10/0x10 [ 4254.368945][ C2] ? lock_acquire+0x1c1/0x220 [ 4254.368947][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4254.368951][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4254.368956][ C2] ? lock_acquire+0x1c1/0x220 [ 4254.368958][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4254.368962][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4254.368965][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4254.368968][ C2] ? neigh_hh_output+0x348/0x590 [ 4254.368971][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4254.368975][ C2] ip_finish_output2+0x786/0x18e0 [ 4254.368979][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4254.368986][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4254.368989][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4254.368992][ C2] ? __ip_finish_output+0x10f/0x770 [ 4254.368996][ C2] ip_output+0x16b/0x4f0 [ 4254.368999][ C2] ? __pfx_ip_output+0x10/0x10 [ 4254.369002][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4254.369005][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4254.369008][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4254.369012][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4254.369015][ C2] ? __alloc_skb+0xd4/0x280 [ 4254.369017][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4254.369023][ C2] ? tcp_fragment+0x168/0x1040 [ 4254.369027][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4254.369030][ C2] ? ip_local_out+0x114/0x3b0 [ 4254.369034][ C2] __ip_queue_xmit+0x672/0x1910 [ 4254.369037][ C2] ? __skb_clone+0x57a/0x760 [ 4254.369040][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4254.369046][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4254.369049][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4254.369054][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4254.369059][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4254.369064][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4254.369067][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4254.369071][ C2] tcp_send_loss_probe+0x348/0x830 [ 4254.369074][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4254.369077][ C2] tcp_write_timer+0x82/0x1d0 [ 4254.369080][ C2] call_timer_fn+0x173/0x430 [ 4254.369086][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4254.369090][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4254.369094][ C2] __run_timers.part.0+0x52d/0x890 [ 4254.369098][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4254.369102][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4254.369105][ C2] ? lock_acquire+0x1c1/0x220 [ 4254.369107][ C2] ? clockevents_program_event+0xf6/0x300 [ 4254.369111][ C2] ? lock_release+0x1d5/0x250 [ 4254.369114][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4254.369118][ C2] ? ktime_get+0xb3/0x190 [ 4254.369122][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4254.369127][ C2] run_timer_softirq+0x72/0x100 [ 4254.369130][ C2] __do_softirq+0x1b9/0x7ff [ 4254.369135][ C2] irq_exit_rcu+0x98/0xc0 [ 4254.369138][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4254.369142][ C2] [ 4254.369143][ C2] [ 4254.369144][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4254.369147][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4254.369151][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4254.369154][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4254.369157][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4254.369159][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4254.369160][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4254.369162][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4254.369164][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4254.369167][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4254.369170][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4254.369175][ C2] default_idle_call+0x69/0xa0 [ 4254.369179][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4254.369182][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4254.369186][ C2] ? lock_release+0x1d5/0x250 [ 4254.369189][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4254.369193][ C2] do_idle+0xfb/0x160 [ 4254.369195][ C2] cpu_startup_entry+0x55/0x60 [ 4254.369198][ C2] start_secondary+0x21c/0x2b0 [ 4254.369201][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4254.369205][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4254.369212][ C2] [ 4280.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1795s! [perl:4135] [ 4280.569704][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4280.570972][ C1] irq event stamp: 209232 [ 4280.571195][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4280.571729][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4280.572208][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4280.572682][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4280.573152][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4280.573603][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4280.574219][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4280.574555][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4280.575529][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4280.575837][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4280.576242][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4280.576644][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4280.577045][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4280.577451][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4280.577852][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4280.578301][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4280.578642][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4280.579042][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4280.579442][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4280.579844][ C1] PKRU: 55555554 [ 4280.580027][ C1] Call Trace: [ 4280.580196][ C1] [ 4280.580347][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4280.580613][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4280.580857][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4280.581135][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4280.581409][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4280.581699][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4280.581966][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4280.582272][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4280.582536][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4280.582845][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4280.583148][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4280.583466][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4280.583756][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4280.584054][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4280.584344][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4280.584655][ C1] ? get_stack_info+0x36/0xc0 [ 4280.584901][ C1] ? lock_acquire+0x1c1/0x220 [ 4280.585143][ C1] ? lock_release+0x1d5/0x250 [ 4280.585384][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4280.585632][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4280.585906][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4280.586190][ C1] ? lock_acquire+0x1c1/0x220 [ 4280.586430][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4280.586673][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4280.586934][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4280.587168][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4280.587417][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4280.587674][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4280.587951][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4280.588231][ C1] ip_local_deliver+0x19d/0x480 [ 4280.588486][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4280.588757][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4280.589021][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4280.589375][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4280.589629][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4280.589949][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4280.590214][ C1] ip_rcv+0x564/0x740 [ 4280.590419][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4280.590650][ C1] ? set_track_prepare+0x8a/0xd0 [ 4280.590904][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4280.591180][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4280.591456][ C1] ? skb_clone+0x10b/0x330 [ 4280.591683][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4280.592003][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4280.592311][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4280.592592][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4280.592893][ C1] ? __tcf_classify+0x329/0x7d0 [ 4280.593144][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4280.593374][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4280.593675][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4280.593959][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4280.594286][ C1] ? lock_acquire+0x1c1/0x220 [ 4280.594524][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4280.594831][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4280.595117][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4280.595437][ C1] ? __copy_skb_header+0xaf/0x490 [ 4280.595697][ C1] ? __skb_clone+0x57a/0x760 [ 4280.595934][ C1] netif_receive_skb+0x55/0x280 [ 4280.596184][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4280.596499][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4280.596834][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4280.597134][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4280.597412][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4280.597703][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4280.598022][ C1] ? hlock_class+0x4e/0x130 [ 4280.598252][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4280.598539][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4280.598815][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4280.599081][ C1] ? hlock_class+0x4e/0x130 [ 4280.599314][ C1] ? mark_lock+0x38/0x3e0 [ 4280.599533][ C1] ? stack_access_ok+0xda/0x1f0 [ 4280.599782][ C1] ? __lock_acquire+0xb67/0x1610 [ 4280.600037][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4280.600315][ C1] ? get_stack_info+0x36/0xc0 [ 4280.600558][ C1] ? stack_access_ok+0xda/0x1f0 [ 4280.600807][ C1] ? get_reg+0x119/0x190 [ 4280.601028][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4280.601300][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4280.601611][ C1] __tcf_classify+0x329/0x7d0 [ 4280.601856][ C1] tcf_classify+0x283/0x930 [ 4280.602090][ C1] ? arch_stack_walk+0xa2/0x100 [ 4280.602341][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4280.602600][ C1] ? get_stack_info+0x36/0xc0 [ 4280.602842][ C1] tc_run+0x2e4/0x5d0 [ 4280.603049][ C1] ? __pfx_tc_run+0x10/0x10 [ 4280.603282][ C1] ? lock_acquire+0x1c1/0x220 [ 4280.603524][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4280.603788][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4280.604045][ C1] ? lock_acquire+0x1c1/0x220 [ 4280.604287][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4280.604554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4280.604861][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4280.605137][ C1] ? neigh_hh_output+0x348/0x590 [ 4280.605392][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4280.605660][ C1] ip_finish_output2+0x786/0x18e0 [ 4280.605918][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4280.606199][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4280.606538][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4280.606818][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4280.607074][ C1] ? __ip_finish_output+0x10f/0x770 [ 4280.607342][ C1] ip_output+0x16b/0x4f0 [ 4280.607560][ C1] ? run_timer_softirq+0x72/0x100 [ 4280.607819][ C1] ? __pfx_ip_output+0x10/0x10 [ 4280.608064][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4280.608352][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4280.608613][ C1] ? ip_local_out+0x114/0x3b0 [ 4280.608855][ C1] __ip_queue_xmit+0x672/0x1910 [ 4280.609106][ C1] ? __create_object+0x5e/0xb0 [ 4280.609353][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4280.609623][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4280.609905][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4280.610181][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4280.610467][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4280.610745][ C1] tcp_delack_timer+0x84/0x240 [ 4280.610996][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4280.611269][ C1] call_timer_fn+0x173/0x430 [ 4280.611506][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4280.611769][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4280.612031][ C1] __run_timers.part.0+0x52d/0x890 [ 4280.612294][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4280.612569][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4280.612856][ C1] ? lock_acquire+0x1c1/0x220 [ 4280.613094][ C1] ? clockevents_program_event+0xf6/0x300 [ 4280.613386][ C1] ? lock_release+0x1d5/0x250 [ 4280.613626][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4280.613891][ C1] ? ktime_get+0xb3/0x190 [ 4280.614111][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4280.614409][ C1] run_timer_softirq+0x72/0x100 [ 4280.614667][ C1] __do_softirq+0x1b9/0x7ff [ 4280.614899][ C1] irq_exit_rcu+0x98/0xc0 [ 4280.615122][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4280.615407][ C1] [ 4280.615559][ C1] [ 4280.615710][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4280.616016][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4280.616342][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4280.617313][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4280.617631][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4280.618030][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4280.618430][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4280.618844][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4280.619245][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4280.619649][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4280.619949][ C1] pipe_read+0xa16/0xdf0 [ 4280.620176][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4280.620454][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4280.620701][ C1] ? iterate_tty_write+0x299/0x540 [ 4280.620964][ C1] ? lock_release+0x1d5/0x250 [ 4280.621206][ C1] vfs_read+0x911/0xc00 [ 4280.621422][ C1] ? lock_acquire+0x1c1/0x220 [ 4280.621662][ C1] ? __might_fault+0xc6/0x180 [ 4280.621906][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4280.622147][ C1] ? __might_fault+0xc6/0x180 [ 4280.622387][ C1] ? lock_release+0x1d5/0x250 [ 4280.622629][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4280.622895][ C1] ? __fget_light+0x54/0x1e0 [ 4280.623137][ C1] ksys_read+0x17a/0x1e0 [ 4280.623354][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4280.623600][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4280.623907][ C1] do_syscall_64+0xc9/0x1e0 [ 4280.624139][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4280.624442][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4280.624673][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4280.625648][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4280.626071][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4280.626474][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4280.626873][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4280.627273][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4280.627673][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4280.628078][ C1] [ 4280.628238][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1795s! [swapper/2:0] [ 4280.628708][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4280.629976][ C2] irq event stamp: 44114564 [ 4280.630207][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4280.630747][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4280.631261][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4280.631738][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4280.632213][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4280.632672][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4280.633286][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4280.633612][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4280.634588][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4280.634895][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4280.635298][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4280.635698][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4280.636097][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4280.636498][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4280.636899][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4280.637350][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4280.637685][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4280.638086][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4280.638496][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4280.638898][ C2] PKRU: 55555554 [ 4280.639080][ C2] Call Trace: [ 4280.639251][ C2] [ 4280.639404][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4280.639668][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4280.639911][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4280.640190][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4280.640463][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4280.640752][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4280.641018][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4280.641325][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4280.641586][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4280.641849][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4280.642160][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4280.642459][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4280.642775][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4280.643064][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4280.643363][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4280.643651][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4280.643962][ C2] ? get_stack_info+0x36/0xc0 [ 4280.644207][ C2] ? lock_acquire+0x1c1/0x220 [ 4280.644447][ C2] ? lock_release+0x1d5/0x250 [ 4280.644687][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4280.644936][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4280.645210][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4280.645493][ C2] ? lock_acquire+0x1c1/0x220 [ 4280.645732][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4280.645976][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4280.646239][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4280.646473][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4280.646721][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4280.646979][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4280.647258][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4280.647537][ C2] ip_local_deliver+0x19d/0x480 [ 4280.647785][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4280.648057][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4280.648322][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4280.648678][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4280.648932][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4280.649254][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4280.649518][ C2] ip_rcv+0x564/0x740 [ 4280.649724][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4280.649954][ C2] ? set_track_prepare+0x8a/0xd0 [ 4280.650209][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4280.650485][ C2] ? start_secondary+0x21c/0x2b0 [ 4280.650735][ C2] ? skb_clone+0x10b/0x330 [ 4280.650965][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4280.651286][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4280.651594][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4280.651874][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4280.652170][ C2] ? __tcf_classify+0x329/0x7d0 [ 4280.652424][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4280.652656][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4280.652957][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4280.653243][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4280.653568][ C2] ? lock_acquire+0x1c1/0x220 [ 4280.653806][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4280.654104][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4280.654390][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4280.654708][ C2] ? __copy_skb_header+0xaf/0x490 [ 4280.654966][ C2] ? __skb_clone+0x57a/0x760 [ 4280.655202][ C2] netif_receive_skb+0x55/0x280 [ 4280.655448][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4280.655759][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4280.656091][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4280.656390][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4280.656662][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4280.656958][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4280.657272][ C2] ? get_stack_info+0x36/0xc0 [ 4280.657513][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4280.657776][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4280.658094][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4280.658373][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4280.658672][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4280.659013][ C2] ? kernel_text_address+0x17/0xe0 [ 4280.659273][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4280.659589][ C2] ? arch_stack_walk+0x8c/0x100 [ 4280.659839][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4280.660102][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4280.660386][ C2] ? lock_acquire+0x1c1/0x220 [ 4280.660625][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4280.660905][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4280.661212][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4280.661488][ C2] ? get_stack_info+0x36/0xc0 [ 4280.661729][ C2] __tcf_classify+0x329/0x7d0 [ 4280.661971][ C2] tcf_classify+0x283/0x930 [ 4280.662205][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4280.662461][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4280.662771][ C2] tc_run+0x2e4/0x5d0 [ 4280.662978][ C2] ? __pfx_tc_run+0x10/0x10 [ 4280.663208][ C2] ? lock_acquire+0x1c1/0x220 [ 4280.663448][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4280.663708][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4280.663961][ C2] ? lock_acquire+0x1c1/0x220 [ 4280.664201][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4280.664465][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4280.664769][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4280.665040][ C2] ? neigh_hh_output+0x348/0x590 [ 4280.665296][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4280.665560][ C2] ip_finish_output2+0x786/0x18e0 [ 4280.665818][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4280.666157][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4280.666433][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4280.666692][ C2] ? __ip_finish_output+0x10f/0x770 [ 4280.666958][ C2] ip_output+0x16b/0x4f0 [ 4280.667176][ C2] ? __pfx_ip_output+0x10/0x10 [ 4280.667420][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4280.667696][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4280.668011][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4280.668288][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4280.668547][ C2] ? __alloc_skb+0xd4/0x280 [ 4280.668778][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4280.669048][ C2] ? tcp_fragment+0x168/0x1040 [ 4280.669295][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4280.669548][ C2] ? ip_local_out+0x114/0x3b0 [ 4280.669787][ C2] __ip_queue_xmit+0x672/0x1910 [ 4280.670035][ C2] ? __skb_clone+0x57a/0x760 [ 4280.670274][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4280.670541][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4280.670821][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4280.671068][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4280.671318][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4280.671623][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4280.671945][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4280.672194][ C2] tcp_send_loss_probe+0x348/0x830 [ 4280.672455][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4280.672722][ C2] tcp_write_timer+0x82/0x1d0 [ 4280.672963][ C2] call_timer_fn+0x173/0x430 [ 4280.673199][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4280.673462][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4280.673723][ C2] __run_timers.part.0+0x52d/0x890 [ 4280.673983][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4280.674252][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4280.674535][ C2] ? lock_acquire+0x1c1/0x220 [ 4280.674775][ C2] ? clockevents_program_event+0xf6/0x300 [ 4280.675066][ C2] ? lock_release+0x1d5/0x250 [ 4280.675305][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4280.675569][ C2] ? ktime_get+0xb3/0x190 [ 4280.675792][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4280.676086][ C2] run_timer_softirq+0x72/0x100 [ 4280.676335][ C2] __do_softirq+0x1b9/0x7ff [ 4280.676569][ C2] irq_exit_rcu+0x98/0xc0 [ 4280.676788][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4280.677076][ C2] [ 4280.677226][ C2] [ 4280.677377][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4280.677680][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4280.677939][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4280.678923][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4280.679235][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4280.679634][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4280.680037][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4280.680437][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4280.680834][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4280.681236][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4280.681527][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4280.681788][ C2] default_idle_call+0x69/0xa0 [ 4280.682033][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4280.682286][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4280.682563][ C2] ? lock_release+0x1d5/0x250 [ 4280.682803][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4280.683076][ C2] do_idle+0xfb/0x160 [ 4280.683280][ C2] cpu_startup_entry+0x55/0x60 [ 4280.683523][ C2] start_secondary+0x21c/0x2b0 [ 4280.683768][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4280.684036][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4280.684352][ C2] [ 4308.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1821s! [perl:4135] [ 4308.569701][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4308.570963][ C1] irq event stamp: 209232 [ 4308.571186][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4308.571716][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4308.572193][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4308.572664][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4308.573128][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4308.573579][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4308.574191][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4308.574517][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4308.575492][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4308.575800][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4308.576202][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4308.576601][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4308.577000][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4308.577400][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4308.577801][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4308.578250][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4308.578590][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4308.578990][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4308.579389][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4308.579791][ C1] PKRU: 55555554 [ 4308.579972][ C1] Call Trace: [ 4308.580143][ C1] [ 4308.580291][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4308.580555][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4308.580797][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4308.581078][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4308.581352][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4308.581640][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4308.581907][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4308.582212][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4308.582474][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4308.582784][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4308.583082][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4308.583399][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4308.583688][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4308.583984][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4308.584272][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4308.584584][ C1] ? get_stack_info+0x36/0xc0 [ 4308.584826][ C1] ? lock_acquire+0x1c1/0x220 [ 4308.585069][ C1] ? lock_release+0x1d5/0x250 [ 4308.585308][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4308.585556][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4308.585831][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4308.586116][ C1] ? lock_acquire+0x1c1/0x220 [ 4308.586356][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4308.586597][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4308.586858][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4308.587092][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4308.587339][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4308.587597][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4308.587881][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4308.588161][ C1] ip_local_deliver+0x19d/0x480 [ 4308.588415][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4308.588688][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4308.588952][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4308.589299][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4308.589552][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4308.589873][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4308.590136][ C1] ip_rcv+0x564/0x740 [ 4308.590340][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4308.590572][ C1] ? set_track_prepare+0x8a/0xd0 [ 4308.590826][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4308.591104][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4308.591377][ C1] ? skb_clone+0x10b/0x330 [ 4308.591605][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4308.591926][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4308.592232][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4308.592514][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4308.592810][ C1] ? __tcf_classify+0x329/0x7d0 [ 4308.593059][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4308.593289][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4308.593590][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4308.593873][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4308.594200][ C1] ? lock_acquire+0x1c1/0x220 [ 4308.594440][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4308.594738][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4308.595023][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4308.595340][ C1] ? __copy_skb_header+0xaf/0x490 [ 4308.595609][ C1] ? __skb_clone+0x57a/0x760 [ 4308.595846][ C1] netif_receive_skb+0x55/0x280 [ 4308.596096][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4308.596410][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4308.596746][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4308.597050][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4308.597325][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4308.597617][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4308.597932][ C1] ? hlock_class+0x4e/0x130 [ 4308.598165][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4308.598452][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4308.598740][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4308.599005][ C1] ? hlock_class+0x4e/0x130 [ 4308.599238][ C1] ? mark_lock+0x38/0x3e0 [ 4308.599458][ C1] ? stack_access_ok+0xda/0x1f0 [ 4308.599708][ C1] ? __lock_acquire+0xb67/0x1610 [ 4308.599963][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4308.600240][ C1] ? get_stack_info+0x36/0xc0 [ 4308.600483][ C1] ? stack_access_ok+0xda/0x1f0 [ 4308.600732][ C1] ? get_reg+0x119/0x190 [ 4308.600948][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4308.601221][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4308.601533][ C1] __tcf_classify+0x329/0x7d0 [ 4308.601776][ C1] tcf_classify+0x283/0x930 [ 4308.602009][ C1] ? arch_stack_walk+0xa2/0x100 [ 4308.602258][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4308.602515][ C1] ? get_stack_info+0x36/0xc0 [ 4308.602756][ C1] tc_run+0x2e4/0x5d0 [ 4308.602962][ C1] ? __pfx_tc_run+0x10/0x10 [ 4308.603196][ C1] ? lock_acquire+0x1c1/0x220 [ 4308.603437][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4308.603699][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4308.603954][ C1] ? lock_acquire+0x1c1/0x220 [ 4308.604193][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4308.604460][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4308.604765][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4308.605041][ C1] ? neigh_hh_output+0x348/0x590 [ 4308.605294][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4308.605560][ C1] ip_finish_output2+0x786/0x18e0 [ 4308.605818][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4308.606097][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4308.606436][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4308.606714][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4308.606968][ C1] ? __ip_finish_output+0x10f/0x770 [ 4308.607244][ C1] ip_output+0x16b/0x4f0 [ 4308.607460][ C1] ? run_timer_softirq+0x72/0x100 [ 4308.607719][ C1] ? __pfx_ip_output+0x10/0x10 [ 4308.607964][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4308.608250][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4308.608509][ C1] ? ip_local_out+0x114/0x3b0 [ 4308.608751][ C1] __ip_queue_xmit+0x672/0x1910 [ 4308.609000][ C1] ? __create_object+0x5e/0xb0 [ 4308.609245][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4308.609514][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4308.609796][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4308.610070][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4308.610361][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4308.610634][ C1] tcp_delack_timer+0x84/0x240 [ 4308.610880][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4308.611152][ C1] call_timer_fn+0x173/0x430 [ 4308.611391][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4308.611653][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4308.611916][ C1] __run_timers.part.0+0x52d/0x890 [ 4308.612178][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4308.612453][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4308.612739][ C1] ? lock_acquire+0x1c1/0x220 [ 4308.612977][ C1] ? clockevents_program_event+0xf6/0x300 [ 4308.613272][ C1] ? lock_release+0x1d5/0x250 [ 4308.613513][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4308.613779][ C1] ? ktime_get+0xb3/0x190 [ 4308.614000][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4308.614299][ C1] run_timer_softirq+0x72/0x100 [ 4308.614548][ C1] __do_softirq+0x1b9/0x7ff [ 4308.614781][ C1] irq_exit_rcu+0x98/0xc0 [ 4308.615005][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4308.615292][ C1] [ 4308.615447][ C1] [ 4308.615598][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4308.615905][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4308.616232][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4308.617207][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4308.617517][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4308.617918][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4308.618327][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4308.618725][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4308.619131][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4308.619535][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4308.619834][ C1] pipe_read+0xa16/0xdf0 [ 4308.620057][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4308.620337][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4308.620582][ C1] ? iterate_tty_write+0x299/0x540 [ 4308.620845][ C1] ? lock_release+0x1d5/0x250 [ 4308.621089][ C1] vfs_read+0x911/0xc00 [ 4308.621303][ C1] ? lock_acquire+0x1c1/0x220 [ 4308.621544][ C1] ? __might_fault+0xc6/0x180 [ 4308.621787][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4308.622025][ C1] ? __might_fault+0xc6/0x180 [ 4308.622273][ C1] ? lock_release+0x1d5/0x250 [ 4308.622514][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4308.622781][ C1] ? __fget_light+0x54/0x1e0 [ 4308.623020][ C1] ksys_read+0x17a/0x1e0 [ 4308.623239][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4308.623485][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4308.623793][ C1] do_syscall_64+0xc9/0x1e0 [ 4308.624024][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4308.624326][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4308.624556][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4308.625539][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4308.625960][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4308.626361][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4308.626763][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4308.627164][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4308.627563][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4308.627968][ C1] [ 4308.628129][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1821s! [swapper/2:0] [ 4308.628598][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4308.629860][ C2] irq event stamp: 44114564 [ 4308.630091][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4308.630632][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4308.631149][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4308.631632][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4308.632106][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4308.632564][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4308.633181][ C2] RIP: 0010:kasan_check_range+0x158/0x1c0 [ 4308.633472][ C2] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [ 4308.634443][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000246 [ 4308.634752][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [ 4308.635154][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4308.635561][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [ 4308.635962][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4308.636363][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4308.636762][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4308.637212][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4308.637546][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4308.637946][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4308.638356][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4308.638756][ C2] PKRU: 55555554 [ 4308.638936][ C2] Call Trace: [ 4308.639111][ C2] [ 4308.639260][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4308.639524][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4308.639768][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4308.640045][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4308.640319][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4308.640606][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4308.640873][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4308.641183][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4308.641442][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 4308.641702][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4308.641964][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4308.642276][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4308.642573][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4308.642889][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4308.643178][ C2] ? kasan_check_range+0x158/0x1c0 [ 4308.643438][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4308.643726][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4308.644037][ C2] ? get_stack_info+0x36/0xc0 [ 4308.644277][ C2] ? lock_acquire+0x1c1/0x220 [ 4308.644519][ C2] ? lock_release+0x1d5/0x250 [ 4308.644760][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4308.645009][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4308.645281][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4308.645566][ C2] ? lock_acquire+0x1c1/0x220 [ 4308.645805][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4308.646048][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4308.646310][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4308.646563][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4308.646808][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4308.647066][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4308.647347][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4308.647627][ C2] ip_local_deliver+0x19d/0x480 [ 4308.647876][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4308.648149][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4308.648423][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4308.648775][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4308.649029][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4308.649351][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4308.649614][ C2] ip_rcv+0x564/0x740 [ 4308.649820][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4308.650049][ C2] ? set_track_prepare+0x8a/0xd0 [ 4308.650305][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4308.650585][ C2] ? start_secondary+0x21c/0x2b0 [ 4308.650837][ C2] ? skb_clone+0x10b/0x330 [ 4308.651067][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4308.651388][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4308.651694][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4308.651976][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4308.652275][ C2] ? __tcf_classify+0x329/0x7d0 [ 4308.652524][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4308.652754][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4308.653056][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4308.653342][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4308.653667][ C2] ? lock_acquire+0x1c1/0x220 [ 4308.653909][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4308.654208][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4308.654491][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4308.654808][ C2] ? __copy_skb_header+0xaf/0x490 [ 4308.655067][ C2] ? __skb_clone+0x57a/0x760 [ 4308.655304][ C2] netif_receive_skb+0x55/0x280 [ 4308.655553][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4308.655865][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4308.656203][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4308.656503][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4308.656782][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4308.657075][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4308.657392][ C2] ? get_stack_info+0x36/0xc0 [ 4308.657634][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4308.657901][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4308.658221][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4308.658510][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4308.658788][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4308.659104][ C2] ? kernel_text_address+0x17/0xe0 [ 4308.659367][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4308.659682][ C2] ? arch_stack_walk+0x8c/0x100 [ 4308.659931][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4308.660211][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4308.660516][ C2] ? lock_acquire+0x1c1/0x220 [ 4308.660759][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4308.661044][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4308.661348][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4308.661628][ C2] ? get_stack_info+0x36/0xc0 [ 4308.661866][ C2] __tcf_classify+0x329/0x7d0 [ 4308.662110][ C2] tcf_classify+0x283/0x930 [ 4308.662344][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4308.662601][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4308.662915][ C2] tc_run+0x2e4/0x5d0 [ 4308.663122][ C2] ? __pfx_tc_run+0x10/0x10 [ 4308.663352][ C2] ? lock_acquire+0x1c1/0x220 [ 4308.663591][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4308.663851][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4308.664105][ C2] ? lock_acquire+0x1c1/0x220 [ 4308.664345][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4308.664609][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4308.664915][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4308.665188][ C2] ? neigh_hh_output+0x348/0x590 [ 4308.665442][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4308.665707][ C2] ip_finish_output2+0x786/0x18e0 [ 4308.665965][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4308.666303][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4308.666581][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4308.666835][ C2] ? __ip_finish_output+0x10f/0x770 [ 4308.667102][ C2] ip_output+0x16b/0x4f0 [ 4308.667318][ C2] ? __pfx_ip_output+0x10/0x10 [ 4308.667562][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4308.667838][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4308.668152][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4308.668438][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4308.668692][ C2] ? __alloc_skb+0xd4/0x280 [ 4308.668922][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4308.669194][ C2] ? tcp_fragment+0x168/0x1040 [ 4308.669439][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4308.669692][ C2] ? ip_local_out+0x114/0x3b0 [ 4308.669933][ C2] __ip_queue_xmit+0x672/0x1910 [ 4308.670182][ C2] ? __skb_clone+0x57a/0x760 [ 4308.670416][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4308.670683][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4308.670964][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4308.671216][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4308.671464][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4308.671766][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4308.672086][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4308.672331][ C2] tcp_send_loss_probe+0x348/0x830 [ 4308.672591][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4308.672859][ C2] tcp_write_timer+0x82/0x1d0 [ 4308.673100][ C2] call_timer_fn+0x173/0x430 [ 4308.673338][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4308.673601][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4308.673862][ C2] __run_timers.part.0+0x52d/0x890 [ 4308.674123][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4308.674393][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4308.674676][ C2] ? lock_acquire+0x1c1/0x220 [ 4308.674915][ C2] ? clockevents_program_event+0xf6/0x300 [ 4308.675209][ C2] ? lock_release+0x1d5/0x250 [ 4308.675446][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4308.675711][ C2] ? ktime_get+0xb3/0x190 [ 4308.675938][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4308.676237][ C2] run_timer_softirq+0x72/0x100 [ 4308.676492][ C2] __do_softirq+0x1b9/0x7ff [ 4308.676738][ C2] irq_exit_rcu+0x98/0xc0 [ 4308.676960][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4308.677249][ C2] [ 4308.677398][ C2] [ 4308.677551][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4308.677854][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4308.678112][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4308.679096][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4308.679403][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4308.679804][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4308.680202][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4308.680599][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4308.680995][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4308.681400][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4308.681687][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4308.681948][ C2] default_idle_call+0x69/0xa0 [ 4308.682194][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4308.682446][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4308.682722][ C2] ? lock_release+0x1d5/0x250 [ 4308.682961][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4308.683236][ C2] do_idle+0xfb/0x160 [ 4308.683440][ C2] cpu_startup_entry+0x55/0x60 [ 4308.683683][ C2] start_secondary+0x21c/0x2b0 [ 4308.683926][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4308.684195][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4308.684507][ C2] [ 4332.368103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4332.368483][ C1] rcu: 1-....: (1972888 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=478215 [ 4332.369040][ C1] rcu: (t=1977481 jiffies g=1882453 q=706 ncpus=4) [ 4332.369375][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4332.369825][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4332.370437][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4332.370768][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4332.371746][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4332.372054][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4332.372457][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4332.372857][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4332.373257][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4332.373656][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4332.374057][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4332.374505][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4332.374839][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4332.375241][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4332.375640][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4332.376042][ C1] PKRU: 55555554 [ 4332.376223][ C1] Call Trace: [ 4332.376393][ C1] [ 4332.376542][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4332.376817][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4332.377072][ C1] ? check_cpu_stall+0x284/0x500 [ 4332.377325][ C1] ? rcu_pending+0x92/0x360 [ 4332.377555][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4332.377824][ C1] ? update_process_times+0xb9/0x110 [ 4332.378097][ C1] ? tick_sched_handle+0x67/0x130 [ 4332.378360][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4332.378646][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4332.378890][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4332.379203][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4332.379476][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4332.379765][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4332.380032][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4332.380342][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4332.380605][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4332.380916][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4332.381214][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4332.381530][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4332.381818][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4332.382116][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4332.382403][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4332.382716][ C1] ? get_stack_info+0x36/0xc0 [ 4332.382958][ C1] ? lock_acquire+0x1c1/0x220 [ 4332.383201][ C1] ? lock_release+0x1d5/0x250 [ 4332.383440][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4332.383689][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4332.383963][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4332.384249][ C1] ? lock_acquire+0x1c1/0x220 [ 4332.384490][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4332.384731][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4332.384992][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4332.385227][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4332.385474][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4332.385732][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4332.386009][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4332.386290][ C1] ip_local_deliver+0x19d/0x480 [ 4332.386536][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4332.386814][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4332.387079][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4332.387426][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4332.387679][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4332.387999][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4332.388266][ C1] ip_rcv+0x564/0x740 [ 4332.388470][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4332.388703][ C1] ? set_track_prepare+0x8a/0xd0 [ 4332.388959][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4332.389236][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4332.389509][ C1] ? skb_clone+0x10b/0x330 [ 4332.389739][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4332.390058][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4332.390365][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4332.390648][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4332.390944][ C1] ? __tcf_classify+0x329/0x7d0 [ 4332.391193][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4332.391423][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4332.391725][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4332.392008][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4332.392333][ C1] ? lock_acquire+0x1c1/0x220 [ 4332.392573][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4332.392871][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4332.393156][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4332.393474][ C1] ? __copy_skb_header+0xaf/0x490 [ 4332.393732][ C1] ? __skb_clone+0x57a/0x760 [ 4332.393969][ C1] netif_receive_skb+0x55/0x280 [ 4332.394218][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4332.394531][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4332.394865][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4332.395164][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4332.395439][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4332.395729][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4332.396042][ C1] ? hlock_class+0x4e/0x130 [ 4332.396274][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4332.396552][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4332.396828][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4332.397093][ C1] ? hlock_class+0x4e/0x130 [ 4332.397326][ C1] ? mark_lock+0x38/0x3e0 [ 4332.397546][ C1] ? stack_access_ok+0xda/0x1f0 [ 4332.397795][ C1] ? __lock_acquire+0xb67/0x1610 [ 4332.398050][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4332.398330][ C1] ? get_stack_info+0x36/0xc0 [ 4332.398572][ C1] ? stack_access_ok+0xda/0x1f0 [ 4332.398821][ C1] ? get_reg+0x119/0x190 [ 4332.399036][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4332.399303][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4332.399614][ C1] __tcf_classify+0x329/0x7d0 [ 4332.399857][ C1] tcf_classify+0x283/0x930 [ 4332.400090][ C1] ? arch_stack_walk+0xa2/0x100 [ 4332.400338][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4332.400594][ C1] ? get_stack_info+0x36/0xc0 [ 4332.400835][ C1] tc_run+0x2e4/0x5d0 [ 4332.401041][ C1] ? __pfx_tc_run+0x10/0x10 [ 4332.401274][ C1] ? lock_acquire+0x1c1/0x220 [ 4332.401515][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4332.401777][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4332.402031][ C1] ? lock_acquire+0x1c1/0x220 [ 4332.402270][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4332.402537][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4332.402841][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4332.403116][ C1] ? neigh_hh_output+0x348/0x590 [ 4332.403369][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4332.403640][ C1] ip_finish_output2+0x786/0x18e0 [ 4332.403897][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4332.404174][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4332.404512][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4332.404789][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4332.405043][ C1] ? __ip_finish_output+0x10f/0x770 [ 4332.405310][ C1] ip_output+0x16b/0x4f0 [ 4332.405526][ C1] ? run_timer_softirq+0x72/0x100 [ 4332.405783][ C1] ? __pfx_ip_output+0x10/0x10 [ 4332.406028][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4332.406314][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4332.406567][ C1] ? ip_local_out+0x114/0x3b0 [ 4332.406810][ C1] __ip_queue_xmit+0x672/0x1910 [ 4332.407060][ C1] ? __create_object+0x5e/0xb0 [ 4332.407305][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4332.407572][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4332.407853][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4332.408127][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4332.408420][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4332.408693][ C1] tcp_delack_timer+0x84/0x240 [ 4332.408939][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4332.409211][ C1] call_timer_fn+0x173/0x430 [ 4332.409450][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4332.409713][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4332.409975][ C1] __run_timers.part.0+0x52d/0x890 [ 4332.410239][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4332.410513][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4332.410799][ C1] ? lock_acquire+0x1c1/0x220 [ 4332.411037][ C1] ? clockevents_program_event+0xf6/0x300 [ 4332.411329][ C1] ? lock_release+0x1d5/0x250 [ 4332.411569][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4332.411838][ C1] ? ktime_get+0xb3/0x190 [ 4332.412059][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4332.412359][ C1] run_timer_softirq+0x72/0x100 [ 4332.412609][ C1] __do_softirq+0x1b9/0x7ff [ 4332.412841][ C1] irq_exit_rcu+0x98/0xc0 [ 4332.413063][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4332.413348][ C1] [ 4332.413499][ C1] [ 4332.413651][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4332.413958][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4332.414284][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4332.415259][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4332.415569][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4332.415969][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4332.416370][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4332.416769][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4332.417172][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4332.417573][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4332.417871][ C1] pipe_read+0xa16/0xdf0 [ 4332.418094][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4332.418377][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4332.418622][ C1] ? iterate_tty_write+0x299/0x540 [ 4332.418884][ C1] ? lock_release+0x1d5/0x250 [ 4332.419127][ C1] vfs_read+0x911/0xc00 [ 4332.419341][ C1] ? lock_acquire+0x1c1/0x220 [ 4332.419581][ C1] ? __might_fault+0xc6/0x180 [ 4332.419822][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4332.420061][ C1] ? __might_fault+0xc6/0x180 [ 4332.420302][ C1] ? lock_release+0x1d5/0x250 [ 4332.420544][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4332.420809][ C1] ? __fget_light+0x54/0x1e0 [ 4332.421048][ C1] ksys_read+0x17a/0x1e0 [ 4332.421266][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4332.421512][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4332.421818][ C1] do_syscall_64+0xc9/0x1e0 [ 4332.422050][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4332.422352][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4332.422579][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4332.423555][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4332.423976][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4332.424376][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4332.424777][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4332.425179][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4332.425578][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4332.425981][ C1] [ 4332.426140][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4332.426424][ C2] NMI backtrace for cpu 2 [ 4332.426435][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4332.426440][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4332.426443][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4332.426454][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4332.426457][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [ 4332.426462][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4332.426464][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4332.426466][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4332.426467][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4332.426470][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4332.426471][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4332.426474][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4332.426478][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4332.426479][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4332.426481][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4332.426482][ C2] PKRU: 55555554 [ 4332.426483][ C2] Call Trace: [ 4332.426487][ C2] [ 4332.426493][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4332.426502][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4332.426509][ C2] ? nmi_handle+0x153/0x420 [ 4332.426514][ C2] ? default_do_nmi+0x41/0x100 [ 4332.426518][ C2] ? exc_nmi+0xf3/0x120 [ 4332.426521][ C2] ? end_repeat_nmi+0xf/0x60 [ 4332.426528][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4332.426533][ C2] ? kasan_check_range+0x12/0x1c0 [ 4332.426536][ C2] ? kasan_check_range+0x12/0x1c0 [ 4332.426539][ C2] ? kasan_check_range+0x12/0x1c0 [ 4332.426542][ C2] [ 4332.426544][ C2] [ 4332.426545][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4332.426549][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4332.426552][ C2] ? get_stack_info+0x36/0xc0 [ 4332.426557][ C2] ? lock_acquire+0x1c1/0x220 [ 4332.426561][ C2] ? lock_release+0x1d5/0x250 [ 4332.426565][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4332.426569][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4332.426572][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4332.426576][ C2] ? lock_acquire+0x1c1/0x220 [ 4332.426578][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4332.426582][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4332.426586][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4332.426593][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4332.426596][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4332.426601][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4332.426609][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4332.426613][ C2] ip_local_deliver+0x19d/0x480 [ 4332.426616][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4332.426618][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4332.426621][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4332.426628][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4332.426633][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4332.426636][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4332.426647][ C2] ip_rcv+0x564/0x740 [ 4332.426650][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4332.426653][ C2] ? set_track_prepare+0x8a/0xd0 [ 4332.426658][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4332.426661][ C2] ? start_secondary+0x21c/0x2b0 [ 4332.426666][ C2] ? skb_clone+0x10b/0x330 [ 4332.426671][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4332.426678][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4332.426683][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4332.426689][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4332.426698][ C2] ? __tcf_classify+0x329/0x7d0 [ 4332.426702][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4332.426705][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4332.426709][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4332.426712][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4332.426716][ C2] ? lock_acquire+0x1c1/0x220 [ 4332.426719][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4332.426723][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4332.426727][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4332.426731][ C2] ? __copy_skb_header+0xaf/0x490 [ 4332.426736][ C2] ? __skb_clone+0x57a/0x760 [ 4332.426739][ C2] netif_receive_skb+0x55/0x280 [ 4332.426742][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4332.426750][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4332.426757][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4332.426763][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4332.426768][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4332.426779][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4332.426786][ C2] ? get_stack_info+0x36/0xc0 [ 4332.426791][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4332.426795][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4332.426801][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4332.426804][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4332.426807][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4332.426809][ C2] ? kernel_text_address+0x17/0xe0 [ 4332.426813][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4332.426820][ C2] ? arch_stack_walk+0x8c/0x100 [ 4332.426824][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4332.426827][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4332.426831][ C2] ? lock_acquire+0x1c1/0x220 [ 4332.426833][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4332.426838][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4332.426844][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4332.426847][ C2] ? get_stack_info+0x36/0xc0 [ 4332.426851][ C2] __tcf_classify+0x329/0x7d0 [ 4332.426857][ C2] tcf_classify+0x283/0x930 [ 4332.426862][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4332.426865][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4332.426870][ C2] tc_run+0x2e4/0x5d0 [ 4332.426875][ C2] ? __pfx_tc_run+0x10/0x10 [ 4332.426878][ C2] ? lock_acquire+0x1c1/0x220 [ 4332.426880][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4332.426884][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4332.426889][ C2] ? lock_acquire+0x1c1/0x220 [ 4332.426891][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4332.426895][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4332.426898][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4332.426901][ C2] ? neigh_hh_output+0x348/0x590 [ 4332.426904][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4332.426908][ C2] ip_finish_output2+0x786/0x18e0 [ 4332.426912][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4332.426920][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4332.426922][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4332.426926][ C2] ? __ip_finish_output+0x10f/0x770 [ 4332.426929][ C2] ip_output+0x16b/0x4f0 [ 4332.426933][ C2] ? __pfx_ip_output+0x10/0x10 [ 4332.426935][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4332.426938][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4332.426941][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4332.426945][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4332.426948][ C2] ? __alloc_skb+0xd4/0x280 [ 4332.426951][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4332.426956][ C2] ? tcp_fragment+0x168/0x1040 [ 4332.426959][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4332.426962][ C2] ? ip_local_out+0x114/0x3b0 [ 4332.426966][ C2] __ip_queue_xmit+0x672/0x1910 [ 4332.426971][ C2] ? __skb_clone+0x57a/0x760 [ 4332.426974][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4332.426980][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4332.426983][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4332.426988][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4332.426993][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4332.426998][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4332.427001][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4332.427004][ C2] tcp_send_loss_probe+0x348/0x830 [ 4332.427008][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4332.427011][ C2] tcp_write_timer+0x82/0x1d0 [ 4332.427014][ C2] call_timer_fn+0x173/0x430 [ 4332.427020][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4332.427024][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4332.427029][ C2] __run_timers.part.0+0x52d/0x890 [ 4332.427032][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4332.427036][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4332.427039][ C2] ? lock_acquire+0x1c1/0x220 [ 4332.427041][ C2] ? clockevents_program_event+0xf6/0x300 [ 4332.427046][ C2] ? lock_release+0x1d5/0x250 [ 4332.427048][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4332.427052][ C2] ? ktime_get+0xb3/0x190 [ 4332.427055][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4332.427059][ C2] run_timer_softirq+0x72/0x100 [ 4332.427063][ C2] __do_softirq+0x1b9/0x7ff [ 4332.427067][ C2] irq_exit_rcu+0x98/0xc0 [ 4332.427070][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4332.427074][ C2] [ 4332.427075][ C2] [ 4332.427076][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4332.427080][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4332.427083][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4332.427086][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4332.427088][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4332.427090][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4332.427092][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4332.427093][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4332.427095][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4332.427098][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4332.427101][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4332.427106][ C2] default_idle_call+0x69/0xa0 [ 4332.427109][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4332.427112][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4332.427116][ C2] ? lock_release+0x1d5/0x250 [ 4332.427119][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4332.427123][ C2] do_idle+0xfb/0x160 [ 4332.427126][ C2] cpu_startup_entry+0x55/0x60 [ 4332.427128][ C2] start_secondary+0x21c/0x2b0 [ 4332.427131][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4332.427135][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4332.427142][ C2] [ 4356.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1866s! [perl:4135] [ 4356.569708][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4356.570978][ C1] irq event stamp: 209232 [ 4356.571200][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4356.571734][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4356.572216][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4356.572689][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4356.573160][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4356.573610][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4356.574223][ C1] RIP: 0010:kasan_check_range+0x74/0x1c0 [ 4356.574514][ C1] Code: ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 <49> 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e [ 4356.575487][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [ 4356.575796][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4356.576197][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4356.576597][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: 1ffff110014741c3 [ 4356.576997][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4356.577401][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4356.577802][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4356.578260][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4356.578593][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4356.578995][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4356.579400][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4356.579800][ C1] PKRU: 55555554 [ 4356.579983][ C1] Call Trace: [ 4356.580154][ C1] [ 4356.580304][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4356.580568][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4356.580818][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4356.581096][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4356.581370][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4356.581663][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4356.581931][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4356.582239][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4356.582501][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 4356.582765][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4356.583076][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4356.583373][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4356.583690][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4356.583989][ C1] ? kasan_check_range+0x74/0x1c0 [ 4356.584245][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4356.584526][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4356.584839][ C1] ? get_stack_info+0x36/0xc0 [ 4356.585080][ C1] ? lock_acquire+0x1c1/0x220 [ 4356.585320][ C1] ? lock_release+0x1d5/0x250 [ 4356.585562][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4356.585811][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4356.586083][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4356.586370][ C1] ? lock_acquire+0x1c1/0x220 [ 4356.586607][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4356.586850][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4356.587110][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4356.587356][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4356.587603][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4356.587862][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4356.588148][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4356.588424][ C1] ip_local_deliver+0x19d/0x480 [ 4356.588672][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4356.588943][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4356.589208][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4356.589558][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4356.589811][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4356.590134][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4356.590401][ C1] ip_rcv+0x564/0x740 [ 4356.590605][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4356.590845][ C1] ? set_track_prepare+0x8a/0xd0 [ 4356.591100][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4356.591377][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4356.591650][ C1] ? skb_clone+0x10b/0x330 [ 4356.591880][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4356.592200][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4356.592505][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4356.592791][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4356.593086][ C1] ? __tcf_classify+0x329/0x7d0 [ 4356.593337][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4356.593570][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4356.593871][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4356.594167][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4356.594493][ C1] ? lock_acquire+0x1c1/0x220 [ 4356.594732][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4356.595027][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4356.595314][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4356.595632][ C1] ? __copy_skb_header+0xaf/0x490 [ 4356.595890][ C1] ? __skb_clone+0x57a/0x760 [ 4356.596123][ C1] netif_receive_skb+0x55/0x280 [ 4356.596373][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4356.596687][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4356.597020][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4356.597326][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4356.597601][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4356.597892][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4356.598213][ C1] ? hlock_class+0x4e/0x130 [ 4356.598449][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4356.598726][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4356.599003][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4356.599270][ C1] ? hlock_class+0x4e/0x130 [ 4356.599501][ C1] ? mark_lock+0x38/0x3e0 [ 4356.599725][ C1] ? stack_access_ok+0xda/0x1f0 [ 4356.599975][ C1] ? __lock_acquire+0xb67/0x1610 [ 4356.600230][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4356.600509][ C1] ? get_stack_info+0x36/0xc0 [ 4356.600751][ C1] ? stack_access_ok+0xda/0x1f0 [ 4356.600999][ C1] ? get_reg+0x119/0x190 [ 4356.601218][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4356.601487][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4356.601799][ C1] __tcf_classify+0x329/0x7d0 [ 4356.602042][ C1] tcf_classify+0x283/0x930 [ 4356.602279][ C1] ? arch_stack_walk+0xa2/0x100 [ 4356.602529][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4356.602790][ C1] ? get_stack_info+0x36/0xc0 [ 4356.603033][ C1] tc_run+0x2e4/0x5d0 [ 4356.603240][ C1] ? __pfx_tc_run+0x10/0x10 [ 4356.603474][ C1] ? lock_acquire+0x1c1/0x220 [ 4356.603712][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4356.603975][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4356.604230][ C1] ? lock_acquire+0x1c1/0x220 [ 4356.604470][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4356.604735][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4356.605044][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4356.605317][ C1] ? neigh_hh_output+0x348/0x590 [ 4356.605572][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4356.605837][ C1] ip_finish_output2+0x786/0x18e0 [ 4356.606093][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4356.606377][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4356.606717][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4356.606994][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4356.607248][ C1] ? __ip_finish_output+0x10f/0x770 [ 4356.607514][ C1] ip_output+0x16b/0x4f0 [ 4356.607731][ C1] ? run_timer_softirq+0x72/0x100 [ 4356.607990][ C1] ? __pfx_ip_output+0x10/0x10 [ 4356.608241][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4356.608539][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4356.608792][ C1] ? ip_local_out+0x114/0x3b0 [ 4356.609031][ C1] __ip_queue_xmit+0x672/0x1910 [ 4356.609279][ C1] ? __create_object+0x5e/0xb0 [ 4356.609527][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4356.609794][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4356.610078][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4356.610351][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4356.610631][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4356.610911][ C1] tcp_delack_timer+0x84/0x240 [ 4356.611156][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4356.611435][ C1] call_timer_fn+0x173/0x430 [ 4356.611672][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4356.611935][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4356.612200][ C1] __run_timers.part.0+0x52d/0x890 [ 4356.612462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4356.612739][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4356.613024][ C1] ? lock_acquire+0x1c1/0x220 [ 4356.613266][ C1] ? clockevents_program_event+0xf6/0x300 [ 4356.613559][ C1] ? lock_release+0x1d5/0x250 [ 4356.613800][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4356.614067][ C1] ? ktime_get+0xb3/0x190 [ 4356.614293][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4356.614598][ C1] run_timer_softirq+0x72/0x100 [ 4356.614848][ C1] __do_softirq+0x1b9/0x7ff [ 4356.615083][ C1] irq_exit_rcu+0x98/0xc0 [ 4356.615305][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4356.615596][ C1] [ 4356.615747][ C1] [ 4356.615899][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4356.616205][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4356.616532][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4356.617509][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4356.617820][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4356.618237][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4356.618638][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4356.619038][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4356.619437][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4356.619842][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4356.620141][ C1] pipe_read+0xa16/0xdf0 [ 4356.620363][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4356.620644][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4356.620889][ C1] ? iterate_tty_write+0x299/0x540 [ 4356.621152][ C1] ? lock_release+0x1d5/0x250 [ 4356.621392][ C1] vfs_read+0x911/0xc00 [ 4356.621610][ C1] ? lock_acquire+0x1c1/0x220 [ 4356.621850][ C1] ? __might_fault+0xc6/0x180 [ 4356.622091][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4356.622332][ C1] ? __might_fault+0xc6/0x180 [ 4356.622574][ C1] ? lock_release+0x1d5/0x250 [ 4356.622815][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4356.623082][ C1] ? __fget_light+0x54/0x1e0 [ 4356.623327][ C1] ksys_read+0x17a/0x1e0 [ 4356.623547][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4356.623790][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4356.624095][ C1] do_syscall_64+0xc9/0x1e0 [ 4356.624329][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4356.624628][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4356.624856][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4356.625826][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4356.626249][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4356.626648][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4356.627045][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4356.627444][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4356.627843][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4356.628252][ C1] [ 4356.628410][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1866s! [swapper/2:0] [ 4356.628867][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4356.630126][ C2] irq event stamp: 44114564 [ 4356.630353][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4356.630896][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4356.631411][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4356.631886][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4356.632358][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4356.632814][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4356.633428][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4356.633753][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4356.634726][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4356.635034][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4356.635437][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4356.635837][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4356.636238][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4356.636635][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4356.637038][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4356.637485][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4356.637817][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4356.638229][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4356.638627][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4356.639025][ C2] PKRU: 55555554 [ 4356.639207][ C2] Call Trace: [ 4356.639380][ C2] [ 4356.639530][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4356.639790][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4356.640033][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4356.640311][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4356.640585][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4356.640871][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4356.641137][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4356.641442][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4356.641703][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4356.641970][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4356.642283][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4356.642580][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4356.642894][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4356.643183][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4356.643478][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4356.643765][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4356.644077][ C2] ? get_stack_info+0x36/0xc0 [ 4356.644326][ C2] ? lock_acquire+0x1c1/0x220 [ 4356.644565][ C2] ? lock_release+0x1d5/0x250 [ 4356.644802][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4356.645051][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4356.645323][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4356.645609][ C2] ? lock_acquire+0x1c1/0x220 [ 4356.645846][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4356.646086][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4356.646347][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4356.646582][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4356.646829][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4356.647087][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4356.647363][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4356.647640][ C2] ip_local_deliver+0x19d/0x480 [ 4356.647886][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4356.648170][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4356.648434][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4356.648782][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4356.649035][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4356.649357][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4356.649620][ C2] ip_rcv+0x564/0x740 [ 4356.649825][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4356.650059][ C2] ? set_track_prepare+0x8a/0xd0 [ 4356.650315][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4356.650591][ C2] ? start_secondary+0x21c/0x2b0 [ 4356.650842][ C2] ? skb_clone+0x10b/0x330 [ 4356.651071][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4356.651389][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4356.651693][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4356.651977][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4356.652271][ C2] ? __tcf_classify+0x329/0x7d0 [ 4356.652521][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4356.652752][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4356.653049][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4356.653338][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4356.653662][ C2] ? lock_acquire+0x1c1/0x220 [ 4356.653901][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4356.654198][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4356.654483][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4356.654798][ C2] ? __copy_skb_header+0xaf/0x490 [ 4356.655056][ C2] ? __skb_clone+0x57a/0x760 [ 4356.655291][ C2] netif_receive_skb+0x55/0x280 [ 4356.655539][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4356.655853][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4356.656186][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4356.656486][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4356.656760][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4356.657047][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4356.657361][ C2] ? get_stack_info+0x36/0xc0 [ 4356.657602][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4356.657864][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4356.658190][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4356.658464][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4356.658742][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4356.659054][ C2] ? kernel_text_address+0x17/0xe0 [ 4356.659317][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4356.659629][ C2] ? arch_stack_walk+0x8c/0x100 [ 4356.659875][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4356.660140][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4356.660426][ C2] ? lock_acquire+0x1c1/0x220 [ 4356.660665][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4356.660947][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4356.661252][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4356.661526][ C2] ? get_stack_info+0x36/0xc0 [ 4356.661767][ C2] __tcf_classify+0x329/0x7d0 [ 4356.662008][ C2] tcf_classify+0x283/0x930 [ 4356.662240][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4356.662493][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4356.662805][ C2] tc_run+0x2e4/0x5d0 [ 4356.663009][ C2] ? __pfx_tc_run+0x10/0x10 [ 4356.663243][ C2] ? lock_acquire+0x1c1/0x220 [ 4356.663481][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4356.663741][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4356.663993][ C2] ? lock_acquire+0x1c1/0x220 [ 4356.664229][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4356.664494][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4356.664796][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4356.665067][ C2] ? neigh_hh_output+0x348/0x590 [ 4356.665319][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4356.665588][ C2] ip_finish_output2+0x786/0x18e0 [ 4356.665843][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4356.666180][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4356.666455][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4356.666706][ C2] ? __ip_finish_output+0x10f/0x770 [ 4356.666969][ C2] ip_output+0x16b/0x4f0 [ 4356.667188][ C2] ? __pfx_ip_output+0x10/0x10 [ 4356.667428][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4356.667706][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4356.668016][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4356.668301][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4356.668552][ C2] ? __alloc_skb+0xd4/0x280 [ 4356.668780][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4356.669050][ C2] ? tcp_fragment+0x168/0x1040 [ 4356.669292][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4356.669549][ C2] ? ip_local_out+0x114/0x3b0 [ 4356.669789][ C2] __ip_queue_xmit+0x672/0x1910 [ 4356.670037][ C2] ? __skb_clone+0x57a/0x760 [ 4356.670274][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4356.670542][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4356.670822][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4356.671068][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4356.671320][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4356.671621][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4356.671940][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4356.672183][ C2] tcp_send_loss_probe+0x348/0x830 [ 4356.672443][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4356.672712][ C2] tcp_write_timer+0x82/0x1d0 [ 4356.672950][ C2] call_timer_fn+0x173/0x430 [ 4356.673189][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4356.673451][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4356.673710][ C2] __run_timers.part.0+0x52d/0x890 [ 4356.673974][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4356.674243][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4356.674531][ C2] ? lock_acquire+0x1c1/0x220 [ 4356.674769][ C2] ? clockevents_program_event+0xf6/0x300 [ 4356.675057][ C2] ? lock_release+0x1d5/0x250 [ 4356.675297][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4356.675561][ C2] ? ktime_get+0xb3/0x190 [ 4356.675780][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4356.676078][ C2] run_timer_softirq+0x72/0x100 [ 4356.676327][ C2] __do_softirq+0x1b9/0x7ff [ 4356.676559][ C2] irq_exit_rcu+0x98/0xc0 [ 4356.676778][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4356.677062][ C2] [ 4356.677215][ C2] [ 4356.677364][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4356.677668][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4356.677925][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4356.678902][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4356.679211][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4356.679610][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4356.680007][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4356.680409][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4356.680808][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4356.681208][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4356.681496][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4356.681756][ C2] default_idle_call+0x69/0xa0 [ 4356.681998][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4356.682251][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4356.682531][ C2] ? lock_release+0x1d5/0x250 [ 4356.682768][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4356.683042][ C2] do_idle+0xfb/0x160 [ 4356.683247][ C2] cpu_startup_entry+0x55/0x60 [ 4356.683491][ C2] start_secondary+0x21c/0x2b0 [ 4356.683733][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4356.684002][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4356.684314][ C2] [ 4384.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1892s! [perl:4135] [ 4384.569704][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4384.570973][ C1] irq event stamp: 209232 [ 4384.571195][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4384.571727][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4384.572208][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4384.572682][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4384.573147][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4384.573598][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4384.574216][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4384.574544][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4384.575530][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4384.575840][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4384.576242][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4384.576644][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4384.577045][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4384.577448][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4384.577850][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4384.578309][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4384.578642][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4384.579044][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4384.579448][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4384.579849][ C1] PKRU: 55555554 [ 4384.580032][ C1] Call Trace: [ 4384.580203][ C1] [ 4384.580353][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4384.580617][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4384.580862][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4384.581140][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4384.581414][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4384.581705][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4384.581972][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4384.582280][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4384.582544][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4384.582854][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4384.583152][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4384.583468][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4384.583759][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4384.584062][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4384.584353][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4384.584665][ C1] ? get_stack_info+0x36/0xc0 [ 4384.584907][ C1] ? lock_acquire+0x1c1/0x220 [ 4384.585148][ C1] ? lock_release+0x1d5/0x250 [ 4384.585391][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4384.585640][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4384.585915][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4384.586199][ C1] ? lock_acquire+0x1c1/0x220 [ 4384.586440][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4384.586687][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4384.586949][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4384.587187][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4384.587433][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4384.587691][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4384.587975][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4384.588253][ C1] ip_local_deliver+0x19d/0x480 [ 4384.588501][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4384.588773][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4384.589036][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4384.589385][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4384.589639][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4384.589966][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4384.590231][ C1] ip_rcv+0x564/0x740 [ 4384.590438][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4384.590669][ C1] ? set_track_prepare+0x8a/0xd0 [ 4384.590923][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4384.591203][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4384.591478][ C1] ? skb_clone+0x10b/0x330 [ 4384.591706][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4384.592029][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4384.592338][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4384.592623][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4384.592920][ C1] ? __tcf_classify+0x329/0x7d0 [ 4384.593172][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4384.593418][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4384.593719][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4384.594006][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4384.594334][ C1] ? lock_acquire+0x1c1/0x220 [ 4384.594572][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4384.594872][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4384.595159][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4384.595477][ C1] ? __copy_skb_header+0xaf/0x490 [ 4384.595736][ C1] ? __skb_clone+0x57a/0x760 [ 4384.595974][ C1] netif_receive_skb+0x55/0x280 [ 4384.596225][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4384.596542][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4384.596880][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4384.597181][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4384.597458][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4384.597748][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4384.598069][ C1] ? hlock_class+0x4e/0x130 [ 4384.598304][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4384.598581][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4384.598857][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4384.599122][ C1] ? hlock_class+0x4e/0x130 [ 4384.599356][ C1] ? mark_lock+0x38/0x3e0 [ 4384.599576][ C1] ? stack_access_ok+0xda/0x1f0 [ 4384.599827][ C1] ? __lock_acquire+0xb67/0x1610 [ 4384.600082][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4384.600361][ C1] ? get_stack_info+0x36/0xc0 [ 4384.600601][ C1] ? stack_access_ok+0xda/0x1f0 [ 4384.600850][ C1] ? get_reg+0x119/0x190 [ 4384.601069][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4384.601340][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4384.601650][ C1] __tcf_classify+0x329/0x7d0 [ 4384.601893][ C1] tcf_classify+0x283/0x930 [ 4384.602127][ C1] ? arch_stack_walk+0xa2/0x100 [ 4384.602379][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4384.602637][ C1] ? get_stack_info+0x36/0xc0 [ 4384.602882][ C1] tc_run+0x2e4/0x5d0 [ 4384.603097][ C1] ? __pfx_tc_run+0x10/0x10 [ 4384.603328][ C1] ? lock_acquire+0x1c1/0x220 [ 4384.603569][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4384.603830][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4384.604085][ C1] ? lock_acquire+0x1c1/0x220 [ 4384.604327][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4384.604592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4384.604900][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4384.605175][ C1] ? neigh_hh_output+0x348/0x590 [ 4384.605429][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4384.605698][ C1] ip_finish_output2+0x786/0x18e0 [ 4384.605957][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4384.606237][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4384.606577][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4384.606855][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4384.607110][ C1] ? __ip_finish_output+0x10f/0x770 [ 4384.607377][ C1] ip_output+0x16b/0x4f0 [ 4384.607594][ C1] ? run_timer_softirq+0x72/0x100 [ 4384.607853][ C1] ? __pfx_ip_output+0x10/0x10 [ 4384.608104][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4384.608390][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4384.608641][ C1] ? ip_local_out+0x114/0x3b0 [ 4384.608889][ C1] __ip_queue_xmit+0x672/0x1910 [ 4384.609139][ C1] ? __create_object+0x5e/0xb0 [ 4384.609386][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4384.609654][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4384.609937][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4384.610214][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4384.610498][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4384.610771][ C1] tcp_delack_timer+0x84/0x240 [ 4384.611016][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4384.611289][ C1] call_timer_fn+0x173/0x430 [ 4384.611526][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4384.611790][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4384.612052][ C1] __run_timers.part.0+0x52d/0x890 [ 4384.612321][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4384.612595][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4384.612881][ C1] ? lock_acquire+0x1c1/0x220 [ 4384.613121][ C1] ? clockevents_program_event+0xf6/0x300 [ 4384.613411][ C1] ? lock_release+0x1d5/0x250 [ 4384.613650][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4384.613915][ C1] ? ktime_get+0xb3/0x190 [ 4384.614137][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4384.614434][ C1] run_timer_softirq+0x72/0x100 [ 4384.614683][ C1] __do_softirq+0x1b9/0x7ff [ 4384.614917][ C1] irq_exit_rcu+0x98/0xc0 [ 4384.615138][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4384.615425][ C1] [ 4384.615581][ C1] [ 4384.615736][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4384.616042][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4384.616367][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4384.617340][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4384.617650][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4384.618055][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4384.618454][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4384.618854][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4384.619253][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4384.619655][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4384.619953][ C1] pipe_read+0xa16/0xdf0 [ 4384.620173][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4384.620451][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4384.620694][ C1] ? iterate_tty_write+0x299/0x540 [ 4384.620955][ C1] ? lock_release+0x1d5/0x250 [ 4384.621197][ C1] vfs_read+0x911/0xc00 [ 4384.621412][ C1] ? lock_acquire+0x1c1/0x220 [ 4384.621651][ C1] ? __might_fault+0xc6/0x180 [ 4384.621892][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4384.622132][ C1] ? __might_fault+0xc6/0x180 [ 4384.622371][ C1] ? lock_release+0x1d5/0x250 [ 4384.622610][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4384.622875][ C1] ? __fget_light+0x54/0x1e0 [ 4384.623114][ C1] ksys_read+0x17a/0x1e0 [ 4384.623330][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4384.623575][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4384.623880][ C1] do_syscall_64+0xc9/0x1e0 [ 4384.624113][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4384.624413][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4384.624642][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4384.625613][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4384.626034][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4384.626434][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4384.626838][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4384.627237][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4384.627638][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4384.628050][ C1] [ 4384.628207][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1892s! [swapper/2:0] [ 4384.628659][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4384.629917][ C2] irq event stamp: 44114564 [ 4384.630153][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4384.630693][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4384.631207][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4384.631684][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4384.632156][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4384.632612][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4384.633227][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4384.633549][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4384.634521][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4384.634829][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4384.635230][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4384.635634][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4384.636032][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4384.636433][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4384.636833][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4384.637282][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4384.637614][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4384.638023][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4384.638424][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4384.638823][ C2] PKRU: 55555554 [ 4384.639005][ C2] Call Trace: [ 4384.639176][ C2] [ 4384.639328][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4384.639591][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4384.639833][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4384.640112][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4384.640384][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4384.640672][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4384.640939][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4384.641245][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4384.641507][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4384.641770][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4384.642077][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4384.642376][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4384.642693][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4384.642980][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4384.643271][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4384.643558][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4384.643870][ C2] ? get_stack_info+0x36/0xc0 [ 4384.644113][ C2] ? lock_acquire+0x1c1/0x220 [ 4384.644355][ C2] ? lock_release+0x1d5/0x250 [ 4384.644594][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4384.644846][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4384.645122][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4384.645408][ C2] ? lock_acquire+0x1c1/0x220 [ 4384.645646][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4384.645889][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4384.646150][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4384.646389][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4384.646636][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4384.646895][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4384.647170][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4384.647450][ C2] ip_local_deliver+0x19d/0x480 [ 4384.647697][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4384.647980][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4384.648247][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4384.648593][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4384.648847][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4384.649168][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4384.649430][ C2] ip_rcv+0x564/0x740 [ 4384.649637][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4384.649867][ C2] ? set_track_prepare+0x8a/0xd0 [ 4384.650121][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4384.650397][ C2] ? start_secondary+0x21c/0x2b0 [ 4384.650648][ C2] ? skb_clone+0x10b/0x330 [ 4384.650878][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4384.651197][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4384.651505][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4384.651785][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4384.652080][ C2] ? __tcf_classify+0x329/0x7d0 [ 4384.652330][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4384.652562][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4384.652862][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4384.653148][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4384.653473][ C2] ? lock_acquire+0x1c1/0x220 [ 4384.653713][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4384.654009][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4384.654296][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4384.654613][ C2] ? __copy_skb_header+0xaf/0x490 [ 4384.654872][ C2] ? __skb_clone+0x57a/0x760 [ 4384.655107][ C2] netif_receive_skb+0x55/0x280 [ 4384.655353][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4384.655666][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4384.655998][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4384.656299][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4384.656573][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4384.656863][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4384.657175][ C2] ? get_stack_info+0x36/0xc0 [ 4384.657416][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4384.657679][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4384.658004][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4384.658284][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4384.658560][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4384.658876][ C2] ? kernel_text_address+0x17/0xe0 [ 4384.659137][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4384.659452][ C2] ? arch_stack_walk+0x8c/0x100 [ 4384.659701][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4384.659965][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4384.660250][ C2] ? lock_acquire+0x1c1/0x220 [ 4384.660489][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4384.660770][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4384.661076][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4384.661353][ C2] ? get_stack_info+0x36/0xc0 [ 4384.661596][ C2] __tcf_classify+0x329/0x7d0 [ 4384.661838][ C2] tcf_classify+0x283/0x930 [ 4384.662070][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4384.662327][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4384.662642][ C2] tc_run+0x2e4/0x5d0 [ 4384.662851][ C2] ? __pfx_tc_run+0x10/0x10 [ 4384.663080][ C2] ? lock_acquire+0x1c1/0x220 [ 4384.663320][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4384.663581][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4384.663835][ C2] ? lock_acquire+0x1c1/0x220 [ 4384.664074][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4384.664341][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4384.664645][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4384.664917][ C2] ? neigh_hh_output+0x348/0x590 [ 4384.665170][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4384.665435][ C2] ip_finish_output2+0x786/0x18e0 [ 4384.665692][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4384.666032][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4384.666308][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4384.666561][ C2] ? __ip_finish_output+0x10f/0x770 [ 4384.666825][ C2] ip_output+0x16b/0x4f0 [ 4384.667044][ C2] ? __pfx_ip_output+0x10/0x10 [ 4384.667291][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4384.667567][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4384.667879][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4384.668162][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4384.668414][ C2] ? __alloc_skb+0xd4/0x280 [ 4384.668646][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4384.668916][ C2] ? tcp_fragment+0x168/0x1040 [ 4384.669161][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4384.669413][ C2] ? ip_local_out+0x114/0x3b0 [ 4384.669651][ C2] __ip_queue_xmit+0x672/0x1910 [ 4384.669901][ C2] ? __skb_clone+0x57a/0x760 [ 4384.670137][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4384.670404][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4384.670685][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4384.670929][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4384.671180][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4384.671482][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4384.671802][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4384.672046][ C2] tcp_send_loss_probe+0x348/0x830 [ 4384.672308][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4384.672576][ C2] tcp_write_timer+0x82/0x1d0 [ 4384.672817][ C2] call_timer_fn+0x173/0x430 [ 4384.673052][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4384.673315][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4384.673579][ C2] __run_timers.part.0+0x52d/0x890 [ 4384.673840][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4384.674112][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4384.674396][ C2] ? lock_acquire+0x1c1/0x220 [ 4384.674635][ C2] ? clockevents_program_event+0xf6/0x300 [ 4384.674924][ C2] ? lock_release+0x1d5/0x250 [ 4384.675165][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4384.675428][ C2] ? ktime_get+0xb3/0x190 [ 4384.675650][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4384.675945][ C2] run_timer_softirq+0x72/0x100 [ 4384.676194][ C2] __do_softirq+0x1b9/0x7ff [ 4384.676427][ C2] irq_exit_rcu+0x98/0xc0 [ 4384.676647][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4384.676933][ C2] [ 4384.677082][ C2] [ 4384.677234][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4384.677537][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4384.677793][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4384.678764][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4384.679072][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4384.679471][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4384.679872][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4384.680271][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4384.680668][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4384.681066][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4384.681358][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4384.681619][ C2] default_idle_call+0x69/0xa0 [ 4384.681863][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4384.682116][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4384.682393][ C2] ? lock_release+0x1d5/0x250 [ 4384.682632][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4384.682905][ C2] do_idle+0xfb/0x160 [ 4384.683109][ C2] cpu_startup_entry+0x55/0x60 [ 4384.683352][ C2] start_secondary+0x21c/0x2b0 [ 4384.683596][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4384.683864][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4384.684175][ C2] [ 4410.426102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4410.426481][ C1] rcu: 1-....: (2050772 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=497403 [ 4410.427039][ C1] rcu: (t=2055539 jiffies g=1882453 q=706 ncpus=4) [ 4410.427373][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4410.427825][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4410.428448][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4410.428780][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4410.429758][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4410.430067][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4410.430470][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4410.430872][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4410.431274][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4410.431682][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4410.432084][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4410.432535][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4410.432869][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4410.433273][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4410.433676][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4410.434078][ C1] PKRU: 55555554 [ 4410.434262][ C1] Call Trace: [ 4410.434431][ C1] [ 4410.434583][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4410.434858][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4410.435112][ C1] ? check_cpu_stall+0x284/0x500 [ 4410.435367][ C1] ? rcu_pending+0x92/0x360 [ 4410.435597][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4410.435870][ C1] ? update_process_times+0xb9/0x110 [ 4410.436142][ C1] ? tick_sched_handle+0x67/0x130 [ 4410.436400][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4410.436686][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4410.436930][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4410.437244][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4410.437518][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4410.437810][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4410.438086][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4410.438392][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4410.438656][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4410.438966][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4410.439266][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4410.439583][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4410.439873][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4410.440171][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4410.440461][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4410.440773][ C1] ? get_stack_info+0x36/0xc0 [ 4410.441017][ C1] ? lock_acquire+0x1c1/0x220 [ 4410.441260][ C1] ? lock_release+0x1d5/0x250 [ 4410.441502][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4410.441751][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4410.442026][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4410.442312][ C1] ? lock_acquire+0x1c1/0x220 [ 4410.442556][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4410.442799][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4410.443061][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4410.443296][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4410.443544][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4410.443803][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4410.444082][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4410.444366][ C1] ip_local_deliver+0x19d/0x480 [ 4410.444615][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4410.444891][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4410.445156][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4410.445507][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4410.445761][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4410.446085][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4410.446351][ C1] ip_rcv+0x564/0x740 [ 4410.446558][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4410.446790][ C1] ? set_track_prepare+0x8a/0xd0 [ 4410.447045][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4410.447324][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4410.447601][ C1] ? skb_clone+0x10b/0x330 [ 4410.447830][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4410.448155][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4410.448463][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4410.448746][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4410.449050][ C1] ? __tcf_classify+0x329/0x7d0 [ 4410.449301][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4410.449531][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4410.449834][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4410.450122][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4410.450450][ C1] ? lock_acquire+0x1c1/0x220 [ 4410.450690][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4410.450989][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4410.451276][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4410.451595][ C1] ? __copy_skb_header+0xaf/0x490 [ 4410.451855][ C1] ? __skb_clone+0x57a/0x760 [ 4410.452093][ C1] netif_receive_skb+0x55/0x280 [ 4410.452344][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4410.452660][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4410.452995][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4410.453295][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4410.453573][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4410.453863][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4410.454187][ C1] ? hlock_class+0x4e/0x130 [ 4410.454420][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4410.454699][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4410.454976][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4410.455241][ C1] ? hlock_class+0x4e/0x130 [ 4410.455475][ C1] ? mark_lock+0x38/0x3e0 [ 4410.455694][ C1] ? stack_access_ok+0xda/0x1f0 [ 4410.455946][ C1] ? __lock_acquire+0xb67/0x1610 [ 4410.456201][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4410.456478][ C1] ? get_stack_info+0x36/0xc0 [ 4410.456720][ C1] ? stack_access_ok+0xda/0x1f0 [ 4410.456968][ C1] ? get_reg+0x119/0x190 [ 4410.457186][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4410.457459][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4410.457769][ C1] __tcf_classify+0x329/0x7d0 [ 4410.458020][ C1] tcf_classify+0x283/0x930 [ 4410.458255][ C1] ? arch_stack_walk+0xa2/0x100 [ 4410.458507][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4410.458765][ C1] ? get_stack_info+0x36/0xc0 [ 4410.459006][ C1] tc_run+0x2e4/0x5d0 [ 4410.459221][ C1] ? __pfx_tc_run+0x10/0x10 [ 4410.459453][ C1] ? lock_acquire+0x1c1/0x220 [ 4410.459694][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4410.459957][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4410.460213][ C1] ? lock_acquire+0x1c1/0x220 [ 4410.460454][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4410.460721][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4410.461028][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4410.461301][ C1] ? neigh_hh_output+0x348/0x590 [ 4410.461559][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4410.461824][ C1] ip_finish_output2+0x786/0x18e0 [ 4410.462082][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4410.462361][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4410.462699][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4410.462978][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4410.463233][ C1] ? __ip_finish_output+0x10f/0x770 [ 4410.463499][ C1] ip_output+0x16b/0x4f0 [ 4410.463715][ C1] ? run_timer_softirq+0x72/0x100 [ 4410.463972][ C1] ? __pfx_ip_output+0x10/0x10 [ 4410.464217][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4410.464503][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4410.464755][ C1] ? ip_local_out+0x114/0x3b0 [ 4410.464998][ C1] __ip_queue_xmit+0x672/0x1910 [ 4410.465249][ C1] ? __create_object+0x5e/0xb0 [ 4410.465495][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4410.465763][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4410.466045][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4410.466320][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4410.466603][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4410.466876][ C1] tcp_delack_timer+0x84/0x240 [ 4410.467122][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4410.467395][ C1] call_timer_fn+0x173/0x430 [ 4410.467632][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4410.467902][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4410.468163][ C1] __run_timers.part.0+0x52d/0x890 [ 4410.468425][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4410.468699][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4410.468988][ C1] ? lock_acquire+0x1c1/0x220 [ 4410.469227][ C1] ? clockevents_program_event+0xf6/0x300 [ 4410.469521][ C1] ? lock_release+0x1d5/0x250 [ 4410.469761][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4410.470027][ C1] ? ktime_get+0xb3/0x190 [ 4410.470249][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4410.470548][ C1] run_timer_softirq+0x72/0x100 [ 4410.470799][ C1] __do_softirq+0x1b9/0x7ff [ 4410.471032][ C1] irq_exit_rcu+0x98/0xc0 [ 4410.471255][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4410.471541][ C1] [ 4410.471694][ C1] [ 4410.471845][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4410.472152][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4410.472479][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4410.473462][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4410.473772][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4410.474172][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4410.474571][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4410.474974][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4410.475376][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4410.475779][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4410.476078][ C1] pipe_read+0xa16/0xdf0 [ 4410.476300][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4410.476577][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4410.476823][ C1] ? iterate_tty_write+0x299/0x540 [ 4410.477085][ C1] ? lock_release+0x1d5/0x250 [ 4410.477328][ C1] vfs_read+0x911/0xc00 [ 4410.477543][ C1] ? lock_acquire+0x1c1/0x220 [ 4410.477784][ C1] ? __might_fault+0xc6/0x180 [ 4410.478039][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4410.478280][ C1] ? __might_fault+0xc6/0x180 [ 4410.478520][ C1] ? lock_release+0x1d5/0x250 [ 4410.478761][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4410.479026][ C1] ? __fget_light+0x54/0x1e0 [ 4410.479265][ C1] ksys_read+0x17a/0x1e0 [ 4410.479483][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4410.479729][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4410.480036][ C1] do_syscall_64+0xc9/0x1e0 [ 4410.480270][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4410.480572][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4410.480801][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4410.481787][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4410.482209][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4410.482611][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4410.483011][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4410.483410][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4410.483809][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4410.484215][ C1] [ 4410.484372][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4410.484647][ C2] NMI backtrace for cpu 2 [ 4410.484657][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4410.484664][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4410.484669][ C2] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 4410.484683][ C2] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 4410.484690][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000216 [ 4410.484696][ C2] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4410.484700][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4410.484703][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4410.484705][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4410.484707][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4410.484709][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4410.484711][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4410.484714][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4410.484716][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4410.484717][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4410.484719][ C2] PKRU: 55555554 [ 4410.484720][ C2] Call Trace: [ 4410.484724][ C2] [ 4410.484728][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4410.484737][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4410.484744][ C2] ? nmi_handle+0x153/0x420 [ 4410.484749][ C2] ? default_do_nmi+0x41/0x100 [ 4410.484753][ C2] ? exc_nmi+0xf3/0x120 [ 4410.484756][ C2] ? end_repeat_nmi+0xf/0x60 [ 4410.484763][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4410.484768][ C2] ? kasan_check_range+0x54/0x1c0 [ 4410.484771][ C2] ? kasan_check_range+0x54/0x1c0 [ 4410.484775][ C2] ? kasan_check_range+0x54/0x1c0 [ 4410.484778][ C2] [ 4410.484778][ C2] [ 4410.484780][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4410.484783][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4410.484786][ C2] ? get_stack_info+0x36/0xc0 [ 4410.484791][ C2] ? lock_acquire+0x1c1/0x220 [ 4410.484796][ C2] ? lock_release+0x1d5/0x250 [ 4410.484799][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4410.484803][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4410.484806][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4410.484810][ C2] ? lock_acquire+0x1c1/0x220 [ 4410.484812][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4410.484817][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4410.484821][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4410.484828][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4410.484830][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4410.484835][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4410.484843][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4410.484847][ C2] ip_local_deliver+0x19d/0x480 [ 4410.484849][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4410.484851][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4410.484854][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4410.484861][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4410.484866][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4410.484869][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4410.484880][ C2] ip_rcv+0x564/0x740 [ 4410.484883][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4410.484885][ C2] ? set_track_prepare+0x8a/0xd0 [ 4410.484891][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4410.484894][ C2] ? start_secondary+0x21c/0x2b0 [ 4410.484899][ C2] ? skb_clone+0x10b/0x330 [ 4410.484903][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4410.484909][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4410.484915][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4410.484920][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4410.484929][ C2] ? __tcf_classify+0x329/0x7d0 [ 4410.484934][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4410.484936][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4410.484940][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4410.484943][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4410.484948][ C2] ? lock_acquire+0x1c1/0x220 [ 4410.484950][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4410.484955][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4410.484959][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4410.484963][ C2] ? __copy_skb_header+0xaf/0x490 [ 4410.484969][ C2] ? __skb_clone+0x57a/0x760 [ 4410.484971][ C2] netif_receive_skb+0x55/0x280 [ 4410.484974][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4410.484983][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4410.484989][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4410.484996][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4410.485001][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4410.485011][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4410.485019][ C2] ? get_stack_info+0x36/0xc0 [ 4410.485024][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4410.485028][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4410.485034][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4410.485037][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4410.485041][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4410.485043][ C2] ? kernel_text_address+0x17/0xe0 [ 4410.485047][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4410.485053][ C2] ? arch_stack_walk+0x8c/0x100 [ 4410.485057][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4410.485060][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4410.485064][ C2] ? lock_acquire+0x1c1/0x220 [ 4410.485066][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4410.485071][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4410.485077][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4410.485079][ C2] ? get_stack_info+0x36/0xc0 [ 4410.485084][ C2] __tcf_classify+0x329/0x7d0 [ 4410.485089][ C2] tcf_classify+0x283/0x930 [ 4410.485094][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4410.485097][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4410.485102][ C2] tc_run+0x2e4/0x5d0 [ 4410.485106][ C2] ? __pfx_tc_run+0x10/0x10 [ 4410.485110][ C2] ? lock_acquire+0x1c1/0x220 [ 4410.485112][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4410.485116][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4410.485120][ C2] ? lock_acquire+0x1c1/0x220 [ 4410.485123][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4410.485127][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4410.485130][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4410.485133][ C2] ? neigh_hh_output+0x348/0x590 [ 4410.485136][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4410.485140][ C2] ip_finish_output2+0x786/0x18e0 [ 4410.485143][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4410.485151][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4410.485154][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4410.485158][ C2] ? __ip_finish_output+0x10f/0x770 [ 4410.485161][ C2] ip_output+0x16b/0x4f0 [ 4410.485165][ C2] ? __pfx_ip_output+0x10/0x10 [ 4410.485168][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4410.485170][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4410.485174][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4410.485177][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4410.485180][ C2] ? __alloc_skb+0xd4/0x280 [ 4410.485183][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4410.485188][ C2] ? tcp_fragment+0x168/0x1040 [ 4410.485191][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4410.485194][ C2] ? ip_local_out+0x114/0x3b0 [ 4410.485198][ C2] __ip_queue_xmit+0x672/0x1910 [ 4410.485202][ C2] ? __skb_clone+0x57a/0x760 [ 4410.485205][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4410.485210][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4410.485213][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4410.485218][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4410.485224][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4410.485228][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4410.485231][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4410.485234][ C2] tcp_send_loss_probe+0x348/0x830 [ 4410.485238][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4410.485240][ C2] tcp_write_timer+0x82/0x1d0 [ 4410.485244][ C2] call_timer_fn+0x173/0x430 [ 4410.485248][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4410.485253][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4410.485257][ C2] __run_timers.part.0+0x52d/0x890 [ 4410.485260][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4410.485264][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4410.485268][ C2] ? lock_acquire+0x1c1/0x220 [ 4410.485270][ C2] ? clockevents_program_event+0xf6/0x300 [ 4410.485276][ C2] ? lock_release+0x1d5/0x250 [ 4410.485279][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4410.485283][ C2] ? ktime_get+0xb3/0x190 [ 4410.485287][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4410.485291][ C2] run_timer_softirq+0x72/0x100 [ 4410.485295][ C2] __do_softirq+0x1b9/0x7ff [ 4410.485299][ C2] irq_exit_rcu+0x98/0xc0 [ 4410.485302][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4410.485307][ C2] [ 4410.485307][ C2] [ 4410.485309][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4410.485312][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4410.485316][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4410.485319][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4410.485321][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4410.485323][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4410.485325][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4410.485326][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4410.485328][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4410.485331][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4410.485334][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4410.485339][ C2] default_idle_call+0x69/0xa0 [ 4410.485342][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4410.485345][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4410.485349][ C2] ? lock_release+0x1d5/0x250 [ 4410.485352][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4410.485356][ C2] do_idle+0xfb/0x160 [ 4410.485358][ C2] cpu_startup_entry+0x55/0x60 [ 4410.485361][ C2] start_secondary+0x21c/0x2b0 [ 4410.485364][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4410.485368][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4410.485374][ C2] [ 4436.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1940s! [perl:4135] [ 4436.569701][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4436.570961][ C1] irq event stamp: 209232 [ 4436.571180][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4436.571708][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4436.572197][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4436.572668][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4436.573133][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4436.573587][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4436.574206][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4436.574534][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4436.575518][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4436.575829][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4436.576232][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4436.576635][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4436.577037][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4436.577442][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4436.577856][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4436.578305][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4436.578640][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4436.579045][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4436.579448][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4436.579850][ C1] PKRU: 55555554 [ 4436.580034][ C1] Call Trace: [ 4436.580207][ C1] [ 4436.580357][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4436.580621][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4436.580867][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4436.581145][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4436.581424][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4436.581717][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4436.581985][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4436.582293][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4436.582557][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4436.582867][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4436.583163][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4436.583480][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4436.583772][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4436.584068][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4436.584361][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4436.584674][ C1] ? get_stack_info+0x36/0xc0 [ 4436.584915][ C1] ? lock_acquire+0x1c1/0x220 [ 4436.585158][ C1] ? lock_release+0x1d5/0x250 [ 4436.585400][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4436.585651][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4436.585924][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4436.586211][ C1] ? lock_acquire+0x1c1/0x220 [ 4436.586450][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4436.586694][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4436.586958][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4436.587195][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4436.587444][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4436.587704][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4436.587991][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4436.588269][ C1] ip_local_deliver+0x19d/0x480 [ 4436.588519][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4436.588793][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4436.589058][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4436.589411][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4436.589669][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4436.589992][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4436.590258][ C1] ip_rcv+0x564/0x740 [ 4436.590468][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4436.590700][ C1] ? set_track_prepare+0x8a/0xd0 [ 4436.590956][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4436.591237][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4436.591512][ C1] ? skb_clone+0x10b/0x330 [ 4436.591743][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4436.592072][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4436.592380][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4436.592665][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4436.592960][ C1] ? __tcf_classify+0x329/0x7d0 [ 4436.593212][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4436.593445][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4436.593746][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4436.594036][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4436.594369][ C1] ? lock_acquire+0x1c1/0x220 [ 4436.594610][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4436.594908][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4436.595202][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4436.595520][ C1] ? __copy_skb_header+0xaf/0x490 [ 4436.595779][ C1] ? __skb_clone+0x57a/0x760 [ 4436.596015][ C1] netif_receive_skb+0x55/0x280 [ 4436.596265][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4436.596580][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4436.596914][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4436.597216][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4436.597493][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4436.597790][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4436.598107][ C1] ? hlock_class+0x4e/0x130 [ 4436.598343][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4436.598620][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4436.598897][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4436.599163][ C1] ? hlock_class+0x4e/0x130 [ 4436.599396][ C1] ? mark_lock+0x38/0x3e0 [ 4436.599617][ C1] ? stack_access_ok+0xda/0x1f0 [ 4436.599867][ C1] ? __lock_acquire+0xb67/0x1610 [ 4436.600122][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4436.600402][ C1] ? get_stack_info+0x36/0xc0 [ 4436.600642][ C1] ? stack_access_ok+0xda/0x1f0 [ 4436.600891][ C1] ? get_reg+0x119/0x190 [ 4436.601116][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4436.601384][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4436.601695][ C1] __tcf_classify+0x329/0x7d0 [ 4436.601936][ C1] tcf_classify+0x283/0x930 [ 4436.602170][ C1] ? arch_stack_walk+0xa2/0x100 [ 4436.602422][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4436.602679][ C1] ? get_stack_info+0x36/0xc0 [ 4436.602923][ C1] tc_run+0x2e4/0x5d0 [ 4436.603129][ C1] ? __pfx_tc_run+0x10/0x10 [ 4436.603361][ C1] ? lock_acquire+0x1c1/0x220 [ 4436.603600][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4436.603862][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4436.604115][ C1] ? lock_acquire+0x1c1/0x220 [ 4436.604355][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4436.604621][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4436.604928][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4436.605201][ C1] ? neigh_hh_output+0x348/0x590 [ 4436.605455][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4436.605721][ C1] ip_finish_output2+0x786/0x18e0 [ 4436.605978][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4436.606258][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4436.606599][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4436.606876][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4436.607131][ C1] ? __ip_finish_output+0x10f/0x770 [ 4436.607396][ C1] ip_output+0x16b/0x4f0 [ 4436.607613][ C1] ? run_timer_softirq+0x72/0x100 [ 4436.607880][ C1] ? __pfx_ip_output+0x10/0x10 [ 4436.608126][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4436.608419][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4436.608672][ C1] ? ip_local_out+0x114/0x3b0 [ 4436.608912][ C1] __ip_queue_xmit+0x672/0x1910 [ 4436.609162][ C1] ? __create_object+0x5e/0xb0 [ 4436.609408][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4436.609676][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4436.609960][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4436.610238][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4436.610521][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4436.610793][ C1] tcp_delack_timer+0x84/0x240 [ 4436.611047][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4436.611318][ C1] call_timer_fn+0x173/0x430 [ 4436.611555][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4436.611816][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4436.612078][ C1] __run_timers.part.0+0x52d/0x890 [ 4436.612338][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4436.612613][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4436.612898][ C1] ? lock_acquire+0x1c1/0x220 [ 4436.613138][ C1] ? clockevents_program_event+0xf6/0x300 [ 4436.613428][ C1] ? lock_release+0x1d5/0x250 [ 4436.613668][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4436.613932][ C1] ? ktime_get+0xb3/0x190 [ 4436.614155][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4436.614451][ C1] run_timer_softirq+0x72/0x100 [ 4436.614706][ C1] __do_softirq+0x1b9/0x7ff [ 4436.614940][ C1] irq_exit_rcu+0x98/0xc0 [ 4436.615161][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4436.615448][ C1] [ 4436.615599][ C1] [ 4436.615749][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4436.616056][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4436.616382][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4436.617360][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4436.617669][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4436.618074][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4436.618477][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4436.618881][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4436.619282][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4436.619684][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4436.619983][ C1] pipe_read+0xa16/0xdf0 [ 4436.620204][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4436.620494][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4436.620738][ C1] ? iterate_tty_write+0x299/0x540 [ 4436.621001][ C1] ? lock_release+0x1d5/0x250 [ 4436.621242][ C1] vfs_read+0x911/0xc00 [ 4436.621459][ C1] ? lock_acquire+0x1c1/0x220 [ 4436.621697][ C1] ? __might_fault+0xc6/0x180 [ 4436.621943][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4436.622184][ C1] ? __might_fault+0xc6/0x180 [ 4436.622426][ C1] ? lock_release+0x1d5/0x250 [ 4436.622665][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4436.622933][ C1] ? __fget_light+0x54/0x1e0 [ 4436.623175][ C1] ksys_read+0x17a/0x1e0 [ 4436.623393][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4436.623638][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4436.623945][ C1] do_syscall_64+0xc9/0x1e0 [ 4436.624179][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4436.624479][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4436.624710][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4436.625685][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4436.626116][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4436.626516][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4436.626915][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4436.627316][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4436.627716][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4436.628122][ C1] [ 4436.628279][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1940s! [swapper/2:0] [ 4436.628726][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4436.629977][ C2] irq event stamp: 44114564 [ 4436.630208][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4436.630744][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4436.631255][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4436.631732][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4436.632202][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4436.632658][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4436.633270][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4436.633595][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4436.634561][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4436.634868][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4436.635267][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4436.635664][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4436.636062][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4436.636464][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4436.636862][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4436.637309][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4436.637640][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4436.638044][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4436.638446][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4436.638842][ C2] PKRU: 55555554 [ 4436.639025][ C2] Call Trace: [ 4436.639196][ C2] [ 4436.639346][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4436.639608][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4436.639852][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4436.640128][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4436.640399][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4436.640688][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4436.640951][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4436.641257][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4436.641518][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4436.641780][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4436.642088][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4436.642384][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4436.642698][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4436.642986][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4436.643281][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4436.643570][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4436.643881][ C2] ? get_stack_info+0x36/0xc0 [ 4436.644120][ C2] ? lock_acquire+0x1c1/0x220 [ 4436.644361][ C2] ? lock_release+0x1d5/0x250 [ 4436.644601][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4436.644849][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4436.645121][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4436.645403][ C2] ? lock_acquire+0x1c1/0x220 [ 4436.645643][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4436.645884][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4436.646144][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4436.646378][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4436.646624][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4436.646881][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4436.647158][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4436.647432][ C2] ip_local_deliver+0x19d/0x480 [ 4436.647679][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4436.647955][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4436.648217][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4436.648571][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4436.648826][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4436.649146][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4436.649408][ C2] ip_rcv+0x564/0x740 [ 4436.649612][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4436.649840][ C2] ? set_track_prepare+0x8a/0xd0 [ 4436.650094][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4436.650372][ C2] ? start_secondary+0x21c/0x2b0 [ 4436.650622][ C2] ? skb_clone+0x10b/0x330 [ 4436.650848][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4436.651169][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4436.651475][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4436.651756][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4436.652050][ C2] ? __tcf_classify+0x329/0x7d0 [ 4436.652300][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4436.652529][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4436.652829][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4436.653112][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4436.653437][ C2] ? lock_acquire+0x1c1/0x220 [ 4436.653675][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4436.653971][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4436.654257][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4436.654572][ C2] ? __copy_skb_header+0xaf/0x490 [ 4436.654829][ C2] ? __skb_clone+0x57a/0x760 [ 4436.655064][ C2] netif_receive_skb+0x55/0x280 [ 4436.655311][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4436.655621][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4436.655953][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4436.656250][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4436.656524][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4436.656811][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4436.657124][ C2] ? get_stack_info+0x36/0xc0 [ 4436.657363][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4436.657628][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4436.657948][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4436.658225][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4436.658500][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4436.658813][ C2] ? kernel_text_address+0x17/0xe0 [ 4436.659072][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4436.659385][ C2] ? arch_stack_walk+0x8c/0x100 [ 4436.659633][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4436.659895][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4436.660180][ C2] ? lock_acquire+0x1c1/0x220 [ 4436.660417][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4436.660700][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4436.661002][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4436.661281][ C2] ? get_stack_info+0x36/0xc0 [ 4436.661518][ C2] __tcf_classify+0x329/0x7d0 [ 4436.661759][ C2] tcf_classify+0x283/0x930 [ 4436.661991][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4436.662248][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4436.662560][ C2] tc_run+0x2e4/0x5d0 [ 4436.662765][ C2] ? __pfx_tc_run+0x10/0x10 [ 4436.662995][ C2] ? lock_acquire+0x1c1/0x220 [ 4436.663233][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4436.663493][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4436.663746][ C2] ? lock_acquire+0x1c1/0x220 [ 4436.663984][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4436.664249][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4436.664552][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4436.664821][ C2] ? neigh_hh_output+0x348/0x590 [ 4436.665072][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4436.665336][ C2] ip_finish_output2+0x786/0x18e0 [ 4436.665591][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4436.665926][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4436.666203][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4436.666454][ C2] ? __ip_finish_output+0x10f/0x770 [ 4436.666718][ C2] ip_output+0x16b/0x4f0 [ 4436.666934][ C2] ? __pfx_ip_output+0x10/0x10 [ 4436.667177][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4436.667451][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4436.667765][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4436.668038][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4436.668290][ C2] ? __alloc_skb+0xd4/0x280 [ 4436.668520][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4436.668787][ C2] ? tcp_fragment+0x168/0x1040 [ 4436.669030][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4436.669282][ C2] ? ip_local_out+0x114/0x3b0 [ 4436.669521][ C2] __ip_queue_xmit+0x672/0x1910 [ 4436.669768][ C2] ? __skb_clone+0x57a/0x760 [ 4436.669999][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4436.670265][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4436.670547][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4436.670788][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4436.671035][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4436.671337][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4436.671658][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4436.671901][ C2] tcp_send_loss_probe+0x348/0x830 [ 4436.672161][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4436.672427][ C2] tcp_write_timer+0x82/0x1d0 [ 4436.672666][ C2] call_timer_fn+0x173/0x430 [ 4436.672902][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4436.673164][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4436.673424][ C2] __run_timers.part.0+0x52d/0x890 [ 4436.673683][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4436.673952][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4436.674234][ C2] ? lock_acquire+0x1c1/0x220 [ 4436.674473][ C2] ? clockevents_program_event+0xf6/0x300 [ 4436.674764][ C2] ? lock_release+0x1d5/0x250 [ 4436.675001][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4436.675267][ C2] ? ktime_get+0xb3/0x190 [ 4436.675486][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4436.675783][ C2] run_timer_softirq+0x72/0x100 [ 4436.676028][ C2] __do_softirq+0x1b9/0x7ff [ 4436.676261][ C2] irq_exit_rcu+0x98/0xc0 [ 4436.676479][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4436.676764][ C2] [ 4436.676913][ C2] [ 4436.677065][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4436.677367][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4436.677622][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4436.678593][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4436.678896][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4436.679297][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4436.679693][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4436.680089][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4436.680485][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4436.680884][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4436.681171][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4436.681432][ C2] default_idle_call+0x69/0xa0 [ 4436.681675][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4436.681925][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4436.682202][ C2] ? lock_release+0x1d5/0x250 [ 4436.682441][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4436.682713][ C2] do_idle+0xfb/0x160 [ 4436.682917][ C2] cpu_startup_entry+0x55/0x60 [ 4436.683158][ C2] start_secondary+0x21c/0x2b0 [ 4436.683401][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4436.683668][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4436.683979][ C2] [ 4464.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 1966s! [swapper/2:0] [ 4464.569697][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4464.570954][ C2] irq event stamp: 44114564 [ 4464.571182][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4464.571719][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4464.572231][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4464.572706][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4464.573176][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4464.573633][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4464.574244][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4464.574568][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4464.575537][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4464.575846][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4464.576244][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4464.576643][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4464.577041][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4464.577438][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4464.577841][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4464.578289][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4464.578622][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4464.579022][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4464.579419][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4464.579818][ C2] PKRU: 55555554 [ 4464.579998][ C2] Call Trace: [ 4464.580170][ C2] [ 4464.580316][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4464.580578][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4464.580820][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4464.581096][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4464.581368][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4464.581655][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4464.581919][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4464.582223][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4464.582482][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4464.582744][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4464.583053][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4464.583349][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4464.583662][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4464.583948][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4464.584245][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4464.584530][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4464.584841][ C2] ? get_stack_info+0x36/0xc0 [ 4464.585081][ C2] ? lock_acquire+0x1c1/0x220 [ 4464.585322][ C2] ? lock_release+0x1d5/0x250 [ 4464.585558][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4464.585808][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4464.586080][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4464.586365][ C2] ? lock_acquire+0x1c1/0x220 [ 4464.586607][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4464.586845][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4464.587104][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4464.587338][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4464.587583][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4464.587846][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4464.588120][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4464.588397][ C2] ip_local_deliver+0x19d/0x480 [ 4464.588642][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4464.588915][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4464.589179][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4464.589523][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4464.589775][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4464.590093][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4464.590354][ C2] ip_rcv+0x564/0x740 [ 4464.590555][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4464.590787][ C2] ? set_track_prepare+0x8a/0xd0 [ 4464.591040][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4464.591315][ C2] ? start_secondary+0x21c/0x2b0 [ 4464.591565][ C2] ? skb_clone+0x10b/0x330 [ 4464.591793][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4464.592110][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4464.592413][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4464.592696][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4464.592988][ C2] ? __tcf_classify+0x329/0x7d0 [ 4464.593237][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4464.593466][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4464.593764][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4464.594049][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4464.594374][ C2] ? lock_acquire+0x1c1/0x220 [ 4464.594613][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4464.594906][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4464.595193][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4464.595508][ C2] ? __copy_skb_header+0xaf/0x490 [ 4464.595766][ C2] ? __skb_clone+0x57a/0x760 [ 4464.595998][ C2] netif_receive_skb+0x55/0x280 [ 4464.596247][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4464.596559][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4464.596890][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4464.597189][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4464.597463][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4464.597755][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4464.598066][ C2] ? get_stack_info+0x36/0xc0 [ 4464.598308][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4464.598572][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4464.598887][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4464.599161][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4464.599440][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4464.599753][ C2] ? kernel_text_address+0x17/0xe0 [ 4464.600012][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4464.600325][ C2] ? arch_stack_walk+0x8c/0x100 [ 4464.600571][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4464.600835][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4464.601119][ C2] ? lock_acquire+0x1c1/0x220 [ 4464.601358][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4464.601638][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4464.601941][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4464.602216][ C2] ? get_stack_info+0x36/0xc0 [ 4464.602455][ C2] __tcf_classify+0x329/0x7d0 [ 4464.602697][ C2] tcf_classify+0x283/0x930 [ 4464.602926][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4464.603181][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4464.603494][ C2] tc_run+0x2e4/0x5d0 [ 4464.603698][ C2] ? __pfx_tc_run+0x10/0x10 [ 4464.603930][ C2] ? lock_acquire+0x1c1/0x220 [ 4464.604169][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4464.604429][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4464.604682][ C2] ? lock_acquire+0x1c1/0x220 [ 4464.604918][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4464.605185][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4464.605484][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4464.605757][ C2] ? neigh_hh_output+0x348/0x590 [ 4464.606008][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4464.606274][ C2] ip_finish_output2+0x786/0x18e0 [ 4464.606529][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4464.606863][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4464.607137][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4464.607388][ C2] ? __ip_finish_output+0x10f/0x770 [ 4464.607658][ C2] ip_output+0x16b/0x4f0 [ 4464.607876][ C2] ? __pfx_ip_output+0x10/0x10 [ 4464.608117][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4464.608394][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4464.608704][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4464.608978][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4464.609234][ C2] ? __alloc_skb+0xd4/0x280 [ 4464.609464][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4464.609734][ C2] ? tcp_fragment+0x168/0x1040 [ 4464.609975][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4464.610226][ C2] ? ip_local_out+0x114/0x3b0 [ 4464.610465][ C2] __ip_queue_xmit+0x672/0x1910 [ 4464.610712][ C2] ? __skb_clone+0x57a/0x760 [ 4464.610947][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4464.611213][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4464.611492][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4464.611736][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4464.611984][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4464.612285][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4464.612603][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4464.612845][ C2] tcp_send_loss_probe+0x348/0x830 [ 4464.613105][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4464.613374][ C2] tcp_write_timer+0x82/0x1d0 [ 4464.613612][ C2] call_timer_fn+0x173/0x430 [ 4464.613847][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4464.614108][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4464.614369][ C2] __run_timers.part.0+0x52d/0x890 [ 4464.614627][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4464.614897][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4464.615182][ C2] ? lock_acquire+0x1c1/0x220 [ 4464.615421][ C2] ? clockevents_program_event+0xf6/0x300 [ 4464.615707][ C2] ? lock_release+0x1d5/0x250 [ 4464.615946][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4464.616209][ C2] ? ktime_get+0xb3/0x190 [ 4464.616429][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4464.616724][ C2] run_timer_softirq+0x72/0x100 [ 4464.616971][ C2] __do_softirq+0x1b9/0x7ff [ 4464.617204][ C2] irq_exit_rcu+0x98/0xc0 [ 4464.617425][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4464.617715][ C2] [ 4464.617866][ C2] [ 4464.618015][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4464.618321][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4464.618576][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4464.619541][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4464.619847][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4464.620244][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4464.620645][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4464.621043][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4464.621440][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4464.621838][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4464.622127][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4464.622387][ C2] default_idle_call+0x69/0xa0 [ 4464.622630][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4464.622880][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4464.623159][ C2] ? lock_release+0x1d5/0x250 [ 4464.623397][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4464.623669][ C2] do_idle+0xfb/0x160 [ 4464.623872][ C2] cpu_startup_entry+0x55/0x60 [ 4464.624116][ C2] start_secondary+0x21c/0x2b0 [ 4464.624359][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4464.624627][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4464.624937][ C2] [ 4464.625093][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 1966s! [perl:4135] [ 4464.625521][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4464.626783][ C1] irq event stamp: 209232 [ 4464.627002][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4464.627535][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4464.628019][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4464.628490][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4464.628955][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4464.629406][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4464.630023][ C1] RIP: 0010:kasan_check_range+0x66/0x1c0 [ 4464.630312][ C1] Code: 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df <4d> 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d [ 4464.631288][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 4464.631595][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4464.631999][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4464.632399][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4464.632799][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4464.633199][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4464.633602][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4464.634052][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4464.634390][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4464.634793][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4464.635194][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4464.635596][ C1] PKRU: 55555554 [ 4464.635781][ C1] Call Trace: [ 4464.635951][ C1] [ 4464.636102][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4464.636365][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4464.636608][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4464.636887][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4464.637160][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4464.637449][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4464.637721][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4464.638026][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4464.638287][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 4464.638550][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4464.638858][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4464.639157][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4464.639473][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4464.639762][ C1] ? kasan_check_range+0x66/0x1c0 [ 4464.640019][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4464.640304][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4464.640615][ C1] ? get_stack_info+0x36/0xc0 [ 4464.640855][ C1] ? lock_acquire+0x1c1/0x220 [ 4464.641097][ C1] ? lock_release+0x1d5/0x250 [ 4464.641339][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4464.641588][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4464.641861][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4464.642145][ C1] ? lock_acquire+0x1c1/0x220 [ 4464.642385][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4464.642627][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4464.642887][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4464.643123][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4464.643370][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4464.643628][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4464.643907][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4464.644185][ C1] ip_local_deliver+0x19d/0x480 [ 4464.644434][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4464.644705][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4464.644969][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4464.645319][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4464.645572][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4464.645893][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4464.646157][ C1] ip_rcv+0x564/0x740 [ 4464.646362][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4464.646592][ C1] ? set_track_prepare+0x8a/0xd0 [ 4464.646847][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4464.647126][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4464.647400][ C1] ? skb_clone+0x10b/0x330 [ 4464.647628][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4464.647953][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4464.648260][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4464.648543][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4464.648838][ C1] ? __tcf_classify+0x329/0x7d0 [ 4464.649089][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4464.649321][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4464.649620][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4464.649907][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4464.650233][ C1] ? lock_acquire+0x1c1/0x220 [ 4464.650472][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4464.650769][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4464.651056][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4464.651374][ C1] ? __copy_skb_header+0xaf/0x490 [ 4464.651632][ C1] ? __skb_clone+0x57a/0x760 [ 4464.651866][ C1] netif_receive_skb+0x55/0x280 [ 4464.652119][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4464.652433][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4464.652766][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4464.653067][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4464.653342][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4464.653629][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4464.653944][ C1] ? hlock_class+0x4e/0x130 [ 4464.654179][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4464.654455][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4464.654731][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4464.654996][ C1] ? hlock_class+0x4e/0x130 [ 4464.655228][ C1] ? mark_lock+0x38/0x3e0 [ 4464.655448][ C1] ? stack_access_ok+0xda/0x1f0 [ 4464.655696][ C1] ? __lock_acquire+0xb67/0x1610 [ 4464.655951][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4464.656230][ C1] ? get_stack_info+0x36/0xc0 [ 4464.656469][ C1] ? stack_access_ok+0xda/0x1f0 [ 4464.656716][ C1] ? get_reg+0x119/0x190 [ 4464.656934][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4464.657203][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4464.657513][ C1] __tcf_classify+0x329/0x7d0 [ 4464.657757][ C1] tcf_classify+0x283/0x930 [ 4464.657991][ C1] ? arch_stack_walk+0xa2/0x100 [ 4464.658241][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4464.658499][ C1] ? get_stack_info+0x36/0xc0 [ 4464.658742][ C1] tc_run+0x2e4/0x5d0 [ 4464.658947][ C1] ? __pfx_tc_run+0x10/0x10 [ 4464.659178][ C1] ? lock_acquire+0x1c1/0x220 [ 4464.659417][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4464.659677][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4464.659930][ C1] ? lock_acquire+0x1c1/0x220 [ 4464.660171][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4464.660437][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4464.660742][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4464.661014][ C1] ? neigh_hh_output+0x348/0x590 [ 4464.661267][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4464.661533][ C1] ip_finish_output2+0x786/0x18e0 [ 4464.661789][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4464.662069][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4464.662408][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4464.662684][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4464.662938][ C1] ? __ip_finish_output+0x10f/0x770 [ 4464.663203][ C1] ip_output+0x16b/0x4f0 [ 4464.663419][ C1] ? run_timer_softirq+0x72/0x100 [ 4464.663676][ C1] ? __pfx_ip_output+0x10/0x10 [ 4464.663921][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4464.664208][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4464.664461][ C1] ? ip_local_out+0x114/0x3b0 [ 4464.664700][ C1] __ip_queue_xmit+0x672/0x1910 [ 4464.664950][ C1] ? __create_object+0x5e/0xb0 [ 4464.665194][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4464.665461][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4464.665744][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4464.666018][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4464.666300][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4464.666571][ C1] tcp_delack_timer+0x84/0x240 [ 4464.666816][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4464.667088][ C1] call_timer_fn+0x173/0x430 [ 4464.667324][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4464.667586][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4464.667852][ C1] __run_timers.part.0+0x52d/0x890 [ 4464.668112][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4464.668388][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4464.668674][ C1] ? lock_acquire+0x1c1/0x220 [ 4464.668914][ C1] ? clockevents_program_event+0xf6/0x300 [ 4464.669204][ C1] ? lock_release+0x1d5/0x250 [ 4464.669444][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4464.669708][ C1] ? ktime_get+0xb3/0x190 [ 4464.669930][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4464.670226][ C1] run_timer_softirq+0x72/0x100 [ 4464.670475][ C1] __do_softirq+0x1b9/0x7ff [ 4464.670709][ C1] irq_exit_rcu+0x98/0xc0 [ 4464.670929][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4464.671216][ C1] [ 4464.671367][ C1] [ 4464.671517][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4464.671822][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4464.672148][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4464.673119][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4464.673428][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4464.673827][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4464.674228][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4464.674628][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4464.675027][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4464.675427][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4464.675726][ C1] pipe_read+0xa16/0xdf0 [ 4464.675946][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4464.676226][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4464.676469][ C1] ? iterate_tty_write+0x299/0x540 [ 4464.676731][ C1] ? lock_release+0x1d5/0x250 [ 4464.676971][ C1] vfs_read+0x911/0xc00 [ 4464.677187][ C1] ? lock_acquire+0x1c1/0x220 [ 4464.677423][ C1] ? __might_fault+0xc6/0x180 [ 4464.677668][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4464.677909][ C1] ? __might_fault+0xc6/0x180 [ 4464.678155][ C1] ? lock_release+0x1d5/0x250 [ 4464.678393][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4464.678659][ C1] ? __fget_light+0x54/0x1e0 [ 4464.678896][ C1] ksys_read+0x17a/0x1e0 [ 4464.679114][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4464.679358][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4464.679664][ C1] do_syscall_64+0xc9/0x1e0 [ 4464.679898][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4464.680196][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4464.680425][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4464.681398][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4464.681820][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4464.682220][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4464.682620][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4464.683016][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4464.683423][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4464.683825][ C1] [ 4488.484103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4488.484473][ C1] rcu: 1-....: (2128601 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=516548 [ 4488.485029][ C1] rcu: (t=2133597 jiffies g=1882453 q=706 ncpus=4) [ 4488.485363][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4488.485812][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4488.486426][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4488.486755][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4488.487732][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4488.488041][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4488.488441][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4488.488839][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4488.489237][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4488.489636][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4488.490036][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4488.490485][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4488.490818][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4488.491220][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4488.491621][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4488.492020][ C1] PKRU: 55555554 [ 4488.492203][ C1] Call Trace: [ 4488.492373][ C1] [ 4488.492525][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4488.492799][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4488.493052][ C1] ? check_cpu_stall+0x284/0x500 [ 4488.493305][ C1] ? rcu_pending+0x92/0x360 [ 4488.493534][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4488.493807][ C1] ? update_process_times+0xb9/0x110 [ 4488.494078][ C1] ? tick_sched_handle+0x67/0x130 [ 4488.494335][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4488.494620][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4488.494863][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4488.495177][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4488.495449][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4488.495738][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4488.496004][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4488.496310][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4488.496573][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4488.496881][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4488.497179][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4488.497495][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4488.497789][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4488.498085][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4488.498374][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4488.498684][ C1] ? get_stack_info+0x36/0xc0 [ 4488.498926][ C1] ? lock_acquire+0x1c1/0x220 [ 4488.499168][ C1] ? lock_release+0x1d5/0x250 [ 4488.499409][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4488.499658][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4488.499931][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4488.500215][ C1] ? lock_acquire+0x1c1/0x220 [ 4488.500455][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4488.500697][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4488.500958][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4488.501193][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4488.501442][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4488.501700][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4488.501979][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4488.502257][ C1] ip_local_deliver+0x19d/0x480 [ 4488.502505][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4488.502781][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4488.503045][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4488.503394][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4488.503648][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4488.503969][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4488.504232][ C1] ip_rcv+0x564/0x740 [ 4488.504438][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4488.504668][ C1] ? set_track_prepare+0x8a/0xd0 [ 4488.504922][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4488.505200][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4488.505478][ C1] ? skb_clone+0x10b/0x330 [ 4488.505705][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4488.506025][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4488.506332][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4488.506614][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4488.506912][ C1] ? __tcf_classify+0x329/0x7d0 [ 4488.507163][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4488.507392][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4488.507698][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4488.507984][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4488.508309][ C1] ? lock_acquire+0x1c1/0x220 [ 4488.508547][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4488.508845][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4488.509130][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4488.509448][ C1] ? __copy_skb_header+0xaf/0x490 [ 4488.509706][ C1] ? __skb_clone+0x57a/0x760 [ 4488.509943][ C1] netif_receive_skb+0x55/0x280 [ 4488.510192][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4488.510507][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4488.510840][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4488.511140][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4488.511417][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4488.511708][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4488.512022][ C1] ? hlock_class+0x4e/0x130 [ 4488.512256][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4488.512534][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4488.512810][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4488.513075][ C1] ? hlock_class+0x4e/0x130 [ 4488.513307][ C1] ? mark_lock+0x38/0x3e0 [ 4488.513526][ C1] ? stack_access_ok+0xda/0x1f0 [ 4488.513776][ C1] ? __lock_acquire+0xb67/0x1610 [ 4488.514031][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4488.514308][ C1] ? get_stack_info+0x36/0xc0 [ 4488.514548][ C1] ? stack_access_ok+0xda/0x1f0 [ 4488.514796][ C1] ? get_reg+0x119/0x190 [ 4488.515018][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4488.515288][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4488.515597][ C1] __tcf_classify+0x329/0x7d0 [ 4488.515839][ C1] tcf_classify+0x283/0x930 [ 4488.516072][ C1] ? arch_stack_walk+0xa2/0x100 [ 4488.516322][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4488.516579][ C1] ? get_stack_info+0x36/0xc0 [ 4488.516819][ C1] tc_run+0x2e4/0x5d0 [ 4488.517026][ C1] ? __pfx_tc_run+0x10/0x10 [ 4488.517257][ C1] ? lock_acquire+0x1c1/0x220 [ 4488.517497][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4488.517763][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4488.518017][ C1] ? lock_acquire+0x1c1/0x220 [ 4488.518256][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4488.518522][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4488.518829][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4488.519102][ C1] ? neigh_hh_output+0x348/0x590 [ 4488.519356][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4488.519621][ C1] ip_finish_output2+0x786/0x18e0 [ 4488.519878][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4488.520156][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4488.520495][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4488.520774][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4488.521029][ C1] ? __ip_finish_output+0x10f/0x770 [ 4488.521295][ C1] ip_output+0x16b/0x4f0 [ 4488.521511][ C1] ? run_timer_softirq+0x72/0x100 [ 4488.521768][ C1] ? __pfx_ip_output+0x10/0x10 [ 4488.522012][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4488.522298][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4488.522550][ C1] ? ip_local_out+0x114/0x3b0 [ 4488.522791][ C1] __ip_queue_xmit+0x672/0x1910 [ 4488.523040][ C1] ? __create_object+0x5e/0xb0 [ 4488.523286][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4488.523554][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4488.523835][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4488.524111][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4488.524394][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4488.524666][ C1] tcp_delack_timer+0x84/0x240 [ 4488.524912][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4488.525183][ C1] call_timer_fn+0x173/0x430 [ 4488.525420][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4488.525683][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4488.525945][ C1] __run_timers.part.0+0x52d/0x890 [ 4488.526206][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4488.526479][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4488.526766][ C1] ? lock_acquire+0x1c1/0x220 [ 4488.527006][ C1] ? clockevents_program_event+0xf6/0x300 [ 4488.527297][ C1] ? lock_release+0x1d5/0x250 [ 4488.527541][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4488.527808][ C1] ? ktime_get+0xb3/0x190 [ 4488.528029][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4488.528329][ C1] run_timer_softirq+0x72/0x100 [ 4488.528578][ C1] __do_softirq+0x1b9/0x7ff [ 4488.528811][ C1] irq_exit_rcu+0x98/0xc0 [ 4488.529033][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4488.529319][ C1] [ 4488.529472][ C1] [ 4488.529622][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4488.529928][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4488.530253][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4488.531229][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4488.531538][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4488.531938][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4488.532338][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4488.532740][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4488.533140][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4488.533542][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4488.533840][ C1] pipe_read+0xa16/0xdf0 [ 4488.534061][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4488.534341][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4488.534584][ C1] ? iterate_tty_write+0x299/0x540 [ 4488.534846][ C1] ? lock_release+0x1d5/0x250 [ 4488.535088][ C1] vfs_read+0x911/0xc00 [ 4488.535301][ C1] ? lock_acquire+0x1c1/0x220 [ 4488.535541][ C1] ? __might_fault+0xc6/0x180 [ 4488.535783][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4488.536024][ C1] ? __might_fault+0xc6/0x180 [ 4488.536262][ C1] ? lock_release+0x1d5/0x250 [ 4488.536504][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4488.536768][ C1] ? __fget_light+0x54/0x1e0 [ 4488.537007][ C1] ksys_read+0x17a/0x1e0 [ 4488.537225][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4488.537471][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4488.537782][ C1] do_syscall_64+0xc9/0x1e0 [ 4488.538016][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4488.538316][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4488.538545][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4488.539520][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4488.539941][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4488.540342][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4488.540743][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4488.541142][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4488.541542][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4488.541945][ C1] [ 4488.542102][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4488.542375][ C2] NMI backtrace for cpu 2 [ 4488.542383][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4488.542388][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4488.542391][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4488.542396][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4488.542399][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4488.542402][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4488.542404][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4488.542405][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4488.542407][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4488.542409][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4488.542410][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4488.542413][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4488.542416][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4488.542418][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4488.542419][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4488.542420][ C2] PKRU: 55555554 [ 4488.542422][ C2] Call Trace: [ 4488.542423][ C2] [ 4488.542426][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4488.542434][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4488.542439][ C2] ? nmi_handle+0x153/0x420 [ 4488.542444][ C2] ? default_do_nmi+0x41/0x100 [ 4488.542446][ C2] ? exc_nmi+0xf3/0x120 [ 4488.542449][ C2] ? end_repeat_nmi+0xf/0x60 [ 4488.542454][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4488.542457][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4488.542460][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4488.542464][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4488.542466][ C2] [ 4488.542467][ C2] [ 4488.542468][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4488.542471][ C2] ? get_stack_info+0x36/0xc0 [ 4488.542475][ C2] ? lock_acquire+0x1c1/0x220 [ 4488.542479][ C2] ? lock_release+0x1d5/0x250 [ 4488.542482][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4488.542486][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4488.542489][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4488.542492][ C2] ? lock_acquire+0x1c1/0x220 [ 4488.542495][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4488.542499][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4488.542502][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4488.542508][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4488.542511][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4488.542515][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4488.542521][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4488.542524][ C2] ip_local_deliver+0x19d/0x480 [ 4488.542527][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4488.542529][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4488.542532][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4488.542537][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4488.542541][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4488.542544][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4488.542553][ C2] ip_rcv+0x564/0x740 [ 4488.542556][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4488.542558][ C2] ? set_track_prepare+0x8a/0xd0 [ 4488.542563][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4488.542566][ C2] ? start_secondary+0x21c/0x2b0 [ 4488.542569][ C2] ? skb_clone+0x10b/0x330 [ 4488.542573][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4488.542579][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4488.542584][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4488.542588][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4488.542596][ C2] ? __tcf_classify+0x329/0x7d0 [ 4488.542600][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4488.542602][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4488.542606][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4488.542610][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4488.542614][ C2] ? lock_acquire+0x1c1/0x220 [ 4488.542616][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4488.542620][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4488.542624][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4488.542628][ C2] ? __copy_skb_header+0xaf/0x490 [ 4488.542632][ C2] ? __skb_clone+0x57a/0x760 [ 4488.542634][ C2] netif_receive_skb+0x55/0x280 [ 4488.542638][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4488.542646][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4488.542653][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4488.542659][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4488.542664][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4488.542674][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4488.542682][ C2] ? get_stack_info+0x36/0xc0 [ 4488.542687][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4488.542690][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4488.542694][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4488.542697][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4488.542701][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4488.542703][ C2] ? kernel_text_address+0x17/0xe0 [ 4488.542707][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4488.542711][ C2] ? arch_stack_walk+0x8c/0x100 [ 4488.542715][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4488.542718][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4488.542721][ C2] ? lock_acquire+0x1c1/0x220 [ 4488.542724][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4488.542728][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4488.542732][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4488.542735][ C2] ? get_stack_info+0x36/0xc0 [ 4488.542739][ C2] __tcf_classify+0x329/0x7d0 [ 4488.542744][ C2] tcf_classify+0x283/0x930 [ 4488.542749][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4488.542752][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4488.542756][ C2] tc_run+0x2e4/0x5d0 [ 4488.542760][ C2] ? __pfx_tc_run+0x10/0x10 [ 4488.542763][ C2] ? lock_acquire+0x1c1/0x220 [ 4488.542766][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4488.542770][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4488.542774][ C2] ? lock_acquire+0x1c1/0x220 [ 4488.542776][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4488.542780][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4488.542782][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4488.542785][ C2] ? neigh_hh_output+0x348/0x590 [ 4488.542789][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4488.542793][ C2] ip_finish_output2+0x786/0x18e0 [ 4488.542796][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4488.542803][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4488.542806][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4488.542810][ C2] ? __ip_finish_output+0x10f/0x770 [ 4488.542814][ C2] ip_output+0x16b/0x4f0 [ 4488.542817][ C2] ? __pfx_ip_output+0x10/0x10 [ 4488.542819][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4488.542822][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4488.542825][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4488.542828][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4488.542831][ C2] ? __alloc_skb+0xd4/0x280 [ 4488.542833][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4488.542837][ C2] ? tcp_fragment+0x168/0x1040 [ 4488.542840][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4488.542843][ C2] ? ip_local_out+0x114/0x3b0 [ 4488.542846][ C2] __ip_queue_xmit+0x672/0x1910 [ 4488.542850][ C2] ? __skb_clone+0x57a/0x760 [ 4488.542853][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4488.542858][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4488.542862][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4488.542866][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4488.542870][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4488.542874][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4488.542877][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4488.542880][ C2] tcp_send_loss_probe+0x348/0x830 [ 4488.542884][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4488.542887][ C2] tcp_write_timer+0x82/0x1d0 [ 4488.542890][ C2] call_timer_fn+0x173/0x430 [ 4488.542894][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4488.542898][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4488.542902][ C2] __run_timers.part.0+0x52d/0x890 [ 4488.542905][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4488.542909][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4488.542912][ C2] ? lock_acquire+0x1c1/0x220 [ 4488.542914][ C2] ? clockevents_program_event+0xf6/0x300 [ 4488.542918][ C2] ? lock_release+0x1d5/0x250 [ 4488.542920][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4488.542924][ C2] ? ktime_get+0xb3/0x190 [ 4488.542927][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4488.542931][ C2] run_timer_softirq+0x72/0x100 [ 4488.542935][ C2] __do_softirq+0x1b9/0x7ff [ 4488.542939][ C2] irq_exit_rcu+0x98/0xc0 [ 4488.542942][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4488.542945][ C2] [ 4488.542946][ C2] [ 4488.542947][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4488.542950][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4488.542954][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4488.542956][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4488.542958][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4488.542959][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4488.542961][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4488.542962][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4488.542963][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4488.542966][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4488.542970][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4488.542974][ C2] default_idle_call+0x69/0xa0 [ 4488.542977][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4488.542979][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4488.542983][ C2] ? lock_release+0x1d5/0x250 [ 4488.542986][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4488.542989][ C2] do_idle+0xfb/0x160 [ 4488.542992][ C2] cpu_startup_entry+0x55/0x60 [ 4488.542994][ C2] start_secondary+0x21c/0x2b0 [ 4488.542998][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4488.543002][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4488.543008][ C2] [ 4512.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2011s! [swapper/2:0] [ 4512.569695][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4512.570955][ C2] irq event stamp: 44114564 [ 4512.571186][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4512.571722][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4512.572234][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4512.572713][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4512.573186][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4512.573643][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4512.574257][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4512.574582][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4512.575557][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4512.575864][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4512.576264][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4512.576662][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4512.577060][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4512.577466][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4512.577867][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4512.578315][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4512.578647][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4512.579047][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4512.579448][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4512.579847][ C2] PKRU: 55555554 [ 4512.580030][ C2] Call Trace: [ 4512.580199][ C2] [ 4512.580349][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4512.580612][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4512.580856][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4512.581134][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4512.581406][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4512.581695][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4512.581962][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4512.582268][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4512.582531][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4512.582794][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4512.583102][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4512.583399][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4512.583716][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4512.584004][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4512.584303][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4512.584592][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4512.584902][ C2] ? get_stack_info+0x36/0xc0 [ 4512.585144][ C2] ? lock_acquire+0x1c1/0x220 [ 4512.585385][ C2] ? lock_release+0x1d5/0x250 [ 4512.585626][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4512.585874][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4512.586148][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4512.586432][ C2] ? lock_acquire+0x1c1/0x220 [ 4512.586672][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4512.586914][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4512.587176][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4512.587415][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4512.587661][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4512.587924][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4512.588202][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4512.588481][ C2] ip_local_deliver+0x19d/0x480 [ 4512.588729][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4512.589000][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4512.589265][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4512.589613][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4512.589867][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4512.590189][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4512.590453][ C2] ip_rcv+0x564/0x740 [ 4512.590658][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4512.590887][ C2] ? set_track_prepare+0x8a/0xd0 [ 4512.591143][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4512.591420][ C2] ? start_secondary+0x21c/0x2b0 [ 4512.591672][ C2] ? skb_clone+0x10b/0x330 [ 4512.591901][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4512.592226][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4512.592532][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4512.592815][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4512.593111][ C2] ? __tcf_classify+0x329/0x7d0 [ 4512.593360][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4512.593591][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4512.593892][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4512.594177][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4512.594502][ C2] ? lock_acquire+0x1c1/0x220 [ 4512.594743][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4512.595040][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4512.595326][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4512.595643][ C2] ? __copy_skb_header+0xaf/0x490 [ 4512.595902][ C2] ? __skb_clone+0x57a/0x760 [ 4512.596139][ C2] netif_receive_skb+0x55/0x280 [ 4512.596387][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4512.596697][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4512.597032][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4512.597332][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4512.597610][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4512.597901][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4512.598216][ C2] ? get_stack_info+0x36/0xc0 [ 4512.598456][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4512.598722][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4512.599038][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4512.599318][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4512.599594][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4512.599910][ C2] ? kernel_text_address+0x17/0xe0 [ 4512.600172][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4512.600487][ C2] ? arch_stack_walk+0x8c/0x100 [ 4512.600737][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4512.601002][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4512.601287][ C2] ? lock_acquire+0x1c1/0x220 [ 4512.601526][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4512.601810][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4512.602117][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4512.602393][ C2] ? get_stack_info+0x36/0xc0 [ 4512.602634][ C2] __tcf_classify+0x329/0x7d0 [ 4512.602876][ C2] tcf_classify+0x283/0x930 [ 4512.603111][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4512.603368][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4512.603682][ C2] tc_run+0x2e4/0x5d0 [ 4512.603889][ C2] ? __pfx_tc_run+0x10/0x10 [ 4512.604119][ C2] ? lock_acquire+0x1c1/0x220 [ 4512.604359][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4512.604619][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4512.604873][ C2] ? lock_acquire+0x1c1/0x220 [ 4512.605113][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4512.605382][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4512.605687][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4512.605958][ C2] ? neigh_hh_output+0x348/0x590 [ 4512.606213][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4512.606478][ C2] ip_finish_output2+0x786/0x18e0 [ 4512.606735][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4512.607072][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4512.607349][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4512.607608][ C2] ? __ip_finish_output+0x10f/0x770 [ 4512.607874][ C2] ip_output+0x16b/0x4f0 [ 4512.608090][ C2] ? __pfx_ip_output+0x10/0x10 [ 4512.608336][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4512.608611][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4512.608923][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4512.609200][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4512.609452][ C2] ? __alloc_skb+0xd4/0x280 [ 4512.609683][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4512.609954][ C2] ? tcp_fragment+0x168/0x1040 [ 4512.610199][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4512.610451][ C2] ? ip_local_out+0x114/0x3b0 [ 4512.610691][ C2] __ip_queue_xmit+0x672/0x1910 [ 4512.610938][ C2] ? __skb_clone+0x57a/0x760 [ 4512.611177][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4512.611444][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4512.611725][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4512.611968][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4512.612219][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4512.612522][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4512.612842][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4512.613086][ C2] tcp_send_loss_probe+0x348/0x830 [ 4512.613348][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4512.613615][ C2] tcp_write_timer+0x82/0x1d0 [ 4512.613856][ C2] call_timer_fn+0x173/0x430 [ 4512.614092][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4512.614356][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4512.614618][ C2] __run_timers.part.0+0x52d/0x890 [ 4512.614879][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4512.615149][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4512.615433][ C2] ? lock_acquire+0x1c1/0x220 [ 4512.615673][ C2] ? clockevents_program_event+0xf6/0x300 [ 4512.615963][ C2] ? lock_release+0x1d5/0x250 [ 4512.616203][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4512.616468][ C2] ? ktime_get+0xb3/0x190 [ 4512.616692][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4512.616988][ C2] run_timer_softirq+0x72/0x100 [ 4512.617237][ C2] __do_softirq+0x1b9/0x7ff [ 4512.617476][ C2] irq_exit_rcu+0x98/0xc0 [ 4512.617695][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4512.617983][ C2] [ 4512.618133][ C2] [ 4512.618285][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4512.618588][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4512.618846][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4512.619819][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4512.620128][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4512.620529][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4512.620929][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4512.621329][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4512.621726][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4512.622128][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4512.622420][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4512.622680][ C2] default_idle_call+0x69/0xa0 [ 4512.622924][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4512.623176][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4512.623454][ C2] ? lock_release+0x1d5/0x250 [ 4512.623694][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4512.623966][ C2] do_idle+0xfb/0x160 [ 4512.624169][ C2] cpu_startup_entry+0x55/0x60 [ 4512.624413][ C2] start_secondary+0x21c/0x2b0 [ 4512.624658][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4512.624928][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4512.625240][ C2] [ 4512.625397][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2011s! [perl:4135] [ 4512.625833][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4512.627090][ C1] irq event stamp: 209232 [ 4512.627309][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4512.627846][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4512.628323][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4512.628792][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4512.629256][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4512.629706][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4512.630320][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4512.630650][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4512.631628][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4512.631937][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4512.632338][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4512.632740][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4512.633141][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4512.633542][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4512.633940][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4512.634392][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4512.634727][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4512.635132][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4512.635532][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4512.635931][ C1] PKRU: 55555554 [ 4512.636114][ C1] Call Trace: [ 4512.636286][ C1] [ 4512.636438][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4512.636702][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4512.636947][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4512.637226][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4512.637509][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4512.637796][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4512.638069][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4512.638377][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4512.638639][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4512.638951][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4512.639248][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4512.639562][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4512.639852][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4512.640149][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4512.640438][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4512.640750][ C1] ? get_stack_info+0x36/0xc0 [ 4512.640993][ C1] ? lock_acquire+0x1c1/0x220 [ 4512.641234][ C1] ? lock_release+0x1d5/0x250 [ 4512.641474][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4512.641731][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4512.642004][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4512.642291][ C1] ? lock_acquire+0x1c1/0x220 [ 4512.642529][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4512.642771][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4512.643031][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4512.643268][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4512.643517][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4512.643776][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4512.644052][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4512.644328][ C1] ip_local_deliver+0x19d/0x480 [ 4512.644577][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4512.644855][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4512.645120][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4512.645467][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4512.645721][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4512.646043][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4512.646306][ C1] ip_rcv+0x564/0x740 [ 4512.646510][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4512.646742][ C1] ? set_track_prepare+0x8a/0xd0 [ 4512.646997][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4512.647273][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4512.647550][ C1] ? skb_clone+0x10b/0x330 [ 4512.647779][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4512.648105][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4512.648410][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4512.648693][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4512.648987][ C1] ? __tcf_classify+0x329/0x7d0 [ 4512.649238][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4512.649470][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4512.649770][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4512.650055][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4512.650381][ C1] ? lock_acquire+0x1c1/0x220 [ 4512.650620][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4512.650917][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4512.651204][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4512.651521][ C1] ? __copy_skb_header+0xaf/0x490 [ 4512.651781][ C1] ? __skb_clone+0x57a/0x760 [ 4512.652016][ C1] netif_receive_skb+0x55/0x280 [ 4512.652263][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4512.652578][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4512.652910][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4512.653210][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4512.653489][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4512.653778][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4512.654089][ C1] ? hlock_class+0x4e/0x130 [ 4512.654324][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4512.654599][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4512.654877][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4512.655142][ C1] ? hlock_class+0x4e/0x130 [ 4512.655371][ C1] ? mark_lock+0x38/0x3e0 [ 4512.655594][ C1] ? stack_access_ok+0xda/0x1f0 [ 4512.655843][ C1] ? __lock_acquire+0xb67/0x1610 [ 4512.656098][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4512.656374][ C1] ? get_stack_info+0x36/0xc0 [ 4512.656615][ C1] ? stack_access_ok+0xda/0x1f0 [ 4512.656862][ C1] ? get_reg+0x119/0x190 [ 4512.657079][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4512.657347][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4512.657663][ C1] __tcf_classify+0x329/0x7d0 [ 4512.657906][ C1] tcf_classify+0x283/0x930 [ 4512.658137][ C1] ? arch_stack_walk+0xa2/0x100 [ 4512.658386][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4512.658643][ C1] ? get_stack_info+0x36/0xc0 [ 4512.658894][ C1] tc_run+0x2e4/0x5d0 [ 4512.659100][ C1] ? __pfx_tc_run+0x10/0x10 [ 4512.659333][ C1] ? lock_acquire+0x1c1/0x220 [ 4512.659571][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4512.659834][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4512.660087][ C1] ? lock_acquire+0x1c1/0x220 [ 4512.660325][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4512.660590][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4512.660901][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4512.661172][ C1] ? neigh_hh_output+0x348/0x590 [ 4512.661428][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4512.661695][ C1] ip_finish_output2+0x786/0x18e0 [ 4512.661952][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4512.662233][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4512.662571][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4512.662847][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4512.663101][ C1] ? __ip_finish_output+0x10f/0x770 [ 4512.663366][ C1] ip_output+0x16b/0x4f0 [ 4512.663585][ C1] ? run_timer_softirq+0x72/0x100 [ 4512.663843][ C1] ? __pfx_ip_output+0x10/0x10 [ 4512.664086][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4512.664374][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4512.664627][ C1] ? ip_local_out+0x114/0x3b0 [ 4512.664868][ C1] __ip_queue_xmit+0x672/0x1910 [ 4512.665117][ C1] ? __create_object+0x5e/0xb0 [ 4512.665361][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4512.665629][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4512.665912][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4512.666186][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4512.666468][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4512.666743][ C1] tcp_delack_timer+0x84/0x240 [ 4512.666987][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4512.667261][ C1] call_timer_fn+0x173/0x430 [ 4512.667502][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4512.667765][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4512.668028][ C1] __run_timers.part.0+0x52d/0x890 [ 4512.668289][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4512.668563][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4512.668848][ C1] ? lock_acquire+0x1c1/0x220 [ 4512.669087][ C1] ? clockevents_program_event+0xf6/0x300 [ 4512.669379][ C1] ? lock_release+0x1d5/0x250 [ 4512.669616][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4512.669882][ C1] ? ktime_get+0xb3/0x190 [ 4512.670107][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4512.670405][ C1] run_timer_softirq+0x72/0x100 [ 4512.670652][ C1] __do_softirq+0x1b9/0x7ff [ 4512.670889][ C1] irq_exit_rcu+0x98/0xc0 [ 4512.671110][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4512.671398][ C1] [ 4512.671548][ C1] [ 4512.671701][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4512.672005][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4512.672332][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4512.673307][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4512.673615][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4512.674018][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4512.674418][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4512.674816][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4512.675216][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4512.675621][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4512.675918][ C1] pipe_read+0xa16/0xdf0 [ 4512.676141][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4512.676419][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4512.676664][ C1] ? iterate_tty_write+0x299/0x540 [ 4512.676925][ C1] ? lock_release+0x1d5/0x250 [ 4512.677167][ C1] vfs_read+0x911/0xc00 [ 4512.677393][ C1] ? lock_acquire+0x1c1/0x220 [ 4512.677632][ C1] ? __might_fault+0xc6/0x180 [ 4512.677871][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4512.678111][ C1] ? __might_fault+0xc6/0x180 [ 4512.678351][ C1] ? lock_release+0x1d5/0x250 [ 4512.678591][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4512.678855][ C1] ? __fget_light+0x54/0x1e0 [ 4512.679091][ C1] ksys_read+0x17a/0x1e0 [ 4512.679310][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4512.679554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4512.679856][ C1] do_syscall_64+0xc9/0x1e0 [ 4512.680090][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4512.680390][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4512.680616][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4512.681584][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4512.682006][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4512.682404][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4512.682802][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4512.683202][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4512.683600][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4512.684000][ C1] [ 4540.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2037s! [swapper/2:0] [ 4540.569694][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4540.570953][ C2] irq event stamp: 44114564 [ 4540.571194][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4540.571729][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4540.572242][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4540.572722][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4540.573192][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4540.573647][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4540.574262][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4540.574587][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4540.575563][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4540.575872][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4540.576272][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4540.576669][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4540.577069][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4540.577477][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4540.577877][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4540.578326][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4540.578658][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4540.579060][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4540.579461][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4540.579860][ C2] PKRU: 55555554 [ 4540.580042][ C2] Call Trace: [ 4540.580215][ C2] [ 4540.580361][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4540.580624][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4540.580867][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4540.581145][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4540.581417][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4540.581708][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4540.581972][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4540.582280][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4540.582541][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4540.582803][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4540.583113][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4540.583408][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4540.583723][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4540.584013][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4540.584308][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4540.584598][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4540.584911][ C2] ? get_stack_info+0x36/0xc0 [ 4540.585152][ C2] ? lock_acquire+0x1c1/0x220 [ 4540.585392][ C2] ? lock_release+0x1d5/0x250 [ 4540.585633][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4540.585882][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4540.586163][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4540.586451][ C2] ? lock_acquire+0x1c1/0x220 [ 4540.586690][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4540.586931][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4540.587193][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4540.587433][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4540.587682][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4540.587941][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4540.588219][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4540.588495][ C2] ip_local_deliver+0x19d/0x480 [ 4540.588743][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4540.589013][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4540.589277][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4540.589630][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4540.589884][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4540.590207][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4540.590469][ C2] ip_rcv+0x564/0x740 [ 4540.590673][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4540.590903][ C2] ? set_track_prepare+0x8a/0xd0 [ 4540.591158][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4540.591437][ C2] ? start_secondary+0x21c/0x2b0 [ 4540.591689][ C2] ? skb_clone+0x10b/0x330 [ 4540.591915][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4540.592236][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4540.592542][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4540.592822][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4540.593119][ C2] ? __tcf_classify+0x329/0x7d0 [ 4540.593368][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4540.593597][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4540.593897][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4540.594183][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4540.594509][ C2] ? lock_acquire+0x1c1/0x220 [ 4540.594747][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4540.595045][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4540.595331][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4540.595648][ C2] ? __copy_skb_header+0xaf/0x490 [ 4540.595911][ C2] ? __skb_clone+0x57a/0x760 [ 4540.596148][ C2] netif_receive_skb+0x55/0x280 [ 4540.596398][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4540.596711][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4540.597044][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4540.597349][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4540.597627][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4540.597915][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4540.598229][ C2] ? get_stack_info+0x36/0xc0 [ 4540.598471][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4540.598737][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4540.599054][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4540.599331][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4540.599612][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4540.599928][ C2] ? kernel_text_address+0x17/0xe0 [ 4540.600190][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4540.600504][ C2] ? arch_stack_walk+0x8c/0x100 [ 4540.600753][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4540.601017][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4540.601303][ C2] ? lock_acquire+0x1c1/0x220 [ 4540.601540][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4540.601825][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4540.602140][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4540.602417][ C2] ? get_stack_info+0x36/0xc0 [ 4540.602657][ C2] __tcf_classify+0x329/0x7d0 [ 4540.602898][ C2] tcf_classify+0x283/0x930 [ 4540.603133][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4540.603390][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4540.603706][ C2] tc_run+0x2e4/0x5d0 [ 4540.603911][ C2] ? __pfx_tc_run+0x10/0x10 [ 4540.604144][ C2] ? lock_acquire+0x1c1/0x220 [ 4540.604382][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4540.604643][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4540.604896][ C2] ? lock_acquire+0x1c1/0x220 [ 4540.605138][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4540.605402][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4540.605705][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4540.605976][ C2] ? neigh_hh_output+0x348/0x590 [ 4540.606229][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4540.606493][ C2] ip_finish_output2+0x786/0x18e0 [ 4540.606750][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4540.607091][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4540.607376][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4540.607629][ C2] ? __ip_finish_output+0x10f/0x770 [ 4540.607894][ C2] ip_output+0x16b/0x4f0 [ 4540.608110][ C2] ? __pfx_ip_output+0x10/0x10 [ 4540.608353][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4540.608629][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4540.608943][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4540.609220][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4540.609471][ C2] ? __alloc_skb+0xd4/0x280 [ 4540.609702][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4540.609972][ C2] ? tcp_fragment+0x168/0x1040 [ 4540.610218][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4540.610470][ C2] ? ip_local_out+0x114/0x3b0 [ 4540.610710][ C2] __ip_queue_xmit+0x672/0x1910 [ 4540.610960][ C2] ? __skb_clone+0x57a/0x760 [ 4540.611195][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4540.611463][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4540.611744][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4540.611990][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4540.612240][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4540.612540][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4540.612861][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4540.613104][ C2] tcp_send_loss_probe+0x348/0x830 [ 4540.613367][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4540.613634][ C2] tcp_write_timer+0x82/0x1d0 [ 4540.613875][ C2] call_timer_fn+0x173/0x430 [ 4540.614114][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4540.614376][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4540.614638][ C2] __run_timers.part.0+0x52d/0x890 [ 4540.614898][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4540.615169][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4540.615454][ C2] ? lock_acquire+0x1c1/0x220 [ 4540.615693][ C2] ? clockevents_program_event+0xf6/0x300 [ 4540.615985][ C2] ? lock_release+0x1d5/0x250 [ 4540.616224][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4540.616490][ C2] ? ktime_get+0xb3/0x190 [ 4540.616710][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4540.617008][ C2] run_timer_softirq+0x72/0x100 [ 4540.617265][ C2] __do_softirq+0x1b9/0x7ff [ 4540.617498][ C2] irq_exit_rcu+0x98/0xc0 [ 4540.617720][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4540.618009][ C2] [ 4540.618160][ C2] [ 4540.618312][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4540.618617][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4540.618874][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4540.619846][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4540.620154][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4540.620553][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4540.620952][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4540.621351][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4540.621750][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4540.622153][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4540.622440][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4540.622701][ C2] default_idle_call+0x69/0xa0 [ 4540.622944][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4540.623198][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4540.623476][ C2] ? lock_release+0x1d5/0x250 [ 4540.623716][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4540.623989][ C2] do_idle+0xfb/0x160 [ 4540.624196][ C2] cpu_startup_entry+0x55/0x60 [ 4540.624438][ C2] start_secondary+0x21c/0x2b0 [ 4540.624683][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4540.624952][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4540.625266][ C2] [ 4540.625426][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2037s! [perl:4135] [ 4540.625853][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4540.627112][ C1] irq event stamp: 209232 [ 4540.627336][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4540.627866][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4540.628345][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4540.628815][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4540.629276][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4540.629725][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4540.630341][ C1] RIP: 0010:kasan_check_range+0x74/0x1c0 [ 4540.630628][ C1] Code: ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 <49> 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e [ 4540.631600][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [ 4540.631908][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4540.632311][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4540.632712][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: 1ffff110014741c3 [ 4540.633113][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4540.633513][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4540.633912][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4540.634364][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4540.634699][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4540.635102][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4540.635502][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4540.635900][ C1] PKRU: 55555554 [ 4540.636083][ C1] Call Trace: [ 4540.636256][ C1] [ 4540.636404][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4540.636666][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4540.636911][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4540.637189][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4540.637468][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4540.637755][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4540.638021][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4540.638328][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4540.638588][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 4540.638849][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4540.639160][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4540.639458][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4540.639772][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4540.640061][ C1] ? kasan_check_range+0x74/0x1c0 [ 4540.640319][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4540.640599][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4540.640911][ C1] ? get_stack_info+0x36/0xc0 [ 4540.641154][ C1] ? lock_acquire+0x1c1/0x220 [ 4540.641396][ C1] ? lock_release+0x1d5/0x250 [ 4540.641636][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4540.641883][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4540.642164][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4540.642449][ C1] ? lock_acquire+0x1c1/0x220 [ 4540.642689][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4540.642931][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4540.643193][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4540.643426][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4540.643673][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4540.643932][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4540.644208][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4540.644487][ C1] ip_local_deliver+0x19d/0x480 [ 4540.644735][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4540.645007][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4540.645272][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4540.645620][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4540.645872][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4540.646193][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4540.646456][ C1] ip_rcv+0x564/0x740 [ 4540.646659][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4540.646892][ C1] ? set_track_prepare+0x8a/0xd0 [ 4540.647146][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4540.647429][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4540.647702][ C1] ? skb_clone+0x10b/0x330 [ 4540.647930][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4540.648249][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4540.648556][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4540.648838][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4540.649134][ C1] ? __tcf_classify+0x329/0x7d0 [ 4540.649383][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4540.649614][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4540.649914][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4540.650198][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4540.650524][ C1] ? lock_acquire+0x1c1/0x220 [ 4540.650764][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4540.651062][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4540.651346][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4540.651663][ C1] ? __copy_skb_header+0xaf/0x490 [ 4540.651921][ C1] ? __skb_clone+0x57a/0x760 [ 4540.652157][ C1] netif_receive_skb+0x55/0x280 [ 4540.652405][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4540.652717][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4540.653052][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4540.653350][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4540.653625][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4540.653915][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4540.654229][ C1] ? hlock_class+0x4e/0x130 [ 4540.654461][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4540.654739][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4540.655014][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4540.655279][ C1] ? hlock_class+0x4e/0x130 [ 4540.655511][ C1] ? mark_lock+0x38/0x3e0 [ 4540.655730][ C1] ? stack_access_ok+0xda/0x1f0 [ 4540.655981][ C1] ? __lock_acquire+0xb67/0x1610 [ 4540.656240][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4540.656516][ C1] ? get_stack_info+0x36/0xc0 [ 4540.656759][ C1] ? stack_access_ok+0xda/0x1f0 [ 4540.657007][ C1] ? get_reg+0x119/0x190 [ 4540.657227][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4540.657496][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4540.657806][ C1] __tcf_classify+0x329/0x7d0 [ 4540.658048][ C1] tcf_classify+0x283/0x930 [ 4540.658282][ C1] ? arch_stack_walk+0xa2/0x100 [ 4540.658532][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4540.658789][ C1] ? get_stack_info+0x36/0xc0 [ 4540.659031][ C1] tc_run+0x2e4/0x5d0 [ 4540.659236][ C1] ? __pfx_tc_run+0x10/0x10 [ 4540.659468][ C1] ? lock_acquire+0x1c1/0x220 [ 4540.659709][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4540.659971][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4540.660226][ C1] ? lock_acquire+0x1c1/0x220 [ 4540.660465][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4540.660731][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4540.661034][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4540.661309][ C1] ? neigh_hh_output+0x348/0x590 [ 4540.661562][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4540.661827][ C1] ip_finish_output2+0x786/0x18e0 [ 4540.662084][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4540.662363][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4540.662698][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4540.662975][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4540.663228][ C1] ? __ip_finish_output+0x10f/0x770 [ 4540.663495][ C1] ip_output+0x16b/0x4f0 [ 4540.663712][ C1] ? run_timer_softirq+0x72/0x100 [ 4540.663969][ C1] ? __pfx_ip_output+0x10/0x10 [ 4540.664214][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4540.664499][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4540.664751][ C1] ? ip_local_out+0x114/0x3b0 [ 4540.664992][ C1] __ip_queue_xmit+0x672/0x1910 [ 4540.665242][ C1] ? __create_object+0x5e/0xb0 [ 4540.665485][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4540.665753][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4540.666034][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4540.666306][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4540.666589][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4540.666861][ C1] tcp_delack_timer+0x84/0x240 [ 4540.667106][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4540.667382][ C1] call_timer_fn+0x173/0x430 [ 4540.667619][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4540.667882][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4540.668144][ C1] __run_timers.part.0+0x52d/0x890 [ 4540.668405][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4540.668679][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4540.668964][ C1] ? lock_acquire+0x1c1/0x220 [ 4540.669202][ C1] ? clockevents_program_event+0xf6/0x300 [ 4540.669494][ C1] ? lock_release+0x1d5/0x250 [ 4540.669733][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4540.669998][ C1] ? ktime_get+0xb3/0x190 [ 4540.670218][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4540.670515][ C1] run_timer_softirq+0x72/0x100 [ 4540.670764][ C1] __do_softirq+0x1b9/0x7ff [ 4540.670999][ C1] irq_exit_rcu+0x98/0xc0 [ 4540.671222][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4540.671508][ C1] [ 4540.671659][ C1] [ 4540.671810][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4540.672116][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4540.672443][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4540.673414][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4540.673723][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4540.674123][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4540.674524][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4540.674922][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4540.675324][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4540.675725][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4540.676022][ C1] pipe_read+0xa16/0xdf0 [ 4540.676243][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4540.676521][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4540.676765][ C1] ? iterate_tty_write+0x299/0x540 [ 4540.677026][ C1] ? lock_release+0x1d5/0x250 [ 4540.677278][ C1] vfs_read+0x911/0xc00 [ 4540.677492][ C1] ? lock_acquire+0x1c1/0x220 [ 4540.677731][ C1] ? __might_fault+0xc6/0x180 [ 4540.677972][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4540.678210][ C1] ? __might_fault+0xc6/0x180 [ 4540.678451][ C1] ? lock_release+0x1d5/0x250 [ 4540.678692][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4540.678956][ C1] ? __fget_light+0x54/0x1e0 [ 4540.679195][ C1] ksys_read+0x17a/0x1e0 [ 4540.679412][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4540.679658][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4540.679964][ C1] do_syscall_64+0xc9/0x1e0 [ 4540.680196][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4540.680497][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4540.680725][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4540.681697][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4540.682118][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4540.682517][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4540.682917][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4540.683316][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4540.683714][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4540.684116][ C1] [ 4566.542102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4566.542468][ C1] rcu: 1-....: (2206373 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=535872 [ 4566.543020][ C1] rcu: (t=2211655 jiffies g=1882453 q=709 ncpus=4) [ 4566.543355][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4566.543802][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4566.544414][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4566.544742][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4566.545709][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4566.546017][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4566.546417][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4566.546818][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4566.547221][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4566.547619][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4566.548016][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4566.548462][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4566.548796][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4566.549196][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4566.549594][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4566.549993][ C1] PKRU: 55555554 [ 4566.550173][ C1] Call Trace: [ 4566.550345][ C1] [ 4566.550492][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4566.550764][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4566.551020][ C1] ? check_cpu_stall+0x284/0x500 [ 4566.551271][ C1] ? rcu_pending+0x92/0x360 [ 4566.551501][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4566.551770][ C1] ? update_process_times+0xb9/0x110 [ 4566.552037][ C1] ? tick_sched_handle+0x67/0x130 [ 4566.552294][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4566.552581][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4566.552824][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4566.553135][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4566.553409][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4566.553695][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4566.553959][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4566.554266][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4566.554526][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4566.554835][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4566.555130][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4566.555444][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4566.555733][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4566.556028][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4566.556315][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4566.556625][ C1] ? get_stack_info+0x36/0xc0 [ 4566.556868][ C1] ? lock_acquire+0x1c1/0x220 [ 4566.557113][ C1] ? lock_release+0x1d5/0x250 [ 4566.557351][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4566.557601][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4566.557871][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4566.558158][ C1] ? lock_acquire+0x1c1/0x220 [ 4566.558396][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4566.558634][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4566.558894][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4566.559130][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4566.559377][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4566.559636][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4566.559911][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4566.560187][ C1] ip_local_deliver+0x19d/0x480 [ 4566.560433][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4566.560706][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4566.560969][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4566.561316][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4566.561570][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4566.561888][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4566.562151][ C1] ip_rcv+0x564/0x740 [ 4566.562355][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4566.562586][ C1] ? set_track_prepare+0x8a/0xd0 [ 4566.562839][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4566.563115][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4566.563386][ C1] ? skb_clone+0x10b/0x330 [ 4566.563616][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4566.563935][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4566.564240][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4566.564523][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4566.564816][ C1] ? __tcf_classify+0x329/0x7d0 [ 4566.565063][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4566.565295][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4566.565595][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4566.565880][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4566.566204][ C1] ? lock_acquire+0x1c1/0x220 [ 4566.566443][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4566.566743][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4566.567028][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4566.567350][ C1] ? __copy_skb_header+0xaf/0x490 [ 4566.567608][ C1] ? __skb_clone+0x57a/0x760 [ 4566.567842][ C1] netif_receive_skb+0x55/0x280 [ 4566.568089][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4566.568402][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4566.568733][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4566.569032][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4566.569305][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4566.569595][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4566.569906][ C1] ? hlock_class+0x4e/0x130 [ 4566.570139][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4566.570412][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4566.570689][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4566.570952][ C1] ? hlock_class+0x4e/0x130 [ 4566.571182][ C1] ? mark_lock+0x38/0x3e0 [ 4566.571403][ C1] ? stack_access_ok+0xda/0x1f0 [ 4566.571652][ C1] ? __lock_acquire+0xb67/0x1610 [ 4566.571906][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4566.572180][ C1] ? get_stack_info+0x36/0xc0 [ 4566.572422][ C1] ? stack_access_ok+0xda/0x1f0 [ 4566.572668][ C1] ? get_reg+0x119/0x190 [ 4566.572883][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4566.573151][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4566.573459][ C1] __tcf_classify+0x329/0x7d0 [ 4566.573700][ C1] tcf_classify+0x283/0x930 [ 4566.573929][ C1] ? arch_stack_walk+0xa2/0x100 [ 4566.574179][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4566.574435][ C1] ? get_stack_info+0x36/0xc0 [ 4566.574676][ C1] tc_run+0x2e4/0x5d0 [ 4566.574880][ C1] ? __pfx_tc_run+0x10/0x10 [ 4566.575112][ C1] ? lock_acquire+0x1c1/0x220 [ 4566.575350][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4566.575611][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4566.575865][ C1] ? lock_acquire+0x1c1/0x220 [ 4566.576102][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4566.576366][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4566.576670][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4566.576942][ C1] ? neigh_hh_output+0x348/0x590 [ 4566.577200][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4566.577466][ C1] ip_finish_output2+0x786/0x18e0 [ 4566.577721][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4566.578002][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4566.578339][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4566.578614][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4566.578867][ C1] ? __ip_finish_output+0x10f/0x770 [ 4566.579131][ C1] ip_output+0x16b/0x4f0 [ 4566.579349][ C1] ? run_timer_softirq+0x72/0x100 [ 4566.579604][ C1] ? __pfx_ip_output+0x10/0x10 [ 4566.579847][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4566.580132][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4566.580384][ C1] ? ip_local_out+0x114/0x3b0 [ 4566.580625][ C1] __ip_queue_xmit+0x672/0x1910 [ 4566.580873][ C1] ? __create_object+0x5e/0xb0 [ 4566.581115][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4566.581383][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4566.581664][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4566.581937][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4566.582218][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4566.582491][ C1] tcp_delack_timer+0x84/0x240 [ 4566.582733][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4566.583005][ C1] call_timer_fn+0x173/0x430 [ 4566.583240][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4566.583502][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4566.583763][ C1] __run_timers.part.0+0x52d/0x890 [ 4566.584023][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4566.584295][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4566.584582][ C1] ? lock_acquire+0x1c1/0x220 [ 4566.584822][ C1] ? clockevents_program_event+0xf6/0x300 [ 4566.585113][ C1] ? lock_release+0x1d5/0x250 [ 4566.585349][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4566.585617][ C1] ? ktime_get+0xb3/0x190 [ 4566.585838][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4566.586135][ C1] run_timer_softirq+0x72/0x100 [ 4566.586382][ C1] __do_softirq+0x1b9/0x7ff [ 4566.586615][ C1] irq_exit_rcu+0x98/0xc0 [ 4566.586835][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4566.587126][ C1] [ 4566.587275][ C1] [ 4566.587427][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4566.587730][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4566.588055][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4566.589027][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4566.589334][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4566.589733][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4566.590131][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4566.590531][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4566.590930][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4566.591333][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4566.591627][ C1] pipe_read+0xa16/0xdf0 [ 4566.591852][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4566.592131][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4566.592376][ C1] ? iterate_tty_write+0x299/0x540 [ 4566.592637][ C1] ? lock_release+0x1d5/0x250 [ 4566.592879][ C1] vfs_read+0x911/0xc00 [ 4566.593093][ C1] ? lock_acquire+0x1c1/0x220 [ 4566.593332][ C1] ? __might_fault+0xc6/0x180 [ 4566.593572][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4566.593811][ C1] ? __might_fault+0xc6/0x180 [ 4566.594051][ C1] ? lock_release+0x1d5/0x250 [ 4566.594292][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4566.594556][ C1] ? __fget_light+0x54/0x1e0 [ 4566.594793][ C1] ksys_read+0x17a/0x1e0 [ 4566.595011][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4566.595256][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4566.595559][ C1] do_syscall_64+0xc9/0x1e0 [ 4566.595793][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4566.596092][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4566.596318][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4566.597297][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4566.597719][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4566.598122][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4566.598522][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4566.598920][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4566.599318][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4566.599719][ C1] [ 4566.599878][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4566.600153][ C2] NMI backtrace for cpu 2 [ 4566.600161][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4566.600168][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4566.600171][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4566.600177][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4566.600180][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4566.600183][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4566.600185][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4566.600186][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4566.600188][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4566.600189][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4566.600191][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4566.600193][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4566.600197][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4566.600198][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4566.600199][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4566.600201][ C2] PKRU: 55555554 [ 4566.600202][ C2] Call Trace: [ 4566.600205][ C2] [ 4566.600208][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4566.600215][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4566.600221][ C2] ? nmi_handle+0x153/0x420 [ 4566.600225][ C2] ? default_do_nmi+0x41/0x100 [ 4566.600228][ C2] ? exc_nmi+0xf3/0x120 [ 4566.600230][ C2] ? end_repeat_nmi+0xf/0x60 [ 4566.600236][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4566.600239][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4566.600242][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4566.600246][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4566.600249][ C2] [ 4566.600250][ C2] [ 4566.600251][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4566.600254][ C2] ? get_stack_info+0x36/0xc0 [ 4566.600258][ C2] ? lock_acquire+0x1c1/0x220 [ 4566.600262][ C2] ? lock_release+0x1d5/0x250 [ 4566.600265][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4566.600269][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4566.600272][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4566.600275][ C2] ? lock_acquire+0x1c1/0x220 [ 4566.600277][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4566.600281][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4566.600284][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4566.600290][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4566.600292][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4566.600297][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4566.600302][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4566.600306][ C2] ip_local_deliver+0x19d/0x480 [ 4566.600308][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4566.600310][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4566.600312][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4566.600318][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4566.600321][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4566.600325][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4566.600333][ C2] ip_rcv+0x564/0x740 [ 4566.600336][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4566.600339][ C2] ? set_track_prepare+0x8a/0xd0 [ 4566.600343][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4566.600346][ C2] ? start_secondary+0x21c/0x2b0 [ 4566.600349][ C2] ? skb_clone+0x10b/0x330 [ 4566.600352][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4566.600358][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4566.600364][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4566.600368][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4566.600377][ C2] ? __tcf_classify+0x329/0x7d0 [ 4566.600381][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4566.600383][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4566.600387][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4566.600390][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4566.600394][ C2] ? lock_acquire+0x1c1/0x220 [ 4566.600396][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4566.600401][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4566.600404][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4566.600408][ C2] ? __copy_skb_header+0xaf/0x490 [ 4566.600412][ C2] ? __skb_clone+0x57a/0x760 [ 4566.600415][ C2] netif_receive_skb+0x55/0x280 [ 4566.600418][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4566.600426][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4566.600433][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4566.600439][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4566.600444][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4566.600454][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4566.600461][ C2] ? get_stack_info+0x36/0xc0 [ 4566.600465][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4566.600468][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4566.600472][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4566.600474][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4566.600478][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4566.600481][ C2] ? kernel_text_address+0x17/0xe0 [ 4566.600484][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4566.600488][ C2] ? arch_stack_walk+0x8c/0x100 [ 4566.600492][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4566.600495][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4566.600499][ C2] ? lock_acquire+0x1c1/0x220 [ 4566.600501][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4566.600506][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4566.600510][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4566.600512][ C2] ? get_stack_info+0x36/0xc0 [ 4566.600517][ C2] __tcf_classify+0x329/0x7d0 [ 4566.600522][ C2] tcf_classify+0x283/0x930 [ 4566.600526][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4566.600529][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4566.600534][ C2] tc_run+0x2e4/0x5d0 [ 4566.600537][ C2] ? __pfx_tc_run+0x10/0x10 [ 4566.600540][ C2] ? lock_acquire+0x1c1/0x220 [ 4566.600542][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4566.600546][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4566.600550][ C2] ? lock_acquire+0x1c1/0x220 [ 4566.600552][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4566.600555][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4566.600558][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4566.600561][ C2] ? neigh_hh_output+0x348/0x590 [ 4566.600564][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4566.600568][ C2] ip_finish_output2+0x786/0x18e0 [ 4566.600571][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4566.600579][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4566.600581][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4566.600585][ C2] ? __ip_finish_output+0x10f/0x770 [ 4566.600588][ C2] ip_output+0x16b/0x4f0 [ 4566.600591][ C2] ? __pfx_ip_output+0x10/0x10 [ 4566.600594][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4566.600597][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4566.600600][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4566.600603][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4566.600605][ C2] ? __alloc_skb+0xd4/0x280 [ 4566.600608][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4566.600612][ C2] ? tcp_fragment+0x168/0x1040 [ 4566.600616][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4566.600618][ C2] ? ip_local_out+0x114/0x3b0 [ 4566.600622][ C2] __ip_queue_xmit+0x672/0x1910 [ 4566.600626][ C2] ? __skb_clone+0x57a/0x760 [ 4566.600628][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4566.600633][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4566.600636][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4566.600641][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4566.600646][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4566.600650][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4566.600653][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4566.600656][ C2] tcp_send_loss_probe+0x348/0x830 [ 4566.600659][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4566.600662][ C2] tcp_write_timer+0x82/0x1d0 [ 4566.600666][ C2] call_timer_fn+0x173/0x430 [ 4566.600669][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4566.600673][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4566.600677][ C2] __run_timers.part.0+0x52d/0x890 [ 4566.600680][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4566.600685][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4566.600687][ C2] ? lock_acquire+0x1c1/0x220 [ 4566.600690][ C2] ? clockevents_program_event+0xf6/0x300 [ 4566.600694][ C2] ? lock_release+0x1d5/0x250 [ 4566.600696][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4566.600699][ C2] ? ktime_get+0xb3/0x190 [ 4566.600703][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4566.600707][ C2] run_timer_softirq+0x72/0x100 [ 4566.600710][ C2] __do_softirq+0x1b9/0x7ff [ 4566.600714][ C2] irq_exit_rcu+0x98/0xc0 [ 4566.600717][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4566.600721][ C2] [ 4566.600722][ C2] [ 4566.600723][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4566.600726][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4566.600729][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4566.600731][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4566.600733][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4566.600735][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4566.600736][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4566.600737][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4566.600739][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4566.600742][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4566.600745][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4566.600748][ C2] default_idle_call+0x69/0xa0 [ 4566.600750][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4566.600753][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4566.600756][ C2] ? lock_release+0x1d5/0x250 [ 4566.600759][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4566.600762][ C2] do_idle+0xfb/0x160 [ 4566.600765][ C2] cpu_startup_entry+0x55/0x60 [ 4566.600767][ C2] start_secondary+0x21c/0x2b0 [ 4566.600769][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4566.600773][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4566.600779][ C2] [ 4592.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2086s! [swapper/2:0] [ 4592.569721][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4592.570981][ C2] irq event stamp: 44114564 [ 4592.571212][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4592.571756][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4592.572268][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4592.572746][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4592.573218][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4592.573674][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4592.574289][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4592.574615][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4592.575588][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4592.575895][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4592.576295][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4592.576694][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4592.577097][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4592.577499][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4592.577897][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4592.578344][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4592.578676][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4592.579075][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4592.579475][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4592.579874][ C2] PKRU: 55555554 [ 4592.580056][ C2] Call Trace: [ 4592.580225][ C2] [ 4592.580378][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4592.580640][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4592.580883][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4592.581160][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4592.581432][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4592.581720][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4592.581985][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4592.582291][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4592.582553][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4592.582816][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4592.583126][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4592.583424][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4592.583742][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4592.584031][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4592.584328][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4592.584616][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4592.584928][ C2] ? get_stack_info+0x36/0xc0 [ 4592.585169][ C2] ? lock_acquire+0x1c1/0x220 [ 4592.585412][ C2] ? lock_release+0x1d5/0x250 [ 4592.585652][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4592.585902][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4592.586176][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4592.586461][ C2] ? lock_acquire+0x1c1/0x220 [ 4592.586700][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4592.586941][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4592.587212][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4592.587448][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4592.587694][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4592.587952][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4592.588231][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4592.588507][ C2] ip_local_deliver+0x19d/0x480 [ 4592.588754][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4592.589025][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4592.589289][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4592.589637][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4592.589891][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4592.590211][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4592.590474][ C2] ip_rcv+0x564/0x740 [ 4592.590679][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4592.590907][ C2] ? set_track_prepare+0x8a/0xd0 [ 4592.591162][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4592.591439][ C2] ? start_secondary+0x21c/0x2b0 [ 4592.591690][ C2] ? skb_clone+0x10b/0x330 [ 4592.591919][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4592.592239][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4592.592545][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4592.592828][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4592.593123][ C2] ? __tcf_classify+0x329/0x7d0 [ 4592.593371][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4592.593602][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4592.593902][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4592.594186][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4592.594512][ C2] ? lock_acquire+0x1c1/0x220 [ 4592.594756][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4592.595052][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4592.595337][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4592.595653][ C2] ? __copy_skb_header+0xaf/0x490 [ 4592.595911][ C2] ? __skb_clone+0x57a/0x760 [ 4592.596146][ C2] netif_receive_skb+0x55/0x280 [ 4592.596395][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4592.596707][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4592.597045][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4592.597345][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4592.597619][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4592.597910][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4592.598224][ C2] ? get_stack_info+0x36/0xc0 [ 4592.598464][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4592.598730][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4592.599048][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4592.599328][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4592.599605][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4592.599921][ C2] ? kernel_text_address+0x17/0xe0 [ 4592.600184][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4592.600497][ C2] ? arch_stack_walk+0x8c/0x100 [ 4592.600747][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4592.601012][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4592.601296][ C2] ? lock_acquire+0x1c1/0x220 [ 4592.601535][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4592.601818][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4592.602126][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4592.602407][ C2] ? get_stack_info+0x36/0xc0 [ 4592.602646][ C2] __tcf_classify+0x329/0x7d0 [ 4592.602889][ C2] tcf_classify+0x283/0x930 [ 4592.603125][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4592.603381][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4592.603694][ C2] tc_run+0x2e4/0x5d0 [ 4592.603902][ C2] ? __pfx_tc_run+0x10/0x10 [ 4592.604133][ C2] ? lock_acquire+0x1c1/0x220 [ 4592.604374][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4592.604634][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4592.604887][ C2] ? lock_acquire+0x1c1/0x220 [ 4592.605128][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4592.605392][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4592.605695][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4592.605967][ C2] ? neigh_hh_output+0x348/0x590 [ 4592.606221][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4592.606485][ C2] ip_finish_output2+0x786/0x18e0 [ 4592.606743][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4592.607084][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4592.607360][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4592.607613][ C2] ? __ip_finish_output+0x10f/0x770 [ 4592.607879][ C2] ip_output+0x16b/0x4f0 [ 4592.608096][ C2] ? __pfx_ip_output+0x10/0x10 [ 4592.608340][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4592.608616][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4592.608927][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4592.609204][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4592.609456][ C2] ? __alloc_skb+0xd4/0x280 [ 4592.609687][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4592.609956][ C2] ? tcp_fragment+0x168/0x1040 [ 4592.610203][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4592.610454][ C2] ? ip_local_out+0x114/0x3b0 [ 4592.610695][ C2] __ip_queue_xmit+0x672/0x1910 [ 4592.610942][ C2] ? __skb_clone+0x57a/0x760 [ 4592.611179][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4592.611445][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4592.611728][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4592.611970][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4592.612221][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4592.612523][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4592.612843][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4592.613086][ C2] tcp_send_loss_probe+0x348/0x830 [ 4592.613347][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4592.613615][ C2] tcp_write_timer+0x82/0x1d0 [ 4592.613855][ C2] call_timer_fn+0x173/0x430 [ 4592.614091][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4592.614355][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4592.614616][ C2] __run_timers.part.0+0x52d/0x890 [ 4592.614878][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4592.615148][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4592.615432][ C2] ? lock_acquire+0x1c1/0x220 [ 4592.615671][ C2] ? clockevents_program_event+0xf6/0x300 [ 4592.615964][ C2] ? lock_release+0x1d5/0x250 [ 4592.616202][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4592.616466][ C2] ? ktime_get+0xb3/0x190 [ 4592.616689][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4592.616991][ C2] run_timer_softirq+0x72/0x100 [ 4592.617240][ C2] __do_softirq+0x1b9/0x7ff [ 4592.617474][ C2] irq_exit_rcu+0x98/0xc0 [ 4592.617693][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4592.617983][ C2] [ 4592.618134][ C2] [ 4592.618285][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4592.618590][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4592.618848][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4592.619818][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4592.620128][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4592.620527][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4592.620926][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4592.621325][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4592.621724][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4592.622126][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4592.622415][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4592.622676][ C2] default_idle_call+0x69/0xa0 [ 4592.622925][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4592.623178][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4592.623456][ C2] ? lock_release+0x1d5/0x250 [ 4592.623695][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4592.623968][ C2] do_idle+0xfb/0x160 [ 4592.624172][ C2] cpu_startup_entry+0x55/0x60 [ 4592.624417][ C2] start_secondary+0x21c/0x2b0 [ 4592.624661][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4592.624929][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4592.625241][ C2] [ 4592.625399][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2086s! [perl:4135] [ 4592.625828][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4592.627094][ C1] irq event stamp: 209232 [ 4592.627312][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4592.627839][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4592.628319][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4592.628790][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4592.629252][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4592.629699][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4592.630312][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4592.630636][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4592.631609][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4592.631917][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4592.632315][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4592.632713][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4592.633112][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4592.633511][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4592.633909][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4592.634355][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4592.634686][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4592.635089][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4592.635488][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4592.635885][ C1] PKRU: 55555554 [ 4592.636067][ C1] Call Trace: [ 4592.636239][ C1] [ 4592.636388][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4592.636649][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4592.636893][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4592.637175][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4592.637448][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4592.637737][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4592.638003][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4592.638309][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4592.638571][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4592.638880][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4592.639174][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4592.639488][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4592.639779][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4592.640073][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4592.640362][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4592.640674][ C1] ? get_stack_info+0x36/0xc0 [ 4592.640915][ C1] ? lock_acquire+0x1c1/0x220 [ 4592.641156][ C1] ? lock_release+0x1d5/0x250 [ 4592.641396][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4592.641645][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4592.641917][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4592.642203][ C1] ? lock_acquire+0x1c1/0x220 [ 4592.642439][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4592.642681][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4592.642941][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4592.643176][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4592.643423][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4592.643681][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4592.643956][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4592.644232][ C1] ip_local_deliver+0x19d/0x480 [ 4592.644480][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4592.644750][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4592.645015][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4592.645364][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4592.645618][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4592.645939][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4592.646202][ C1] ip_rcv+0x564/0x740 [ 4592.646406][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4592.646637][ C1] ? set_track_prepare+0x8a/0xd0 [ 4592.646889][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4592.647172][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4592.647444][ C1] ? skb_clone+0x10b/0x330 [ 4592.647672][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4592.647994][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4592.648299][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4592.648584][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4592.648877][ C1] ? __tcf_classify+0x329/0x7d0 [ 4592.649127][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4592.649358][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4592.649655][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4592.649943][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4592.650269][ C1] ? lock_acquire+0x1c1/0x220 [ 4592.650508][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4592.650802][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4592.651090][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4592.651406][ C1] ? __copy_skb_header+0xaf/0x490 [ 4592.651662][ C1] ? __skb_clone+0x57a/0x760 [ 4592.651895][ C1] netif_receive_skb+0x55/0x280 [ 4592.652143][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4592.652461][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4592.652792][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4592.653094][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4592.653368][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4592.653656][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4592.653968][ C1] ? hlock_class+0x4e/0x130 [ 4592.654202][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4592.654477][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4592.654752][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4592.655016][ C1] ? hlock_class+0x4e/0x130 [ 4592.655247][ C1] ? mark_lock+0x38/0x3e0 [ 4592.655467][ C1] ? stack_access_ok+0xda/0x1f0 [ 4592.655715][ C1] ? __lock_acquire+0xb67/0x1610 [ 4592.655969][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4592.656246][ C1] ? get_stack_info+0x36/0xc0 [ 4592.656485][ C1] ? stack_access_ok+0xda/0x1f0 [ 4592.656731][ C1] ? get_reg+0x119/0x190 [ 4592.656956][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4592.657224][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4592.657534][ C1] __tcf_classify+0x329/0x7d0 [ 4592.657775][ C1] tcf_classify+0x283/0x930 [ 4592.658005][ C1] ? arch_stack_walk+0xa2/0x100 [ 4592.658255][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4592.658511][ C1] ? get_stack_info+0x36/0xc0 [ 4592.658752][ C1] tc_run+0x2e4/0x5d0 [ 4592.658957][ C1] ? __pfx_tc_run+0x10/0x10 [ 4592.659189][ C1] ? lock_acquire+0x1c1/0x220 [ 4592.659425][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4592.659687][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4592.659938][ C1] ? lock_acquire+0x1c1/0x220 [ 4592.660178][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4592.660441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4592.660746][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4592.661017][ C1] ? neigh_hh_output+0x348/0x590 [ 4592.661270][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4592.661534][ C1] ip_finish_output2+0x786/0x18e0 [ 4592.661793][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4592.662072][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4592.662409][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4592.662684][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4592.662937][ C1] ? __ip_finish_output+0x10f/0x770 [ 4592.663201][ C1] ip_output+0x16b/0x4f0 [ 4592.663418][ C1] ? run_timer_softirq+0x72/0x100 [ 4592.663674][ C1] ? __pfx_ip_output+0x10/0x10 [ 4592.663916][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4592.664204][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4592.664456][ C1] ? ip_local_out+0x114/0x3b0 [ 4592.664696][ C1] __ip_queue_xmit+0x672/0x1910 [ 4592.664943][ C1] ? __create_object+0x5e/0xb0 [ 4592.665187][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4592.665453][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4592.665736][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4592.666007][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4592.666288][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4592.666561][ C1] tcp_delack_timer+0x84/0x240 [ 4592.666806][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4592.667086][ C1] call_timer_fn+0x173/0x430 [ 4592.667320][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4592.667582][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4592.667844][ C1] __run_timers.part.0+0x52d/0x890 [ 4592.668104][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4592.668379][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4592.668663][ C1] ? lock_acquire+0x1c1/0x220 [ 4592.668902][ C1] ? clockevents_program_event+0xf6/0x300 [ 4592.669192][ C1] ? lock_release+0x1d5/0x250 [ 4592.669430][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4592.669693][ C1] ? ktime_get+0xb3/0x190 [ 4592.669918][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4592.670214][ C1] run_timer_softirq+0x72/0x100 [ 4592.670462][ C1] __do_softirq+0x1b9/0x7ff [ 4592.670696][ C1] irq_exit_rcu+0x98/0xc0 [ 4592.670916][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4592.671203][ C1] [ 4592.671353][ C1] [ 4592.671504][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4592.671807][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4592.672130][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4592.673101][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4592.673408][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4592.673808][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4592.674208][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4592.674605][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4592.675004][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4592.675405][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4592.675701][ C1] pipe_read+0xa16/0xdf0 [ 4592.675922][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4592.676200][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4592.676444][ C1] ? iterate_tty_write+0x299/0x540 [ 4592.676705][ C1] ? lock_release+0x1d5/0x250 [ 4592.676945][ C1] vfs_read+0x911/0xc00 [ 4592.677165][ C1] ? lock_acquire+0x1c1/0x220 [ 4592.677404][ C1] ? __might_fault+0xc6/0x180 [ 4592.677643][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4592.677883][ C1] ? __might_fault+0xc6/0x180 [ 4592.678124][ C1] ? lock_release+0x1d5/0x250 [ 4592.678363][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4592.678627][ C1] ? __fget_light+0x54/0x1e0 [ 4592.678863][ C1] ksys_read+0x17a/0x1e0 [ 4592.679083][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4592.679329][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4592.679632][ C1] do_syscall_64+0xc9/0x1e0 [ 4592.679866][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4592.680167][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4592.680392][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4592.681363][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4592.681785][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4592.682183][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4592.682579][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4592.682980][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4592.683378][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4592.683780][ C1] [ 4620.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2112s! [swapper/2:0] [ 4620.569709][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4620.570960][ C2] irq event stamp: 44114564 [ 4620.571188][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4620.571723][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4620.572234][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4620.572709][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4620.573177][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4620.573630][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4620.574242][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 4620.574524][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 4620.575491][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 4620.575796][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4620.576199][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4620.576598][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4620.577004][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4620.577402][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4620.577800][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4620.578247][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4620.578588][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4620.578988][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4620.579386][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4620.579785][ C2] PKRU: 55555554 [ 4620.579966][ C2] Call Trace: [ 4620.580138][ C2] [ 4620.580285][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4620.580547][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4620.580788][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4620.581066][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4620.581338][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4620.581624][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4620.581889][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4620.582193][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4620.582453][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4620.582715][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4620.583023][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4620.583319][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4620.583633][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4620.583925][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 4620.584199][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4620.584473][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4620.584796][ C2] ? get_stack_info+0x36/0xc0 [ 4620.585036][ C2] ? lock_acquire+0x1c1/0x220 [ 4620.585274][ C2] ? lock_release+0x1d5/0x250 [ 4620.585514][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4620.585762][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4620.586033][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4620.586319][ C2] ? lock_acquire+0x1c1/0x220 [ 4620.586554][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4620.586796][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4620.587059][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4620.587295][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4620.587542][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4620.587799][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4620.588073][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4620.588348][ C2] ip_local_deliver+0x19d/0x480 [ 4620.588596][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4620.588867][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4620.589131][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4620.589477][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4620.589728][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4620.590047][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4620.590309][ C2] ip_rcv+0x564/0x740 [ 4620.590512][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4620.590742][ C2] ? set_track_prepare+0x8a/0xd0 [ 4620.590994][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4620.591270][ C2] ? start_secondary+0x21c/0x2b0 [ 4620.591522][ C2] ? skb_clone+0x10b/0x330 [ 4620.591746][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4620.592064][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4620.592370][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4620.592649][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4620.592943][ C2] ? __tcf_classify+0x329/0x7d0 [ 4620.593193][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4620.593421][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4620.593719][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4620.594004][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4620.594330][ C2] ? lock_acquire+0x1c1/0x220 [ 4620.594566][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4620.594863][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4620.595148][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4620.595462][ C2] ? __copy_skb_header+0xaf/0x490 [ 4620.595719][ C2] ? __skb_clone+0x57a/0x760 [ 4620.595953][ C2] netif_receive_skb+0x55/0x280 [ 4620.596203][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4620.596515][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4620.596852][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4620.597151][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4620.597427][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4620.597714][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4620.598026][ C2] ? get_stack_info+0x36/0xc0 [ 4620.598268][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4620.598532][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4620.598849][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4620.599125][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4620.599399][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4620.599714][ C2] ? kernel_text_address+0x17/0xe0 [ 4620.599973][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4620.600287][ C2] ? arch_stack_walk+0x8c/0x100 [ 4620.600535][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4620.600798][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4620.601084][ C2] ? lock_acquire+0x1c1/0x220 [ 4620.601322][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4620.601605][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4620.601912][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4620.602190][ C2] ? get_stack_info+0x36/0xc0 [ 4620.602430][ C2] __tcf_classify+0x329/0x7d0 [ 4620.602673][ C2] tcf_classify+0x283/0x930 [ 4620.602907][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4620.603168][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4620.603480][ C2] tc_run+0x2e4/0x5d0 [ 4620.603684][ C2] ? __pfx_tc_run+0x10/0x10 [ 4620.603916][ C2] ? lock_acquire+0x1c1/0x220 [ 4620.604153][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4620.604414][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4620.604665][ C2] ? lock_acquire+0x1c1/0x220 [ 4620.604903][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4620.605166][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4620.605469][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4620.605739][ C2] ? neigh_hh_output+0x348/0x590 [ 4620.605991][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4620.606255][ C2] ip_finish_output2+0x786/0x18e0 [ 4620.606511][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4620.606858][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4620.607134][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4620.607386][ C2] ? __ip_finish_output+0x10f/0x770 [ 4620.607650][ C2] ip_output+0x16b/0x4f0 [ 4620.607864][ C2] ? __pfx_ip_output+0x10/0x10 [ 4620.608108][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4620.608384][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4620.608695][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4620.608973][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4620.609223][ C2] ? __alloc_skb+0xd4/0x280 [ 4620.609452][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4620.609719][ C2] ? tcp_fragment+0x168/0x1040 [ 4620.609963][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4620.610213][ C2] ? ip_local_out+0x114/0x3b0 [ 4620.610453][ C2] __ip_queue_xmit+0x672/0x1910 [ 4620.610700][ C2] ? __skb_clone+0x57a/0x760 [ 4620.610933][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4620.611202][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4620.611481][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4620.611726][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4620.611974][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4620.612272][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4620.612591][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4620.612834][ C2] tcp_send_loss_probe+0x348/0x830 [ 4620.613094][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4620.613361][ C2] tcp_write_timer+0x82/0x1d0 [ 4620.613601][ C2] call_timer_fn+0x173/0x430 [ 4620.613838][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4620.614099][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4620.614361][ C2] __run_timers.part.0+0x52d/0x890 [ 4620.614620][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4620.614887][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4620.615174][ C2] ? lock_acquire+0x1c1/0x220 [ 4620.615410][ C2] ? clockevents_program_event+0xf6/0x300 [ 4620.615702][ C2] ? lock_release+0x1d5/0x250 [ 4620.615940][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4620.616205][ C2] ? ktime_get+0xb3/0x190 [ 4620.616427][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4620.616724][ C2] run_timer_softirq+0x72/0x100 [ 4620.616978][ C2] __do_softirq+0x1b9/0x7ff [ 4620.617209][ C2] irq_exit_rcu+0x98/0xc0 [ 4620.617432][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4620.617716][ C2] [ 4620.617868][ C2] [ 4620.618017][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4620.618323][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4620.618580][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4620.619549][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4620.619858][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4620.620256][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4620.620653][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4620.621051][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4620.621451][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4620.621850][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4620.622139][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4620.622400][ C2] default_idle_call+0x69/0xa0 [ 4620.622643][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4620.622895][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4620.623175][ C2] ? lock_release+0x1d5/0x250 [ 4620.623411][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4620.623686][ C2] do_idle+0xfb/0x160 [ 4620.623889][ C2] cpu_startup_entry+0x55/0x60 [ 4620.624132][ C2] start_secondary+0x21c/0x2b0 [ 4620.624373][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4620.624644][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4620.624952][ C2] [ 4620.625112][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2112s! [perl:4135] [ 4620.625541][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4620.626792][ C1] irq event stamp: 209232 [ 4620.627013][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4620.627542][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4620.628019][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4620.628486][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4620.628947][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4620.629397][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4620.630010][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 4620.630298][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 4620.631268][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000282 [ 4620.631574][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4620.631974][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4620.632372][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4620.632769][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4620.633167][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4620.633567][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4620.634015][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4620.634347][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4620.634747][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4620.635145][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4620.635545][ C1] PKRU: 55555554 [ 4620.635726][ C1] Call Trace: [ 4620.635895][ C1] [ 4620.636044][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4620.636306][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4620.636549][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4620.636833][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4620.637105][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4620.637395][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4620.637662][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4620.637965][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4620.638227][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 4620.638489][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4620.638798][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4620.639095][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4620.639411][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4620.639698][ C1] ? kasan_check_range+0x1b/0x1c0 [ 4620.639954][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4620.640238][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4620.640549][ C1] ? get_stack_info+0x36/0xc0 [ 4620.640788][ C1] ? lock_acquire+0x1c1/0x220 [ 4620.641030][ C1] ? lock_release+0x1d5/0x250 [ 4620.641271][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4620.641520][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4620.641792][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4620.642076][ C1] ? lock_acquire+0x1c1/0x220 [ 4620.642315][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4620.642557][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4620.642818][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4620.643052][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4620.643299][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4620.643557][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4620.643835][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4620.644112][ C1] ip_local_deliver+0x19d/0x480 [ 4620.644361][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4620.644632][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4620.644895][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4620.645244][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4620.645496][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4620.645817][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4620.646079][ C1] ip_rcv+0x564/0x740 [ 4620.646288][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4620.646517][ C1] ? set_track_prepare+0x8a/0xd0 [ 4620.646770][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4620.647052][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4620.647325][ C1] ? skb_clone+0x10b/0x330 [ 4620.647551][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4620.647870][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4620.648177][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4620.648459][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4620.648755][ C1] ? __tcf_classify+0x329/0x7d0 [ 4620.649005][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4620.649235][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4620.649536][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4620.649820][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4620.650146][ C1] ? lock_acquire+0x1c1/0x220 [ 4620.650383][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4620.650680][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4620.650965][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4620.651281][ C1] ? __copy_skb_header+0xaf/0x490 [ 4620.651539][ C1] ? __skb_clone+0x57a/0x760 [ 4620.651774][ C1] netif_receive_skb+0x55/0x280 [ 4620.652023][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4620.652337][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4620.652672][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4620.652971][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4620.653247][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4620.653534][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4620.653850][ C1] ? hlock_class+0x4e/0x130 [ 4620.654083][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4620.654359][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4620.654634][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4620.654897][ C1] ? hlock_class+0x4e/0x130 [ 4620.655129][ C1] ? mark_lock+0x38/0x3e0 [ 4620.655347][ C1] ? stack_access_ok+0xda/0x1f0 [ 4620.655596][ C1] ? __lock_acquire+0xb67/0x1610 [ 4620.655850][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4620.656126][ C1] ? get_stack_info+0x36/0xc0 [ 4620.656369][ C1] ? stack_access_ok+0xda/0x1f0 [ 4620.656614][ C1] ? get_reg+0x119/0x190 [ 4620.656836][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4620.657105][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4620.657414][ C1] __tcf_classify+0x329/0x7d0 [ 4620.657656][ C1] tcf_classify+0x283/0x930 [ 4620.657888][ C1] ? arch_stack_walk+0xa2/0x100 [ 4620.658138][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4620.658395][ C1] ? get_stack_info+0x36/0xc0 [ 4620.658636][ C1] tc_run+0x2e4/0x5d0 [ 4620.658843][ C1] ? __pfx_tc_run+0x10/0x10 [ 4620.659072][ C1] ? lock_acquire+0x1c1/0x220 [ 4620.659311][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4620.659572][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4620.659824][ C1] ? lock_acquire+0x1c1/0x220 [ 4620.660062][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4620.660328][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4620.660634][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4620.660906][ C1] ? neigh_hh_output+0x348/0x590 [ 4620.661160][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4620.661423][ C1] ip_finish_output2+0x786/0x18e0 [ 4620.661679][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4620.661957][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4620.662294][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4620.662570][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4620.662823][ C1] ? __ip_finish_output+0x10f/0x770 [ 4620.663088][ C1] ip_output+0x16b/0x4f0 [ 4620.663304][ C1] ? run_timer_softirq+0x72/0x100 [ 4620.663560][ C1] ? __pfx_ip_output+0x10/0x10 [ 4620.663804][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4620.664089][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4620.664340][ C1] ? ip_local_out+0x114/0x3b0 [ 4620.664580][ C1] __ip_queue_xmit+0x672/0x1910 [ 4620.664828][ C1] ? __create_object+0x5e/0xb0 [ 4620.665073][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4620.665339][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4620.665620][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4620.665894][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4620.666175][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4620.666445][ C1] tcp_delack_timer+0x84/0x240 [ 4620.666689][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4620.666964][ C1] call_timer_fn+0x173/0x430 [ 4620.667201][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4620.667463][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4620.667724][ C1] __run_timers.part.0+0x52d/0x890 [ 4620.667984][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4620.668257][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4620.668544][ C1] ? lock_acquire+0x1c1/0x220 [ 4620.668784][ C1] ? clockevents_program_event+0xf6/0x300 [ 4620.669073][ C1] ? lock_release+0x1d5/0x250 [ 4620.669313][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4620.669577][ C1] ? ktime_get+0xb3/0x190 [ 4620.669797][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4620.670093][ C1] run_timer_softirq+0x72/0x100 [ 4620.670343][ C1] __do_softirq+0x1b9/0x7ff [ 4620.670576][ C1] irq_exit_rcu+0x98/0xc0 [ 4620.670796][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4620.671085][ C1] [ 4620.671237][ C1] [ 4620.671387][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4620.671692][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4620.672017][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4620.672985][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4620.673293][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4620.673691][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4620.674089][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4620.674490][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4620.674888][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4620.675291][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4620.675587][ C1] pipe_read+0xa16/0xdf0 [ 4620.675807][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4620.676084][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4620.676330][ C1] ? iterate_tty_write+0x299/0x540 [ 4620.676591][ C1] ? lock_release+0x1d5/0x250 [ 4620.676844][ C1] vfs_read+0x911/0xc00 [ 4620.677059][ C1] ? lock_acquire+0x1c1/0x220 [ 4620.677296][ C1] ? __might_fault+0xc6/0x180 [ 4620.677537][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4620.677778][ C1] ? __might_fault+0xc6/0x180 [ 4620.678016][ C1] ? lock_release+0x1d5/0x250 [ 4620.678256][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4620.678519][ C1] ? __fget_light+0x54/0x1e0 [ 4620.678758][ C1] ksys_read+0x17a/0x1e0 [ 4620.678974][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4620.679219][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4620.679523][ C1] do_syscall_64+0xc9/0x1e0 [ 4620.679757][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4620.680054][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4620.680283][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4620.681247][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4620.681668][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4620.682067][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4620.682465][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4620.682864][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4620.683267][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4620.683668][ C1] [ 4644.600103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4644.600468][ C1] rcu: 1-....: (2284147 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=555311 [ 4644.601024][ C1] rcu: (t=2289713 jiffies g=1882453 q=709 ncpus=4) [ 4644.601358][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4644.601805][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4644.602416][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4644.602742][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4644.603711][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4644.604020][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4644.604418][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4644.604818][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4644.605216][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4644.605613][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4644.606011][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4644.606459][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4644.606799][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4644.607201][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4644.607598][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4644.607996][ C1] PKRU: 55555554 [ 4644.608179][ C1] Call Trace: [ 4644.608351][ C1] [ 4644.608499][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4644.608772][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4644.609024][ C1] ? check_cpu_stall+0x284/0x500 [ 4644.609276][ C1] ? rcu_pending+0x92/0x360 [ 4644.609509][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4644.609779][ C1] ? update_process_times+0xb9/0x110 [ 4644.610048][ C1] ? tick_sched_handle+0x67/0x130 [ 4644.610305][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4644.610592][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4644.610835][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4644.611146][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4644.611420][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4644.611707][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4644.611972][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4644.612279][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4644.612540][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4644.612849][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4644.613147][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4644.613462][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4644.613752][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4644.614048][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4644.614337][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4644.614648][ C1] ? get_stack_info+0x36/0xc0 [ 4644.614890][ C1] ? lock_acquire+0x1c1/0x220 [ 4644.615129][ C1] ? lock_release+0x1d5/0x250 [ 4644.615369][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4644.615618][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4644.615890][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4644.616177][ C1] ? lock_acquire+0x1c1/0x220 [ 4644.616416][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4644.616657][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4644.616920][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4644.617157][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4644.617404][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4644.617662][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4644.617937][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4644.618213][ C1] ip_local_deliver+0x19d/0x480 [ 4644.618462][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4644.618735][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4644.619000][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4644.619347][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4644.619600][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4644.619921][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4644.620184][ C1] ip_rcv+0x564/0x740 [ 4644.620388][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4644.620620][ C1] ? set_track_prepare+0x8a/0xd0 [ 4644.620874][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4644.621150][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4644.621420][ C1] ? skb_clone+0x10b/0x330 [ 4644.621650][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4644.621970][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4644.622276][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4644.622559][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4644.622854][ C1] ? __tcf_classify+0x329/0x7d0 [ 4644.623103][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4644.623335][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4644.623635][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4644.623919][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4644.624244][ C1] ? lock_acquire+0x1c1/0x220 [ 4644.624483][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4644.624778][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4644.625064][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4644.625381][ C1] ? __copy_skb_header+0xaf/0x490 [ 4644.625639][ C1] ? __skb_clone+0x57a/0x760 [ 4644.625874][ C1] netif_receive_skb+0x55/0x280 [ 4644.626122][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4644.626435][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4644.626773][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4644.627073][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4644.627347][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4644.627637][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4644.627948][ C1] ? hlock_class+0x4e/0x130 [ 4644.628183][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4644.628458][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4644.628737][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4644.629004][ C1] ? hlock_class+0x4e/0x130 [ 4644.629235][ C1] ? mark_lock+0x38/0x3e0 [ 4644.629457][ C1] ? stack_access_ok+0xda/0x1f0 [ 4644.629707][ C1] ? __lock_acquire+0xb67/0x1610 [ 4644.629960][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4644.630237][ C1] ? get_stack_info+0x36/0xc0 [ 4644.630478][ C1] ? stack_access_ok+0xda/0x1f0 [ 4644.630725][ C1] ? get_reg+0x119/0x190 [ 4644.630941][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4644.631209][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4644.631518][ C1] __tcf_classify+0x329/0x7d0 [ 4644.631761][ C1] tcf_classify+0x283/0x930 [ 4644.631991][ C1] ? arch_stack_walk+0xa2/0x100 [ 4644.632241][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4644.632497][ C1] ? get_stack_info+0x36/0xc0 [ 4644.632738][ C1] tc_run+0x2e4/0x5d0 [ 4644.632943][ C1] ? __pfx_tc_run+0x10/0x10 [ 4644.633175][ C1] ? lock_acquire+0x1c1/0x220 [ 4644.633413][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4644.633674][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4644.633927][ C1] ? lock_acquire+0x1c1/0x220 [ 4644.634165][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4644.634430][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4644.634735][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4644.635006][ C1] ? neigh_hh_output+0x348/0x590 [ 4644.635260][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4644.635525][ C1] ip_finish_output2+0x786/0x18e0 [ 4644.635782][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4644.636062][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4644.636398][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4644.636673][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4644.636931][ C1] ? __ip_finish_output+0x10f/0x770 [ 4644.637195][ C1] ip_output+0x16b/0x4f0 [ 4644.637413][ C1] ? run_timer_softirq+0x72/0x100 [ 4644.637670][ C1] ? __pfx_ip_output+0x10/0x10 [ 4644.637913][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4644.638198][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4644.638450][ C1] ? ip_local_out+0x114/0x3b0 [ 4644.638691][ C1] __ip_queue_xmit+0x672/0x1910 [ 4644.638938][ C1] ? __create_object+0x5e/0xb0 [ 4644.639180][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4644.639448][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4644.639729][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4644.640000][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4644.640282][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4644.640555][ C1] tcp_delack_timer+0x84/0x240 [ 4644.640798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4644.641070][ C1] call_timer_fn+0x173/0x430 [ 4644.641306][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4644.641568][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4644.641829][ C1] __run_timers.part.0+0x52d/0x890 [ 4644.642090][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4644.642363][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4644.642647][ C1] ? lock_acquire+0x1c1/0x220 [ 4644.642886][ C1] ? clockevents_program_event+0xf6/0x300 [ 4644.643177][ C1] ? lock_release+0x1d5/0x250 [ 4644.643414][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4644.643679][ C1] ? ktime_get+0xb3/0x190 [ 4644.643901][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4644.644198][ C1] run_timer_softirq+0x72/0x100 [ 4644.644445][ C1] __do_softirq+0x1b9/0x7ff [ 4644.644677][ C1] irq_exit_rcu+0x98/0xc0 [ 4644.644898][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4644.645184][ C1] [ 4644.645332][ C1] [ 4644.645485][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4644.645789][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4644.646113][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4644.647088][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4644.647394][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4644.647794][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4644.648192][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4644.648589][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4644.648987][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4644.649388][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4644.649683][ C1] pipe_read+0xa16/0xdf0 [ 4644.649907][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4644.650184][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4644.650428][ C1] ? iterate_tty_write+0x299/0x540 [ 4644.650689][ C1] ? lock_release+0x1d5/0x250 [ 4644.650930][ C1] vfs_read+0x911/0xc00 [ 4644.651145][ C1] ? lock_acquire+0x1c1/0x220 [ 4644.651384][ C1] ? __might_fault+0xc6/0x180 [ 4644.651623][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4644.651862][ C1] ? __might_fault+0xc6/0x180 [ 4644.652102][ C1] ? lock_release+0x1d5/0x250 [ 4644.652343][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4644.652607][ C1] ? __fget_light+0x54/0x1e0 [ 4644.652844][ C1] ksys_read+0x17a/0x1e0 [ 4644.653062][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4644.653306][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4644.653609][ C1] do_syscall_64+0xc9/0x1e0 [ 4644.653842][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4644.654142][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4644.654368][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4644.655338][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4644.655760][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4644.656158][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4644.656557][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4644.656962][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4644.657361][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4644.657761][ C1] [ 4644.657920][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4644.658197][ C2] NMI backtrace for cpu 2 [ 4644.658207][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4644.658214][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4644.658218][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4644.658228][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4644.658232][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4644.658236][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4644.658238][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4644.658241][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4644.658242][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4644.658244][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4644.658246][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4644.658248][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4644.658252][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4644.658253][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4644.658255][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4644.658256][ C2] PKRU: 55555554 [ 4644.658257][ C2] Call Trace: [ 4644.658261][ C2] [ 4644.658265][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4644.658273][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4644.658280][ C2] ? nmi_handle+0x153/0x420 [ 4644.658286][ C2] ? default_do_nmi+0x41/0x100 [ 4644.658289][ C2] ? exc_nmi+0xf3/0x120 [ 4644.658292][ C2] ? end_repeat_nmi+0xf/0x60 [ 4644.658299][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4644.658303][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4644.658306][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4644.658310][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4644.658313][ C2] [ 4644.658314][ C2] [ 4644.658315][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4644.658318][ C2] ? get_stack_info+0x36/0xc0 [ 4644.658323][ C2] ? lock_acquire+0x1c1/0x220 [ 4644.658328][ C2] ? lock_release+0x1d5/0x250 [ 4644.658331][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4644.658335][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4644.658338][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4644.658341][ C2] ? lock_acquire+0x1c1/0x220 [ 4644.658344][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4644.658349][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4644.658352][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4644.658359][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4644.658361][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4644.658367][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4644.658374][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4644.658378][ C2] ip_local_deliver+0x19d/0x480 [ 4644.658380][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4644.658383][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4644.658385][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4644.658392][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4644.658398][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4644.658401][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4644.658411][ C2] ip_rcv+0x564/0x740 [ 4644.658414][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4644.658416][ C2] ? set_track_prepare+0x8a/0xd0 [ 4644.658422][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4644.658425][ C2] ? start_secondary+0x21c/0x2b0 [ 4644.658430][ C2] ? skb_clone+0x10b/0x330 [ 4644.658435][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4644.658441][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4644.658446][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4644.658451][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4644.658460][ C2] ? __tcf_classify+0x329/0x7d0 [ 4644.658464][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4644.658467][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4644.658471][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4644.658474][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4644.658478][ C2] ? lock_acquire+0x1c1/0x220 [ 4644.658481][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4644.658485][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4644.658489][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4644.658494][ C2] ? __copy_skb_header+0xaf/0x490 [ 4644.658499][ C2] ? __skb_clone+0x57a/0x760 [ 4644.658501][ C2] netif_receive_skb+0x55/0x280 [ 4644.658505][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4644.658513][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4644.658520][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4644.658526][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4644.658531][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4644.658542][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4644.658549][ C2] ? get_stack_info+0x36/0xc0 [ 4644.658554][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4644.658558][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4644.658564][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4644.658567][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4644.658570][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4644.658573][ C2] ? kernel_text_address+0x17/0xe0 [ 4644.658577][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4644.658584][ C2] ? arch_stack_walk+0x8c/0x100 [ 4644.658588][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4644.658592][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4644.658595][ C2] ? lock_acquire+0x1c1/0x220 [ 4644.658597][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4644.658603][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4644.658609][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4644.658611][ C2] ? get_stack_info+0x36/0xc0 [ 4644.658616][ C2] __tcf_classify+0x329/0x7d0 [ 4644.658621][ C2] tcf_classify+0x283/0x930 [ 4644.658626][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4644.658629][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4644.658634][ C2] tc_run+0x2e4/0x5d0 [ 4644.658639][ C2] ? __pfx_tc_run+0x10/0x10 [ 4644.658642][ C2] ? lock_acquire+0x1c1/0x220 [ 4644.658644][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4644.658648][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4644.658653][ C2] ? lock_acquire+0x1c1/0x220 [ 4644.658655][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4644.658659][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4644.658662][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4644.658665][ C2] ? neigh_hh_output+0x348/0x590 [ 4644.658669][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4644.658672][ C2] ip_finish_output2+0x786/0x18e0 [ 4644.658676][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4644.658684][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4644.658687][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4644.658691][ C2] ? __ip_finish_output+0x10f/0x770 [ 4644.658695][ C2] ip_output+0x16b/0x4f0 [ 4644.658698][ C2] ? __pfx_ip_output+0x10/0x10 [ 4644.658701][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4644.658704][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4644.658707][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4644.658711][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4644.658714][ C2] ? __alloc_skb+0xd4/0x280 [ 4644.658716][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4644.658721][ C2] ? tcp_fragment+0x168/0x1040 [ 4644.658725][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4644.658728][ C2] ? ip_local_out+0x114/0x3b0 [ 4644.658732][ C2] __ip_queue_xmit+0x672/0x1910 [ 4644.658736][ C2] ? __skb_clone+0x57a/0x760 [ 4644.658738][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4644.658744][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4644.658748][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4644.658752][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4644.658758][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4644.658763][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4644.658766][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4644.658769][ C2] tcp_send_loss_probe+0x348/0x830 [ 4644.658773][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4644.658776][ C2] tcp_write_timer+0x82/0x1d0 [ 4644.658779][ C2] call_timer_fn+0x173/0x430 [ 4644.658785][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4644.658790][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4644.658794][ C2] __run_timers.part.0+0x52d/0x890 [ 4644.658797][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4644.658802][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4644.658805][ C2] ? lock_acquire+0x1c1/0x220 [ 4644.658808][ C2] ? clockevents_program_event+0xf6/0x300 [ 4644.658814][ C2] ? lock_release+0x1d5/0x250 [ 4644.658816][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4644.658821][ C2] ? ktime_get+0xb3/0x190 [ 4644.658825][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4644.658829][ C2] run_timer_softirq+0x72/0x100 [ 4644.658833][ C2] __do_softirq+0x1b9/0x7ff [ 4644.658838][ C2] irq_exit_rcu+0x98/0xc0 [ 4644.658841][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4644.658845][ C2] [ 4644.658846][ C2] [ 4644.658847][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4644.658850][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4644.658854][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4644.658857][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4644.658859][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4644.658861][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4644.658863][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4644.658865][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4644.658866][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4644.658869][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4644.658873][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4644.658877][ C2] default_idle_call+0x69/0xa0 [ 4644.658881][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4644.658883][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4644.658888][ C2] ? lock_release+0x1d5/0x250 [ 4644.658890][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4644.658895][ C2] do_idle+0xfb/0x160 [ 4644.658897][ C2] cpu_startup_entry+0x55/0x60 [ 4644.658900][ C2] start_secondary+0x21c/0x2b0 [ 4644.658903][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4644.658907][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4644.658913][ C2] [ 4672.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2160s! [swapper/2:0] [ 4672.569714][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4672.570971][ C2] irq event stamp: 44114564 [ 4672.571198][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4672.571738][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4672.572249][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4672.572723][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4672.573193][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4672.573649][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4672.574262][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4672.574585][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4672.575551][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4672.575859][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4672.576262][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4672.576668][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4672.577066][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4672.577464][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4672.577861][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4672.578309][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4672.578644][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4672.579045][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4672.579442][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4672.579839][ C2] PKRU: 55555554 [ 4672.580020][ C2] Call Trace: [ 4672.580194][ C2] [ 4672.580341][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4672.580603][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4672.580848][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4672.581125][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4672.581398][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4672.581684][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4672.581949][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4672.582259][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4672.582519][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4672.582780][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4672.583090][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4672.583387][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4672.583703][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4672.583991][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4672.584287][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4672.584573][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4672.584884][ C2] ? get_stack_info+0x36/0xc0 [ 4672.585126][ C2] ? lock_acquire+0x1c1/0x220 [ 4672.585366][ C2] ? lock_release+0x1d5/0x250 [ 4672.585604][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4672.585854][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4672.586130][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4672.586415][ C2] ? lock_acquire+0x1c1/0x220 [ 4672.586661][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4672.586899][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4672.587163][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4672.587398][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4672.587645][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4672.587903][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4672.588179][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4672.588457][ C2] ip_local_deliver+0x19d/0x480 [ 4672.588702][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4672.588975][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4672.589240][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4672.589586][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4672.589841][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4672.590161][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4672.590423][ C2] ip_rcv+0x564/0x740 [ 4672.590626][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4672.590859][ C2] ? set_track_prepare+0x8a/0xd0 [ 4672.591112][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4672.591387][ C2] ? start_secondary+0x21c/0x2b0 [ 4672.591639][ C2] ? skb_clone+0x10b/0x330 [ 4672.591869][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4672.592189][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4672.592492][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4672.592776][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4672.593069][ C2] ? __tcf_classify+0x329/0x7d0 [ 4672.593320][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4672.593552][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4672.593849][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4672.594138][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4672.594462][ C2] ? lock_acquire+0x1c1/0x220 [ 4672.594700][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4672.594994][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4672.595282][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4672.595599][ C2] ? __copy_skb_header+0xaf/0x490 [ 4672.595856][ C2] ? __skb_clone+0x57a/0x760 [ 4672.596088][ C2] netif_receive_skb+0x55/0x280 [ 4672.596338][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4672.596656][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4672.596987][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4672.597288][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4672.597560][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4672.597846][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4672.598159][ C2] ? get_stack_info+0x36/0xc0 [ 4672.598400][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4672.598664][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4672.598980][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4672.599256][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4672.599534][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4672.599850][ C2] ? kernel_text_address+0x17/0xe0 [ 4672.600112][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4672.600424][ C2] ? arch_stack_walk+0x8c/0x100 [ 4672.600671][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4672.600936][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4672.601222][ C2] ? lock_acquire+0x1c1/0x220 [ 4672.601461][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4672.601743][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4672.602048][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4672.602326][ C2] ? get_stack_info+0x36/0xc0 [ 4672.602568][ C2] __tcf_classify+0x329/0x7d0 [ 4672.602809][ C2] tcf_classify+0x283/0x930 [ 4672.603040][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4672.603298][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4672.603611][ C2] tc_run+0x2e4/0x5d0 [ 4672.603816][ C2] ? __pfx_tc_run+0x10/0x10 [ 4672.604048][ C2] ? lock_acquire+0x1c1/0x220 [ 4672.604290][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4672.604557][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4672.604811][ C2] ? lock_acquire+0x1c1/0x220 [ 4672.605048][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4672.605315][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4672.605616][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4672.605889][ C2] ? neigh_hh_output+0x348/0x590 [ 4672.606142][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4672.606408][ C2] ip_finish_output2+0x786/0x18e0 [ 4672.606672][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4672.607009][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4672.607285][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4672.607537][ C2] ? __ip_finish_output+0x10f/0x770 [ 4672.607800][ C2] ip_output+0x16b/0x4f0 [ 4672.608018][ C2] ? __pfx_ip_output+0x10/0x10 [ 4672.608260][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4672.608539][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4672.608852][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4672.609128][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4672.609384][ C2] ? __alloc_skb+0xd4/0x280 [ 4672.609613][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4672.609884][ C2] ? tcp_fragment+0x168/0x1040 [ 4672.610127][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4672.610378][ C2] ? ip_local_out+0x114/0x3b0 [ 4672.610619][ C2] __ip_queue_xmit+0x672/0x1910 [ 4672.610866][ C2] ? __skb_clone+0x57a/0x760 [ 4672.611106][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4672.611373][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4672.611653][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4672.611899][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4672.612150][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4672.612451][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4672.612772][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4672.613013][ C2] tcp_send_loss_probe+0x348/0x830 [ 4672.613275][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4672.613544][ C2] tcp_write_timer+0x82/0x1d0 [ 4672.613781][ C2] call_timer_fn+0x173/0x430 [ 4672.614020][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4672.614283][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4672.614544][ C2] __run_timers.part.0+0x52d/0x890 [ 4672.614803][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4672.615073][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4672.615361][ C2] ? lock_acquire+0x1c1/0x220 [ 4672.615605][ C2] ? clockevents_program_event+0xf6/0x300 [ 4672.615893][ C2] ? lock_release+0x1d5/0x250 [ 4672.616133][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4672.616404][ C2] ? ktime_get+0xb3/0x190 [ 4672.616634][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4672.616931][ C2] run_timer_softirq+0x72/0x100 [ 4672.617179][ C2] __do_softirq+0x1b9/0x7ff [ 4672.617413][ C2] irq_exit_rcu+0x98/0xc0 [ 4672.617632][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4672.617917][ C2] [ 4672.618069][ C2] [ 4672.618219][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4672.618524][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4672.618787][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4672.619757][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4672.620065][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4672.620464][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4672.620860][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4672.621261][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4672.621659][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4672.622057][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4672.622349][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4672.622610][ C2] default_idle_call+0x69/0xa0 [ 4672.622853][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4672.623105][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4672.623385][ C2] ? lock_release+0x1d5/0x250 [ 4672.623622][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4672.623896][ C2] do_idle+0xfb/0x160 [ 4672.624099][ C2] cpu_startup_entry+0x55/0x60 [ 4672.624344][ C2] start_secondary+0x21c/0x2b0 [ 4672.624589][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4672.624857][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4672.625168][ C2] [ 4672.625326][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2160s! [perl:4135] [ 4672.625754][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4672.627012][ C1] irq event stamp: 209232 [ 4672.627232][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4672.627760][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4672.628234][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4672.628705][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4672.629167][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4672.629613][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4672.630225][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4672.630545][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4672.631513][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4672.631819][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4672.632220][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4672.632618][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4672.633016][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4672.633413][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4672.633812][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4672.634259][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4672.634590][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4672.634988][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4672.635387][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4672.635786][ C1] PKRU: 55555554 [ 4672.635971][ C1] Call Trace: [ 4672.636141][ C1] [ 4672.636290][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4672.636552][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4672.636800][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4672.637079][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4672.637351][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4672.637638][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4672.637905][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4672.638210][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4672.638473][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4672.638782][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4672.639079][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4672.639395][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4672.639682][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4672.639973][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4672.640261][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4672.640573][ C1] ? get_stack_info+0x36/0xc0 [ 4672.640815][ C1] ? lock_acquire+0x1c1/0x220 [ 4672.641056][ C1] ? lock_release+0x1d5/0x250 [ 4672.641294][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4672.641544][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4672.641816][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4672.642102][ C1] ? lock_acquire+0x1c1/0x220 [ 4672.642341][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4672.642581][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4672.642846][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4672.643080][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4672.643328][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4672.643586][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4672.643861][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4672.644140][ C1] ip_local_deliver+0x19d/0x480 [ 4672.644386][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4672.644659][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4672.644922][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4672.645269][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4672.645522][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4672.645842][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4672.646104][ C1] ip_rcv+0x564/0x740 [ 4672.646307][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4672.646539][ C1] ? set_track_prepare+0x8a/0xd0 [ 4672.646797][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4672.647072][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4672.647345][ C1] ? skb_clone+0x10b/0x330 [ 4672.647572][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4672.647891][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4672.648199][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4672.648479][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4672.648774][ C1] ? __tcf_classify+0x329/0x7d0 [ 4672.649021][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4672.649252][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4672.649553][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4672.649837][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4672.650162][ C1] ? lock_acquire+0x1c1/0x220 [ 4672.650401][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4672.650697][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4672.650982][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4672.651299][ C1] ? __copy_skb_header+0xaf/0x490 [ 4672.651557][ C1] ? __skb_clone+0x57a/0x760 [ 4672.651793][ C1] netif_receive_skb+0x55/0x280 [ 4672.652041][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4672.652351][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4672.652684][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4672.652983][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4672.653256][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4672.653547][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4672.653858][ C1] ? hlock_class+0x4e/0x130 [ 4672.654090][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4672.654366][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4672.654642][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4672.654905][ C1] ? hlock_class+0x4e/0x130 [ 4672.655137][ C1] ? mark_lock+0x38/0x3e0 [ 4672.655357][ C1] ? stack_access_ok+0xda/0x1f0 [ 4672.655605][ C1] ? __lock_acquire+0xb67/0x1610 [ 4672.655859][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4672.656135][ C1] ? get_stack_info+0x36/0xc0 [ 4672.656375][ C1] ? stack_access_ok+0xda/0x1f0 [ 4672.656631][ C1] ? get_reg+0x119/0x190 [ 4672.656846][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4672.657113][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4672.657422][ C1] __tcf_classify+0x329/0x7d0 [ 4672.657664][ C1] tcf_classify+0x283/0x930 [ 4672.657896][ C1] ? arch_stack_walk+0xa2/0x100 [ 4672.658143][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4672.658400][ C1] ? get_stack_info+0x36/0xc0 [ 4672.658641][ C1] tc_run+0x2e4/0x5d0 [ 4672.658845][ C1] ? __pfx_tc_run+0x10/0x10 [ 4672.659078][ C1] ? lock_acquire+0x1c1/0x220 [ 4672.659317][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4672.659578][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4672.659831][ C1] ? lock_acquire+0x1c1/0x220 [ 4672.660068][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4672.660334][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4672.660638][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4672.660911][ C1] ? neigh_hh_output+0x348/0x590 [ 4672.661164][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4672.661429][ C1] ip_finish_output2+0x786/0x18e0 [ 4672.661685][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4672.661963][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4672.662302][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4672.662578][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4672.662829][ C1] ? __ip_finish_output+0x10f/0x770 [ 4672.663095][ C1] ip_output+0x16b/0x4f0 [ 4672.663312][ C1] ? run_timer_softirq+0x72/0x100 [ 4672.663569][ C1] ? __pfx_ip_output+0x10/0x10 [ 4672.663813][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4672.664098][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4672.664349][ C1] ? ip_local_out+0x114/0x3b0 [ 4672.664590][ C1] __ip_queue_xmit+0x672/0x1910 [ 4672.664839][ C1] ? __create_object+0x5e/0xb0 [ 4672.665081][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4672.665349][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4672.665629][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4672.665901][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4672.666184][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4672.666456][ C1] tcp_delack_timer+0x84/0x240 [ 4672.666705][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4672.666976][ C1] call_timer_fn+0x173/0x430 [ 4672.667214][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4672.667476][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4672.667737][ C1] __run_timers.part.0+0x52d/0x890 [ 4672.667996][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4672.668269][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4672.668554][ C1] ? lock_acquire+0x1c1/0x220 [ 4672.668791][ C1] ? clockevents_program_event+0xf6/0x300 [ 4672.669086][ C1] ? lock_release+0x1d5/0x250 [ 4672.669325][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4672.669590][ C1] ? ktime_get+0xb3/0x190 [ 4672.669810][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4672.670106][ C1] run_timer_softirq+0x72/0x100 [ 4672.670357][ C1] __do_softirq+0x1b9/0x7ff [ 4672.670589][ C1] irq_exit_rcu+0x98/0xc0 [ 4672.670810][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4672.671095][ C1] [ 4672.671245][ C1] [ 4672.671397][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4672.671700][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4672.672025][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4672.672993][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4672.673301][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4672.673699][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4672.674095][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4672.674492][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4672.674891][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4672.675292][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4672.675587][ C1] pipe_read+0xa16/0xdf0 [ 4672.675809][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4672.676085][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4672.676329][ C1] ? iterate_tty_write+0x299/0x540 [ 4672.676597][ C1] ? lock_release+0x1d5/0x250 [ 4672.676839][ C1] vfs_read+0x911/0xc00 [ 4672.677053][ C1] ? lock_acquire+0x1c1/0x220 [ 4672.677292][ C1] ? __might_fault+0xc6/0x180 [ 4672.677532][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4672.677770][ C1] ? __might_fault+0xc6/0x180 [ 4672.678011][ C1] ? lock_release+0x1d5/0x250 [ 4672.678251][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4672.678520][ C1] ? __fget_light+0x54/0x1e0 [ 4672.678759][ C1] ksys_read+0x17a/0x1e0 [ 4672.678975][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4672.679221][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4672.679529][ C1] do_syscall_64+0xc9/0x1e0 [ 4672.679760][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4672.680062][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4672.680290][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4672.681258][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4672.681678][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4672.682076][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4672.682481][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4672.682879][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4672.683277][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4672.683676][ C1] [ 4700.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2186s! [swapper/2:0] [ 4700.569704][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4700.570956][ C2] irq event stamp: 44114564 [ 4700.571185][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4700.571717][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4700.572228][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4700.572709][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4700.573177][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4700.573630][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4700.574242][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4700.574566][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4700.575533][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4700.575839][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4700.576237][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4700.576637][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4700.577033][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4700.577434][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4700.577831][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4700.578280][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4700.578610][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4700.579008][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4700.579408][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4700.579805][ C2] PKRU: 55555554 [ 4700.579986][ C2] Call Trace: [ 4700.580155][ C2] [ 4700.580301][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4700.580562][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4700.580806][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4700.581081][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4700.581353][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4700.581641][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4700.581911][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4700.582216][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4700.582477][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4700.582739][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4700.583046][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4700.583340][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4700.583653][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4700.583943][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4700.584236][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4700.584525][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4700.584839][ C2] ? get_stack_info+0x36/0xc0 [ 4700.585078][ C2] ? lock_acquire+0x1c1/0x220 [ 4700.585318][ C2] ? lock_release+0x1d5/0x250 [ 4700.585558][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4700.585807][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4700.586078][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4700.586362][ C2] ? lock_acquire+0x1c1/0x220 [ 4700.586608][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4700.586848][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4700.587108][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4700.587342][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4700.587592][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4700.587854][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4700.588130][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4700.588404][ C2] ip_local_deliver+0x19d/0x480 [ 4700.588651][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4700.588920][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4700.589188][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4700.589536][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4700.589788][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4700.590106][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4700.590367][ C2] ip_rcv+0x564/0x740 [ 4700.590570][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4700.590797][ C2] ? set_track_prepare+0x8a/0xd0 [ 4700.591048][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4700.591327][ C2] ? start_secondary+0x21c/0x2b0 [ 4700.591577][ C2] ? skb_clone+0x10b/0x330 [ 4700.591812][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4700.592131][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4700.592436][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4700.592715][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4700.593009][ C2] ? __tcf_classify+0x329/0x7d0 [ 4700.593256][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4700.593485][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4700.593783][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4700.594066][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4700.594391][ C2] ? lock_acquire+0x1c1/0x220 [ 4700.594630][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4700.594926][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4700.595210][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4700.595525][ C2] ? __copy_skb_header+0xaf/0x490 [ 4700.595782][ C2] ? __skb_clone+0x57a/0x760 [ 4700.596016][ C2] netif_receive_skb+0x55/0x280 [ 4700.596266][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4700.596582][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4700.596913][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4700.597210][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4700.597485][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4700.597773][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4700.598084][ C2] ? get_stack_info+0x36/0xc0 [ 4700.598323][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4700.598589][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4700.598905][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4700.599182][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4700.599457][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4700.599772][ C2] ? kernel_text_address+0x17/0xe0 [ 4700.600030][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4700.600342][ C2] ? arch_stack_walk+0x8c/0x100 [ 4700.600590][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4700.600857][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4700.601141][ C2] ? lock_acquire+0x1c1/0x220 [ 4700.601379][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4700.601661][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4700.601963][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4700.602242][ C2] ? get_stack_info+0x36/0xc0 [ 4700.602481][ C2] __tcf_classify+0x329/0x7d0 [ 4700.602723][ C2] tcf_classify+0x283/0x930 [ 4700.602956][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4700.603211][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4700.603524][ C2] tc_run+0x2e4/0x5d0 [ 4700.603730][ C2] ? __pfx_tc_run+0x10/0x10 [ 4700.603959][ C2] ? lock_acquire+0x1c1/0x220 [ 4700.604199][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4700.604458][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4700.604715][ C2] ? lock_acquire+0x1c1/0x220 [ 4700.604954][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4700.605218][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4700.605521][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4700.605792][ C2] ? neigh_hh_output+0x348/0x590 [ 4700.606042][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4700.606306][ C2] ip_finish_output2+0x786/0x18e0 [ 4700.606568][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4700.606903][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4700.607182][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4700.607434][ C2] ? __ip_finish_output+0x10f/0x770 [ 4700.607699][ C2] ip_output+0x16b/0x4f0 [ 4700.607915][ C2] ? __pfx_ip_output+0x10/0x10 [ 4700.608159][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4700.608433][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4700.608744][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4700.609019][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4700.609270][ C2] ? __alloc_skb+0xd4/0x280 [ 4700.609501][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4700.609769][ C2] ? tcp_fragment+0x168/0x1040 [ 4700.610016][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4700.610269][ C2] ? ip_local_out+0x114/0x3b0 [ 4700.610509][ C2] __ip_queue_xmit+0x672/0x1910 [ 4700.610757][ C2] ? __skb_clone+0x57a/0x760 [ 4700.610989][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4700.611256][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4700.611540][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4700.611783][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4700.612030][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4700.612331][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4700.612649][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4700.612892][ C2] tcp_send_loss_probe+0x348/0x830 [ 4700.613159][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4700.613425][ C2] tcp_write_timer+0x82/0x1d0 [ 4700.613665][ C2] call_timer_fn+0x173/0x430 [ 4700.613902][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4700.614165][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4700.614425][ C2] __run_timers.part.0+0x52d/0x890 [ 4700.614685][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4700.614954][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4700.615238][ C2] ? lock_acquire+0x1c1/0x220 [ 4700.615477][ C2] ? clockevents_program_event+0xf6/0x300 [ 4700.615767][ C2] ? lock_release+0x1d5/0x250 [ 4700.616004][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4700.616269][ C2] ? ktime_get+0xb3/0x190 [ 4700.616495][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4700.616790][ C2] run_timer_softirq+0x72/0x100 [ 4700.617037][ C2] __do_softirq+0x1b9/0x7ff [ 4700.617268][ C2] irq_exit_rcu+0x98/0xc0 [ 4700.617489][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4700.617776][ C2] [ 4700.617927][ C2] [ 4700.618078][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4700.618383][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4700.618640][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4700.619606][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4700.619912][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4700.620312][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4700.620709][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4700.621105][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4700.621505][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4700.621904][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4700.622193][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4700.622452][ C2] default_idle_call+0x69/0xa0 [ 4700.622696][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4700.622947][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4700.623223][ C2] ? lock_release+0x1d5/0x250 [ 4700.623462][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4700.623734][ C2] do_idle+0xfb/0x160 [ 4700.623939][ C2] cpu_startup_entry+0x55/0x60 [ 4700.624180][ C2] start_secondary+0x21c/0x2b0 [ 4700.624422][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4700.624690][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4700.624999][ C2] [ 4700.625157][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2186s! [perl:4135] [ 4700.625588][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4700.626848][ C1] irq event stamp: 209232 [ 4700.627065][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4700.627598][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4700.628073][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4700.628541][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4700.629005][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4700.629452][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4700.630065][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4700.630390][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4700.631359][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4700.631667][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4700.632064][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4700.632464][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4700.632863][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4700.633262][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4700.633660][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4700.634107][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4700.634440][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4700.634842][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4700.635240][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4700.635636][ C1] PKRU: 55555554 [ 4700.635819][ C1] Call Trace: [ 4700.635992][ C1] [ 4700.636139][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4700.636401][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4700.636656][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4700.636932][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4700.637206][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4700.637494][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4700.637759][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4700.638065][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4700.638327][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4700.638637][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4700.638934][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4700.639249][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4700.639539][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4700.639835][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4700.640123][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4700.640435][ C1] ? get_stack_info+0x36/0xc0 [ 4700.640676][ C1] ? lock_acquire+0x1c1/0x220 [ 4700.640915][ C1] ? lock_release+0x1d5/0x250 [ 4700.641156][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4700.641405][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4700.641677][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4700.641964][ C1] ? lock_acquire+0x1c1/0x220 [ 4700.642202][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4700.642443][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4700.642702][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4700.642938][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4700.643185][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4700.643444][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4700.643720][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4700.643995][ C1] ip_local_deliver+0x19d/0x480 [ 4700.644243][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4700.644516][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4700.644780][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4700.645126][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4700.645379][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4700.645699][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4700.645962][ C1] ip_rcv+0x564/0x740 [ 4700.646165][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4700.646397][ C1] ? set_track_prepare+0x8a/0xd0 [ 4700.646656][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4700.646931][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4700.647203][ C1] ? skb_clone+0x10b/0x330 [ 4700.647431][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4700.647750][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4700.648055][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4700.648337][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4700.648630][ C1] ? __tcf_classify+0x329/0x7d0 [ 4700.648880][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4700.649112][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4700.649412][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4700.649697][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4700.650021][ C1] ? lock_acquire+0x1c1/0x220 [ 4700.650261][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4700.650557][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4700.650843][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4700.651160][ C1] ? __copy_skb_header+0xaf/0x490 [ 4700.651418][ C1] ? __skb_clone+0x57a/0x760 [ 4700.651651][ C1] netif_receive_skb+0x55/0x280 [ 4700.651898][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4700.652211][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4700.652543][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4700.652843][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4700.653116][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4700.653404][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4700.653713][ C1] ? hlock_class+0x4e/0x130 [ 4700.653948][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4700.654223][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4700.654500][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4700.654764][ C1] ? hlock_class+0x4e/0x130 [ 4700.654994][ C1] ? mark_lock+0x38/0x3e0 [ 4700.655215][ C1] ? stack_access_ok+0xda/0x1f0 [ 4700.655464][ C1] ? __lock_acquire+0xb67/0x1610 [ 4700.655718][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4700.655995][ C1] ? get_stack_info+0x36/0xc0 [ 4700.656236][ C1] ? stack_access_ok+0xda/0x1f0 [ 4700.656490][ C1] ? get_reg+0x119/0x190 [ 4700.656707][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4700.656974][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4700.657284][ C1] __tcf_classify+0x329/0x7d0 [ 4700.657526][ C1] tcf_classify+0x283/0x930 [ 4700.657757][ C1] ? arch_stack_walk+0xa2/0x100 [ 4700.658007][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4700.658263][ C1] ? get_stack_info+0x36/0xc0 [ 4700.658505][ C1] tc_run+0x2e4/0x5d0 [ 4700.658709][ C1] ? __pfx_tc_run+0x10/0x10 [ 4700.658941][ C1] ? lock_acquire+0x1c1/0x220 [ 4700.659179][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4700.659441][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4700.659693][ C1] ? lock_acquire+0x1c1/0x220 [ 4700.659931][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4700.660194][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4700.660500][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4700.660772][ C1] ? neigh_hh_output+0x348/0x590 [ 4700.661024][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4700.661290][ C1] ip_finish_output2+0x786/0x18e0 [ 4700.661545][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4700.661826][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4700.662165][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4700.662440][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4700.662692][ C1] ? __ip_finish_output+0x10f/0x770 [ 4700.662956][ C1] ip_output+0x16b/0x4f0 [ 4700.663175][ C1] ? run_timer_softirq+0x72/0x100 [ 4700.663432][ C1] ? __pfx_ip_output+0x10/0x10 [ 4700.663673][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4700.663960][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4700.664212][ C1] ? ip_local_out+0x114/0x3b0 [ 4700.664453][ C1] __ip_queue_xmit+0x672/0x1910 [ 4700.664700][ C1] ? __create_object+0x5e/0xb0 [ 4700.664943][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4700.665209][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4700.665491][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4700.665763][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4700.666044][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4700.666317][ C1] tcp_delack_timer+0x84/0x240 [ 4700.666565][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4700.666837][ C1] call_timer_fn+0x173/0x430 [ 4700.667072][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4700.667334][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4700.667595][ C1] __run_timers.part.0+0x52d/0x890 [ 4700.667857][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4700.668130][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4700.668414][ C1] ? lock_acquire+0x1c1/0x220 [ 4700.668652][ C1] ? clockevents_program_event+0xf6/0x300 [ 4700.668943][ C1] ? lock_release+0x1d5/0x250 [ 4700.669181][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4700.669446][ C1] ? ktime_get+0xb3/0x190 [ 4700.669667][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4700.669963][ C1] run_timer_softirq+0x72/0x100 [ 4700.670210][ C1] __do_softirq+0x1b9/0x7ff [ 4700.670444][ C1] irq_exit_rcu+0x98/0xc0 [ 4700.670664][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4700.670951][ C1] [ 4700.671101][ C1] [ 4700.671253][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4700.671554][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4700.671878][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4700.672848][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4700.673153][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4700.673553][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4700.673952][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4700.674349][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4700.674746][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4700.675149][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4700.675443][ C1] pipe_read+0xa16/0xdf0 [ 4700.675664][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4700.675941][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4700.676186][ C1] ? iterate_tty_write+0x299/0x540 [ 4700.676451][ C1] ? lock_release+0x1d5/0x250 [ 4700.676701][ C1] vfs_read+0x911/0xc00 [ 4700.676914][ C1] ? lock_acquire+0x1c1/0x220 [ 4700.677153][ C1] ? __might_fault+0xc6/0x180 [ 4700.677393][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4700.677631][ C1] ? __might_fault+0xc6/0x180 [ 4700.677871][ C1] ? lock_release+0x1d5/0x250 [ 4700.678111][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4700.678375][ C1] ? __fget_light+0x54/0x1e0 [ 4700.678611][ C1] ksys_read+0x17a/0x1e0 [ 4700.678829][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4700.679073][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4700.679377][ C1] do_syscall_64+0xc9/0x1e0 [ 4700.679609][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4700.679908][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4700.680134][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4700.681101][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4700.681522][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4700.681919][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4700.682318][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4700.682717][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4700.683115][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4700.683514][ C1] [ 4722.658103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4722.658477][ C1] rcu: 1-....: (2361921 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=574763 [ 4722.659033][ C1] rcu: (t=2367771 jiffies g=1882453 q=709 ncpus=4) [ 4722.659367][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4722.659815][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4722.660430][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4722.660727][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4722.661698][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 4722.662006][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4722.662405][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4722.662802][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4722.663207][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4722.663609][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4722.664007][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4722.664455][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4722.664789][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4722.665189][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4722.665588][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4722.665986][ C1] PKRU: 55555554 [ 4722.666168][ C1] Call Trace: [ 4722.666339][ C1] [ 4722.666491][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4722.666771][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4722.667024][ C1] ? check_cpu_stall+0x284/0x500 [ 4722.667277][ C1] ? rcu_pending+0x92/0x360 [ 4722.667509][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4722.667778][ C1] ? update_process_times+0xb9/0x110 [ 4722.668048][ C1] ? tick_sched_handle+0x67/0x130 [ 4722.668304][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4722.668589][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4722.668834][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4722.669148][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4722.669419][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4722.669710][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4722.669975][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4722.670283][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4722.670546][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4722.670856][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4722.671151][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4722.671466][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4722.671756][ C1] ? kasan_check_range+0x12/0x1c0 [ 4722.672013][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 4722.672295][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4722.672608][ C1] ? get_stack_info+0x36/0xc0 [ 4722.672849][ C1] ? lock_acquire+0x1c1/0x220 [ 4722.673089][ C1] ? lock_release+0x1d5/0x250 [ 4722.673331][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4722.673580][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4722.673852][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4722.674138][ C1] ? lock_acquire+0x1c1/0x220 [ 4722.674376][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4722.674619][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4722.674879][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4722.675115][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4722.675365][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4722.675623][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4722.675899][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4722.676175][ C1] ip_local_deliver+0x19d/0x480 [ 4722.676427][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4722.676697][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4722.676963][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4722.677311][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4722.677565][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4722.677885][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4722.678147][ C1] ip_rcv+0x564/0x740 [ 4722.678353][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4722.678585][ C1] ? set_track_prepare+0x8a/0xd0 [ 4722.678838][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4722.679114][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4722.679386][ C1] ? skb_clone+0x10b/0x330 [ 4722.679615][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4722.679933][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4722.680237][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4722.680523][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4722.680817][ C1] ? __tcf_classify+0x329/0x7d0 [ 4722.681067][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4722.681298][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4722.681596][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4722.681883][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4722.682208][ C1] ? lock_acquire+0x1c1/0x220 [ 4722.682448][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4722.682743][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4722.683029][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4722.683346][ C1] ? __copy_skb_header+0xaf/0x490 [ 4722.683604][ C1] ? __skb_clone+0x57a/0x760 [ 4722.683838][ C1] netif_receive_skb+0x55/0x280 [ 4722.684088][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4722.684403][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4722.684734][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4722.685035][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4722.685308][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4722.685597][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4722.685909][ C1] ? hlock_class+0x4e/0x130 [ 4722.686144][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4722.686425][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4722.686703][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4722.686967][ C1] ? hlock_class+0x4e/0x130 [ 4722.687196][ C1] ? mark_lock+0x38/0x3e0 [ 4722.687418][ C1] ? stack_access_ok+0xda/0x1f0 [ 4722.687666][ C1] ? __lock_acquire+0xb67/0x1610 [ 4722.687920][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4722.688197][ C1] ? get_stack_info+0x36/0xc0 [ 4722.688438][ C1] ? stack_access_ok+0xda/0x1f0 [ 4722.688683][ C1] ? get_reg+0x119/0x190 [ 4722.688901][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4722.689170][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4722.689480][ C1] __tcf_classify+0x329/0x7d0 [ 4722.689725][ C1] tcf_classify+0x283/0x930 [ 4722.689956][ C1] ? arch_stack_walk+0xa2/0x100 [ 4722.690205][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4722.690461][ C1] ? get_stack_info+0x36/0xc0 [ 4722.690703][ C1] tc_run+0x2e4/0x5d0 [ 4722.690908][ C1] ? __pfx_tc_run+0x10/0x10 [ 4722.691140][ C1] ? lock_acquire+0x1c1/0x220 [ 4722.691377][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4722.691640][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4722.691892][ C1] ? lock_acquire+0x1c1/0x220 [ 4722.692132][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4722.692396][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4722.692702][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4722.692973][ C1] ? neigh_hh_output+0x348/0x590 [ 4722.693226][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4722.693491][ C1] ip_finish_output2+0x786/0x18e0 [ 4722.693747][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4722.694028][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4722.694366][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4722.694641][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4722.694894][ C1] ? __ip_finish_output+0x10f/0x770 [ 4722.695159][ C1] ip_output+0x16b/0x4f0 [ 4722.695377][ C1] ? run_timer_softirq+0x72/0x100 [ 4722.695634][ C1] ? __pfx_ip_output+0x10/0x10 [ 4722.695876][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4722.696165][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4722.696423][ C1] ? ip_local_out+0x114/0x3b0 [ 4722.696663][ C1] __ip_queue_xmit+0x672/0x1910 [ 4722.696910][ C1] ? __create_object+0x5e/0xb0 [ 4722.697155][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4722.697421][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4722.697705][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4722.697977][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4722.698259][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4722.698533][ C1] tcp_delack_timer+0x84/0x240 [ 4722.698775][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4722.699051][ C1] call_timer_fn+0x173/0x430 [ 4722.699285][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4722.699546][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4722.699808][ C1] __run_timers.part.0+0x52d/0x890 [ 4722.700069][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4722.700344][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4722.700627][ C1] ? lock_acquire+0x1c1/0x220 [ 4722.700867][ C1] ? clockevents_program_event+0xf6/0x300 [ 4722.701157][ C1] ? lock_release+0x1d5/0x250 [ 4722.701395][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4722.701659][ C1] ? ktime_get+0xb3/0x190 [ 4722.701882][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4722.702177][ C1] run_timer_softirq+0x72/0x100 [ 4722.702426][ C1] __do_softirq+0x1b9/0x7ff [ 4722.702659][ C1] irq_exit_rcu+0x98/0xc0 [ 4722.702879][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4722.703166][ C1] [ 4722.703316][ C1] [ 4722.703467][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4722.703770][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4722.704094][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4722.705065][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4722.705373][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4722.705773][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4722.706173][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4722.706576][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4722.706974][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4722.707377][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4722.707674][ C1] pipe_read+0xa16/0xdf0 [ 4722.707895][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4722.708174][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4722.708418][ C1] ? iterate_tty_write+0x299/0x540 [ 4722.708680][ C1] ? lock_release+0x1d5/0x250 [ 4722.708920][ C1] vfs_read+0x911/0xc00 [ 4722.709136][ C1] ? lock_acquire+0x1c1/0x220 [ 4722.709375][ C1] ? __might_fault+0xc6/0x180 [ 4722.709614][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4722.709854][ C1] ? __might_fault+0xc6/0x180 [ 4722.710095][ C1] ? lock_release+0x1d5/0x250 [ 4722.710335][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4722.710601][ C1] ? __fget_light+0x54/0x1e0 [ 4722.710837][ C1] ksys_read+0x17a/0x1e0 [ 4722.711059][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4722.711303][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4722.711606][ C1] do_syscall_64+0xc9/0x1e0 [ 4722.711840][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4722.712140][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4722.712366][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4722.713333][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4722.713757][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4722.714155][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4722.714551][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4722.714952][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4722.715354][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4722.715756][ C1] [ 4722.715914][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4722.716190][ C2] NMI backtrace for cpu 2 [ 4722.716200][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4722.716207][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4722.716212][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4722.716223][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4722.716226][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4722.716230][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4722.716232][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4722.716234][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4722.716236][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4722.716238][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4722.716240][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4722.716242][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4722.716245][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4722.716247][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4722.716248][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4722.716250][ C2] PKRU: 55555554 [ 4722.716251][ C2] Call Trace: [ 4722.716255][ C2] [ 4722.716259][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4722.716267][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4722.716273][ C2] ? nmi_handle+0x153/0x420 [ 4722.716279][ C2] ? default_do_nmi+0x41/0x100 [ 4722.716282][ C2] ? exc_nmi+0xf3/0x120 [ 4722.716285][ C2] ? end_repeat_nmi+0xf/0x60 [ 4722.716292][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4722.716295][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4722.716298][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4722.716301][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4722.716304][ C2] [ 4722.716305][ C2] [ 4722.716307][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4722.716309][ C2] ? get_stack_info+0x36/0xc0 [ 4722.716314][ C2] ? lock_acquire+0x1c1/0x220 [ 4722.716319][ C2] ? lock_release+0x1d5/0x250 [ 4722.716323][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4722.716327][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4722.716330][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4722.716334][ C2] ? lock_acquire+0x1c1/0x220 [ 4722.716336][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4722.716341][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4722.716344][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4722.716351][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4722.716358][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4722.716364][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4722.716371][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4722.716375][ C2] ip_local_deliver+0x19d/0x480 [ 4722.716378][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4722.716380][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4722.716383][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4722.716390][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4722.716395][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4722.716398][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4722.716409][ C2] ip_rcv+0x564/0x740 [ 4722.716412][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4722.716414][ C2] ? set_track_prepare+0x8a/0xd0 [ 4722.716420][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4722.716423][ C2] ? start_secondary+0x21c/0x2b0 [ 4722.716428][ C2] ? skb_clone+0x10b/0x330 [ 4722.716433][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4722.716439][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4722.716445][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4722.716450][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4722.716458][ C2] ? __tcf_classify+0x329/0x7d0 [ 4722.716462][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4722.716465][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4722.716468][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4722.716472][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4722.716476][ C2] ? lock_acquire+0x1c1/0x220 [ 4722.716479][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4722.716483][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4722.716487][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4722.716491][ C2] ? __copy_skb_header+0xaf/0x490 [ 4722.716497][ C2] ? __skb_clone+0x57a/0x760 [ 4722.716499][ C2] netif_receive_skb+0x55/0x280 [ 4722.716503][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4722.716511][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4722.716518][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4722.716525][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4722.716529][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4722.716540][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4722.716547][ C2] ? get_stack_info+0x36/0xc0 [ 4722.716552][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4722.716556][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4722.716561][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4722.716564][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4722.716568][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4722.716570][ C2] ? kernel_text_address+0x17/0xe0 [ 4722.716575][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4722.716580][ C2] ? arch_stack_walk+0x8c/0x100 [ 4722.716585][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4722.716588][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4722.716592][ C2] ? lock_acquire+0x1c1/0x220 [ 4722.716594][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4722.716600][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4722.716606][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4722.716608][ C2] ? get_stack_info+0x36/0xc0 [ 4722.716613][ C2] __tcf_classify+0x329/0x7d0 [ 4722.716618][ C2] tcf_classify+0x283/0x930 [ 4722.716623][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4722.716626][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4722.716631][ C2] tc_run+0x2e4/0x5d0 [ 4722.716636][ C2] ? __pfx_tc_run+0x10/0x10 [ 4722.716639][ C2] ? lock_acquire+0x1c1/0x220 [ 4722.716641][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4722.716645][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4722.716650][ C2] ? lock_acquire+0x1c1/0x220 [ 4722.716652][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4722.716656][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4722.716659][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4722.716662][ C2] ? neigh_hh_output+0x348/0x590 [ 4722.716665][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4722.716669][ C2] ip_finish_output2+0x786/0x18e0 [ 4722.716672][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4722.716680][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4722.716682][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4722.716686][ C2] ? __ip_finish_output+0x10f/0x770 [ 4722.716690][ C2] ip_output+0x16b/0x4f0 [ 4722.716693][ C2] ? __pfx_ip_output+0x10/0x10 [ 4722.716696][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4722.716699][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4722.716702][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4722.716706][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4722.716709][ C2] ? __alloc_skb+0xd4/0x280 [ 4722.716711][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4722.716716][ C2] ? tcp_fragment+0x168/0x1040 [ 4722.716720][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4722.716723][ C2] ? ip_local_out+0x114/0x3b0 [ 4722.716727][ C2] __ip_queue_xmit+0x672/0x1910 [ 4722.716731][ C2] ? __skb_clone+0x57a/0x760 [ 4722.716734][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4722.716740][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4722.716743][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4722.716747][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4722.716752][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4722.716756][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4722.716759][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4722.716763][ C2] tcp_send_loss_probe+0x348/0x830 [ 4722.716766][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4722.716769][ C2] tcp_write_timer+0x82/0x1d0 [ 4722.716772][ C2] call_timer_fn+0x173/0x430 [ 4722.716777][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4722.716782][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4722.716786][ C2] __run_timers.part.0+0x52d/0x890 [ 4722.716789][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4722.716793][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4722.716796][ C2] ? lock_acquire+0x1c1/0x220 [ 4722.716798][ C2] ? clockevents_program_event+0xf6/0x300 [ 4722.716804][ C2] ? lock_release+0x1d5/0x250 [ 4722.716806][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4722.716811][ C2] ? ktime_get+0xb3/0x190 [ 4722.716815][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4722.716819][ C2] run_timer_softirq+0x72/0x100 [ 4722.716822][ C2] __do_softirq+0x1b9/0x7ff [ 4722.716827][ C2] irq_exit_rcu+0x98/0xc0 [ 4722.716830][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4722.716835][ C2] [ 4722.716836][ C2] [ 4722.716837][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4722.716841][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4722.716845][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4722.716847][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4722.716850][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4722.716852][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4722.716854][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4722.716855][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4722.716857][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4722.716860][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4722.716864][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4722.716868][ C2] default_idle_call+0x69/0xa0 [ 4722.716872][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4722.716875][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4722.716879][ C2] ? lock_release+0x1d5/0x250 [ 4722.716882][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4722.716886][ C2] do_idle+0xfb/0x160 [ 4722.716888][ C2] cpu_startup_entry+0x55/0x60 [ 4722.716891][ C2] start_secondary+0x21c/0x2b0 [ 4722.716894][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4722.716899][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4722.716905][ C2] [ 4748.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2231s! [swapper/2:0] [ 4748.569714][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4748.570974][ C2] irq event stamp: 44114564 [ 4748.571201][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4748.571740][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4748.572252][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4748.572728][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4748.573197][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4748.573653][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4748.574267][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 4748.574555][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 4748.575527][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [ 4748.575833][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4748.576234][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4748.576639][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4748.577036][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4748.577435][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4748.577837][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4748.578283][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4748.578616][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4748.579014][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4748.579412][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4748.579811][ C2] PKRU: 55555554 [ 4748.579992][ C2] Call Trace: [ 4748.580163][ C2] [ 4748.580314][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4748.580578][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4748.580820][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4748.581098][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4748.581370][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4748.581659][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4748.581925][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4748.582230][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4748.582492][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4748.582760][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4748.583066][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4748.583363][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4748.583684][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4748.583972][ C2] ? kasan_check_range+0x12/0x1c0 [ 4748.584229][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4748.584513][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4748.584830][ C2] ? get_stack_info+0x36/0xc0 [ 4748.585070][ C2] ? lock_acquire+0x1c1/0x220 [ 4748.585314][ C2] ? lock_release+0x1d5/0x250 [ 4748.585554][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4748.585803][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4748.586074][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4748.586365][ C2] ? lock_acquire+0x1c1/0x220 [ 4748.586606][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4748.586852][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4748.587113][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4748.587348][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4748.587594][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4748.587850][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4748.588128][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4748.588404][ C2] ip_local_deliver+0x19d/0x480 [ 4748.588653][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4748.588924][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4748.589187][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4748.589537][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4748.589790][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4748.590111][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4748.590374][ C2] ip_rcv+0x564/0x740 [ 4748.590578][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4748.590806][ C2] ? set_track_prepare+0x8a/0xd0 [ 4748.591065][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4748.591345][ C2] ? start_secondary+0x21c/0x2b0 [ 4748.591596][ C2] ? skb_clone+0x10b/0x330 [ 4748.591823][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4748.592142][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4748.592447][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4748.592729][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4748.593024][ C2] ? __tcf_classify+0x329/0x7d0 [ 4748.593273][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4748.593503][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4748.593802][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4748.594084][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4748.594410][ C2] ? lock_acquire+0x1c1/0x220 [ 4748.594650][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4748.594947][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4748.595232][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4748.595549][ C2] ? __copy_skb_header+0xaf/0x490 [ 4748.595806][ C2] ? __skb_clone+0x57a/0x760 [ 4748.596041][ C2] netif_receive_skb+0x55/0x280 [ 4748.596295][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4748.596607][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4748.596940][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4748.597238][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4748.597512][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4748.597801][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4748.598113][ C2] ? get_stack_info+0x36/0xc0 [ 4748.598354][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4748.598619][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4748.598934][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4748.599210][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4748.599486][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4748.599801][ C2] ? kernel_text_address+0x17/0xe0 [ 4748.600060][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4748.600374][ C2] ? arch_stack_walk+0x8c/0x100 [ 4748.600623][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4748.600886][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4748.601171][ C2] ? lock_acquire+0x1c1/0x220 [ 4748.601409][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4748.601692][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4748.601996][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4748.602274][ C2] ? get_stack_info+0x36/0xc0 [ 4748.602513][ C2] __tcf_classify+0x329/0x7d0 [ 4748.602756][ C2] tcf_classify+0x283/0x930 [ 4748.602989][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4748.603246][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4748.603564][ C2] tc_run+0x2e4/0x5d0 [ 4748.603769][ C2] ? __pfx_tc_run+0x10/0x10 [ 4748.603999][ C2] ? lock_acquire+0x1c1/0x220 [ 4748.604238][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4748.604498][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4748.604751][ C2] ? lock_acquire+0x1c1/0x220 [ 4748.604991][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4748.605255][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4748.605559][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4748.605830][ C2] ? neigh_hh_output+0x348/0x590 [ 4748.606082][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4748.606352][ C2] ip_finish_output2+0x786/0x18e0 [ 4748.606608][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4748.606944][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4748.607221][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4748.607473][ C2] ? __ip_finish_output+0x10f/0x770 [ 4748.607738][ C2] ip_output+0x16b/0x4f0 [ 4748.607954][ C2] ? __pfx_ip_output+0x10/0x10 [ 4748.608198][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4748.608474][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4748.608785][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4748.609060][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4748.609313][ C2] ? __alloc_skb+0xd4/0x280 [ 4748.609543][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4748.609811][ C2] ? tcp_fragment+0x168/0x1040 [ 4748.610055][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4748.610308][ C2] ? ip_local_out+0x114/0x3b0 [ 4748.610548][ C2] __ip_queue_xmit+0x672/0x1910 [ 4748.610795][ C2] ? __skb_clone+0x57a/0x760 [ 4748.611029][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4748.611296][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4748.611578][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4748.611821][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4748.612070][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4748.612380][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4748.612698][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4748.612941][ C2] tcp_send_loss_probe+0x348/0x830 [ 4748.613201][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4748.613467][ C2] tcp_write_timer+0x82/0x1d0 [ 4748.613707][ C2] call_timer_fn+0x173/0x430 [ 4748.613945][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4748.614208][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4748.614471][ C2] __run_timers.part.0+0x52d/0x890 [ 4748.614730][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4748.614998][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4748.615282][ C2] ? lock_acquire+0x1c1/0x220 [ 4748.615521][ C2] ? clockevents_program_event+0xf6/0x300 [ 4748.615813][ C2] ? lock_release+0x1d5/0x250 [ 4748.616050][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4748.616320][ C2] ? ktime_get+0xb3/0x190 [ 4748.616540][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4748.616837][ C2] run_timer_softirq+0x72/0x100 [ 4748.617083][ C2] __do_softirq+0x1b9/0x7ff [ 4748.617318][ C2] irq_exit_rcu+0x98/0xc0 [ 4748.617538][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4748.617822][ C2] [ 4748.617971][ C2] [ 4748.618124][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4748.618427][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4748.618684][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4748.619654][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4748.619959][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4748.620361][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4748.620758][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4748.621155][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4748.621552][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4748.621954][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4748.622242][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4748.622504][ C2] default_idle_call+0x69/0xa0 [ 4748.622749][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4748.623000][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4748.623278][ C2] ? lock_release+0x1d5/0x250 [ 4748.623517][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4748.623789][ C2] do_idle+0xfb/0x160 [ 4748.623994][ C2] cpu_startup_entry+0x55/0x60 [ 4748.624237][ C2] start_secondary+0x21c/0x2b0 [ 4748.624481][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4748.624749][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4748.625061][ C2] [ 4748.625220][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2231s! [perl:4135] [ 4748.625656][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4748.626919][ C1] irq event stamp: 209232 [ 4748.627138][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4748.627668][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4748.628147][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4748.628616][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4748.629078][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4748.629525][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4748.630138][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4748.630465][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4748.631441][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4748.631749][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4748.632148][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4748.632548][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4748.632945][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4748.633346][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4748.633746][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4748.634194][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4748.634526][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4748.634926][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4748.635329][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4748.635726][ C1] PKRU: 55555554 [ 4748.635909][ C1] Call Trace: [ 4748.636080][ C1] [ 4748.636230][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4748.636499][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4748.636744][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4748.637020][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4748.637292][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4748.637583][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4748.637849][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4748.638156][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4748.638418][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4748.638727][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4748.639022][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4748.639338][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4748.639627][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4748.639923][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4748.640213][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4748.640525][ C1] ? get_stack_info+0x36/0xc0 [ 4748.640765][ C1] ? lock_acquire+0x1c1/0x220 [ 4748.641006][ C1] ? lock_release+0x1d5/0x250 [ 4748.641248][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4748.641497][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4748.641770][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4748.642054][ C1] ? lock_acquire+0x1c1/0x220 [ 4748.642294][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4748.642536][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4748.642797][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4748.643032][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4748.643278][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4748.643537][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4748.643815][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4748.644092][ C1] ip_local_deliver+0x19d/0x480 [ 4748.644340][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4748.644612][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4748.644875][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4748.645224][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4748.645476][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4748.645797][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4748.646060][ C1] ip_rcv+0x564/0x740 [ 4748.646269][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4748.646499][ C1] ? set_track_prepare+0x8a/0xd0 [ 4748.646753][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4748.647031][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4748.647304][ C1] ? skb_clone+0x10b/0x330 [ 4748.647530][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4748.647850][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4748.648158][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4748.648440][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4748.648735][ C1] ? __tcf_classify+0x329/0x7d0 [ 4748.648984][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4748.649214][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4748.649514][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4748.649800][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4748.650125][ C1] ? lock_acquire+0x1c1/0x220 [ 4748.650361][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4748.650663][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4748.650949][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4748.651267][ C1] ? __copy_skb_header+0xaf/0x490 [ 4748.651526][ C1] ? __skb_clone+0x57a/0x760 [ 4748.651762][ C1] netif_receive_skb+0x55/0x280 [ 4748.652010][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4748.652324][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4748.652657][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4748.652956][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4748.653231][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4748.653518][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4748.653830][ C1] ? hlock_class+0x4e/0x130 [ 4748.654063][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4748.654339][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4748.654614][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4748.654876][ C1] ? hlock_class+0x4e/0x130 [ 4748.655109][ C1] ? mark_lock+0x38/0x3e0 [ 4748.655327][ C1] ? stack_access_ok+0xda/0x1f0 [ 4748.655577][ C1] ? __lock_acquire+0xb67/0x1610 [ 4748.655830][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4748.656106][ C1] ? get_stack_info+0x36/0xc0 [ 4748.656354][ C1] ? stack_access_ok+0xda/0x1f0 [ 4748.656602][ C1] ? get_reg+0x119/0x190 [ 4748.656818][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4748.657087][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4748.657396][ C1] __tcf_classify+0x329/0x7d0 [ 4748.657636][ C1] tcf_classify+0x283/0x930 [ 4748.657869][ C1] ? arch_stack_walk+0xa2/0x100 [ 4748.658118][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4748.658375][ C1] ? get_stack_info+0x36/0xc0 [ 4748.658615][ C1] tc_run+0x2e4/0x5d0 [ 4748.658821][ C1] ? __pfx_tc_run+0x10/0x10 [ 4748.659051][ C1] ? lock_acquire+0x1c1/0x220 [ 4748.659290][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4748.659552][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4748.659805][ C1] ? lock_acquire+0x1c1/0x220 [ 4748.660044][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4748.660308][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4748.660615][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4748.660886][ C1] ? neigh_hh_output+0x348/0x590 [ 4748.661139][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4748.661404][ C1] ip_finish_output2+0x786/0x18e0 [ 4748.661660][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4748.661937][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4748.662275][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4748.662552][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4748.662805][ C1] ? __ip_finish_output+0x10f/0x770 [ 4748.663069][ C1] ip_output+0x16b/0x4f0 [ 4748.663284][ C1] ? run_timer_softirq+0x72/0x100 [ 4748.663541][ C1] ? __pfx_ip_output+0x10/0x10 [ 4748.663786][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4748.664072][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4748.664324][ C1] ? ip_local_out+0x114/0x3b0 [ 4748.664563][ C1] __ip_queue_xmit+0x672/0x1910 [ 4748.664810][ C1] ? __create_object+0x5e/0xb0 [ 4748.665056][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4748.665323][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4748.665603][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4748.665879][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4748.666162][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4748.666439][ C1] tcp_delack_timer+0x84/0x240 [ 4748.666684][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4748.666954][ C1] call_timer_fn+0x173/0x430 [ 4748.667192][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4748.667454][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4748.667714][ C1] __run_timers.part.0+0x52d/0x890 [ 4748.667974][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4748.668248][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4748.668534][ C1] ? lock_acquire+0x1c1/0x220 [ 4748.668773][ C1] ? clockevents_program_event+0xf6/0x300 [ 4748.669063][ C1] ? lock_release+0x1d5/0x250 [ 4748.669303][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4748.669566][ C1] ? ktime_get+0xb3/0x190 [ 4748.669787][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4748.670084][ C1] run_timer_softirq+0x72/0x100 [ 4748.670333][ C1] __do_softirq+0x1b9/0x7ff [ 4748.670565][ C1] irq_exit_rcu+0x98/0xc0 [ 4748.670786][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4748.671071][ C1] [ 4748.671223][ C1] [ 4748.671373][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4748.671678][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4748.672003][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4748.672975][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4748.673283][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4748.673681][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4748.674080][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4748.674480][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4748.674878][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4748.675283][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4748.675580][ C1] pipe_read+0xa16/0xdf0 [ 4748.675800][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4748.676078][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4748.676326][ C1] ? iterate_tty_write+0x299/0x540 [ 4748.676589][ C1] ? lock_release+0x1d5/0x250 [ 4748.676832][ C1] vfs_read+0x911/0xc00 [ 4748.677046][ C1] ? lock_acquire+0x1c1/0x220 [ 4748.677285][ C1] ? __might_fault+0xc6/0x180 [ 4748.677526][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4748.677766][ C1] ? __might_fault+0xc6/0x180 [ 4748.678004][ C1] ? lock_release+0x1d5/0x250 [ 4748.678244][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4748.678509][ C1] ? __fget_light+0x54/0x1e0 [ 4748.678746][ C1] ksys_read+0x17a/0x1e0 [ 4748.678962][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4748.679208][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4748.679514][ C1] do_syscall_64+0xc9/0x1e0 [ 4748.679747][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4748.680045][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4748.680275][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4748.681247][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4748.681669][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4748.682068][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4748.682466][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4748.682864][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4748.683263][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4748.683665][ C1] [ 4776.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2257s! [swapper/2:0] [ 4776.569729][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4776.570989][ C2] irq event stamp: 44114564 [ 4776.571218][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4776.571757][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4776.572268][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4776.572745][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4776.573216][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4776.573671][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4776.574286][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4776.574610][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4776.575581][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4776.575890][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4776.576293][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4776.576690][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4776.577091][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4776.577489][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4776.577887][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4776.578334][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4776.578665][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4776.579068][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4776.579468][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4776.579866][ C2] PKRU: 55555554 [ 4776.580048][ C2] Call Trace: [ 4776.580221][ C2] [ 4776.580371][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4776.580634][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4776.580878][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4776.581156][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4776.581429][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4776.581718][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4776.581982][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4776.582290][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4776.582550][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4776.582813][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4776.583125][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4776.583421][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4776.583736][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4776.584026][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4776.584321][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4776.584610][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4776.584921][ C2] ? get_stack_info+0x36/0xc0 [ 4776.585165][ C2] ? lock_acquire+0x1c1/0x220 [ 4776.585404][ C2] ? lock_release+0x1d5/0x250 [ 4776.585645][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4776.585893][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4776.586170][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4776.586456][ C2] ? lock_acquire+0x1c1/0x220 [ 4776.586692][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4776.586934][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4776.587195][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4776.587430][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4776.587677][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4776.587939][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4776.588216][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4776.588493][ C2] ip_local_deliver+0x19d/0x480 [ 4776.588740][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4776.589010][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4776.589276][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4776.589626][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4776.589879][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4776.590200][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4776.590463][ C2] ip_rcv+0x564/0x740 [ 4776.590666][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4776.590897][ C2] ? set_track_prepare+0x8a/0xd0 [ 4776.591152][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4776.591428][ C2] ? start_secondary+0x21c/0x2b0 [ 4776.591680][ C2] ? skb_clone+0x10b/0x330 [ 4776.591906][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4776.592226][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4776.592532][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4776.592813][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4776.593108][ C2] ? __tcf_classify+0x329/0x7d0 [ 4776.593359][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4776.593588][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4776.593887][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4776.594174][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4776.594499][ C2] ? lock_acquire+0x1c1/0x220 [ 4776.594735][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4776.595034][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4776.595321][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4776.595636][ C2] ? __copy_skb_header+0xaf/0x490 [ 4776.595895][ C2] ? __skb_clone+0x57a/0x760 [ 4776.596135][ C2] netif_receive_skb+0x55/0x280 [ 4776.596384][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4776.596698][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4776.597029][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4776.597329][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4776.597604][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4776.597892][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4776.598206][ C2] ? get_stack_info+0x36/0xc0 [ 4776.598448][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4776.598712][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4776.599030][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4776.599306][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4776.599582][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4776.599898][ C2] ? kernel_text_address+0x17/0xe0 [ 4776.600158][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4776.600471][ C2] ? arch_stack_walk+0x8c/0x100 [ 4776.600720][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4776.600984][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4776.601272][ C2] ? lock_acquire+0x1c1/0x220 [ 4776.601509][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4776.601792][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4776.602097][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4776.602373][ C2] ? get_stack_info+0x36/0xc0 [ 4776.602614][ C2] __tcf_classify+0x329/0x7d0 [ 4776.602853][ C2] tcf_classify+0x283/0x930 [ 4776.603087][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4776.603344][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4776.603657][ C2] tc_run+0x2e4/0x5d0 [ 4776.603863][ C2] ? __pfx_tc_run+0x10/0x10 [ 4776.604094][ C2] ? lock_acquire+0x1c1/0x220 [ 4776.604332][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4776.604593][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4776.604846][ C2] ? lock_acquire+0x1c1/0x220 [ 4776.605083][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4776.605348][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4776.605653][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4776.605924][ C2] ? neigh_hh_output+0x348/0x590 [ 4776.606183][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4776.606446][ C2] ip_finish_output2+0x786/0x18e0 [ 4776.606703][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4776.607042][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4776.607319][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4776.607572][ C2] ? __ip_finish_output+0x10f/0x770 [ 4776.607838][ C2] ip_output+0x16b/0x4f0 [ 4776.608054][ C2] ? __pfx_ip_output+0x10/0x10 [ 4776.608297][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4776.608574][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4776.608884][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4776.609164][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4776.609415][ C2] ? __alloc_skb+0xd4/0x280 [ 4776.609644][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4776.609913][ C2] ? tcp_fragment+0x168/0x1040 [ 4776.610159][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4776.610409][ C2] ? ip_local_out+0x114/0x3b0 [ 4776.610650][ C2] __ip_queue_xmit+0x672/0x1910 [ 4776.610899][ C2] ? __skb_clone+0x57a/0x760 [ 4776.611133][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4776.611401][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4776.611681][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4776.611927][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4776.612178][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4776.612478][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4776.612797][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4776.613041][ C2] tcp_send_loss_probe+0x348/0x830 [ 4776.613302][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4776.613570][ C2] tcp_write_timer+0x82/0x1d0 [ 4776.613811][ C2] call_timer_fn+0x173/0x430 [ 4776.614050][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4776.614312][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4776.614574][ C2] __run_timers.part.0+0x52d/0x890 [ 4776.614834][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4776.615102][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4776.615388][ C2] ? lock_acquire+0x1c1/0x220 [ 4776.615625][ C2] ? clockevents_program_event+0xf6/0x300 [ 4776.615918][ C2] ? lock_release+0x1d5/0x250 [ 4776.616163][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4776.616426][ C2] ? ktime_get+0xb3/0x190 [ 4776.616645][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4776.616943][ C2] run_timer_softirq+0x72/0x100 [ 4776.617192][ C2] __do_softirq+0x1b9/0x7ff [ 4776.617422][ C2] irq_exit_rcu+0x98/0xc0 [ 4776.617644][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4776.617929][ C2] [ 4776.618080][ C2] [ 4776.618231][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4776.618537][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4776.618795][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4776.619768][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4776.620077][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4776.620476][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4776.620873][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4776.621270][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4776.621670][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4776.622070][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4776.622360][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4776.622621][ C2] default_idle_call+0x69/0xa0 [ 4776.622864][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4776.623116][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4776.623393][ C2] ? lock_release+0x1d5/0x250 [ 4776.623632][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4776.623907][ C2] do_idle+0xfb/0x160 [ 4776.624112][ C2] cpu_startup_entry+0x55/0x60 [ 4776.624354][ C2] start_secondary+0x21c/0x2b0 [ 4776.624596][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4776.624866][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4776.625177][ C2] [ 4776.625336][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2257s! [perl:4135] [ 4776.625772][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4776.627032][ C1] irq event stamp: 209232 [ 4776.627252][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4776.627781][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4776.628258][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4776.628728][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4776.629191][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4776.629640][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4776.630251][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 4776.630572][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 4776.631541][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4776.631849][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4776.632248][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4776.632648][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4776.633048][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4776.633445][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4776.633844][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4776.634291][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4776.634624][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4776.635025][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4776.635423][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4776.635823][ C1] PKRU: 55555554 [ 4776.636004][ C1] Call Trace: [ 4776.636182][ C1] [ 4776.636330][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4776.636593][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4776.636836][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4776.637115][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4776.637388][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4776.637674][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4776.637941][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4776.638248][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4776.638509][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4776.638819][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4776.639116][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4776.639431][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4776.639720][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 4776.640011][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4776.640299][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4776.640611][ C1] ? get_stack_info+0x36/0xc0 [ 4776.640853][ C1] ? lock_acquire+0x1c1/0x220 [ 4776.641092][ C1] ? lock_release+0x1d5/0x250 [ 4776.641332][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4776.641581][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4776.641853][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4776.642141][ C1] ? lock_acquire+0x1c1/0x220 [ 4776.642379][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4776.642618][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4776.642879][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4776.643115][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4776.643363][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4776.643621][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4776.643897][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4776.644172][ C1] ip_local_deliver+0x19d/0x480 [ 4776.644419][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4776.644691][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4776.644956][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4776.645302][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4776.645555][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4776.645876][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4776.646143][ C1] ip_rcv+0x564/0x740 [ 4776.646350][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4776.646582][ C1] ? set_track_prepare+0x8a/0xd0 [ 4776.646836][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4776.647112][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4776.647383][ C1] ? skb_clone+0x10b/0x330 [ 4776.647612][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4776.647932][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4776.648241][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4776.648524][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4776.648817][ C1] ? __tcf_classify+0x329/0x7d0 [ 4776.649067][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4776.649298][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4776.649598][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4776.649882][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4776.650207][ C1] ? lock_acquire+0x1c1/0x220 [ 4776.650447][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4776.650743][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4776.651028][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4776.651345][ C1] ? __copy_skb_header+0xaf/0x490 [ 4776.651602][ C1] ? __skb_clone+0x57a/0x760 [ 4776.651841][ C1] netif_receive_skb+0x55/0x280 [ 4776.652087][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4776.652400][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4776.652732][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4776.653032][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4776.653305][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4776.653594][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4776.653905][ C1] ? hlock_class+0x4e/0x130 [ 4776.654140][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4776.654414][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4776.654692][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4776.654956][ C1] ? hlock_class+0x4e/0x130 [ 4776.655184][ C1] ? mark_lock+0x38/0x3e0 [ 4776.655406][ C1] ? stack_access_ok+0xda/0x1f0 [ 4776.655655][ C1] ? __lock_acquire+0xb67/0x1610 [ 4776.655908][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4776.656188][ C1] ? get_stack_info+0x36/0xc0 [ 4776.656428][ C1] ? stack_access_ok+0xda/0x1f0 [ 4776.656675][ C1] ? get_reg+0x119/0x190 [ 4776.656890][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4776.657158][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4776.657467][ C1] __tcf_classify+0x329/0x7d0 [ 4776.657709][ C1] tcf_classify+0x283/0x930 [ 4776.657939][ C1] ? arch_stack_walk+0xa2/0x100 [ 4776.658189][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4776.658445][ C1] ? get_stack_info+0x36/0xc0 [ 4776.658686][ C1] tc_run+0x2e4/0x5d0 [ 4776.658891][ C1] ? __pfx_tc_run+0x10/0x10 [ 4776.659123][ C1] ? lock_acquire+0x1c1/0x220 [ 4776.659361][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4776.659623][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4776.659875][ C1] ? lock_acquire+0x1c1/0x220 [ 4776.660114][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4776.660377][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4776.660683][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4776.660954][ C1] ? neigh_hh_output+0x348/0x590 [ 4776.661207][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4776.661473][ C1] ip_finish_output2+0x786/0x18e0 [ 4776.661729][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4776.662009][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4776.662346][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4776.662621][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4776.662875][ C1] ? __ip_finish_output+0x10f/0x770 [ 4776.663139][ C1] ip_output+0x16b/0x4f0 [ 4776.663358][ C1] ? run_timer_softirq+0x72/0x100 [ 4776.663615][ C1] ? __pfx_ip_output+0x10/0x10 [ 4776.663858][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4776.664145][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4776.664397][ C1] ? ip_local_out+0x114/0x3b0 [ 4776.664638][ C1] __ip_queue_xmit+0x672/0x1910 [ 4776.664887][ C1] ? __create_object+0x5e/0xb0 [ 4776.665130][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4776.665397][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4776.665680][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4776.665952][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4776.666239][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4776.666512][ C1] tcp_delack_timer+0x84/0x240 [ 4776.666755][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4776.667027][ C1] call_timer_fn+0x173/0x430 [ 4776.667263][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4776.667527][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4776.667789][ C1] __run_timers.part.0+0x52d/0x890 [ 4776.668049][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4776.668323][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4776.668606][ C1] ? lock_acquire+0x1c1/0x220 [ 4776.668845][ C1] ? clockevents_program_event+0xf6/0x300 [ 4776.669137][ C1] ? lock_release+0x1d5/0x250 [ 4776.669374][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4776.669640][ C1] ? ktime_get+0xb3/0x190 [ 4776.669862][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4776.670159][ C1] run_timer_softirq+0x72/0x100 [ 4776.670406][ C1] __do_softirq+0x1b9/0x7ff [ 4776.670639][ C1] irq_exit_rcu+0x98/0xc0 [ 4776.670859][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4776.671145][ C1] [ 4776.671295][ C1] [ 4776.671447][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4776.671749][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4776.672073][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4776.673044][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4776.673351][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4776.673752][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4776.674151][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4776.674548][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4776.674944][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4776.675348][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4776.675642][ C1] pipe_read+0xa16/0xdf0 [ 4776.675865][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4776.676145][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4776.676389][ C1] ? iterate_tty_write+0x299/0x540 [ 4776.676650][ C1] ? lock_release+0x1d5/0x250 [ 4776.676891][ C1] vfs_read+0x911/0xc00 [ 4776.677104][ C1] ? lock_acquire+0x1c1/0x220 [ 4776.677344][ C1] ? __might_fault+0xc6/0x180 [ 4776.677583][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4776.677823][ C1] ? __might_fault+0xc6/0x180 [ 4776.678063][ C1] ? lock_release+0x1d5/0x250 [ 4776.678303][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4776.678567][ C1] ? __fget_light+0x54/0x1e0 [ 4776.678803][ C1] ksys_read+0x17a/0x1e0 [ 4776.679021][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4776.679266][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4776.679568][ C1] do_syscall_64+0xc9/0x1e0 [ 4776.679802][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4776.680102][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4776.680328][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4776.681297][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4776.681720][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4776.682117][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4776.682515][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4776.682914][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4776.683312][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4776.683712][ C1] [ 4800.716103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4800.716477][ C1] rcu: 1-....: (2439695 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=594183 [ 4800.717034][ C1] rcu: (t=2445829 jiffies g=1882453 q=712 ncpus=4) [ 4800.717367][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4800.717814][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4800.718427][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4800.718754][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4800.719721][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4800.720030][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4800.720428][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4800.720826][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4800.721224][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4800.721625][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4800.722023][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4800.722470][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4800.722802][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4800.723201][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4800.723602][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4800.724001][ C1] PKRU: 55555554 [ 4800.724183][ C1] Call Trace: [ 4800.724352][ C1] [ 4800.724502][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4800.724773][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4800.725026][ C1] ? check_cpu_stall+0x284/0x500 [ 4800.725279][ C1] ? rcu_pending+0x92/0x360 [ 4800.725510][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4800.725780][ C1] ? update_process_times+0xb9/0x110 [ 4800.726054][ C1] ? tick_sched_handle+0x67/0x130 [ 4800.726311][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4800.726595][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4800.726838][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4800.727151][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4800.727422][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4800.727712][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4800.727975][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4800.728283][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4800.728546][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4800.728855][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4800.729153][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4800.729470][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4800.729759][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4800.730054][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4800.730343][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4800.730654][ C1] ? get_stack_info+0x36/0xc0 [ 4800.730894][ C1] ? lock_acquire+0x1c1/0x220 [ 4800.731135][ C1] ? lock_release+0x1d5/0x250 [ 4800.731375][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4800.731624][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4800.731896][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4800.732180][ C1] ? lock_acquire+0x1c1/0x220 [ 4800.732419][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4800.732662][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4800.732922][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4800.733157][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4800.733402][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4800.733660][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4800.733939][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4800.734216][ C1] ip_local_deliver+0x19d/0x480 [ 4800.734464][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4800.734734][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4800.734996][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4800.735344][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4800.735596][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4800.735916][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4800.736183][ C1] ip_rcv+0x564/0x740 [ 4800.736388][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4800.736616][ C1] ? set_track_prepare+0x8a/0xd0 [ 4800.736869][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4800.737146][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4800.737420][ C1] ? skb_clone+0x10b/0x330 [ 4800.737645][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4800.737970][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4800.738276][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4800.738561][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4800.738857][ C1] ? __tcf_classify+0x329/0x7d0 [ 4800.739107][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4800.739336][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4800.739634][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4800.739919][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4800.740244][ C1] ? lock_acquire+0x1c1/0x220 [ 4800.740481][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4800.740781][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4800.741066][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4800.741381][ C1] ? __copy_skb_header+0xaf/0x490 [ 4800.741639][ C1] ? __skb_clone+0x57a/0x760 [ 4800.741876][ C1] netif_receive_skb+0x55/0x280 [ 4800.742123][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4800.742437][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4800.742769][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4800.743067][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4800.743342][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4800.743629][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4800.743942][ C1] ? hlock_class+0x4e/0x130 [ 4800.744175][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4800.744451][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4800.744726][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4800.744988][ C1] ? hlock_class+0x4e/0x130 [ 4800.745220][ C1] ? mark_lock+0x38/0x3e0 [ 4800.745438][ C1] ? stack_access_ok+0xda/0x1f0 [ 4800.745686][ C1] ? __lock_acquire+0xb67/0x1610 [ 4800.745939][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4800.746220][ C1] ? get_stack_info+0x36/0xc0 [ 4800.746460][ C1] ? stack_access_ok+0xda/0x1f0 [ 4800.746706][ C1] ? get_reg+0x119/0x190 [ 4800.746923][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4800.747192][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4800.747501][ C1] __tcf_classify+0x329/0x7d0 [ 4800.747742][ C1] tcf_classify+0x283/0x930 [ 4800.747975][ C1] ? arch_stack_walk+0xa2/0x100 [ 4800.748224][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4800.748481][ C1] ? get_stack_info+0x36/0xc0 [ 4800.748721][ C1] tc_run+0x2e4/0x5d0 [ 4800.748928][ C1] ? __pfx_tc_run+0x10/0x10 [ 4800.749158][ C1] ? lock_acquire+0x1c1/0x220 [ 4800.749397][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4800.749658][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4800.749912][ C1] ? lock_acquire+0x1c1/0x220 [ 4800.750151][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4800.750416][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4800.750721][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4800.750994][ C1] ? neigh_hh_output+0x348/0x590 [ 4800.751246][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4800.751510][ C1] ip_finish_output2+0x786/0x18e0 [ 4800.751766][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4800.752043][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4800.752381][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4800.752658][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4800.752911][ C1] ? __ip_finish_output+0x10f/0x770 [ 4800.753178][ C1] ip_output+0x16b/0x4f0 [ 4800.753393][ C1] ? run_timer_softirq+0x72/0x100 [ 4800.753651][ C1] ? __pfx_ip_output+0x10/0x10 [ 4800.753898][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4800.754184][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4800.754435][ C1] ? ip_local_out+0x114/0x3b0 [ 4800.754675][ C1] __ip_queue_xmit+0x672/0x1910 [ 4800.754923][ C1] ? __create_object+0x5e/0xb0 [ 4800.755169][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4800.755436][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4800.755716][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4800.755994][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4800.756276][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4800.756547][ C1] tcp_delack_timer+0x84/0x240 [ 4800.756791][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4800.757061][ C1] call_timer_fn+0x173/0x430 [ 4800.757299][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4800.757560][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4800.757821][ C1] __run_timers.part.0+0x52d/0x890 [ 4800.758080][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4800.758354][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4800.758640][ C1] ? lock_acquire+0x1c1/0x220 [ 4800.758879][ C1] ? clockevents_program_event+0xf6/0x300 [ 4800.759168][ C1] ? lock_release+0x1d5/0x250 [ 4800.759408][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4800.759670][ C1] ? ktime_get+0xb3/0x190 [ 4800.759890][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4800.760187][ C1] run_timer_softirq+0x72/0x100 [ 4800.760436][ C1] __do_softirq+0x1b9/0x7ff [ 4800.760669][ C1] irq_exit_rcu+0x98/0xc0 [ 4800.760889][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4800.761175][ C1] [ 4800.761326][ C1] [ 4800.761475][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4800.761781][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4800.762104][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4800.763076][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4800.763385][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4800.763782][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4800.764180][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4800.764579][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4800.764978][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4800.765377][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4800.765674][ C1] pipe_read+0xa16/0xdf0 [ 4800.765893][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4800.766176][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4800.766419][ C1] ? iterate_tty_write+0x299/0x540 [ 4800.766680][ C1] ? lock_release+0x1d5/0x250 [ 4800.766922][ C1] vfs_read+0x911/0xc00 [ 4800.767135][ C1] ? lock_acquire+0x1c1/0x220 [ 4800.767373][ C1] ? __might_fault+0xc6/0x180 [ 4800.767614][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4800.767854][ C1] ? __might_fault+0xc6/0x180 [ 4800.768092][ C1] ? lock_release+0x1d5/0x250 [ 4800.768332][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4800.768596][ C1] ? __fget_light+0x54/0x1e0 [ 4800.768834][ C1] ksys_read+0x17a/0x1e0 [ 4800.769050][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4800.769295][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4800.769600][ C1] do_syscall_64+0xc9/0x1e0 [ 4800.769833][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4800.770131][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4800.770361][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4800.771331][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4800.771752][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4800.772152][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4800.772550][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4800.772947][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4800.773347][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4800.773749][ C1] [ 4800.773905][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4800.774179][ C2] NMI backtrace for cpu 2 [ 4800.774186][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4800.774192][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4800.774196][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4800.774205][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4800.774211][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4800.774216][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4800.774220][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4800.774223][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4800.774225][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4800.774226][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4800.774228][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4800.774230][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4800.774234][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4800.774236][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4800.774237][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4800.774239][ C2] PKRU: 55555554 [ 4800.774240][ C2] Call Trace: [ 4800.774242][ C2] [ 4800.774244][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4800.774252][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4800.774258][ C2] ? nmi_handle+0x153/0x420 [ 4800.774263][ C2] ? default_do_nmi+0x41/0x100 [ 4800.774265][ C2] ? exc_nmi+0xf3/0x120 [ 4800.774268][ C2] ? end_repeat_nmi+0xf/0x60 [ 4800.774274][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4800.774277][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4800.774280][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4800.774284][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4800.774287][ C2] [ 4800.774288][ C2] [ 4800.774289][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4800.774292][ C2] ? get_stack_info+0x36/0xc0 [ 4800.774296][ C2] ? lock_acquire+0x1c1/0x220 [ 4800.774300][ C2] ? lock_release+0x1d5/0x250 [ 4800.774303][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4800.774307][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4800.774310][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4800.774313][ C2] ? lock_acquire+0x1c1/0x220 [ 4800.774315][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4800.774319][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4800.774321][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4800.774328][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4800.774330][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4800.774335][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4800.774340][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4800.774343][ C2] ip_local_deliver+0x19d/0x480 [ 4800.774346][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4800.774348][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4800.774350][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4800.774356][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4800.774359][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4800.774362][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4800.774371][ C2] ip_rcv+0x564/0x740 [ 4800.774374][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4800.774377][ C2] ? set_track_prepare+0x8a/0xd0 [ 4800.774381][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4800.774384][ C2] ? start_secondary+0x21c/0x2b0 [ 4800.774386][ C2] ? skb_clone+0x10b/0x330 [ 4800.774390][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4800.774396][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4800.774402][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4800.774405][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4800.774414][ C2] ? __tcf_classify+0x329/0x7d0 [ 4800.774418][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4800.774420][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4800.774423][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4800.774427][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4800.774431][ C2] ? lock_acquire+0x1c1/0x220 [ 4800.774433][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4800.774438][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4800.774442][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4800.774446][ C2] ? __copy_skb_header+0xaf/0x490 [ 4800.774450][ C2] ? __skb_clone+0x57a/0x760 [ 4800.774453][ C2] netif_receive_skb+0x55/0x280 [ 4800.774456][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4800.774464][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4800.774470][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4800.774477][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4800.774481][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4800.774491][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4800.774499][ C2] ? get_stack_info+0x36/0xc0 [ 4800.774503][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4800.774506][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4800.774510][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4800.774512][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4800.774515][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4800.774518][ C2] ? kernel_text_address+0x17/0xe0 [ 4800.774521][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4800.774525][ C2] ? arch_stack_walk+0x8c/0x100 [ 4800.774529][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4800.774532][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4800.774535][ C2] ? lock_acquire+0x1c1/0x220 [ 4800.774537][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4800.774541][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4800.774545][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4800.774548][ C2] ? get_stack_info+0x36/0xc0 [ 4800.774552][ C2] __tcf_classify+0x329/0x7d0 [ 4800.774557][ C2] tcf_classify+0x283/0x930 [ 4800.774561][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4800.774565][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4800.774569][ C2] tc_run+0x2e4/0x5d0 [ 4800.774573][ C2] ? __pfx_tc_run+0x10/0x10 [ 4800.774576][ C2] ? lock_acquire+0x1c1/0x220 [ 4800.774578][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4800.774582][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4800.774586][ C2] ? lock_acquire+0x1c1/0x220 [ 4800.774589][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4800.774592][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4800.774595][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4800.774598][ C2] ? neigh_hh_output+0x348/0x590 [ 4800.774601][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4800.774605][ C2] ip_finish_output2+0x786/0x18e0 [ 4800.774608][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4800.774616][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4800.774618][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4800.774622][ C2] ? __ip_finish_output+0x10f/0x770 [ 4800.774626][ C2] ip_output+0x16b/0x4f0 [ 4800.774629][ C2] ? __pfx_ip_output+0x10/0x10 [ 4800.774631][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4800.774634][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4800.774637][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4800.774640][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4800.774643][ C2] ? __alloc_skb+0xd4/0x280 [ 4800.774645][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4800.774649][ C2] ? tcp_fragment+0x168/0x1040 [ 4800.774652][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4800.774655][ C2] ? ip_local_out+0x114/0x3b0 [ 4800.774658][ C2] __ip_queue_xmit+0x672/0x1910 [ 4800.774662][ C2] ? __skb_clone+0x57a/0x760 [ 4800.774665][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4800.774670][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4800.774673][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4800.774677][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4800.774681][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4800.774686][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4800.774689][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4800.774692][ C2] tcp_send_loss_probe+0x348/0x830 [ 4800.774695][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4800.774698][ C2] tcp_write_timer+0x82/0x1d0 [ 4800.774701][ C2] call_timer_fn+0x173/0x430 [ 4800.774704][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4800.774709][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4800.774713][ C2] __run_timers.part.0+0x52d/0x890 [ 4800.774715][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4800.774719][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4800.774722][ C2] ? lock_acquire+0x1c1/0x220 [ 4800.774725][ C2] ? clockevents_program_event+0xf6/0x300 [ 4800.774728][ C2] ? lock_release+0x1d5/0x250 [ 4800.774731][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4800.774734][ C2] ? ktime_get+0xb3/0x190 [ 4800.774736][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4800.774741][ C2] run_timer_softirq+0x72/0x100 [ 4800.774744][ C2] __do_softirq+0x1b9/0x7ff [ 4800.774748][ C2] irq_exit_rcu+0x98/0xc0 [ 4800.774751][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4800.774754][ C2] [ 4800.774755][ C2] [ 4800.774756][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4800.774759][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4800.774762][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4800.774765][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4800.774767][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4800.774768][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4800.774770][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4800.774771][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4800.774773][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4800.774776][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4800.774779][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4800.774782][ C2] default_idle_call+0x69/0xa0 [ 4800.774785][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4800.774787][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4800.774791][ C2] ? lock_release+0x1d5/0x250 [ 4800.774793][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4800.774797][ C2] do_idle+0xfb/0x160 [ 4800.774800][ C2] cpu_startup_entry+0x55/0x60 [ 4800.774802][ C2] start_secondary+0x21c/0x2b0 [ 4800.774805][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4800.774809][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4800.774814][ C2] [ 4828.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2305s! [swapper/2:0] [ 4828.569688][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4828.570909][ C2] irq event stamp: 44114564 [ 4828.571134][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4828.571655][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4828.572156][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4828.572619][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4828.573075][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4828.573518][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4828.574113][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 4828.574390][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 4828.575342][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 4828.575640][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4828.576032][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4828.576419][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4828.576810][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4828.577199][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4828.577587][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4828.578020][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4828.578343][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4828.578734][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4828.579122][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4828.579508][ C2] PKRU: 55555554 [ 4828.579684][ C2] Call Trace: [ 4828.579851][ C2] [ 4828.579995][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4828.580253][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4828.580490][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4828.580759][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4828.581026][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4828.581307][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4828.581566][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4828.581864][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4828.582119][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4828.582375][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4828.582678][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4828.582964][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4828.583275][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4828.583558][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 4828.583831][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4828.584108][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4828.584411][ C2] ? get_stack_info+0x36/0xc0 [ 4828.584645][ C2] ? lock_acquire+0x1c1/0x220 [ 4828.584879][ C2] ? lock_release+0x1d5/0x250 [ 4828.585115][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4828.585357][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4828.585622][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4828.585905][ C2] ? lock_acquire+0x1c1/0x220 [ 4828.586141][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4828.586376][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4828.586629][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4828.586858][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4828.587097][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4828.587349][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4828.587620][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4828.587889][ C2] ip_local_deliver+0x19d/0x480 [ 4828.588130][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4828.588394][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4828.588650][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4828.588989][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4828.589238][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4828.589550][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4828.589805][ C2] ip_rcv+0x564/0x740 [ 4828.590005][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4828.590229][ C2] ? set_track_prepare+0x8a/0xd0 [ 4828.590477][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4828.590748][ C2] ? start_secondary+0x21c/0x2b0 [ 4828.590992][ C2] ? skb_clone+0x10b/0x330 [ 4828.591215][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4828.591526][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4828.591823][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4828.592097][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4828.592385][ C2] ? __tcf_classify+0x329/0x7d0 [ 4828.592626][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4828.592850][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4828.593144][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4828.593419][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4828.593735][ C2] ? lock_acquire+0x1c1/0x220 [ 4828.593968][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4828.594257][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4828.594538][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4828.594846][ C2] ? __copy_skb_header+0xaf/0x490 [ 4828.595096][ C2] ? __skb_clone+0x57a/0x760 [ 4828.595325][ C2] netif_receive_skb+0x55/0x280 [ 4828.595566][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4828.595872][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4828.596197][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4828.596486][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4828.596752][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4828.597035][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4828.597341][ C2] ? get_stack_info+0x36/0xc0 [ 4828.597573][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4828.597831][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4828.598140][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4828.598409][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4828.598677][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4828.598983][ C2] ? kernel_text_address+0x17/0xe0 [ 4828.599238][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4828.599542][ C2] ? arch_stack_walk+0x8c/0x100 [ 4828.599784][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4828.600040][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4828.600316][ C2] ? lock_acquire+0x1c1/0x220 [ 4828.600550][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4828.600825][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4828.601122][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4828.601391][ C2] ? get_stack_info+0x36/0xc0 [ 4828.601624][ C2] __tcf_classify+0x329/0x7d0 [ 4828.601860][ C2] tcf_classify+0x283/0x930 [ 4828.602087][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4828.602336][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4828.602641][ C2] tc_run+0x2e4/0x5d0 [ 4828.602841][ C2] ? __pfx_tc_run+0x10/0x10 [ 4828.603063][ C2] ? lock_acquire+0x1c1/0x220 [ 4828.603297][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4828.603555][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4828.603800][ C2] ? lock_acquire+0x1c1/0x220 [ 4828.604033][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4828.604292][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4828.604588][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4828.604854][ C2] ? neigh_hh_output+0x348/0x590 [ 4828.605100][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4828.605357][ C2] ip_finish_output2+0x786/0x18e0 [ 4828.605608][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4828.605964][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4828.606242][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4828.606494][ C2] ? __ip_finish_output+0x10f/0x770 [ 4828.606760][ C2] ip_output+0x16b/0x4f0 [ 4828.606988][ C2] ? __pfx_ip_output+0x10/0x10 [ 4828.607227][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4828.607496][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4828.607800][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4828.608069][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4828.608315][ C2] ? __alloc_skb+0xd4/0x280 [ 4828.608540][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4828.608803][ C2] ? tcp_fragment+0x168/0x1040 [ 4828.609043][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4828.609289][ C2] ? ip_local_out+0x114/0x3b0 [ 4828.609523][ C2] __ip_queue_xmit+0x672/0x1910 [ 4828.609764][ C2] ? __skb_clone+0x57a/0x760 [ 4828.609993][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4828.610253][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4828.610527][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4828.610765][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4828.611008][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4828.611303][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4828.611613][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4828.611851][ C2] tcp_send_loss_probe+0x348/0x830 [ 4828.612105][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4828.612366][ C2] tcp_write_timer+0x82/0x1d0 [ 4828.612599][ C2] call_timer_fn+0x173/0x430 [ 4828.612829][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4828.613084][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4828.613340][ C2] __run_timers.part.0+0x52d/0x890 [ 4828.613593][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4828.613854][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4828.614131][ C2] ? lock_acquire+0x1c1/0x220 [ 4828.614364][ C2] ? clockevents_program_event+0xf6/0x300 [ 4828.614648][ C2] ? lock_release+0x1d5/0x250 [ 4828.614878][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4828.615137][ C2] ? ktime_get+0xb3/0x190 [ 4828.615352][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4828.615641][ C2] run_timer_softirq+0x72/0x100 [ 4828.615886][ C2] __do_softirq+0x1b9/0x7ff [ 4828.616115][ C2] irq_exit_rcu+0x98/0xc0 [ 4828.616329][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4828.616606][ C2] [ 4828.616751][ C2] [ 4828.616899][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4828.617193][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4828.617443][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4828.618387][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4828.618685][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4828.619073][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4828.619461][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4828.619848][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4828.620236][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4828.620628][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4828.620908][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4828.621161][ C2] default_idle_call+0x69/0xa0 [ 4828.621398][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4828.621642][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4828.621912][ C2] ? lock_release+0x1d5/0x250 [ 4828.622147][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4828.622411][ C2] do_idle+0xfb/0x160 [ 4828.622608][ C2] cpu_startup_entry+0x55/0x60 [ 4828.622847][ C2] start_secondary+0x21c/0x2b0 [ 4828.623084][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4828.623348][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4828.623650][ C2] [ 4828.623803][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2305s! [perl:4135] [ 4828.624230][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4828.625485][ C1] irq event stamp: 209232 [ 4828.625706][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4828.626240][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4828.626714][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4828.627187][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4828.627649][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4828.628096][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4828.628707][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4828.629032][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4828.630003][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4828.630311][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4828.630712][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4828.631112][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4828.631508][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4828.631907][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4828.632307][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4828.632753][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4828.633085][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4828.633484][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4828.633883][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4828.634284][ C1] PKRU: 55555554 [ 4828.634466][ C1] Call Trace: [ 4828.634634][ C1] [ 4828.634785][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4828.635047][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4828.635289][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4828.635567][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4828.635839][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4828.636132][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4828.636397][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4828.636701][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4828.636962][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4828.637270][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4828.637566][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4828.637882][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4828.638169][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4828.638466][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4828.638753][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4828.639063][ C1] ? get_stack_info+0x36/0xc0 [ 4828.639306][ C1] ? lock_acquire+0x1c1/0x220 [ 4828.639547][ C1] ? lock_release+0x1d5/0x250 [ 4828.639787][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4828.640034][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4828.640308][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4828.640595][ C1] ? lock_acquire+0x1c1/0x220 [ 4828.640833][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4828.641075][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4828.641335][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4828.641568][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4828.641815][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4828.642072][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4828.642347][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4828.642626][ C1] ip_local_deliver+0x19d/0x480 [ 4828.642873][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4828.643144][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4828.643407][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4828.643752][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4828.644006][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4828.644325][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4828.644588][ C1] ip_rcv+0x564/0x740 [ 4828.644792][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4828.645022][ C1] ? set_track_prepare+0x8a/0xd0 [ 4828.645274][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4828.645548][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4828.645823][ C1] ? skb_clone+0x10b/0x330 [ 4828.646058][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4828.646376][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4828.646681][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4828.646961][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4828.647257][ C1] ? __tcf_classify+0x329/0x7d0 [ 4828.647506][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4828.647735][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4828.648034][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4828.648318][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4828.648643][ C1] ? lock_acquire+0x1c1/0x220 [ 4828.648881][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4828.649179][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4828.649462][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4828.649778][ C1] ? __copy_skb_header+0xaf/0x490 [ 4828.650035][ C1] ? __skb_clone+0x57a/0x760 [ 4828.650270][ C1] netif_receive_skb+0x55/0x280 [ 4828.650518][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4828.650830][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4828.651162][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4828.651458][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4828.651734][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4828.652022][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4828.652334][ C1] ? hlock_class+0x4e/0x130 [ 4828.652566][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4828.652843][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4828.653118][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4828.653381][ C1] ? hlock_class+0x4e/0x130 [ 4828.653613][ C1] ? mark_lock+0x38/0x3e0 [ 4828.653831][ C1] ? stack_access_ok+0xda/0x1f0 [ 4828.654078][ C1] ? __lock_acquire+0xb67/0x1610 [ 4828.654331][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4828.654606][ C1] ? get_stack_info+0x36/0xc0 [ 4828.654846][ C1] ? stack_access_ok+0xda/0x1f0 [ 4828.655092][ C1] ? get_reg+0x119/0x190 [ 4828.655308][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4828.655576][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4828.655888][ C1] __tcf_classify+0x329/0x7d0 [ 4828.656131][ C1] tcf_classify+0x283/0x930 [ 4828.656363][ C1] ? arch_stack_walk+0xa2/0x100 [ 4828.656612][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4828.656868][ C1] ? get_stack_info+0x36/0xc0 [ 4828.657107][ C1] tc_run+0x2e4/0x5d0 [ 4828.657314][ C1] ? __pfx_tc_run+0x10/0x10 [ 4828.657544][ C1] ? lock_acquire+0x1c1/0x220 [ 4828.657783][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4828.658044][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4828.658298][ C1] ? lock_acquire+0x1c1/0x220 [ 4828.658536][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4828.658800][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4828.659104][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4828.659378][ C1] ? neigh_hh_output+0x348/0x590 [ 4828.659630][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4828.659895][ C1] ip_finish_output2+0x786/0x18e0 [ 4828.660151][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4828.660429][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4828.660766][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4828.661044][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4828.661297][ C1] ? __ip_finish_output+0x10f/0x770 [ 4828.661562][ C1] ip_output+0x16b/0x4f0 [ 4828.661777][ C1] ? run_timer_softirq+0x72/0x100 [ 4828.662033][ C1] ? __pfx_ip_output+0x10/0x10 [ 4828.662276][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4828.662561][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4828.662812][ C1] ? ip_local_out+0x114/0x3b0 [ 4828.663053][ C1] __ip_queue_xmit+0x672/0x1910 [ 4828.663302][ C1] ? __create_object+0x5e/0xb0 [ 4828.663549][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4828.663816][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4828.664096][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4828.664369][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4828.664652][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4828.664924][ C1] tcp_delack_timer+0x84/0x240 [ 4828.665168][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4828.665440][ C1] call_timer_fn+0x173/0x430 [ 4828.665677][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4828.665943][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4828.666203][ C1] __run_timers.part.0+0x52d/0x890 [ 4828.666463][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4828.666735][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4828.667021][ C1] ? lock_acquire+0x1c1/0x220 [ 4828.667259][ C1] ? clockevents_program_event+0xf6/0x300 [ 4828.667550][ C1] ? lock_release+0x1d5/0x250 [ 4828.667790][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4828.668054][ C1] ? ktime_get+0xb3/0x190 [ 4828.668273][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4828.668570][ C1] run_timer_softirq+0x72/0x100 [ 4828.668819][ C1] __do_softirq+0x1b9/0x7ff [ 4828.669049][ C1] irq_exit_rcu+0x98/0xc0 [ 4828.669271][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4828.669555][ C1] [ 4828.669708][ C1] [ 4828.669858][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4828.670162][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4828.670487][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4828.671459][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4828.671767][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4828.672165][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4828.672563][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4828.672961][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4828.673361][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4828.673761][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4828.674058][ C1] pipe_read+0xa16/0xdf0 [ 4828.674279][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4828.674555][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4828.674799][ C1] ? iterate_tty_write+0x299/0x540 [ 4828.675060][ C1] ? lock_release+0x1d5/0x250 [ 4828.675301][ C1] vfs_read+0x911/0xc00 [ 4828.675514][ C1] ? lock_acquire+0x1c1/0x220 [ 4828.675753][ C1] ? __might_fault+0xc6/0x180 [ 4828.676008][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4828.676247][ C1] ? __might_fault+0xc6/0x180 [ 4828.676485][ C1] ? lock_release+0x1d5/0x250 [ 4828.676725][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4828.676994][ C1] ? __fget_light+0x54/0x1e0 [ 4828.677232][ C1] ksys_read+0x17a/0x1e0 [ 4828.677448][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4828.677692][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4828.677997][ C1] do_syscall_64+0xc9/0x1e0 [ 4828.678228][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4828.678530][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4828.678758][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4828.679732][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4828.680154][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4828.680555][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4828.680953][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4828.681353][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4828.681749][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4828.682152][ C1] [ 4856.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2332s! [perl:4135] [ 4856.569720][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4856.570983][ C1] irq event stamp: 209232 [ 4856.571203][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4856.571740][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4856.572224][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4856.572693][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4856.573157][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4856.573604][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4856.574219][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4856.574545][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4856.575519][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4856.575838][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4856.576237][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4856.576635][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4856.577037][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4856.577437][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4856.577838][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4856.578286][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4856.578619][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4856.579024][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4856.579427][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4856.579826][ C1] PKRU: 55555554 [ 4856.580009][ C1] Call Trace: [ 4856.580182][ C1] [ 4856.580330][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4856.580593][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4856.580840][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4856.581118][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4856.581395][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4856.581685][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4856.581951][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4856.582259][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4856.582524][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4856.582836][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4856.583135][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4856.583451][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4856.583745][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4856.584041][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4856.584331][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4856.584645][ C1] ? get_stack_info+0x36/0xc0 [ 4856.584886][ C1] ? lock_acquire+0x1c1/0x220 [ 4856.585128][ C1] ? lock_release+0x1d5/0x250 [ 4856.585369][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4856.585620][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4856.585900][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4856.586187][ C1] ? lock_acquire+0x1c1/0x220 [ 4856.586425][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4856.586667][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4856.586928][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4856.587165][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4856.587414][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4856.587674][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4856.587951][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4856.588229][ C1] ip_local_deliver+0x19d/0x480 [ 4856.588477][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4856.588748][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4856.589015][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4856.589365][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4856.589622][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4856.589947][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4856.590212][ C1] ip_rcv+0x564/0x740 [ 4856.590416][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4856.590649][ C1] ? set_track_prepare+0x8a/0xd0 [ 4856.590903][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4856.591182][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4856.591455][ C1] ? skb_clone+0x10b/0x330 [ 4856.591686][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4856.592007][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4856.592314][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4856.592601][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4856.592899][ C1] ? __tcf_classify+0x329/0x7d0 [ 4856.593148][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4856.593379][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4856.593679][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4856.593966][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4856.594291][ C1] ? lock_acquire+0x1c1/0x220 [ 4856.594532][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4856.594828][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4856.595115][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4856.595432][ C1] ? __copy_skb_header+0xaf/0x490 [ 4856.595689][ C1] ? __skb_clone+0x57a/0x760 [ 4856.595933][ C1] netif_receive_skb+0x55/0x280 [ 4856.596181][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4856.596496][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4856.596827][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4856.597127][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4856.597401][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4856.597689][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4856.598003][ C1] ? hlock_class+0x4e/0x130 [ 4856.598237][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4856.598512][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4856.598788][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4856.599052][ C1] ? hlock_class+0x4e/0x130 [ 4856.599283][ C1] ? mark_lock+0x38/0x3e0 [ 4856.599504][ C1] ? stack_access_ok+0xda/0x1f0 [ 4856.599752][ C1] ? __lock_acquire+0xb67/0x1610 [ 4856.600005][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4856.600282][ C1] ? get_stack_info+0x36/0xc0 [ 4856.600523][ C1] ? stack_access_ok+0xda/0x1f0 [ 4856.600769][ C1] ? get_reg+0x119/0x190 [ 4856.600988][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4856.601257][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4856.601567][ C1] __tcf_classify+0x329/0x7d0 [ 4856.601812][ C1] tcf_classify+0x283/0x930 [ 4856.602045][ C1] ? arch_stack_walk+0xa2/0x100 [ 4856.602297][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4856.602554][ C1] ? get_stack_info+0x36/0xc0 [ 4856.602797][ C1] tc_run+0x2e4/0x5d0 [ 4856.603004][ C1] ? __pfx_tc_run+0x10/0x10 [ 4856.603238][ C1] ? lock_acquire+0x1c1/0x220 [ 4856.603476][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4856.603739][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4856.603992][ C1] ? lock_acquire+0x1c1/0x220 [ 4856.604233][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4856.604498][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4856.604805][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4856.605078][ C1] ? neigh_hh_output+0x348/0x590 [ 4856.605332][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4856.605598][ C1] ip_finish_output2+0x786/0x18e0 [ 4856.605867][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4856.606148][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4856.606491][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4856.606766][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4856.607020][ C1] ? __ip_finish_output+0x10f/0x770 [ 4856.607287][ C1] ip_output+0x16b/0x4f0 [ 4856.607509][ C1] ? run_timer_softirq+0x72/0x100 [ 4856.607766][ C1] ? __pfx_ip_output+0x10/0x10 [ 4856.608009][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4856.608296][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4856.608550][ C1] ? ip_local_out+0x114/0x3b0 [ 4856.608788][ C1] __ip_queue_xmit+0x672/0x1910 [ 4856.609038][ C1] ? __create_object+0x5e/0xb0 [ 4856.609284][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4856.609551][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4856.609835][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4856.610110][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4856.610394][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4856.610670][ C1] tcp_delack_timer+0x84/0x240 [ 4856.610916][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4856.611189][ C1] call_timer_fn+0x173/0x430 [ 4856.611424][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4856.611686][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4856.611948][ C1] __run_timers.part.0+0x52d/0x890 [ 4856.612208][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4856.612484][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4856.612768][ C1] ? lock_acquire+0x1c1/0x220 [ 4856.613008][ C1] ? clockevents_program_event+0xf6/0x300 [ 4856.613297][ C1] ? lock_release+0x1d5/0x250 [ 4856.613537][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4856.613800][ C1] ? ktime_get+0xb3/0x190 [ 4856.614023][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4856.614319][ C1] run_timer_softirq+0x72/0x100 [ 4856.614567][ C1] __do_softirq+0x1b9/0x7ff [ 4856.614801][ C1] irq_exit_rcu+0x98/0xc0 [ 4856.615021][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4856.615310][ C1] [ 4856.615460][ C1] [ 4856.615610][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4856.615934][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4856.616258][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4856.617230][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4856.617541][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4856.617939][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4856.618341][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4856.618738][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4856.619137][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4856.619536][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4856.619838][ C1] pipe_read+0xa16/0xdf0 [ 4856.620061][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4856.620342][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4856.620584][ C1] ? iterate_tty_write+0x299/0x540 [ 4856.620846][ C1] ? lock_release+0x1d5/0x250 [ 4856.621084][ C1] vfs_read+0x911/0xc00 [ 4856.621301][ C1] ? lock_acquire+0x1c1/0x220 [ 4856.621537][ C1] ? __might_fault+0xc6/0x180 [ 4856.621780][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4856.622019][ C1] ? __might_fault+0xc6/0x180 [ 4856.622261][ C1] ? lock_release+0x1d5/0x250 [ 4856.622499][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4856.622766][ C1] ? __fget_light+0x54/0x1e0 [ 4856.623002][ C1] ksys_read+0x17a/0x1e0 [ 4856.623221][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4856.623464][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4856.623770][ C1] do_syscall_64+0xc9/0x1e0 [ 4856.624004][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4856.624304][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4856.624533][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4856.625505][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4856.625934][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4856.626333][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4856.626733][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4856.627132][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4856.627533][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4856.627936][ C1] [ 4856.628099][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2332s! [swapper/2:0] [ 4856.628579][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4856.629850][ C2] irq event stamp: 44114564 [ 4856.630081][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4856.630627][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4856.631140][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4856.631620][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4856.632091][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4856.632548][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4856.633164][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4856.633489][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4856.634464][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4856.634771][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4856.635174][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4856.635576][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4856.635994][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4856.636400][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4856.636800][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4856.637250][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4856.637582][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4856.637982][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4856.638387][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4856.638787][ C2] PKRU: 55555554 [ 4856.638969][ C2] Call Trace: [ 4856.639144][ C2] [ 4856.639295][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4856.639561][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4856.639807][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4856.640085][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4856.640359][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4856.640650][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4856.640916][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4856.641224][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4856.641486][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4856.641751][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4856.642060][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4856.642358][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4856.642681][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4856.642971][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4856.643270][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4856.643560][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4856.643872][ C2] ? get_stack_info+0x36/0xc0 [ 4856.644116][ C2] ? lock_acquire+0x1c1/0x220 [ 4856.644360][ C2] ? lock_release+0x1d5/0x250 [ 4856.644602][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4856.644852][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4856.645127][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4856.645412][ C2] ? lock_acquire+0x1c1/0x220 [ 4856.645652][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4856.645921][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4856.646185][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4856.646420][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4856.646668][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4856.646927][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4856.647208][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4856.647485][ C2] ip_local_deliver+0x19d/0x480 [ 4856.647735][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4856.648006][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4856.648273][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4856.648624][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4856.648878][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4856.649201][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4856.649468][ C2] ip_rcv+0x564/0x740 [ 4856.649674][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4856.649904][ C2] ? set_track_prepare+0x8a/0xd0 [ 4856.650161][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4856.650441][ C2] ? start_secondary+0x21c/0x2b0 [ 4856.650695][ C2] ? skb_clone+0x10b/0x330 [ 4856.650925][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4856.651247][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4856.651556][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4856.651839][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4856.652138][ C2] ? __tcf_classify+0x329/0x7d0 [ 4856.652387][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4856.652620][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4856.652927][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4856.653213][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4856.653540][ C2] ? lock_acquire+0x1c1/0x220 [ 4856.653780][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4856.654080][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4856.654368][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4856.654690][ C2] ? __copy_skb_header+0xaf/0x490 [ 4856.654948][ C2] ? __skb_clone+0x57a/0x760 [ 4856.655186][ C2] netif_receive_skb+0x55/0x280 [ 4856.655436][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4856.655766][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4856.656102][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4856.656405][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4856.656678][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4856.656971][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4856.657284][ C2] ? get_stack_info+0x36/0xc0 [ 4856.657526][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4856.657793][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4856.658112][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4856.658391][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4856.658667][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4856.658986][ C2] ? kernel_text_address+0x17/0xe0 [ 4856.659249][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4856.659565][ C2] ? arch_stack_walk+0x8c/0x100 [ 4856.659821][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4856.660088][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4856.660380][ C2] ? lock_acquire+0x1c1/0x220 [ 4856.660621][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4856.660904][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4856.661213][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4856.661490][ C2] ? get_stack_info+0x36/0xc0 [ 4856.661731][ C2] __tcf_classify+0x329/0x7d0 [ 4856.661975][ C2] tcf_classify+0x283/0x930 [ 4856.662211][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4856.662473][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4856.662786][ C2] tc_run+0x2e4/0x5d0 [ 4856.662995][ C2] ? __pfx_tc_run+0x10/0x10 [ 4856.663227][ C2] ? lock_acquire+0x1c1/0x220 [ 4856.663469][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4856.663731][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4856.663986][ C2] ? lock_acquire+0x1c1/0x220 [ 4856.664228][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4856.664495][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4856.664800][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4856.665072][ C2] ? neigh_hh_output+0x348/0x590 [ 4856.665328][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4856.665593][ C2] ip_finish_output2+0x786/0x18e0 [ 4856.665871][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4856.666213][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4856.666491][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4856.666746][ C2] ? __ip_finish_output+0x10f/0x770 [ 4856.667013][ C2] ip_output+0x16b/0x4f0 [ 4856.667231][ C2] ? __pfx_ip_output+0x10/0x10 [ 4856.667475][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4856.667755][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4856.668071][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4856.668350][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4856.668603][ C2] ? __alloc_skb+0xd4/0x280 [ 4856.668836][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4856.669107][ C2] ? tcp_fragment+0x168/0x1040 [ 4856.669354][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4856.669608][ C2] ? ip_local_out+0x114/0x3b0 [ 4856.669853][ C2] __ip_queue_xmit+0x672/0x1910 [ 4856.670101][ C2] ? __skb_clone+0x57a/0x760 [ 4856.670340][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4856.670606][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4856.670889][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4856.671136][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4856.671388][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4856.671692][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4856.672013][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4856.672259][ C2] tcp_send_loss_probe+0x348/0x830 [ 4856.672520][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4856.672790][ C2] tcp_write_timer+0x82/0x1d0 [ 4856.673031][ C2] call_timer_fn+0x173/0x430 [ 4856.673271][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4856.673540][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4856.673804][ C2] __run_timers.part.0+0x52d/0x890 [ 4856.674066][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4856.674338][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4856.674624][ C2] ? lock_acquire+0x1c1/0x220 [ 4856.674867][ C2] ? clockevents_program_event+0xf6/0x300 [ 4856.675162][ C2] ? lock_release+0x1d5/0x250 [ 4856.675401][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4856.675665][ C2] ? ktime_get+0xb3/0x190 [ 4856.675907][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4856.676205][ C2] run_timer_softirq+0x72/0x100 [ 4856.676454][ C2] __do_softirq+0x1b9/0x7ff [ 4856.676691][ C2] irq_exit_rcu+0x98/0xc0 [ 4856.676912][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4856.677204][ C2] [ 4856.677355][ C2] [ 4856.677507][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4856.677812][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4856.678070][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4856.679052][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4856.679366][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4856.679769][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4856.680172][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4856.680575][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4856.680974][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4856.681378][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4856.681669][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4856.681931][ C2] default_idle_call+0x69/0xa0 [ 4856.682179][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4856.682431][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4856.682711][ C2] ? lock_release+0x1d5/0x250 [ 4856.682951][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4856.683228][ C2] do_idle+0xfb/0x160 [ 4856.683433][ C2] cpu_startup_entry+0x55/0x60 [ 4856.683677][ C2] start_secondary+0x21c/0x2b0 [ 4856.683923][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4856.684196][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4856.684510][ C2] [ 4878.774103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4878.774484][ C1] rcu: 1-....: (2517525 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=613610 [ 4878.775039][ C1] rcu: (t=2523887 jiffies g=1882453 q=712 ncpus=4) [ 4878.775373][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4878.775830][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4878.776445][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4878.776774][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4878.777747][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4878.778056][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4878.778455][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4878.778856][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4878.779257][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4878.779656][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4878.780057][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4878.780509][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4878.780845][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4878.781249][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4878.781648][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4878.782047][ C1] PKRU: 55555554 [ 4878.782234][ C1] Call Trace: [ 4878.782409][ C1] [ 4878.782558][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4878.782832][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4878.783085][ C1] ? check_cpu_stall+0x284/0x500 [ 4878.783339][ C1] ? rcu_pending+0x92/0x360 [ 4878.783572][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4878.783842][ C1] ? update_process_times+0xb9/0x110 [ 4878.784112][ C1] ? tick_sched_handle+0x67/0x130 [ 4878.784370][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4878.784657][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4878.784900][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4878.785213][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4878.785488][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4878.785786][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4878.786052][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4878.786360][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4878.786624][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4878.786936][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4878.787233][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4878.787548][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4878.787841][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4878.788138][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4878.788428][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4878.788742][ C1] ? get_stack_info+0x36/0xc0 [ 4878.788984][ C1] ? lock_acquire+0x1c1/0x220 [ 4878.789224][ C1] ? lock_release+0x1d5/0x250 [ 4878.789467][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4878.789718][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4878.789991][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4878.790281][ C1] ? lock_acquire+0x1c1/0x220 [ 4878.790518][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4878.790763][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4878.791024][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4878.791262][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4878.791510][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4878.791769][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4878.792047][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4878.792324][ C1] ip_local_deliver+0x19d/0x480 [ 4878.792573][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4878.792845][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4878.793113][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4878.793465][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4878.793720][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4878.794043][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4878.794309][ C1] ip_rcv+0x564/0x740 [ 4878.794514][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4878.794747][ C1] ? set_track_prepare+0x8a/0xd0 [ 4878.795002][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4878.795281][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4878.795555][ C1] ? skb_clone+0x10b/0x330 [ 4878.795793][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4878.796114][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4878.796418][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4878.796702][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4878.796998][ C1] ? __tcf_classify+0x329/0x7d0 [ 4878.797248][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4878.797479][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4878.797779][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4878.798067][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4878.798393][ C1] ? lock_acquire+0x1c1/0x220 [ 4878.798632][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4878.798928][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4878.799215][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4878.799532][ C1] ? __copy_skb_header+0xaf/0x490 [ 4878.799790][ C1] ? __skb_clone+0x57a/0x760 [ 4878.800022][ C1] netif_receive_skb+0x55/0x280 [ 4878.800271][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4878.800587][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4878.800919][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4878.801219][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4878.801493][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4878.801781][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4878.802094][ C1] ? hlock_class+0x4e/0x130 [ 4878.802329][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4878.802606][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4878.802882][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4878.803147][ C1] ? hlock_class+0x4e/0x130 [ 4878.803378][ C1] ? mark_lock+0x38/0x3e0 [ 4878.803599][ C1] ? stack_access_ok+0xda/0x1f0 [ 4878.803848][ C1] ? __lock_acquire+0xb67/0x1610 [ 4878.804107][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4878.804385][ C1] ? get_stack_info+0x36/0xc0 [ 4878.804626][ C1] ? stack_access_ok+0xda/0x1f0 [ 4878.804873][ C1] ? get_reg+0x119/0x190 [ 4878.805093][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4878.805361][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4878.805684][ C1] __tcf_classify+0x329/0x7d0 [ 4878.805927][ C1] tcf_classify+0x283/0x930 [ 4878.806160][ C1] ? arch_stack_walk+0xa2/0x100 [ 4878.806409][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4878.806666][ C1] ? get_stack_info+0x36/0xc0 [ 4878.806908][ C1] tc_run+0x2e4/0x5d0 [ 4878.807114][ C1] ? __pfx_tc_run+0x10/0x10 [ 4878.807345][ C1] ? lock_acquire+0x1c1/0x220 [ 4878.807584][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4878.807846][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4878.808100][ C1] ? lock_acquire+0x1c1/0x220 [ 4878.808341][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4878.808606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4878.808915][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4878.809187][ C1] ? neigh_hh_output+0x348/0x590 [ 4878.809441][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4878.809705][ C1] ip_finish_output2+0x786/0x18e0 [ 4878.809961][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4878.810241][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4878.810581][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4878.810857][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4878.811112][ C1] ? __ip_finish_output+0x10f/0x770 [ 4878.811379][ C1] ip_output+0x16b/0x4f0 [ 4878.811596][ C1] ? run_timer_softirq+0x72/0x100 [ 4878.811853][ C1] ? __pfx_ip_output+0x10/0x10 [ 4878.812098][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4878.812387][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4878.812643][ C1] ? ip_local_out+0x114/0x3b0 [ 4878.812883][ C1] __ip_queue_xmit+0x672/0x1910 [ 4878.813134][ C1] ? __create_object+0x5e/0xb0 [ 4878.813379][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4878.813648][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4878.813932][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4878.814206][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4878.814488][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4878.814761][ C1] tcp_delack_timer+0x84/0x240 [ 4878.815005][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4878.815279][ C1] call_timer_fn+0x173/0x430 [ 4878.815515][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4878.815787][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4878.816052][ C1] __run_timers.part.0+0x52d/0x890 [ 4878.816313][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4878.816589][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4878.816874][ C1] ? lock_acquire+0x1c1/0x220 [ 4878.817113][ C1] ? clockevents_program_event+0xf6/0x300 [ 4878.817403][ C1] ? lock_release+0x1d5/0x250 [ 4878.817644][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4878.817910][ C1] ? ktime_get+0xb3/0x190 [ 4878.818133][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4878.818430][ C1] run_timer_softirq+0x72/0x100 [ 4878.818680][ C1] __do_softirq+0x1b9/0x7ff [ 4878.818916][ C1] irq_exit_rcu+0x98/0xc0 [ 4878.819137][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4878.819426][ C1] [ 4878.819577][ C1] [ 4878.819726][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4878.820034][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4878.820360][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4878.821337][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4878.821648][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4878.822048][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4878.822453][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4878.822853][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4878.823256][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4878.823658][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4878.823960][ C1] pipe_read+0xa16/0xdf0 [ 4878.824180][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4878.824462][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4878.824705][ C1] ? iterate_tty_write+0x299/0x540 [ 4878.824968][ C1] ? lock_release+0x1d5/0x250 [ 4878.825209][ C1] vfs_read+0x911/0xc00 [ 4878.825426][ C1] ? lock_acquire+0x1c1/0x220 [ 4878.825672][ C1] ? __might_fault+0xc6/0x180 [ 4878.825916][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4878.826158][ C1] ? __might_fault+0xc6/0x180 [ 4878.826399][ C1] ? lock_release+0x1d5/0x250 [ 4878.826638][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4878.826904][ C1] ? __fget_light+0x54/0x1e0 [ 4878.827142][ C1] ksys_read+0x17a/0x1e0 [ 4878.827362][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4878.827606][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4878.827913][ C1] do_syscall_64+0xc9/0x1e0 [ 4878.828149][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4878.828449][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4878.828678][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4878.829652][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4878.830076][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4878.830477][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4878.830877][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4878.831280][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4878.831682][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4878.832087][ C1] [ 4878.832245][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4878.832530][ C2] NMI backtrace for cpu 2 [ 4878.832542][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4878.832549][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4878.832554][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4878.832567][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4878.832574][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4878.832578][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4878.832580][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4878.832582][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4878.832584][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4878.832586][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4878.832588][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4878.832590][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4878.832594][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4878.832596][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4878.832598][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4878.832599][ C2] PKRU: 55555554 [ 4878.832601][ C2] Call Trace: [ 4878.832605][ C2] [ 4878.832609][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4878.832618][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4878.832624][ C2] ? nmi_handle+0x153/0x420 [ 4878.832630][ C2] ? default_do_nmi+0x41/0x100 [ 4878.832634][ C2] ? exc_nmi+0xf3/0x120 [ 4878.832637][ C2] ? end_repeat_nmi+0xf/0x60 [ 4878.832644][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4878.832647][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4878.832650][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4878.832654][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4878.832657][ C2] [ 4878.832658][ C2] [ 4878.832659][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4878.832662][ C2] ? get_stack_info+0x36/0xc0 [ 4878.832667][ C2] ? lock_acquire+0x1c1/0x220 [ 4878.832672][ C2] ? lock_release+0x1d5/0x250 [ 4878.832675][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4878.832680][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4878.832683][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4878.832686][ C2] ? lock_acquire+0x1c1/0x220 [ 4878.832689][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4878.832694][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4878.832697][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4878.832704][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4878.832707][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4878.832712][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4878.832720][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4878.832724][ C2] ip_local_deliver+0x19d/0x480 [ 4878.832727][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4878.832730][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4878.832732][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4878.832740][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4878.832746][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4878.832749][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4878.832760][ C2] ip_rcv+0x564/0x740 [ 4878.832763][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4878.832766][ C2] ? set_track_prepare+0x8a/0xd0 [ 4878.832773][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4878.832776][ C2] ? start_secondary+0x21c/0x2b0 [ 4878.832781][ C2] ? skb_clone+0x10b/0x330 [ 4878.832786][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4878.832793][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4878.832798][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4878.832805][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4878.832816][ C2] ? __tcf_classify+0x329/0x7d0 [ 4878.832820][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4878.832822][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4878.832827][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4878.832830][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4878.832834][ C2] ? lock_acquire+0x1c1/0x220 [ 4878.832837][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4878.832841][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4878.832845][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4878.832849][ C2] ? __copy_skb_header+0xaf/0x490 [ 4878.832856][ C2] ? __skb_clone+0x57a/0x760 [ 4878.832858][ C2] netif_receive_skb+0x55/0x280 [ 4878.832862][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4878.832871][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4878.832878][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4878.832884][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4878.832890][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4878.832902][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4878.832909][ C2] ? get_stack_info+0x36/0xc0 [ 4878.832914][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4878.832918][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4878.832923][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4878.832926][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4878.832930][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4878.832932][ C2] ? kernel_text_address+0x17/0xe0 [ 4878.832937][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4878.832943][ C2] ? arch_stack_walk+0x8c/0x100 [ 4878.832948][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4878.832952][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4878.832955][ C2] ? lock_acquire+0x1c1/0x220 [ 4878.832957][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4878.832963][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4878.832970][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4878.832973][ C2] ? get_stack_info+0x36/0xc0 [ 4878.832977][ C2] __tcf_classify+0x329/0x7d0 [ 4878.832983][ C2] tcf_classify+0x283/0x930 [ 4878.832988][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4878.832991][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4878.832995][ C2] tc_run+0x2e4/0x5d0 [ 4878.833001][ C2] ? __pfx_tc_run+0x10/0x10 [ 4878.833004][ C2] ? lock_acquire+0x1c1/0x220 [ 4878.833007][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4878.833011][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4878.833016][ C2] ? lock_acquire+0x1c1/0x220 [ 4878.833018][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4878.833022][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4878.833025][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4878.833028][ C2] ? neigh_hh_output+0x348/0x590 [ 4878.833031][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4878.833035][ C2] ip_finish_output2+0x786/0x18e0 [ 4878.833038][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4878.833046][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4878.833048][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4878.833052][ C2] ? __ip_finish_output+0x10f/0x770 [ 4878.833056][ C2] ip_output+0x16b/0x4f0 [ 4878.833059][ C2] ? __pfx_ip_output+0x10/0x10 [ 4878.833062][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4878.833065][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4878.833068][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4878.833072][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4878.833075][ C2] ? __alloc_skb+0xd4/0x280 [ 4878.833078][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4878.833082][ C2] ? tcp_fragment+0x168/0x1040 [ 4878.833087][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4878.833090][ C2] ? ip_local_out+0x114/0x3b0 [ 4878.833094][ C2] __ip_queue_xmit+0x672/0x1910 [ 4878.833098][ C2] ? __skb_clone+0x57a/0x760 [ 4878.833100][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4878.833106][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4878.833109][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4878.833114][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4878.833120][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4878.833125][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4878.833128][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4878.833132][ C2] tcp_send_loss_probe+0x348/0x830 [ 4878.833135][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4878.833138][ C2] tcp_write_timer+0x82/0x1d0 [ 4878.833141][ C2] call_timer_fn+0x173/0x430 [ 4878.833147][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4878.833152][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4878.833156][ C2] __run_timers.part.0+0x52d/0x890 [ 4878.833159][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4878.833164][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4878.833167][ C2] ? lock_acquire+0x1c1/0x220 [ 4878.833169][ C2] ? clockevents_program_event+0xf6/0x300 [ 4878.833176][ C2] ? lock_release+0x1d5/0x250 [ 4878.833179][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4878.833183][ C2] ? ktime_get+0xb3/0x190 [ 4878.833188][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4878.833193][ C2] run_timer_softirq+0x72/0x100 [ 4878.833196][ C2] __do_softirq+0x1b9/0x7ff [ 4878.833201][ C2] irq_exit_rcu+0x98/0xc0 [ 4878.833204][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4878.833208][ C2] [ 4878.833209][ C2] [ 4878.833210][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4878.833214][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4878.833217][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4878.833220][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4878.833223][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4878.833225][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4878.833226][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4878.833228][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4878.833230][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4878.833233][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4878.833236][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4878.833241][ C2] default_idle_call+0x69/0xa0 [ 4878.833245][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4878.833247][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4878.833252][ C2] ? lock_release+0x1d5/0x250 [ 4878.833254][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4878.833259][ C2] do_idle+0xfb/0x160 [ 4878.833261][ C2] cpu_startup_entry+0x55/0x60 [ 4878.833264][ C2] start_secondary+0x21c/0x2b0 [ 4878.833267][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4878.833271][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4878.833278][ C2] [ 4904.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2376s! [swapper/2:0] [ 4904.569704][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4904.570868][ C2] irq event stamp: 44114564 [ 4904.571079][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4904.571580][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4904.572055][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4904.572497][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4904.572932][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4904.573354][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4904.573923][ C2] RIP: 0010:__kasan_check_read+0x8/0x20 [ 4904.574187][ C2] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 4904.575085][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 4904.575371][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4904.575746][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4904.576118][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4904.576487][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4904.576855][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4904.577227][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4904.577640][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4904.577949][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4904.578321][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4904.578687][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4904.579058][ C2] PKRU: 55555554 [ 4904.579225][ C2] Call Trace: [ 4904.579385][ C2] [ 4904.579524][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4904.579768][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4904.579993][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4904.580253][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4904.580505][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4904.580770][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4904.581017][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4904.581301][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4904.581542][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4904.581784][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4904.582072][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4904.582348][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4904.582642][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4904.582908][ C2] ? __kasan_check_read+0x8/0x20 [ 4904.583142][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4904.583402][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4904.583689][ C2] ? get_stack_info+0x36/0xc0 [ 4904.583915][ C2] ? lock_acquire+0x1c1/0x220 [ 4904.584141][ C2] ? lock_release+0x1d5/0x250 [ 4904.584365][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4904.584594][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4904.584848][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4904.585111][ C2] ? lock_acquire+0x1c1/0x220 [ 4904.585332][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4904.585563][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4904.585804][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4904.586019][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4904.586250][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4904.586490][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4904.586747][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4904.587003][ C2] ip_local_deliver+0x19d/0x480 [ 4904.587234][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4904.587484][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4904.587726][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4904.588049][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4904.588284][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4904.588580][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4904.588825][ C2] ip_rcv+0x564/0x740 [ 4904.589016][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4904.589230][ C2] ? set_track_prepare+0x8a/0xd0 [ 4904.589465][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4904.589721][ C2] ? start_secondary+0x21c/0x2b0 [ 4904.589953][ C2] ? skb_clone+0x10b/0x330 [ 4904.590167][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4904.590463][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4904.590747][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4904.591007][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4904.591281][ C2] ? __tcf_classify+0x329/0x7d0 [ 4904.591511][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4904.591725][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4904.592005][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4904.592268][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4904.592568][ C2] ? lock_acquire+0x1c1/0x220 [ 4904.592789][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4904.593063][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4904.593327][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4904.593619][ C2] ? __copy_skb_header+0xaf/0x490 [ 4904.593859][ C2] ? __skb_clone+0x57a/0x760 [ 4904.594082][ C2] netif_receive_skb+0x55/0x280 [ 4904.594312][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4904.594599][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4904.594907][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4904.595186][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4904.595438][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4904.595712][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4904.595999][ C2] ? get_stack_info+0x36/0xc0 [ 4904.596222][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4904.596466][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4904.596761][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4904.597019][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4904.597274][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4904.597565][ C2] ? kernel_text_address+0x17/0xe0 [ 4904.597805][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4904.598098][ C2] ? arch_stack_walk+0x8c/0x100 [ 4904.598330][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4904.598575][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4904.598838][ C2] ? lock_acquire+0x1c1/0x220 [ 4904.599059][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4904.599320][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4904.599603][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4904.599858][ C2] ? get_stack_info+0x36/0xc0 [ 4904.600081][ C2] __tcf_classify+0x329/0x7d0 [ 4904.600305][ C2] tcf_classify+0x283/0x930 [ 4904.600521][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4904.600758][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4904.601047][ C2] tc_run+0x2e4/0x5d0 [ 4904.601240][ C2] ? __pfx_tc_run+0x10/0x10 [ 4904.601453][ C2] ? lock_acquire+0x1c1/0x220 [ 4904.601674][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4904.601917][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4904.602151][ C2] ? lock_acquire+0x1c1/0x220 [ 4904.602372][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4904.602617][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4904.602899][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4904.603151][ C2] ? neigh_hh_output+0x348/0x590 [ 4904.603385][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4904.603629][ C2] ip_finish_output2+0x786/0x18e0 [ 4904.603867][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4904.604179][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4904.604435][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4904.604668][ C2] ? __ip_finish_output+0x10f/0x770 [ 4904.604914][ C2] ip_output+0x16b/0x4f0 [ 4904.605115][ C2] ? __pfx_ip_output+0x10/0x10 [ 4904.605342][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4904.605627][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4904.605929][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4904.606199][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4904.606449][ C2] ? __alloc_skb+0xd4/0x280 [ 4904.606685][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4904.606935][ C2] ? tcp_fragment+0x168/0x1040 [ 4904.607162][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4904.607396][ C2] ? ip_local_out+0x114/0x3b0 [ 4904.607618][ C2] __ip_queue_xmit+0x672/0x1910 [ 4904.607847][ C2] ? __skb_clone+0x57a/0x760 [ 4904.608065][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4904.608312][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4904.608572][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4904.608798][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4904.609029][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4904.609310][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4904.609606][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4904.609832][ C2] tcp_send_loss_probe+0x348/0x830 [ 4904.610073][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4904.610323][ C2] tcp_write_timer+0x82/0x1d0 [ 4904.610545][ C2] call_timer_fn+0x173/0x430 [ 4904.610789][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4904.611044][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4904.611299][ C2] __run_timers.part.0+0x52d/0x890 [ 4904.611555][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4904.611817][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4904.612097][ C2] ? lock_acquire+0x1c1/0x220 [ 4904.612318][ C2] ? clockevents_program_event+0xf6/0x300 [ 4904.612588][ C2] ? lock_release+0x1d5/0x250 [ 4904.612808][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4904.613050][ C2] ? ktime_get+0xb3/0x190 [ 4904.613258][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4904.613529][ C2] run_timer_softirq+0x72/0x100 [ 4904.613760][ C2] __do_softirq+0x1b9/0x7ff [ 4904.613977][ C2] irq_exit_rcu+0x98/0xc0 [ 4904.614180][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4904.614446][ C2] [ 4904.614585][ C2] [ 4904.614724][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4904.615005][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4904.615244][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4904.616197][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4904.616497][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4904.616881][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4904.617251][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4904.617619][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4904.617987][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4904.618358][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4904.618625][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4904.618866][ C2] default_idle_call+0x69/0xa0 [ 4904.619093][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4904.619326][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4904.619583][ C2] ? lock_release+0x1d5/0x250 [ 4904.619804][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4904.620056][ C2] do_idle+0xfb/0x160 [ 4904.620245][ C2] cpu_startup_entry+0x55/0x60 [ 4904.620470][ C2] start_secondary+0x21c/0x2b0 [ 4904.620696][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4904.620945][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4904.621234][ C2] [ 4904.621379][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2376s! [perl:4135] [ 4904.621808][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4904.623070][ C1] irq event stamp: 209232 [ 4904.623288][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4904.623817][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4904.624298][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4904.624767][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4904.625230][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4904.625683][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4904.626297][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4904.626624][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4904.627597][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4904.627905][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4904.628304][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4904.628706][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4904.629105][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4904.629506][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4904.629906][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4904.630353][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4904.630685][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4904.631086][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4904.631487][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4904.631886][ C1] PKRU: 55555554 [ 4904.632068][ C1] Call Trace: [ 4904.632240][ C1] [ 4904.632388][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4904.632650][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4904.632894][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4904.633171][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4904.633443][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4904.633734][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4904.634001][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4904.634307][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4904.634570][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4904.634882][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4904.635180][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4904.635500][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4904.635791][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4904.636085][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4904.636376][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4904.636688][ C1] ? get_stack_info+0x36/0xc0 [ 4904.636928][ C1] ? lock_acquire+0x1c1/0x220 [ 4904.637169][ C1] ? lock_release+0x1d5/0x250 [ 4904.637408][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4904.637658][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4904.637930][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4904.638216][ C1] ? lock_acquire+0x1c1/0x220 [ 4904.638454][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4904.638697][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4904.638957][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4904.639193][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4904.639441][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4904.639699][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4904.639974][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4904.640250][ C1] ip_local_deliver+0x19d/0x480 [ 4904.640498][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4904.640770][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4904.641034][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4904.641386][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4904.641640][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4904.641960][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4904.642222][ C1] ip_rcv+0x564/0x740 [ 4904.642426][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4904.642657][ C1] ? set_track_prepare+0x8a/0xd0 [ 4904.642912][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4904.643190][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4904.643462][ C1] ? skb_clone+0x10b/0x330 [ 4904.643691][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4904.644009][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4904.644315][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4904.644599][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4904.644892][ C1] ? __tcf_classify+0x329/0x7d0 [ 4904.645142][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4904.645374][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4904.645680][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4904.645967][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4904.646293][ C1] ? lock_acquire+0x1c1/0x220 [ 4904.646532][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4904.646828][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4904.647115][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4904.647432][ C1] ? __copy_skb_header+0xaf/0x490 [ 4904.647689][ C1] ? __skb_clone+0x57a/0x760 [ 4904.647923][ C1] netif_receive_skb+0x55/0x280 [ 4904.648172][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4904.648485][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4904.648817][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4904.649117][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4904.649392][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4904.649679][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4904.649993][ C1] ? hlock_class+0x4e/0x130 [ 4904.650227][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4904.650503][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4904.650779][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4904.651044][ C1] ? hlock_class+0x4e/0x130 [ 4904.651275][ C1] ? mark_lock+0x38/0x3e0 [ 4904.651496][ C1] ? stack_access_ok+0xda/0x1f0 [ 4904.651744][ C1] ? __lock_acquire+0xb67/0x1610 [ 4904.651997][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4904.652276][ C1] ? get_stack_info+0x36/0xc0 [ 4904.652516][ C1] ? stack_access_ok+0xda/0x1f0 [ 4904.652765][ C1] ? get_reg+0x119/0x190 [ 4904.652983][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4904.653251][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4904.653560][ C1] __tcf_classify+0x329/0x7d0 [ 4904.653802][ C1] tcf_classify+0x283/0x930 [ 4904.654036][ C1] ? arch_stack_walk+0xa2/0x100 [ 4904.654284][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4904.654541][ C1] ? get_stack_info+0x36/0xc0 [ 4904.654782][ C1] tc_run+0x2e4/0x5d0 [ 4904.654988][ C1] ? __pfx_tc_run+0x10/0x10 [ 4904.655219][ C1] ? lock_acquire+0x1c1/0x220 [ 4904.655458][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4904.655723][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4904.655976][ C1] ? lock_acquire+0x1c1/0x220 [ 4904.656215][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4904.656480][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4904.656786][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4904.657056][ C1] ? neigh_hh_output+0x348/0x590 [ 4904.657309][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4904.657573][ C1] ip_finish_output2+0x786/0x18e0 [ 4904.657829][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4904.658108][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4904.658451][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4904.658727][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4904.658981][ C1] ? __ip_finish_output+0x10f/0x770 [ 4904.659246][ C1] ip_output+0x16b/0x4f0 [ 4904.659461][ C1] ? run_timer_softirq+0x72/0x100 [ 4904.659719][ C1] ? __pfx_ip_output+0x10/0x10 [ 4904.659962][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4904.660250][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4904.660502][ C1] ? ip_local_out+0x114/0x3b0 [ 4904.660741][ C1] __ip_queue_xmit+0x672/0x1910 [ 4904.660990][ C1] ? __create_object+0x5e/0xb0 [ 4904.661235][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4904.661502][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4904.661784][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4904.662058][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4904.662339][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4904.662612][ C1] tcp_delack_timer+0x84/0x240 [ 4904.662855][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4904.663129][ C1] call_timer_fn+0x173/0x430 [ 4904.663365][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4904.663626][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4904.663887][ C1] __run_timers.part.0+0x52d/0x890 [ 4904.664148][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4904.664424][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4904.664709][ C1] ? lock_acquire+0x1c1/0x220 [ 4904.664948][ C1] ? clockevents_program_event+0xf6/0x300 [ 4904.665238][ C1] ? lock_release+0x1d5/0x250 [ 4904.665478][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4904.665745][ C1] ? ktime_get+0xb3/0x190 [ 4904.665968][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4904.666264][ C1] run_timer_softirq+0x72/0x100 [ 4904.666513][ C1] __do_softirq+0x1b9/0x7ff [ 4904.666746][ C1] irq_exit_rcu+0x98/0xc0 [ 4904.666967][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4904.667254][ C1] [ 4904.667404][ C1] [ 4904.667554][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4904.667860][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4904.668185][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4904.669156][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4904.669465][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4904.669863][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4904.670266][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4904.670666][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4904.671064][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4904.671465][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4904.671763][ C1] pipe_read+0xa16/0xdf0 [ 4904.671982][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4904.672264][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4904.672508][ C1] ? iterate_tty_write+0x299/0x540 [ 4904.672770][ C1] ? lock_release+0x1d5/0x250 [ 4904.673009][ C1] vfs_read+0x911/0xc00 [ 4904.673225][ C1] ? lock_acquire+0x1c1/0x220 [ 4904.673462][ C1] ? __might_fault+0xc6/0x180 [ 4904.673704][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4904.673945][ C1] ? __might_fault+0xc6/0x180 [ 4904.674186][ C1] ? lock_release+0x1d5/0x250 [ 4904.674423][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4904.674689][ C1] ? __fget_light+0x54/0x1e0 [ 4904.674926][ C1] ksys_read+0x17a/0x1e0 [ 4904.675145][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4904.675387][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4904.675714][ C1] do_syscall_64+0xc9/0x1e0 [ 4904.675948][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4904.676248][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4904.676477][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4904.677446][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4904.677868][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4904.678266][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4904.678662][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4904.679059][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4904.679459][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4904.679860][ C1] [ 4932.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2402s! [perl:4135] [ 4932.569719][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4932.570994][ C1] irq event stamp: 209232 [ 4932.571217][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4932.571750][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4932.572231][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4932.572706][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4932.573175][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4932.573628][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4932.574249][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4932.574576][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4932.575565][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4932.575875][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4932.576280][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4932.576682][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4932.577081][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4932.577485][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4932.577891][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4932.578343][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4932.578679][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4932.579083][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4932.579485][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4932.579890][ C1] PKRU: 55555554 [ 4932.580074][ C1] Call Trace: [ 4932.580246][ C1] [ 4932.580399][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4932.580663][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4932.580908][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4932.581189][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4932.581467][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4932.581760][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4932.582028][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4932.582338][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4932.582602][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4932.582912][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4932.583216][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4932.583533][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4932.583824][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4932.584123][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4932.584415][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4932.584728][ C1] ? get_stack_info+0x36/0xc0 [ 4932.584973][ C1] ? lock_acquire+0x1c1/0x220 [ 4932.585218][ C1] ? lock_release+0x1d5/0x250 [ 4932.585466][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4932.585716][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4932.585992][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4932.586280][ C1] ? lock_acquire+0x1c1/0x220 [ 4932.586524][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4932.586769][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4932.587032][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4932.587269][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4932.587519][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4932.587779][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4932.588062][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4932.588344][ C1] ip_local_deliver+0x19d/0x480 [ 4932.588595][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4932.588870][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4932.589136][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4932.589488][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4932.589746][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4932.590069][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4932.590336][ C1] ip_rcv+0x564/0x740 [ 4932.590542][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4932.590775][ C1] ? set_track_prepare+0x8a/0xd0 [ 4932.591031][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4932.591309][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4932.591585][ C1] ? skb_clone+0x10b/0x330 [ 4932.591812][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4932.592135][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4932.592443][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4932.592726][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4932.593028][ C1] ? __tcf_classify+0x329/0x7d0 [ 4932.593280][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4932.593510][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4932.593812][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4932.594098][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4932.594427][ C1] ? lock_acquire+0x1c1/0x220 [ 4932.594667][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4932.594965][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4932.595251][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4932.595576][ C1] ? __copy_skb_header+0xaf/0x490 [ 4932.595835][ C1] ? __skb_clone+0x57a/0x760 [ 4932.596073][ C1] netif_receive_skb+0x55/0x280 [ 4932.596325][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4932.596641][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4932.596976][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4932.597280][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4932.597559][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4932.597852][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4932.598175][ C1] ? hlock_class+0x4e/0x130 [ 4932.598407][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4932.598687][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4932.598964][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4932.599231][ C1] ? hlock_class+0x4e/0x130 [ 4932.599470][ C1] ? mark_lock+0x38/0x3e0 [ 4932.599691][ C1] ? stack_access_ok+0xda/0x1f0 [ 4932.599944][ C1] ? __lock_acquire+0xb67/0x1610 [ 4932.600202][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4932.600481][ C1] ? get_stack_info+0x36/0xc0 [ 4932.600725][ C1] ? stack_access_ok+0xda/0x1f0 [ 4932.600974][ C1] ? get_reg+0x119/0x190 [ 4932.601193][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4932.601464][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4932.601775][ C1] __tcf_classify+0x329/0x7d0 [ 4932.602020][ C1] tcf_classify+0x283/0x930 [ 4932.602256][ C1] ? arch_stack_walk+0xa2/0x100 [ 4932.602507][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4932.602765][ C1] ? get_stack_info+0x36/0xc0 [ 4932.603007][ C1] tc_run+0x2e4/0x5d0 [ 4932.603216][ C1] ? __pfx_tc_run+0x10/0x10 [ 4932.603450][ C1] ? lock_acquire+0x1c1/0x220 [ 4932.603692][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4932.603954][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4932.604213][ C1] ? lock_acquire+0x1c1/0x220 [ 4932.604459][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4932.604726][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4932.605032][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4932.605308][ C1] ? neigh_hh_output+0x348/0x590 [ 4932.605568][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4932.605837][ C1] ip_finish_output2+0x786/0x18e0 [ 4932.606097][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4932.606378][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4932.606716][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4932.606995][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4932.607250][ C1] ? __ip_finish_output+0x10f/0x770 [ 4932.607516][ C1] ip_output+0x16b/0x4f0 [ 4932.607733][ C1] ? run_timer_softirq+0x72/0x100 [ 4932.607992][ C1] ? __pfx_ip_output+0x10/0x10 [ 4932.608239][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4932.608526][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4932.608780][ C1] ? ip_local_out+0x114/0x3b0 [ 4932.609025][ C1] __ip_queue_xmit+0x672/0x1910 [ 4932.609277][ C1] ? __create_object+0x5e/0xb0 [ 4932.609526][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4932.609795][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4932.610078][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4932.610353][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4932.610639][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4932.610913][ C1] tcp_delack_timer+0x84/0x240 [ 4932.611162][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4932.611436][ C1] call_timer_fn+0x173/0x430 [ 4932.611674][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4932.611938][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4932.612205][ C1] __run_timers.part.0+0x52d/0x890 [ 4932.612467][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4932.612743][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4932.613032][ C1] ? lock_acquire+0x1c1/0x220 [ 4932.613272][ C1] ? clockevents_program_event+0xf6/0x300 [ 4932.613566][ C1] ? lock_release+0x1d5/0x250 [ 4932.613808][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4932.614073][ C1] ? ktime_get+0xb3/0x190 [ 4932.614296][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4932.614597][ C1] run_timer_softirq+0x72/0x100 [ 4932.614848][ C1] __do_softirq+0x1b9/0x7ff [ 4932.615082][ C1] irq_exit_rcu+0x98/0xc0 [ 4932.615306][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4932.615602][ C1] [ 4932.615756][ C1] [ 4932.615908][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4932.616217][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4932.616546][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4932.617528][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4932.617840][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4932.618243][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4932.618644][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4932.619046][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4932.619450][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4932.619852][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4932.620155][ C1] pipe_read+0xa16/0xdf0 [ 4932.620377][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4932.620656][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4932.620901][ C1] ? iterate_tty_write+0x299/0x540 [ 4932.621164][ C1] ? lock_release+0x1d5/0x250 [ 4932.621408][ C1] vfs_read+0x911/0xc00 [ 4932.621623][ C1] ? lock_acquire+0x1c1/0x220 [ 4932.621864][ C1] ? __might_fault+0xc6/0x180 [ 4932.622106][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4932.622347][ C1] ? __might_fault+0xc6/0x180 [ 4932.622588][ C1] ? lock_release+0x1d5/0x250 [ 4932.622829][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4932.623096][ C1] ? __fget_light+0x54/0x1e0 [ 4932.623337][ C1] ksys_read+0x17a/0x1e0 [ 4932.623554][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4932.623800][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4932.624107][ C1] do_syscall_64+0xc9/0x1e0 [ 4932.624340][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4932.624643][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4932.624874][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4932.625862][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4932.626287][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4932.626694][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4932.627096][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4932.627500][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4932.627902][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4932.628309][ C1] [ 4932.628470][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2402s! [swapper/2:0] [ 4932.628975][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4932.630259][ C2] irq event stamp: 44114564 [ 4932.630489][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4932.631036][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4932.631556][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4932.632041][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4932.632518][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4932.632988][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4932.633613][ C2] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 4932.633901][ C2] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 4932.634889][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000246 [ 4932.635202][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4932.635618][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4932.636026][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4932.636430][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4932.636832][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4932.637238][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4932.637693][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4932.638032][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4932.638436][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4932.638840][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4932.639246][ C2] PKRU: 55555554 [ 4932.639429][ C2] Call Trace: [ 4932.639605][ C2] [ 4932.639756][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4932.640025][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4932.640273][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4932.640555][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4932.640831][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4932.641122][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4932.641390][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4932.641700][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4932.641963][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4932.642232][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4932.642549][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4932.642850][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4932.643169][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4932.643463][ C2] ? kasan_check_range+0x4/0x1c0 [ 4932.643718][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 4932.644003][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4932.644319][ C2] ? get_stack_info+0x36/0xc0 [ 4932.644566][ C2] ? lock_acquire+0x1c1/0x220 [ 4932.644810][ C2] ? lock_release+0x1d5/0x250 [ 4932.645052][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4932.645304][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4932.645595][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4932.645882][ C2] ? lock_acquire+0x1c1/0x220 [ 4932.646126][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4932.646370][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4932.646635][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4932.646871][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4932.647132][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4932.647392][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4932.647673][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4932.647955][ C2] ip_local_deliver+0x19d/0x480 [ 4932.648206][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4932.648481][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4932.648747][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4932.649096][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4932.649352][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4932.649677][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4932.649945][ C2] ip_rcv+0x564/0x740 [ 4932.650154][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4932.650388][ C2] ? set_track_prepare+0x8a/0xd0 [ 4932.650644][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4932.650922][ C2] ? start_secondary+0x21c/0x2b0 [ 4932.651180][ C2] ? skb_clone+0x10b/0x330 [ 4932.651412][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4932.651734][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4932.652043][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4932.652328][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4932.652627][ C2] ? __tcf_classify+0x329/0x7d0 [ 4932.652880][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4932.653117][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4932.653423][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4932.653710][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4932.654037][ C2] ? lock_acquire+0x1c1/0x220 [ 4932.654281][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4932.654582][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4932.654872][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4932.655193][ C2] ? __copy_skb_header+0xaf/0x490 [ 4932.655471][ C2] ? __skb_clone+0x57a/0x760 [ 4932.655709][ C2] netif_receive_skb+0x55/0x280 [ 4932.655959][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4932.656276][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4932.656612][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4932.656918][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4932.657206][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4932.657506][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4932.657825][ C2] ? get_stack_info+0x36/0xc0 [ 4932.658071][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4932.658340][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4932.658663][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4932.658945][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4932.659226][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4932.659547][ C2] ? kernel_text_address+0x17/0xe0 [ 4932.659811][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4932.660134][ C2] ? arch_stack_walk+0x8c/0x100 [ 4932.660384][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4932.660652][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4932.660940][ C2] ? lock_acquire+0x1c1/0x220 [ 4932.661185][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4932.661470][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4932.661781][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4932.662060][ C2] ? get_stack_info+0x36/0xc0 [ 4932.662314][ C2] __tcf_classify+0x329/0x7d0 [ 4932.662562][ C2] tcf_classify+0x283/0x930 [ 4932.662796][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4932.663055][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4932.663373][ C2] tc_run+0x2e4/0x5d0 [ 4932.663585][ C2] ? __pfx_tc_run+0x10/0x10 [ 4932.663818][ C2] ? lock_acquire+0x1c1/0x220 [ 4932.664061][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4932.664330][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4932.664586][ C2] ? lock_acquire+0x1c1/0x220 [ 4932.664828][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4932.665095][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4932.665420][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4932.665697][ C2] ? neigh_hh_output+0x348/0x590 [ 4932.665952][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4932.666220][ C2] ip_finish_output2+0x786/0x18e0 [ 4932.666480][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4932.666821][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4932.667100][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4932.667359][ C2] ? __ip_finish_output+0x10f/0x770 [ 4932.667629][ C2] ip_output+0x16b/0x4f0 [ 4932.667850][ C2] ? __pfx_ip_output+0x10/0x10 [ 4932.668098][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4932.668379][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4932.668697][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4932.668976][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4932.669233][ C2] ? __alloc_skb+0xd4/0x280 [ 4932.669466][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4932.669740][ C2] ? tcp_fragment+0x168/0x1040 [ 4932.669991][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4932.670245][ C2] ? ip_local_out+0x114/0x3b0 [ 4932.670488][ C2] __ip_queue_xmit+0x672/0x1910 [ 4932.670742][ C2] ? __skb_clone+0x57a/0x760 [ 4932.670981][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4932.671252][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4932.671535][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4932.671784][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4932.672036][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4932.672341][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4932.672666][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4932.672914][ C2] tcp_send_loss_probe+0x348/0x830 [ 4932.673177][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4932.673449][ C2] tcp_write_timer+0x82/0x1d0 [ 4932.673691][ C2] call_timer_fn+0x173/0x430 [ 4932.673930][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4932.674198][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4932.674466][ C2] __run_timers.part.0+0x52d/0x890 [ 4932.674729][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4932.675005][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4932.675297][ C2] ? lock_acquire+0x1c1/0x220 [ 4932.675554][ C2] ? clockevents_program_event+0xf6/0x300 [ 4932.675849][ C2] ? lock_release+0x1d5/0x250 [ 4932.676095][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4932.676362][ C2] ? ktime_get+0xb3/0x190 [ 4932.676590][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4932.676891][ C2] run_timer_softirq+0x72/0x100 [ 4932.677146][ C2] __do_softirq+0x1b9/0x7ff [ 4932.677387][ C2] irq_exit_rcu+0x98/0xc0 [ 4932.677610][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4932.677905][ C2] [ 4932.678056][ C2] [ 4932.678209][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4932.678518][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4932.678778][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4932.679760][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4932.680074][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4932.680476][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4932.680881][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4932.681284][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4932.681687][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4932.682089][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4932.682385][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4932.682652][ C2] default_idle_call+0x69/0xa0 [ 4932.682900][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4932.683155][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4932.683436][ C2] ? lock_release+0x1d5/0x250 [ 4932.683678][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4932.683955][ C2] do_idle+0xfb/0x160 [ 4932.684165][ C2] cpu_startup_entry+0x55/0x60 [ 4932.684413][ C2] start_secondary+0x21c/0x2b0 [ 4932.684662][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4932.684934][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4932.685251][ C2] [ 4956.832104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 4956.832479][ C1] rcu: 1-....: (2595358 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=632741 [ 4956.833040][ C1] rcu: (t=2601945 jiffies g=1882453 q=712 ncpus=4) [ 4956.833375][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4956.833827][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4956.834446][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4956.834778][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4956.835768][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4956.836078][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4956.836482][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4956.836883][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4956.837288][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4956.837690][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4956.838092][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4956.838542][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4956.838876][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4956.839278][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4956.839681][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4956.840083][ C1] PKRU: 55555554 [ 4956.840266][ C1] Call Trace: [ 4956.840436][ C1] [ 4956.840586][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 4956.840860][ C1] ? print_cpu_stall+0x263/0x6a0 [ 4956.841114][ C1] ? check_cpu_stall+0x284/0x500 [ 4956.841368][ C1] ? rcu_pending+0x92/0x360 [ 4956.841598][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 4956.841869][ C1] ? update_process_times+0xb9/0x110 [ 4956.842141][ C1] ? tick_sched_handle+0x67/0x130 [ 4956.842400][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 4956.842685][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4956.842929][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 4956.843244][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4956.843517][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4956.843807][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4956.844074][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4956.844381][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4956.844644][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4956.844954][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4956.845253][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4956.845582][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4956.845871][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4956.846170][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4956.846464][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4956.846778][ C1] ? get_stack_info+0x36/0xc0 [ 4956.847020][ C1] ? lock_acquire+0x1c1/0x220 [ 4956.847263][ C1] ? lock_release+0x1d5/0x250 [ 4956.847504][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4956.847754][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4956.848033][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4956.848318][ C1] ? lock_acquire+0x1c1/0x220 [ 4956.848559][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4956.848802][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4956.849068][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4956.849303][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4956.849551][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4956.849810][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4956.850087][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4956.850366][ C1] ip_local_deliver+0x19d/0x480 [ 4956.850615][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4956.850888][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4956.851153][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4956.851501][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4956.851755][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4956.852077][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4956.852342][ C1] ip_rcv+0x564/0x740 [ 4956.852549][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4956.852782][ C1] ? set_track_prepare+0x8a/0xd0 [ 4956.853037][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4956.853314][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4956.853591][ C1] ? skb_clone+0x10b/0x330 [ 4956.853819][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4956.854142][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4956.854451][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4956.854734][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4956.855033][ C1] ? __tcf_classify+0x329/0x7d0 [ 4956.855287][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4956.855518][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4956.855821][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4956.856108][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4956.856436][ C1] ? lock_acquire+0x1c1/0x220 [ 4956.856677][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4956.856975][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4956.857262][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4956.857581][ C1] ? __copy_skb_header+0xaf/0x490 [ 4956.857839][ C1] ? __skb_clone+0x57a/0x760 [ 4956.858077][ C1] netif_receive_skb+0x55/0x280 [ 4956.858328][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4956.858646][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4956.858982][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4956.859281][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4956.859559][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4956.859851][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4956.860166][ C1] ? hlock_class+0x4e/0x130 [ 4956.860399][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4956.860678][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4956.860956][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4956.861221][ C1] ? hlock_class+0x4e/0x130 [ 4956.861455][ C1] ? mark_lock+0x38/0x3e0 [ 4956.861675][ C1] ? stack_access_ok+0xda/0x1f0 [ 4956.861925][ C1] ? __lock_acquire+0xb67/0x1610 [ 4956.862180][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4956.862456][ C1] ? get_stack_info+0x36/0xc0 [ 4956.862699][ C1] ? stack_access_ok+0xda/0x1f0 [ 4956.862948][ C1] ? get_reg+0x119/0x190 [ 4956.863165][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4956.863437][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4956.863746][ C1] __tcf_classify+0x329/0x7d0 [ 4956.863991][ C1] tcf_classify+0x283/0x930 [ 4956.864226][ C1] ? arch_stack_walk+0xa2/0x100 [ 4956.864477][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4956.864736][ C1] ? get_stack_info+0x36/0xc0 [ 4956.864976][ C1] tc_run+0x2e4/0x5d0 [ 4956.865184][ C1] ? __pfx_tc_run+0x10/0x10 [ 4956.865420][ C1] ? lock_acquire+0x1c1/0x220 [ 4956.865661][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4956.865923][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4956.866179][ C1] ? lock_acquire+0x1c1/0x220 [ 4956.866420][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4956.866689][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4956.866996][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4956.867271][ C1] ? neigh_hh_output+0x348/0x590 [ 4956.867526][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4956.867792][ C1] ip_finish_output2+0x786/0x18e0 [ 4956.868050][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4956.868329][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4956.868668][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4956.868948][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4956.869202][ C1] ? __ip_finish_output+0x10f/0x770 [ 4956.869469][ C1] ip_output+0x16b/0x4f0 [ 4956.869686][ C1] ? run_timer_softirq+0x72/0x100 [ 4956.869943][ C1] ? __pfx_ip_output+0x10/0x10 [ 4956.870189][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4956.870476][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4956.870729][ C1] ? ip_local_out+0x114/0x3b0 [ 4956.870971][ C1] __ip_queue_xmit+0x672/0x1910 [ 4956.871226][ C1] ? __create_object+0x5e/0xb0 [ 4956.871473][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4956.871741][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4956.872024][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4956.872299][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4956.872584][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4956.872857][ C1] tcp_delack_timer+0x84/0x240 [ 4956.873103][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4956.873376][ C1] call_timer_fn+0x173/0x430 [ 4956.873614][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4956.873878][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4956.874141][ C1] __run_timers.part.0+0x52d/0x890 [ 4956.874403][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4956.874677][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4956.874965][ C1] ? lock_acquire+0x1c1/0x220 [ 4956.875204][ C1] ? clockevents_program_event+0xf6/0x300 [ 4956.875501][ C1] ? lock_release+0x1d5/0x250 [ 4956.875743][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4956.876009][ C1] ? ktime_get+0xb3/0x190 [ 4956.876231][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4956.876531][ C1] run_timer_softirq+0x72/0x100 [ 4956.876781][ C1] __do_softirq+0x1b9/0x7ff [ 4956.877015][ C1] irq_exit_rcu+0x98/0xc0 [ 4956.877238][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4956.877525][ C1] [ 4956.877678][ C1] [ 4956.877829][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4956.878138][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4956.878465][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4956.879444][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4956.879755][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4956.880157][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4956.880557][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4956.880959][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4956.881360][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4956.881763][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4956.882062][ C1] pipe_read+0xa16/0xdf0 [ 4956.882283][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4956.882562][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4956.882806][ C1] ? iterate_tty_write+0x299/0x540 [ 4956.883069][ C1] ? lock_release+0x1d5/0x250 [ 4956.883312][ C1] vfs_read+0x911/0xc00 [ 4956.883525][ C1] ? lock_acquire+0x1c1/0x220 [ 4956.883766][ C1] ? __might_fault+0xc6/0x180 [ 4956.884009][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4956.884250][ C1] ? __might_fault+0xc6/0x180 [ 4956.884490][ C1] ? lock_release+0x1d5/0x250 [ 4956.884730][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4956.884996][ C1] ? __fget_light+0x54/0x1e0 [ 4956.885235][ C1] ksys_read+0x17a/0x1e0 [ 4956.885458][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4956.885705][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4956.886012][ C1] do_syscall_64+0xc9/0x1e0 [ 4956.886244][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4956.886546][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4956.886776][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4956.887752][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4956.888175][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4956.888578][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4956.888979][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4956.889380][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4956.889779][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4956.890186][ C1] [ 4956.890344][ C1] Sending NMI from CPU 1 to CPUs 2: [ 4956.890622][ C2] NMI backtrace for cpu 2 [ 4956.890632][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4956.890639][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4956.890644][ C2] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 4956.890655][ C2] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 ca 35 0c fe 89 d8 [ 4956.890658][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000246 [ 4956.890662][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4956.890664][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4956.890666][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4956.890668][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4956.890670][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4956.890671][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4956.890674][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4956.890677][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4956.890679][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4956.890680][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4956.890682][ C2] PKRU: 55555554 [ 4956.890683][ C2] Call Trace: [ 4956.890686][ C2] [ 4956.890691][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 4956.890700][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 4956.890707][ C2] ? nmi_handle+0x153/0x420 [ 4956.890712][ C2] ? default_do_nmi+0x41/0x100 [ 4956.890716][ C2] ? exc_nmi+0xf3/0x120 [ 4956.890718][ C2] ? end_repeat_nmi+0xf/0x60 [ 4956.890725][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4956.890728][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 4956.890731][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 4956.890734][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 4956.890737][ C2] [ 4956.890738][ C2] [ 4956.890740][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4956.890742][ C2] ? get_stack_info+0x36/0xc0 [ 4956.890747][ C2] ? lock_acquire+0x1c1/0x220 [ 4956.890752][ C2] ? lock_release+0x1d5/0x250 [ 4956.890755][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4956.890760][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4956.890763][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4956.890766][ C2] ? lock_acquire+0x1c1/0x220 [ 4956.890768][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4956.890773][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4956.890777][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4956.890783][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4956.890786][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4956.890792][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4956.890799][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4956.890803][ C2] ip_local_deliver+0x19d/0x480 [ 4956.890806][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4956.890808][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4956.890810][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4956.890817][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4956.890822][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4956.890825][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4956.890835][ C2] ip_rcv+0x564/0x740 [ 4956.890838][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4956.890841][ C2] ? set_track_prepare+0x8a/0xd0 [ 4956.890846][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4956.890849][ C2] ? start_secondary+0x21c/0x2b0 [ 4956.890854][ C2] ? skb_clone+0x10b/0x330 [ 4956.890858][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4956.890865][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4956.890870][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4956.890876][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4956.890885][ C2] ? __tcf_classify+0x329/0x7d0 [ 4956.890888][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4956.890891][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4956.890895][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4956.890898][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4956.890903][ C2] ? lock_acquire+0x1c1/0x220 [ 4956.890905][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4956.890909][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4956.890913][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4956.890917][ C2] ? __copy_skb_header+0xaf/0x490 [ 4956.890922][ C2] ? __skb_clone+0x57a/0x760 [ 4956.890925][ C2] netif_receive_skb+0x55/0x280 [ 4956.890928][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4956.890937][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4956.890943][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4956.890949][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4956.890954][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4956.890964][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4956.890971][ C2] ? get_stack_info+0x36/0xc0 [ 4956.890976][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4956.890979][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4956.890985][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4956.890987][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4956.890991][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4956.890993][ C2] ? kernel_text_address+0x17/0xe0 [ 4956.890997][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4956.891003][ C2] ? arch_stack_walk+0x8c/0x100 [ 4956.891008][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4956.891011][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4956.891014][ C2] ? lock_acquire+0x1c1/0x220 [ 4956.891017][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4956.891022][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4956.891028][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4956.891030][ C2] ? get_stack_info+0x36/0xc0 [ 4956.891034][ C2] __tcf_classify+0x329/0x7d0 [ 4956.891040][ C2] tcf_classify+0x283/0x930 [ 4956.891045][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4956.891048][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4956.891052][ C2] tc_run+0x2e4/0x5d0 [ 4956.891057][ C2] ? __pfx_tc_run+0x10/0x10 [ 4956.891060][ C2] ? lock_acquire+0x1c1/0x220 [ 4956.891063][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4956.891067][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4956.891071][ C2] ? lock_acquire+0x1c1/0x220 [ 4956.891073][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4956.891077][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4956.891080][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4956.891083][ C2] ? neigh_hh_output+0x348/0x590 [ 4956.891086][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4956.891090][ C2] ip_finish_output2+0x786/0x18e0 [ 4956.891093][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4956.891101][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4956.891103][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4956.891107][ C2] ? __ip_finish_output+0x10f/0x770 [ 4956.891110][ C2] ip_output+0x16b/0x4f0 [ 4956.891113][ C2] ? __pfx_ip_output+0x10/0x10 [ 4956.891116][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4956.891119][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4956.891122][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4956.891126][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4956.891128][ C2] ? __alloc_skb+0xd4/0x280 [ 4956.891131][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4956.891136][ C2] ? tcp_fragment+0x168/0x1040 [ 4956.891140][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4956.891144][ C2] ? ip_local_out+0x114/0x3b0 [ 4956.891147][ C2] __ip_queue_xmit+0x672/0x1910 [ 4956.891151][ C2] ? __skb_clone+0x57a/0x760 [ 4956.891154][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4956.891160][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4956.891163][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4956.891168][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4956.891174][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4956.891179][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4956.891182][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4956.891185][ C2] tcp_send_loss_probe+0x348/0x830 [ 4956.891189][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4956.891192][ C2] tcp_write_timer+0x82/0x1d0 [ 4956.891195][ C2] call_timer_fn+0x173/0x430 [ 4956.891200][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4956.891205][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4956.891209][ C2] __run_timers.part.0+0x52d/0x890 [ 4956.891212][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4956.891216][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4956.891219][ C2] ? lock_acquire+0x1c1/0x220 [ 4956.891221][ C2] ? clockevents_program_event+0xf6/0x300 [ 4956.891227][ C2] ? lock_release+0x1d5/0x250 [ 4956.891229][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4956.891233][ C2] ? ktime_get+0xb3/0x190 [ 4956.891238][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4956.891242][ C2] run_timer_softirq+0x72/0x100 [ 4956.891245][ C2] __do_softirq+0x1b9/0x7ff [ 4956.891249][ C2] irq_exit_rcu+0x98/0xc0 [ 4956.891252][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4956.891256][ C2] [ 4956.891257][ C2] [ 4956.891258][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4956.891261][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4956.891265][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4956.891267][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4956.891270][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4956.891271][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4956.891273][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4956.891275][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4956.891277][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4956.891280][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4956.891283][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4956.891288][ C2] default_idle_call+0x69/0xa0 [ 4956.891291][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4956.891294][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4956.891298][ C2] ? lock_release+0x1d5/0x250 [ 4956.891300][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4956.891305][ C2] do_idle+0xfb/0x160 [ 4956.891307][ C2] cpu_startup_entry+0x55/0x60 [ 4956.891310][ C2] start_secondary+0x21c/0x2b0 [ 4956.891313][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4956.891317][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4956.891322][ C2] [ 4984.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2451s! [perl:4135] [ 4984.569733][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4984.571020][ C1] irq event stamp: 209232 [ 4984.571243][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4984.571780][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 4984.572264][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 4984.572736][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 4984.573208][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 4984.573659][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4984.574277][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4984.574605][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4984.575594][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 4984.575905][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4984.576309][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 4984.576716][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 4984.577119][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 4984.577522][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 4984.577924][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 4984.578378][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4984.578720][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 4984.579127][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4984.579529][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4984.579931][ C1] PKRU: 55555554 [ 4984.580114][ C1] Call Trace: [ 4984.580289][ C1] [ 4984.580438][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4984.580704][ C1] ? __run_hrtimer+0x1c0/0x710 [ 4984.580952][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4984.581234][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 4984.581512][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4984.581801][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4984.582067][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4984.582380][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 4984.582643][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4984.582954][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4984.583254][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4984.583571][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4984.583863][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4984.584162][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4984.584454][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4984.584768][ C1] ? get_stack_info+0x36/0xc0 [ 4984.585013][ C1] ? lock_acquire+0x1c1/0x220 [ 4984.585260][ C1] ? lock_release+0x1d5/0x250 [ 4984.585502][ C1] do_raw_spin_lock+0x1ec/0x270 [ 4984.585753][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4984.586027][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4984.586318][ C1] ? lock_acquire+0x1c1/0x220 [ 4984.586560][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4984.586803][ C1] _raw_spin_lock_nested+0x65/0x80 [ 4984.587064][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 4984.587304][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4984.587554][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 4984.587815][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 4984.588093][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 4984.588373][ C1] ip_local_deliver+0x19d/0x480 [ 4984.588623][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 4984.588897][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4984.589166][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4984.589516][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4984.589773][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4984.590094][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4984.590360][ C1] ip_rcv+0x564/0x740 [ 4984.590565][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4984.590802][ C1] ? set_track_prepare+0x8a/0xd0 [ 4984.591057][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 4984.591337][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 4984.591610][ C1] ? skb_clone+0x10b/0x330 [ 4984.591839][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4984.592161][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4984.592469][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4984.592754][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4984.593051][ C1] ? __tcf_classify+0x329/0x7d0 [ 4984.593303][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 4984.593537][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 4984.593839][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4984.594128][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4984.594458][ C1] ? lock_acquire+0x1c1/0x220 [ 4984.594699][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 4984.594996][ C1] netif_receive_skb_internal+0xb0/0x300 [ 4984.595293][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4984.595612][ C1] ? __copy_skb_header+0xaf/0x490 [ 4984.595871][ C1] ? __skb_clone+0x57a/0x760 [ 4984.596108][ C1] netif_receive_skb+0x55/0x280 [ 4984.596357][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4984.596672][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4984.597006][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4984.597310][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 4984.597586][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 4984.597878][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4984.598198][ C1] ? hlock_class+0x4e/0x130 [ 4984.598434][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4984.598710][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4984.598990][ C1] ? __pfx_validate_chain+0x10/0x10 [ 4984.599257][ C1] ? hlock_class+0x4e/0x130 [ 4984.599487][ C1] ? mark_lock+0x38/0x3e0 [ 4984.599710][ C1] ? stack_access_ok+0xda/0x1f0 [ 4984.599960][ C1] ? __lock_acquire+0xb67/0x1610 [ 4984.600216][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 4984.600494][ C1] ? get_stack_info+0x36/0xc0 [ 4984.600737][ C1] ? stack_access_ok+0xda/0x1f0 [ 4984.600984][ C1] ? get_reg+0x119/0x190 [ 4984.601204][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 4984.601475][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4984.601785][ C1] __tcf_classify+0x329/0x7d0 [ 4984.602032][ C1] tcf_classify+0x283/0x930 [ 4984.602266][ C1] ? arch_stack_walk+0xa2/0x100 [ 4984.602516][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 4984.602775][ C1] ? get_stack_info+0x36/0xc0 [ 4984.603016][ C1] tc_run+0x2e4/0x5d0 [ 4984.603223][ C1] ? __pfx_tc_run+0x10/0x10 [ 4984.603455][ C1] ? lock_acquire+0x1c1/0x220 [ 4984.603693][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 4984.603956][ C1] __dev_queue_xmit+0x686/0x17e0 [ 4984.604211][ C1] ? lock_acquire+0x1c1/0x220 [ 4984.604449][ C1] ? ip_finish_output2+0x786/0x18e0 [ 4984.604713][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4984.605022][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4984.605302][ C1] ? neigh_hh_output+0x348/0x590 [ 4984.605556][ C1] ? ip_finish_output2+0x262/0x18e0 [ 4984.605822][ C1] ip_finish_output2+0x786/0x18e0 [ 4984.606080][ C1] ? stack_depot_save_flags+0x45/0x550 [ 4984.606364][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4984.606704][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 4984.606984][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4984.607240][ C1] ? __ip_finish_output+0x10f/0x770 [ 4984.607508][ C1] ip_output+0x16b/0x4f0 [ 4984.607727][ C1] ? run_timer_softirq+0x72/0x100 [ 4984.607986][ C1] ? __pfx_ip_output+0x10/0x10 [ 4984.608230][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4984.608525][ C1] ? rcu_read_lock_held+0xe/0x50 [ 4984.608778][ C1] ? ip_local_out+0x114/0x3b0 [ 4984.609019][ C1] __ip_queue_xmit+0x672/0x1910 [ 4984.609272][ C1] ? __create_object+0x5e/0xb0 [ 4984.609517][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 4984.609785][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4984.610070][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 4984.610344][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 4984.610626][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4984.610900][ C1] tcp_delack_timer+0x84/0x240 [ 4984.611145][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4984.611420][ C1] call_timer_fn+0x173/0x430 [ 4984.611654][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 4984.611916][ C1] ? next_expiry_recalc+0xcd/0x220 [ 4984.612180][ C1] __run_timers.part.0+0x52d/0x890 [ 4984.612441][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 4984.612716][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 4984.613002][ C1] ? lock_acquire+0x1c1/0x220 [ 4984.613244][ C1] ? clockevents_program_event+0xf6/0x300 [ 4984.613536][ C1] ? lock_release+0x1d5/0x250 [ 4984.613776][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4984.614040][ C1] ? ktime_get+0xb3/0x190 [ 4984.614265][ C1] ? clockevents_program_event+0x1ea/0x300 [ 4984.614561][ C1] run_timer_softirq+0x72/0x100 [ 4984.614811][ C1] __do_softirq+0x1b9/0x7ff [ 4984.615046][ C1] irq_exit_rcu+0x98/0xc0 [ 4984.615273][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 4984.615563][ C1] [ 4984.615713][ C1] [ 4984.615865][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4984.616171][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 4984.616496][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 4984.617472][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 4984.617783][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 4984.618186][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 4984.618589][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 4984.618990][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 4984.619393][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 4984.619796][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 4984.620094][ C1] pipe_read+0xa16/0xdf0 [ 4984.620318][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 4984.620599][ C1] ? __pfx_pipe_read+0x10/0x10 [ 4984.620845][ C1] ? iterate_tty_write+0x299/0x540 [ 4984.621109][ C1] ? lock_release+0x1d5/0x250 [ 4984.621351][ C1] vfs_read+0x911/0xc00 [ 4984.621568][ C1] ? lock_acquire+0x1c1/0x220 [ 4984.621807][ C1] ? __might_fault+0xc6/0x180 [ 4984.622051][ C1] ? __pfx_vfs_read+0x10/0x10 [ 4984.622293][ C1] ? __might_fault+0xc6/0x180 [ 4984.622537][ C1] ? lock_release+0x1d5/0x250 [ 4984.622778][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 4984.623046][ C1] ? __fget_light+0x54/0x1e0 [ 4984.623283][ C1] ksys_read+0x17a/0x1e0 [ 4984.623504][ C1] ? __pfx_ksys_read+0x10/0x10 [ 4984.623749][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4984.624055][ C1] do_syscall_64+0xc9/0x1e0 [ 4984.624291][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 4984.624592][ C1] RIP: 0033:0x7f08a1ea38b2 [ 4984.624819][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 4984.625802][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 4984.626229][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 4984.626630][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 4984.627029][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 4984.627432][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 4984.627832][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 4984.628237][ C1] [ 4984.628398][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2451s! [swapper/2:0] [ 4984.628877][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 4984.630158][ C2] irq event stamp: 44114564 [ 4984.630388][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 4984.630935][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 4984.631451][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 4984.631936][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 4984.632412][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 4984.632874][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 4984.633492][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 4984.633822][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 4984.634805][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 4984.635117][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 4984.635526][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 4984.635927][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 4984.636333][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 4984.636734][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 4984.637137][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 4984.637586][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 4984.637922][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 4984.638328][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4984.638729][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 4984.639130][ C2] PKRU: 55555554 [ 4984.639314][ C2] Call Trace: [ 4984.639488][ C2] [ 4984.639639][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 4984.639906][ C2] ? __run_hrtimer+0x1c0/0x710 [ 4984.640153][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 4984.640431][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 4984.640707][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 4984.641000][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4984.641269][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 4984.641582][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 4984.641845][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 4984.642111][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 4984.642424][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 4984.642728][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4984.643046][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4984.643341][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 4984.643638][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 4984.643930][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 4984.644247][ C2] ? get_stack_info+0x36/0xc0 [ 4984.644491][ C2] ? lock_acquire+0x1c1/0x220 [ 4984.644731][ C2] ? lock_release+0x1d5/0x250 [ 4984.644973][ C2] do_raw_spin_lock+0x1ec/0x270 [ 4984.645235][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 4984.645509][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4984.645798][ C2] ? lock_acquire+0x1c1/0x220 [ 4984.646038][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 4984.646282][ C2] _raw_spin_lock_nested+0x65/0x80 [ 4984.646545][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 4984.646784][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 4984.647034][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 4984.647296][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 4984.647577][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 4984.647859][ C2] ip_local_deliver+0x19d/0x480 [ 4984.648114][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 4984.648391][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 4984.648659][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 4984.649012][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4984.649269][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 4984.649593][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 4984.649860][ C2] ip_rcv+0x564/0x740 [ 4984.650069][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4984.650303][ C2] ? set_track_prepare+0x8a/0xd0 [ 4984.650559][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4984.650840][ C2] ? start_secondary+0x21c/0x2b0 [ 4984.651096][ C2] ? skb_clone+0x10b/0x330 [ 4984.651332][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 4984.651654][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 4984.651963][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 4984.652249][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 4984.652549][ C2] ? __tcf_classify+0x329/0x7d0 [ 4984.652802][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 4984.653036][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 4984.653343][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4984.653632][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 4984.653962][ C2] ? lock_acquire+0x1c1/0x220 [ 4984.654202][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 4984.654503][ C2] netif_receive_skb_internal+0xb0/0x300 [ 4984.654791][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 4984.655112][ C2] ? __copy_skb_header+0xaf/0x490 [ 4984.655381][ C2] ? __skb_clone+0x57a/0x760 [ 4984.655618][ C2] netif_receive_skb+0x55/0x280 [ 4984.655870][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 4984.656187][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 4984.656522][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 4984.656823][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 4984.657101][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 4984.657393][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 4984.657707][ C2] ? get_stack_info+0x36/0xc0 [ 4984.657953][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 4984.658222][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4984.658543][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4984.658822][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 4984.659102][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 4984.659421][ C2] ? kernel_text_address+0x17/0xe0 [ 4984.659683][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4984.660001][ C2] ? arch_stack_walk+0x8c/0x100 [ 4984.660255][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 4984.660523][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 4984.660813][ C2] ? lock_acquire+0x1c1/0x220 [ 4984.661054][ C2] ? stack_depot_save_flags+0x281/0x550 [ 4984.661348][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4984.661658][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 4984.661939][ C2] ? get_stack_info+0x36/0xc0 [ 4984.662184][ C2] __tcf_classify+0x329/0x7d0 [ 4984.662429][ C2] tcf_classify+0x283/0x930 [ 4984.662664][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 4984.662924][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 4984.663241][ C2] tc_run+0x2e4/0x5d0 [ 4984.663448][ C2] ? __pfx_tc_run+0x10/0x10 [ 4984.663682][ C2] ? lock_acquire+0x1c1/0x220 [ 4984.663921][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 4984.664186][ C2] __dev_queue_xmit+0x686/0x17e0 [ 4984.664442][ C2] ? lock_acquire+0x1c1/0x220 [ 4984.664684][ C2] ? ip_finish_output2+0x786/0x18e0 [ 4984.664953][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 4984.665270][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 4984.665544][ C2] ? neigh_hh_output+0x348/0x590 [ 4984.665800][ C2] ? ip_finish_output2+0x262/0x18e0 [ 4984.666065][ C2] ip_finish_output2+0x786/0x18e0 [ 4984.666327][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 4984.666668][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 4984.666949][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4984.667209][ C2] ? __ip_finish_output+0x10f/0x770 [ 4984.667478][ C2] ip_output+0x16b/0x4f0 [ 4984.667699][ C2] ? __pfx_ip_output+0x10/0x10 [ 4984.667947][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 4984.668232][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4984.668552][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 4984.668832][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 4984.669089][ C2] ? __alloc_skb+0xd4/0x280 [ 4984.669324][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 4984.669597][ C2] ? tcp_fragment+0x168/0x1040 [ 4984.669847][ C2] ? rcu_read_lock_held+0xe/0x50 [ 4984.670102][ C2] ? ip_local_out+0x114/0x3b0 [ 4984.670350][ C2] __ip_queue_xmit+0x672/0x1910 [ 4984.670601][ C2] ? __skb_clone+0x57a/0x760 [ 4984.670840][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 4984.671110][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 4984.671394][ C2] ? ipv4_dst_check+0xe3/0x170 [ 4984.671640][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 4984.671891][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 4984.672199][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 4984.672523][ C2] ? tcp_fragment+0xb0e/0x1040 [ 4984.672772][ C2] tcp_send_loss_probe+0x348/0x830 [ 4984.673036][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4984.673307][ C2] tcp_write_timer+0x82/0x1d0 [ 4984.673549][ C2] call_timer_fn+0x173/0x430 [ 4984.673789][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 4984.674054][ C2] ? next_expiry_recalc+0xcd/0x220 [ 4984.674319][ C2] __run_timers.part.0+0x52d/0x890 [ 4984.674582][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 4984.674855][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 4984.675158][ C2] ? lock_acquire+0x1c1/0x220 [ 4984.675402][ C2] ? clockevents_program_event+0xf6/0x300 [ 4984.675698][ C2] ? lock_release+0x1d5/0x250 [ 4984.675939][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 4984.676210][ C2] ? ktime_get+0xb3/0x190 [ 4984.676435][ C2] ? clockevents_program_event+0x1ea/0x300 [ 4984.676734][ C2] run_timer_softirq+0x72/0x100 [ 4984.676985][ C2] __do_softirq+0x1b9/0x7ff [ 4984.677224][ C2] irq_exit_rcu+0x98/0xc0 [ 4984.677446][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 4984.677739][ C2] [ 4984.677891][ C2] [ 4984.678045][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 4984.678353][ C2] RIP: 0010:default_idle+0xf/0x20 [ 4984.678613][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 4984.679600][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 4984.679917][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 4984.680327][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 4984.680734][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 4984.681139][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 4984.681541][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 4984.681951][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 4984.682247][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 4984.682512][ C2] default_idle_call+0x69/0xa0 [ 4984.682759][ C2] cpuidle_idle_call+0x1f6/0x280 [ 4984.683013][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 4984.683292][ C2] ? lock_release+0x1d5/0x250 [ 4984.683533][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 4984.683810][ C2] do_idle+0xfb/0x160 [ 4984.684014][ C2] cpu_startup_entry+0x55/0x60 [ 4984.684260][ C2] start_secondary+0x21c/0x2b0 [ 4984.684506][ C2] ? __pfx_start_secondary+0x10/0x10 [ 4984.684777][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 4984.685093][ C2] [ 5012.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2477s! [perl:4135] [ 5012.569721][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5012.570989][ C1] irq event stamp: 209232 [ 5012.571211][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5012.571743][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5012.572220][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5012.572696][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5012.573160][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5012.573609][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5012.574223][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5012.574549][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5012.575526][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5012.575835][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5012.576238][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5012.576640][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5012.577039][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5012.577440][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5012.577841][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5012.578291][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5012.578632][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5012.579035][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5012.579436][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5012.579838][ C1] PKRU: 55555554 [ 5012.580020][ C1] Call Trace: [ 5012.580190][ C1] [ 5012.580341][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5012.580605][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5012.580850][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5012.581128][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5012.581408][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5012.581698][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5012.581967][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5012.582274][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5012.582537][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5012.582846][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5012.583145][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5012.583462][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5012.583751][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5012.584051][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5012.584342][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5012.584654][ C1] ? get_stack_info+0x36/0xc0 [ 5012.584897][ C1] ? lock_acquire+0x1c1/0x220 [ 5012.585144][ C1] ? lock_release+0x1d5/0x250 [ 5012.585386][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5012.585635][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5012.585910][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5012.586196][ C1] ? lock_acquire+0x1c1/0x220 [ 5012.586437][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5012.586679][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5012.586940][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5012.587175][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5012.587424][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5012.587683][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5012.587963][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5012.588243][ C1] ip_local_deliver+0x19d/0x480 [ 5012.588491][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5012.588765][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5012.589030][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5012.589378][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5012.589633][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5012.589954][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5012.590219][ C1] ip_rcv+0x564/0x740 [ 5012.590425][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5012.590657][ C1] ? set_track_prepare+0x8a/0xd0 [ 5012.590911][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5012.591188][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5012.591465][ C1] ? skb_clone+0x10b/0x330 [ 5012.591692][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5012.592013][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5012.592322][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5012.592605][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5012.592903][ C1] ? __tcf_classify+0x329/0x7d0 [ 5012.593155][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5012.593386][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5012.593690][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5012.593977][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5012.594305][ C1] ? lock_acquire+0x1c1/0x220 [ 5012.594545][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5012.594845][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5012.595137][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5012.595457][ C1] ? __copy_skb_header+0xaf/0x490 [ 5012.595716][ C1] ? __skb_clone+0x57a/0x760 [ 5012.595953][ C1] netif_receive_skb+0x55/0x280 [ 5012.596204][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5012.596521][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5012.596859][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5012.597159][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5012.597437][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5012.597729][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5012.598043][ C1] ? hlock_class+0x4e/0x130 [ 5012.598276][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5012.598558][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5012.598835][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5012.599101][ C1] ? hlock_class+0x4e/0x130 [ 5012.599335][ C1] ? mark_lock+0x38/0x3e0 [ 5012.599556][ C1] ? stack_access_ok+0xda/0x1f0 [ 5012.599809][ C1] ? __lock_acquire+0xb67/0x1610 [ 5012.600066][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5012.600344][ C1] ? get_stack_info+0x36/0xc0 [ 5012.600588][ C1] ? stack_access_ok+0xda/0x1f0 [ 5012.600836][ C1] ? get_reg+0x119/0x190 [ 5012.601053][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5012.601324][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5012.601634][ C1] __tcf_classify+0x329/0x7d0 [ 5012.601878][ C1] tcf_classify+0x283/0x930 [ 5012.602112][ C1] ? arch_stack_walk+0xa2/0x100 [ 5012.602363][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5012.602622][ C1] ? get_stack_info+0x36/0xc0 [ 5012.602862][ C1] tc_run+0x2e4/0x5d0 [ 5012.603070][ C1] ? __pfx_tc_run+0x10/0x10 [ 5012.603307][ C1] ? lock_acquire+0x1c1/0x220 [ 5012.603549][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5012.603811][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5012.604066][ C1] ? lock_acquire+0x1c1/0x220 [ 5012.604307][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5012.604574][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5012.604880][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5012.605160][ C1] ? neigh_hh_output+0x348/0x590 [ 5012.605416][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5012.605683][ C1] ip_finish_output2+0x786/0x18e0 [ 5012.605941][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5012.606222][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5012.606561][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5012.606842][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5012.607099][ C1] ? __ip_finish_output+0x10f/0x770 [ 5012.607366][ C1] ip_output+0x16b/0x4f0 [ 5012.607584][ C1] ? run_timer_softirq+0x72/0x100 [ 5012.607844][ C1] ? __pfx_ip_output+0x10/0x10 [ 5012.608090][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5012.608377][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5012.608630][ C1] ? ip_local_out+0x114/0x3b0 [ 5012.608874][ C1] __ip_queue_xmit+0x672/0x1910 [ 5012.609125][ C1] ? __create_object+0x5e/0xb0 [ 5012.609371][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5012.609641][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5012.609926][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5012.610201][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5012.610486][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5012.610760][ C1] tcp_delack_timer+0x84/0x240 [ 5012.611007][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5012.611280][ C1] call_timer_fn+0x173/0x430 [ 5012.611519][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5012.611783][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5012.612047][ C1] __run_timers.part.0+0x52d/0x890 [ 5012.612310][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5012.612585][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5012.612876][ C1] ? lock_acquire+0x1c1/0x220 [ 5012.613116][ C1] ? clockevents_program_event+0xf6/0x300 [ 5012.613412][ C1] ? lock_release+0x1d5/0x250 [ 5012.613654][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5012.613921][ C1] ? ktime_get+0xb3/0x190 [ 5012.614144][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5012.614445][ C1] run_timer_softirq+0x72/0x100 [ 5012.614696][ C1] __do_softirq+0x1b9/0x7ff [ 5012.614928][ C1] irq_exit_rcu+0x98/0xc0 [ 5012.615156][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5012.615444][ C1] [ 5012.615598][ C1] [ 5012.615750][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5012.616059][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5012.616385][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5012.617368][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5012.617680][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5012.618087][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5012.618488][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5012.618891][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5012.619294][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5012.619699][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5012.620000][ C1] pipe_read+0xa16/0xdf0 [ 5012.620223][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5012.620506][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5012.620753][ C1] ? iterate_tty_write+0x299/0x540 [ 5012.621016][ C1] ? lock_release+0x1d5/0x250 [ 5012.621261][ C1] vfs_read+0x911/0xc00 [ 5012.621475][ C1] ? lock_acquire+0x1c1/0x220 [ 5012.621717][ C1] ? __might_fault+0xc6/0x180 [ 5012.621962][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5012.622202][ C1] ? __might_fault+0xc6/0x180 [ 5012.622443][ C1] ? lock_release+0x1d5/0x250 [ 5012.622685][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5012.622952][ C1] ? __fget_light+0x54/0x1e0 [ 5012.623193][ C1] ksys_read+0x17a/0x1e0 [ 5012.623412][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5012.623659][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5012.623969][ C1] do_syscall_64+0xc9/0x1e0 [ 5012.624202][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5012.624506][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5012.624738][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5012.625723][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5012.626147][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5012.626551][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5012.626954][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5012.627354][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5012.627755][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5012.628162][ C1] [ 5012.628322][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2477s! [swapper/2:0] [ 5012.628757][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5012.630018][ C2] irq event stamp: 44114564 [ 5012.630247][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5012.630784][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5012.631299][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5012.631777][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5012.632250][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5012.632712][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5012.633329][ C2] RIP: 0010:__kasan_check_read+0x8/0x20 [ 5012.633615][ C2] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 5012.634597][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 5012.634907][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5012.635315][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5012.635719][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5012.636121][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5012.636525][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5012.636925][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5012.637375][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5012.637709][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5012.638110][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5012.638512][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5012.638911][ C2] PKRU: 55555554 [ 5012.639094][ C2] Call Trace: [ 5012.639265][ C2] [ 5012.639416][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5012.639681][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5012.639924][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5012.640202][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5012.640478][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5012.640769][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5012.641037][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5012.641344][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5012.641606][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5012.641870][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5012.642180][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5012.642477][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5012.642793][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5012.643082][ C2] ? __kasan_check_read+0x8/0x20 [ 5012.643333][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 5012.643616][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5012.643928][ C2] ? get_stack_info+0x36/0xc0 [ 5012.644168][ C2] ? lock_acquire+0x1c1/0x220 [ 5012.644409][ C2] ? lock_release+0x1d5/0x250 [ 5012.644651][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5012.644899][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5012.645184][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5012.645471][ C2] ? lock_acquire+0x1c1/0x220 [ 5012.645710][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5012.645953][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5012.646214][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5012.646451][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5012.646700][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5012.646958][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5012.647234][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5012.647511][ C2] ip_local_deliver+0x19d/0x480 [ 5012.647759][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5012.648029][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5012.648291][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5012.648640][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5012.648892][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5012.649212][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5012.649475][ C2] ip_rcv+0x564/0x740 [ 5012.649679][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5012.649907][ C2] ? set_track_prepare+0x8a/0xd0 [ 5012.650160][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5012.650439][ C2] ? start_secondary+0x21c/0x2b0 [ 5012.650692][ C2] ? skb_clone+0x10b/0x330 [ 5012.650917][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5012.651237][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5012.651542][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5012.651823][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5012.652124][ C2] ? __tcf_classify+0x329/0x7d0 [ 5012.652372][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5012.652601][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5012.652903][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5012.653188][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5012.653516][ C2] ? lock_acquire+0x1c1/0x220 [ 5012.653756][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5012.654055][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5012.654339][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5012.654656][ C2] ? __copy_skb_header+0xaf/0x490 [ 5012.654914][ C2] ? __skb_clone+0x57a/0x760 [ 5012.655156][ C2] netif_receive_skb+0x55/0x280 [ 5012.655406][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5012.655720][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5012.656054][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5012.656352][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5012.656630][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5012.656925][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5012.657239][ C2] ? get_stack_info+0x36/0xc0 [ 5012.657480][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5012.657745][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5012.658064][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5012.658342][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5012.658618][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5012.658934][ C2] ? kernel_text_address+0x17/0xe0 [ 5012.659197][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5012.659511][ C2] ? arch_stack_walk+0x8c/0x100 [ 5012.659759][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5012.660024][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5012.660309][ C2] ? lock_acquire+0x1c1/0x220 [ 5012.660548][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5012.660831][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5012.661134][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5012.661414][ C2] ? get_stack_info+0x36/0xc0 [ 5012.661663][ C2] __tcf_classify+0x329/0x7d0 [ 5012.661906][ C2] tcf_classify+0x283/0x930 [ 5012.662141][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5012.662397][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5012.662711][ C2] tc_run+0x2e4/0x5d0 [ 5012.662915][ C2] ? __pfx_tc_run+0x10/0x10 [ 5012.663147][ C2] ? lock_acquire+0x1c1/0x220 [ 5012.663384][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5012.663646][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5012.663899][ C2] ? lock_acquire+0x1c1/0x220 [ 5012.664137][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5012.664401][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5012.664706][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5012.664977][ C2] ? neigh_hh_output+0x348/0x590 [ 5012.665238][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5012.665501][ C2] ip_finish_output2+0x786/0x18e0 [ 5012.665757][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5012.666092][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5012.666371][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5012.666624][ C2] ? __ip_finish_output+0x10f/0x770 [ 5012.666887][ C2] ip_output+0x16b/0x4f0 [ 5012.667102][ C2] ? __pfx_ip_output+0x10/0x10 [ 5012.667346][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5012.667621][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5012.667935][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5012.668213][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5012.668464][ C2] ? __alloc_skb+0xd4/0x280 [ 5012.668696][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5012.668965][ C2] ? tcp_fragment+0x168/0x1040 [ 5012.669208][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5012.669461][ C2] ? ip_local_out+0x114/0x3b0 [ 5012.669702][ C2] __ip_queue_xmit+0x672/0x1910 [ 5012.669949][ C2] ? __skb_clone+0x57a/0x760 [ 5012.670182][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5012.670448][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5012.670736][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5012.670983][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5012.671232][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5012.671532][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5012.671851][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5012.672095][ C2] tcp_send_loss_probe+0x348/0x830 [ 5012.672355][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5012.672623][ C2] tcp_write_timer+0x82/0x1d0 [ 5012.672865][ C2] call_timer_fn+0x173/0x430 [ 5012.673105][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5012.673368][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5012.673630][ C2] __run_timers.part.0+0x52d/0x890 [ 5012.673892][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5012.674164][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5012.674449][ C2] ? lock_acquire+0x1c1/0x220 [ 5012.674689][ C2] ? clockevents_program_event+0xf6/0x300 [ 5012.674980][ C2] ? lock_release+0x1d5/0x250 [ 5012.675223][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5012.675489][ C2] ? ktime_get+0xb3/0x190 [ 5012.675709][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5012.676008][ C2] run_timer_softirq+0x72/0x100 [ 5012.676256][ C2] __do_softirq+0x1b9/0x7ff [ 5012.676488][ C2] irq_exit_rcu+0x98/0xc0 [ 5012.676709][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5012.676996][ C2] [ 5012.677145][ C2] [ 5012.677300][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5012.677604][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5012.677861][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5012.678836][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5012.679144][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5012.679544][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5012.679942][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5012.680342][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5012.680740][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5012.681143][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5012.681430][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5012.681690][ C2] default_idle_call+0x69/0xa0 [ 5012.681934][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5012.682187][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5012.682466][ C2] ? lock_release+0x1d5/0x250 [ 5012.682707][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5012.682979][ C2] do_idle+0xfb/0x160 [ 5012.683185][ C2] cpu_startup_entry+0x55/0x60 [ 5012.683427][ C2] start_secondary+0x21c/0x2b0 [ 5012.683672][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5012.683940][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5012.684254][ C2] [ 5034.891102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5034.891459][ C1] rcu: 1-....: (2673243 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=651743 [ 5034.891997][ C1] rcu: (t=2680004 jiffies g=1882453 q=712 ncpus=4) [ 5034.892323][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5034.892761][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5034.893360][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 5034.893639][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 5034.894587][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 5034.894888][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5034.895306][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5034.895706][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5034.896115][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5034.896502][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5034.896894][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5034.897330][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5034.897654][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5034.898045][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5034.898434][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5034.898825][ C1] PKRU: 55555554 [ 5034.899002][ C1] Call Trace: [ 5034.899167][ C1] [ 5034.899313][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5034.899579][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5034.899845][ C1] ? check_cpu_stall+0x284/0x500 [ 5034.900098][ C1] ? rcu_pending+0x92/0x360 [ 5034.900327][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5034.900601][ C1] ? update_process_times+0xb9/0x110 [ 5034.900873][ C1] ? tick_sched_handle+0x67/0x130 [ 5034.901135][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5034.901412][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5034.901649][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5034.901955][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5034.902220][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5034.902501][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5034.902761][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5034.903057][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5034.903314][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5034.903616][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5034.903906][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5034.904236][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5034.904526][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 5034.904813][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5034.905098][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5034.905411][ C1] ? get_stack_info+0x36/0xc0 [ 5034.905653][ C1] ? lock_acquire+0x1c1/0x220 [ 5034.905892][ C1] ? lock_release+0x1d5/0x250 [ 5034.906134][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5034.906383][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5034.906655][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5034.906943][ C1] ? lock_acquire+0x1c1/0x220 [ 5034.907181][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5034.907422][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5034.907682][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5034.907919][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5034.908168][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5034.908426][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5034.908702][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5034.908978][ C1] ip_local_deliver+0x19d/0x480 [ 5034.909226][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5034.909498][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5034.909764][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5034.910111][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5034.910365][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5034.910686][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5034.910950][ C1] ip_rcv+0x564/0x740 [ 5034.911154][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5034.911386][ C1] ? set_track_prepare+0x8a/0xd0 [ 5034.911640][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5034.911917][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5034.912189][ C1] ? skb_clone+0x10b/0x330 [ 5034.912419][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5034.912739][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5034.913046][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5034.913331][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5034.913625][ C1] ? __tcf_classify+0x329/0x7d0 [ 5034.913874][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5034.914106][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5034.914406][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5034.914693][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5034.915024][ C1] ? lock_acquire+0x1c1/0x220 [ 5034.915265][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5034.915560][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5034.915848][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5034.916167][ C1] ? __copy_skb_header+0xaf/0x490 [ 5034.916424][ C1] ? __skb_clone+0x57a/0x760 [ 5034.916659][ C1] netif_receive_skb+0x55/0x280 [ 5034.916908][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5034.917223][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5034.917555][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5034.917856][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5034.918130][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5034.918420][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5034.918731][ C1] ? hlock_class+0x4e/0x130 [ 5034.918966][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5034.919242][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5034.919520][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5034.919785][ C1] ? hlock_class+0x4e/0x130 [ 5034.920014][ C1] ? mark_lock+0x38/0x3e0 [ 5034.920236][ C1] ? stack_access_ok+0xda/0x1f0 [ 5034.920487][ C1] ? __lock_acquire+0xb67/0x1610 [ 5034.920741][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5034.921018][ C1] ? get_stack_info+0x36/0xc0 [ 5034.921259][ C1] ? stack_access_ok+0xda/0x1f0 [ 5034.921505][ C1] ? get_reg+0x119/0x190 [ 5034.921723][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5034.921990][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5034.922303][ C1] __tcf_classify+0x329/0x7d0 [ 5034.922546][ C1] tcf_classify+0x283/0x930 [ 5034.922777][ C1] ? arch_stack_walk+0xa2/0x100 [ 5034.923028][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5034.923285][ C1] ? get_stack_info+0x36/0xc0 [ 5034.923527][ C1] tc_run+0x2e4/0x5d0 [ 5034.923733][ C1] ? __pfx_tc_run+0x10/0x10 [ 5034.923966][ C1] ? lock_acquire+0x1c1/0x220 [ 5034.924205][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5034.924471][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5034.924724][ C1] ? lock_acquire+0x1c1/0x220 [ 5034.924967][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5034.925232][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5034.925542][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5034.925815][ C1] ? neigh_hh_output+0x348/0x590 [ 5034.926069][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5034.926335][ C1] ip_finish_output2+0x786/0x18e0 [ 5034.926592][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5034.926874][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5034.927214][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5034.927491][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5034.927745][ C1] ? __ip_finish_output+0x10f/0x770 [ 5034.928010][ C1] ip_output+0x16b/0x4f0 [ 5034.928228][ C1] ? run_timer_softirq+0x72/0x100 [ 5034.928486][ C1] ? __pfx_ip_output+0x10/0x10 [ 5034.928729][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5034.929017][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5034.929271][ C1] ? ip_local_out+0x114/0x3b0 [ 5034.929512][ C1] __ip_queue_xmit+0x672/0x1910 [ 5034.929759][ C1] ? __create_object+0x5e/0xb0 [ 5034.930003][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5034.930272][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5034.930557][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5034.930829][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5034.931111][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5034.931386][ C1] tcp_delack_timer+0x84/0x240 [ 5034.931630][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5034.931905][ C1] call_timer_fn+0x173/0x430 [ 5034.932140][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5034.932403][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5034.932666][ C1] __run_timers.part.0+0x52d/0x890 [ 5034.932927][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5034.933202][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5034.933487][ C1] ? lock_acquire+0x1c1/0x220 [ 5034.933727][ C1] ? clockevents_program_event+0xf6/0x300 [ 5034.934019][ C1] ? lock_release+0x1d5/0x250 [ 5034.934262][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5034.934527][ C1] ? ktime_get+0xb3/0x190 [ 5034.934750][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5034.935051][ C1] run_timer_softirq+0x72/0x100 [ 5034.935299][ C1] __do_softirq+0x1b9/0x7ff [ 5034.935533][ C1] irq_exit_rcu+0x98/0xc0 [ 5034.935753][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5034.936042][ C1] [ 5034.936192][ C1] [ 5034.936343][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5034.936647][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5034.936972][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5034.937950][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5034.938259][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5034.938660][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5034.939059][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5034.939460][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5034.939858][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5034.940261][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5034.940559][ C1] pipe_read+0xa16/0xdf0 [ 5034.940780][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5034.941058][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5034.941303][ C1] ? iterate_tty_write+0x299/0x540 [ 5034.941565][ C1] ? lock_release+0x1d5/0x250 [ 5034.941805][ C1] vfs_read+0x911/0xc00 [ 5034.942020][ C1] ? lock_acquire+0x1c1/0x220 [ 5034.942260][ C1] ? __might_fault+0xc6/0x180 [ 5034.942502][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5034.942743][ C1] ? __might_fault+0xc6/0x180 [ 5034.942983][ C1] ? lock_release+0x1d5/0x250 [ 5034.943225][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5034.943490][ C1] ? __fget_light+0x54/0x1e0 [ 5034.943726][ C1] ksys_read+0x17a/0x1e0 [ 5034.943947][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5034.944192][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5034.944495][ C1] do_syscall_64+0xc9/0x1e0 [ 5034.944730][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5034.945036][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5034.945261][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5034.946233][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5034.946656][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5034.947057][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5034.947456][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5034.947857][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5034.948256][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5034.948658][ C1] [ 5034.948817][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5034.949091][ C2] NMI backtrace for cpu 2 [ 5034.949097][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5034.949103][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5034.949107][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5034.949115][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5034.949121][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5034.949126][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5034.949130][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5034.949134][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5034.949138][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5034.949142][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5034.949146][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5034.949150][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5034.949156][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5034.949160][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5034.949163][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5034.949167][ C2] PKRU: 55555554 [ 5034.949169][ C2] Call Trace: [ 5034.949172][ C2] [ 5034.949175][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5034.949189][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5034.949198][ C2] ? nmi_handle+0x153/0x420 [ 5034.949208][ C2] ? default_do_nmi+0x41/0x100 [ 5034.949214][ C2] ? exc_nmi+0xf3/0x120 [ 5034.949220][ C2] ? end_repeat_nmi+0xf/0x60 [ 5034.949232][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5034.949240][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5034.949248][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5034.949257][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5034.949264][ C2] [ 5034.949266][ C2] [ 5034.949269][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5034.949276][ C2] ? get_stack_info+0x36/0xc0 [ 5034.949285][ C2] ? lock_acquire+0x1c1/0x220 [ 5034.949293][ C2] ? lock_release+0x1d5/0x250 [ 5034.949301][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5034.949310][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5034.949317][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5034.949325][ C2] ? lock_acquire+0x1c1/0x220 [ 5034.949331][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5034.949339][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5034.949346][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5034.949362][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5034.949368][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5034.949380][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5034.949389][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5034.949398][ C2] ip_local_deliver+0x19d/0x480 [ 5034.949404][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5034.949409][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5034.949415][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5034.949426][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5034.949433][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5034.949441][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5034.949462][ C2] ip_rcv+0x564/0x740 [ 5034.949468][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5034.949475][ C2] ? set_track_prepare+0x8a/0xd0 [ 5034.949483][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5034.949491][ C2] ? start_secondary+0x21c/0x2b0 [ 5034.949497][ C2] ? skb_clone+0x10b/0x330 [ 5034.949503][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5034.949518][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5034.949532][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5034.949539][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5034.949560][ C2] ? __tcf_classify+0x329/0x7d0 [ 5034.949568][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5034.949574][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5034.949582][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5034.949589][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5034.949600][ C2] ? lock_acquire+0x1c1/0x220 [ 5034.949606][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5034.949617][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5034.949625][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5034.949635][ C2] ? __copy_skb_header+0xaf/0x490 [ 5034.949645][ C2] ? __skb_clone+0x57a/0x760 [ 5034.949651][ C2] netif_receive_skb+0x55/0x280 [ 5034.949659][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5034.949677][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5034.949695][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5034.949713][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5034.949724][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5034.949750][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5034.949770][ C2] ? get_stack_info+0x36/0xc0 [ 5034.949782][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5034.949788][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5034.949797][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5034.949803][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5034.949812][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5034.949818][ C2] ? kernel_text_address+0x17/0xe0 [ 5034.949825][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5034.949834][ C2] ? arch_stack_walk+0x8c/0x100 [ 5034.949842][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5034.949849][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5034.949858][ C2] ? lock_acquire+0x1c1/0x220 [ 5034.949863][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5034.949872][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5034.949881][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5034.949888][ C2] ? get_stack_info+0x36/0xc0 [ 5034.949899][ C2] __tcf_classify+0x329/0x7d0 [ 5034.949912][ C2] tcf_classify+0x283/0x930 [ 5034.949923][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5034.949930][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5034.949942][ C2] tc_run+0x2e4/0x5d0 [ 5034.949950][ C2] ? __pfx_tc_run+0x10/0x10 [ 5034.949957][ C2] ? lock_acquire+0x1c1/0x220 [ 5034.949963][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5034.949973][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5034.949983][ C2] ? lock_acquire+0x1c1/0x220 [ 5034.949989][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5034.949997][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5034.950004][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5034.950011][ C2] ? neigh_hh_output+0x348/0x590 [ 5034.950020][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5034.950030][ C2] ip_finish_output2+0x786/0x18e0 [ 5034.950039][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5034.950058][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5034.950064][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5034.950074][ C2] ? __ip_finish_output+0x10f/0x770 [ 5034.950083][ C2] ip_output+0x16b/0x4f0 [ 5034.950091][ C2] ? __pfx_ip_output+0x10/0x10 [ 5034.950097][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5034.950104][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5034.950111][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5034.950117][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5034.950123][ C2] ? __alloc_skb+0xd4/0x280 [ 5034.950129][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5034.950137][ C2] ? tcp_fragment+0x168/0x1040 [ 5034.950144][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5034.950151][ C2] ? ip_local_out+0x114/0x3b0 [ 5034.950160][ C2] __ip_queue_xmit+0x672/0x1910 [ 5034.950169][ C2] ? __skb_clone+0x57a/0x760 [ 5034.950177][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5034.950191][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5034.950199][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5034.950207][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5034.950216][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5034.950227][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5034.950235][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5034.950244][ C2] tcp_send_loss_probe+0x348/0x830 [ 5034.950252][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5034.950258][ C2] tcp_write_timer+0x82/0x1d0 [ 5034.950266][ C2] call_timer_fn+0x173/0x430 [ 5034.950275][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5034.950287][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5034.950297][ C2] __run_timers.part.0+0x52d/0x890 [ 5034.950304][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5034.950316][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5034.950323][ C2] ? lock_acquire+0x1c1/0x220 [ 5034.950329][ C2] ? clockevents_program_event+0xf6/0x300 [ 5034.950338][ C2] ? lock_release+0x1d5/0x250 [ 5034.950344][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5034.950351][ C2] ? ktime_get+0xb3/0x190 [ 5034.950359][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5034.950370][ C2] run_timer_softirq+0x72/0x100 [ 5034.950379][ C2] __do_softirq+0x1b9/0x7ff [ 5034.950390][ C2] irq_exit_rcu+0x98/0xc0 [ 5034.950395][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5034.950402][ C2] [ 5034.950404][ C2] [ 5034.950407][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5034.950414][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5034.950421][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5034.950426][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5034.950431][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5034.950435][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5034.950438][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5034.950439][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5034.950441][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5034.950444][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5034.950447][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5034.950451][ C2] default_idle_call+0x69/0xa0 [ 5034.950454][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5034.950456][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5034.950459][ C2] ? lock_release+0x1d5/0x250 [ 5034.950462][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5034.950466][ C2] do_idle+0xfb/0x160 [ 5034.950468][ C2] cpu_startup_entry+0x55/0x60 [ 5034.950470][ C2] start_secondary+0x21c/0x2b0 [ 5034.950473][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5034.950477][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5034.950483][ C2] [ 5034.950484][ C2] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.394 msecs [ 5060.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2522s! [perl:4135] [ 5060.569689][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5060.570943][ C1] irq event stamp: 209232 [ 5060.571164][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5060.571702][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5060.572165][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5060.572624][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5060.573075][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5060.573512][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5060.574109][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5060.574426][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5060.575409][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5060.575715][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5060.576124][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5060.576512][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5060.576901][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5060.577290][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5060.577681][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5060.578117][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5060.578442][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5060.578832][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5060.579223][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5060.579613][ C1] PKRU: 55555554 [ 5060.579791][ C1] Call Trace: [ 5060.579956][ C1] [ 5060.580104][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5060.580359][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5060.580596][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5060.580869][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5060.581134][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5060.581415][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5060.581678][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5060.581976][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5060.582231][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5060.582531][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5060.582820][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5060.583128][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5060.583409][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5060.583698][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5060.583979][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5060.584283][ C1] ? get_stack_info+0x36/0xc0 [ 5060.584518][ C1] ? lock_acquire+0x1c1/0x220 [ 5060.584757][ C1] ? lock_release+0x1d5/0x250 [ 5060.585014][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5060.585263][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5060.585537][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5060.585821][ C1] ? lock_acquire+0x1c1/0x220 [ 5060.586069][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5060.586305][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5060.586559][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5060.586786][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5060.587028][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5060.587279][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5060.587551][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5060.587821][ C1] ip_local_deliver+0x19d/0x480 [ 5060.588063][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5060.588328][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5060.588585][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5060.588948][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5060.589201][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5060.589521][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5060.589786][ C1] ip_rcv+0x564/0x740 [ 5060.589993][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5060.590223][ C1] ? set_track_prepare+0x8a/0xd0 [ 5060.590478][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5060.590755][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5060.591029][ C1] ? skb_clone+0x10b/0x330 [ 5060.591256][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5060.591576][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5060.591883][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5060.592165][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5060.592464][ C1] ? __tcf_classify+0x329/0x7d0 [ 5060.592713][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5060.592942][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5060.593244][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5060.593529][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5060.593854][ C1] ? lock_acquire+0x1c1/0x220 [ 5060.594093][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5060.594391][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5060.594676][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5060.595000][ C1] ? __copy_skb_header+0xaf/0x490 [ 5060.595259][ C1] ? __skb_clone+0x57a/0x760 [ 5060.595499][ C1] netif_receive_skb+0x55/0x280 [ 5060.595749][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5060.596063][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5060.596396][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5060.596695][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5060.596972][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5060.597262][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5060.597576][ C1] ? hlock_class+0x4e/0x130 [ 5060.597808][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5060.598087][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5060.598363][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5060.598628][ C1] ? hlock_class+0x4e/0x130 [ 5060.598860][ C1] ? mark_lock+0x38/0x3e0 [ 5060.599079][ C1] ? stack_access_ok+0xda/0x1f0 [ 5060.599329][ C1] ? __lock_acquire+0xb67/0x1610 [ 5060.599583][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5060.599859][ C1] ? get_stack_info+0x36/0xc0 [ 5060.600103][ C1] ? stack_access_ok+0xda/0x1f0 [ 5060.600350][ C1] ? get_reg+0x119/0x190 [ 5060.600566][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5060.600837][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5060.601145][ C1] __tcf_classify+0x329/0x7d0 [ 5060.601389][ C1] tcf_classify+0x283/0x930 [ 5060.601623][ C1] ? arch_stack_walk+0xa2/0x100 [ 5060.601871][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5060.602128][ C1] ? get_stack_info+0x36/0xc0 [ 5060.602366][ C1] tc_run+0x2e4/0x5d0 [ 5060.602574][ C1] ? __pfx_tc_run+0x10/0x10 [ 5060.602804][ C1] ? lock_acquire+0x1c1/0x220 [ 5060.603044][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5060.603306][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5060.603560][ C1] ? lock_acquire+0x1c1/0x220 [ 5060.603800][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5060.604065][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5060.604371][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5060.604644][ C1] ? neigh_hh_output+0x348/0x590 [ 5060.604901][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5060.605167][ C1] ip_finish_output2+0x786/0x18e0 [ 5060.605425][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5060.605703][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5060.606040][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5060.606320][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5060.606574][ C1] ? __ip_finish_output+0x10f/0x770 [ 5060.606840][ C1] ip_output+0x16b/0x4f0 [ 5060.607057][ C1] ? run_timer_softirq+0x72/0x100 [ 5060.607315][ C1] ? __pfx_ip_output+0x10/0x10 [ 5060.607559][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5060.607844][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5060.608097][ C1] ? ip_local_out+0x114/0x3b0 [ 5060.608339][ C1] __ip_queue_xmit+0x672/0x1910 [ 5060.608588][ C1] ? __create_object+0x5e/0xb0 [ 5060.608834][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5060.609101][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5060.609383][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5060.609657][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5060.609939][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5060.610212][ C1] tcp_delack_timer+0x84/0x240 [ 5060.610457][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5060.610731][ C1] call_timer_fn+0x173/0x430 [ 5060.610968][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5060.611231][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5060.611494][ C1] __run_timers.part.0+0x52d/0x890 [ 5060.611755][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5060.612030][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5060.612318][ C1] ? lock_acquire+0x1c1/0x220 [ 5060.612556][ C1] ? clockevents_program_event+0xf6/0x300 [ 5060.612849][ C1] ? lock_release+0x1d5/0x250 [ 5060.613090][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5060.613355][ C1] ? ktime_get+0xb3/0x190 [ 5060.613575][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5060.613874][ C1] run_timer_softirq+0x72/0x100 [ 5060.614124][ C1] __do_softirq+0x1b9/0x7ff [ 5060.614357][ C1] irq_exit_rcu+0x98/0xc0 [ 5060.614579][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5060.614868][ C1] [ 5060.615022][ C1] [ 5060.615172][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5060.615478][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5060.615803][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5060.616776][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5060.617085][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5060.617484][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5060.617882][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5060.618282][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5060.618683][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5060.619084][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5060.619382][ C1] pipe_read+0xa16/0xdf0 [ 5060.619603][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5060.619881][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5060.620127][ C1] ? iterate_tty_write+0x299/0x540 [ 5060.620389][ C1] ? lock_release+0x1d5/0x250 [ 5060.620630][ C1] vfs_read+0x911/0xc00 [ 5060.620843][ C1] ? lock_acquire+0x1c1/0x220 [ 5060.621083][ C1] ? __might_fault+0xc6/0x180 [ 5060.621326][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5060.621566][ C1] ? __might_fault+0xc6/0x180 [ 5060.621805][ C1] ? lock_release+0x1d5/0x250 [ 5060.622046][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5060.622310][ C1] ? __fget_light+0x54/0x1e0 [ 5060.622550][ C1] ksys_read+0x17a/0x1e0 [ 5060.622767][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5060.623013][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5060.623318][ C1] do_syscall_64+0xc9/0x1e0 [ 5060.623551][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5060.623852][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5060.624082][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5060.625058][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5060.625478][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5060.625879][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5060.626278][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5060.626676][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5060.627074][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5060.627480][ C1] [ 5060.627636][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2522s! [swapper/2:0] [ 5060.628054][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5060.629306][ C2] irq event stamp: 44114564 [ 5060.629536][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5060.630069][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5060.630580][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5060.631056][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5060.631525][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5060.631979][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5060.632598][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5060.632923][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5060.633893][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5060.634200][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5060.634597][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5060.634999][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5060.635396][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5060.635794][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5060.636192][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5060.636636][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5060.636967][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5060.637367][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5060.637765][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5060.638161][ C2] PKRU: 55555554 [ 5060.638341][ C2] Call Trace: [ 5060.638511][ C2] [ 5060.638658][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5060.638918][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5060.639162][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5060.639440][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5060.639709][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5060.639997][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5060.640261][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5060.640565][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5060.640825][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5060.641086][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5060.641393][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5060.641686][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5060.641999][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5060.642288][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5060.642580][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5060.642868][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5060.643178][ C2] ? get_stack_info+0x36/0xc0 [ 5060.643416][ C2] ? lock_acquire+0x1c1/0x220 [ 5060.643654][ C2] ? lock_release+0x1d5/0x250 [ 5060.643893][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5060.644142][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5060.644412][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5060.644695][ C2] ? lock_acquire+0x1c1/0x220 [ 5060.644935][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5060.645175][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5060.645434][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5060.645668][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5060.645913][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5060.646170][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5060.646443][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5060.646718][ C2] ip_local_deliver+0x19d/0x480 [ 5060.646963][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5060.647233][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5060.647494][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5060.647841][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5060.648092][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5060.648412][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5060.648673][ C2] ip_rcv+0x564/0x740 [ 5060.648875][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5060.649104][ C2] ? set_track_prepare+0x8a/0xd0 [ 5060.649355][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5060.649632][ C2] ? start_secondary+0x21c/0x2b0 [ 5060.649886][ C2] ? skb_clone+0x10b/0x330 [ 5060.650111][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5060.650432][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5060.650736][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5060.651014][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5060.651307][ C2] ? __tcf_classify+0x329/0x7d0 [ 5060.651555][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5060.651782][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5060.652082][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5060.652365][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5060.652689][ C2] ? lock_acquire+0x1c1/0x220 [ 5060.652926][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5060.653222][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5060.653505][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5060.653821][ C2] ? __copy_skb_header+0xaf/0x490 [ 5060.654076][ C2] ? __skb_clone+0x57a/0x760 [ 5060.654311][ C2] netif_receive_skb+0x55/0x280 [ 5060.654558][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5060.654872][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5060.655203][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5060.655499][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5060.655773][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5060.656058][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5060.656369][ C2] ? get_stack_info+0x36/0xc0 [ 5060.656609][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5060.656872][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5060.657188][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5060.657461][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5060.657736][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5060.658050][ C2] ? kernel_text_address+0x17/0xe0 [ 5060.658308][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5060.658620][ C2] ? arch_stack_walk+0x8c/0x100 [ 5060.658871][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5060.659134][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5060.659419][ C2] ? lock_acquire+0x1c1/0x220 [ 5060.659655][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5060.659937][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5060.660239][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5060.660515][ C2] ? get_stack_info+0x36/0xc0 [ 5060.660755][ C2] __tcf_classify+0x329/0x7d0 [ 5060.660993][ C2] tcf_classify+0x283/0x930 [ 5060.661226][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5060.661481][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5060.661793][ C2] tc_run+0x2e4/0x5d0 [ 5060.661997][ C2] ? __pfx_tc_run+0x10/0x10 [ 5060.662228][ C2] ? lock_acquire+0x1c1/0x220 [ 5060.662462][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5060.662723][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5060.662974][ C2] ? lock_acquire+0x1c1/0x220 [ 5060.663213][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5060.663475][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5060.663778][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5060.664047][ C2] ? neigh_hh_output+0x348/0x590 [ 5060.664298][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5060.664560][ C2] ip_finish_output2+0x786/0x18e0 [ 5060.664821][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5060.665158][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5060.665434][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5060.665685][ C2] ? __ip_finish_output+0x10f/0x770 [ 5060.665948][ C2] ip_output+0x16b/0x4f0 [ 5060.666163][ C2] ? __pfx_ip_output+0x10/0x10 [ 5060.666405][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5060.666680][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5060.666991][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5060.667268][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5060.667517][ C2] ? __alloc_skb+0xd4/0x280 [ 5060.667746][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5060.668012][ C2] ? tcp_fragment+0x168/0x1040 [ 5060.668256][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5060.668506][ C2] ? ip_local_out+0x114/0x3b0 [ 5060.668745][ C2] __ip_queue_xmit+0x672/0x1910 [ 5060.668992][ C2] ? __skb_clone+0x57a/0x760 [ 5060.669225][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5060.669492][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5060.669772][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5060.670015][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5060.670268][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5060.670565][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5060.670882][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5060.671125][ C2] tcp_send_loss_probe+0x348/0x830 [ 5060.671384][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5060.671649][ C2] tcp_write_timer+0x82/0x1d0 [ 5060.671888][ C2] call_timer_fn+0x173/0x430 [ 5060.672124][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5060.672385][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5060.672645][ C2] __run_timers.part.0+0x52d/0x890 [ 5060.672904][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5060.673172][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5060.673457][ C2] ? lock_acquire+0x1c1/0x220 [ 5060.673693][ C2] ? clockevents_program_event+0xf6/0x300 [ 5060.673983][ C2] ? lock_release+0x1d5/0x250 [ 5060.674221][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5060.674485][ C2] ? ktime_get+0xb3/0x190 [ 5060.674703][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5060.675003][ C2] run_timer_softirq+0x72/0x100 [ 5060.675253][ C2] __do_softirq+0x1b9/0x7ff [ 5060.675482][ C2] irq_exit_rcu+0x98/0xc0 [ 5060.675703][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5060.675986][ C2] [ 5060.676136][ C2] [ 5060.676286][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5060.676590][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5060.676845][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5060.677809][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5060.678116][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5060.678514][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5060.678910][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5060.679307][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5060.679706][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5060.680104][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5060.680391][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5060.680650][ C2] default_idle_call+0x69/0xa0 [ 5060.680893][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5060.681143][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5060.681420][ C2] ? lock_release+0x1d5/0x250 [ 5060.681657][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5060.681930][ C2] do_idle+0xfb/0x160 [ 5060.682134][ C2] cpu_startup_entry+0x55/0x60 [ 5060.682375][ C2] start_secondary+0x21c/0x2b0 [ 5060.682618][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5060.682887][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5060.683196][ C2] [ 5088.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2548s! [perl:4135] [ 5088.569699][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5088.570956][ C1] irq event stamp: 209232 [ 5088.571173][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5088.571705][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5088.572184][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5088.572650][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5088.573121][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5088.573568][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5088.574188][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5088.574515][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5088.575490][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5088.575799][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5088.576198][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5088.576597][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5088.576999][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5088.577399][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5088.577799][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5088.578247][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5088.578579][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5088.578986][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5088.579386][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5088.579786][ C1] PKRU: 55555554 [ 5088.579968][ C1] Call Trace: [ 5088.580141][ C1] [ 5088.580288][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5088.580550][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5088.580795][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5088.581071][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5088.581346][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5088.581634][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5088.581899][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5088.582208][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5088.582471][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5088.582780][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5088.583075][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5088.583389][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5088.583679][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5088.583973][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5088.584263][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5088.584575][ C1] ? get_stack_info+0x36/0xc0 [ 5088.584820][ C1] ? lock_acquire+0x1c1/0x220 [ 5088.585062][ C1] ? lock_release+0x1d5/0x250 [ 5088.585303][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5088.585552][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5088.585824][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5088.586110][ C1] ? lock_acquire+0x1c1/0x220 [ 5088.586347][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5088.586589][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5088.586848][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5088.587085][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5088.587333][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5088.587592][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5088.587868][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5088.588145][ C1] ip_local_deliver+0x19d/0x480 [ 5088.588392][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5088.588662][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5088.588928][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5088.589277][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5088.589531][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5088.589851][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5088.590114][ C1] ip_rcv+0x564/0x740 [ 5088.590318][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5088.590550][ C1] ? set_track_prepare+0x8a/0xd0 [ 5088.590804][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5088.591084][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5088.591356][ C1] ? skb_clone+0x10b/0x330 [ 5088.591585][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5088.591904][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5088.592208][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5088.592492][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5088.592785][ C1] ? __tcf_classify+0x329/0x7d0 [ 5088.593035][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5088.593266][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5088.593564][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5088.593850][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5088.594175][ C1] ? lock_acquire+0x1c1/0x220 [ 5088.594416][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5088.594715][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5088.595003][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5088.595321][ C1] ? __copy_skb_header+0xaf/0x490 [ 5088.595579][ C1] ? __skb_clone+0x57a/0x760 [ 5088.595813][ C1] netif_receive_skb+0x55/0x280 [ 5088.596061][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5088.596374][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5088.596705][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5088.597006][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5088.597283][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5088.597572][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5088.597884][ C1] ? hlock_class+0x4e/0x130 [ 5088.598118][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5088.598393][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5088.598673][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5088.598936][ C1] ? hlock_class+0x4e/0x130 [ 5088.599166][ C1] ? mark_lock+0x38/0x3e0 [ 5088.599391][ C1] ? stack_access_ok+0xda/0x1f0 [ 5088.599641][ C1] ? __lock_acquire+0xb67/0x1610 [ 5088.599894][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5088.600170][ C1] ? get_stack_info+0x36/0xc0 [ 5088.600412][ C1] ? stack_access_ok+0xda/0x1f0 [ 5088.600658][ C1] ? get_reg+0x119/0x190 [ 5088.600875][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5088.601144][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5088.601454][ C1] __tcf_classify+0x329/0x7d0 [ 5088.601696][ C1] tcf_classify+0x283/0x930 [ 5088.601926][ C1] ? arch_stack_walk+0xa2/0x100 [ 5088.602175][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5088.602432][ C1] ? get_stack_info+0x36/0xc0 [ 5088.602673][ C1] tc_run+0x2e4/0x5d0 [ 5088.602879][ C1] ? __pfx_tc_run+0x10/0x10 [ 5088.603110][ C1] ? lock_acquire+0x1c1/0x220 [ 5088.603348][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5088.603611][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5088.603864][ C1] ? lock_acquire+0x1c1/0x220 [ 5088.604103][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5088.604367][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5088.604682][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5088.604953][ C1] ? neigh_hh_output+0x348/0x590 [ 5088.605207][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5088.605472][ C1] ip_finish_output2+0x786/0x18e0 [ 5088.605732][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5088.606012][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5088.606348][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5088.606623][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5088.606876][ C1] ? __ip_finish_output+0x10f/0x770 [ 5088.607141][ C1] ip_output+0x16b/0x4f0 [ 5088.607359][ C1] ? run_timer_softirq+0x72/0x100 [ 5088.607617][ C1] ? __pfx_ip_output+0x10/0x10 [ 5088.607859][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5088.608146][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5088.608399][ C1] ? ip_local_out+0x114/0x3b0 [ 5088.608640][ C1] __ip_queue_xmit+0x672/0x1910 [ 5088.608888][ C1] ? __create_object+0x5e/0xb0 [ 5088.609131][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5088.609399][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5088.609682][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5088.609954][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5088.610240][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5088.610514][ C1] tcp_delack_timer+0x84/0x240 [ 5088.610757][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5088.611030][ C1] call_timer_fn+0x173/0x430 [ 5088.611265][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5088.611528][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5088.611790][ C1] __run_timers.part.0+0x52d/0x890 [ 5088.612050][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5088.612324][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5088.612608][ C1] ? lock_acquire+0x1c1/0x220 [ 5088.612848][ C1] ? clockevents_program_event+0xf6/0x300 [ 5088.613139][ C1] ? lock_release+0x1d5/0x250 [ 5088.613377][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5088.613642][ C1] ? ktime_get+0xb3/0x190 [ 5088.613863][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5088.614161][ C1] run_timer_softirq+0x72/0x100 [ 5088.614407][ C1] __do_softirq+0x1b9/0x7ff [ 5088.614648][ C1] irq_exit_rcu+0x98/0xc0 [ 5088.614874][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5088.615162][ C1] [ 5088.615312][ C1] [ 5088.615465][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5088.615767][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5088.616093][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5088.617066][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5088.617374][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5088.617774][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5088.618174][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5088.618570][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5088.618969][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5088.619372][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5088.619666][ C1] pipe_read+0xa16/0xdf0 [ 5088.619889][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5088.620167][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5088.620411][ C1] ? iterate_tty_write+0x299/0x540 [ 5088.620674][ C1] ? lock_release+0x1d5/0x250 [ 5088.620915][ C1] vfs_read+0x911/0xc00 [ 5088.621130][ C1] ? lock_acquire+0x1c1/0x220 [ 5088.621370][ C1] ? __might_fault+0xc6/0x180 [ 5088.621609][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5088.621848][ C1] ? __might_fault+0xc6/0x180 [ 5088.622087][ C1] ? lock_release+0x1d5/0x250 [ 5088.622333][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5088.622598][ C1] ? __fget_light+0x54/0x1e0 [ 5088.622835][ C1] ksys_read+0x17a/0x1e0 [ 5088.623054][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5088.623299][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5088.623603][ C1] do_syscall_64+0xc9/0x1e0 [ 5088.623836][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5088.624137][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5088.624364][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5088.625341][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5088.625764][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5088.626162][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5088.626562][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5088.626962][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5088.627360][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5088.627760][ C1] [ 5088.627919][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2548s! [swapper/2:0] [ 5088.628339][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5088.629590][ C2] irq event stamp: 44114564 [ 5088.629817][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5088.630353][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5088.630862][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5088.631338][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5088.631804][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5088.632259][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5088.632869][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5088.633189][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5088.634155][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5088.634462][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5088.634864][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5088.635262][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5088.635661][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5088.636059][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5088.636456][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5088.636903][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5088.637237][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5088.637639][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5088.638037][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5088.638434][ C2] PKRU: 55555554 [ 5088.638615][ C2] Call Trace: [ 5088.638787][ C2] [ 5088.638934][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5088.639196][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5088.639444][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5088.639720][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5088.639996][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5088.640285][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5088.640550][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5088.640857][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5088.641118][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5088.641381][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5088.641689][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5088.641986][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5088.642299][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5088.642593][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5088.642881][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5088.643171][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5088.643483][ C2] ? get_stack_info+0x36/0xc0 [ 5088.643724][ C2] ? lock_acquire+0x1c1/0x220 [ 5088.643963][ C2] ? lock_release+0x1d5/0x250 [ 5088.644204][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5088.644455][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5088.644731][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5088.645017][ C2] ? lock_acquire+0x1c1/0x220 [ 5088.645254][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5088.645496][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5088.645756][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5088.645994][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5088.646242][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5088.646500][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5088.646775][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5088.647052][ C2] ip_local_deliver+0x19d/0x480 [ 5088.647300][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5088.647571][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5088.647837][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5088.648184][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5088.648438][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5088.648758][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5088.649020][ C2] ip_rcv+0x564/0x740 [ 5088.649224][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5088.649455][ C2] ? set_track_prepare+0x8a/0xd0 [ 5088.649708][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5088.649984][ C2] ? start_secondary+0x21c/0x2b0 [ 5088.650237][ C2] ? skb_clone+0x10b/0x330 [ 5088.650463][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5088.650782][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5088.651089][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5088.651371][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5088.651665][ C2] ? __tcf_classify+0x329/0x7d0 [ 5088.651915][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5088.652145][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5088.652445][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5088.652732][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5088.653057][ C2] ? lock_acquire+0x1c1/0x220 [ 5088.653295][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5088.653593][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5088.653879][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5088.654200][ C2] ? __copy_skb_header+0xaf/0x490 [ 5088.654457][ C2] ? __skb_clone+0x57a/0x760 [ 5088.654697][ C2] netif_receive_skb+0x55/0x280 [ 5088.654946][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5088.655258][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5088.655590][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5088.655888][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5088.656164][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5088.656452][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5088.656764][ C2] ? get_stack_info+0x36/0xc0 [ 5088.657007][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5088.657271][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5088.657587][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5088.657862][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5088.658138][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5088.658453][ C2] ? kernel_text_address+0x17/0xe0 [ 5088.658712][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5088.659024][ C2] ? arch_stack_walk+0x8c/0x100 [ 5088.659273][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5088.659537][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5088.659825][ C2] ? lock_acquire+0x1c1/0x220 [ 5088.660062][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5088.660345][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5088.660649][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5088.660926][ C2] ? get_stack_info+0x36/0xc0 [ 5088.661168][ C2] __tcf_classify+0x329/0x7d0 [ 5088.661409][ C2] tcf_classify+0x283/0x930 [ 5088.661643][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5088.661899][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5088.662213][ C2] tc_run+0x2e4/0x5d0 [ 5088.662418][ C2] ? __pfx_tc_run+0x10/0x10 [ 5088.662650][ C2] ? lock_acquire+0x1c1/0x220 [ 5088.662887][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5088.663148][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5088.663400][ C2] ? lock_acquire+0x1c1/0x220 [ 5088.663638][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5088.663902][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5088.664207][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5088.664477][ C2] ? neigh_hh_output+0x348/0x590 [ 5088.664734][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5088.664998][ C2] ip_finish_output2+0x786/0x18e0 [ 5088.665256][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5088.665596][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5088.665872][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5088.666127][ C2] ? __ip_finish_output+0x10f/0x770 [ 5088.666391][ C2] ip_output+0x16b/0x4f0 [ 5088.666607][ C2] ? __pfx_ip_output+0x10/0x10 [ 5088.666851][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5088.667131][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5088.667444][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5088.667722][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5088.667974][ C2] ? __alloc_skb+0xd4/0x280 [ 5088.668203][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5088.668474][ C2] ? tcp_fragment+0x168/0x1040 [ 5088.668719][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5088.668970][ C2] ? ip_local_out+0x114/0x3b0 [ 5088.669210][ C2] __ip_queue_xmit+0x672/0x1910 [ 5088.669460][ C2] ? __skb_clone+0x57a/0x760 [ 5088.669694][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5088.669962][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5088.670243][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5088.670488][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5088.670737][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5088.671036][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5088.671355][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5088.671600][ C2] tcp_send_loss_probe+0x348/0x830 [ 5088.671859][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5088.672127][ C2] tcp_write_timer+0x82/0x1d0 [ 5088.672367][ C2] call_timer_fn+0x173/0x430 [ 5088.672604][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5088.672865][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5088.673127][ C2] __run_timers.part.0+0x52d/0x890 [ 5088.673387][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5088.673655][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5088.673941][ C2] ? lock_acquire+0x1c1/0x220 [ 5088.674178][ C2] ? clockevents_program_event+0xf6/0x300 [ 5088.674470][ C2] ? lock_release+0x1d5/0x250 [ 5088.674713][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5088.674978][ C2] ? ktime_get+0xb3/0x190 [ 5088.675197][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5088.675494][ C2] run_timer_softirq+0x72/0x100 [ 5088.675743][ C2] __do_softirq+0x1b9/0x7ff [ 5088.675975][ C2] irq_exit_rcu+0x98/0xc0 [ 5088.676197][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5088.676483][ C2] [ 5088.676633][ C2] [ 5088.676783][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5088.677088][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5088.677345][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5088.678318][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5088.678626][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5088.679025][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5088.679422][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5088.679820][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5088.680221][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5088.680621][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5088.680909][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5088.681171][ C2] default_idle_call+0x69/0xa0 [ 5088.681413][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5088.681663][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5088.681941][ C2] ? lock_release+0x1d5/0x250 [ 5088.682179][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5088.682454][ C2] do_idle+0xfb/0x160 [ 5088.682658][ C2] cpu_startup_entry+0x55/0x60 [ 5088.682901][ C2] start_secondary+0x21c/0x2b0 [ 5088.683143][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5088.683414][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5088.683724][ C2] [ 5112.949102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5112.949472][ C1] rcu: 1-....: (2751129 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=671010 [ 5112.950026][ C1] rcu: (t=2758062 jiffies g=1882453 q=712 ncpus=4) [ 5112.950359][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5112.950808][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5112.951423][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5112.951752][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5112.952722][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5112.953031][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5112.953430][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5112.953828][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5112.954228][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5112.954632][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5112.955032][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5112.955480][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5112.955814][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5112.956215][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5112.956614][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5112.957013][ C1] PKRU: 55555554 [ 5112.957195][ C1] Call Trace: [ 5112.957368][ C1] [ 5112.957514][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5112.957786][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5112.958038][ C1] ? check_cpu_stall+0x284/0x500 [ 5112.958292][ C1] ? rcu_pending+0x92/0x360 [ 5112.958524][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5112.958793][ C1] ? update_process_times+0xb9/0x110 [ 5112.959063][ C1] ? tick_sched_handle+0x67/0x130 [ 5112.959320][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5112.959607][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5112.959849][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5112.960161][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5112.960438][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5112.960726][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5112.960991][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5112.961297][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5112.961559][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5112.961869][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5112.962167][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5112.962481][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5112.962773][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5112.963067][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5112.963356][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5112.963668][ C1] ? get_stack_info+0x36/0xc0 [ 5112.963910][ C1] ? lock_acquire+0x1c1/0x220 [ 5112.964149][ C1] ? lock_release+0x1d5/0x250 [ 5112.964390][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5112.964645][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5112.964917][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5112.965204][ C1] ? lock_acquire+0x1c1/0x220 [ 5112.965442][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5112.965682][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5112.965942][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5112.966179][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5112.966427][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5112.966686][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5112.966961][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5112.967238][ C1] ip_local_deliver+0x19d/0x480 [ 5112.967485][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5112.967755][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5112.968021][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5112.968369][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5112.968623][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5112.968944][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5112.969207][ C1] ip_rcv+0x564/0x740 [ 5112.969414][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5112.969646][ C1] ? set_track_prepare+0x8a/0xd0 [ 5112.969901][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5112.970178][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5112.970450][ C1] ? skb_clone+0x10b/0x330 [ 5112.970679][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5112.970998][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5112.971303][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5112.971587][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5112.971880][ C1] ? __tcf_classify+0x329/0x7d0 [ 5112.972130][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5112.972362][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5112.972661][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5112.972946][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5112.973273][ C1] ? lock_acquire+0x1c1/0x220 [ 5112.973512][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5112.973808][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5112.974096][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5112.974413][ C1] ? __copy_skb_header+0xaf/0x490 [ 5112.974676][ C1] ? __skb_clone+0x57a/0x760 [ 5112.974910][ C1] netif_receive_skb+0x55/0x280 [ 5112.975158][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5112.975472][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5112.975803][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5112.976103][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5112.976377][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5112.976666][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5112.976978][ C1] ? hlock_class+0x4e/0x130 [ 5112.977212][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5112.977488][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5112.977765][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5112.978028][ C1] ? hlock_class+0x4e/0x130 [ 5112.978258][ C1] ? mark_lock+0x38/0x3e0 [ 5112.978480][ C1] ? stack_access_ok+0xda/0x1f0 [ 5112.978729][ C1] ? __lock_acquire+0xb67/0x1610 [ 5112.978983][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5112.979260][ C1] ? get_stack_info+0x36/0xc0 [ 5112.979501][ C1] ? stack_access_ok+0xda/0x1f0 [ 5112.979748][ C1] ? get_reg+0x119/0x190 [ 5112.979965][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5112.980233][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5112.980543][ C1] __tcf_classify+0x329/0x7d0 [ 5112.980788][ C1] tcf_classify+0x283/0x930 [ 5112.981018][ C1] ? arch_stack_walk+0xa2/0x100 [ 5112.981267][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5112.981524][ C1] ? get_stack_info+0x36/0xc0 [ 5112.981765][ C1] tc_run+0x2e4/0x5d0 [ 5112.981970][ C1] ? __pfx_tc_run+0x10/0x10 [ 5112.982202][ C1] ? lock_acquire+0x1c1/0x220 [ 5112.982439][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5112.982700][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5112.982953][ C1] ? lock_acquire+0x1c1/0x220 [ 5112.983191][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5112.983455][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5112.983761][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5112.984032][ C1] ? neigh_hh_output+0x348/0x590 [ 5112.984285][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5112.984554][ C1] ip_finish_output2+0x786/0x18e0 [ 5112.984811][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5112.985093][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5112.985434][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5112.985710][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5112.985963][ C1] ? __ip_finish_output+0x10f/0x770 [ 5112.986228][ C1] ip_output+0x16b/0x4f0 [ 5112.986447][ C1] ? run_timer_softirq+0x72/0x100 [ 5112.986703][ C1] ? __pfx_ip_output+0x10/0x10 [ 5112.986946][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5112.987233][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5112.987485][ C1] ? ip_local_out+0x114/0x3b0 [ 5112.987725][ C1] __ip_queue_xmit+0x672/0x1910 [ 5112.987973][ C1] ? __create_object+0x5e/0xb0 [ 5112.988217][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5112.988483][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5112.988767][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5112.989039][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5112.989320][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5112.989594][ C1] tcp_delack_timer+0x84/0x240 [ 5112.989836][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5112.990109][ C1] call_timer_fn+0x173/0x430 [ 5112.990343][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5112.990606][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5112.990867][ C1] __run_timers.part.0+0x52d/0x890 [ 5112.991128][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5112.991402][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5112.991686][ C1] ? lock_acquire+0x1c1/0x220 [ 5112.991925][ C1] ? clockevents_program_event+0xf6/0x300 [ 5112.992215][ C1] ? lock_release+0x1d5/0x250 [ 5112.992453][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5112.992717][ C1] ? ktime_get+0xb3/0x190 [ 5112.992940][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5112.993236][ C1] run_timer_softirq+0x72/0x100 [ 5112.993484][ C1] __do_softirq+0x1b9/0x7ff [ 5112.993717][ C1] irq_exit_rcu+0x98/0xc0 [ 5112.993936][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5112.994225][ C1] [ 5112.994375][ C1] [ 5112.994527][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5112.994834][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5112.995158][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5112.996131][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5112.996438][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5112.996839][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5112.997239][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5112.997638][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5112.998037][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5112.998446][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5112.998741][ C1] pipe_read+0xa16/0xdf0 [ 5112.998962][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5112.999240][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5112.999484][ C1] ? iterate_tty_write+0x299/0x540 [ 5112.999746][ C1] ? lock_release+0x1d5/0x250 [ 5112.999986][ C1] vfs_read+0x911/0xc00 [ 5113.000201][ C1] ? lock_acquire+0x1c1/0x220 [ 5113.000440][ C1] ? __might_fault+0xc6/0x180 [ 5113.000679][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5113.000918][ C1] ? __might_fault+0xc6/0x180 [ 5113.001162][ C1] ? lock_release+0x1d5/0x250 [ 5113.001402][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5113.001666][ C1] ? __fget_light+0x54/0x1e0 [ 5113.001901][ C1] ksys_read+0x17a/0x1e0 [ 5113.002121][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5113.002365][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5113.002668][ C1] do_syscall_64+0xc9/0x1e0 [ 5113.002902][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5113.003202][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5113.003432][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5113.004402][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5113.004830][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5113.005228][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5113.005626][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5113.006027][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5113.006425][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5113.006826][ C1] [ 5113.006984][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5113.007256][ C2] NMI backtrace for cpu 2 [ 5113.007262][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5113.007268][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5113.007272][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5113.007281][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5113.007287][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5113.007292][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5113.007296][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5113.007300][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5113.007303][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5113.007307][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5113.007311][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5113.007316][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5113.007322][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5113.007326][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5113.007329][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5113.007332][ C2] PKRU: 55555554 [ 5113.007334][ C2] Call Trace: [ 5113.007338][ C2] [ 5113.007341][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5113.007353][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5113.007361][ C2] ? nmi_handle+0x153/0x420 [ 5113.007371][ C2] ? default_do_nmi+0x41/0x100 [ 5113.007378][ C2] ? exc_nmi+0xf3/0x120 [ 5113.007383][ C2] ? end_repeat_nmi+0xf/0x60 [ 5113.007395][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5113.007403][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5113.007411][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5113.007420][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5113.007428][ C2] [ 5113.007430][ C2] [ 5113.007433][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5113.007439][ C2] ? get_stack_info+0x36/0xc0 [ 5113.007448][ C2] ? lock_acquire+0x1c1/0x220 [ 5113.007456][ C2] ? lock_release+0x1d5/0x250 [ 5113.007465][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5113.007473][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5113.007477][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5113.007480][ C2] ? lock_acquire+0x1c1/0x220 [ 5113.007482][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5113.007486][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5113.007489][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5113.007495][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5113.007497][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5113.007502][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5113.007507][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5113.007511][ C2] ip_local_deliver+0x19d/0x480 [ 5113.007513][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5113.007515][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5113.007518][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5113.007523][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5113.007527][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5113.007530][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5113.007539][ C2] ip_rcv+0x564/0x740 [ 5113.007541][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5113.007544][ C2] ? set_track_prepare+0x8a/0xd0 [ 5113.007548][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5113.007551][ C2] ? start_secondary+0x21c/0x2b0 [ 5113.007555][ C2] ? skb_clone+0x10b/0x330 [ 5113.007558][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5113.007563][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5113.007569][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5113.007572][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5113.007580][ C2] ? __tcf_classify+0x329/0x7d0 [ 5113.007584][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5113.007586][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5113.007590][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5113.007594][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5113.007598][ C2] ? lock_acquire+0x1c1/0x220 [ 5113.007600][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5113.007604][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5113.007607][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5113.007612][ C2] ? __copy_skb_header+0xaf/0x490 [ 5113.007616][ C2] ? __skb_clone+0x57a/0x760 [ 5113.007619][ C2] netif_receive_skb+0x55/0x280 [ 5113.007622][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5113.007629][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5113.007636][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5113.007642][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5113.007647][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5113.007657][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5113.007664][ C2] ? get_stack_info+0x36/0xc0 [ 5113.007669][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5113.007671][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5113.007675][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5113.007677][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5113.007681][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5113.007683][ C2] ? kernel_text_address+0x17/0xe0 [ 5113.007687][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5113.007691][ C2] ? arch_stack_walk+0x8c/0x100 [ 5113.007695][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5113.007698][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5113.007701][ C2] ? lock_acquire+0x1c1/0x220 [ 5113.007703][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5113.007707][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5113.007711][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5113.007714][ C2] ? get_stack_info+0x36/0xc0 [ 5113.007718][ C2] __tcf_classify+0x329/0x7d0 [ 5113.007724][ C2] tcf_classify+0x283/0x930 [ 5113.007728][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5113.007731][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5113.007736][ C2] tc_run+0x2e4/0x5d0 [ 5113.007739][ C2] ? __pfx_tc_run+0x10/0x10 [ 5113.007742][ C2] ? lock_acquire+0x1c1/0x220 [ 5113.007744][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5113.007748][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5113.007752][ C2] ? lock_acquire+0x1c1/0x220 [ 5113.007754][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5113.007758][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5113.007761][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5113.007763][ C2] ? neigh_hh_output+0x348/0x590 [ 5113.007767][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5113.007770][ C2] ip_finish_output2+0x786/0x18e0 [ 5113.007774][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5113.007782][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5113.007784][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5113.007788][ C2] ? __ip_finish_output+0x10f/0x770 [ 5113.007791][ C2] ip_output+0x16b/0x4f0 [ 5113.007794][ C2] ? __pfx_ip_output+0x10/0x10 [ 5113.007797][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5113.007800][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5113.007803][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5113.007806][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5113.007808][ C2] ? __alloc_skb+0xd4/0x280 [ 5113.007811][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5113.007814][ C2] ? tcp_fragment+0x168/0x1040 [ 5113.007818][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5113.007820][ C2] ? ip_local_out+0x114/0x3b0 [ 5113.007824][ C2] __ip_queue_xmit+0x672/0x1910 [ 5113.007827][ C2] ? __skb_clone+0x57a/0x760 [ 5113.007830][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5113.007835][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5113.007838][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5113.007842][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5113.007846][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5113.007850][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5113.007853][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5113.007856][ C2] tcp_send_loss_probe+0x348/0x830 [ 5113.007859][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5113.007862][ C2] tcp_write_timer+0x82/0x1d0 [ 5113.007865][ C2] call_timer_fn+0x173/0x430 [ 5113.007869][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5113.007873][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5113.007878][ C2] __run_timers.part.0+0x52d/0x890 [ 5113.007880][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5113.007885][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5113.007888][ C2] ? lock_acquire+0x1c1/0x220 [ 5113.007890][ C2] ? clockevents_program_event+0xf6/0x300 [ 5113.007894][ C2] ? lock_release+0x1d5/0x250 [ 5113.007897][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5113.007900][ C2] ? ktime_get+0xb3/0x190 [ 5113.007904][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5113.007908][ C2] run_timer_softirq+0x72/0x100 [ 5113.007912][ C2] __do_softirq+0x1b9/0x7ff [ 5113.007916][ C2] irq_exit_rcu+0x98/0xc0 [ 5113.007918][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5113.007921][ C2] [ 5113.007922][ C2] [ 5113.007923][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5113.007927][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5113.007930][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5113.007932][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5113.007934][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5113.007936][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5113.007937][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5113.007938][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5113.007940][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5113.007943][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5113.007946][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5113.007950][ C2] default_idle_call+0x69/0xa0 [ 5113.007953][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5113.007955][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5113.007959][ C2] ? lock_release+0x1d5/0x250 [ 5113.007961][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5113.007965][ C2] do_idle+0xfb/0x160 [ 5113.007968][ C2] cpu_startup_entry+0x55/0x60 [ 5113.007970][ C2] start_secondary+0x21c/0x2b0 [ 5113.007973][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5113.007977][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5113.007982][ C2] [ 5140.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2596s! [perl:4135] [ 5140.569714][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5140.570979][ C1] irq event stamp: 209232 [ 5140.571199][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5140.571728][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5140.572206][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5140.572678][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5140.573141][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5140.573591][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5140.574202][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5140.574528][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5140.575502][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5140.575810][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5140.576211][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5140.576611][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5140.577010][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5140.577410][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5140.577812][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5140.578268][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5140.578604][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5140.579006][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5140.579404][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5140.579808][ C1] PKRU: 55555554 [ 5140.579990][ C1] Call Trace: [ 5140.580162][ C1] [ 5140.580312][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5140.580575][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5140.580818][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5140.581098][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5140.581371][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5140.581658][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5140.581927][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5140.582232][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5140.582494][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5140.582804][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5140.583101][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5140.583417][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5140.583705][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5140.583994][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5140.584281][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5140.584606][ C1] ? get_stack_info+0x36/0xc0 [ 5140.584848][ C1] ? lock_acquire+0x1c1/0x220 [ 5140.585092][ C1] ? lock_release+0x1d5/0x250 [ 5140.585332][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5140.585581][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5140.585854][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5140.586141][ C1] ? lock_acquire+0x1c1/0x220 [ 5140.586381][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5140.586620][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5140.586882][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5140.587118][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5140.587366][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5140.587624][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5140.587899][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5140.588177][ C1] ip_local_deliver+0x19d/0x480 [ 5140.588423][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5140.588698][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5140.588962][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5140.589309][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5140.589562][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5140.589883][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5140.590146][ C1] ip_rcv+0x564/0x740 [ 5140.590350][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5140.590582][ C1] ? set_track_prepare+0x8a/0xd0 [ 5140.590836][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5140.591114][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5140.591386][ C1] ? skb_clone+0x10b/0x330 [ 5140.591617][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5140.591936][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5140.592244][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5140.592526][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5140.592823][ C1] ? __tcf_classify+0x329/0x7d0 [ 5140.593072][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5140.593305][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5140.593606][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5140.593891][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5140.594217][ C1] ? lock_acquire+0x1c1/0x220 [ 5140.594460][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5140.594758][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5140.595043][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5140.595361][ C1] ? __copy_skb_header+0xaf/0x490 [ 5140.595619][ C1] ? __skb_clone+0x57a/0x760 [ 5140.595855][ C1] netif_receive_skb+0x55/0x280 [ 5140.596103][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5140.596416][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5140.596751][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5140.597051][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5140.597326][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5140.597619][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5140.597931][ C1] ? hlock_class+0x4e/0x130 [ 5140.598165][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5140.598443][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5140.598721][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5140.598985][ C1] ? hlock_class+0x4e/0x130 [ 5140.599217][ C1] ? mark_lock+0x38/0x3e0 [ 5140.599437][ C1] ? stack_access_ok+0xda/0x1f0 [ 5140.599687][ C1] ? __lock_acquire+0xb67/0x1610 [ 5140.599949][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5140.600225][ C1] ? get_stack_info+0x36/0xc0 [ 5140.600467][ C1] ? stack_access_ok+0xda/0x1f0 [ 5140.600715][ C1] ? get_reg+0x119/0x190 [ 5140.600931][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5140.601201][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5140.601513][ C1] __tcf_classify+0x329/0x7d0 [ 5140.601757][ C1] tcf_classify+0x283/0x930 [ 5140.601988][ C1] ? arch_stack_walk+0xa2/0x100 [ 5140.602237][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5140.602494][ C1] ? get_stack_info+0x36/0xc0 [ 5140.602737][ C1] tc_run+0x2e4/0x5d0 [ 5140.602942][ C1] ? __pfx_tc_run+0x10/0x10 [ 5140.603176][ C1] ? lock_acquire+0x1c1/0x220 [ 5140.603417][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5140.603679][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5140.603934][ C1] ? lock_acquire+0x1c1/0x220 [ 5140.604174][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5140.604446][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5140.604751][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5140.605024][ C1] ? neigh_hh_output+0x348/0x590 [ 5140.605277][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5140.605544][ C1] ip_finish_output2+0x786/0x18e0 [ 5140.605802][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5140.606082][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5140.606421][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5140.606696][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5140.606949][ C1] ? __ip_finish_output+0x10f/0x770 [ 5140.607216][ C1] ip_output+0x16b/0x4f0 [ 5140.607437][ C1] ? run_timer_softirq+0x72/0x100 [ 5140.607696][ C1] ? __pfx_ip_output+0x10/0x10 [ 5140.607942][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5140.608229][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5140.608482][ C1] ? ip_local_out+0x114/0x3b0 [ 5140.608723][ C1] __ip_queue_xmit+0x672/0x1910 [ 5140.608972][ C1] ? __create_object+0x5e/0xb0 [ 5140.609216][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5140.609484][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5140.609765][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5140.610038][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5140.610321][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5140.610594][ C1] tcp_delack_timer+0x84/0x240 [ 5140.610839][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5140.611111][ C1] call_timer_fn+0x173/0x430 [ 5140.611349][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5140.611612][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5140.611874][ C1] __run_timers.part.0+0x52d/0x890 [ 5140.612135][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5140.612409][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5140.612694][ C1] ? lock_acquire+0x1c1/0x220 [ 5140.612936][ C1] ? clockevents_program_event+0xf6/0x300 [ 5140.613228][ C1] ? lock_release+0x1d5/0x250 [ 5140.613466][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5140.613731][ C1] ? ktime_get+0xb3/0x190 [ 5140.613952][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5140.614250][ C1] run_timer_softirq+0x72/0x100 [ 5140.614503][ C1] __do_softirq+0x1b9/0x7ff [ 5140.614737][ C1] irq_exit_rcu+0x98/0xc0 [ 5140.614960][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5140.615248][ C1] [ 5140.615397][ C1] [ 5140.615551][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5140.615856][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5140.616183][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5140.617157][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5140.617465][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5140.617864][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5140.618265][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5140.618663][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5140.619064][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5140.619468][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5140.619764][ C1] pipe_read+0xa16/0xdf0 [ 5140.619988][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5140.620266][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5140.620510][ C1] ? iterate_tty_write+0x299/0x540 [ 5140.620772][ C1] ? lock_release+0x1d5/0x250 [ 5140.621015][ C1] vfs_read+0x911/0xc00 [ 5140.621233][ C1] ? lock_acquire+0x1c1/0x220 [ 5140.621473][ C1] ? __might_fault+0xc6/0x180 [ 5140.621715][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5140.621956][ C1] ? __might_fault+0xc6/0x180 [ 5140.622197][ C1] ? lock_release+0x1d5/0x250 [ 5140.622439][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5140.622703][ C1] ? __fget_light+0x54/0x1e0 [ 5140.622941][ C1] ksys_read+0x17a/0x1e0 [ 5140.623159][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5140.623405][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5140.623710][ C1] do_syscall_64+0xc9/0x1e0 [ 5140.623944][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5140.624247][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5140.624479][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5140.625452][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5140.625875][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5140.626273][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5140.626674][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5140.627073][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5140.627470][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5140.627872][ C1] [ 5140.628031][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2596s! [swapper/2:0] [ 5140.628451][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5140.629711][ C2] irq event stamp: 44114564 [ 5140.629944][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5140.630478][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5140.630990][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5140.631469][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5140.631943][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5140.632401][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5140.633020][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5140.633347][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5140.634324][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5140.634636][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5140.635036][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5140.635435][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5140.635834][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5140.636239][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5140.636638][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5140.637086][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5140.637420][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5140.637823][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5140.638225][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5140.638625][ C2] PKRU: 55555554 [ 5140.638807][ C2] Call Trace: [ 5140.638977][ C2] [ 5140.639127][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5140.639391][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5140.639636][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5140.639917][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5140.640191][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5140.640482][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5140.640748][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5140.641058][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5140.641321][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5140.641585][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5140.641896][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5140.642193][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5140.642508][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5140.642798][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5140.643092][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5140.643383][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5140.643695][ C2] ? get_stack_info+0x36/0xc0 [ 5140.643934][ C2] ? lock_acquire+0x1c1/0x220 [ 5140.644175][ C2] ? lock_release+0x1d5/0x250 [ 5140.644416][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5140.644671][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5140.644942][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5140.645226][ C2] ? lock_acquire+0x1c1/0x220 [ 5140.645465][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5140.645707][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5140.645967][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5140.646203][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5140.646448][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5140.646705][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5140.646982][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5140.647257][ C2] ip_local_deliver+0x19d/0x480 [ 5140.647507][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5140.647778][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5140.648039][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5140.648388][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5140.648640][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5140.648959][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5140.649221][ C2] ip_rcv+0x564/0x740 [ 5140.649424][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5140.649652][ C2] ? set_track_prepare+0x8a/0xd0 [ 5140.649905][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5140.650183][ C2] ? start_secondary+0x21c/0x2b0 [ 5140.650434][ C2] ? skb_clone+0x10b/0x330 [ 5140.650661][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5140.650978][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5140.651284][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5140.651564][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5140.651858][ C2] ? __tcf_classify+0x329/0x7d0 [ 5140.652106][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5140.652335][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5140.652636][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5140.652918][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5140.653243][ C2] ? lock_acquire+0x1c1/0x220 [ 5140.653482][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5140.653779][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5140.654063][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5140.654381][ C2] ? __copy_skb_header+0xaf/0x490 [ 5140.654643][ C2] ? __skb_clone+0x57a/0x760 [ 5140.654878][ C2] netif_receive_skb+0x55/0x280 [ 5140.655127][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5140.655439][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5140.655771][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5140.656070][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5140.656346][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5140.656636][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5140.656948][ C2] ? get_stack_info+0x36/0xc0 [ 5140.657187][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5140.657451][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5140.657766][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5140.658043][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5140.658319][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5140.658633][ C2] ? kernel_text_address+0x17/0xe0 [ 5140.658892][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5140.659204][ C2] ? arch_stack_walk+0x8c/0x100 [ 5140.659453][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5140.659718][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5140.660002][ C2] ? lock_acquire+0x1c1/0x220 [ 5140.660241][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5140.660523][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5140.660827][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5140.661105][ C2] ? get_stack_info+0x36/0xc0 [ 5140.661344][ C2] __tcf_classify+0x329/0x7d0 [ 5140.661587][ C2] tcf_classify+0x283/0x930 [ 5140.661820][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5140.662075][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5140.662389][ C2] tc_run+0x2e4/0x5d0 [ 5140.662592][ C2] ? __pfx_tc_run+0x10/0x10 [ 5140.662822][ C2] ? lock_acquire+0x1c1/0x220 [ 5140.663061][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5140.663323][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5140.663576][ C2] ? lock_acquire+0x1c1/0x220 [ 5140.663814][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5140.664077][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5140.664384][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5140.664659][ C2] ? neigh_hh_output+0x348/0x590 [ 5140.664911][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5140.665174][ C2] ip_finish_output2+0x786/0x18e0 [ 5140.665431][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5140.665768][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5140.666046][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5140.666298][ C2] ? __ip_finish_output+0x10f/0x770 [ 5140.666566][ C2] ip_output+0x16b/0x4f0 [ 5140.666781][ C2] ? __pfx_ip_output+0x10/0x10 [ 5140.667023][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5140.667299][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5140.667613][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5140.667889][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5140.668140][ C2] ? __alloc_skb+0xd4/0x280 [ 5140.668372][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5140.668640][ C2] ? tcp_fragment+0x168/0x1040 [ 5140.668884][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5140.669135][ C2] ? ip_local_out+0x114/0x3b0 [ 5140.669374][ C2] __ip_queue_xmit+0x672/0x1910 [ 5140.669621][ C2] ? __skb_clone+0x57a/0x760 [ 5140.669855][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5140.670121][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5140.670404][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5140.670647][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5140.670895][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5140.671197][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5140.671515][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5140.671759][ C2] tcp_send_loss_probe+0x348/0x830 [ 5140.672019][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5140.672287][ C2] tcp_write_timer+0x82/0x1d0 [ 5140.672528][ C2] call_timer_fn+0x173/0x430 [ 5140.672765][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5140.673026][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5140.673287][ C2] __run_timers.part.0+0x52d/0x890 [ 5140.673547][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5140.673816][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5140.674099][ C2] ? lock_acquire+0x1c1/0x220 [ 5140.674339][ C2] ? clockevents_program_event+0xf6/0x300 [ 5140.674635][ C2] ? lock_release+0x1d5/0x250 [ 5140.674871][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5140.675138][ C2] ? ktime_get+0xb3/0x190 [ 5140.675360][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5140.675658][ C2] run_timer_softirq+0x72/0x100 [ 5140.675905][ C2] __do_softirq+0x1b9/0x7ff [ 5140.676138][ C2] irq_exit_rcu+0x98/0xc0 [ 5140.676357][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5140.676643][ C2] [ 5140.676792][ C2] [ 5140.676944][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5140.677247][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5140.677503][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5140.678472][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5140.678778][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5140.679179][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5140.679578][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5140.679974][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5140.680371][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5140.680774][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5140.681061][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5140.681321][ C2] default_idle_call+0x69/0xa0 [ 5140.681564][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5140.681818][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5140.682093][ C2] ? lock_release+0x1d5/0x250 [ 5140.682333][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5140.682605][ C2] do_idle+0xfb/0x160 [ 5140.682811][ C2] cpu_startup_entry+0x55/0x60 [ 5140.683053][ C2] start_secondary+0x21c/0x2b0 [ 5140.683299][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5140.683567][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5140.683879][ C2] [ 5168.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2622s! [perl:4135] [ 5168.569719][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5168.570983][ C1] irq event stamp: 209232 [ 5168.571205][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5168.571746][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5168.572222][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5168.572694][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5168.573158][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5168.573606][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5168.574219][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5168.574548][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5168.575521][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5168.575828][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5168.576229][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5168.576628][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5168.577026][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5168.577424][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5168.577825][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5168.578273][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5168.578606][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5168.579007][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5168.579407][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5168.579807][ C1] PKRU: 55555554 [ 5168.579990][ C1] Call Trace: [ 5168.580159][ C1] [ 5168.580310][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5168.580574][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5168.580817][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5168.581095][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5168.581368][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5168.581657][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5168.581926][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5168.582233][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5168.582495][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5168.582804][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5168.583101][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5168.583418][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5168.583706][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5168.584004][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5168.584293][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5168.584608][ C1] ? get_stack_info+0x36/0xc0 [ 5168.584850][ C1] ? lock_acquire+0x1c1/0x220 [ 5168.585092][ C1] ? lock_release+0x1d5/0x250 [ 5168.585332][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5168.585581][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5168.585855][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5168.586140][ C1] ? lock_acquire+0x1c1/0x220 [ 5168.586380][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5168.586622][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5168.586883][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5168.587119][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5168.587366][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5168.587624][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5168.587900][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5168.588179][ C1] ip_local_deliver+0x19d/0x480 [ 5168.588427][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5168.588698][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5168.588962][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5168.589308][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5168.589561][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5168.589882][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5168.590145][ C1] ip_rcv+0x564/0x740 [ 5168.590350][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5168.590581][ C1] ? set_track_prepare+0x8a/0xd0 [ 5168.590834][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5168.591111][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5168.591387][ C1] ? skb_clone+0x10b/0x330 [ 5168.591614][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5168.591933][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5168.592239][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5168.592529][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5168.592829][ C1] ? __tcf_classify+0x329/0x7d0 [ 5168.593079][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5168.593308][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5168.593610][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5168.593894][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5168.594221][ C1] ? lock_acquire+0x1c1/0x220 [ 5168.594466][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5168.594764][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5168.595048][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5168.595370][ C1] ? __copy_skb_header+0xaf/0x490 [ 5168.595628][ C1] ? __skb_clone+0x57a/0x760 [ 5168.595864][ C1] netif_receive_skb+0x55/0x280 [ 5168.596113][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5168.596427][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5168.596760][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5168.597059][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5168.597336][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5168.597627][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5168.597941][ C1] ? hlock_class+0x4e/0x130 [ 5168.598173][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5168.598452][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5168.598728][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5168.598992][ C1] ? hlock_class+0x4e/0x130 [ 5168.599224][ C1] ? mark_lock+0x38/0x3e0 [ 5168.599443][ C1] ? stack_access_ok+0xda/0x1f0 [ 5168.599693][ C1] ? __lock_acquire+0xb67/0x1610 [ 5168.599947][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5168.600223][ C1] ? get_stack_info+0x36/0xc0 [ 5168.600463][ C1] ? stack_access_ok+0xda/0x1f0 [ 5168.600711][ C1] ? get_reg+0x119/0x190 [ 5168.600926][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5168.601195][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5168.601503][ C1] __tcf_classify+0x329/0x7d0 [ 5168.601746][ C1] tcf_classify+0x283/0x930 [ 5168.601979][ C1] ? arch_stack_walk+0xa2/0x100 [ 5168.602228][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5168.602485][ C1] ? get_stack_info+0x36/0xc0 [ 5168.602724][ C1] tc_run+0x2e4/0x5d0 [ 5168.602931][ C1] ? __pfx_tc_run+0x10/0x10 [ 5168.603162][ C1] ? lock_acquire+0x1c1/0x220 [ 5168.603401][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5168.603662][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5168.603916][ C1] ? lock_acquire+0x1c1/0x220 [ 5168.604154][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5168.604423][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5168.604727][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5168.605001][ C1] ? neigh_hh_output+0x348/0x590 [ 5168.605254][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5168.605518][ C1] ip_finish_output2+0x786/0x18e0 [ 5168.605775][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5168.606052][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5168.606389][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5168.606667][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5168.606920][ C1] ? __ip_finish_output+0x10f/0x770 [ 5168.607186][ C1] ip_output+0x16b/0x4f0 [ 5168.607402][ C1] ? run_timer_softirq+0x72/0x100 [ 5168.607659][ C1] ? __pfx_ip_output+0x10/0x10 [ 5168.607903][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5168.608189][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5168.608442][ C1] ? ip_local_out+0x114/0x3b0 [ 5168.608684][ C1] __ip_queue_xmit+0x672/0x1910 [ 5168.608933][ C1] ? __create_object+0x5e/0xb0 [ 5168.609179][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5168.609447][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5168.609727][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5168.610001][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5168.610284][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5168.610555][ C1] tcp_delack_timer+0x84/0x240 [ 5168.610800][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5168.611071][ C1] call_timer_fn+0x173/0x430 [ 5168.611309][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5168.611571][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5168.611832][ C1] __run_timers.part.0+0x52d/0x890 [ 5168.612092][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5168.612365][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5168.612652][ C1] ? lock_acquire+0x1c1/0x220 [ 5168.612889][ C1] ? clockevents_program_event+0xf6/0x300 [ 5168.613181][ C1] ? lock_release+0x1d5/0x250 [ 5168.613420][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5168.613685][ C1] ? ktime_get+0xb3/0x190 [ 5168.613905][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5168.614204][ C1] run_timer_softirq+0x72/0x100 [ 5168.614457][ C1] __do_softirq+0x1b9/0x7ff [ 5168.614687][ C1] irq_exit_rcu+0x98/0xc0 [ 5168.614910][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5168.615196][ C1] [ 5168.615349][ C1] [ 5168.615498][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5168.615803][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5168.616128][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5168.617099][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5168.617407][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5168.617806][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5168.618204][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5168.618603][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5168.619003][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5168.619404][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5168.619701][ C1] pipe_read+0xa16/0xdf0 [ 5168.619921][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5168.620198][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5168.620442][ C1] ? iterate_tty_write+0x299/0x540 [ 5168.620703][ C1] ? lock_release+0x1d5/0x250 [ 5168.620945][ C1] vfs_read+0x911/0xc00 [ 5168.621158][ C1] ? lock_acquire+0x1c1/0x220 [ 5168.621398][ C1] ? __might_fault+0xc6/0x180 [ 5168.621640][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5168.621884][ C1] ? __might_fault+0xc6/0x180 [ 5168.622123][ C1] ? lock_release+0x1d5/0x250 [ 5168.622363][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5168.622628][ C1] ? __fget_light+0x54/0x1e0 [ 5168.622865][ C1] ksys_read+0x17a/0x1e0 [ 5168.623082][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5168.623326][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5168.623632][ C1] do_syscall_64+0xc9/0x1e0 [ 5168.623863][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5168.624164][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5168.624397][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5168.625367][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5168.625787][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5168.626188][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5168.626587][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5168.626985][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5168.627383][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5168.627786][ C1] [ 5168.627943][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2622s! [swapper/2:0] [ 5168.628369][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5168.629620][ C2] irq event stamp: 44114564 [ 5168.629848][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5168.630385][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5168.630897][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5168.631373][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5168.631844][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5168.632301][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5168.632911][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5168.633236][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5168.634206][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5168.634521][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5168.634925][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5168.635324][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5168.635722][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5168.636120][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5168.636518][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5168.636963][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5168.637296][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5168.637698][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5168.638096][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5168.638495][ C2] PKRU: 55555554 [ 5168.638675][ C2] Call Trace: [ 5168.638847][ C2] [ 5168.638994][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5168.639257][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5168.639501][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5168.639780][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5168.640053][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5168.640340][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5168.640605][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5168.640910][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5168.641170][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5168.641431][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5168.641740][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5168.642041][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5168.642355][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5168.642643][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5168.642939][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5168.643226][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5168.643538][ C2] ? get_stack_info+0x36/0xc0 [ 5168.643778][ C2] ? lock_acquire+0x1c1/0x220 [ 5168.644021][ C2] ? lock_release+0x1d5/0x250 [ 5168.644258][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5168.644512][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5168.644784][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5168.645068][ C2] ? lock_acquire+0x1c1/0x220 [ 5168.645308][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5168.645552][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5168.645812][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5168.646046][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5168.646294][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5168.646551][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5168.646825][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5168.647104][ C2] ip_local_deliver+0x19d/0x480 [ 5168.647351][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5168.647623][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5168.647886][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5168.648232][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5168.648483][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5168.648802][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5168.649063][ C2] ip_rcv+0x564/0x740 [ 5168.649267][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5168.649498][ C2] ? set_track_prepare+0x8a/0xd0 [ 5168.649751][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5168.650027][ C2] ? start_secondary+0x21c/0x2b0 [ 5168.650278][ C2] ? skb_clone+0x10b/0x330 [ 5168.650505][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5168.650825][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5168.651128][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5168.651411][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5168.651703][ C2] ? __tcf_classify+0x329/0x7d0 [ 5168.651951][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5168.652182][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5168.652481][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5168.652767][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5168.653091][ C2] ? lock_acquire+0x1c1/0x220 [ 5168.653331][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5168.653626][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5168.653912][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5168.654230][ C2] ? __copy_skb_header+0xaf/0x490 [ 5168.654491][ C2] ? __skb_clone+0x57a/0x760 [ 5168.654723][ C2] netif_receive_skb+0x55/0x280 [ 5168.654971][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5168.655285][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5168.655616][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5168.655915][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5168.656189][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5168.656476][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5168.656788][ C2] ? get_stack_info+0x36/0xc0 [ 5168.657030][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5168.657294][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5168.657614][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5168.657889][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5168.658169][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5168.658485][ C2] ? kernel_text_address+0x17/0xe0 [ 5168.658745][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5168.659056][ C2] ? arch_stack_walk+0x8c/0x100 [ 5168.659305][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5168.659568][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5168.659852][ C2] ? lock_acquire+0x1c1/0x220 [ 5168.660092][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5168.660372][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5168.660677][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5168.660952][ C2] ? get_stack_info+0x36/0xc0 [ 5168.661194][ C2] __tcf_classify+0x329/0x7d0 [ 5168.661436][ C2] tcf_classify+0x283/0x930 [ 5168.661666][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5168.661922][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5168.662235][ C2] tc_run+0x2e4/0x5d0 [ 5168.662438][ C2] ? __pfx_tc_run+0x10/0x10 [ 5168.662670][ C2] ? lock_acquire+0x1c1/0x220 [ 5168.662908][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5168.663170][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5168.663423][ C2] ? lock_acquire+0x1c1/0x220 [ 5168.663661][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5168.663927][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5168.664228][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5168.664508][ C2] ? neigh_hh_output+0x348/0x590 [ 5168.664760][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5168.665025][ C2] ip_finish_output2+0x786/0x18e0 [ 5168.665283][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5168.665620][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5168.665896][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5168.666149][ C2] ? __ip_finish_output+0x10f/0x770 [ 5168.666414][ C2] ip_output+0x16b/0x4f0 [ 5168.666633][ C2] ? __pfx_ip_output+0x10/0x10 [ 5168.666876][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5168.667157][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5168.667472][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5168.667748][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5168.667999][ C2] ? __alloc_skb+0xd4/0x280 [ 5168.668230][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5168.668500][ C2] ? tcp_fragment+0x168/0x1040 [ 5168.668744][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5168.668998][ C2] ? ip_local_out+0x114/0x3b0 [ 5168.669239][ C2] __ip_queue_xmit+0x672/0x1910 [ 5168.669488][ C2] ? __skb_clone+0x57a/0x760 [ 5168.669725][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5168.669995][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5168.670277][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5168.670523][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5168.670772][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5168.671075][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5168.671396][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5168.671639][ C2] tcp_send_loss_probe+0x348/0x830 [ 5168.671902][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5168.672171][ C2] tcp_write_timer+0x82/0x1d0 [ 5168.672411][ C2] call_timer_fn+0x173/0x430 [ 5168.672648][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5168.672910][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5168.673172][ C2] __run_timers.part.0+0x52d/0x890 [ 5168.673432][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5168.673702][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5168.673988][ C2] ? lock_acquire+0x1c1/0x220 [ 5168.674231][ C2] ? clockevents_program_event+0xf6/0x300 [ 5168.674525][ C2] ? lock_release+0x1d5/0x250 [ 5168.674765][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5168.675030][ C2] ? ktime_get+0xb3/0x190 [ 5168.675253][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5168.675549][ C2] run_timer_softirq+0x72/0x100 [ 5168.675797][ C2] __do_softirq+0x1b9/0x7ff [ 5168.676032][ C2] irq_exit_rcu+0x98/0xc0 [ 5168.676251][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5168.676538][ C2] [ 5168.676688][ C2] [ 5168.676837][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5168.677145][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5168.677402][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5168.678372][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5168.678681][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5168.679078][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5168.679476][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5168.679874][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5168.680271][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5168.680673][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5168.680964][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5168.681226][ C2] default_idle_call+0x69/0xa0 [ 5168.681469][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5168.681720][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5168.681998][ C2] ? lock_release+0x1d5/0x250 [ 5168.682238][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5168.682512][ C2] do_idle+0xfb/0x160 [ 5168.682715][ C2] cpu_startup_entry+0x55/0x60 [ 5168.682957][ C2] start_secondary+0x21c/0x2b0 [ 5168.683200][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5168.683469][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5168.683783][ C2] [ 5191.007103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5191.007470][ C1] rcu: 1-....: (2829015 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=690399 [ 5191.008024][ C1] rcu: (t=2836120 jiffies g=1882453 q=712 ncpus=4) [ 5191.008358][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5191.008806][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5191.009420][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 5191.009709][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 5191.010680][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000282 [ 5191.010987][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5191.011387][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5191.011786][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5191.012185][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5191.012584][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5191.012987][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5191.013439][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5191.013771][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5191.014171][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5191.014577][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5191.014977][ C1] PKRU: 55555554 [ 5191.015160][ C1] Call Trace: [ 5191.015329][ C1] [ 5191.015480][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5191.015753][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5191.016006][ C1] ? check_cpu_stall+0x284/0x500 [ 5191.016259][ C1] ? rcu_pending+0x92/0x360 [ 5191.016488][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5191.016760][ C1] ? update_process_times+0xb9/0x110 [ 5191.017031][ C1] ? tick_sched_handle+0x67/0x130 [ 5191.017288][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5191.017572][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5191.017815][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5191.018128][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5191.018401][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5191.018690][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5191.018956][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5191.019261][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5191.019522][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 5191.019784][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5191.020098][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5191.020395][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5191.020711][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5191.021002][ C1] ? kasan_check_range+0x1b/0x1c0 [ 5191.021259][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5191.021542][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5191.021854][ C1] ? get_stack_info+0x36/0xc0 [ 5191.022095][ C1] ? lock_acquire+0x1c1/0x220 [ 5191.022336][ C1] ? lock_release+0x1d5/0x250 [ 5191.022576][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5191.022826][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5191.023099][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5191.023383][ C1] ? lock_acquire+0x1c1/0x220 [ 5191.023621][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5191.023866][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5191.024126][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5191.024366][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5191.024613][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5191.024871][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5191.025147][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5191.025426][ C1] ip_local_deliver+0x19d/0x480 [ 5191.025674][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5191.025945][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5191.026208][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5191.026559][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5191.026812][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5191.027132][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5191.027395][ C1] ip_rcv+0x564/0x740 [ 5191.027599][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5191.027830][ C1] ? set_track_prepare+0x8a/0xd0 [ 5191.028084][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5191.028362][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5191.028634][ C1] ? skb_clone+0x10b/0x330 [ 5191.028863][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5191.029183][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5191.029488][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5191.029773][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5191.030066][ C1] ? __tcf_classify+0x329/0x7d0 [ 5191.030315][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5191.030546][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5191.030845][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5191.031132][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5191.031458][ C1] ? lock_acquire+0x1c1/0x220 [ 5191.031697][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5191.031992][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5191.032279][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5191.032596][ C1] ? __copy_skb_header+0xaf/0x490 [ 5191.032853][ C1] ? __skb_clone+0x57a/0x760 [ 5191.033087][ C1] netif_receive_skb+0x55/0x280 [ 5191.033339][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5191.033652][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5191.033984][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5191.034291][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5191.034565][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5191.034853][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5191.035166][ C1] ? hlock_class+0x4e/0x130 [ 5191.035400][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5191.035676][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5191.035951][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5191.036216][ C1] ? hlock_class+0x4e/0x130 [ 5191.036447][ C1] ? mark_lock+0x38/0x3e0 [ 5191.036667][ C1] ? stack_access_ok+0xda/0x1f0 [ 5191.036916][ C1] ? __lock_acquire+0xb67/0x1610 [ 5191.037169][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5191.037447][ C1] ? get_stack_info+0x36/0xc0 [ 5191.037686][ C1] ? stack_access_ok+0xda/0x1f0 [ 5191.037933][ C1] ? get_reg+0x119/0x190 [ 5191.038151][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5191.038419][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5191.038728][ C1] __tcf_classify+0x329/0x7d0 [ 5191.038969][ C1] tcf_classify+0x283/0x930 [ 5191.039202][ C1] ? arch_stack_walk+0xa2/0x100 [ 5191.039452][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5191.039709][ C1] ? get_stack_info+0x36/0xc0 [ 5191.039951][ C1] tc_run+0x2e4/0x5d0 [ 5191.040156][ C1] ? __pfx_tc_run+0x10/0x10 [ 5191.040386][ C1] ? lock_acquire+0x1c1/0x220 [ 5191.040624][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5191.040885][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5191.041138][ C1] ? lock_acquire+0x1c1/0x220 [ 5191.041377][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5191.041642][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5191.041948][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5191.042220][ C1] ? neigh_hh_output+0x348/0x590 [ 5191.042473][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5191.042738][ C1] ip_finish_output2+0x786/0x18e0 [ 5191.042994][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5191.043272][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5191.043610][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5191.043886][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5191.044140][ C1] ? __ip_finish_output+0x10f/0x770 [ 5191.044408][ C1] ip_output+0x16b/0x4f0 [ 5191.044624][ C1] ? run_timer_softirq+0x72/0x100 [ 5191.044881][ C1] ? __pfx_ip_output+0x10/0x10 [ 5191.045125][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5191.045413][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5191.045666][ C1] ? ip_local_out+0x114/0x3b0 [ 5191.045905][ C1] __ip_queue_xmit+0x672/0x1910 [ 5191.046154][ C1] ? __create_object+0x5e/0xb0 [ 5191.046399][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5191.046666][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5191.046948][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5191.047222][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5191.047503][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5191.047776][ C1] tcp_delack_timer+0x84/0x240 [ 5191.048020][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5191.048292][ C1] call_timer_fn+0x173/0x430 [ 5191.048527][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5191.048789][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5191.049049][ C1] __run_timers.part.0+0x52d/0x890 [ 5191.049309][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5191.049587][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5191.049871][ C1] ? lock_acquire+0x1c1/0x220 [ 5191.050109][ C1] ? clockevents_program_event+0xf6/0x300 [ 5191.050399][ C1] ? lock_release+0x1d5/0x250 [ 5191.050640][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5191.050903][ C1] ? ktime_get+0xb3/0x190 [ 5191.051126][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5191.051421][ C1] run_timer_softirq+0x72/0x100 [ 5191.051669][ C1] __do_softirq+0x1b9/0x7ff [ 5191.051903][ C1] irq_exit_rcu+0x98/0xc0 [ 5191.052126][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5191.052412][ C1] [ 5191.052562][ C1] [ 5191.052712][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5191.053017][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5191.053342][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5191.054319][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5191.054628][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5191.055027][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5191.055429][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5191.055827][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5191.056225][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5191.056625][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5191.056923][ C1] pipe_read+0xa16/0xdf0 [ 5191.057142][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5191.057424][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5191.057666][ C1] ? iterate_tty_write+0x299/0x540 [ 5191.057928][ C1] ? lock_release+0x1d5/0x250 [ 5191.058167][ C1] vfs_read+0x911/0xc00 [ 5191.058383][ C1] ? lock_acquire+0x1c1/0x220 [ 5191.058620][ C1] ? __might_fault+0xc6/0x180 [ 5191.058862][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5191.059102][ C1] ? __might_fault+0xc6/0x180 [ 5191.059342][ C1] ? lock_release+0x1d5/0x250 [ 5191.059580][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5191.059846][ C1] ? __fget_light+0x54/0x1e0 [ 5191.060082][ C1] ksys_read+0x17a/0x1e0 [ 5191.060301][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5191.060543][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5191.060849][ C1] do_syscall_64+0xc9/0x1e0 [ 5191.061082][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5191.061380][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5191.061608][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5191.062576][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5191.062997][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5191.063396][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5191.063794][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5191.064193][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5191.064597][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5191.064999][ C1] [ 5191.065156][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5191.065430][ C2] NMI backtrace for cpu 2 [ 5191.065437][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5191.065443][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5191.065447][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5191.065458][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5191.065463][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5191.065469][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5191.065473][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5191.065477][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5191.065481][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5191.065485][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5191.065489][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5191.065493][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5191.065499][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5191.065503][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5191.065506][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5191.065510][ C2] PKRU: 55555554 [ 5191.065512][ C2] Call Trace: [ 5191.065515][ C2] [ 5191.065520][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5191.065531][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5191.065540][ C2] ? nmi_handle+0x153/0x420 [ 5191.065550][ C2] ? default_do_nmi+0x41/0x100 [ 5191.065557][ C2] ? exc_nmi+0xf3/0x120 [ 5191.065563][ C2] ? end_repeat_nmi+0xf/0x60 [ 5191.065575][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5191.065583][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5191.065591][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5191.065599][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5191.065607][ C2] [ 5191.065609][ C2] [ 5191.065612][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5191.065619][ C2] ? get_stack_info+0x36/0xc0 [ 5191.065627][ C2] ? lock_acquire+0x1c1/0x220 [ 5191.065631][ C2] ? lock_release+0x1d5/0x250 [ 5191.065635][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5191.065638][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5191.065641][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5191.065644][ C2] ? lock_acquire+0x1c1/0x220 [ 5191.065647][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5191.065650][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5191.065653][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5191.065660][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5191.065662][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5191.065666][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5191.065672][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5191.065675][ C2] ip_local_deliver+0x19d/0x480 [ 5191.065677][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5191.065679][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5191.065681][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5191.065687][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5191.065691][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5191.065694][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5191.065703][ C2] ip_rcv+0x564/0x740 [ 5191.065705][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5191.065708][ C2] ? set_track_prepare+0x8a/0xd0 [ 5191.065712][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5191.065715][ C2] ? start_secondary+0x21c/0x2b0 [ 5191.065719][ C2] ? skb_clone+0x10b/0x330 [ 5191.065722][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5191.065728][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5191.065733][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5191.065738][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5191.065746][ C2] ? __tcf_classify+0x329/0x7d0 [ 5191.065749][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5191.065752][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5191.065755][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5191.065758][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5191.065762][ C2] ? lock_acquire+0x1c1/0x220 [ 5191.065764][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5191.065769][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5191.065772][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5191.065776][ C2] ? __copy_skb_header+0xaf/0x490 [ 5191.065781][ C2] ? __skb_clone+0x57a/0x760 [ 5191.065783][ C2] netif_receive_skb+0x55/0x280 [ 5191.065786][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5191.065794][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5191.065800][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5191.065807][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5191.065811][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5191.065821][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5191.065829][ C2] ? get_stack_info+0x36/0xc0 [ 5191.065833][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5191.065836][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5191.065841][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5191.065844][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5191.065847][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5191.065850][ C2] ? kernel_text_address+0x17/0xe0 [ 5191.065853][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5191.065858][ C2] ? arch_stack_walk+0x8c/0x100 [ 5191.065862][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5191.065865][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5191.065868][ C2] ? lock_acquire+0x1c1/0x220 [ 5191.065870][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5191.065875][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5191.065879][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5191.065882][ C2] ? get_stack_info+0x36/0xc0 [ 5191.065886][ C2] __tcf_classify+0x329/0x7d0 [ 5191.065891][ C2] tcf_classify+0x283/0x930 [ 5191.065896][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5191.065899][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5191.065904][ C2] tc_run+0x2e4/0x5d0 [ 5191.065907][ C2] ? __pfx_tc_run+0x10/0x10 [ 5191.065910][ C2] ? lock_acquire+0x1c1/0x220 [ 5191.065913][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5191.065916][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5191.065921][ C2] ? lock_acquire+0x1c1/0x220 [ 5191.065923][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5191.065926][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5191.065929][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5191.065932][ C2] ? neigh_hh_output+0x348/0x590 [ 5191.065935][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5191.065939][ C2] ip_finish_output2+0x786/0x18e0 [ 5191.065942][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5191.065950][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5191.065952][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5191.065956][ C2] ? __ip_finish_output+0x10f/0x770 [ 5191.065960][ C2] ip_output+0x16b/0x4f0 [ 5191.065963][ C2] ? __pfx_ip_output+0x10/0x10 [ 5191.065965][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5191.065968][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5191.065971][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5191.065974][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5191.065977][ C2] ? __alloc_skb+0xd4/0x280 [ 5191.065979][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5191.065983][ C2] ? tcp_fragment+0x168/0x1040 [ 5191.065987][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5191.065990][ C2] ? ip_local_out+0x114/0x3b0 [ 5191.065993][ C2] __ip_queue_xmit+0x672/0x1910 [ 5191.065997][ C2] ? __skb_clone+0x57a/0x760 [ 5191.065999][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5191.066005][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5191.066008][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5191.066012][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5191.066016][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5191.066021][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5191.066024][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5191.066027][ C2] tcp_send_loss_probe+0x348/0x830 [ 5191.066031][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5191.066033][ C2] tcp_write_timer+0x82/0x1d0 [ 5191.066037][ C2] call_timer_fn+0x173/0x430 [ 5191.066041][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5191.066046][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5191.066050][ C2] __run_timers.part.0+0x52d/0x890 [ 5191.066053][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5191.066057][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5191.066060][ C2] ? lock_acquire+0x1c1/0x220 [ 5191.066062][ C2] ? clockevents_program_event+0xf6/0x300 [ 5191.066066][ C2] ? lock_release+0x1d5/0x250 [ 5191.066069][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5191.066072][ C2] ? ktime_get+0xb3/0x190 [ 5191.066075][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5191.066080][ C2] run_timer_softirq+0x72/0x100 [ 5191.066083][ C2] __do_softirq+0x1b9/0x7ff [ 5191.066087][ C2] irq_exit_rcu+0x98/0xc0 [ 5191.066090][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5191.066093][ C2] [ 5191.066094][ C2] [ 5191.066095][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5191.066098][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5191.066102][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5191.066104][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5191.066106][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5191.066108][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5191.066110][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5191.066111][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5191.066112][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5191.066116][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5191.066119][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5191.066123][ C2] default_idle_call+0x69/0xa0 [ 5191.066126][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5191.066128][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5191.066132][ C2] ? lock_release+0x1d5/0x250 [ 5191.066135][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5191.066139][ C2] do_idle+0xfb/0x160 [ 5191.066142][ C2] cpu_startup_entry+0x55/0x60 [ 5191.066144][ C2] start_secondary+0x21c/0x2b0 [ 5191.066147][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5191.066151][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5191.066157][ C2] [ 5216.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2667s! [perl:4135] [ 5216.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5216.570958][ C1] irq event stamp: 209232 [ 5216.571176][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5216.571708][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5216.572184][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5216.572650][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5216.573116][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5216.573564][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5216.574181][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 5216.574473][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 5216.575441][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000246 [ 5216.575752][ C1] RAX: ffffed10014741c4 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 5216.576151][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5216.576548][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 5216.576946][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5216.577346][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5216.577745][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5216.578192][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5216.578524][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5216.578924][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5216.579326][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5216.579725][ C1] PKRU: 55555554 [ 5216.579908][ C1] Call Trace: [ 5216.580078][ C1] [ 5216.580227][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5216.580490][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5216.580734][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5216.581011][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5216.581283][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5216.581574][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5216.581840][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5216.582147][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5216.582408][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 5216.582669][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5216.582978][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5216.583274][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5216.583589][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5216.583877][ C1] ? kasan_check_range+0x106/0x1c0 [ 5216.584140][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5216.584427][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5216.584739][ C1] ? get_stack_info+0x36/0xc0 [ 5216.584982][ C1] ? lock_acquire+0x1c1/0x220 [ 5216.585220][ C1] ? lock_release+0x1d5/0x250 [ 5216.585461][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5216.585711][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5216.585982][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5216.586269][ C1] ? lock_acquire+0x1c1/0x220 [ 5216.586507][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5216.586748][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5216.587008][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5216.587245][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5216.587492][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5216.587751][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5216.588027][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5216.588301][ C1] ip_local_deliver+0x19d/0x480 [ 5216.588549][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5216.588821][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5216.589086][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5216.589432][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5216.589687][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5216.590007][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5216.590271][ C1] ip_rcv+0x564/0x740 [ 5216.590474][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5216.590706][ C1] ? set_track_prepare+0x8a/0xd0 [ 5216.590959][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5216.591236][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5216.591508][ C1] ? skb_clone+0x10b/0x330 [ 5216.591736][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5216.592056][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5216.592362][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5216.592645][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5216.592939][ C1] ? __tcf_classify+0x329/0x7d0 [ 5216.593188][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5216.593420][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5216.593720][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5216.594005][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5216.594337][ C1] ? lock_acquire+0x1c1/0x220 [ 5216.594577][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5216.594871][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5216.595159][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5216.595476][ C1] ? __copy_skb_header+0xaf/0x490 [ 5216.595734][ C1] ? __skb_clone+0x57a/0x760 [ 5216.595968][ C1] netif_receive_skb+0x55/0x280 [ 5216.596216][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5216.596529][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5216.596860][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5216.597162][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5216.597436][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5216.597725][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5216.598037][ C1] ? hlock_class+0x4e/0x130 [ 5216.598270][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5216.598546][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5216.598825][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5216.599088][ C1] ? hlock_class+0x4e/0x130 [ 5216.599318][ C1] ? mark_lock+0x38/0x3e0 [ 5216.599540][ C1] ? stack_access_ok+0xda/0x1f0 [ 5216.599789][ C1] ? __lock_acquire+0xb67/0x1610 [ 5216.600043][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5216.600319][ C1] ? get_stack_info+0x36/0xc0 [ 5216.600560][ C1] ? stack_access_ok+0xda/0x1f0 [ 5216.600806][ C1] ? get_reg+0x119/0x190 [ 5216.601023][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5216.601290][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5216.601600][ C1] __tcf_classify+0x329/0x7d0 [ 5216.601843][ C1] tcf_classify+0x283/0x930 [ 5216.602073][ C1] ? arch_stack_walk+0xa2/0x100 [ 5216.602323][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5216.602579][ C1] ? get_stack_info+0x36/0xc0 [ 5216.602821][ C1] tc_run+0x2e4/0x5d0 [ 5216.603026][ C1] ? __pfx_tc_run+0x10/0x10 [ 5216.603258][ C1] ? lock_acquire+0x1c1/0x220 [ 5216.603496][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5216.603757][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5216.604010][ C1] ? lock_acquire+0x1c1/0x220 [ 5216.604253][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5216.604517][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5216.604823][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5216.605094][ C1] ? neigh_hh_output+0x348/0x590 [ 5216.605347][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5216.605612][ C1] ip_finish_output2+0x786/0x18e0 [ 5216.605869][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5216.606151][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5216.606488][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5216.606763][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5216.607018][ C1] ? __ip_finish_output+0x10f/0x770 [ 5216.607283][ C1] ip_output+0x16b/0x4f0 [ 5216.607501][ C1] ? run_timer_softirq+0x72/0x100 [ 5216.607759][ C1] ? __pfx_ip_output+0x10/0x10 [ 5216.608003][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5216.608292][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5216.608545][ C1] ? ip_local_out+0x114/0x3b0 [ 5216.608785][ C1] __ip_queue_xmit+0x672/0x1910 [ 5216.609035][ C1] ? __create_object+0x5e/0xb0 [ 5216.609279][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5216.609545][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5216.609832][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5216.610105][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5216.610386][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5216.610660][ C1] tcp_delack_timer+0x84/0x240 [ 5216.610904][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5216.611178][ C1] call_timer_fn+0x173/0x430 [ 5216.611411][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5216.611675][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5216.611936][ C1] __run_timers.part.0+0x52d/0x890 [ 5216.612197][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5216.612471][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5216.612755][ C1] ? lock_acquire+0x1c1/0x220 [ 5216.612994][ C1] ? clockevents_program_event+0xf6/0x300 [ 5216.613286][ C1] ? lock_release+0x1d5/0x250 [ 5216.613524][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5216.613787][ C1] ? ktime_get+0xb3/0x190 [ 5216.614010][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5216.614311][ C1] run_timer_softirq+0x72/0x100 [ 5216.614559][ C1] __do_softirq+0x1b9/0x7ff [ 5216.614793][ C1] irq_exit_rcu+0x98/0xc0 [ 5216.615012][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5216.615300][ C1] [ 5216.615450][ C1] [ 5216.615602][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5216.615906][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5216.616230][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5216.617202][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5216.617509][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5216.617911][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5216.618311][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5216.618709][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5216.619105][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5216.619508][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5216.619802][ C1] pipe_read+0xa16/0xdf0 [ 5216.620024][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5216.620303][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5216.620547][ C1] ? iterate_tty_write+0x299/0x540 [ 5216.620808][ C1] ? lock_release+0x1d5/0x250 [ 5216.621047][ C1] vfs_read+0x911/0xc00 [ 5216.621262][ C1] ? lock_acquire+0x1c1/0x220 [ 5216.621501][ C1] ? __might_fault+0xc6/0x180 [ 5216.621740][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5216.621980][ C1] ? __might_fault+0xc6/0x180 [ 5216.622220][ C1] ? lock_release+0x1d5/0x250 [ 5216.622460][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5216.622724][ C1] ? __fget_light+0x54/0x1e0 [ 5216.622960][ C1] ksys_read+0x17a/0x1e0 [ 5216.623179][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5216.623424][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5216.623727][ C1] do_syscall_64+0xc9/0x1e0 [ 5216.623961][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5216.624265][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5216.624492][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5216.625461][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5216.625884][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5216.626282][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5216.626680][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5216.627081][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5216.627480][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5216.627882][ C1] [ 5216.628040][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2667s! [swapper/2:0] [ 5216.628462][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5216.629712][ C2] irq event stamp: 44114564 [ 5216.629940][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5216.630474][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5216.630985][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5216.631462][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5216.631932][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5216.632387][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5216.632994][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5216.633318][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5216.634291][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5216.634597][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5216.634997][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5216.635395][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5216.635791][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5216.636188][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5216.636588][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5216.637033][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5216.637364][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5216.637763][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5216.638160][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5216.638558][ C2] PKRU: 55555554 [ 5216.638738][ C2] Call Trace: [ 5216.638908][ C2] [ 5216.639055][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5216.639317][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5216.639557][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5216.639836][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5216.640108][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5216.640395][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5216.640661][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5216.640965][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5216.641225][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5216.641489][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5216.641797][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5216.642092][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5216.642409][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5216.642699][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5216.642995][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5216.643281][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5216.643593][ C2] ? get_stack_info+0x36/0xc0 [ 5216.643834][ C2] ? lock_acquire+0x1c1/0x220 [ 5216.644074][ C2] ? lock_release+0x1d5/0x250 [ 5216.644317][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5216.644564][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5216.644838][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5216.645122][ C2] ? lock_acquire+0x1c1/0x220 [ 5216.645360][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5216.645600][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5216.645859][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5216.646092][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5216.646338][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5216.646594][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5216.646866][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5216.647146][ C2] ip_local_deliver+0x19d/0x480 [ 5216.647391][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5216.647662][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5216.647925][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5216.648270][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5216.648522][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5216.648841][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5216.649103][ C2] ip_rcv+0x564/0x740 [ 5216.649306][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5216.649537][ C2] ? set_track_prepare+0x8a/0xd0 [ 5216.649789][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5216.650064][ C2] ? start_secondary+0x21c/0x2b0 [ 5216.650316][ C2] ? skb_clone+0x10b/0x330 [ 5216.650543][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5216.650861][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5216.651164][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5216.651445][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5216.651737][ C2] ? __tcf_classify+0x329/0x7d0 [ 5216.651986][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5216.652217][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5216.652516][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5216.652800][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5216.653124][ C2] ? lock_acquire+0x1c1/0x220 [ 5216.653364][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5216.653658][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5216.653945][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5216.654265][ C2] ? __copy_skb_header+0xaf/0x490 [ 5216.654521][ C2] ? __skb_clone+0x57a/0x760 [ 5216.654753][ C2] netif_receive_skb+0x55/0x280 [ 5216.655001][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5216.655313][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5216.655643][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5216.655943][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5216.656216][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5216.656504][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5216.656812][ C2] ? get_stack_info+0x36/0xc0 [ 5216.657055][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5216.657321][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5216.657638][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5216.657913][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5216.658192][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5216.658506][ C2] ? kernel_text_address+0x17/0xe0 [ 5216.658770][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5216.659082][ C2] ? arch_stack_walk+0x8c/0x100 [ 5216.659328][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5216.659592][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5216.659875][ C2] ? lock_acquire+0x1c1/0x220 [ 5216.660113][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5216.660392][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5216.660697][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5216.660972][ C2] ? get_stack_info+0x36/0xc0 [ 5216.661213][ C2] __tcf_classify+0x329/0x7d0 [ 5216.661455][ C2] tcf_classify+0x283/0x930 [ 5216.661685][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5216.661944][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5216.662257][ C2] tc_run+0x2e4/0x5d0 [ 5216.662462][ C2] ? __pfx_tc_run+0x10/0x10 [ 5216.662692][ C2] ? lock_acquire+0x1c1/0x220 [ 5216.662931][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5216.663191][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5216.663443][ C2] ? lock_acquire+0x1c1/0x220 [ 5216.663680][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5216.663943][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5216.664250][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5216.664522][ C2] ? neigh_hh_output+0x348/0x590 [ 5216.664774][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5216.665038][ C2] ip_finish_output2+0x786/0x18e0 [ 5216.665294][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5216.665630][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5216.665905][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5216.666158][ C2] ? __ip_finish_output+0x10f/0x770 [ 5216.666421][ C2] ip_output+0x16b/0x4f0 [ 5216.666639][ C2] ? __pfx_ip_output+0x10/0x10 [ 5216.666881][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5216.667157][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5216.667469][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5216.667744][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5216.667994][ C2] ? __alloc_skb+0xd4/0x280 [ 5216.668225][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5216.668493][ C2] ? tcp_fragment+0x168/0x1040 [ 5216.668736][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5216.668987][ C2] ? ip_local_out+0x114/0x3b0 [ 5216.669225][ C2] __ip_queue_xmit+0x672/0x1910 [ 5216.669473][ C2] ? __skb_clone+0x57a/0x760 [ 5216.669708][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5216.669973][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5216.670253][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5216.670497][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5216.670745][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5216.671047][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5216.671367][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5216.671609][ C2] tcp_send_loss_probe+0x348/0x830 [ 5216.671869][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5216.672137][ C2] tcp_write_timer+0x82/0x1d0 [ 5216.672375][ C2] call_timer_fn+0x173/0x430 [ 5216.672610][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5216.672871][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5216.673132][ C2] __run_timers.part.0+0x52d/0x890 [ 5216.673390][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5216.673662][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5216.673946][ C2] ? lock_acquire+0x1c1/0x220 [ 5216.674192][ C2] ? clockevents_program_event+0xf6/0x300 [ 5216.674480][ C2] ? lock_release+0x1d5/0x250 [ 5216.674719][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5216.674982][ C2] ? ktime_get+0xb3/0x190 [ 5216.675203][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5216.675497][ C2] run_timer_softirq+0x72/0x100 [ 5216.675746][ C2] __do_softirq+0x1b9/0x7ff [ 5216.675978][ C2] irq_exit_rcu+0x98/0xc0 [ 5216.676197][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5216.676485][ C2] [ 5216.676635][ C2] [ 5216.676783][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5216.677088][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5216.677344][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5216.678311][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5216.678622][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5216.679019][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5216.679418][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5216.679817][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5216.680214][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5216.680613][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5216.680903][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5216.681163][ C2] default_idle_call+0x69/0xa0 [ 5216.681408][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5216.681658][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5216.681935][ C2] ? lock_release+0x1d5/0x250 [ 5216.682174][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5216.682450][ C2] do_idle+0xfb/0x160 [ 5216.682652][ C2] cpu_startup_entry+0x55/0x60 [ 5216.682894][ C2] start_secondary+0x21c/0x2b0 [ 5216.683138][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5216.683406][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5216.683716][ C2] [ 5244.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2693s! [perl:4135] [ 5244.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5244.570958][ C1] irq event stamp: 209232 [ 5244.571176][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5244.571704][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5244.572181][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5244.572650][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5244.573110][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5244.573558][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5244.574175][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5244.574500][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5244.575470][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5244.575779][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5244.576178][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5244.576576][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5244.576975][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5244.577374][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5244.577772][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5244.578221][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5244.578553][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5244.578953][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5244.579356][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5244.579754][ C1] PKRU: 55555554 [ 5244.579936][ C1] Call Trace: [ 5244.580106][ C1] [ 5244.580255][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5244.580518][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5244.580761][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5244.581037][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5244.581308][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5244.581598][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5244.581864][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5244.582171][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5244.582433][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5244.582742][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5244.583036][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5244.583352][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5244.583642][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5244.583936][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5244.584231][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5244.584542][ C1] ? get_stack_info+0x36/0xc0 [ 5244.584781][ C1] ? lock_acquire+0x1c1/0x220 [ 5244.585023][ C1] ? lock_release+0x1d5/0x250 [ 5244.585263][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5244.585512][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5244.585788][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5244.586071][ C1] ? lock_acquire+0x1c1/0x220 [ 5244.586311][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5244.586553][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5244.586813][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5244.587048][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5244.587294][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5244.587552][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5244.587835][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5244.588111][ C1] ip_local_deliver+0x19d/0x480 [ 5244.588359][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5244.588630][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5244.588893][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5244.589242][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5244.589496][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5244.589816][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5244.590078][ C1] ip_rcv+0x564/0x740 [ 5244.590283][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5244.590512][ C1] ? set_track_prepare+0x8a/0xd0 [ 5244.590765][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5244.591044][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5244.591317][ C1] ? skb_clone+0x10b/0x330 [ 5244.591544][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5244.591863][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5244.592169][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5244.592452][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5244.592752][ C1] ? __tcf_classify+0x329/0x7d0 [ 5244.593002][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5244.593232][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5244.593539][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5244.593828][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5244.594165][ C1] ? lock_acquire+0x1c1/0x220 [ 5244.594403][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5244.594702][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5244.594988][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5244.595306][ C1] ? __copy_skb_header+0xaf/0x490 [ 5244.595565][ C1] ? __skb_clone+0x57a/0x760 [ 5244.595800][ C1] netif_receive_skb+0x55/0x280 [ 5244.596050][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5244.596365][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5244.596699][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5244.597000][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5244.597276][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5244.597565][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5244.597879][ C1] ? hlock_class+0x4e/0x130 [ 5244.598115][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5244.598392][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5244.598668][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5244.598933][ C1] ? hlock_class+0x4e/0x130 [ 5244.599166][ C1] ? mark_lock+0x38/0x3e0 [ 5244.599388][ C1] ? stack_access_ok+0xda/0x1f0 [ 5244.599637][ C1] ? __lock_acquire+0xb67/0x1610 [ 5244.599892][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5244.600171][ C1] ? get_stack_info+0x36/0xc0 [ 5244.600415][ C1] ? stack_access_ok+0xda/0x1f0 [ 5244.600662][ C1] ? get_reg+0x119/0x190 [ 5244.600881][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5244.601150][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5244.601460][ C1] __tcf_classify+0x329/0x7d0 [ 5244.601700][ C1] tcf_classify+0x283/0x930 [ 5244.601934][ C1] ? arch_stack_walk+0xa2/0x100 [ 5244.602184][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5244.602443][ C1] ? get_stack_info+0x36/0xc0 [ 5244.602684][ C1] tc_run+0x2e4/0x5d0 [ 5244.602890][ C1] ? __pfx_tc_run+0x10/0x10 [ 5244.603120][ C1] ? lock_acquire+0x1c1/0x220 [ 5244.603361][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5244.603622][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5244.603876][ C1] ? lock_acquire+0x1c1/0x220 [ 5244.604121][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5244.604387][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5244.604695][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5244.604968][ C1] ? neigh_hh_output+0x348/0x590 [ 5244.605222][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5244.605488][ C1] ip_finish_output2+0x786/0x18e0 [ 5244.605745][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5244.606023][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5244.606363][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5244.606641][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5244.606894][ C1] ? __ip_finish_output+0x10f/0x770 [ 5244.607160][ C1] ip_output+0x16b/0x4f0 [ 5244.607377][ C1] ? run_timer_softirq+0x72/0x100 [ 5244.607635][ C1] ? __pfx_ip_output+0x10/0x10 [ 5244.607881][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5244.608168][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5244.608421][ C1] ? ip_local_out+0x114/0x3b0 [ 5244.608661][ C1] __ip_queue_xmit+0x672/0x1910 [ 5244.608911][ C1] ? __create_object+0x5e/0xb0 [ 5244.609156][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5244.609427][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5244.609709][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5244.609985][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5244.610267][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5244.610543][ C1] tcp_delack_timer+0x84/0x240 [ 5244.610788][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5244.611060][ C1] call_timer_fn+0x173/0x430 [ 5244.611299][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5244.611562][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5244.611824][ C1] __run_timers.part.0+0x52d/0x890 [ 5244.612085][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5244.612360][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5244.612647][ C1] ? lock_acquire+0x1c1/0x220 [ 5244.612887][ C1] ? clockevents_program_event+0xf6/0x300 [ 5244.613178][ C1] ? lock_release+0x1d5/0x250 [ 5244.613419][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5244.613683][ C1] ? ktime_get+0xb3/0x190 [ 5244.613906][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5244.614210][ C1] run_timer_softirq+0x72/0x100 [ 5244.614459][ C1] __do_softirq+0x1b9/0x7ff [ 5244.614694][ C1] irq_exit_rcu+0x98/0xc0 [ 5244.614915][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5244.615202][ C1] [ 5244.615353][ C1] [ 5244.615504][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5244.615810][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5244.616136][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5244.617114][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5244.617432][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5244.617834][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5244.618237][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5244.618645][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5244.619049][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5244.619452][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5244.619757][ C1] pipe_read+0xa16/0xdf0 [ 5244.619978][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5244.620259][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5244.620502][ C1] ? iterate_tty_write+0x299/0x540 [ 5244.620766][ C1] ? lock_release+0x1d5/0x250 [ 5244.621007][ C1] vfs_read+0x911/0xc00 [ 5244.621223][ C1] ? lock_acquire+0x1c1/0x220 [ 5244.621462][ C1] ? __might_fault+0xc6/0x180 [ 5244.621705][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5244.621946][ C1] ? __might_fault+0xc6/0x180 [ 5244.622186][ C1] ? lock_release+0x1d5/0x250 [ 5244.622426][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5244.622692][ C1] ? __fget_light+0x54/0x1e0 [ 5244.622932][ C1] ksys_read+0x17a/0x1e0 [ 5244.623150][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5244.623395][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5244.623703][ C1] do_syscall_64+0xc9/0x1e0 [ 5244.623937][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5244.624242][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5244.624473][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5244.625446][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5244.625869][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5244.626270][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5244.626670][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5244.627069][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5244.627472][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5244.627875][ C1] [ 5244.628031][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2693s! [swapper/2:0] [ 5244.628454][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5244.629704][ C2] irq event stamp: 44114564 [ 5244.629935][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5244.630469][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5244.630981][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5244.631459][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5244.631927][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5244.632386][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5244.632997][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5244.633322][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5244.634296][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5244.634603][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5244.635001][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5244.635402][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5244.635799][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5244.636200][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5244.636599][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5244.637045][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5244.637381][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5244.637780][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5244.638181][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5244.638578][ C2] PKRU: 55555554 [ 5244.638760][ C2] Call Trace: [ 5244.638929][ C2] [ 5244.639077][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5244.639340][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5244.639584][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5244.639860][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5244.640132][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5244.640421][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5244.640686][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5244.640992][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5244.641253][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5244.641515][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5244.641827][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5244.642121][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5244.642435][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5244.642725][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5244.643018][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5244.643310][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5244.643621][ C2] ? get_stack_info+0x36/0xc0 [ 5244.643859][ C2] ? lock_acquire+0x1c1/0x220 [ 5244.644103][ C2] ? lock_release+0x1d5/0x250 [ 5244.644343][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5244.644592][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5244.644864][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5244.645147][ C2] ? lock_acquire+0x1c1/0x220 [ 5244.645387][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5244.645628][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5244.645887][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5244.646122][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5244.646368][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5244.646625][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5244.646901][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5244.647176][ C2] ip_local_deliver+0x19d/0x480 [ 5244.647423][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5244.647693][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5244.647956][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5244.648303][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5244.648555][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5244.648879][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5244.649139][ C2] ip_rcv+0x564/0x740 [ 5244.649343][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5244.649572][ C2] ? set_track_prepare+0x8a/0xd0 [ 5244.649830][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5244.650110][ C2] ? start_secondary+0x21c/0x2b0 [ 5244.650362][ C2] ? skb_clone+0x10b/0x330 [ 5244.650587][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5244.650906][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5244.651212][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5244.651492][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5244.651788][ C2] ? __tcf_classify+0x329/0x7d0 [ 5244.652035][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5244.652264][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5244.652564][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5244.652847][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5244.653172][ C2] ? lock_acquire+0x1c1/0x220 [ 5244.653412][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5244.653709][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5244.653992][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5244.654311][ C2] ? __copy_skb_header+0xaf/0x490 [ 5244.654568][ C2] ? __skb_clone+0x57a/0x760 [ 5244.654803][ C2] netif_receive_skb+0x55/0x280 [ 5244.655051][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5244.655364][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5244.655697][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5244.655994][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5244.656269][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5244.656557][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5244.656870][ C2] ? get_stack_info+0x36/0xc0 [ 5244.657110][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5244.657375][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5244.657691][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5244.657967][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5244.658243][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5244.658558][ C2] ? kernel_text_address+0x17/0xe0 [ 5244.658818][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5244.659130][ C2] ? arch_stack_walk+0x8c/0x100 [ 5244.659378][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5244.659640][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5244.659925][ C2] ? lock_acquire+0x1c1/0x220 [ 5244.660163][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5244.660445][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5244.660748][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5244.661027][ C2] ? get_stack_info+0x36/0xc0 [ 5244.661265][ C2] __tcf_classify+0x329/0x7d0 [ 5244.661507][ C2] tcf_classify+0x283/0x930 [ 5244.661740][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5244.661996][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5244.662309][ C2] tc_run+0x2e4/0x5d0 [ 5244.662513][ C2] ? __pfx_tc_run+0x10/0x10 [ 5244.662743][ C2] ? lock_acquire+0x1c1/0x220 [ 5244.662981][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5244.663241][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5244.663495][ C2] ? lock_acquire+0x1c1/0x220 [ 5244.663733][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5244.663997][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5244.664306][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5244.664578][ C2] ? neigh_hh_output+0x348/0x590 [ 5244.664830][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5244.665093][ C2] ip_finish_output2+0x786/0x18e0 [ 5244.665349][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5244.665686][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5244.665964][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5244.666217][ C2] ? __ip_finish_output+0x10f/0x770 [ 5244.666481][ C2] ip_output+0x16b/0x4f0 [ 5244.666696][ C2] ? __pfx_ip_output+0x10/0x10 [ 5244.666938][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5244.667214][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5244.667527][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5244.667802][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5244.668051][ C2] ? __alloc_skb+0xd4/0x280 [ 5244.668283][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5244.668551][ C2] ? tcp_fragment+0x168/0x1040 [ 5244.668795][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5244.669046][ C2] ? ip_local_out+0x114/0x3b0 [ 5244.669287][ C2] __ip_queue_xmit+0x672/0x1910 [ 5244.669534][ C2] ? __skb_clone+0x57a/0x760 [ 5244.669768][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5244.670034][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5244.670316][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5244.670560][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5244.670808][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5244.671108][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5244.671426][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5244.671670][ C2] tcp_send_loss_probe+0x348/0x830 [ 5244.671930][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5244.672198][ C2] tcp_write_timer+0x82/0x1d0 [ 5244.672438][ C2] call_timer_fn+0x173/0x430 [ 5244.672674][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5244.672936][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5244.673198][ C2] __run_timers.part.0+0x52d/0x890 [ 5244.673458][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5244.673728][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5244.674012][ C2] ? lock_acquire+0x1c1/0x220 [ 5244.674254][ C2] ? clockevents_program_event+0xf6/0x300 [ 5244.674545][ C2] ? lock_release+0x1d5/0x250 [ 5244.674782][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5244.675047][ C2] ? ktime_get+0xb3/0x190 [ 5244.675268][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5244.675564][ C2] run_timer_softirq+0x72/0x100 [ 5244.675811][ C2] __do_softirq+0x1b9/0x7ff [ 5244.676042][ C2] irq_exit_rcu+0x98/0xc0 [ 5244.676263][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5244.676547][ C2] [ 5244.676696][ C2] [ 5244.676849][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5244.677152][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5244.677409][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5244.678377][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5244.678684][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5244.679082][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5244.679479][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5244.679876][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5244.680275][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5244.680676][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5244.680965][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5244.681225][ C2] default_idle_call+0x69/0xa0 [ 5244.681468][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5244.681719][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5244.681995][ C2] ? lock_release+0x1d5/0x250 [ 5244.682234][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5244.682506][ C2] do_idle+0xfb/0x160 [ 5244.682711][ C2] cpu_startup_entry+0x55/0x60 [ 5244.682952][ C2] start_secondary+0x21c/0x2b0 [ 5244.683201][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5244.683470][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5244.683781][ C2] [ 5269.065102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5269.065469][ C1] rcu: 1-....: (2906901 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=709849 [ 5269.066024][ C1] rcu: (t=2914178 jiffies g=1882453 q=712 ncpus=4) [ 5269.066356][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5269.066806][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5269.067419][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5269.067748][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5269.068718][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5269.069027][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5269.069425][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5269.069823][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5269.070224][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5269.070624][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5269.071022][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5269.071472][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5269.071804][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5269.072208][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5269.072608][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5269.073005][ C1] PKRU: 55555554 [ 5269.073186][ C1] Call Trace: [ 5269.073359][ C1] [ 5269.073505][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5269.073777][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5269.074034][ C1] ? check_cpu_stall+0x284/0x500 [ 5269.074286][ C1] ? rcu_pending+0x92/0x360 [ 5269.074517][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5269.074786][ C1] ? update_process_times+0xb9/0x110 [ 5269.075055][ C1] ? tick_sched_handle+0x67/0x130 [ 5269.075311][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5269.075600][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5269.075841][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5269.076155][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5269.076428][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5269.076716][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5269.076981][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5269.077287][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5269.077549][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5269.077858][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5269.078153][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5269.078469][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5269.078760][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5269.079054][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5269.079346][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5269.079658][ C1] ? get_stack_info+0x36/0xc0 [ 5269.079899][ C1] ? lock_acquire+0x1c1/0x220 [ 5269.080138][ C1] ? lock_release+0x1d5/0x250 [ 5269.080379][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5269.080628][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5269.080900][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5269.081189][ C1] ? lock_acquire+0x1c1/0x220 [ 5269.081427][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5269.081668][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5269.081928][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5269.082163][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5269.082411][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5269.082669][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5269.082944][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5269.083221][ C1] ip_local_deliver+0x19d/0x480 [ 5269.083468][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5269.083741][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5269.084009][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5269.084360][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5269.084613][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5269.084935][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5269.085198][ C1] ip_rcv+0x564/0x740 [ 5269.085401][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5269.085633][ C1] ? set_track_prepare+0x8a/0xd0 [ 5269.085885][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5269.086162][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5269.086434][ C1] ? skb_clone+0x10b/0x330 [ 5269.086662][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5269.086982][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5269.087285][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5269.087569][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5269.087863][ C1] ? __tcf_classify+0x329/0x7d0 [ 5269.088112][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5269.088343][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5269.088641][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5269.088928][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5269.089253][ C1] ? lock_acquire+0x1c1/0x220 [ 5269.089492][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5269.089787][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5269.090078][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5269.090395][ C1] ? __copy_skb_header+0xaf/0x490 [ 5269.090656][ C1] ? __skb_clone+0x57a/0x760 [ 5269.090889][ C1] netif_receive_skb+0x55/0x280 [ 5269.091137][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5269.091451][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5269.091782][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5269.092082][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5269.092356][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5269.092644][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5269.092957][ C1] ? hlock_class+0x4e/0x130 [ 5269.093191][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5269.093467][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5269.093743][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5269.094013][ C1] ? hlock_class+0x4e/0x130 [ 5269.094244][ C1] ? mark_lock+0x38/0x3e0 [ 5269.094465][ C1] ? stack_access_ok+0xda/0x1f0 [ 5269.094713][ C1] ? __lock_acquire+0xb67/0x1610 [ 5269.094967][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5269.095246][ C1] ? get_stack_info+0x36/0xc0 [ 5269.095485][ C1] ? stack_access_ok+0xda/0x1f0 [ 5269.095731][ C1] ? get_reg+0x119/0x190 [ 5269.095950][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5269.096218][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5269.096528][ C1] __tcf_classify+0x329/0x7d0 [ 5269.096769][ C1] tcf_classify+0x283/0x930 [ 5269.097002][ C1] ? arch_stack_walk+0xa2/0x100 [ 5269.097250][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5269.097507][ C1] ? get_stack_info+0x36/0xc0 [ 5269.097749][ C1] tc_run+0x2e4/0x5d0 [ 5269.097954][ C1] ? __pfx_tc_run+0x10/0x10 [ 5269.098186][ C1] ? lock_acquire+0x1c1/0x220 [ 5269.098424][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5269.098684][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5269.098939][ C1] ? lock_acquire+0x1c1/0x220 [ 5269.099179][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5269.099443][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5269.099749][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5269.100020][ C1] ? neigh_hh_output+0x348/0x590 [ 5269.100273][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5269.100537][ C1] ip_finish_output2+0x786/0x18e0 [ 5269.100794][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5269.101074][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5269.101413][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5269.101689][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5269.101942][ C1] ? __ip_finish_output+0x10f/0x770 [ 5269.102210][ C1] ip_output+0x16b/0x4f0 [ 5269.102427][ C1] ? run_timer_softirq+0x72/0x100 [ 5269.102683][ C1] ? __pfx_ip_output+0x10/0x10 [ 5269.102926][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5269.103214][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5269.103466][ C1] ? ip_local_out+0x114/0x3b0 [ 5269.103705][ C1] __ip_queue_xmit+0x672/0x1910 [ 5269.103958][ C1] ? __create_object+0x5e/0xb0 [ 5269.104204][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5269.104470][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5269.104754][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5269.105030][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5269.105310][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5269.105582][ C1] tcp_delack_timer+0x84/0x240 [ 5269.105825][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5269.106099][ C1] call_timer_fn+0x173/0x430 [ 5269.106334][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5269.106596][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5269.106856][ C1] __run_timers.part.0+0x52d/0x890 [ 5269.107119][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5269.107396][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5269.107680][ C1] ? lock_acquire+0x1c1/0x220 [ 5269.107919][ C1] ? clockevents_program_event+0xf6/0x300 [ 5269.108209][ C1] ? lock_release+0x1d5/0x250 [ 5269.108449][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5269.108712][ C1] ? ktime_get+0xb3/0x190 [ 5269.108935][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5269.109231][ C1] run_timer_softirq+0x72/0x100 [ 5269.109480][ C1] __do_softirq+0x1b9/0x7ff [ 5269.109714][ C1] irq_exit_rcu+0x98/0xc0 [ 5269.109933][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5269.110222][ C1] [ 5269.110372][ C1] [ 5269.110524][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5269.110828][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5269.111152][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5269.112128][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5269.112437][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5269.112837][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5269.113239][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5269.113638][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5269.114040][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5269.114444][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5269.114741][ C1] pipe_read+0xa16/0xdf0 [ 5269.114961][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5269.115241][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5269.115485][ C1] ? iterate_tty_write+0x299/0x540 [ 5269.115747][ C1] ? lock_release+0x1d5/0x250 [ 5269.115985][ C1] vfs_read+0x911/0xc00 [ 5269.116203][ C1] ? lock_acquire+0x1c1/0x220 [ 5269.116441][ C1] ? __might_fault+0xc6/0x180 [ 5269.116681][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5269.116921][ C1] ? __might_fault+0xc6/0x180 [ 5269.117162][ C1] ? lock_release+0x1d5/0x250 [ 5269.117400][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5269.117665][ C1] ? __fget_light+0x54/0x1e0 [ 5269.117902][ C1] ksys_read+0x17a/0x1e0 [ 5269.118121][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5269.118365][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5269.118669][ C1] do_syscall_64+0xc9/0x1e0 [ 5269.118903][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5269.119203][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5269.119431][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5269.120401][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5269.120822][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5269.121221][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5269.121619][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5269.122017][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5269.122418][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5269.122819][ C1] [ 5269.122976][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5269.123249][ C2] NMI backtrace for cpu 2 [ 5269.123255][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5269.123262][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5269.123266][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5269.123275][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5269.123280][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5269.123286][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5269.123290][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5269.123293][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5269.123297][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5269.123301][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5269.123305][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5269.123310][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5269.123315][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5269.123319][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5269.123322][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5269.123326][ C2] PKRU: 55555554 [ 5269.123328][ C2] Call Trace: [ 5269.123331][ C2] [ 5269.123335][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5269.123346][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5269.123354][ C2] ? nmi_handle+0x153/0x420 [ 5269.123364][ C2] ? default_do_nmi+0x41/0x100 [ 5269.123371][ C2] ? exc_nmi+0xf3/0x120 [ 5269.123377][ C2] ? end_repeat_nmi+0xf/0x60 [ 5269.123389][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5269.123397][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5269.123405][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5269.123413][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5269.123421][ C2] [ 5269.123423][ C2] [ 5269.123426][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5269.123433][ C2] ? get_stack_info+0x36/0xc0 [ 5269.123441][ C2] ? lock_acquire+0x1c1/0x220 [ 5269.123449][ C2] ? lock_release+0x1d5/0x250 [ 5269.123458][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5269.123467][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5269.123474][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5269.123482][ C2] ? lock_acquire+0x1c1/0x220 [ 5269.123487][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5269.123496][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5269.123503][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5269.123519][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5269.123525][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5269.123537][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5269.123547][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5269.123555][ C2] ip_local_deliver+0x19d/0x480 [ 5269.123561][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5269.123566][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5269.123572][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5269.123584][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5269.123591][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5269.123598][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5269.123620][ C2] ip_rcv+0x564/0x740 [ 5269.123626][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5269.123632][ C2] ? set_track_prepare+0x8a/0xd0 [ 5269.123641][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5269.123648][ C2] ? start_secondary+0x21c/0x2b0 [ 5269.123655][ C2] ? skb_clone+0x10b/0x330 [ 5269.123660][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5269.123676][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5269.123690][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5269.123698][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5269.123718][ C2] ? __tcf_classify+0x329/0x7d0 [ 5269.123727][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5269.123732][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5269.123740][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5269.123748][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5269.123759][ C2] ? lock_acquire+0x1c1/0x220 [ 5269.123764][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5269.123775][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5269.123784][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5269.123794][ C2] ? __copy_skb_header+0xaf/0x490 [ 5269.123803][ C2] ? __skb_clone+0x57a/0x760 [ 5269.123810][ C2] netif_receive_skb+0x55/0x280 [ 5269.123818][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5269.123835][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5269.123853][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5269.123871][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5269.123883][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5269.123909][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5269.123923][ C2] ? get_stack_info+0x36/0xc0 [ 5269.123928][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5269.123931][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5269.123935][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5269.123938][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5269.123941][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5269.123944][ C2] ? kernel_text_address+0x17/0xe0 [ 5269.123947][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5269.123951][ C2] ? arch_stack_walk+0x8c/0x100 [ 5269.123955][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5269.123958][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5269.123962][ C2] ? lock_acquire+0x1c1/0x220 [ 5269.123964][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5269.123968][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5269.123972][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5269.123975][ C2] ? get_stack_info+0x36/0xc0 [ 5269.123979][ C2] __tcf_classify+0x329/0x7d0 [ 5269.123984][ C2] tcf_classify+0x283/0x930 [ 5269.123989][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5269.123992][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5269.123996][ C2] tc_run+0x2e4/0x5d0 [ 5269.124000][ C2] ? __pfx_tc_run+0x10/0x10 [ 5269.124003][ C2] ? lock_acquire+0x1c1/0x220 [ 5269.124005][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5269.124009][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5269.124014][ C2] ? lock_acquire+0x1c1/0x220 [ 5269.124016][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5269.124019][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5269.124022][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5269.124025][ C2] ? neigh_hh_output+0x348/0x590 [ 5269.124028][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5269.124032][ C2] ip_finish_output2+0x786/0x18e0 [ 5269.124035][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5269.124043][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5269.124045][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5269.124049][ C2] ? __ip_finish_output+0x10f/0x770 [ 5269.124053][ C2] ip_output+0x16b/0x4f0 [ 5269.124056][ C2] ? __pfx_ip_output+0x10/0x10 [ 5269.124058][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5269.124061][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5269.124064][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5269.124067][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5269.124070][ C2] ? __alloc_skb+0xd4/0x280 [ 5269.124072][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5269.124077][ C2] ? tcp_fragment+0x168/0x1040 [ 5269.124080][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5269.124083][ C2] ? ip_local_out+0x114/0x3b0 [ 5269.124087][ C2] __ip_queue_xmit+0x672/0x1910 [ 5269.124090][ C2] ? __skb_clone+0x57a/0x760 [ 5269.124093][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5269.124098][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5269.124101][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5269.124105][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5269.124109][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5269.124113][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5269.124116][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5269.124120][ C2] tcp_send_loss_probe+0x348/0x830 [ 5269.124123][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5269.124126][ C2] tcp_write_timer+0x82/0x1d0 [ 5269.124129][ C2] call_timer_fn+0x173/0x430 [ 5269.124133][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5269.124138][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5269.124142][ C2] __run_timers.part.0+0x52d/0x890 [ 5269.124145][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5269.124149][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5269.124152][ C2] ? lock_acquire+0x1c1/0x220 [ 5269.124154][ C2] ? clockevents_program_event+0xf6/0x300 [ 5269.124159][ C2] ? lock_release+0x1d5/0x250 [ 5269.124161][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5269.124165][ C2] ? ktime_get+0xb3/0x190 [ 5269.124168][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5269.124173][ C2] run_timer_softirq+0x72/0x100 [ 5269.124176][ C2] __do_softirq+0x1b9/0x7ff [ 5269.124181][ C2] irq_exit_rcu+0x98/0xc0 [ 5269.124183][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5269.124186][ C2] [ 5269.124187][ C2] [ 5269.124188][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5269.124191][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5269.124194][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5269.124197][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5269.124199][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5269.124201][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5269.124202][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5269.124204][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5269.124205][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5269.124209][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5269.124212][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5269.124215][ C2] default_idle_call+0x69/0xa0 [ 5269.124218][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5269.124220][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5269.124224][ C2] ? lock_release+0x1d5/0x250 [ 5269.124226][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5269.124230][ C2] do_idle+0xfb/0x160 [ 5269.124233][ C2] cpu_startup_entry+0x55/0x60 [ 5269.124235][ C2] start_secondary+0x21c/0x2b0 [ 5269.124238][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5269.124242][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5269.124248][ C2] [ 5296.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2741s! [perl:4135] [ 5296.569698][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5296.570965][ C1] irq event stamp: 209232 [ 5296.571183][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5296.571715][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5296.572193][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5296.572662][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5296.573123][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5296.573571][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5296.574191][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5296.574519][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5296.575493][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5296.575800][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5296.576201][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5296.576599][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5296.576998][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5296.577399][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5296.577798][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5296.578245][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5296.578576][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5296.578978][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5296.579378][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5296.579776][ C1] PKRU: 55555554 [ 5296.579958][ C1] Call Trace: [ 5296.580130][ C1] [ 5296.580277][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5296.580540][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5296.580785][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5296.581062][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5296.581334][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5296.581624][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5296.581889][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5296.582197][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5296.582459][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5296.582770][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5296.583065][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5296.583381][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5296.583671][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5296.583968][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5296.584259][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5296.584572][ C1] ? get_stack_info+0x36/0xc0 [ 5296.584810][ C1] ? lock_acquire+0x1c1/0x220 [ 5296.585053][ C1] ? lock_release+0x1d5/0x250 [ 5296.585294][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5296.585544][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5296.585816][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5296.586105][ C1] ? lock_acquire+0x1c1/0x220 [ 5296.586344][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5296.586585][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5296.586846][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5296.587082][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5296.587329][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5296.587587][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5296.587864][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5296.588141][ C1] ip_local_deliver+0x19d/0x480 [ 5296.588389][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5296.588660][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5296.588923][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5296.589272][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5296.589525][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5296.589845][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5296.590114][ C1] ip_rcv+0x564/0x740 [ 5296.590318][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5296.590549][ C1] ? set_track_prepare+0x8a/0xd0 [ 5296.590801][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5296.591079][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5296.591352][ C1] ? skb_clone+0x10b/0x330 [ 5296.591580][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5296.591900][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5296.592205][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5296.592491][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5296.592784][ C1] ? __tcf_classify+0x329/0x7d0 [ 5296.593036][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5296.593267][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5296.593566][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5296.593857][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5296.594184][ C1] ? lock_acquire+0x1c1/0x220 [ 5296.594423][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5296.594719][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5296.595006][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5296.595324][ C1] ? __copy_skb_header+0xaf/0x490 [ 5296.595582][ C1] ? __skb_clone+0x57a/0x760 [ 5296.595815][ C1] netif_receive_skb+0x55/0x280 [ 5296.596063][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5296.596377][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5296.596709][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5296.597012][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5296.597287][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5296.597573][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5296.597886][ C1] ? hlock_class+0x4e/0x130 [ 5296.598120][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5296.598395][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5296.598671][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5296.598936][ C1] ? hlock_class+0x4e/0x130 [ 5296.599166][ C1] ? mark_lock+0x38/0x3e0 [ 5296.599387][ C1] ? stack_access_ok+0xda/0x1f0 [ 5296.599635][ C1] ? __lock_acquire+0xb67/0x1610 [ 5296.599889][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5296.600166][ C1] ? get_stack_info+0x36/0xc0 [ 5296.600406][ C1] ? stack_access_ok+0xda/0x1f0 [ 5296.600651][ C1] ? get_reg+0x119/0x190 [ 5296.600872][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5296.601140][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5296.601450][ C1] __tcf_classify+0x329/0x7d0 [ 5296.601691][ C1] tcf_classify+0x283/0x930 [ 5296.601926][ C1] ? arch_stack_walk+0xa2/0x100 [ 5296.602176][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5296.602432][ C1] ? get_stack_info+0x36/0xc0 [ 5296.602674][ C1] tc_run+0x2e4/0x5d0 [ 5296.602879][ C1] ? __pfx_tc_run+0x10/0x10 [ 5296.603112][ C1] ? lock_acquire+0x1c1/0x220 [ 5296.603349][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5296.603610][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5296.603867][ C1] ? lock_acquire+0x1c1/0x220 [ 5296.604106][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5296.604371][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5296.604677][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5296.604948][ C1] ? neigh_hh_output+0x348/0x590 [ 5296.605201][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5296.605465][ C1] ip_finish_output2+0x786/0x18e0 [ 5296.605720][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5296.605999][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5296.606337][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5296.606613][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5296.606865][ C1] ? __ip_finish_output+0x10f/0x770 [ 5296.607130][ C1] ip_output+0x16b/0x4f0 [ 5296.607346][ C1] ? run_timer_softirq+0x72/0x100 [ 5296.607603][ C1] ? __pfx_ip_output+0x10/0x10 [ 5296.607846][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5296.608137][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5296.608389][ C1] ? ip_local_out+0x114/0x3b0 [ 5296.608630][ C1] __ip_queue_xmit+0x672/0x1910 [ 5296.608877][ C1] ? __create_object+0x5e/0xb0 [ 5296.609121][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5296.609387][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5296.609670][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5296.609943][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5296.610224][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5296.610496][ C1] tcp_delack_timer+0x84/0x240 [ 5296.610739][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5296.611013][ C1] call_timer_fn+0x173/0x430 [ 5296.611248][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5296.611510][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5296.611771][ C1] __run_timers.part.0+0x52d/0x890 [ 5296.612032][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5296.612307][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5296.612591][ C1] ? lock_acquire+0x1c1/0x220 [ 5296.612830][ C1] ? clockevents_program_event+0xf6/0x300 [ 5296.613119][ C1] ? lock_release+0x1d5/0x250 [ 5296.613359][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5296.613623][ C1] ? ktime_get+0xb3/0x190 [ 5296.613850][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5296.614145][ C1] run_timer_softirq+0x72/0x100 [ 5296.614394][ C1] __do_softirq+0x1b9/0x7ff [ 5296.614628][ C1] irq_exit_rcu+0x98/0xc0 [ 5296.614847][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5296.615135][ C1] [ 5296.615285][ C1] [ 5296.615435][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5296.615739][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5296.616063][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5296.617034][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5296.617343][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5296.617740][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5296.618141][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5296.618539][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5296.618937][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5296.619338][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5296.619635][ C1] pipe_read+0xa16/0xdf0 [ 5296.619855][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5296.620135][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5296.620379][ C1] ? iterate_tty_write+0x299/0x540 [ 5296.620641][ C1] ? lock_release+0x1d5/0x250 [ 5296.620879][ C1] vfs_read+0x911/0xc00 [ 5296.621096][ C1] ? lock_acquire+0x1c1/0x220 [ 5296.621333][ C1] ? __might_fault+0xc6/0x180 [ 5296.621573][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5296.621813][ C1] ? __might_fault+0xc6/0x180 [ 5296.622054][ C1] ? lock_release+0x1d5/0x250 [ 5296.622292][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5296.622562][ C1] ? __fget_light+0x54/0x1e0 [ 5296.622797][ C1] ksys_read+0x17a/0x1e0 [ 5296.623019][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5296.623263][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5296.623568][ C1] do_syscall_64+0xc9/0x1e0 [ 5296.623808][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5296.624107][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5296.624336][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5296.625309][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5296.625731][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5296.626130][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5296.626527][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5296.626927][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5296.627326][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5296.627731][ C1] [ 5296.627888][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2741s! [swapper/2:0] [ 5296.628309][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5296.629558][ C2] irq event stamp: 44114564 [ 5296.629785][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5296.630321][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5296.630832][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5296.631309][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5296.631774][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5296.632230][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5296.632842][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5296.633162][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5296.634135][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5296.634442][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5296.634839][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5296.635239][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5296.635639][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5296.636037][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5296.636435][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5296.636881][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5296.637214][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5296.637616][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5296.638015][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5296.638412][ C2] PKRU: 55555554 [ 5296.638593][ C2] Call Trace: [ 5296.638765][ C2] [ 5296.638911][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5296.639172][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5296.639416][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5296.639691][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5296.639966][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5296.640254][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5296.640517][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5296.640823][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5296.641084][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5296.641345][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5296.641655][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5296.641951][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5296.642264][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5296.642553][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5296.642841][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5296.643130][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5296.643442][ C2] ? get_stack_info+0x36/0xc0 [ 5296.643682][ C2] ? lock_acquire+0x1c1/0x220 [ 5296.643925][ C2] ? lock_release+0x1d5/0x250 [ 5296.644165][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5296.644414][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5296.644686][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5296.644972][ C2] ? lock_acquire+0x1c1/0x220 [ 5296.645208][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5296.645449][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5296.645709][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5296.645943][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5296.646191][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5296.646449][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5296.646723][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5296.646998][ C2] ip_local_deliver+0x19d/0x480 [ 5296.647246][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5296.647515][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5296.647779][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5296.648127][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5296.648379][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5296.648699][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5296.648960][ C2] ip_rcv+0x564/0x740 [ 5296.649164][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5296.649395][ C2] ? set_track_prepare+0x8a/0xd0 [ 5296.649646][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5296.649922][ C2] ? start_secondary+0x21c/0x2b0 [ 5296.650174][ C2] ? skb_clone+0x10b/0x330 [ 5296.650399][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5296.650718][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5296.651024][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5296.651304][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5296.651599][ C2] ? __tcf_classify+0x329/0x7d0 [ 5296.651848][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5296.652077][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5296.652377][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5296.652663][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5296.652989][ C2] ? lock_acquire+0x1c1/0x220 [ 5296.653226][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5296.653524][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5296.653813][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5296.654129][ C2] ? __copy_skb_header+0xaf/0x490 [ 5296.654386][ C2] ? __skb_clone+0x57a/0x760 [ 5296.654621][ C2] netif_receive_skb+0x55/0x280 [ 5296.654869][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5296.655184][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5296.655515][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5296.655814][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5296.656089][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5296.656376][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5296.656689][ C2] ? get_stack_info+0x36/0xc0 [ 5296.656931][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5296.657195][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5296.657514][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5296.657789][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5296.658064][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5296.658379][ C2] ? kernel_text_address+0x17/0xe0 [ 5296.658639][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5296.658952][ C2] ? arch_stack_walk+0x8c/0x100 [ 5296.659200][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5296.659463][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5296.659750][ C2] ? lock_acquire+0x1c1/0x220 [ 5296.659988][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5296.660271][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5296.660575][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5296.660851][ C2] ? get_stack_info+0x36/0xc0 [ 5296.661093][ C2] __tcf_classify+0x329/0x7d0 [ 5296.661332][ C2] tcf_classify+0x283/0x930 [ 5296.661572][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5296.661828][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5296.662141][ C2] tc_run+0x2e4/0x5d0 [ 5296.662345][ C2] ? __pfx_tc_run+0x10/0x10 [ 5296.662576][ C2] ? lock_acquire+0x1c1/0x220 [ 5296.662813][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5296.663074][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5296.663326][ C2] ? lock_acquire+0x1c1/0x220 [ 5296.663565][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5296.663832][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5296.664136][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5296.664406][ C2] ? neigh_hh_output+0x348/0x590 [ 5296.664659][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5296.664922][ C2] ip_finish_output2+0x786/0x18e0 [ 5296.665178][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5296.665519][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5296.665795][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5296.666047][ C2] ? __ip_finish_output+0x10f/0x770 [ 5296.666312][ C2] ip_output+0x16b/0x4f0 [ 5296.666528][ C2] ? __pfx_ip_output+0x10/0x10 [ 5296.666772][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5296.667048][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5296.667359][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5296.667638][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5296.667889][ C2] ? __alloc_skb+0xd4/0x280 [ 5296.668118][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5296.668386][ C2] ? tcp_fragment+0x168/0x1040 [ 5296.668629][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5296.668881][ C2] ? ip_local_out+0x114/0x3b0 [ 5296.669122][ C2] __ip_queue_xmit+0x672/0x1910 [ 5296.669370][ C2] ? __skb_clone+0x57a/0x760 [ 5296.669604][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5296.669872][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5296.670152][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5296.670397][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5296.670647][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5296.670945][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5296.671264][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5296.671508][ C2] tcp_send_loss_probe+0x348/0x830 [ 5296.671768][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5296.672034][ C2] tcp_write_timer+0x82/0x1d0 [ 5296.672278][ C2] call_timer_fn+0x173/0x430 [ 5296.672515][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5296.672777][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5296.673038][ C2] __run_timers.part.0+0x52d/0x890 [ 5296.673297][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5296.673566][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5296.673855][ C2] ? lock_acquire+0x1c1/0x220 [ 5296.674091][ C2] ? clockevents_program_event+0xf6/0x300 [ 5296.674384][ C2] ? lock_release+0x1d5/0x250 [ 5296.674624][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5296.674888][ C2] ? ktime_get+0xb3/0x190 [ 5296.675107][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5296.675405][ C2] run_timer_softirq+0x72/0x100 [ 5296.675654][ C2] __do_softirq+0x1b9/0x7ff [ 5296.675884][ C2] irq_exit_rcu+0x98/0xc0 [ 5296.676107][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5296.676390][ C2] [ 5296.676542][ C2] [ 5296.676692][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5296.676996][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5296.677252][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5296.678221][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5296.678531][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5296.678928][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5296.679326][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5296.679723][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5296.680123][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5296.680523][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5296.680810][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5296.681072][ C2] default_idle_call+0x69/0xa0 [ 5296.681315][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5296.681566][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5296.681842][ C2] ? lock_release+0x1d5/0x250 [ 5296.682079][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5296.682354][ C2] do_idle+0xfb/0x160 [ 5296.682558][ C2] cpu_startup_entry+0x55/0x60 [ 5296.682799][ C2] start_secondary+0x21c/0x2b0 [ 5296.683041][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5296.683312][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5296.683620][ C2] [ 5324.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2767s! [perl:4135] [ 5324.569696][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5324.570948][ C1] irq event stamp: 209232 [ 5324.571168][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5324.571695][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5324.572171][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5324.572641][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5324.573102][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5324.573551][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5324.574182][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5324.574507][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5324.575475][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5324.575782][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5324.576180][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5324.576578][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5324.576976][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5324.577376][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5324.577775][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5324.578223][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5324.578554][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5324.578954][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5324.579358][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5324.579756][ C1] PKRU: 55555554 [ 5324.579942][ C1] Call Trace: [ 5324.580112][ C1] [ 5324.580261][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5324.580523][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5324.580767][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5324.581044][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5324.581316][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5324.581606][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5324.581870][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5324.582176][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5324.582439][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5324.582747][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5324.583043][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5324.583358][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5324.583652][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5324.583947][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5324.584237][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5324.584547][ C1] ? get_stack_info+0x36/0xc0 [ 5324.584791][ C1] ? lock_acquire+0x1c1/0x220 [ 5324.585033][ C1] ? lock_release+0x1d5/0x250 [ 5324.585274][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5324.585523][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5324.585795][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5324.586078][ C1] ? lock_acquire+0x1c1/0x220 [ 5324.586318][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5324.586560][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5324.586821][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5324.587055][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5324.587302][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5324.587560][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5324.587840][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5324.588117][ C1] ip_local_deliver+0x19d/0x480 [ 5324.588365][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5324.588636][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5324.588899][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5324.589248][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5324.589501][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5324.589822][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5324.590085][ C1] ip_rcv+0x564/0x740 [ 5324.590291][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5324.590521][ C1] ? set_track_prepare+0x8a/0xd0 [ 5324.590774][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5324.591051][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5324.591325][ C1] ? skb_clone+0x10b/0x330 [ 5324.591551][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5324.591870][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5324.592177][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5324.592458][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5324.592760][ C1] ? __tcf_classify+0x329/0x7d0 [ 5324.593011][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5324.593239][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5324.593540][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5324.593831][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5324.594156][ C1] ? lock_acquire+0x1c1/0x220 [ 5324.594394][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5324.594691][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5324.594975][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5324.595292][ C1] ? __copy_skb_header+0xaf/0x490 [ 5324.595550][ C1] ? __skb_clone+0x57a/0x760 [ 5324.595786][ C1] netif_receive_skb+0x55/0x280 [ 5324.596034][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5324.596347][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5324.596680][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5324.596978][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5324.597254][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5324.597542][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5324.597854][ C1] ? hlock_class+0x4e/0x130 [ 5324.598086][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5324.598364][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5324.598640][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5324.598903][ C1] ? hlock_class+0x4e/0x130 [ 5324.599136][ C1] ? mark_lock+0x38/0x3e0 [ 5324.599355][ C1] ? stack_access_ok+0xda/0x1f0 [ 5324.599604][ C1] ? __lock_acquire+0xb67/0x1610 [ 5324.599858][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5324.600135][ C1] ? get_stack_info+0x36/0xc0 [ 5324.600375][ C1] ? stack_access_ok+0xda/0x1f0 [ 5324.600622][ C1] ? get_reg+0x119/0x190 [ 5324.600839][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5324.601108][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5324.601416][ C1] __tcf_classify+0x329/0x7d0 [ 5324.601658][ C1] tcf_classify+0x283/0x930 [ 5324.601890][ C1] ? arch_stack_walk+0xa2/0x100 [ 5324.602140][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5324.602398][ C1] ? get_stack_info+0x36/0xc0 [ 5324.602637][ C1] tc_run+0x2e4/0x5d0 [ 5324.602844][ C1] ? __pfx_tc_run+0x10/0x10 [ 5324.603074][ C1] ? lock_acquire+0x1c1/0x220 [ 5324.603313][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5324.603580][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5324.603834][ C1] ? lock_acquire+0x1c1/0x220 [ 5324.604073][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5324.604339][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5324.604644][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5324.604916][ C1] ? neigh_hh_output+0x348/0x590 [ 5324.605169][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5324.605434][ C1] ip_finish_output2+0x786/0x18e0 [ 5324.605690][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5324.605967][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5324.606305][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5324.606583][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5324.606835][ C1] ? __ip_finish_output+0x10f/0x770 [ 5324.607100][ C1] ip_output+0x16b/0x4f0 [ 5324.607315][ C1] ? run_timer_softirq+0x72/0x100 [ 5324.607572][ C1] ? __pfx_ip_output+0x10/0x10 [ 5324.607815][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5324.608102][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5324.608352][ C1] ? ip_local_out+0x114/0x3b0 [ 5324.608593][ C1] __ip_queue_xmit+0x672/0x1910 [ 5324.608842][ C1] ? __create_object+0x5e/0xb0 [ 5324.609086][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5324.609354][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5324.609635][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5324.609910][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5324.610191][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5324.610463][ C1] tcp_delack_timer+0x84/0x240 [ 5324.610707][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5324.610977][ C1] call_timer_fn+0x173/0x430 [ 5324.611214][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5324.611476][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5324.611738][ C1] __run_timers.part.0+0x52d/0x890 [ 5324.611998][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5324.612270][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5324.612558][ C1] ? lock_acquire+0x1c1/0x220 [ 5324.612797][ C1] ? clockevents_program_event+0xf6/0x300 [ 5324.613088][ C1] ? lock_release+0x1d5/0x250 [ 5324.613328][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5324.613596][ C1] ? ktime_get+0xb3/0x190 [ 5324.613816][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5324.614115][ C1] run_timer_softirq+0x72/0x100 [ 5324.614363][ C1] __do_softirq+0x1b9/0x7ff [ 5324.614596][ C1] irq_exit_rcu+0x98/0xc0 [ 5324.614816][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5324.615100][ C1] [ 5324.615253][ C1] [ 5324.615403][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5324.615711][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5324.616035][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5324.617008][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5324.617316][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5324.617713][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5324.618111][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5324.618512][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5324.618910][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5324.619310][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5324.619607][ C1] pipe_read+0xa16/0xdf0 [ 5324.619827][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5324.620104][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5324.620347][ C1] ? iterate_tty_write+0x299/0x540 [ 5324.620609][ C1] ? lock_release+0x1d5/0x250 [ 5324.620850][ C1] vfs_read+0x911/0xc00 [ 5324.621064][ C1] ? lock_acquire+0x1c1/0x220 [ 5324.621303][ C1] ? __might_fault+0xc6/0x180 [ 5324.621545][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5324.621785][ C1] ? __might_fault+0xc6/0x180 [ 5324.622022][ C1] ? lock_release+0x1d5/0x250 [ 5324.622264][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5324.622528][ C1] ? __fget_light+0x54/0x1e0 [ 5324.622766][ C1] ksys_read+0x17a/0x1e0 [ 5324.622982][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5324.623228][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5324.623533][ C1] do_syscall_64+0xc9/0x1e0 [ 5324.623773][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5324.624072][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5324.624300][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5324.625272][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5324.625693][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5324.626094][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5324.626494][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5324.626892][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5324.627290][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5324.627694][ C1] [ 5324.627851][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2767s! [swapper/2:0] [ 5324.628274][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5324.629527][ C2] irq event stamp: 44114564 [ 5324.629756][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5324.630293][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5324.630804][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5324.631281][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5324.631748][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5324.632205][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5324.632821][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5324.633145][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5324.634121][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5324.634429][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5324.634827][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5324.635228][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5324.635627][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5324.636025][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5324.636422][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5324.636870][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5324.637203][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5324.637604][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5324.638003][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5324.638401][ C2] PKRU: 55555554 [ 5324.638583][ C2] Call Trace: [ 5324.638755][ C2] [ 5324.638902][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5324.639164][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5324.639408][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5324.639685][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5324.639959][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5324.640247][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5324.640512][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5324.640819][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5324.641080][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5324.641342][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5324.641651][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5324.641946][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5324.642260][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5324.642550][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5324.642845][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5324.643134][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5324.643445][ C2] ? get_stack_info+0x36/0xc0 [ 5324.643692][ C2] ? lock_acquire+0x1c1/0x220 [ 5324.643931][ C2] ? lock_release+0x1d5/0x250 [ 5324.644172][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5324.644420][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5324.644691][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5324.644978][ C2] ? lock_acquire+0x1c1/0x220 [ 5324.645217][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5324.645456][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5324.645715][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5324.645951][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5324.646199][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5324.646457][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5324.646733][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5324.647009][ C2] ip_local_deliver+0x19d/0x480 [ 5324.647256][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5324.647530][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5324.647794][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5324.648140][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5324.648393][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5324.648713][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5324.648975][ C2] ip_rcv+0x564/0x740 [ 5324.649179][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5324.649411][ C2] ? set_track_prepare+0x8a/0xd0 [ 5324.649664][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5324.649939][ C2] ? start_secondary+0x21c/0x2b0 [ 5324.650190][ C2] ? skb_clone+0x10b/0x330 [ 5324.650417][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5324.650735][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5324.651041][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5324.651324][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5324.651618][ C2] ? __tcf_classify+0x329/0x7d0 [ 5324.651866][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5324.652097][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5324.652394][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5324.652681][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5324.653007][ C2] ? lock_acquire+0x1c1/0x220 [ 5324.653245][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5324.653541][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5324.653830][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5324.654148][ C2] ? __copy_skb_header+0xaf/0x490 [ 5324.654405][ C2] ? __skb_clone+0x57a/0x760 [ 5324.654638][ C2] netif_receive_skb+0x55/0x280 [ 5324.654888][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5324.655200][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5324.655533][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5324.655832][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5324.656105][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5324.656393][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5324.656705][ C2] ? get_stack_info+0x36/0xc0 [ 5324.656948][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5324.657212][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5324.657529][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5324.657804][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5324.658082][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5324.658397][ C2] ? kernel_text_address+0x17/0xe0 [ 5324.658659][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5324.658971][ C2] ? arch_stack_walk+0x8c/0x100 [ 5324.659219][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5324.659484][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5324.659769][ C2] ? lock_acquire+0x1c1/0x220 [ 5324.660008][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5324.660289][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5324.660594][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5324.660870][ C2] ? get_stack_info+0x36/0xc0 [ 5324.661119][ C2] __tcf_classify+0x329/0x7d0 [ 5324.661362][ C2] tcf_classify+0x283/0x930 [ 5324.661593][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5324.661848][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5324.662163][ C2] tc_run+0x2e4/0x5d0 [ 5324.662368][ C2] ? __pfx_tc_run+0x10/0x10 [ 5324.662600][ C2] ? lock_acquire+0x1c1/0x220 [ 5324.662840][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5324.663100][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5324.663353][ C2] ? lock_acquire+0x1c1/0x220 [ 5324.663594][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5324.663860][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5324.664163][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5324.664437][ C2] ? neigh_hh_output+0x348/0x590 [ 5324.664689][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5324.664955][ C2] ip_finish_output2+0x786/0x18e0 [ 5324.665213][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5324.665551][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5324.665826][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5324.666081][ C2] ? __ip_finish_output+0x10f/0x770 [ 5324.666345][ C2] ip_output+0x16b/0x4f0 [ 5324.666562][ C2] ? __pfx_ip_output+0x10/0x10 [ 5324.666804][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5324.667083][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5324.667395][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5324.667671][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5324.667923][ C2] ? __alloc_skb+0xd4/0x280 [ 5324.668151][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5324.668421][ C2] ? tcp_fragment+0x168/0x1040 [ 5324.668662][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5324.668914][ C2] ? ip_local_out+0x114/0x3b0 [ 5324.669155][ C2] __ip_queue_xmit+0x672/0x1910 [ 5324.669403][ C2] ? __skb_clone+0x57a/0x760 [ 5324.669641][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5324.669910][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5324.670191][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5324.670436][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5324.670684][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5324.670984][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5324.671304][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5324.671547][ C2] tcp_send_loss_probe+0x348/0x830 [ 5324.671806][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5324.672077][ C2] tcp_write_timer+0x82/0x1d0 [ 5324.672314][ C2] call_timer_fn+0x173/0x430 [ 5324.672552][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5324.672813][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5324.673074][ C2] __run_timers.part.0+0x52d/0x890 [ 5324.673333][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5324.673606][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5324.673894][ C2] ? lock_acquire+0x1c1/0x220 [ 5324.674133][ C2] ? clockevents_program_event+0xf6/0x300 [ 5324.674422][ C2] ? lock_release+0x1d5/0x250 [ 5324.674662][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5324.674925][ C2] ? ktime_get+0xb3/0x190 [ 5324.675144][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5324.675443][ C2] run_timer_softirq+0x72/0x100 [ 5324.675691][ C2] __do_softirq+0x1b9/0x7ff [ 5324.675923][ C2] irq_exit_rcu+0x98/0xc0 [ 5324.676144][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5324.676428][ C2] [ 5324.676581][ C2] [ 5324.676730][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5324.677035][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5324.677294][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5324.678265][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5324.678575][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5324.678975][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5324.679372][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5324.679774][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5324.680174][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5324.680574][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5324.680865][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5324.681127][ C2] default_idle_call+0x69/0xa0 [ 5324.681371][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5324.681621][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5324.681906][ C2] ? lock_release+0x1d5/0x250 [ 5324.682145][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5324.682421][ C2] do_idle+0xfb/0x160 [ 5324.682625][ C2] cpu_startup_entry+0x55/0x60 [ 5324.682869][ C2] start_secondary+0x21c/0x2b0 [ 5324.683112][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5324.683383][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5324.683698][ C2] [ 5347.128103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5347.128474][ C1] rcu: 1-....: (2984791 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=729274 [ 5347.129029][ C1] rcu: (t=2992241 jiffies g=1882453 q=712 ncpus=4) [ 5347.129362][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5347.129811][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5347.130424][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5347.130752][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5347.131722][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5347.132031][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5347.132429][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5347.132827][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5347.133230][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5347.133633][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5347.134032][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5347.134479][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5347.134811][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5347.135212][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5347.135611][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5347.136010][ C1] PKRU: 55555554 [ 5347.136192][ C1] Call Trace: [ 5347.136364][ C1] [ 5347.136512][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5347.136783][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5347.137036][ C1] ? check_cpu_stall+0x284/0x500 [ 5347.137289][ C1] ? rcu_pending+0x92/0x360 [ 5347.137521][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5347.137792][ C1] ? update_process_times+0xb9/0x110 [ 5347.138060][ C1] ? tick_sched_handle+0x67/0x130 [ 5347.138316][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5347.138602][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5347.138844][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5347.139157][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5347.139429][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5347.139719][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5347.139983][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5347.140290][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5347.140553][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5347.140864][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5347.141159][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5347.141475][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5347.141766][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5347.142061][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5347.142352][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5347.142664][ C1] ? get_stack_info+0x36/0xc0 [ 5347.142904][ C1] ? lock_acquire+0x1c1/0x220 [ 5347.143145][ C1] ? lock_release+0x1d5/0x250 [ 5347.143386][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5347.143640][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5347.143912][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5347.144202][ C1] ? lock_acquire+0x1c1/0x220 [ 5347.144440][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5347.144686][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5347.144947][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5347.145183][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5347.145430][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5347.145688][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5347.145964][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5347.146241][ C1] ip_local_deliver+0x19d/0x480 [ 5347.146489][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5347.146759][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5347.147022][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5347.147374][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5347.147628][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5347.147947][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5347.148210][ C1] ip_rcv+0x564/0x740 [ 5347.148414][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5347.148645][ C1] ? set_track_prepare+0x8a/0xd0 [ 5347.148898][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5347.149177][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5347.149450][ C1] ? skb_clone+0x10b/0x330 [ 5347.149679][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5347.149998][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5347.150304][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5347.150588][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5347.150881][ C1] ? __tcf_classify+0x329/0x7d0 [ 5347.151131][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5347.151363][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5347.151662][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5347.151950][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5347.152276][ C1] ? lock_acquire+0x1c1/0x220 [ 5347.152515][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5347.152810][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5347.153098][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5347.153416][ C1] ? __copy_skb_header+0xaf/0x490 [ 5347.153679][ C1] ? __skb_clone+0x57a/0x760 [ 5347.153912][ C1] netif_receive_skb+0x55/0x280 [ 5347.154162][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5347.154481][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5347.154816][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5347.155117][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5347.155391][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5347.155680][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5347.155994][ C1] ? hlock_class+0x4e/0x130 [ 5347.156228][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5347.156504][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5347.156780][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5347.157046][ C1] ? hlock_class+0x4e/0x130 [ 5347.157276][ C1] ? mark_lock+0x38/0x3e0 [ 5347.157497][ C1] ? stack_access_ok+0xda/0x1f0 [ 5347.157747][ C1] ? __lock_acquire+0xb67/0x1610 [ 5347.158001][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5347.158278][ C1] ? get_stack_info+0x36/0xc0 [ 5347.158518][ C1] ? stack_access_ok+0xda/0x1f0 [ 5347.158764][ C1] ? get_reg+0x119/0x190 [ 5347.158984][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5347.159252][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5347.159562][ C1] __tcf_classify+0x329/0x7d0 [ 5347.159805][ C1] tcf_classify+0x283/0x930 [ 5347.160036][ C1] ? arch_stack_walk+0xa2/0x100 [ 5347.160286][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5347.160543][ C1] ? get_stack_info+0x36/0xc0 [ 5347.160784][ C1] tc_run+0x2e4/0x5d0 [ 5347.160989][ C1] ? __pfx_tc_run+0x10/0x10 [ 5347.161222][ C1] ? lock_acquire+0x1c1/0x220 [ 5347.161460][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5347.161721][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5347.161974][ C1] ? lock_acquire+0x1c1/0x220 [ 5347.162215][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5347.162478][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5347.162785][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5347.163057][ C1] ? neigh_hh_output+0x348/0x590 [ 5347.163310][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5347.163580][ C1] ip_finish_output2+0x786/0x18e0 [ 5347.163836][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5347.164116][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5347.164455][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5347.164733][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5347.164986][ C1] ? __ip_finish_output+0x10f/0x770 [ 5347.165250][ C1] ip_output+0x16b/0x4f0 [ 5347.165467][ C1] ? run_timer_softirq+0x72/0x100 [ 5347.165723][ C1] ? __pfx_ip_output+0x10/0x10 [ 5347.165965][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5347.166254][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5347.166506][ C1] ? ip_local_out+0x114/0x3b0 [ 5347.166746][ C1] __ip_queue_xmit+0x672/0x1910 [ 5347.166993][ C1] ? __create_object+0x5e/0xb0 [ 5347.167237][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5347.167504][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5347.167787][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5347.168060][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5347.168341][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5347.168614][ C1] tcp_delack_timer+0x84/0x240 [ 5347.168857][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5347.169131][ C1] call_timer_fn+0x173/0x430 [ 5347.169365][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5347.169627][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5347.169888][ C1] __run_timers.part.0+0x52d/0x890 [ 5347.170150][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5347.170426][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5347.170709][ C1] ? lock_acquire+0x1c1/0x220 [ 5347.170949][ C1] ? clockevents_program_event+0xf6/0x300 [ 5347.171238][ C1] ? lock_release+0x1d5/0x250 [ 5347.171479][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5347.171743][ C1] ? ktime_get+0xb3/0x190 [ 5347.171965][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5347.172260][ C1] run_timer_softirq+0x72/0x100 [ 5347.172508][ C1] __do_softirq+0x1b9/0x7ff [ 5347.172743][ C1] irq_exit_rcu+0x98/0xc0 [ 5347.172963][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5347.173255][ C1] [ 5347.173405][ C1] [ 5347.173559][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5347.173866][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5347.174191][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5347.175163][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5347.175475][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5347.175875][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5347.176275][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5347.176674][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5347.177075][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5347.177476][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5347.177773][ C1] pipe_read+0xa16/0xdf0 [ 5347.177993][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5347.178273][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5347.178516][ C1] ? iterate_tty_write+0x299/0x540 [ 5347.178778][ C1] ? lock_release+0x1d5/0x250 [ 5347.179017][ C1] vfs_read+0x911/0xc00 [ 5347.179234][ C1] ? lock_acquire+0x1c1/0x220 [ 5347.179472][ C1] ? __might_fault+0xc6/0x180 [ 5347.179712][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5347.179952][ C1] ? __might_fault+0xc6/0x180 [ 5347.180192][ C1] ? lock_release+0x1d5/0x250 [ 5347.180431][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5347.180697][ C1] ? __fget_light+0x54/0x1e0 [ 5347.180933][ C1] ksys_read+0x17a/0x1e0 [ 5347.181152][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5347.181395][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5347.181700][ C1] do_syscall_64+0xc9/0x1e0 [ 5347.181933][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5347.182232][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5347.182459][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5347.183428][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5347.183854][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5347.184253][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5347.184651][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5347.185050][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5347.185450][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5347.185851][ C1] [ 5347.186009][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5347.186282][ C2] NMI backtrace for cpu 2 [ 5347.186289][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5347.186295][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5347.186300][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5347.186309][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5347.186315][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5347.186320][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5347.186324][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5347.186328][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5347.186332][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5347.186336][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5347.186340][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5347.186345][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5347.186350][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5347.186354][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5347.186357][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5347.186361][ C2] PKRU: 55555554 [ 5347.186363][ C2] Call Trace: [ 5347.186366][ C2] [ 5347.186370][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5347.186382][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5347.186390][ C2] ? nmi_handle+0x153/0x420 [ 5347.186400][ C2] ? default_do_nmi+0x41/0x100 [ 5347.186407][ C2] ? exc_nmi+0xf3/0x120 [ 5347.186413][ C2] ? end_repeat_nmi+0xf/0x60 [ 5347.186425][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5347.186433][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5347.186441][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5347.186449][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5347.186457][ C2] [ 5347.186459][ C2] [ 5347.186462][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5347.186469][ C2] ? get_stack_info+0x36/0xc0 [ 5347.186478][ C2] ? lock_acquire+0x1c1/0x220 [ 5347.186486][ C2] ? lock_release+0x1d5/0x250 [ 5347.186495][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5347.186503][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5347.186510][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5347.186519][ C2] ? lock_acquire+0x1c1/0x220 [ 5347.186524][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5347.186533][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5347.186540][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5347.186556][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5347.186562][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5347.186574][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5347.186584][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5347.186593][ C2] ip_local_deliver+0x19d/0x480 [ 5347.186599][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5347.186604][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5347.186610][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5347.186621][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5347.186629][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5347.186636][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5347.186658][ C2] ip_rcv+0x564/0x740 [ 5347.186664][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5347.186670][ C2] ? set_track_prepare+0x8a/0xd0 [ 5347.186679][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5347.186686][ C2] ? start_secondary+0x21c/0x2b0 [ 5347.186693][ C2] ? skb_clone+0x10b/0x330 [ 5347.186699][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5347.186714][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5347.186729][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5347.186736][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5347.186757][ C2] ? __tcf_classify+0x329/0x7d0 [ 5347.186766][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5347.186771][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5347.186779][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5347.186787][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5347.186798][ C2] ? lock_acquire+0x1c1/0x220 [ 5347.186803][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5347.186814][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5347.186823][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5347.186833][ C2] ? __copy_skb_header+0xaf/0x490 [ 5347.186842][ C2] ? __skb_clone+0x57a/0x760 [ 5347.186849][ C2] netif_receive_skb+0x55/0x280 [ 5347.186857][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5347.186875][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5347.186892][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5347.186910][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5347.186922][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5347.186949][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5347.186968][ C2] ? get_stack_info+0x36/0xc0 [ 5347.186980][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5347.186987][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5347.186996][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5347.187002][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5347.187012][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5347.187018][ C2] ? kernel_text_address+0x17/0xe0 [ 5347.187025][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5347.187034][ C2] ? arch_stack_walk+0x8c/0x100 [ 5347.187042][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5347.187049][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5347.187058][ C2] ? lock_acquire+0x1c1/0x220 [ 5347.187063][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5347.187072][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5347.187081][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5347.187088][ C2] ? get_stack_info+0x36/0xc0 [ 5347.187099][ C2] __tcf_classify+0x329/0x7d0 [ 5347.187112][ C2] tcf_classify+0x283/0x930 [ 5347.187123][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5347.187130][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5347.187142][ C2] tc_run+0x2e4/0x5d0 [ 5347.187150][ C2] ? __pfx_tc_run+0x10/0x10 [ 5347.187157][ C2] ? lock_acquire+0x1c1/0x220 [ 5347.187163][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5347.187173][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5347.187183][ C2] ? lock_acquire+0x1c1/0x220 [ 5347.187189][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5347.187196][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5347.187204][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5347.187210][ C2] ? neigh_hh_output+0x348/0x590 [ 5347.187220][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5347.187229][ C2] ip_finish_output2+0x786/0x18e0 [ 5347.187238][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5347.187258][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5347.187262][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5347.187266][ C2] ? __ip_finish_output+0x10f/0x770 [ 5347.187270][ C2] ip_output+0x16b/0x4f0 [ 5347.187273][ C2] ? __pfx_ip_output+0x10/0x10 [ 5347.187275][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5347.187278][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5347.187281][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5347.187285][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5347.187287][ C2] ? __alloc_skb+0xd4/0x280 [ 5347.187290][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5347.187294][ C2] ? tcp_fragment+0x168/0x1040 [ 5347.187297][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5347.187300][ C2] ? ip_local_out+0x114/0x3b0 [ 5347.187304][ C2] __ip_queue_xmit+0x672/0x1910 [ 5347.187307][ C2] ? __skb_clone+0x57a/0x760 [ 5347.187310][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5347.187315][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5347.187318][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5347.187323][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5347.187327][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5347.187331][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5347.187334][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5347.187337][ C2] tcp_send_loss_probe+0x348/0x830 [ 5347.187340][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5347.187343][ C2] tcp_write_timer+0x82/0x1d0 [ 5347.187346][ C2] call_timer_fn+0x173/0x430 [ 5347.187350][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5347.187355][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5347.187359][ C2] __run_timers.part.0+0x52d/0x890 [ 5347.187362][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5347.187366][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5347.187369][ C2] ? lock_acquire+0x1c1/0x220 [ 5347.187371][ C2] ? clockevents_program_event+0xf6/0x300 [ 5347.187376][ C2] ? lock_release+0x1d5/0x250 [ 5347.187378][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5347.187382][ C2] ? ktime_get+0xb3/0x190 [ 5347.187385][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5347.187389][ C2] run_timer_softirq+0x72/0x100 [ 5347.187393][ C2] __do_softirq+0x1b9/0x7ff [ 5347.187397][ C2] irq_exit_rcu+0x98/0xc0 [ 5347.187399][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5347.187403][ C2] [ 5347.187404][ C2] [ 5347.187405][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5347.187408][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5347.187411][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5347.187413][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5347.187416][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5347.187417][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5347.187419][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5347.187420][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5347.187422][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5347.187425][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5347.187428][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5347.187432][ C2] default_idle_call+0x69/0xa0 [ 5347.187435][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5347.187437][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5347.187441][ C2] ? lock_release+0x1d5/0x250 [ 5347.187444][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5347.187448][ C2] do_idle+0xfb/0x160 [ 5347.187450][ C2] cpu_startup_entry+0x55/0x60 [ 5347.187453][ C2] start_secondary+0x21c/0x2b0 [ 5347.187456][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5347.187460][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5347.187466][ C2] [ 5372.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2812s! [perl:4135] [ 5372.569696][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5372.570952][ C1] irq event stamp: 209232 [ 5372.571172][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5372.571703][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5372.572179][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5372.572650][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5372.573112][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5372.573565][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5372.574176][ C1] RIP: 0010:kasan_check_range+0x81/0x1c0 [ 5372.574465][ C1] Code: 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da <48> 29 ea 48 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d [ 5372.575435][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [ 5372.575742][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 5372.576140][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5372.576538][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 5372.576937][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5372.577338][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5372.577737][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5372.578184][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5372.578517][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5372.578918][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5372.579318][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5372.579717][ C1] PKRU: 55555554 [ 5372.579899][ C1] Call Trace: [ 5372.580070][ C1] [ 5372.580218][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5372.580480][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5372.580725][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5372.581000][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5372.581271][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5372.581561][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5372.581827][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5372.582134][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5372.582394][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 5372.582656][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5372.582965][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5372.583260][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5372.583579][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5372.583869][ C1] ? kasan_check_range+0x81/0x1c0 [ 5372.584126][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5372.584407][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5372.584718][ C1] ? get_stack_info+0x36/0xc0 [ 5372.584959][ C1] ? lock_acquire+0x1c1/0x220 [ 5372.585197][ C1] ? lock_release+0x1d5/0x250 [ 5372.585441][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5372.585691][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5372.585962][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5372.586252][ C1] ? lock_acquire+0x1c1/0x220 [ 5372.586489][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5372.586730][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5372.586989][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5372.587225][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5372.587473][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5372.587732][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5372.588006][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5372.588282][ C1] ip_local_deliver+0x19d/0x480 [ 5372.588529][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5372.588801][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5372.589066][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5372.589412][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5372.589668][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5372.589989][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5372.590251][ C1] ip_rcv+0x564/0x740 [ 5372.590454][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5372.590685][ C1] ? set_track_prepare+0x8a/0xd0 [ 5372.590939][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5372.591215][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5372.591487][ C1] ? skb_clone+0x10b/0x330 [ 5372.591716][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5372.592035][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5372.592339][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5372.592622][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5372.592916][ C1] ? __tcf_classify+0x329/0x7d0 [ 5372.593165][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5372.593402][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5372.593701][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5372.593986][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5372.594312][ C1] ? lock_acquire+0x1c1/0x220 [ 5372.594552][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5372.594846][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5372.595133][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5372.595451][ C1] ? __copy_skb_header+0xaf/0x490 [ 5372.595709][ C1] ? __skb_clone+0x57a/0x760 [ 5372.595942][ C1] netif_receive_skb+0x55/0x280 [ 5372.596191][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5372.596505][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5372.596839][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5372.597140][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5372.597414][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5372.597702][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5372.598014][ C1] ? hlock_class+0x4e/0x130 [ 5372.598248][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5372.598522][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5372.598799][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5372.599062][ C1] ? hlock_class+0x4e/0x130 [ 5372.599293][ C1] ? mark_lock+0x38/0x3e0 [ 5372.599515][ C1] ? stack_access_ok+0xda/0x1f0 [ 5372.599763][ C1] ? __lock_acquire+0xb67/0x1610 [ 5372.600017][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5372.600294][ C1] ? get_stack_info+0x36/0xc0 [ 5372.600534][ C1] ? stack_access_ok+0xda/0x1f0 [ 5372.600782][ C1] ? get_reg+0x119/0x190 [ 5372.601000][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5372.601267][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5372.601576][ C1] __tcf_classify+0x329/0x7d0 [ 5372.601818][ C1] tcf_classify+0x283/0x930 [ 5372.602048][ C1] ? arch_stack_walk+0xa2/0x100 [ 5372.602297][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5372.602553][ C1] ? get_stack_info+0x36/0xc0 [ 5372.602794][ C1] tc_run+0x2e4/0x5d0 [ 5372.602999][ C1] ? __pfx_tc_run+0x10/0x10 [ 5372.603232][ C1] ? lock_acquire+0x1c1/0x220 [ 5372.603478][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5372.603742][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5372.603995][ C1] ? lock_acquire+0x1c1/0x220 [ 5372.604234][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5372.604498][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5372.604804][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5372.605075][ C1] ? neigh_hh_output+0x348/0x590 [ 5372.605328][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5372.605593][ C1] ip_finish_output2+0x786/0x18e0 [ 5372.605849][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5372.606130][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5372.606468][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5372.606742][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5372.606995][ C1] ? __ip_finish_output+0x10f/0x770 [ 5372.607259][ C1] ip_output+0x16b/0x4f0 [ 5372.607481][ C1] ? run_timer_softirq+0x72/0x100 [ 5372.607739][ C1] ? __pfx_ip_output+0x10/0x10 [ 5372.607982][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5372.608269][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5372.608521][ C1] ? ip_local_out+0x114/0x3b0 [ 5372.608761][ C1] __ip_queue_xmit+0x672/0x1910 [ 5372.609009][ C1] ? __create_object+0x5e/0xb0 [ 5372.609252][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5372.609519][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5372.609802][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5372.610075][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5372.610355][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5372.610630][ C1] tcp_delack_timer+0x84/0x240 [ 5372.610873][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5372.611146][ C1] call_timer_fn+0x173/0x430 [ 5372.611380][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5372.611642][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5372.611904][ C1] __run_timers.part.0+0x52d/0x890 [ 5372.612165][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5372.612439][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5372.612723][ C1] ? lock_acquire+0x1c1/0x220 [ 5372.612963][ C1] ? clockevents_program_event+0xf6/0x300 [ 5372.613253][ C1] ? lock_release+0x1d5/0x250 [ 5372.613497][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5372.613761][ C1] ? ktime_get+0xb3/0x190 [ 5372.613984][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5372.614281][ C1] run_timer_softirq+0x72/0x100 [ 5372.614529][ C1] __do_softirq+0x1b9/0x7ff [ 5372.614763][ C1] irq_exit_rcu+0x98/0xc0 [ 5372.614982][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5372.615270][ C1] [ 5372.615419][ C1] [ 5372.615571][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5372.615875][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5372.616200][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5372.617170][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5372.617476][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5372.617877][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5372.618276][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5372.618674][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5372.619074][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5372.619477][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5372.619773][ C1] pipe_read+0xa16/0xdf0 [ 5372.619994][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5372.620272][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5372.620516][ C1] ? iterate_tty_write+0x299/0x540 [ 5372.620777][ C1] ? lock_release+0x1d5/0x250 [ 5372.621017][ C1] vfs_read+0x911/0xc00 [ 5372.621233][ C1] ? lock_acquire+0x1c1/0x220 [ 5372.621473][ C1] ? __might_fault+0xc6/0x180 [ 5372.621713][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5372.621953][ C1] ? __might_fault+0xc6/0x180 [ 5372.622194][ C1] ? lock_release+0x1d5/0x250 [ 5372.622434][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5372.622699][ C1] ? __fget_light+0x54/0x1e0 [ 5372.622935][ C1] ksys_read+0x17a/0x1e0 [ 5372.623155][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5372.623407][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5372.623709][ C1] do_syscall_64+0xc9/0x1e0 [ 5372.623944][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5372.624245][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5372.624471][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5372.625440][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5372.625862][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5372.626261][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5372.626659][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5372.627060][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5372.627459][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5372.627860][ C1] [ 5372.628018][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2812s! [swapper/2:0] [ 5372.628439][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5372.629690][ C2] irq event stamp: 44114564 [ 5372.629917][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5372.630452][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5372.630964][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5372.631439][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5372.631908][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5372.632365][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5372.632978][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5372.633301][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5372.634276][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5372.634584][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5372.634981][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5372.635380][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5372.635779][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5372.636177][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5372.636574][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5372.637019][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5372.637352][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5372.637753][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5372.638151][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5372.638548][ C2] PKRU: 55555554 [ 5372.638730][ C2] Call Trace: [ 5372.638900][ C2] [ 5372.639047][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5372.639309][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5372.639552][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5372.639827][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5372.640102][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5372.640389][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5372.640652][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5372.640958][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5372.641219][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5372.641480][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5372.641789][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5372.642084][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5372.642400][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5372.642690][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5372.642985][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5372.643274][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5372.643587][ C2] ? get_stack_info+0x36/0xc0 [ 5372.643829][ C2] ? lock_acquire+0x1c1/0x220 [ 5372.644066][ C2] ? lock_release+0x1d5/0x250 [ 5372.644307][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5372.644556][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5372.644826][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5372.645113][ C2] ? lock_acquire+0x1c1/0x220 [ 5372.645351][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5372.645591][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5372.645850][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5372.646086][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5372.646333][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5372.646589][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5372.646862][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5372.647138][ C2] ip_local_deliver+0x19d/0x480 [ 5372.647385][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5372.647657][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5372.647922][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5372.648271][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5372.648523][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5372.648842][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5372.649104][ C2] ip_rcv+0x564/0x740 [ 5372.649306][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5372.649538][ C2] ? set_track_prepare+0x8a/0xd0 [ 5372.649791][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5372.650067][ C2] ? start_secondary+0x21c/0x2b0 [ 5372.650318][ C2] ? skb_clone+0x10b/0x330 [ 5372.650544][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5372.650862][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5372.651169][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5372.651451][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5372.651743][ C2] ? __tcf_classify+0x329/0x7d0 [ 5372.651991][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5372.652223][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5372.652520][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5372.652807][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5372.653132][ C2] ? lock_acquire+0x1c1/0x220 [ 5372.653373][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5372.653669][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5372.653955][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5372.654270][ C2] ? __copy_skb_header+0xaf/0x490 [ 5372.654527][ C2] ? __skb_clone+0x57a/0x760 [ 5372.654761][ C2] netif_receive_skb+0x55/0x280 [ 5372.655010][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5372.655321][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5372.655653][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5372.655955][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5372.656229][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5372.656516][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5372.656828][ C2] ? get_stack_info+0x36/0xc0 [ 5372.657070][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5372.657333][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5372.657651][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5372.657926][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5372.658203][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5372.658518][ C2] ? kernel_text_address+0x17/0xe0 [ 5372.658778][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5372.659089][ C2] ? arch_stack_walk+0x8c/0x100 [ 5372.659338][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5372.659601][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5372.659888][ C2] ? lock_acquire+0x1c1/0x220 [ 5372.660127][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5372.660409][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5372.660713][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5372.660988][ C2] ? get_stack_info+0x36/0xc0 [ 5372.661230][ C2] __tcf_classify+0x329/0x7d0 [ 5372.661471][ C2] tcf_classify+0x283/0x930 [ 5372.661702][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5372.661958][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5372.662271][ C2] tc_run+0x2e4/0x5d0 [ 5372.662475][ C2] ? __pfx_tc_run+0x10/0x10 [ 5372.662707][ C2] ? lock_acquire+0x1c1/0x220 [ 5372.662944][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5372.663205][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5372.663461][ C2] ? lock_acquire+0x1c1/0x220 [ 5372.663698][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5372.663963][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5372.664266][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5372.664539][ C2] ? neigh_hh_output+0x348/0x590 [ 5372.664791][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5372.665056][ C2] ip_finish_output2+0x786/0x18e0 [ 5372.665314][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5372.665653][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5372.665929][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5372.666183][ C2] ? __ip_finish_output+0x10f/0x770 [ 5372.666447][ C2] ip_output+0x16b/0x4f0 [ 5372.666662][ C2] ? __pfx_ip_output+0x10/0x10 [ 5372.666904][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5372.667182][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5372.667493][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5372.667770][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5372.668021][ C2] ? __alloc_skb+0xd4/0x280 [ 5372.668249][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5372.668517][ C2] ? tcp_fragment+0x168/0x1040 [ 5372.668760][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5372.669012][ C2] ? ip_local_out+0x114/0x3b0 [ 5372.669253][ C2] __ip_queue_xmit+0x672/0x1910 [ 5372.669502][ C2] ? __skb_clone+0x57a/0x760 [ 5372.669737][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5372.670004][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5372.670284][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5372.670527][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5372.670777][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5372.671075][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5372.671396][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5372.671639][ C2] tcp_send_loss_probe+0x348/0x830 [ 5372.671898][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5372.672167][ C2] tcp_write_timer+0x82/0x1d0 [ 5372.672406][ C2] call_timer_fn+0x173/0x430 [ 5372.672644][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5372.672905][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5372.673167][ C2] __run_timers.part.0+0x52d/0x890 [ 5372.673429][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5372.673697][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5372.673983][ C2] ? lock_acquire+0x1c1/0x220 [ 5372.674224][ C2] ? clockevents_program_event+0xf6/0x300 [ 5372.674515][ C2] ? lock_release+0x1d5/0x250 [ 5372.674755][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5372.675019][ C2] ? ktime_get+0xb3/0x190 [ 5372.675238][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5372.675536][ C2] run_timer_softirq+0x72/0x100 [ 5372.675784][ C2] __do_softirq+0x1b9/0x7ff [ 5372.676016][ C2] irq_exit_rcu+0x98/0xc0 [ 5372.676238][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5372.676523][ C2] [ 5372.676675][ C2] [ 5372.676824][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5372.677129][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5372.677386][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5372.678354][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5372.678662][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5372.679060][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5372.679458][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5372.679857][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5372.680256][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5372.680657][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5372.680945][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5372.681208][ C2] default_idle_call+0x69/0xa0 [ 5372.681449][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5372.681701][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5372.681981][ C2] ? lock_release+0x1d5/0x250 [ 5372.682218][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5372.682493][ C2] do_idle+0xfb/0x160 [ 5372.682697][ C2] cpu_startup_entry+0x55/0x60 [ 5372.682944][ C2] start_secondary+0x21c/0x2b0 [ 5372.683187][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5372.683460][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5372.683770][ C2] [ 5400.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2838s! [perl:4135] [ 5400.569701][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5400.570962][ C1] irq event stamp: 209232 [ 5400.571182][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5400.571711][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5400.572189][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5400.572660][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5400.573123][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5400.573580][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5400.574194][ C1] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 5400.574477][ C1] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 5400.575451][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000246 [ 5400.575759][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5400.576159][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5400.576557][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5400.576958][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5400.577357][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5400.577756][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5400.578203][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5400.578535][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5400.578939][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5400.579339][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5400.579738][ C1] PKRU: 55555554 [ 5400.579921][ C1] Call Trace: [ 5400.580094][ C1] [ 5400.580242][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5400.580504][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5400.580748][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5400.581025][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5400.581300][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5400.581590][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5400.581856][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5400.582164][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5400.582426][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5400.582737][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5400.583033][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5400.583354][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5400.583645][ C1] ? kasan_check_range+0x4/0x1c0 [ 5400.583899][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5400.584180][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5400.584492][ C1] ? get_stack_info+0x36/0xc0 [ 5400.584735][ C1] ? lock_acquire+0x1c1/0x220 [ 5400.584975][ C1] ? lock_release+0x1d5/0x250 [ 5400.585216][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5400.585465][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5400.585737][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5400.586025][ C1] ? lock_acquire+0x1c1/0x220 [ 5400.586264][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5400.586505][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5400.586766][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5400.587004][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5400.587252][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5400.587512][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5400.587787][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5400.588065][ C1] ip_local_deliver+0x19d/0x480 [ 5400.588313][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5400.588587][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5400.588853][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5400.589202][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5400.589457][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5400.589779][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5400.590044][ C1] ip_rcv+0x564/0x740 [ 5400.590249][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5400.590480][ C1] ? set_track_prepare+0x8a/0xd0 [ 5400.590734][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5400.591011][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5400.591285][ C1] ? skb_clone+0x10b/0x330 [ 5400.591515][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5400.591836][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5400.592143][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5400.592426][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5400.592721][ C1] ? __tcf_classify+0x329/0x7d0 [ 5400.592971][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5400.593209][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5400.593510][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5400.593796][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5400.594120][ C1] ? lock_acquire+0x1c1/0x220 [ 5400.594361][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5400.594657][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5400.594944][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5400.595262][ C1] ? __copy_skb_header+0xaf/0x490 [ 5400.595520][ C1] ? __skb_clone+0x57a/0x760 [ 5400.595759][ C1] netif_receive_skb+0x55/0x280 [ 5400.596007][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5400.596322][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5400.596654][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5400.596955][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5400.597229][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5400.597519][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5400.597830][ C1] ? hlock_class+0x4e/0x130 [ 5400.598066][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5400.598341][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5400.598620][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5400.598885][ C1] ? hlock_class+0x4e/0x130 [ 5400.599115][ C1] ? mark_lock+0x38/0x3e0 [ 5400.599338][ C1] ? stack_access_ok+0xda/0x1f0 [ 5400.599588][ C1] ? __lock_acquire+0xb67/0x1610 [ 5400.599842][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5400.600119][ C1] ? get_stack_info+0x36/0xc0 [ 5400.600360][ C1] ? stack_access_ok+0xda/0x1f0 [ 5400.600608][ C1] ? get_reg+0x119/0x190 [ 5400.600824][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5400.601092][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5400.601403][ C1] __tcf_classify+0x329/0x7d0 [ 5400.601647][ C1] tcf_classify+0x283/0x930 [ 5400.601878][ C1] ? arch_stack_walk+0xa2/0x100 [ 5400.602128][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5400.602384][ C1] ? get_stack_info+0x36/0xc0 [ 5400.602626][ C1] tc_run+0x2e4/0x5d0 [ 5400.602832][ C1] ? __pfx_tc_run+0x10/0x10 [ 5400.603066][ C1] ? lock_acquire+0x1c1/0x220 [ 5400.603309][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5400.603573][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5400.603825][ C1] ? lock_acquire+0x1c1/0x220 [ 5400.604065][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5400.604330][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5400.604637][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5400.604909][ C1] ? neigh_hh_output+0x348/0x590 [ 5400.605163][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5400.605430][ C1] ip_finish_output2+0x786/0x18e0 [ 5400.605688][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5400.605967][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5400.606306][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5400.606583][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5400.606837][ C1] ? __ip_finish_output+0x10f/0x770 [ 5400.607103][ C1] ip_output+0x16b/0x4f0 [ 5400.607322][ C1] ? run_timer_softirq+0x72/0x100 [ 5400.607580][ C1] ? __pfx_ip_output+0x10/0x10 [ 5400.607824][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5400.608113][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5400.608366][ C1] ? ip_local_out+0x114/0x3b0 [ 5400.608609][ C1] __ip_queue_xmit+0x672/0x1910 [ 5400.608857][ C1] ? __create_object+0x5e/0xb0 [ 5400.609101][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5400.609370][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5400.609653][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5400.609927][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5400.610210][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5400.610484][ C1] tcp_delack_timer+0x84/0x240 [ 5400.610729][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5400.611002][ C1] call_timer_fn+0x173/0x430 [ 5400.611239][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5400.611503][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5400.611765][ C1] __run_timers.part.0+0x52d/0x890 [ 5400.612026][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5400.612304][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5400.612588][ C1] ? lock_acquire+0x1c1/0x220 [ 5400.612829][ C1] ? clockevents_program_event+0xf6/0x300 [ 5400.613121][ C1] ? lock_release+0x1d5/0x250 [ 5400.613366][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5400.613633][ C1] ? ktime_get+0xb3/0x190 [ 5400.613855][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5400.614153][ C1] run_timer_softirq+0x72/0x100 [ 5400.614401][ C1] __do_softirq+0x1b9/0x7ff [ 5400.614636][ C1] irq_exit_rcu+0x98/0xc0 [ 5400.614858][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5400.615146][ C1] [ 5400.615296][ C1] [ 5400.615448][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5400.615753][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5400.616079][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5400.617052][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5400.617360][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5400.617763][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5400.618163][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5400.618562][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5400.618961][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5400.619364][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5400.619660][ C1] pipe_read+0xa16/0xdf0 [ 5400.619884][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5400.620162][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5400.620407][ C1] ? iterate_tty_write+0x299/0x540 [ 5400.620669][ C1] ? lock_release+0x1d5/0x250 [ 5400.620911][ C1] vfs_read+0x911/0xc00 [ 5400.621126][ C1] ? lock_acquire+0x1c1/0x220 [ 5400.621367][ C1] ? __might_fault+0xc6/0x180 [ 5400.621606][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5400.621848][ C1] ? __might_fault+0xc6/0x180 [ 5400.622089][ C1] ? lock_release+0x1d5/0x250 [ 5400.622331][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5400.622597][ C1] ? __fget_light+0x54/0x1e0 [ 5400.622832][ C1] ksys_read+0x17a/0x1e0 [ 5400.623051][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5400.623302][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5400.623604][ C1] do_syscall_64+0xc9/0x1e0 [ 5400.623839][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5400.624139][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5400.624366][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5400.625338][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5400.625762][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5400.626162][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5400.626562][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5400.626964][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5400.627363][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5400.627765][ C1] [ 5400.627924][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2838s! [swapper/2:0] [ 5400.628347][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5400.629600][ C2] irq event stamp: 44114564 [ 5400.629832][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5400.630368][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5400.630881][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5400.631363][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5400.631835][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5400.632294][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5400.632915][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5400.633254][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5400.634233][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5400.634546][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5400.634947][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5400.635346][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5400.635745][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5400.636146][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5400.636544][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5400.636991][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5400.637323][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5400.637724][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5400.638124][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5400.638523][ C2] PKRU: 55555554 [ 5400.638705][ C2] Call Trace: [ 5400.638876][ C2] [ 5400.639024][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5400.639289][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5400.639533][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5400.639812][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5400.640084][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5400.640373][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5400.640638][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5400.640945][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5400.641205][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5400.641468][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5400.641777][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5400.642072][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5400.642387][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5400.642678][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5400.642971][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5400.643266][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5400.643577][ C2] ? get_stack_info+0x36/0xc0 [ 5400.643816][ C2] ? lock_acquire+0x1c1/0x220 [ 5400.644058][ C2] ? lock_release+0x1d5/0x250 [ 5400.644299][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5400.644549][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5400.644820][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5400.645105][ C2] ? lock_acquire+0x1c1/0x220 [ 5400.645343][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5400.645583][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5400.645843][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5400.646078][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5400.646324][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5400.646586][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5400.646862][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5400.647137][ C2] ip_local_deliver+0x19d/0x480 [ 5400.647384][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5400.647653][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5400.647916][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5400.648264][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5400.648516][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5400.648837][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5400.649098][ C2] ip_rcv+0x564/0x740 [ 5400.649303][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5400.649532][ C2] ? set_track_prepare+0x8a/0xd0 [ 5400.649783][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5400.650062][ C2] ? start_secondary+0x21c/0x2b0 [ 5400.650313][ C2] ? skb_clone+0x10b/0x330 [ 5400.650537][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5400.650856][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5400.651162][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5400.651442][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5400.651736][ C2] ? __tcf_classify+0x329/0x7d0 [ 5400.651983][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5400.652215][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5400.652515][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5400.652799][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5400.653125][ C2] ? lock_acquire+0x1c1/0x220 [ 5400.653368][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5400.653664][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5400.653948][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5400.654264][ C2] ? __copy_skb_header+0xaf/0x490 [ 5400.654521][ C2] ? __skb_clone+0x57a/0x760 [ 5400.654755][ C2] netif_receive_skb+0x55/0x280 [ 5400.655003][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5400.655316][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5400.655647][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5400.655945][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5400.656220][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5400.656508][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5400.656820][ C2] ? get_stack_info+0x36/0xc0 [ 5400.657065][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5400.657331][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5400.657647][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5400.657922][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5400.658198][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5400.658513][ C2] ? kernel_text_address+0x17/0xe0 [ 5400.658771][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5400.659084][ C2] ? arch_stack_walk+0x8c/0x100 [ 5400.659333][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5400.659596][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5400.659882][ C2] ? lock_acquire+0x1c1/0x220 [ 5400.660120][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5400.660403][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5400.660704][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5400.660983][ C2] ? get_stack_info+0x36/0xc0 [ 5400.661222][ C2] __tcf_classify+0x329/0x7d0 [ 5400.661464][ C2] tcf_classify+0x283/0x930 [ 5400.661696][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5400.661952][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5400.662265][ C2] tc_run+0x2e4/0x5d0 [ 5400.662469][ C2] ? __pfx_tc_run+0x10/0x10 [ 5400.662699][ C2] ? lock_acquire+0x1c1/0x220 [ 5400.662936][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5400.663203][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5400.663455][ C2] ? lock_acquire+0x1c1/0x220 [ 5400.663692][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5400.663956][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5400.664259][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5400.664530][ C2] ? neigh_hh_output+0x348/0x590 [ 5400.664781][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5400.665044][ C2] ip_finish_output2+0x786/0x18e0 [ 5400.665300][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5400.665639][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5400.665917][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5400.666170][ C2] ? __ip_finish_output+0x10f/0x770 [ 5400.666434][ C2] ip_output+0x16b/0x4f0 [ 5400.666649][ C2] ? __pfx_ip_output+0x10/0x10 [ 5400.666891][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5400.667166][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5400.667479][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5400.667754][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5400.668004][ C2] ? __alloc_skb+0xd4/0x280 [ 5400.668236][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5400.668503][ C2] ? tcp_fragment+0x168/0x1040 [ 5400.668747][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5400.668998][ C2] ? ip_local_out+0x114/0x3b0 [ 5400.669239][ C2] __ip_queue_xmit+0x672/0x1910 [ 5400.669487][ C2] ? __skb_clone+0x57a/0x760 [ 5400.669719][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5400.669984][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5400.670267][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5400.670510][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5400.670757][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5400.671058][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5400.671376][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5400.671619][ C2] tcp_send_loss_probe+0x348/0x830 [ 5400.671878][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5400.672145][ C2] tcp_write_timer+0x82/0x1d0 [ 5400.672384][ C2] call_timer_fn+0x173/0x430 [ 5400.672621][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5400.672882][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5400.673142][ C2] __run_timers.part.0+0x52d/0x890 [ 5400.673413][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5400.673682][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5400.673966][ C2] ? lock_acquire+0x1c1/0x220 [ 5400.674205][ C2] ? clockevents_program_event+0xf6/0x300 [ 5400.674495][ C2] ? lock_release+0x1d5/0x250 [ 5400.674734][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5400.674998][ C2] ? ktime_get+0xb3/0x190 [ 5400.675219][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5400.675515][ C2] run_timer_softirq+0x72/0x100 [ 5400.675762][ C2] __do_softirq+0x1b9/0x7ff [ 5400.675995][ C2] irq_exit_rcu+0x98/0xc0 [ 5400.676216][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5400.676501][ C2] [ 5400.676650][ C2] [ 5400.676802][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5400.677104][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5400.677361][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5400.678331][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5400.678638][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5400.679038][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5400.679437][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5400.679834][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5400.680232][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5400.680632][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5400.680917][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5400.681177][ C2] default_idle_call+0x69/0xa0 [ 5400.681421][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5400.681670][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5400.681946][ C2] ? lock_release+0x1d5/0x250 [ 5400.682186][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5400.682457][ C2] do_idle+0xfb/0x160 [ 5400.682660][ C2] cpu_startup_entry+0x55/0x60 [ 5400.682901][ C2] start_secondary+0x21c/0x2b0 [ 5400.683146][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5400.683426][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5400.683736][ C2] [ 5425.191102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5425.191467][ C1] rcu: 1-....: (3062681 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=748670 [ 5425.192022][ C1] rcu: (t=3070304 jiffies g=1882453 q=712 ncpus=4) [ 5425.192355][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5425.192802][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5425.193421][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5425.193745][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5425.194715][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5425.195025][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5425.195422][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5425.195820][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5425.196222][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5425.196620][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5425.197019][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5425.197466][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5425.197798][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5425.198202][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5425.198603][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5425.199001][ C1] PKRU: 55555554 [ 5425.199183][ C1] Call Trace: [ 5425.199355][ C1] [ 5425.199501][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5425.199774][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5425.200027][ C1] ? check_cpu_stall+0x284/0x500 [ 5425.200279][ C1] ? rcu_pending+0x92/0x360 [ 5425.200511][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5425.200781][ C1] ? update_process_times+0xb9/0x110 [ 5425.201050][ C1] ? tick_sched_handle+0x67/0x130 [ 5425.201307][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5425.201594][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5425.201835][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5425.202149][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5425.202423][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5425.202711][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5425.202977][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5425.203290][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5425.203552][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5425.203864][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5425.204157][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5425.204474][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5425.204765][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5425.205052][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5425.205343][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5425.205655][ C1] ? get_stack_info+0x36/0xc0 [ 5425.205894][ C1] ? lock_acquire+0x1c1/0x220 [ 5425.206136][ C1] ? lock_release+0x1d5/0x250 [ 5425.206376][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5425.206626][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5425.206898][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5425.207183][ C1] ? lock_acquire+0x1c1/0x220 [ 5425.207422][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5425.207664][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5425.207924][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5425.208160][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5425.208406][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5425.208665][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5425.208943][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5425.209220][ C1] ip_local_deliver+0x19d/0x480 [ 5425.209468][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5425.209742][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5425.210006][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5425.210356][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5425.210610][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5425.210930][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5425.211194][ C1] ip_rcv+0x564/0x740 [ 5425.211398][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5425.211629][ C1] ? set_track_prepare+0x8a/0xd0 [ 5425.211881][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5425.212165][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5425.212438][ C1] ? skb_clone+0x10b/0x330 [ 5425.212666][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5425.212986][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5425.213297][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5425.213582][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5425.213876][ C1] ? __tcf_classify+0x329/0x7d0 [ 5425.214126][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5425.214357][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5425.214656][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5425.214943][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5425.215270][ C1] ? lock_acquire+0x1c1/0x220 [ 5425.215509][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5425.215805][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5425.216091][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5425.216409][ C1] ? __copy_skb_header+0xaf/0x490 [ 5425.216667][ C1] ? __skb_clone+0x57a/0x760 [ 5425.216902][ C1] netif_receive_skb+0x55/0x280 [ 5425.217151][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5425.217466][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5425.217798][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5425.218099][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5425.218374][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5425.218665][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5425.218979][ C1] ? hlock_class+0x4e/0x130 [ 5425.219212][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5425.219488][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5425.219764][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5425.220029][ C1] ? hlock_class+0x4e/0x130 [ 5425.220261][ C1] ? mark_lock+0x38/0x3e0 [ 5425.220482][ C1] ? stack_access_ok+0xda/0x1f0 [ 5425.220730][ C1] ? __lock_acquire+0xb67/0x1610 [ 5425.220984][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5425.221263][ C1] ? get_stack_info+0x36/0xc0 [ 5425.221501][ C1] ? stack_access_ok+0xda/0x1f0 [ 5425.221749][ C1] ? get_reg+0x119/0x190 [ 5425.221968][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5425.222237][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5425.222547][ C1] __tcf_classify+0x329/0x7d0 [ 5425.222787][ C1] tcf_classify+0x283/0x930 [ 5425.223020][ C1] ? arch_stack_walk+0xa2/0x100 [ 5425.223274][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5425.223530][ C1] ? get_stack_info+0x36/0xc0 [ 5425.223772][ C1] tc_run+0x2e4/0x5d0 [ 5425.223977][ C1] ? __pfx_tc_run+0x10/0x10 [ 5425.224208][ C1] ? lock_acquire+0x1c1/0x220 [ 5425.224447][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5425.224708][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5425.224962][ C1] ? lock_acquire+0x1c1/0x220 [ 5425.225201][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5425.225466][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5425.225771][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5425.226043][ C1] ? neigh_hh_output+0x348/0x590 [ 5425.226296][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5425.226562][ C1] ip_finish_output2+0x786/0x18e0 [ 5425.226817][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5425.227095][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5425.227434][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5425.227710][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5425.227967][ C1] ? __ip_finish_output+0x10f/0x770 [ 5425.228232][ C1] ip_output+0x16b/0x4f0 [ 5425.228448][ C1] ? run_timer_softirq+0x72/0x100 [ 5425.228705][ C1] ? __pfx_ip_output+0x10/0x10 [ 5425.228949][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5425.229237][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5425.229489][ C1] ? ip_local_out+0x114/0x3b0 [ 5425.229728][ C1] __ip_queue_xmit+0x672/0x1910 [ 5425.229976][ C1] ? __create_object+0x5e/0xb0 [ 5425.230222][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5425.230488][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5425.230768][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5425.231043][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5425.231323][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5425.231594][ C1] tcp_delack_timer+0x84/0x240 [ 5425.231839][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5425.232110][ C1] call_timer_fn+0x173/0x430 [ 5425.232347][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5425.232609][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5425.232871][ C1] __run_timers.part.0+0x52d/0x890 [ 5425.233134][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5425.233410][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5425.233695][ C1] ? lock_acquire+0x1c1/0x220 [ 5425.233934][ C1] ? clockevents_program_event+0xf6/0x300 [ 5425.234224][ C1] ? lock_release+0x1d5/0x250 [ 5425.234465][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5425.234730][ C1] ? ktime_get+0xb3/0x190 [ 5425.234952][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5425.235249][ C1] run_timer_softirq+0x72/0x100 [ 5425.235496][ C1] __do_softirq+0x1b9/0x7ff [ 5425.235731][ C1] irq_exit_rcu+0x98/0xc0 [ 5425.235951][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5425.236239][ C1] [ 5425.236390][ C1] [ 5425.236539][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5425.236845][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5425.237169][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5425.238141][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5425.238450][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5425.238848][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5425.239249][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5425.239648][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5425.240046][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5425.240447][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5425.240745][ C1] pipe_read+0xa16/0xdf0 [ 5425.240966][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5425.241245][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5425.241487][ C1] ? iterate_tty_write+0x299/0x540 [ 5425.241749][ C1] ? lock_release+0x1d5/0x250 [ 5425.241989][ C1] vfs_read+0x911/0xc00 [ 5425.242205][ C1] ? lock_acquire+0x1c1/0x220 [ 5425.242443][ C1] ? __might_fault+0xc6/0x180 [ 5425.242685][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5425.242925][ C1] ? __might_fault+0xc6/0x180 [ 5425.243168][ C1] ? lock_release+0x1d5/0x250 [ 5425.243407][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5425.243679][ C1] ? __fget_light+0x54/0x1e0 [ 5425.243917][ C1] ksys_read+0x17a/0x1e0 [ 5425.244138][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5425.244381][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5425.244686][ C1] do_syscall_64+0xc9/0x1e0 [ 5425.244920][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5425.245217][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5425.245447][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5425.246416][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5425.246838][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5425.247238][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5425.247636][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5425.248033][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5425.248435][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5425.248835][ C1] [ 5425.248991][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5425.249264][ C2] NMI backtrace for cpu 2 [ 5425.249271][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5425.249277][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5425.249281][ C2] RIP: 0010:kasan_check_range+0x106/0x1c0 [ 5425.249291][ C2] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [ 5425.249297][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000246 [ 5425.249302][ C2] RAX: ffffed100147436c RBX: ffffed100147436c RCX: ffffffff97c7eb80 [ 5425.249306][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5425.249310][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [ 5425.249314][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5425.249318][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5425.249322][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5425.249327][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5425.249332][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5425.249336][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5425.249339][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5425.249343][ C2] PKRU: 55555554 [ 5425.249345][ C2] Call Trace: [ 5425.249348][ C2] [ 5425.249352][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5425.249364][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5425.249372][ C2] ? nmi_handle+0x153/0x420 [ 5425.249382][ C2] ? default_do_nmi+0x41/0x100 [ 5425.249389][ C2] ? exc_nmi+0xf3/0x120 [ 5425.249395][ C2] ? end_repeat_nmi+0xf/0x60 [ 5425.249407][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5425.249416][ C2] ? kasan_check_range+0x106/0x1c0 [ 5425.249423][ C2] ? kasan_check_range+0x106/0x1c0 [ 5425.249432][ C2] ? kasan_check_range+0x106/0x1c0 [ 5425.249440][ C2] [ 5425.249441][ C2] [ 5425.249444][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 5425.249452][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5425.249459][ C2] ? get_stack_info+0x36/0xc0 [ 5425.249468][ C2] ? lock_acquire+0x1c1/0x220 [ 5425.249476][ C2] ? lock_release+0x1d5/0x250 [ 5425.249485][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5425.249493][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5425.249500][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5425.249508][ C2] ? lock_acquire+0x1c1/0x220 [ 5425.249514][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5425.249522][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5425.249529][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5425.249546][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5425.249552][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5425.249564][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5425.249575][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5425.249583][ C2] ip_local_deliver+0x19d/0x480 [ 5425.249589][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5425.249594][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5425.249600][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5425.249612][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5425.249620][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5425.249627][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5425.249649][ C2] ip_rcv+0x564/0x740 [ 5425.249655][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5425.249661][ C2] ? set_track_prepare+0x8a/0xd0 [ 5425.249670][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5425.249677][ C2] ? start_secondary+0x21c/0x2b0 [ 5425.249684][ C2] ? skb_clone+0x10b/0x330 [ 5425.249690][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5425.249705][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5425.249720][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5425.249727][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5425.249748][ C2] ? __tcf_classify+0x329/0x7d0 [ 5425.249756][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5425.249762][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5425.249769][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5425.249777][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5425.249788][ C2] ? lock_acquire+0x1c1/0x220 [ 5425.249794][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5425.249804][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5425.249813][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5425.249824][ C2] ? __copy_skb_header+0xaf/0x490 [ 5425.249833][ C2] ? __skb_clone+0x57a/0x760 [ 5425.249839][ C2] netif_receive_skb+0x55/0x280 [ 5425.249847][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5425.249865][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5425.249883][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5425.249901][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5425.249913][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5425.249939][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5425.249959][ C2] ? get_stack_info+0x36/0xc0 [ 5425.249971][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5425.249978][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5425.249987][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5425.249993][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5425.250003][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5425.250009][ C2] ? kernel_text_address+0x17/0xe0 [ 5425.250016][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5425.250025][ C2] ? arch_stack_walk+0x8c/0x100 [ 5425.250033][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5425.250041][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5425.250049][ C2] ? lock_acquire+0x1c1/0x220 [ 5425.250055][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5425.250062][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5425.250066][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5425.250069][ C2] ? get_stack_info+0x36/0xc0 [ 5425.250073][ C2] __tcf_classify+0x329/0x7d0 [ 5425.250078][ C2] tcf_classify+0x283/0x930 [ 5425.250082][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5425.250086][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5425.250090][ C2] tc_run+0x2e4/0x5d0 [ 5425.250093][ C2] ? __pfx_tc_run+0x10/0x10 [ 5425.250096][ C2] ? lock_acquire+0x1c1/0x220 [ 5425.250099][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5425.250103][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5425.250106][ C2] ? lock_acquire+0x1c1/0x220 [ 5425.250109][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5425.250112][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5425.250115][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5425.250118][ C2] ? neigh_hh_output+0x348/0x590 [ 5425.250121][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5425.250125][ C2] ip_finish_output2+0x786/0x18e0 [ 5425.250128][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5425.250136][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5425.250139][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5425.250142][ C2] ? __ip_finish_output+0x10f/0x770 [ 5425.250146][ C2] ip_output+0x16b/0x4f0 [ 5425.250149][ C2] ? __pfx_ip_output+0x10/0x10 [ 5425.250152][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5425.250155][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5425.250158][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5425.250161][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5425.250163][ C2] ? __alloc_skb+0xd4/0x280 [ 5425.250166][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5425.250170][ C2] ? tcp_fragment+0x168/0x1040 [ 5425.250173][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5425.250176][ C2] ? ip_local_out+0x114/0x3b0 [ 5425.250180][ C2] __ip_queue_xmit+0x672/0x1910 [ 5425.250183][ C2] ? __skb_clone+0x57a/0x760 [ 5425.250186][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5425.250191][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5425.250194][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5425.250198][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5425.250202][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5425.250207][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5425.250210][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5425.250213][ C2] tcp_send_loss_probe+0x348/0x830 [ 5425.250217][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5425.250219][ C2] tcp_write_timer+0x82/0x1d0 [ 5425.250223][ C2] call_timer_fn+0x173/0x430 [ 5425.250227][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5425.250231][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5425.250235][ C2] __run_timers.part.0+0x52d/0x890 [ 5425.250238][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5425.250242][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5425.250245][ C2] ? lock_acquire+0x1c1/0x220 [ 5425.250247][ C2] ? clockevents_program_event+0xf6/0x300 [ 5425.250252][ C2] ? lock_release+0x1d5/0x250 [ 5425.250254][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5425.250257][ C2] ? ktime_get+0xb3/0x190 [ 5425.250261][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5425.250265][ C2] run_timer_softirq+0x72/0x100 [ 5425.250268][ C2] __do_softirq+0x1b9/0x7ff [ 5425.250273][ C2] irq_exit_rcu+0x98/0xc0 [ 5425.250275][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5425.250279][ C2] [ 5425.250279][ C2] [ 5425.250280][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5425.250284][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5425.250287][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5425.250289][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5425.250291][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5425.250293][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5425.250294][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5425.250296][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5425.250297][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5425.250300][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5425.250303][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5425.250307][ C2] default_idle_call+0x69/0xa0 [ 5425.250310][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5425.250312][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5425.250316][ C2] ? lock_release+0x1d5/0x250 [ 5425.250318][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5425.250322][ C2] do_idle+0xfb/0x160 [ 5425.250325][ C2] cpu_startup_entry+0x55/0x60 [ 5425.250328][ C2] start_secondary+0x21c/0x2b0 [ 5425.250331][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5425.250335][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5425.250341][ C2] [ 5452.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2887s! [perl:4135] [ 5452.569699][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5452.570954][ C1] irq event stamp: 209232 [ 5452.571173][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5452.571702][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5452.572176][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5452.572645][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5452.573112][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5452.573559][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5452.574170][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 5452.574455][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 5452.575422][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 5452.575730][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5452.576129][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5452.576527][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5452.576925][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5452.577325][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5452.577723][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5452.578171][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5452.578504][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5452.578905][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5452.579305][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5452.579704][ C1] PKRU: 55555554 [ 5452.579886][ C1] Call Trace: [ 5452.580057][ C1] [ 5452.580205][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5452.580468][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5452.580712][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5452.580988][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5452.581259][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5452.581551][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5452.581815][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5452.582121][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5452.582384][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5452.582693][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5452.582992][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5452.583308][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5452.583597][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 5452.583882][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5452.584162][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5452.584473][ C1] ? get_stack_info+0x36/0xc0 [ 5452.584715][ C1] ? lock_acquire+0x1c1/0x220 [ 5452.584957][ C1] ? lock_release+0x1d5/0x250 [ 5452.585196][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5452.585445][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5452.585719][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5452.586003][ C1] ? lock_acquire+0x1c1/0x220 [ 5452.586243][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5452.586482][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5452.586744][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5452.586977][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5452.587224][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5452.587483][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5452.587758][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5452.588036][ C1] ip_local_deliver+0x19d/0x480 [ 5452.588283][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5452.588555][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5452.588818][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5452.589164][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5452.589418][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5452.589738][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5452.590000][ C1] ip_rcv+0x564/0x740 [ 5452.590203][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5452.590436][ C1] ? set_track_prepare+0x8a/0xd0 [ 5452.590689][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5452.590965][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5452.591241][ C1] ? skb_clone+0x10b/0x330 [ 5452.591468][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5452.591787][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5452.592093][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5452.592374][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5452.592669][ C1] ? __tcf_classify+0x329/0x7d0 [ 5452.592917][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5452.593152][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5452.593453][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5452.593736][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5452.594060][ C1] ? lock_acquire+0x1c1/0x220 [ 5452.594300][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5452.594598][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5452.594882][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5452.595198][ C1] ? __copy_skb_header+0xaf/0x490 [ 5452.595456][ C1] ? __skb_clone+0x57a/0x760 [ 5452.595690][ C1] netif_receive_skb+0x55/0x280 [ 5452.595940][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5452.596252][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5452.596585][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5452.596883][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5452.597157][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5452.597446][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5452.597759][ C1] ? hlock_class+0x4e/0x130 [ 5452.597989][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5452.598267][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5452.598543][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5452.598806][ C1] ? hlock_class+0x4e/0x130 [ 5452.599038][ C1] ? mark_lock+0x38/0x3e0 [ 5452.599257][ C1] ? stack_access_ok+0xda/0x1f0 [ 5452.599505][ C1] ? __lock_acquire+0xb67/0x1610 [ 5452.599760][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5452.600034][ C1] ? get_stack_info+0x36/0xc0 [ 5452.600278][ C1] ? stack_access_ok+0xda/0x1f0 [ 5452.600529][ C1] ? get_reg+0x119/0x190 [ 5452.600744][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5452.601011][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5452.601322][ C1] __tcf_classify+0x329/0x7d0 [ 5452.601564][ C1] tcf_classify+0x283/0x930 [ 5452.601796][ C1] ? arch_stack_walk+0xa2/0x100 [ 5452.602043][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5452.602299][ C1] ? get_stack_info+0x36/0xc0 [ 5452.602540][ C1] tc_run+0x2e4/0x5d0 [ 5452.602744][ C1] ? __pfx_tc_run+0x10/0x10 [ 5452.602981][ C1] ? lock_acquire+0x1c1/0x220 [ 5452.603222][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5452.603482][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5452.603735][ C1] ? lock_acquire+0x1c1/0x220 [ 5452.603972][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5452.604237][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5452.604540][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5452.604814][ C1] ? neigh_hh_output+0x348/0x590 [ 5452.605067][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5452.605331][ C1] ip_finish_output2+0x786/0x18e0 [ 5452.605587][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5452.605865][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5452.606202][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5452.606478][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5452.606731][ C1] ? __ip_finish_output+0x10f/0x770 [ 5452.606997][ C1] ip_output+0x16b/0x4f0 [ 5452.607213][ C1] ? run_timer_softirq+0x72/0x100 [ 5452.607469][ C1] ? __pfx_ip_output+0x10/0x10 [ 5452.607713][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5452.607997][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5452.608249][ C1] ? ip_local_out+0x114/0x3b0 [ 5452.608490][ C1] __ip_queue_xmit+0x672/0x1910 [ 5452.608739][ C1] ? __create_object+0x5e/0xb0 [ 5452.608982][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5452.609249][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5452.609529][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5452.609805][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5452.610091][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5452.610365][ C1] tcp_delack_timer+0x84/0x240 [ 5452.610610][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5452.610881][ C1] call_timer_fn+0x173/0x430 [ 5452.611118][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5452.611379][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5452.611640][ C1] __run_timers.part.0+0x52d/0x890 [ 5452.611900][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5452.612173][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5452.612459][ C1] ? lock_acquire+0x1c1/0x220 [ 5452.612696][ C1] ? clockevents_program_event+0xf6/0x300 [ 5452.612992][ C1] ? lock_release+0x1d5/0x250 [ 5452.613232][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5452.613496][ C1] ? ktime_get+0xb3/0x190 [ 5452.613715][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5452.614012][ C1] run_timer_softirq+0x72/0x100 [ 5452.614261][ C1] __do_softirq+0x1b9/0x7ff [ 5452.614496][ C1] irq_exit_rcu+0x98/0xc0 [ 5452.614718][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5452.615003][ C1] [ 5452.615153][ C1] [ 5452.615304][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5452.615609][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5452.615933][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5452.616902][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5452.617210][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5452.617607][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5452.618005][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5452.618403][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5452.618803][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5452.619204][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5452.619500][ C1] pipe_read+0xa16/0xdf0 [ 5452.619721][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5452.619999][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5452.620243][ C1] ? iterate_tty_write+0x299/0x540 [ 5452.620505][ C1] ? lock_release+0x1d5/0x250 [ 5452.620746][ C1] vfs_read+0x911/0xc00 [ 5452.620959][ C1] ? lock_acquire+0x1c1/0x220 [ 5452.621198][ C1] ? __might_fault+0xc6/0x180 [ 5452.621438][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5452.621675][ C1] ? __might_fault+0xc6/0x180 [ 5452.621916][ C1] ? lock_release+0x1d5/0x250 [ 5452.622157][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5452.622421][ C1] ? __fget_light+0x54/0x1e0 [ 5452.622659][ C1] ksys_read+0x17a/0x1e0 [ 5452.622875][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5452.623125][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5452.623430][ C1] do_syscall_64+0xc9/0x1e0 [ 5452.623661][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5452.623962][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5452.624190][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5452.625159][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5452.625577][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5452.625975][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5452.626374][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5452.626772][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5452.627168][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5452.627569][ C1] [ 5452.627728][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2887s! [swapper/2:0] [ 5452.628147][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5452.629396][ C2] irq event stamp: 44114564 [ 5452.629627][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5452.630161][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5452.630671][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5452.631149][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5452.631620][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5452.632073][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5452.632689][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5452.633018][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5452.633991][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5452.634299][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5452.634697][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5452.635093][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5452.635492][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5452.635891][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5452.636289][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5452.636735][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5452.637066][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5452.637468][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5452.637868][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5452.638267][ C2] PKRU: 55555554 [ 5452.638448][ C2] Call Trace: [ 5452.638619][ C2] [ 5452.638767][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5452.639029][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5452.639272][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5452.639547][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5452.639818][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5452.640107][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5452.640371][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5452.640675][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5452.640935][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5452.641197][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5452.641506][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5452.641800][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5452.642114][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5452.642403][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5452.642696][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5452.642991][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5452.643302][ C2] ? get_stack_info+0x36/0xc0 [ 5452.643540][ C2] ? lock_acquire+0x1c1/0x220 [ 5452.643780][ C2] ? lock_release+0x1d5/0x250 [ 5452.644020][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5452.644269][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5452.644540][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5452.644825][ C2] ? lock_acquire+0x1c1/0x220 [ 5452.645063][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5452.645304][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5452.645564][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5452.645799][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5452.646044][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5452.646301][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5452.646576][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5452.646853][ C2] ip_local_deliver+0x19d/0x480 [ 5452.647100][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5452.647370][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5452.647631][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5452.647978][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5452.648231][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5452.648554][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5452.648816][ C2] ip_rcv+0x564/0x740 [ 5452.649020][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5452.649249][ C2] ? set_track_prepare+0x8a/0xd0 [ 5452.649501][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5452.649779][ C2] ? start_secondary+0x21c/0x2b0 [ 5452.650031][ C2] ? skb_clone+0x10b/0x330 [ 5452.650256][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5452.650574][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5452.650879][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5452.651159][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5452.651453][ C2] ? __tcf_classify+0x329/0x7d0 [ 5452.651701][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5452.651930][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5452.652231][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5452.652518][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5452.652844][ C2] ? lock_acquire+0x1c1/0x220 [ 5452.653089][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5452.653390][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5452.653672][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5452.653990][ C2] ? __copy_skb_header+0xaf/0x490 [ 5452.654246][ C2] ? __skb_clone+0x57a/0x760 [ 5452.654481][ C2] netif_receive_skb+0x55/0x280 [ 5452.654729][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5452.655041][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5452.655374][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5452.655670][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5452.655946][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5452.656234][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5452.656544][ C2] ? get_stack_info+0x36/0xc0 [ 5452.656785][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5452.657049][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5452.657366][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5452.657642][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5452.657917][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5452.658231][ C2] ? kernel_text_address+0x17/0xe0 [ 5452.658490][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5452.658802][ C2] ? arch_stack_walk+0x8c/0x100 [ 5452.659050][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5452.659314][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5452.659599][ C2] ? lock_acquire+0x1c1/0x220 [ 5452.659836][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5452.660119][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5452.660420][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5452.660699][ C2] ? get_stack_info+0x36/0xc0 [ 5452.660938][ C2] __tcf_classify+0x329/0x7d0 [ 5452.661179][ C2] tcf_classify+0x283/0x930 [ 5452.661412][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5452.661667][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5452.661979][ C2] tc_run+0x2e4/0x5d0 [ 5452.662183][ C2] ? __pfx_tc_run+0x10/0x10 [ 5452.662412][ C2] ? lock_acquire+0x1c1/0x220 [ 5452.662649][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5452.662909][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5452.663166][ C2] ? lock_acquire+0x1c1/0x220 [ 5452.663404][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5452.663668][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5452.663970][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5452.664241][ C2] ? neigh_hh_output+0x348/0x590 [ 5452.664496][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5452.664759][ C2] ip_finish_output2+0x786/0x18e0 [ 5452.665014][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5452.665353][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5452.665629][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5452.665882][ C2] ? __ip_finish_output+0x10f/0x770 [ 5452.666147][ C2] ip_output+0x16b/0x4f0 [ 5452.666362][ C2] ? __pfx_ip_output+0x10/0x10 [ 5452.666603][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5452.666878][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5452.667190][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5452.667466][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5452.667716][ C2] ? __alloc_skb+0xd4/0x280 [ 5452.667946][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5452.668214][ C2] ? tcp_fragment+0x168/0x1040 [ 5452.668457][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5452.668708][ C2] ? ip_local_out+0x114/0x3b0 [ 5452.668948][ C2] __ip_queue_xmit+0x672/0x1910 [ 5452.669196][ C2] ? __skb_clone+0x57a/0x760 [ 5452.669429][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5452.669695][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5452.669975][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5452.670219][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5452.670467][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5452.670766][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5452.671085][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5452.671330][ C2] tcp_send_loss_probe+0x348/0x830 [ 5452.671588][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5452.671854][ C2] tcp_write_timer+0x82/0x1d0 [ 5452.672094][ C2] call_timer_fn+0x173/0x430 [ 5452.672331][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5452.672592][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5452.672852][ C2] __run_timers.part.0+0x52d/0x890 [ 5452.673117][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5452.673385][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5452.673670][ C2] ? lock_acquire+0x1c1/0x220 [ 5452.673907][ C2] ? clockevents_program_event+0xf6/0x300 [ 5452.674198][ C2] ? lock_release+0x1d5/0x250 [ 5452.674436][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5452.674703][ C2] ? ktime_get+0xb3/0x190 [ 5452.674921][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5452.675218][ C2] run_timer_softirq+0x72/0x100 [ 5452.675465][ C2] __do_softirq+0x1b9/0x7ff [ 5452.675697][ C2] irq_exit_rcu+0x98/0xc0 [ 5452.675918][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5452.676202][ C2] [ 5452.676352][ C2] [ 5452.676503][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5452.676807][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5452.677063][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5452.678029][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5452.678337][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5452.678737][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5452.679133][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5452.679530][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5452.679929][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5452.680329][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5452.680615][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5452.680875][ C2] default_idle_call+0x69/0xa0 [ 5452.681119][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5452.681369][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5452.681644][ C2] ? lock_release+0x1d5/0x250 [ 5452.681884][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5452.682155][ C2] do_idle+0xfb/0x160 [ 5452.682362][ C2] cpu_startup_entry+0x55/0x60 [ 5452.682601][ C2] start_secondary+0x21c/0x2b0 [ 5452.682845][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5452.683117][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5452.683432][ C2] [ 5480.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2913s! [perl:4135] [ 5480.569710][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5480.570964][ C1] irq event stamp: 209232 [ 5480.571181][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5480.571708][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5480.572187][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5480.572654][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5480.573120][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5480.573569][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5480.574184][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 5480.574469][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 5480.575440][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 5480.575748][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5480.576147][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5480.576548][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5480.576948][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5480.577345][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5480.577746][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5480.578195][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5480.578529][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5480.578930][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5480.579329][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5480.579727][ C1] PKRU: 55555554 [ 5480.579909][ C1] Call Trace: [ 5480.580081][ C1] [ 5480.580229][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5480.580491][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5480.580735][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5480.581011][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5480.581285][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5480.581571][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5480.581836][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5480.582143][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5480.582405][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5480.582713][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5480.583012][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5480.583327][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5480.583616][ C1] ? kasan_check_range+0x12/0x1c0 [ 5480.583873][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5480.584152][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5480.584463][ C1] ? get_stack_info+0x36/0xc0 [ 5480.584705][ C1] ? lock_acquire+0x1c1/0x220 [ 5480.584946][ C1] ? lock_release+0x1d5/0x250 [ 5480.585185][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5480.585433][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5480.585707][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5480.585990][ C1] ? lock_acquire+0x1c1/0x220 [ 5480.586229][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5480.586470][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5480.586730][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5480.586964][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5480.587211][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5480.587468][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5480.587741][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5480.588026][ C1] ip_local_deliver+0x19d/0x480 [ 5480.588274][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5480.588547][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5480.588812][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5480.589159][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5480.589414][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5480.589735][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5480.589999][ C1] ip_rcv+0x564/0x740 [ 5480.590204][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5480.590437][ C1] ? set_track_prepare+0x8a/0xd0 [ 5480.590691][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5480.590968][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5480.591243][ C1] ? skb_clone+0x10b/0x330 [ 5480.591471][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5480.591791][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5480.592099][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5480.592381][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5480.592679][ C1] ? __tcf_classify+0x329/0x7d0 [ 5480.592934][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5480.593165][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5480.593467][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5480.593753][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5480.594079][ C1] ? lock_acquire+0x1c1/0x220 [ 5480.594321][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5480.594621][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5480.594906][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5480.595225][ C1] ? __copy_skb_header+0xaf/0x490 [ 5480.595483][ C1] ? __skb_clone+0x57a/0x760 [ 5480.595722][ C1] netif_receive_skb+0x55/0x280 [ 5480.595972][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5480.596286][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5480.596621][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5480.596921][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5480.597196][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5480.597487][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5480.597807][ C1] ? hlock_class+0x4e/0x130 [ 5480.598038][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5480.598318][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5480.598595][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5480.598859][ C1] ? hlock_class+0x4e/0x130 [ 5480.599092][ C1] ? mark_lock+0x38/0x3e0 [ 5480.599312][ C1] ? stack_access_ok+0xda/0x1f0 [ 5480.599562][ C1] ? __lock_acquire+0xb67/0x1610 [ 5480.599818][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5480.600095][ C1] ? get_stack_info+0x36/0xc0 [ 5480.600336][ C1] ? stack_access_ok+0xda/0x1f0 [ 5480.600584][ C1] ? get_reg+0x119/0x190 [ 5480.600801][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5480.601070][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5480.601381][ C1] __tcf_classify+0x329/0x7d0 [ 5480.601624][ C1] tcf_classify+0x283/0x930 [ 5480.601857][ C1] ? arch_stack_walk+0xa2/0x100 [ 5480.602106][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5480.602364][ C1] ? get_stack_info+0x36/0xc0 [ 5480.602604][ C1] tc_run+0x2e4/0x5d0 [ 5480.602816][ C1] ? __pfx_tc_run+0x10/0x10 [ 5480.603049][ C1] ? lock_acquire+0x1c1/0x220 [ 5480.603289][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5480.603552][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5480.603807][ C1] ? lock_acquire+0x1c1/0x220 [ 5480.604047][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5480.604313][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5480.604619][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5480.604893][ C1] ? neigh_hh_output+0x348/0x590 [ 5480.605146][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5480.605413][ C1] ip_finish_output2+0x786/0x18e0 [ 5480.605670][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5480.605949][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5480.606288][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5480.606567][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5480.606821][ C1] ? __ip_finish_output+0x10f/0x770 [ 5480.607088][ C1] ip_output+0x16b/0x4f0 [ 5480.607304][ C1] ? run_timer_softirq+0x72/0x100 [ 5480.607562][ C1] ? __pfx_ip_output+0x10/0x10 [ 5480.607806][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5480.608092][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5480.608345][ C1] ? ip_local_out+0x114/0x3b0 [ 5480.608588][ C1] __ip_queue_xmit+0x672/0x1910 [ 5480.608838][ C1] ? __create_object+0x5e/0xb0 [ 5480.609084][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5480.609352][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5480.609634][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5480.609906][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5480.610191][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5480.610464][ C1] tcp_delack_timer+0x84/0x240 [ 5480.610710][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5480.610983][ C1] call_timer_fn+0x173/0x430 [ 5480.611221][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5480.611483][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5480.611745][ C1] __run_timers.part.0+0x52d/0x890 [ 5480.612007][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5480.612281][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5480.612568][ C1] ? lock_acquire+0x1c1/0x220 [ 5480.612811][ C1] ? clockevents_program_event+0xf6/0x300 [ 5480.613105][ C1] ? lock_release+0x1d5/0x250 [ 5480.613347][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5480.613616][ C1] ? ktime_get+0xb3/0x190 [ 5480.613838][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5480.614137][ C1] run_timer_softirq+0x72/0x100 [ 5480.614387][ C1] __do_softirq+0x1b9/0x7ff [ 5480.614618][ C1] irq_exit_rcu+0x98/0xc0 [ 5480.614841][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5480.615127][ C1] [ 5480.615279][ C1] [ 5480.615430][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5480.615736][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5480.616062][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5480.617036][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5480.617346][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5480.617749][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5480.618148][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5480.618549][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5480.618950][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5480.619354][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5480.619653][ C1] pipe_read+0xa16/0xdf0 [ 5480.619875][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5480.620152][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5480.620398][ C1] ? iterate_tty_write+0x299/0x540 [ 5480.620660][ C1] ? lock_release+0x1d5/0x250 [ 5480.620902][ C1] vfs_read+0x911/0xc00 [ 5480.621117][ C1] ? lock_acquire+0x1c1/0x220 [ 5480.621358][ C1] ? __might_fault+0xc6/0x180 [ 5480.621600][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5480.621839][ C1] ? __might_fault+0xc6/0x180 [ 5480.622079][ C1] ? lock_release+0x1d5/0x250 [ 5480.622321][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5480.622586][ C1] ? __fget_light+0x54/0x1e0 [ 5480.622830][ C1] ksys_read+0x17a/0x1e0 [ 5480.623048][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5480.623293][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5480.623599][ C1] do_syscall_64+0xc9/0x1e0 [ 5480.623830][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5480.624133][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5480.624362][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5480.625337][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5480.625758][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5480.626159][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5480.626560][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5480.626960][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5480.627360][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5480.627765][ C1] [ 5480.627923][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2913s! [swapper/2:0] [ 5480.628347][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5480.629601][ C2] irq event stamp: 44114564 [ 5480.629831][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5480.630367][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5480.630879][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5480.631354][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5480.631826][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5480.632282][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5480.632897][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5480.633223][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5480.634196][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5480.634502][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5480.634904][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5480.635303][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5480.635701][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5480.636102][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5480.636502][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5480.636950][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5480.637282][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5480.637683][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5480.638083][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5480.638484][ C2] PKRU: 55555554 [ 5480.638666][ C2] Call Trace: [ 5480.638834][ C2] [ 5480.638985][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5480.639247][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5480.639490][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5480.639767][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5480.640039][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5480.640328][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5480.640593][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5480.640897][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5480.641160][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5480.641423][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5480.641732][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5480.642028][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5480.642342][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5480.642630][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5480.642929][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5480.643220][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5480.643531][ C2] ? get_stack_info+0x36/0xc0 [ 5480.643771][ C2] ? lock_acquire+0x1c1/0x220 [ 5480.644012][ C2] ? lock_release+0x1d5/0x250 [ 5480.644253][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5480.644501][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5480.644774][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5480.645058][ C2] ? lock_acquire+0x1c1/0x220 [ 5480.645297][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5480.645539][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5480.645799][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5480.646033][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5480.646281][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5480.646538][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5480.646815][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5480.647093][ C2] ip_local_deliver+0x19d/0x480 [ 5480.647341][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5480.647611][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5480.647875][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5480.648222][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5480.648476][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5480.648796][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5480.649059][ C2] ip_rcv+0x564/0x740 [ 5480.649264][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5480.649492][ C2] ? set_track_prepare+0x8a/0xd0 [ 5480.649745][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5480.650022][ C2] ? start_secondary+0x21c/0x2b0 [ 5480.650273][ C2] ? skb_clone+0x10b/0x330 [ 5480.650500][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5480.650820][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5480.651126][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5480.651407][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5480.651701][ C2] ? __tcf_classify+0x329/0x7d0 [ 5480.651948][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5480.652179][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5480.652481][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5480.652764][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5480.653095][ C2] ? lock_acquire+0x1c1/0x220 [ 5480.653334][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5480.653631][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5480.653918][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5480.654236][ C2] ? __copy_skb_header+0xaf/0x490 [ 5480.654493][ C2] ? __skb_clone+0x57a/0x760 [ 5480.654730][ C2] netif_receive_skb+0x55/0x280 [ 5480.654978][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5480.655288][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5480.655622][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5480.655921][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5480.656194][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5480.656485][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5480.656797][ C2] ? get_stack_info+0x36/0xc0 [ 5480.657037][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5480.657303][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5480.657618][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5480.657897][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5480.658174][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5480.658489][ C2] ? kernel_text_address+0x17/0xe0 [ 5480.658749][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5480.659062][ C2] ? arch_stack_walk+0x8c/0x100 [ 5480.659311][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5480.659575][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5480.659859][ C2] ? lock_acquire+0x1c1/0x220 [ 5480.660098][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5480.660379][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5480.660683][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5480.660960][ C2] ? get_stack_info+0x36/0xc0 [ 5480.661200][ C2] __tcf_classify+0x329/0x7d0 [ 5480.661443][ C2] tcf_classify+0x283/0x930 [ 5480.661677][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5480.661933][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5480.662247][ C2] tc_run+0x2e4/0x5d0 [ 5480.662452][ C2] ? __pfx_tc_run+0x10/0x10 [ 5480.662682][ C2] ? lock_acquire+0x1c1/0x220 [ 5480.662925][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5480.663186][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5480.663439][ C2] ? lock_acquire+0x1c1/0x220 [ 5480.663678][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5480.663943][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5480.664248][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5480.664519][ C2] ? neigh_hh_output+0x348/0x590 [ 5480.664774][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5480.665039][ C2] ip_finish_output2+0x786/0x18e0 [ 5480.665296][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5480.665633][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5480.665910][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5480.666164][ C2] ? __ip_finish_output+0x10f/0x770 [ 5480.666430][ C2] ip_output+0x16b/0x4f0 [ 5480.666646][ C2] ? __pfx_ip_output+0x10/0x10 [ 5480.666890][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5480.667166][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5480.667479][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5480.667754][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5480.668005][ C2] ? __alloc_skb+0xd4/0x280 [ 5480.668237][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5480.668505][ C2] ? tcp_fragment+0x168/0x1040 [ 5480.668749][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5480.669000][ C2] ? ip_local_out+0x114/0x3b0 [ 5480.669242][ C2] __ip_queue_xmit+0x672/0x1910 [ 5480.669490][ C2] ? __skb_clone+0x57a/0x760 [ 5480.669726][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5480.669993][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5480.670274][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5480.670517][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5480.670768][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5480.671073][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5480.671393][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5480.671638][ C2] tcp_send_loss_probe+0x348/0x830 [ 5480.671898][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5480.672166][ C2] tcp_write_timer+0x82/0x1d0 [ 5480.672406][ C2] call_timer_fn+0x173/0x430 [ 5480.672643][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5480.672912][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5480.673178][ C2] __run_timers.part.0+0x52d/0x890 [ 5480.673440][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5480.673710][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5480.673994][ C2] ? lock_acquire+0x1c1/0x220 [ 5480.674235][ C2] ? clockevents_program_event+0xf6/0x300 [ 5480.674526][ C2] ? lock_release+0x1d5/0x250 [ 5480.674765][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5480.675030][ C2] ? ktime_get+0xb3/0x190 [ 5480.675254][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5480.675549][ C2] run_timer_softirq+0x72/0x100 [ 5480.675797][ C2] __do_softirq+0x1b9/0x7ff [ 5480.676032][ C2] irq_exit_rcu+0x98/0xc0 [ 5480.676252][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5480.676540][ C2] [ 5480.676690][ C2] [ 5480.676842][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5480.677145][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5480.677403][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5480.678376][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5480.678683][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5480.679082][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5480.679482][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5480.679880][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5480.680277][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5480.680679][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5480.680968][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5480.681229][ C2] default_idle_call+0x69/0xa0 [ 5480.681475][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5480.681727][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5480.682003][ C2] ? lock_release+0x1d5/0x250 [ 5480.682244][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5480.682518][ C2] do_idle+0xfb/0x160 [ 5480.682720][ C2] cpu_startup_entry+0x55/0x60 [ 5480.682968][ C2] start_secondary+0x21c/0x2b0 [ 5480.683212][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5480.683481][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5480.683792][ C2] [ 5503.254103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5503.254476][ C1] rcu: 1-....: (3140571 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=768040 [ 5503.255032][ C1] rcu: (t=3148367 jiffies g=1882453 q=712 ncpus=4) [ 5503.255364][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5503.255814][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5503.256428][ C1] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 5503.256715][ C1] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 5503.257688][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 5503.257995][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5503.258395][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5503.258795][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffff88800a3a0e1b [ 5503.259193][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5503.259591][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5503.259991][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5503.260438][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5503.260771][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5503.261171][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5503.261569][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5503.261970][ C1] PKRU: 55555554 [ 5503.262150][ C1] Call Trace: [ 5503.262321][ C1] [ 5503.262470][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5503.262748][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5503.263001][ C1] ? check_cpu_stall+0x284/0x500 [ 5503.263253][ C1] ? rcu_pending+0x92/0x360 [ 5503.263483][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5503.263753][ C1] ? update_process_times+0xb9/0x110 [ 5503.264023][ C1] ? tick_sched_handle+0x67/0x130 [ 5503.264280][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5503.264566][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5503.264809][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5503.265122][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5503.265394][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5503.265682][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5503.265949][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5503.266255][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5503.266514][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 5503.266774][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5503.267085][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5503.267383][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5503.267699][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5503.267988][ C1] ? kasan_check_range+0x69/0x1c0 [ 5503.268244][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5503.268525][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5503.268837][ C1] ? get_stack_info+0x36/0xc0 [ 5503.269078][ C1] ? lock_acquire+0x1c1/0x220 [ 5503.269320][ C1] ? lock_release+0x1d5/0x250 [ 5503.269561][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5503.269810][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5503.270081][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5503.270366][ C1] ? lock_acquire+0x1c1/0x220 [ 5503.270606][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5503.270847][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5503.271108][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5503.271343][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5503.271589][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5503.271847][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5503.272124][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5503.272401][ C1] ip_local_deliver+0x19d/0x480 [ 5503.272650][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5503.272930][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5503.273198][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5503.273547][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5503.273800][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5503.274121][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5503.274383][ C1] ip_rcv+0x564/0x740 [ 5503.274589][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5503.274818][ C1] ? set_track_prepare+0x8a/0xd0 [ 5503.275071][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5503.275348][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5503.275621][ C1] ? skb_clone+0x10b/0x330 [ 5503.275849][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5503.276167][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5503.276475][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5503.276759][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5503.277055][ C1] ? __tcf_classify+0x329/0x7d0 [ 5503.277306][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5503.277536][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5503.277837][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5503.278122][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5503.278447][ C1] ? lock_acquire+0x1c1/0x220 [ 5503.278684][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5503.278982][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5503.279267][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5503.279585][ C1] ? __copy_skb_header+0xaf/0x490 [ 5503.279841][ C1] ? __skb_clone+0x57a/0x760 [ 5503.280077][ C1] netif_receive_skb+0x55/0x280 [ 5503.280325][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5503.280640][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5503.280971][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5503.281272][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5503.281549][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5503.281837][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5503.282150][ C1] ? hlock_class+0x4e/0x130 [ 5503.282383][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5503.282660][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5503.282940][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5503.283203][ C1] ? hlock_class+0x4e/0x130 [ 5503.283435][ C1] ? mark_lock+0x38/0x3e0 [ 5503.283655][ C1] ? stack_access_ok+0xda/0x1f0 [ 5503.283905][ C1] ? __lock_acquire+0xb67/0x1610 [ 5503.284158][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5503.284435][ C1] ? get_stack_info+0x36/0xc0 [ 5503.284675][ C1] ? stack_access_ok+0xda/0x1f0 [ 5503.284922][ C1] ? get_reg+0x119/0x190 [ 5503.285140][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5503.285409][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5503.285719][ C1] __tcf_classify+0x329/0x7d0 [ 5503.285961][ C1] tcf_classify+0x283/0x930 [ 5503.286195][ C1] ? arch_stack_walk+0xa2/0x100 [ 5503.286444][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5503.286701][ C1] ? get_stack_info+0x36/0xc0 [ 5503.286942][ C1] tc_run+0x2e4/0x5d0 [ 5503.287148][ C1] ? __pfx_tc_run+0x10/0x10 [ 5503.287378][ C1] ? lock_acquire+0x1c1/0x220 [ 5503.287617][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5503.287879][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5503.288133][ C1] ? lock_acquire+0x1c1/0x220 [ 5503.288372][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5503.288637][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5503.288944][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5503.289218][ C1] ? neigh_hh_output+0x348/0x590 [ 5503.289472][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5503.289737][ C1] ip_finish_output2+0x786/0x18e0 [ 5503.289994][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5503.290271][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5503.290610][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5503.290888][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5503.291142][ C1] ? __ip_finish_output+0x10f/0x770 [ 5503.291408][ C1] ip_output+0x16b/0x4f0 [ 5503.291624][ C1] ? run_timer_softirq+0x72/0x100 [ 5503.291880][ C1] ? __pfx_ip_output+0x10/0x10 [ 5503.292124][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5503.292411][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5503.292662][ C1] ? ip_local_out+0x114/0x3b0 [ 5503.292908][ C1] __ip_queue_xmit+0x672/0x1910 [ 5503.293157][ C1] ? __create_object+0x5e/0xb0 [ 5503.293402][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5503.293669][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5503.293949][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5503.294224][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5503.294507][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5503.294778][ C1] tcp_delack_timer+0x84/0x240 [ 5503.295022][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5503.295294][ C1] call_timer_fn+0x173/0x430 [ 5503.295532][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5503.295793][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5503.296055][ C1] __run_timers.part.0+0x52d/0x890 [ 5503.296316][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5503.296590][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5503.296877][ C1] ? lock_acquire+0x1c1/0x220 [ 5503.297117][ C1] ? clockevents_program_event+0xf6/0x300 [ 5503.297407][ C1] ? lock_release+0x1d5/0x250 [ 5503.297648][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5503.297913][ C1] ? ktime_get+0xb3/0x190 [ 5503.298133][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5503.298432][ C1] run_timer_softirq+0x72/0x100 [ 5503.298681][ C1] __do_softirq+0x1b9/0x7ff [ 5503.298914][ C1] irq_exit_rcu+0x98/0xc0 [ 5503.299135][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5503.299421][ C1] [ 5503.299574][ C1] [ 5503.299724][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5503.300030][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5503.300356][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5503.301328][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5503.301641][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5503.302039][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5503.302437][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5503.302845][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5503.303248][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5503.303650][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5503.303948][ C1] pipe_read+0xa16/0xdf0 [ 5503.304168][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5503.304448][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5503.304692][ C1] ? iterate_tty_write+0x299/0x540 [ 5503.304953][ C1] ? lock_release+0x1d5/0x250 [ 5503.305195][ C1] vfs_read+0x911/0xc00 [ 5503.305410][ C1] ? lock_acquire+0x1c1/0x220 [ 5503.305650][ C1] ? __might_fault+0xc6/0x180 [ 5503.305893][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5503.306133][ C1] ? __might_fault+0xc6/0x180 [ 5503.306371][ C1] ? lock_release+0x1d5/0x250 [ 5503.306612][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5503.306876][ C1] ? __fget_light+0x54/0x1e0 [ 5503.307115][ C1] ksys_read+0x17a/0x1e0 [ 5503.307332][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5503.307578][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5503.307883][ C1] do_syscall_64+0xc9/0x1e0 [ 5503.308116][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5503.308416][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5503.308646][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5503.309618][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5503.310038][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5503.310440][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5503.310839][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5503.311238][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5503.311638][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5503.312042][ C1] [ 5503.312199][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5503.312474][ C2] NMI backtrace for cpu 2 [ 5503.312480][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5503.312487][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5503.312491][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5503.312500][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5503.312506][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5503.312511][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5503.312515][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5503.312519][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5503.312523][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5503.312527][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5503.312531][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5503.312535][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5503.312541][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5503.312545][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5503.312548][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5503.312552][ C2] PKRU: 55555554 [ 5503.312554][ C2] Call Trace: [ 5503.312557][ C2] [ 5503.312561][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5503.312573][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5503.312581][ C2] ? nmi_handle+0x153/0x420 [ 5503.312591][ C2] ? default_do_nmi+0x41/0x100 [ 5503.312597][ C2] ? exc_nmi+0xf3/0x120 [ 5503.312603][ C2] ? end_repeat_nmi+0xf/0x60 [ 5503.312615][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5503.312623][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5503.312631][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5503.312640][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5503.312648][ C2] [ 5503.312650][ C2] [ 5503.312653][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5503.312659][ C2] ? get_stack_info+0x36/0xc0 [ 5503.312668][ C2] ? lock_acquire+0x1c1/0x220 [ 5503.312676][ C2] ? lock_release+0x1d5/0x250 [ 5503.312685][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5503.312696][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5503.312699][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5503.312702][ C2] ? lock_acquire+0x1c1/0x220 [ 5503.312704][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5503.312708][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5503.312711][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5503.312717][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5503.312719][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5503.312724][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5503.312729][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5503.312733][ C2] ip_local_deliver+0x19d/0x480 [ 5503.312735][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5503.312737][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5503.312740][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5503.312745][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5503.312749][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5503.312752][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5503.312761][ C2] ip_rcv+0x564/0x740 [ 5503.312764][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5503.312766][ C2] ? set_track_prepare+0x8a/0xd0 [ 5503.312770][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5503.312773][ C2] ? start_secondary+0x21c/0x2b0 [ 5503.312777][ C2] ? skb_clone+0x10b/0x330 [ 5503.312780][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5503.312786][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5503.312792][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5503.312795][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5503.312803][ C2] ? __tcf_classify+0x329/0x7d0 [ 5503.312807][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5503.312809][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5503.312812][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5503.312815][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5503.312820][ C2] ? lock_acquire+0x1c1/0x220 [ 5503.312822][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5503.312826][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5503.312829][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5503.312833][ C2] ? __copy_skb_header+0xaf/0x490 [ 5503.312838][ C2] ? __skb_clone+0x57a/0x760 [ 5503.312840][ C2] netif_receive_skb+0x55/0x280 [ 5503.312844][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5503.312851][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5503.312858][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5503.312864][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5503.312869][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5503.312879][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5503.312886][ C2] ? get_stack_info+0x36/0xc0 [ 5503.312891][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5503.312894][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5503.312898][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5503.312900][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5503.312903][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5503.312906][ C2] ? kernel_text_address+0x17/0xe0 [ 5503.312909][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5503.312913][ C2] ? arch_stack_walk+0x8c/0x100 [ 5503.312916][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5503.312920][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5503.312923][ C2] ? lock_acquire+0x1c1/0x220 [ 5503.312925][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5503.312929][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5503.312933][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5503.312936][ C2] ? get_stack_info+0x36/0xc0 [ 5503.312940][ C2] __tcf_classify+0x329/0x7d0 [ 5503.312945][ C2] tcf_classify+0x283/0x930 [ 5503.312950][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5503.312953][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5503.312957][ C2] tc_run+0x2e4/0x5d0 [ 5503.312961][ C2] ? __pfx_tc_run+0x10/0x10 [ 5503.312964][ C2] ? lock_acquire+0x1c1/0x220 [ 5503.312966][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5503.312970][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5503.312974][ C2] ? lock_acquire+0x1c1/0x220 [ 5503.312976][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5503.312979][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5503.312982][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5503.312985][ C2] ? neigh_hh_output+0x348/0x590 [ 5503.312989][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5503.312992][ C2] ip_finish_output2+0x786/0x18e0 [ 5503.312996][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5503.313003][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5503.313006][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5503.313009][ C2] ? __ip_finish_output+0x10f/0x770 [ 5503.313013][ C2] ip_output+0x16b/0x4f0 [ 5503.313016][ C2] ? __pfx_ip_output+0x10/0x10 [ 5503.313018][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5503.313021][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5503.313024][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5503.313027][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5503.313030][ C2] ? __alloc_skb+0xd4/0x280 [ 5503.313032][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5503.313036][ C2] ? tcp_fragment+0x168/0x1040 [ 5503.313039][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5503.313042][ C2] ? ip_local_out+0x114/0x3b0 [ 5503.313046][ C2] __ip_queue_xmit+0x672/0x1910 [ 5503.313049][ C2] ? __skb_clone+0x57a/0x760 [ 5503.313052][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5503.313057][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5503.313060][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5503.313064][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5503.313068][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5503.313072][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5503.313075][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5503.313078][ C2] tcp_send_loss_probe+0x348/0x830 [ 5503.313081][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5503.313084][ C2] tcp_write_timer+0x82/0x1d0 [ 5503.313087][ C2] call_timer_fn+0x173/0x430 [ 5503.313091][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5503.313096][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5503.313100][ C2] __run_timers.part.0+0x52d/0x890 [ 5503.313103][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5503.313107][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5503.313110][ C2] ? lock_acquire+0x1c1/0x220 [ 5503.313112][ C2] ? clockevents_program_event+0xf6/0x300 [ 5503.313117][ C2] ? lock_release+0x1d5/0x250 [ 5503.313119][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5503.313122][ C2] ? ktime_get+0xb3/0x190 [ 5503.313126][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5503.313130][ C2] run_timer_softirq+0x72/0x100 [ 5503.313134][ C2] __do_softirq+0x1b9/0x7ff [ 5503.313139][ C2] irq_exit_rcu+0x98/0xc0 [ 5503.313141][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5503.313145][ C2] [ 5503.313146][ C2] [ 5503.313147][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5503.313150][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5503.313153][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5503.313155][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5503.313157][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5503.313159][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5503.313160][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5503.313162][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5503.313163][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5503.313167][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5503.313170][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5503.313173][ C2] default_idle_call+0x69/0xa0 [ 5503.313176][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5503.313178][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5503.313182][ C2] ? lock_release+0x1d5/0x250 [ 5503.313185][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5503.313189][ C2] do_idle+0xfb/0x160 [ 5503.313191][ C2] cpu_startup_entry+0x55/0x60 [ 5503.313193][ C2] start_secondary+0x21c/0x2b0 [ 5503.313196][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5503.313200][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5503.313206][ C2] [ 5528.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2957s! [perl:4135] [ 5528.569707][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5528.570966][ C1] irq event stamp: 209232 [ 5528.571184][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5528.571716][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5528.572195][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5528.572666][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5528.573131][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5528.573581][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5528.574196][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 5528.574479][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 5528.575452][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 5528.575761][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5528.576164][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5528.576565][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5528.576965][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5528.577365][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5528.577768][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5528.578216][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5528.578550][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5528.578950][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5528.579350][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5528.579751][ C1] PKRU: 55555554 [ 5528.579933][ C1] Call Trace: [ 5528.580102][ C1] [ 5528.580253][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5528.580516][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5528.580759][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5528.581039][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5528.581311][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5528.581600][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5528.581868][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5528.582173][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5528.582437][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5528.582751][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5528.583049][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5528.583365][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5528.583654][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 5528.583938][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5528.584219][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5528.584532][ C1] ? get_stack_info+0x36/0xc0 [ 5528.584774][ C1] ? lock_acquire+0x1c1/0x220 [ 5528.585015][ C1] ? lock_release+0x1d5/0x250 [ 5528.585257][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5528.585508][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5528.585780][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5528.586068][ C1] ? lock_acquire+0x1c1/0x220 [ 5528.586308][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5528.586550][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5528.586810][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5528.587048][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5528.587296][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5528.587556][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5528.587835][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5528.588112][ C1] ip_local_deliver+0x19d/0x480 [ 5528.588360][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5528.588633][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5528.588898][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5528.589246][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5528.589501][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5528.589823][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5528.590085][ C1] ip_rcv+0x564/0x740 [ 5528.590290][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5528.590523][ C1] ? set_track_prepare+0x8a/0xd0 [ 5528.590778][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5528.591056][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5528.591329][ C1] ? skb_clone+0x10b/0x330 [ 5528.591559][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5528.591879][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5528.592186][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5528.592471][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5528.592771][ C1] ? __tcf_classify+0x329/0x7d0 [ 5528.593021][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5528.593256][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5528.593556][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5528.593842][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5528.594169][ C1] ? lock_acquire+0x1c1/0x220 [ 5528.594409][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5528.594705][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5528.594993][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5528.595312][ C1] ? __copy_skb_header+0xaf/0x490 [ 5528.595570][ C1] ? __skb_clone+0x57a/0x760 [ 5528.595804][ C1] netif_receive_skb+0x55/0x280 [ 5528.596051][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5528.596366][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5528.596699][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5528.596999][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5528.597274][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5528.597564][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5528.597875][ C1] ? hlock_class+0x4e/0x130 [ 5528.598111][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5528.598386][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5528.598664][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5528.598929][ C1] ? hlock_class+0x4e/0x130 [ 5528.599159][ C1] ? mark_lock+0x38/0x3e0 [ 5528.599381][ C1] ? stack_access_ok+0xda/0x1f0 [ 5528.599632][ C1] ? __lock_acquire+0xb67/0x1610 [ 5528.599886][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5528.600163][ C1] ? get_stack_info+0x36/0xc0 [ 5528.600405][ C1] ? stack_access_ok+0xda/0x1f0 [ 5528.600651][ C1] ? get_reg+0x119/0x190 [ 5528.600869][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5528.601138][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5528.601449][ C1] __tcf_classify+0x329/0x7d0 [ 5528.601697][ C1] tcf_classify+0x283/0x930 [ 5528.601929][ C1] ? arch_stack_walk+0xa2/0x100 [ 5528.602178][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5528.602435][ C1] ? get_stack_info+0x36/0xc0 [ 5528.602684][ C1] tc_run+0x2e4/0x5d0 [ 5528.602890][ C1] ? __pfx_tc_run+0x10/0x10 [ 5528.603123][ C1] ? lock_acquire+0x1c1/0x220 [ 5528.603361][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5528.603624][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5528.603878][ C1] ? lock_acquire+0x1c1/0x220 [ 5528.604117][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5528.604382][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5528.604688][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5528.604960][ C1] ? neigh_hh_output+0x348/0x590 [ 5528.605214][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5528.605479][ C1] ip_finish_output2+0x786/0x18e0 [ 5528.605736][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5528.606018][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5528.606356][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5528.606632][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5528.606886][ C1] ? __ip_finish_output+0x10f/0x770 [ 5528.607152][ C1] ip_output+0x16b/0x4f0 [ 5528.607371][ C1] ? run_timer_softirq+0x72/0x100 [ 5528.607629][ C1] ? __pfx_ip_output+0x10/0x10 [ 5528.607873][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5528.608160][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5528.608414][ C1] ? ip_local_out+0x114/0x3b0 [ 5528.608654][ C1] __ip_queue_xmit+0x672/0x1910 [ 5528.608903][ C1] ? __create_object+0x5e/0xb0 [ 5528.609148][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5528.609415][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5528.609700][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5528.609973][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5528.610255][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5528.610530][ C1] tcp_delack_timer+0x84/0x240 [ 5528.610774][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5528.611048][ C1] call_timer_fn+0x173/0x430 [ 5528.611283][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5528.611547][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5528.611809][ C1] __run_timers.part.0+0x52d/0x890 [ 5528.612070][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5528.612346][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5528.612635][ C1] ? lock_acquire+0x1c1/0x220 [ 5528.612876][ C1] ? clockevents_program_event+0xf6/0x300 [ 5528.613169][ C1] ? lock_release+0x1d5/0x250 [ 5528.613408][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5528.613673][ C1] ? ktime_get+0xb3/0x190 [ 5528.613896][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5528.614194][ C1] run_timer_softirq+0x72/0x100 [ 5528.614442][ C1] __do_softirq+0x1b9/0x7ff [ 5528.614677][ C1] irq_exit_rcu+0x98/0xc0 [ 5528.614896][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5528.615184][ C1] [ 5528.615334][ C1] [ 5528.615485][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5528.615788][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5528.616113][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5528.617087][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5528.617395][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5528.617796][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5528.618196][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5528.618596][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5528.618994][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5528.619398][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5528.619693][ C1] pipe_read+0xa16/0xdf0 [ 5528.619917][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5528.620199][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5528.620443][ C1] ? iterate_tty_write+0x299/0x540 [ 5528.620705][ C1] ? lock_release+0x1d5/0x250 [ 5528.620946][ C1] vfs_read+0x911/0xc00 [ 5528.621160][ C1] ? lock_acquire+0x1c1/0x220 [ 5528.621400][ C1] ? __might_fault+0xc6/0x180 [ 5528.621639][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5528.621880][ C1] ? __might_fault+0xc6/0x180 [ 5528.622121][ C1] ? lock_release+0x1d5/0x250 [ 5528.622362][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5528.622632][ C1] ? __fget_light+0x54/0x1e0 [ 5528.622867][ C1] ksys_read+0x17a/0x1e0 [ 5528.623088][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5528.623334][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5528.623638][ C1] do_syscall_64+0xc9/0x1e0 [ 5528.623873][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5528.624174][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5528.624401][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5528.625376][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5528.625799][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5528.626199][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5528.626597][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5528.626998][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5528.627397][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5528.627800][ C1] [ 5528.627959][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2957s! [swapper/2:0] [ 5528.628384][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5528.629634][ C2] irq event stamp: 44114564 [ 5528.629860][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5528.630397][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5528.630907][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5528.631383][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5528.631851][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5528.632305][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5528.632917][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5528.633241][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5528.634206][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5528.634514][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5528.634914][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5528.635314][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5528.635710][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5528.636107][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5528.636503][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5528.636950][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5528.637285][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5528.637684][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5528.638082][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5528.638480][ C2] PKRU: 55555554 [ 5528.638660][ C2] Call Trace: [ 5528.638830][ C2] [ 5528.638978][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5528.639237][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5528.639480][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5528.639756][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5528.640029][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5528.640315][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5528.640578][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5528.640883][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5528.641143][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5528.641404][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5528.641713][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5528.642009][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5528.642323][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5528.642614][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5528.642907][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5528.643195][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5528.643506][ C2] ? get_stack_info+0x36/0xc0 [ 5528.643747][ C2] ? lock_acquire+0x1c1/0x220 [ 5528.643987][ C2] ? lock_release+0x1d5/0x250 [ 5528.644224][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5528.644472][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5528.644742][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5528.645028][ C2] ? lock_acquire+0x1c1/0x220 [ 5528.645267][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5528.645504][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5528.645767][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5528.646002][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5528.646247][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5528.646505][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5528.646778][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5528.647055][ C2] ip_local_deliver+0x19d/0x480 [ 5528.647300][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5528.647573][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5528.647836][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5528.648181][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5528.648434][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5528.648752][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5528.649013][ C2] ip_rcv+0x564/0x740 [ 5528.649217][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5528.649447][ C2] ? set_track_prepare+0x8a/0xd0 [ 5528.649702][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5528.649976][ C2] ? start_secondary+0x21c/0x2b0 [ 5528.650228][ C2] ? skb_clone+0x10b/0x330 [ 5528.650457][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5528.650775][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5528.651080][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5528.651364][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5528.651656][ C2] ? __tcf_classify+0x329/0x7d0 [ 5528.651904][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5528.652135][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5528.652432][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5528.652723][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5528.653046][ C2] ? lock_acquire+0x1c1/0x220 [ 5528.653285][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5528.653579][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5528.653866][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5528.654178][ C2] ? __copy_skb_header+0xaf/0x490 [ 5528.654435][ C2] ? __skb_clone+0x57a/0x760 [ 5528.654667][ C2] netif_receive_skb+0x55/0x280 [ 5528.654915][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5528.655227][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5528.655557][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5528.655856][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5528.656129][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5528.656415][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5528.656727][ C2] ? get_stack_info+0x36/0xc0 [ 5528.656969][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5528.657232][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5528.657549][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5528.657824][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5528.658101][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5528.658414][ C2] ? kernel_text_address+0x17/0xe0 [ 5528.658675][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5528.658986][ C2] ? arch_stack_walk+0x8c/0x100 [ 5528.659233][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5528.659499][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5528.659784][ C2] ? lock_acquire+0x1c1/0x220 [ 5528.660022][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5528.660302][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5528.660607][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5528.660881][ C2] ? get_stack_info+0x36/0xc0 [ 5528.661122][ C2] __tcf_classify+0x329/0x7d0 [ 5528.661364][ C2] tcf_classify+0x283/0x930 [ 5528.661593][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5528.661848][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5528.662160][ C2] tc_run+0x2e4/0x5d0 [ 5528.662363][ C2] ? __pfx_tc_run+0x10/0x10 [ 5528.662598][ C2] ? lock_acquire+0x1c1/0x220 [ 5528.662837][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5528.663097][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5528.663350][ C2] ? lock_acquire+0x1c1/0x220 [ 5528.663586][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5528.663850][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5528.664150][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5528.664424][ C2] ? neigh_hh_output+0x348/0x590 [ 5528.664674][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5528.664938][ C2] ip_finish_output2+0x786/0x18e0 [ 5528.665194][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5528.665531][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5528.665806][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5528.666059][ C2] ? __ip_finish_output+0x10f/0x770 [ 5528.666322][ C2] ip_output+0x16b/0x4f0 [ 5528.666538][ C2] ? __pfx_ip_output+0x10/0x10 [ 5528.666777][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5528.667056][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5528.667367][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5528.667641][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5528.667892][ C2] ? __alloc_skb+0xd4/0x280 [ 5528.668121][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5528.668391][ C2] ? tcp_fragment+0x168/0x1040 [ 5528.668632][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5528.668882][ C2] ? ip_local_out+0x114/0x3b0 [ 5528.669122][ C2] __ip_queue_xmit+0x672/0x1910 [ 5528.669370][ C2] ? __skb_clone+0x57a/0x760 [ 5528.669605][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5528.669871][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5528.670149][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5528.670393][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5528.670640][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5528.670940][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5528.671260][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5528.671500][ C2] tcp_send_loss_probe+0x348/0x830 [ 5528.671763][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5528.672030][ C2] tcp_write_timer+0x82/0x1d0 [ 5528.672267][ C2] call_timer_fn+0x173/0x430 [ 5528.672503][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5528.672769][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5528.673030][ C2] __run_timers.part.0+0x52d/0x890 [ 5528.673288][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5528.673558][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5528.673844][ C2] ? lock_acquire+0x1c1/0x220 [ 5528.674083][ C2] ? clockevents_program_event+0xf6/0x300 [ 5528.674371][ C2] ? lock_release+0x1d5/0x250 [ 5528.674610][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5528.674872][ C2] ? ktime_get+0xb3/0x190 [ 5528.675092][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5528.675388][ C2] run_timer_softirq+0x72/0x100 [ 5528.675636][ C2] __do_softirq+0x1b9/0x7ff [ 5528.675869][ C2] irq_exit_rcu+0x98/0xc0 [ 5528.676088][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5528.676374][ C2] [ 5528.676524][ C2] [ 5528.676673][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5528.676979][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5528.677236][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5528.678199][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5528.678508][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5528.678903][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5528.679300][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5528.679700][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5528.680097][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5528.680496][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5528.680786][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5528.681046][ C2] default_idle_call+0x69/0xa0 [ 5528.681288][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5528.681537][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5528.681815][ C2] ? lock_release+0x1d5/0x250 [ 5528.682052][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5528.682326][ C2] do_idle+0xfb/0x160 [ 5528.682529][ C2] cpu_startup_entry+0x55/0x60 [ 5528.682776][ C2] start_secondary+0x21c/0x2b0 [ 5528.683018][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5528.683287][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5528.683597][ C2] [ 5556.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 2983s! [swapper/2:0] [ 5556.569705][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5556.570952][ C2] irq event stamp: 44114564 [ 5556.571177][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5556.571711][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5556.572221][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5556.572699][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5556.573170][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5556.573625][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5556.574232][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5556.574553][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5556.575521][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5556.575827][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5556.576222][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5556.576620][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5556.577017][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5556.577412][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5556.577809][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5556.578252][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5556.578584][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5556.578988][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5556.579384][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5556.579780][ C2] PKRU: 55555554 [ 5556.579959][ C2] Call Trace: [ 5556.580130][ C2] [ 5556.580276][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5556.580536][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5556.580779][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5556.581053][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5556.581325][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5556.581610][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5556.581874][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5556.582179][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5556.582438][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5556.582701][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5556.583008][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5556.583303][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5556.583617][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5556.583903][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5556.584197][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5556.584484][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5556.584793][ C2] ? get_stack_info+0x36/0xc0 [ 5556.585032][ C2] ? lock_acquire+0x1c1/0x220 [ 5556.585275][ C2] ? lock_release+0x1d5/0x250 [ 5556.585512][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5556.585760][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5556.586033][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5556.586316][ C2] ? lock_acquire+0x1c1/0x220 [ 5556.586554][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5556.586793][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5556.587054][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5556.587288][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5556.587533][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5556.587794][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5556.588067][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5556.588345][ C2] ip_local_deliver+0x19d/0x480 [ 5556.588591][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5556.588863][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5556.589126][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5556.589472][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5556.589724][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5556.590042][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5556.590304][ C2] ip_rcv+0x564/0x740 [ 5556.590507][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5556.590739][ C2] ? set_track_prepare+0x8a/0xd0 [ 5556.590991][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5556.591266][ C2] ? start_secondary+0x21c/0x2b0 [ 5556.591516][ C2] ? skb_clone+0x10b/0x330 [ 5556.591744][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5556.592064][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5556.592367][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5556.592655][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5556.592948][ C2] ? __tcf_classify+0x329/0x7d0 [ 5556.593194][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5556.593424][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5556.593721][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5556.594006][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5556.594330][ C2] ? lock_acquire+0x1c1/0x220 [ 5556.594569][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5556.594862][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5556.595148][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5556.595465][ C2] ? __copy_skb_header+0xaf/0x490 [ 5556.595721][ C2] ? __skb_clone+0x57a/0x760 [ 5556.595953][ C2] netif_receive_skb+0x55/0x280 [ 5556.596201][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5556.596512][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5556.596843][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5556.597142][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5556.597415][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5556.597702][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5556.598013][ C2] ? get_stack_info+0x36/0xc0 [ 5556.598256][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5556.598521][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5556.598837][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5556.599111][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5556.599390][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5556.599703][ C2] ? kernel_text_address+0x17/0xe0 [ 5556.599963][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5556.600275][ C2] ? arch_stack_walk+0x8c/0x100 [ 5556.600523][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5556.600788][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5556.601072][ C2] ? lock_acquire+0x1c1/0x220 [ 5556.601312][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5556.601593][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5556.601898][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5556.602172][ C2] ? get_stack_info+0x36/0xc0 [ 5556.602413][ C2] __tcf_classify+0x329/0x7d0 [ 5556.602664][ C2] tcf_classify+0x283/0x930 [ 5556.602895][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5556.603151][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5556.603464][ C2] tc_run+0x2e4/0x5d0 [ 5556.603670][ C2] ? __pfx_tc_run+0x10/0x10 [ 5556.603901][ C2] ? lock_acquire+0x1c1/0x220 [ 5556.604141][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5556.604401][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5556.604654][ C2] ? lock_acquire+0x1c1/0x220 [ 5556.604892][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5556.605156][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5556.605458][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5556.605734][ C2] ? neigh_hh_output+0x348/0x590 [ 5556.605986][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5556.606251][ C2] ip_finish_output2+0x786/0x18e0 [ 5556.606507][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5556.606844][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5556.607118][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5556.607370][ C2] ? __ip_finish_output+0x10f/0x770 [ 5556.607633][ C2] ip_output+0x16b/0x4f0 [ 5556.607852][ C2] ? __pfx_ip_output+0x10/0x10 [ 5556.608094][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5556.608371][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5556.608682][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5556.608958][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5556.609210][ C2] ? __alloc_skb+0xd4/0x280 [ 5556.609441][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5556.609711][ C2] ? tcp_fragment+0x168/0x1040 [ 5556.609954][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5556.610205][ C2] ? ip_local_out+0x114/0x3b0 [ 5556.610444][ C2] __ip_queue_xmit+0x672/0x1910 [ 5556.610691][ C2] ? __skb_clone+0x57a/0x760 [ 5556.610928][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5556.611194][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5556.611473][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5556.611718][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5556.611967][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5556.612268][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5556.612593][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5556.612835][ C2] tcp_send_loss_probe+0x348/0x830 [ 5556.613096][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5556.613364][ C2] tcp_write_timer+0x82/0x1d0 [ 5556.613603][ C2] call_timer_fn+0x173/0x430 [ 5556.613838][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5556.614099][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5556.614360][ C2] __run_timers.part.0+0x52d/0x890 [ 5556.614620][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5556.614890][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5556.615175][ C2] ? lock_acquire+0x1c1/0x220 [ 5556.615416][ C2] ? clockevents_program_event+0xf6/0x300 [ 5556.615705][ C2] ? lock_release+0x1d5/0x250 [ 5556.615944][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5556.616207][ C2] ? ktime_get+0xb3/0x190 [ 5556.616429][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5556.616724][ C2] run_timer_softirq+0x72/0x100 [ 5556.616972][ C2] __do_softirq+0x1b9/0x7ff [ 5556.617205][ C2] irq_exit_rcu+0x98/0xc0 [ 5556.617424][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5556.617710][ C2] [ 5556.617860][ C2] [ 5556.618009][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5556.618313][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5556.618570][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5556.619539][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5556.619847][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5556.620246][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5556.620645][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5556.621044][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5556.621442][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5556.621844][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5556.622134][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5556.622394][ C2] default_idle_call+0x69/0xa0 [ 5556.622640][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5556.622893][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5556.623171][ C2] ? lock_release+0x1d5/0x250 [ 5556.623411][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5556.623684][ C2] do_idle+0xfb/0x160 [ 5556.623887][ C2] cpu_startup_entry+0x55/0x60 [ 5556.624131][ C2] start_secondary+0x21c/0x2b0 [ 5556.624375][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5556.624644][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5556.624954][ C2] [ 5556.625110][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 2983s! [perl:4135] [ 5556.625525][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5556.626781][ C1] irq event stamp: 209232 [ 5556.627000][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5556.627527][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5556.628006][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5556.628475][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5556.628936][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5556.629385][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5556.629999][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5556.630326][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5556.631300][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5556.631610][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5556.632009][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5556.632408][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5556.632812][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5556.633214][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5556.633613][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5556.634064][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5556.634397][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5556.634799][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5556.635200][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5556.635599][ C1] PKRU: 55555554 [ 5556.635781][ C1] Call Trace: [ 5556.635953][ C1] [ 5556.636101][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5556.636365][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5556.636610][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5556.636887][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5556.637161][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5556.637453][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5556.637719][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5556.638026][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5556.638291][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5556.638601][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5556.638896][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5556.639212][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5556.639504][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5556.639799][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5556.640090][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5556.640405][ C1] ? get_stack_info+0x36/0xc0 [ 5556.640645][ C1] ? lock_acquire+0x1c1/0x220 [ 5556.640887][ C1] ? lock_release+0x1d5/0x250 [ 5556.641129][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5556.641379][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5556.641652][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5556.641938][ C1] ? lock_acquire+0x1c1/0x220 [ 5556.642179][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5556.642421][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5556.642686][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5556.642924][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5556.643171][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5556.643432][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5556.643710][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5556.643987][ C1] ip_local_deliver+0x19d/0x480 [ 5556.644236][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5556.644509][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5556.644773][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5556.645124][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5556.645377][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5556.645699][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5556.645961][ C1] ip_rcv+0x564/0x740 [ 5556.646167][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5556.646396][ C1] ? set_track_prepare+0x8a/0xd0 [ 5556.646651][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5556.646930][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5556.647203][ C1] ? skb_clone+0x10b/0x330 [ 5556.647430][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5556.647749][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5556.648057][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5556.648340][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5556.648635][ C1] ? __tcf_classify+0x329/0x7d0 [ 5556.648886][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5556.649118][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5556.649419][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5556.649706][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5556.650032][ C1] ? lock_acquire+0x1c1/0x220 [ 5556.650272][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5556.650569][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5556.650856][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5556.651173][ C1] ? __copy_skb_header+0xaf/0x490 [ 5556.651432][ C1] ? __skb_clone+0x57a/0x760 [ 5556.651667][ C1] netif_receive_skb+0x55/0x280 [ 5556.651917][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5556.652231][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5556.652569][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5556.652871][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5556.653146][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5556.653435][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5556.653750][ C1] ? hlock_class+0x4e/0x130 [ 5556.653984][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5556.654262][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5556.654538][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5556.654800][ C1] ? hlock_class+0x4e/0x130 [ 5556.655034][ C1] ? mark_lock+0x38/0x3e0 [ 5556.655255][ C1] ? stack_access_ok+0xda/0x1f0 [ 5556.655503][ C1] ? __lock_acquire+0xb67/0x1610 [ 5556.655758][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5556.656036][ C1] ? get_stack_info+0x36/0xc0 [ 5556.656276][ C1] ? stack_access_ok+0xda/0x1f0 [ 5556.656524][ C1] ? get_reg+0x119/0x190 [ 5556.656742][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5556.657011][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5556.657323][ C1] __tcf_classify+0x329/0x7d0 [ 5556.657564][ C1] tcf_classify+0x283/0x930 [ 5556.657797][ C1] ? arch_stack_walk+0xa2/0x100 [ 5556.658047][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5556.658304][ C1] ? get_stack_info+0x36/0xc0 [ 5556.658547][ C1] tc_run+0x2e4/0x5d0 [ 5556.658754][ C1] ? __pfx_tc_run+0x10/0x10 [ 5556.658984][ C1] ? lock_acquire+0x1c1/0x220 [ 5556.659224][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5556.659486][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5556.659743][ C1] ? lock_acquire+0x1c1/0x220 [ 5556.659983][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5556.660250][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5556.660559][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5556.660831][ C1] ? neigh_hh_output+0x348/0x590 [ 5556.661084][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5556.661351][ C1] ip_finish_output2+0x786/0x18e0 [ 5556.661608][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5556.661885][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5556.662226][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5556.662508][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5556.662764][ C1] ? __ip_finish_output+0x10f/0x770 [ 5556.663029][ C1] ip_output+0x16b/0x4f0 [ 5556.663245][ C1] ? run_timer_softirq+0x72/0x100 [ 5556.663502][ C1] ? __pfx_ip_output+0x10/0x10 [ 5556.663746][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5556.664034][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5556.664287][ C1] ? ip_local_out+0x114/0x3b0 [ 5556.664531][ C1] __ip_queue_xmit+0x672/0x1910 [ 5556.664780][ C1] ? __create_object+0x5e/0xb0 [ 5556.665025][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5556.665294][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5556.665576][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5556.665851][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5556.666132][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5556.666404][ C1] tcp_delack_timer+0x84/0x240 [ 5556.666649][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5556.666920][ C1] call_timer_fn+0x173/0x430 [ 5556.667158][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5556.667421][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5556.667683][ C1] __run_timers.part.0+0x52d/0x890 [ 5556.667944][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5556.668220][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5556.668507][ C1] ? lock_acquire+0x1c1/0x220 [ 5556.668748][ C1] ? clockevents_program_event+0xf6/0x300 [ 5556.669038][ C1] ? lock_release+0x1d5/0x250 [ 5556.669282][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5556.669550][ C1] ? ktime_get+0xb3/0x190 [ 5556.669773][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5556.670070][ C1] run_timer_softirq+0x72/0x100 [ 5556.670320][ C1] __do_softirq+0x1b9/0x7ff [ 5556.670555][ C1] irq_exit_rcu+0x98/0xc0 [ 5556.670776][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5556.671064][ C1] [ 5556.671216][ C1] [ 5556.671365][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5556.671676][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5556.672002][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5556.672981][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5556.673291][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5556.673691][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5556.674092][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5556.674493][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5556.674892][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5556.675292][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5556.675593][ C1] pipe_read+0xa16/0xdf0 [ 5556.675815][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5556.676095][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5556.676337][ C1] ? iterate_tty_write+0x299/0x540 [ 5556.676601][ C1] ? lock_release+0x1d5/0x250 [ 5556.676841][ C1] vfs_read+0x911/0xc00 [ 5556.677057][ C1] ? lock_acquire+0x1c1/0x220 [ 5556.677295][ C1] ? __might_fault+0xc6/0x180 [ 5556.677537][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5556.677778][ C1] ? __might_fault+0xc6/0x180 [ 5556.678018][ C1] ? lock_release+0x1d5/0x250 [ 5556.678258][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5556.678524][ C1] ? __fget_light+0x54/0x1e0 [ 5556.678763][ C1] ksys_read+0x17a/0x1e0 [ 5556.678981][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5556.679225][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5556.679532][ C1] do_syscall_64+0xc9/0x1e0 [ 5556.679767][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5556.680066][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5556.680298][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5556.681270][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5556.681693][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5556.682094][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5556.682498][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5556.682898][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5556.683301][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5556.683705][ C1] [ 5581.312103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5581.312479][ C1] rcu: 1-....: (3218401 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=787468 [ 5581.313037][ C1] rcu: (t=3226425 jiffies g=1882453 q=712 ncpus=4) [ 5581.313370][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5581.313820][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5581.314432][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5581.314762][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5581.315734][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5581.316040][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5581.316443][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5581.316843][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5581.317242][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5581.317640][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5581.318044][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5581.318492][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5581.318825][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5581.319226][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5581.319625][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5581.320027][ C1] PKRU: 55555554 [ 5581.320208][ C1] Call Trace: [ 5581.320377][ C1] [ 5581.320527][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5581.320800][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5581.321053][ C1] ? check_cpu_stall+0x284/0x500 [ 5581.321306][ C1] ? rcu_pending+0x92/0x360 [ 5581.321535][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5581.321806][ C1] ? update_process_times+0xb9/0x110 [ 5581.322077][ C1] ? tick_sched_handle+0x67/0x130 [ 5581.322338][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5581.322623][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5581.322866][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5581.323179][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5581.323452][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5581.323741][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5581.324008][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5581.324314][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5581.324577][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5581.324885][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5581.325183][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5581.325499][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5581.325787][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5581.326084][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5581.326372][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5581.326683][ C1] ? get_stack_info+0x36/0xc0 [ 5581.326925][ C1] ? lock_acquire+0x1c1/0x220 [ 5581.327167][ C1] ? lock_release+0x1d5/0x250 [ 5581.327407][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5581.327655][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5581.327929][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5581.328212][ C1] ? lock_acquire+0x1c1/0x220 [ 5581.328452][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5581.328694][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5581.328955][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5581.329188][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5581.329436][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5581.329693][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5581.329970][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5581.330249][ C1] ip_local_deliver+0x19d/0x480 [ 5581.330497][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5581.330772][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5581.331036][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5581.331384][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5581.331639][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5581.331960][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5581.332224][ C1] ip_rcv+0x564/0x740 [ 5581.332435][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5581.332668][ C1] ? set_track_prepare+0x8a/0xd0 [ 5581.332921][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5581.333198][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5581.333475][ C1] ? skb_clone+0x10b/0x330 [ 5581.333704][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5581.334024][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5581.334331][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5581.334613][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5581.334911][ C1] ? __tcf_classify+0x329/0x7d0 [ 5581.335161][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5581.335391][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5581.335694][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5581.335979][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5581.336306][ C1] ? lock_acquire+0x1c1/0x220 [ 5581.336545][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5581.336844][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5581.337129][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5581.337456][ C1] ? __copy_skb_header+0xaf/0x490 [ 5581.337714][ C1] ? __skb_clone+0x57a/0x760 [ 5581.337951][ C1] netif_receive_skb+0x55/0x280 [ 5581.338202][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5581.338518][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5581.338852][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5581.339151][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5581.339429][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5581.339718][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5581.340033][ C1] ? hlock_class+0x4e/0x130 [ 5581.340265][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5581.340545][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5581.340822][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5581.341087][ C1] ? hlock_class+0x4e/0x130 [ 5581.341320][ C1] ? mark_lock+0x38/0x3e0 [ 5581.341540][ C1] ? stack_access_ok+0xda/0x1f0 [ 5581.341791][ C1] ? __lock_acquire+0xb67/0x1610 [ 5581.342046][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5581.342328][ C1] ? get_stack_info+0x36/0xc0 [ 5581.342573][ C1] ? stack_access_ok+0xda/0x1f0 [ 5581.342822][ C1] ? get_reg+0x119/0x190 [ 5581.343038][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5581.343309][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5581.343619][ C1] __tcf_classify+0x329/0x7d0 [ 5581.343864][ C1] tcf_classify+0x283/0x930 [ 5581.344097][ C1] ? arch_stack_walk+0xa2/0x100 [ 5581.344348][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5581.344606][ C1] ? get_stack_info+0x36/0xc0 [ 5581.344846][ C1] tc_run+0x2e4/0x5d0 [ 5581.345054][ C1] ? __pfx_tc_run+0x10/0x10 [ 5581.345286][ C1] ? lock_acquire+0x1c1/0x220 [ 5581.345527][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5581.345790][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5581.346044][ C1] ? lock_acquire+0x1c1/0x220 [ 5581.346285][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5581.346551][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5581.346857][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5581.347132][ C1] ? neigh_hh_output+0x348/0x590 [ 5581.347387][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5581.347654][ C1] ip_finish_output2+0x786/0x18e0 [ 5581.347912][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5581.348192][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5581.348530][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5581.348810][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5581.349064][ C1] ? __ip_finish_output+0x10f/0x770 [ 5581.349331][ C1] ip_output+0x16b/0x4f0 [ 5581.349548][ C1] ? run_timer_softirq+0x72/0x100 [ 5581.349806][ C1] ? __pfx_ip_output+0x10/0x10 [ 5581.350052][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5581.350340][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5581.350594][ C1] ? ip_local_out+0x114/0x3b0 [ 5581.350836][ C1] __ip_queue_xmit+0x672/0x1910 [ 5581.351086][ C1] ? __create_object+0x5e/0xb0 [ 5581.351334][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5581.351603][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5581.351885][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5581.352163][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5581.352453][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5581.352725][ C1] tcp_delack_timer+0x84/0x240 [ 5581.352976][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5581.353250][ C1] call_timer_fn+0x173/0x430 [ 5581.353488][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5581.353752][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5581.354014][ C1] __run_timers.part.0+0x52d/0x890 [ 5581.354276][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5581.354550][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5581.354839][ C1] ? lock_acquire+0x1c1/0x220 [ 5581.355077][ C1] ? clockevents_program_event+0xf6/0x300 [ 5581.355370][ C1] ? lock_release+0x1d5/0x250 [ 5581.355611][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5581.355876][ C1] ? ktime_get+0xb3/0x190 [ 5581.356097][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5581.356398][ C1] run_timer_softirq+0x72/0x100 [ 5581.356648][ C1] __do_softirq+0x1b9/0x7ff [ 5581.356881][ C1] irq_exit_rcu+0x98/0xc0 [ 5581.357105][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5581.357391][ C1] [ 5581.357544][ C1] [ 5581.357694][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5581.358003][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5581.358329][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5581.359307][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5581.359617][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5581.360019][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5581.360423][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5581.360825][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5581.361229][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5581.361632][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5581.361932][ C1] pipe_read+0xa16/0xdf0 [ 5581.362157][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5581.362448][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5581.362693][ C1] ? iterate_tty_write+0x299/0x540 [ 5581.362956][ C1] ? lock_release+0x1d5/0x250 [ 5581.363199][ C1] vfs_read+0x911/0xc00 [ 5581.363412][ C1] ? lock_acquire+0x1c1/0x220 [ 5581.363654][ C1] ? __might_fault+0xc6/0x180 [ 5581.363897][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5581.364137][ C1] ? __might_fault+0xc6/0x180 [ 5581.364377][ C1] ? lock_release+0x1d5/0x250 [ 5581.364619][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5581.364885][ C1] ? __fget_light+0x54/0x1e0 [ 5581.365124][ C1] ksys_read+0x17a/0x1e0 [ 5581.365342][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5581.365588][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5581.365895][ C1] do_syscall_64+0xc9/0x1e0 [ 5581.366128][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5581.366430][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5581.366660][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5581.367639][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5581.368061][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5581.368465][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5581.368866][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5581.369266][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5581.369666][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5581.370072][ C1] [ 5581.370231][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5581.370505][ C2] NMI backtrace for cpu 2 [ 5581.370511][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5581.370517][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5581.370521][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5581.370530][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5581.370535][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5581.370540][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5581.370543][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5581.370547][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5581.370550][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5581.370554][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5581.370557][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5581.370559][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5581.370562][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5581.370564][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5581.370565][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5581.370567][ C2] PKRU: 55555554 [ 5581.370568][ C2] Call Trace: [ 5581.370570][ C2] [ 5581.370572][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5581.370578][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5581.370582][ C2] ? nmi_handle+0x153/0x420 [ 5581.370587][ C2] ? default_do_nmi+0x41/0x100 [ 5581.370590][ C2] ? exc_nmi+0xf3/0x120 [ 5581.370592][ C2] ? end_repeat_nmi+0xf/0x60 [ 5581.370597][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5581.370601][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5581.370604][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5581.370607][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5581.370610][ C2] [ 5581.370611][ C2] [ 5581.370612][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5581.370615][ C2] ? get_stack_info+0x36/0xc0 [ 5581.370619][ C2] ? lock_acquire+0x1c1/0x220 [ 5581.370623][ C2] ? lock_release+0x1d5/0x250 [ 5581.370626][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5581.370629][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5581.370632][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5581.370636][ C2] ? lock_acquire+0x1c1/0x220 [ 5581.370638][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5581.370642][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5581.370644][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5581.370651][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5581.370653][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5581.370657][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5581.370662][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5581.370666][ C2] ip_local_deliver+0x19d/0x480 [ 5581.370668][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5581.370670][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5581.370672][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5581.370677][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5581.370681][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5581.370684][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5581.370693][ C2] ip_rcv+0x564/0x740 [ 5581.370695][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5581.370698][ C2] ? set_track_prepare+0x8a/0xd0 [ 5581.370702][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5581.370705][ C2] ? start_secondary+0x21c/0x2b0 [ 5581.370708][ C2] ? skb_clone+0x10b/0x330 [ 5581.370711][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5581.370717][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5581.370722][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5581.370726][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5581.370734][ C2] ? __tcf_classify+0x329/0x7d0 [ 5581.370737][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5581.370740][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5581.370743][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5581.370746][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5581.370750][ C2] ? lock_acquire+0x1c1/0x220 [ 5581.370752][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5581.370757][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5581.370760][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5581.370764][ C2] ? __copy_skb_header+0xaf/0x490 [ 5581.370768][ C2] ? __skb_clone+0x57a/0x760 [ 5581.370771][ C2] netif_receive_skb+0x55/0x280 [ 5581.370774][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5581.370781][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5581.370788][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5581.370795][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5581.370799][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5581.370809][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5581.370816][ C2] ? get_stack_info+0x36/0xc0 [ 5581.370821][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5581.370824][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5581.370827][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5581.370830][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5581.370833][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5581.370835][ C2] ? kernel_text_address+0x17/0xe0 [ 5581.370838][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5581.370842][ C2] ? arch_stack_walk+0x8c/0x100 [ 5581.370846][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5581.370849][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5581.370852][ C2] ? lock_acquire+0x1c1/0x220 [ 5581.370855][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5581.370859][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5581.370863][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5581.370866][ C2] ? get_stack_info+0x36/0xc0 [ 5581.370870][ C2] __tcf_classify+0x329/0x7d0 [ 5581.370875][ C2] tcf_classify+0x283/0x930 [ 5581.370880][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5581.370883][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5581.370887][ C2] tc_run+0x2e4/0x5d0 [ 5581.370891][ C2] ? __pfx_tc_run+0x10/0x10 [ 5581.370894][ C2] ? lock_acquire+0x1c1/0x220 [ 5581.370896][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5581.370900][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5581.370904][ C2] ? lock_acquire+0x1c1/0x220 [ 5581.370906][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5581.370909][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5581.370912][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5581.370915][ C2] ? neigh_hh_output+0x348/0x590 [ 5581.370919][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5581.370922][ C2] ip_finish_output2+0x786/0x18e0 [ 5581.370926][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5581.370933][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5581.370936][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5581.370940][ C2] ? __ip_finish_output+0x10f/0x770 [ 5581.370943][ C2] ip_output+0x16b/0x4f0 [ 5581.370946][ C2] ? __pfx_ip_output+0x10/0x10 [ 5581.370949][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5581.370952][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5581.370955][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5581.370957][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5581.370960][ C2] ? __alloc_skb+0xd4/0x280 [ 5581.370962][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5581.370966][ C2] ? tcp_fragment+0x168/0x1040 [ 5581.370969][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5581.370972][ C2] ? ip_local_out+0x114/0x3b0 [ 5581.370975][ C2] __ip_queue_xmit+0x672/0x1910 [ 5581.370979][ C2] ? __skb_clone+0x57a/0x760 [ 5581.370981][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5581.370987][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5581.370990][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5581.370993][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5581.370996][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5581.371000][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5581.371003][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5581.371006][ C2] tcp_send_loss_probe+0x348/0x830 [ 5581.371009][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5581.371012][ C2] tcp_write_timer+0x82/0x1d0 [ 5581.371015][ C2] call_timer_fn+0x173/0x430 [ 5581.371019][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5581.371023][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5581.371027][ C2] __run_timers.part.0+0x52d/0x890 [ 5581.371030][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5581.371034][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5581.371037][ C2] ? lock_acquire+0x1c1/0x220 [ 5581.371039][ C2] ? clockevents_program_event+0xf6/0x300 [ 5581.371044][ C2] ? lock_release+0x1d5/0x250 [ 5581.371046][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5581.371049][ C2] ? ktime_get+0xb3/0x190 [ 5581.371053][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5581.371057][ C2] run_timer_softirq+0x72/0x100 [ 5581.371060][ C2] __do_softirq+0x1b9/0x7ff [ 5581.371064][ C2] irq_exit_rcu+0x98/0xc0 [ 5581.371067][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5581.371070][ C2] [ 5581.371071][ C2] [ 5581.371072][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5581.371075][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5581.371078][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5581.371080][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5581.371082][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5581.371084][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5581.371085][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5581.371086][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5581.371088][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5581.371091][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5581.371094][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5581.371097][ C2] default_idle_call+0x69/0xa0 [ 5581.371100][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5581.371103][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5581.371106][ C2] ? lock_release+0x1d5/0x250 [ 5581.371109][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5581.371113][ C2] do_idle+0xfb/0x160 [ 5581.371115][ C2] cpu_startup_entry+0x55/0x60 [ 5581.371118][ C2] start_secondary+0x21c/0x2b0 [ 5581.371121][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5581.371124][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5581.371130][ C2] [ 5608.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3032s! [swapper/2:0] [ 5608.569700][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5608.570946][ C2] irq event stamp: 44114564 [ 5608.571175][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5608.571707][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5608.572220][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5608.572694][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5608.573165][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5608.573618][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5608.574228][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 5608.574509][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 5608.575472][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 5608.575782][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5608.576178][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5608.576575][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5608.576973][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5608.577368][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5608.577764][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5608.578207][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5608.578539][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5608.578939][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5608.579339][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5608.579734][ C2] PKRU: 55555554 [ 5608.579914][ C2] Call Trace: [ 5608.580084][ C2] [ 5608.580231][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5608.580491][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5608.580735][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5608.581009][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5608.581284][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5608.581569][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5608.581832][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5608.582137][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5608.582401][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5608.582661][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5608.582968][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5608.583263][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5608.583575][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5608.583865][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 5608.584143][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 5608.584425][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5608.584735][ C2] ? get_stack_info+0x36/0xc0 [ 5608.584973][ C2] ? lock_acquire+0x1c1/0x220 [ 5608.585212][ C2] ? lock_release+0x1d5/0x250 [ 5608.585452][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5608.585700][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5608.585973][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5608.586257][ C2] ? lock_acquire+0x1c1/0x220 [ 5608.586495][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5608.586735][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5608.586994][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5608.587229][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5608.587474][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5608.587731][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5608.588006][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5608.588280][ C2] ip_local_deliver+0x19d/0x480 [ 5608.588527][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5608.588795][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5608.589059][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5608.589406][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5608.589658][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5608.589976][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5608.590237][ C2] ip_rcv+0x564/0x740 [ 5608.590440][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5608.590667][ C2] ? set_track_prepare+0x8a/0xd0 [ 5608.590919][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5608.591197][ C2] ? start_secondary+0x21c/0x2b0 [ 5608.591447][ C2] ? skb_clone+0x10b/0x330 [ 5608.591672][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5608.591989][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5608.592298][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5608.592577][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5608.592871][ C2] ? __tcf_classify+0x329/0x7d0 [ 5608.593118][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5608.593346][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5608.593644][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5608.593926][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5608.594248][ C2] ? lock_acquire+0x1c1/0x220 [ 5608.594487][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5608.594783][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5608.595065][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5608.595380][ C2] ? __copy_skb_header+0xaf/0x490 [ 5608.595637][ C2] ? __skb_clone+0x57a/0x760 [ 5608.595871][ C2] netif_receive_skb+0x55/0x280 [ 5608.596125][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5608.596435][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5608.596766][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5608.597062][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5608.597336][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5608.597624][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5608.597935][ C2] ? get_stack_info+0x36/0xc0 [ 5608.598174][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5608.598436][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5608.598753][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5608.599029][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5608.599305][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5608.599617][ C2] ? kernel_text_address+0x17/0xe0 [ 5608.599876][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5608.600188][ C2] ? arch_stack_walk+0x8c/0x100 [ 5608.600436][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5608.600699][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5608.600982][ C2] ? lock_acquire+0x1c1/0x220 [ 5608.601219][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5608.601500][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5608.601801][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5608.602077][ C2] ? get_stack_info+0x36/0xc0 [ 5608.602320][ C2] __tcf_classify+0x329/0x7d0 [ 5608.602561][ C2] tcf_classify+0x283/0x930 [ 5608.602793][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5608.603048][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5608.603360][ C2] tc_run+0x2e4/0x5d0 [ 5608.603564][ C2] ? __pfx_tc_run+0x10/0x10 [ 5608.603793][ C2] ? lock_acquire+0x1c1/0x220 [ 5608.604030][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5608.604291][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5608.604543][ C2] ? lock_acquire+0x1c1/0x220 [ 5608.604780][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5608.605043][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5608.605346][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5608.605616][ C2] ? neigh_hh_output+0x348/0x590 [ 5608.605867][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5608.606129][ C2] ip_finish_output2+0x786/0x18e0 [ 5608.606384][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5608.606718][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5608.606997][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5608.607248][ C2] ? __ip_finish_output+0x10f/0x770 [ 5608.607511][ C2] ip_output+0x16b/0x4f0 [ 5608.607725][ C2] ? __pfx_ip_output+0x10/0x10 [ 5608.607967][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5608.608241][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5608.608551][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5608.608823][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5608.609073][ C2] ? __alloc_skb+0xd4/0x280 [ 5608.609303][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5608.609571][ C2] ? tcp_fragment+0x168/0x1040 [ 5608.609814][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5608.610064][ C2] ? ip_local_out+0x114/0x3b0 [ 5608.610305][ C2] __ip_queue_xmit+0x672/0x1910 [ 5608.610551][ C2] ? __skb_clone+0x57a/0x760 [ 5608.610783][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5608.611048][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5608.611330][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5608.611573][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5608.611818][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5608.612119][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5608.612439][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5608.612682][ C2] tcp_send_loss_probe+0x348/0x830 [ 5608.612941][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5608.613208][ C2] tcp_write_timer+0x82/0x1d0 [ 5608.613447][ C2] call_timer_fn+0x173/0x430 [ 5608.613684][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5608.613945][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5608.614204][ C2] __run_timers.part.0+0x52d/0x890 [ 5608.614463][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5608.614734][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5608.615016][ C2] ? lock_acquire+0x1c1/0x220 [ 5608.615253][ C2] ? clockevents_program_event+0xf6/0x300 [ 5608.615543][ C2] ? lock_release+0x1d5/0x250 [ 5608.615779][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5608.616043][ C2] ? ktime_get+0xb3/0x190 [ 5608.616263][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5608.616557][ C2] run_timer_softirq+0x72/0x100 [ 5608.616803][ C2] __do_softirq+0x1b9/0x7ff [ 5608.617035][ C2] irq_exit_rcu+0x98/0xc0 [ 5608.617254][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5608.617538][ C2] [ 5608.617686][ C2] [ 5608.617838][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5608.618139][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5608.618395][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5608.619359][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5608.619664][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5608.620063][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5608.620459][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5608.620856][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5608.621250][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5608.621649][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5608.621935][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5608.622194][ C2] default_idle_call+0x69/0xa0 [ 5608.622439][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5608.622689][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5608.622965][ C2] ? lock_release+0x1d5/0x250 [ 5608.623203][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5608.623475][ C2] do_idle+0xfb/0x160 [ 5608.623678][ C2] cpu_startup_entry+0x55/0x60 [ 5608.623919][ C2] start_secondary+0x21c/0x2b0 [ 5608.624163][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5608.624430][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5608.624738][ C2] [ 5608.624897][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3032s! [perl:4135] [ 5608.625317][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5608.626572][ C1] irq event stamp: 209232 [ 5608.626790][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5608.627317][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5608.627795][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5608.628265][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5608.628727][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5608.629176][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5608.629791][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5608.630117][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5608.631086][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5608.631394][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5608.631794][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5608.632193][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5608.632600][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5608.633005][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5608.633404][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5608.633853][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5608.634186][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5608.634589][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5608.634990][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5608.635390][ C1] PKRU: 55555554 [ 5608.635572][ C1] Call Trace: [ 5608.635744][ C1] [ 5608.635893][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5608.636155][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5608.636401][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5608.636679][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5608.636951][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5608.637243][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5608.637509][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5608.637816][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5608.638079][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5608.638390][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5608.638685][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5608.639001][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5608.639292][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5608.639588][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5608.639880][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5608.640193][ C1] ? get_stack_info+0x36/0xc0 [ 5608.640433][ C1] ? lock_acquire+0x1c1/0x220 [ 5608.640678][ C1] ? lock_release+0x1d5/0x250 [ 5608.640919][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5608.641171][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5608.641446][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5608.641733][ C1] ? lock_acquire+0x1c1/0x220 [ 5608.641974][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5608.642222][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5608.642483][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5608.642721][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5608.642968][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5608.643228][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5608.643505][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5608.643783][ C1] ip_local_deliver+0x19d/0x480 [ 5608.644031][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5608.644303][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5608.644567][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5608.644917][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5608.645171][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5608.645493][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5608.645756][ C1] ip_rcv+0x564/0x740 [ 5608.645961][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5608.646193][ C1] ? set_track_prepare+0x8a/0xd0 [ 5608.646447][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5608.646728][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5608.647001][ C1] ? skb_clone+0x10b/0x330 [ 5608.647229][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5608.647549][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5608.647855][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5608.648138][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5608.648432][ C1] ? __tcf_classify+0x329/0x7d0 [ 5608.648682][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5608.648914][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5608.649214][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5608.649502][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5608.649828][ C1] ? lock_acquire+0x1c1/0x220 [ 5608.650068][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5608.650369][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5608.650655][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5608.650972][ C1] ? __copy_skb_header+0xaf/0x490 [ 5608.651231][ C1] ? __skb_clone+0x57a/0x760 [ 5608.651466][ C1] netif_receive_skb+0x55/0x280 [ 5608.651716][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5608.652028][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5608.652364][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5608.652665][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5608.652940][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5608.653228][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5608.653541][ C1] ? hlock_class+0x4e/0x130 [ 5608.653775][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5608.654052][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5608.654331][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5608.654596][ C1] ? hlock_class+0x4e/0x130 [ 5608.654828][ C1] ? mark_lock+0x38/0x3e0 [ 5608.655052][ C1] ? stack_access_ok+0xda/0x1f0 [ 5608.655300][ C1] ? __lock_acquire+0xb67/0x1610 [ 5608.655559][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5608.655839][ C1] ? get_stack_info+0x36/0xc0 [ 5608.656078][ C1] ? stack_access_ok+0xda/0x1f0 [ 5608.656327][ C1] ? get_reg+0x119/0x190 [ 5608.656545][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5608.656814][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5608.657126][ C1] __tcf_classify+0x329/0x7d0 [ 5608.657367][ C1] tcf_classify+0x283/0x930 [ 5608.657601][ C1] ? arch_stack_walk+0xa2/0x100 [ 5608.657850][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5608.658107][ C1] ? get_stack_info+0x36/0xc0 [ 5608.658350][ C1] tc_run+0x2e4/0x5d0 [ 5608.658556][ C1] ? __pfx_tc_run+0x10/0x10 [ 5608.658786][ C1] ? lock_acquire+0x1c1/0x220 [ 5608.659025][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5608.659287][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5608.659541][ C1] ? lock_acquire+0x1c1/0x220 [ 5608.659782][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5608.660047][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5608.660354][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5608.660627][ C1] ? neigh_hh_output+0x348/0x590 [ 5608.660884][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5608.661149][ C1] ip_finish_output2+0x786/0x18e0 [ 5608.661406][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5608.661685][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5608.662025][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5608.662306][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5608.662561][ C1] ? __ip_finish_output+0x10f/0x770 [ 5608.662827][ C1] ip_output+0x16b/0x4f0 [ 5608.663043][ C1] ? run_timer_softirq+0x72/0x100 [ 5608.663300][ C1] ? __pfx_ip_output+0x10/0x10 [ 5608.663545][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5608.663834][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5608.664087][ C1] ? ip_local_out+0x114/0x3b0 [ 5608.664325][ C1] __ip_queue_xmit+0x672/0x1910 [ 5608.664575][ C1] ? __create_object+0x5e/0xb0 [ 5608.664821][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5608.665088][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5608.665371][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5608.665646][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5608.665927][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5608.666199][ C1] tcp_delack_timer+0x84/0x240 [ 5608.666449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5608.666721][ C1] call_timer_fn+0x173/0x430 [ 5608.666957][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5608.667221][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5608.667482][ C1] __run_timers.part.0+0x52d/0x890 [ 5608.667743][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5608.668019][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5608.668305][ C1] ? lock_acquire+0x1c1/0x220 [ 5608.668549][ C1] ? clockevents_program_event+0xf6/0x300 [ 5608.668838][ C1] ? lock_release+0x1d5/0x250 [ 5608.669079][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5608.669344][ C1] ? ktime_get+0xb3/0x190 [ 5608.669566][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5608.669863][ C1] run_timer_softirq+0x72/0x100 [ 5608.670111][ C1] __do_softirq+0x1b9/0x7ff [ 5608.670345][ C1] irq_exit_rcu+0x98/0xc0 [ 5608.670566][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5608.670854][ C1] [ 5608.671005][ C1] [ 5608.671155][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5608.671462][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5608.671788][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5608.672765][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5608.673077][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5608.673476][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5608.673878][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5608.674278][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5608.674677][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5608.675080][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5608.675379][ C1] pipe_read+0xa16/0xdf0 [ 5608.675599][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5608.675881][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5608.676125][ C1] ? iterate_tty_write+0x299/0x540 [ 5608.676387][ C1] ? lock_release+0x1d5/0x250 [ 5608.676627][ C1] vfs_read+0x911/0xc00 [ 5608.676844][ C1] ? lock_acquire+0x1c1/0x220 [ 5608.677082][ C1] ? __might_fault+0xc6/0x180 [ 5608.677327][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5608.677567][ C1] ? __might_fault+0xc6/0x180 [ 5608.677807][ C1] ? lock_release+0x1d5/0x250 [ 5608.678046][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5608.678312][ C1] ? __fget_light+0x54/0x1e0 [ 5608.678550][ C1] ksys_read+0x17a/0x1e0 [ 5608.678767][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5608.679012][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5608.679318][ C1] do_syscall_64+0xc9/0x1e0 [ 5608.679553][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5608.679852][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5608.680083][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5608.681056][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5608.681479][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5608.681878][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5608.682288][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5608.682688][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5608.683089][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5608.683493][ C1] [ 5636.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3058s! [swapper/2:0] [ 5636.569708][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5636.570955][ C2] irq event stamp: 44114564 [ 5636.571183][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5636.571716][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5636.572226][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5636.572699][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5636.573166][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5636.573618][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5636.574229][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5636.574547][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5636.575513][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5636.575816][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5636.576213][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5636.576610][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5636.577005][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5636.577402][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5636.577799][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5636.578243][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5636.578573][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5636.578971][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5636.579370][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5636.579767][ C2] PKRU: 55555554 [ 5636.579947][ C2] Call Trace: [ 5636.580114][ C2] [ 5636.580263][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5636.580521][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5636.580764][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5636.581038][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5636.581309][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5636.581597][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5636.581861][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5636.582166][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5636.582426][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5636.582687][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5636.582993][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5636.583287][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5636.583602][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5636.583888][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5636.584176][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5636.584463][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5636.584771][ C2] ? get_stack_info+0x36/0xc0 [ 5636.585011][ C2] ? lock_acquire+0x1c1/0x220 [ 5636.585252][ C2] ? lock_release+0x1d5/0x250 [ 5636.585490][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5636.585736][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5636.586008][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5636.586291][ C2] ? lock_acquire+0x1c1/0x220 [ 5636.586528][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5636.586768][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5636.587026][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5636.587257][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5636.587502][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5636.587761][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5636.588035][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5636.588312][ C2] ip_local_deliver+0x19d/0x480 [ 5636.588558][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5636.588828][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5636.589088][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5636.589433][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5636.589686][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5636.590003][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5636.590265][ C2] ip_rcv+0x564/0x740 [ 5636.590469][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5636.590699][ C2] ? set_track_prepare+0x8a/0xd0 [ 5636.590951][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5636.591225][ C2] ? start_secondary+0x21c/0x2b0 [ 5636.591475][ C2] ? skb_clone+0x10b/0x330 [ 5636.591704][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5636.592023][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5636.592331][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5636.592612][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5636.592905][ C2] ? __tcf_classify+0x329/0x7d0 [ 5636.593152][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5636.593383][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5636.593683][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5636.593965][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5636.594288][ C2] ? lock_acquire+0x1c1/0x220 [ 5636.594526][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5636.594821][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5636.595106][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5636.595422][ C2] ? __copy_skb_header+0xaf/0x490 [ 5636.595679][ C2] ? __skb_clone+0x57a/0x760 [ 5636.595912][ C2] netif_receive_skb+0x55/0x280 [ 5636.596159][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5636.596470][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5636.596800][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5636.597100][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5636.597373][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5636.597661][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5636.597971][ C2] ? get_stack_info+0x36/0xc0 [ 5636.598211][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5636.598474][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5636.598789][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5636.599066][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5636.599342][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5636.599656][ C2] ? kernel_text_address+0x17/0xe0 [ 5636.599915][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5636.600228][ C2] ? arch_stack_walk+0x8c/0x100 [ 5636.600476][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5636.600739][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5636.601023][ C2] ? lock_acquire+0x1c1/0x220 [ 5636.601261][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5636.601542][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5636.601847][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5636.602124][ C2] ? get_stack_info+0x36/0xc0 [ 5636.602365][ C2] __tcf_classify+0x329/0x7d0 [ 5636.602606][ C2] tcf_classify+0x283/0x930 [ 5636.602838][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5636.603092][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5636.603403][ C2] tc_run+0x2e4/0x5d0 [ 5636.603611][ C2] ? __pfx_tc_run+0x10/0x10 [ 5636.603840][ C2] ? lock_acquire+0x1c1/0x220 [ 5636.604078][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5636.604339][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5636.604591][ C2] ? lock_acquire+0x1c1/0x220 [ 5636.604831][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5636.605094][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5636.605397][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5636.605668][ C2] ? neigh_hh_output+0x348/0x590 [ 5636.605920][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5636.606183][ C2] ip_finish_output2+0x786/0x18e0 [ 5636.606440][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5636.606776][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5636.607050][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5636.607303][ C2] ? __ip_finish_output+0x10f/0x770 [ 5636.607567][ C2] ip_output+0x16b/0x4f0 [ 5636.607785][ C2] ? __pfx_ip_output+0x10/0x10 [ 5636.608028][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5636.608302][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5636.608614][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5636.608888][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5636.609139][ C2] ? __alloc_skb+0xd4/0x280 [ 5636.609370][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5636.609638][ C2] ? tcp_fragment+0x168/0x1040 [ 5636.609882][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5636.610133][ C2] ? ip_local_out+0x114/0x3b0 [ 5636.610370][ C2] __ip_queue_xmit+0x672/0x1910 [ 5636.610618][ C2] ? __skb_clone+0x57a/0x760 [ 5636.610853][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5636.611119][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5636.611399][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5636.611641][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5636.611889][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5636.612194][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5636.612513][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5636.612756][ C2] tcp_send_loss_probe+0x348/0x830 [ 5636.613015][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5636.613282][ C2] tcp_write_timer+0x82/0x1d0 [ 5636.613521][ C2] call_timer_fn+0x173/0x430 [ 5636.613755][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5636.614015][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5636.614277][ C2] __run_timers.part.0+0x52d/0x890 [ 5636.614536][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5636.614805][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5636.615088][ C2] ? lock_acquire+0x1c1/0x220 [ 5636.615327][ C2] ? clockevents_program_event+0xf6/0x300 [ 5636.615614][ C2] ? lock_release+0x1d5/0x250 [ 5636.615853][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5636.616116][ C2] ? ktime_get+0xb3/0x190 [ 5636.616337][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5636.616631][ C2] run_timer_softirq+0x72/0x100 [ 5636.616878][ C2] __do_softirq+0x1b9/0x7ff [ 5636.617114][ C2] irq_exit_rcu+0x98/0xc0 [ 5636.617331][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5636.617617][ C2] [ 5636.617766][ C2] [ 5636.617915][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5636.618218][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5636.618474][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5636.619439][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5636.619746][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5636.620147][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5636.620547][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5636.620944][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5636.621342][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5636.621739][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5636.622029][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5636.622292][ C2] default_idle_call+0x69/0xa0 [ 5636.622536][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5636.622786][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5636.623062][ C2] ? lock_release+0x1d5/0x250 [ 5636.623301][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5636.623573][ C2] do_idle+0xfb/0x160 [ 5636.623776][ C2] cpu_startup_entry+0x55/0x60 [ 5636.624019][ C2] start_secondary+0x21c/0x2b0 [ 5636.624263][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5636.624531][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5636.624841][ C2] [ 5636.624997][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3058s! [perl:4135] [ 5636.625416][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5636.626670][ C1] irq event stamp: 209232 [ 5636.626891][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5636.627419][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5636.627897][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5636.628370][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5636.628833][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5636.629280][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5636.629895][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 5636.630182][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 5636.631154][ C1] RSP: 0018:ffffc900001c7b60 EFLAGS: 00000282 [ 5636.631462][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5636.631861][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5636.632265][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5636.632670][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5636.633071][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5636.633470][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5636.633919][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5636.634253][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5636.634657][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5636.635058][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5636.635457][ C1] PKRU: 55555554 [ 5636.635639][ C1] Call Trace: [ 5636.635812][ C1] [ 5636.635959][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5636.636221][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5636.636466][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5636.636744][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5636.637019][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5636.637310][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5636.637576][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5636.637884][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5636.638147][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5636.638458][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5636.638754][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5636.639070][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5636.639363][ C1] ? kasan_check_range+0x1a/0x1c0 [ 5636.639621][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5636.639902][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5636.640215][ C1] ? get_stack_info+0x36/0xc0 [ 5636.640458][ C1] ? lock_acquire+0x1c1/0x220 [ 5636.640698][ C1] ? lock_release+0x1d5/0x250 [ 5636.640938][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5636.641188][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5636.641459][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5636.641747][ C1] ? lock_acquire+0x1c1/0x220 [ 5636.641987][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5636.642232][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5636.642494][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5636.642729][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5636.642977][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5636.643236][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5636.643511][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5636.643789][ C1] ip_local_deliver+0x19d/0x480 [ 5636.644036][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5636.644314][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5636.644578][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5636.644925][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5636.645179][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5636.645499][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5636.645761][ C1] ip_rcv+0x564/0x740 [ 5636.645965][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5636.646197][ C1] ? set_track_prepare+0x8a/0xd0 [ 5636.646452][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5636.646728][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5636.647001][ C1] ? skb_clone+0x10b/0x330 [ 5636.647231][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5636.647550][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5636.647858][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5636.648139][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5636.648433][ C1] ? __tcf_classify+0x329/0x7d0 [ 5636.648682][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5636.648915][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5636.649216][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5636.649502][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5636.649827][ C1] ? lock_acquire+0x1c1/0x220 [ 5636.650068][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5636.650366][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5636.650652][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5636.650969][ C1] ? __copy_skb_header+0xaf/0x490 [ 5636.651228][ C1] ? __skb_clone+0x57a/0x760 [ 5636.651464][ C1] netif_receive_skb+0x55/0x280 [ 5636.651712][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5636.652024][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5636.652363][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5636.652663][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5636.652937][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5636.653229][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5636.653541][ C1] ? hlock_class+0x4e/0x130 [ 5636.653775][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5636.654051][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5636.654328][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5636.654592][ C1] ? hlock_class+0x4e/0x130 [ 5636.654823][ C1] ? mark_lock+0x38/0x3e0 [ 5636.655044][ C1] ? stack_access_ok+0xda/0x1f0 [ 5636.655294][ C1] ? __lock_acquire+0xb67/0x1610 [ 5636.655549][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5636.655825][ C1] ? get_stack_info+0x36/0xc0 [ 5636.656067][ C1] ? stack_access_ok+0xda/0x1f0 [ 5636.656315][ C1] ? get_reg+0x119/0x190 [ 5636.656532][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5636.656799][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5636.657110][ C1] __tcf_classify+0x329/0x7d0 [ 5636.657353][ C1] tcf_classify+0x283/0x930 [ 5636.657584][ C1] ? arch_stack_walk+0xa2/0x100 [ 5636.657833][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5636.658090][ C1] ? get_stack_info+0x36/0xc0 [ 5636.658332][ C1] tc_run+0x2e4/0x5d0 [ 5636.658537][ C1] ? __pfx_tc_run+0x10/0x10 [ 5636.658769][ C1] ? lock_acquire+0x1c1/0x220 [ 5636.659010][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5636.659274][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5636.659529][ C1] ? lock_acquire+0x1c1/0x220 [ 5636.659767][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5636.660035][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5636.660341][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5636.660615][ C1] ? neigh_hh_output+0x348/0x590 [ 5636.660868][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5636.661136][ C1] ip_finish_output2+0x786/0x18e0 [ 5636.661393][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5636.661673][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5636.662012][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5636.662294][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5636.662549][ C1] ? __ip_finish_output+0x10f/0x770 [ 5636.662815][ C1] ip_output+0x16b/0x4f0 [ 5636.663034][ C1] ? run_timer_softirq+0x72/0x100 [ 5636.663293][ C1] ? __pfx_ip_output+0x10/0x10 [ 5636.663537][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5636.663824][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5636.664078][ C1] ? ip_local_out+0x114/0x3b0 [ 5636.664320][ C1] __ip_queue_xmit+0x672/0x1910 [ 5636.664570][ C1] ? __create_object+0x5e/0xb0 [ 5636.664813][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5636.665084][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5636.665366][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5636.665639][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5636.665922][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5636.666197][ C1] tcp_delack_timer+0x84/0x240 [ 5636.666441][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5636.666714][ C1] call_timer_fn+0x173/0x430 [ 5636.666950][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5636.667213][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5636.667476][ C1] __run_timers.part.0+0x52d/0x890 [ 5636.667736][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5636.668010][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5636.668295][ C1] ? lock_acquire+0x1c1/0x220 [ 5636.668536][ C1] ? clockevents_program_event+0xf6/0x300 [ 5636.668828][ C1] ? lock_release+0x1d5/0x250 [ 5636.669066][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5636.669332][ C1] ? ktime_get+0xb3/0x190 [ 5636.669555][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5636.669852][ C1] run_timer_softirq+0x72/0x100 [ 5636.670100][ C1] __do_softirq+0x1b9/0x7ff [ 5636.670334][ C1] irq_exit_rcu+0x98/0xc0 [ 5636.670556][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5636.670843][ C1] [ 5636.670993][ C1] [ 5636.671146][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5636.671451][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5636.671777][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5636.672755][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5636.673064][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5636.673467][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5636.673866][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5636.674266][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5636.674667][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5636.675072][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5636.675369][ C1] pipe_read+0xa16/0xdf0 [ 5636.675592][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5636.675870][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5636.676116][ C1] ? iterate_tty_write+0x299/0x540 [ 5636.676380][ C1] ? lock_release+0x1d5/0x250 [ 5636.676623][ C1] vfs_read+0x911/0xc00 [ 5636.676838][ C1] ? lock_acquire+0x1c1/0x220 [ 5636.677080][ C1] ? __might_fault+0xc6/0x180 [ 5636.677321][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5636.677561][ C1] ? __might_fault+0xc6/0x180 [ 5636.677802][ C1] ? lock_release+0x1d5/0x250 [ 5636.678045][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5636.678314][ C1] ? __fget_light+0x54/0x1e0 [ 5636.678552][ C1] ksys_read+0x17a/0x1e0 [ 5636.678772][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5636.679019][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5636.679324][ C1] do_syscall_64+0xc9/0x1e0 [ 5636.679560][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5636.679863][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5636.680091][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5636.681066][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5636.681489][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5636.681889][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5636.682296][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5636.682697][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5636.683097][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5636.683500][ C1] [ 5659.370103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5659.370511][ C1] rcu: 1-....: (3296175 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=806859 [ 5659.371067][ C1] rcu: (t=3304483 jiffies g=1882453 q=712 ncpus=4) [ 5659.371404][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5659.371855][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5659.372477][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5659.372809][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5659.373786][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5659.374096][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5659.374497][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5659.374903][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5659.375304][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5659.375709][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5659.376111][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5659.376561][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5659.376899][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5659.377302][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5659.377701][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5659.378103][ C1] PKRU: 55555554 [ 5659.378284][ C1] Call Trace: [ 5659.378457][ C1] [ 5659.378606][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5659.378882][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5659.379140][ C1] ? check_cpu_stall+0x284/0x500 [ 5659.379393][ C1] ? rcu_pending+0x92/0x360 [ 5659.379626][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5659.379898][ C1] ? update_process_times+0xb9/0x110 [ 5659.380168][ C1] ? tick_sched_handle+0x67/0x130 [ 5659.380427][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5659.380716][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5659.380960][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5659.381274][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5659.381549][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5659.381839][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5659.382116][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5659.382425][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5659.382689][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5659.383006][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5659.383304][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5659.383621][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5659.383912][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5659.384210][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5659.384500][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5659.384814][ C1] ? get_stack_info+0x36/0xc0 [ 5659.385060][ C1] ? lock_acquire+0x1c1/0x220 [ 5659.385302][ C1] ? lock_release+0x1d5/0x250 [ 5659.385542][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5659.385793][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5659.386066][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5659.386355][ C1] ? lock_acquire+0x1c1/0x220 [ 5659.386596][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5659.386837][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5659.387100][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5659.387340][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5659.387591][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5659.387851][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5659.388136][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5659.388415][ C1] ip_local_deliver+0x19d/0x480 [ 5659.388662][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5659.388945][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5659.389210][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5659.389558][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5659.389812][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5659.390134][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5659.390398][ C1] ip_rcv+0x564/0x740 [ 5659.390604][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5659.390836][ C1] ? set_track_prepare+0x8a/0xd0 [ 5659.391094][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5659.391372][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5659.391644][ C1] ? skb_clone+0x10b/0x330 [ 5659.391877][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5659.392209][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5659.392517][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5659.392805][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5659.393104][ C1] ? __tcf_classify+0x329/0x7d0 [ 5659.393355][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5659.393588][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5659.393893][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5659.394178][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5659.394505][ C1] ? lock_acquire+0x1c1/0x220 [ 5659.394754][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5659.395051][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5659.395338][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5659.395658][ C1] ? __copy_skb_header+0xaf/0x490 [ 5659.395917][ C1] ? __skb_clone+0x57a/0x760 [ 5659.396154][ C1] netif_receive_skb+0x55/0x280 [ 5659.396403][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5659.396718][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5659.397051][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5659.397355][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5659.397631][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5659.397926][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5659.398243][ C1] ? hlock_class+0x4e/0x130 [ 5659.398479][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5659.398757][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5659.399038][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5659.399303][ C1] ? hlock_class+0x4e/0x130 [ 5659.399537][ C1] ? mark_lock+0x38/0x3e0 [ 5659.399758][ C1] ? stack_access_ok+0xda/0x1f0 [ 5659.400010][ C1] ? __lock_acquire+0xb67/0x1610 [ 5659.400270][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5659.400546][ C1] ? get_stack_info+0x36/0xc0 [ 5659.400790][ C1] ? stack_access_ok+0xda/0x1f0 [ 5659.401040][ C1] ? get_reg+0x119/0x190 [ 5659.401258][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5659.401531][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5659.401845][ C1] __tcf_classify+0x329/0x7d0 [ 5659.402097][ C1] tcf_classify+0x283/0x930 [ 5659.402328][ C1] ? arch_stack_walk+0xa2/0x100 [ 5659.402579][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5659.402837][ C1] ? get_stack_info+0x36/0xc0 [ 5659.403080][ C1] tc_run+0x2e4/0x5d0 [ 5659.403286][ C1] ? __pfx_tc_run+0x10/0x10 [ 5659.403519][ C1] ? lock_acquire+0x1c1/0x220 [ 5659.403759][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5659.404022][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5659.404275][ C1] ? lock_acquire+0x1c1/0x220 [ 5659.404513][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5659.404778][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5659.405085][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5659.405358][ C1] ? neigh_hh_output+0x348/0x590 [ 5659.405612][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5659.405881][ C1] ip_finish_output2+0x786/0x18e0 [ 5659.406138][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5659.406419][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5659.406759][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5659.407035][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5659.407290][ C1] ? __ip_finish_output+0x10f/0x770 [ 5659.407557][ C1] ip_output+0x16b/0x4f0 [ 5659.407778][ C1] ? run_timer_softirq+0x72/0x100 [ 5659.408039][ C1] ? __pfx_ip_output+0x10/0x10 [ 5659.408284][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5659.408573][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5659.408827][ C1] ? ip_local_out+0x114/0x3b0 [ 5659.409069][ C1] __ip_queue_xmit+0x672/0x1910 [ 5659.409318][ C1] ? __create_object+0x5e/0xb0 [ 5659.409562][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5659.409832][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5659.410116][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5659.410392][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5659.410675][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5659.410951][ C1] tcp_delack_timer+0x84/0x240 [ 5659.411196][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5659.411471][ C1] call_timer_fn+0x173/0x430 [ 5659.411713][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5659.411989][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5659.412253][ C1] __run_timers.part.0+0x52d/0x890 [ 5659.412514][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5659.412791][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5659.413076][ C1] ? lock_acquire+0x1c1/0x220 [ 5659.413317][ C1] ? clockevents_program_event+0xf6/0x300 [ 5659.413609][ C1] ? lock_release+0x1d5/0x250 [ 5659.413849][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5659.414119][ C1] ? ktime_get+0xb3/0x190 [ 5659.414347][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5659.414646][ C1] run_timer_softirq+0x72/0x100 [ 5659.414895][ C1] __do_softirq+0x1b9/0x7ff [ 5659.415132][ C1] irq_exit_rcu+0x98/0xc0 [ 5659.415357][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5659.415649][ C1] [ 5659.415799][ C1] [ 5659.415952][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5659.416257][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5659.416586][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5659.417570][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5659.417881][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5659.418289][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5659.418692][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5659.419099][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5659.419505][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5659.419914][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5659.420211][ C1] pipe_read+0xa16/0xdf0 [ 5659.420437][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5659.420719][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5659.420968][ C1] ? iterate_tty_write+0x299/0x540 [ 5659.421232][ C1] ? lock_release+0x1d5/0x250 [ 5659.421478][ C1] vfs_read+0x911/0xc00 [ 5659.421697][ C1] ? lock_acquire+0x1c1/0x220 [ 5659.421939][ C1] ? __might_fault+0xc6/0x180 [ 5659.422191][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5659.422433][ C1] ? __might_fault+0xc6/0x180 [ 5659.422677][ C1] ? lock_release+0x1d5/0x250 [ 5659.422919][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5659.423187][ C1] ? __fget_light+0x54/0x1e0 [ 5659.423426][ C1] ksys_read+0x17a/0x1e0 [ 5659.423646][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5659.423896][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5659.424203][ C1] do_syscall_64+0xc9/0x1e0 [ 5659.424439][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5659.424742][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5659.424970][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5659.425950][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5659.426378][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5659.426781][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5659.427182][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5659.427590][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5659.427993][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5659.428399][ C1] [ 5659.428560][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5659.428845][ C2] NMI backtrace for cpu 2 [ 5659.428852][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5659.428858][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5659.428862][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5659.428871][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5659.428876][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5659.428881][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5659.428885][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5659.428888][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5659.428892][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5659.428896][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5659.428900][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5659.428904][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5659.428912][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5659.428916][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5659.428919][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5659.428923][ C2] PKRU: 55555554 [ 5659.428925][ C2] Call Trace: [ 5659.428928][ C2] [ 5659.428931][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5659.428937][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5659.428942][ C2] ? nmi_handle+0x153/0x420 [ 5659.428947][ C2] ? default_do_nmi+0x41/0x100 [ 5659.428950][ C2] ? exc_nmi+0xf3/0x120 [ 5659.428953][ C2] ? end_repeat_nmi+0xf/0x60 [ 5659.428958][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5659.428961][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5659.428964][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5659.428968][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5659.428971][ C2] [ 5659.428971][ C2] [ 5659.428973][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5659.428976][ C2] ? get_stack_info+0x36/0xc0 [ 5659.428980][ C2] ? lock_acquire+0x1c1/0x220 [ 5659.428984][ C2] ? lock_release+0x1d5/0x250 [ 5659.428987][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5659.428991][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5659.428994][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5659.428997][ C2] ? lock_acquire+0x1c1/0x220 [ 5659.429000][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5659.429004][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5659.429007][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5659.429013][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5659.429016][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5659.429020][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5659.429026][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5659.429030][ C2] ip_local_deliver+0x19d/0x480 [ 5659.429032][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5659.429034][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5659.429036][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5659.429042][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5659.429046][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5659.429049][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5659.429058][ C2] ip_rcv+0x564/0x740 [ 5659.429061][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5659.429064][ C2] ? set_track_prepare+0x8a/0xd0 [ 5659.429068][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5659.429071][ C2] ? start_secondary+0x21c/0x2b0 [ 5659.429075][ C2] ? skb_clone+0x10b/0x330 [ 5659.429080][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5659.429086][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5659.429091][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5659.429097][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5659.429108][ C2] ? __tcf_classify+0x329/0x7d0 [ 5659.429112][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5659.429114][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5659.429118][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5659.429121][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5659.429125][ C2] ? lock_acquire+0x1c1/0x220 [ 5659.429128][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5659.429132][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5659.429136][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5659.429140][ C2] ? __copy_skb_header+0xaf/0x490 [ 5659.429145][ C2] ? __skb_clone+0x57a/0x760 [ 5659.429147][ C2] netif_receive_skb+0x55/0x280 [ 5659.429150][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5659.429159][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5659.429166][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5659.429173][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5659.429177][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5659.429188][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5659.429195][ C2] ? get_stack_info+0x36/0xc0 [ 5659.429200][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5659.429203][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5659.429207][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5659.429210][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5659.429213][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5659.429215][ C2] ? kernel_text_address+0x17/0xe0 [ 5659.429219][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5659.429224][ C2] ? arch_stack_walk+0x8c/0x100 [ 5659.429227][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5659.429231][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5659.429234][ C2] ? lock_acquire+0x1c1/0x220 [ 5659.429236][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5659.429241][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5659.429245][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5659.429248][ C2] ? get_stack_info+0x36/0xc0 [ 5659.429252][ C2] __tcf_classify+0x329/0x7d0 [ 5659.429257][ C2] tcf_classify+0x283/0x930 [ 5659.429261][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5659.429264][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5659.429269][ C2] tc_run+0x2e4/0x5d0 [ 5659.429273][ C2] ? __pfx_tc_run+0x10/0x10 [ 5659.429276][ C2] ? lock_acquire+0x1c1/0x220 [ 5659.429278][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5659.429282][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5659.429286][ C2] ? lock_acquire+0x1c1/0x220 [ 5659.429289][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5659.429292][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5659.429295][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5659.429298][ C2] ? neigh_hh_output+0x348/0x590 [ 5659.429301][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5659.429305][ C2] ip_finish_output2+0x786/0x18e0 [ 5659.429308][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5659.429316][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5659.429319][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5659.429322][ C2] ? __ip_finish_output+0x10f/0x770 [ 5659.429326][ C2] ip_output+0x16b/0x4f0 [ 5659.429329][ C2] ? __pfx_ip_output+0x10/0x10 [ 5659.429332][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5659.429335][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5659.429338][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5659.429341][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5659.429344][ C2] ? __alloc_skb+0xd4/0x280 [ 5659.429346][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5659.429351][ C2] ? tcp_fragment+0x168/0x1040 [ 5659.429354][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5659.429357][ C2] ? ip_local_out+0x114/0x3b0 [ 5659.429361][ C2] __ip_queue_xmit+0x672/0x1910 [ 5659.429364][ C2] ? __skb_clone+0x57a/0x760 [ 5659.429367][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5659.429373][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5659.429376][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5659.429379][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5659.429384][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5659.429389][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5659.429392][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5659.429395][ C2] tcp_send_loss_probe+0x348/0x830 [ 5659.429398][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5659.429401][ C2] tcp_write_timer+0x82/0x1d0 [ 5659.429404][ C2] call_timer_fn+0x173/0x430 [ 5659.429409][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5659.429413][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5659.429417][ C2] __run_timers.part.0+0x52d/0x890 [ 5659.429420][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5659.429424][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5659.429427][ C2] ? lock_acquire+0x1c1/0x220 [ 5659.429430][ C2] ? clockevents_program_event+0xf6/0x300 [ 5659.429434][ C2] ? lock_release+0x1d5/0x250 [ 5659.429436][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5659.429440][ C2] ? ktime_get+0xb3/0x190 [ 5659.429444][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5659.429448][ C2] run_timer_softirq+0x72/0x100 [ 5659.429451][ C2] __do_softirq+0x1b9/0x7ff [ 5659.429456][ C2] irq_exit_rcu+0x98/0xc0 [ 5659.429458][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5659.429462][ C2] [ 5659.429463][ C2] [ 5659.429464][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5659.429467][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5659.429470][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5659.429473][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5659.429476][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5659.429477][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5659.429479][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5659.429480][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5659.429482][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5659.429485][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5659.429488][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5659.429492][ C2] default_idle_call+0x69/0xa0 [ 5659.429495][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5659.429498][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5659.429502][ C2] ? lock_release+0x1d5/0x250 [ 5659.429505][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5659.429509][ C2] do_idle+0xfb/0x160 [ 5659.429512][ C2] cpu_startup_entry+0x55/0x60 [ 5659.429514][ C2] start_secondary+0x21c/0x2b0 [ 5659.429517][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5659.429521][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5659.429527][ C2] [ 5684.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3103s! [perl:4135] [ 5684.569724][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5684.570983][ C1] irq event stamp: 209232 [ 5684.571205][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5684.571736][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5684.572219][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5684.572693][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5684.573157][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5684.573608][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5684.574222][ C1] RIP: 0010:kasan_check_range+0x66/0x1c0 [ 5684.574511][ C1] Code: 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df <4d> 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d [ 5684.575482][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 5684.575793][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5684.576196][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5684.576595][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5684.576998][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5684.577397][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5684.577797][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5684.578247][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5684.578580][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5684.578985][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5684.579386][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5684.579786][ C1] PKRU: 55555554 [ 5684.579975][ C1] Call Trace: [ 5684.580150][ C1] [ 5684.580299][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5684.580564][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5684.580810][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5684.581088][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5684.581362][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5684.581651][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5684.581927][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5684.582234][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5684.582495][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 5684.582757][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5684.583067][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5684.583363][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5684.583681][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5684.583973][ C1] ? kasan_check_range+0x66/0x1c0 [ 5684.584232][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5684.584515][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5684.584827][ C1] ? get_stack_info+0x36/0xc0 [ 5684.585069][ C1] ? lock_acquire+0x1c1/0x220 [ 5684.585311][ C1] ? lock_release+0x1d5/0x250 [ 5684.585551][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5684.585802][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5684.586075][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5684.586364][ C1] ? lock_acquire+0x1c1/0x220 [ 5684.586605][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5684.586846][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5684.587109][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5684.587346][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5684.587596][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5684.587855][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5684.588140][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5684.588420][ C1] ip_local_deliver+0x19d/0x480 [ 5684.588668][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5684.588945][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5684.589211][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5684.589561][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5684.589817][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5684.590139][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5684.590404][ C1] ip_rcv+0x564/0x740 [ 5684.590609][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5684.590847][ C1] ? set_track_prepare+0x8a/0xd0 [ 5684.591103][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5684.591382][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5684.591657][ C1] ? skb_clone+0x10b/0x330 [ 5684.591901][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5684.592226][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5684.592536][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5684.592822][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5684.593120][ C1] ? __tcf_classify+0x329/0x7d0 [ 5684.593370][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5684.593603][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5684.593906][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5684.594194][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5684.594523][ C1] ? lock_acquire+0x1c1/0x220 [ 5684.594764][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5684.595062][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5684.595351][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5684.595672][ C1] ? __copy_skb_header+0xaf/0x490 [ 5684.595935][ C1] ? __skb_clone+0x57a/0x760 [ 5684.596172][ C1] netif_receive_skb+0x55/0x280 [ 5684.596426][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5684.596742][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5684.597077][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5684.597380][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5684.597655][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5684.597948][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5684.598262][ C1] ? hlock_class+0x4e/0x130 [ 5684.598497][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5684.598775][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5684.599057][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5684.599325][ C1] ? hlock_class+0x4e/0x130 [ 5684.599564][ C1] ? mark_lock+0x38/0x3e0 [ 5684.599788][ C1] ? stack_access_ok+0xda/0x1f0 [ 5684.600039][ C1] ? __lock_acquire+0xb67/0x1610 [ 5684.600296][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5684.600572][ C1] ? get_stack_info+0x36/0xc0 [ 5684.600814][ C1] ? stack_access_ok+0xda/0x1f0 [ 5684.601062][ C1] ? get_reg+0x119/0x190 [ 5684.601279][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5684.601547][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5684.601859][ C1] __tcf_classify+0x329/0x7d0 [ 5684.602114][ C1] tcf_classify+0x283/0x930 [ 5684.602345][ C1] ? arch_stack_walk+0xa2/0x100 [ 5684.602596][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5684.602854][ C1] ? get_stack_info+0x36/0xc0 [ 5684.603097][ C1] tc_run+0x2e4/0x5d0 [ 5684.603303][ C1] ? __pfx_tc_run+0x10/0x10 [ 5684.603536][ C1] ? lock_acquire+0x1c1/0x220 [ 5684.603776][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5684.604040][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5684.604295][ C1] ? lock_acquire+0x1c1/0x220 [ 5684.604534][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5684.604803][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5684.605111][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5684.605385][ C1] ? neigh_hh_output+0x348/0x590 [ 5684.605638][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5684.605906][ C1] ip_finish_output2+0x786/0x18e0 [ 5684.606164][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5684.606446][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5684.606786][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5684.607064][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5684.607319][ C1] ? __ip_finish_output+0x10f/0x770 [ 5684.607585][ C1] ip_output+0x16b/0x4f0 [ 5684.607804][ C1] ? run_timer_softirq+0x72/0x100 [ 5684.608065][ C1] ? __pfx_ip_output+0x10/0x10 [ 5684.608310][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5684.608601][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5684.608854][ C1] ? ip_local_out+0x114/0x3b0 [ 5684.609096][ C1] __ip_queue_xmit+0x672/0x1910 [ 5684.609345][ C1] ? __create_object+0x5e/0xb0 [ 5684.609589][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5684.609860][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5684.610151][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5684.610422][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5684.610707][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5684.610981][ C1] tcp_delack_timer+0x84/0x240 [ 5684.611226][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5684.611500][ C1] call_timer_fn+0x173/0x430 [ 5684.611736][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5684.612016][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5684.612278][ C1] __run_timers.part.0+0x52d/0x890 [ 5684.612539][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5684.612813][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5684.613099][ C1] ? lock_acquire+0x1c1/0x220 [ 5684.613340][ C1] ? clockevents_program_event+0xf6/0x300 [ 5684.613634][ C1] ? lock_release+0x1d5/0x250 [ 5684.613872][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5684.614139][ C1] ? ktime_get+0xb3/0x190 [ 5684.614362][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5684.614661][ C1] run_timer_softirq+0x72/0x100 [ 5684.614909][ C1] __do_softirq+0x1b9/0x7ff [ 5684.615143][ C1] irq_exit_rcu+0x98/0xc0 [ 5684.615365][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5684.615653][ C1] [ 5684.615803][ C1] [ 5684.615956][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5684.616261][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5684.616588][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5684.617561][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5684.617869][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5684.618274][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5684.618674][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5684.619072][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5684.619472][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5684.619876][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5684.620173][ C1] pipe_read+0xa16/0xdf0 [ 5684.620397][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5684.620675][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5684.620920][ C1] ? iterate_tty_write+0x299/0x540 [ 5684.621182][ C1] ? lock_release+0x1d5/0x250 [ 5684.621425][ C1] vfs_read+0x911/0xc00 [ 5684.621640][ C1] ? lock_acquire+0x1c1/0x220 [ 5684.621890][ C1] ? __might_fault+0xc6/0x180 [ 5684.622131][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5684.622371][ C1] ? __might_fault+0xc6/0x180 [ 5684.622612][ C1] ? lock_release+0x1d5/0x250 [ 5684.622854][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5684.623119][ C1] ? __fget_light+0x54/0x1e0 [ 5684.623357][ C1] ksys_read+0x17a/0x1e0 [ 5684.623575][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5684.623820][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5684.624124][ C1] do_syscall_64+0xc9/0x1e0 [ 5684.624359][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5684.624660][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5684.624888][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5684.625859][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5684.626284][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5684.626682][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5684.627083][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5684.627484][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5684.627882][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5684.628284][ C1] [ 5684.628444][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3103s! [swapper/2:0] [ 5684.628868][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5684.630145][ C2] irq event stamp: 44114564 [ 5684.630380][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5684.630927][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5684.631446][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5684.631950][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5684.632431][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5684.632894][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5684.633508][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5684.633836][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5684.634804][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5684.635111][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5684.635507][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5684.635903][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5684.636300][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5684.636698][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5684.637093][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5684.637535][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5684.637865][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5684.638265][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5684.638660][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5684.639054][ C2] PKRU: 55555554 [ 5684.639234][ C2] Call Trace: [ 5684.639403][ C2] [ 5684.639549][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5684.639812][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5684.640054][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5684.640328][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5684.640600][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5684.640886][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5684.641149][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5684.641454][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5684.641713][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5684.641981][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5684.642289][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5684.642584][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5684.642895][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5684.643185][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5684.643478][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5684.643766][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5684.644076][ C2] ? get_stack_info+0x36/0xc0 [ 5684.644317][ C2] ? lock_acquire+0x1c1/0x220 [ 5684.644555][ C2] ? lock_release+0x1d5/0x250 [ 5684.644795][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5684.645042][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5684.645313][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5684.645597][ C2] ? lock_acquire+0x1c1/0x220 [ 5684.645833][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5684.646073][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5684.646332][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5684.646565][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5684.646812][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5684.647068][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5684.647341][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5684.647615][ C2] ip_local_deliver+0x19d/0x480 [ 5684.647861][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5684.648129][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5684.648392][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5684.648740][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5684.648993][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5684.649315][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5684.649578][ C2] ip_rcv+0x564/0x740 [ 5684.649781][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5684.650011][ C2] ? set_track_prepare+0x8a/0xd0 [ 5684.650263][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5684.650538][ C2] ? start_secondary+0x21c/0x2b0 [ 5684.650789][ C2] ? skb_clone+0x10b/0x330 [ 5684.651013][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5684.651331][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5684.651636][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5684.651929][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5684.652224][ C2] ? __tcf_classify+0x329/0x7d0 [ 5684.652472][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5684.652701][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5684.653003][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5684.653288][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5684.653613][ C2] ? lock_acquire+0x1c1/0x220 [ 5684.653848][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5684.654145][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5684.654429][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5684.654743][ C2] ? __copy_skb_header+0xaf/0x490 [ 5684.654998][ C2] ? __skb_clone+0x57a/0x760 [ 5684.655234][ C2] netif_receive_skb+0x55/0x280 [ 5684.655482][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5684.655795][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5684.656125][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5684.656421][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5684.656695][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5684.656981][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5684.657292][ C2] ? get_stack_info+0x36/0xc0 [ 5684.657534][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5684.657797][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5684.658112][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5684.658387][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5684.658661][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5684.658975][ C2] ? kernel_text_address+0x17/0xe0 [ 5684.659234][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5684.659546][ C2] ? arch_stack_walk+0x8c/0x100 [ 5684.659793][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5684.660054][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5684.660339][ C2] ? lock_acquire+0x1c1/0x220 [ 5684.660575][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5684.660856][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5684.661161][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5684.661436][ C2] ? get_stack_info+0x36/0xc0 [ 5684.661676][ C2] __tcf_classify+0x329/0x7d0 [ 5684.661921][ C2] tcf_classify+0x283/0x930 [ 5684.662154][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5684.662408][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5684.662719][ C2] tc_run+0x2e4/0x5d0 [ 5684.662922][ C2] ? __pfx_tc_run+0x10/0x10 [ 5684.663153][ C2] ? lock_acquire+0x1c1/0x220 [ 5684.663389][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5684.663649][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5684.663900][ C2] ? lock_acquire+0x1c1/0x220 [ 5684.664137][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5684.664399][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5684.664702][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5684.664971][ C2] ? neigh_hh_output+0x348/0x590 [ 5684.665223][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5684.665485][ C2] ip_finish_output2+0x786/0x18e0 [ 5684.665740][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5684.666077][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5684.666351][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5684.666604][ C2] ? __ip_finish_output+0x10f/0x770 [ 5684.666866][ C2] ip_output+0x16b/0x4f0 [ 5684.667081][ C2] ? __pfx_ip_output+0x10/0x10 [ 5684.667323][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5684.667599][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5684.667908][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5684.668186][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5684.668436][ C2] ? __alloc_skb+0xd4/0x280 [ 5684.668664][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5684.668931][ C2] ? tcp_fragment+0x168/0x1040 [ 5684.669174][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5684.669424][ C2] ? ip_local_out+0x114/0x3b0 [ 5684.669663][ C2] __ip_queue_xmit+0x672/0x1910 [ 5684.669911][ C2] ? __skb_clone+0x57a/0x760 [ 5684.670144][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5684.670411][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5684.670689][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5684.670934][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5684.671183][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5684.671481][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5684.671799][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5684.672050][ C2] tcp_send_loss_probe+0x348/0x830 [ 5684.672308][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5684.672573][ C2] tcp_write_timer+0x82/0x1d0 [ 5684.672814][ C2] call_timer_fn+0x173/0x430 [ 5684.673052][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5684.673313][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5684.673573][ C2] __run_timers.part.0+0x52d/0x890 [ 5684.673833][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5684.674100][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5684.674385][ C2] ? lock_acquire+0x1c1/0x220 [ 5684.674621][ C2] ? clockevents_program_event+0xf6/0x300 [ 5684.674912][ C2] ? lock_release+0x1d5/0x250 [ 5684.675150][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5684.675413][ C2] ? ktime_get+0xb3/0x190 [ 5684.675632][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5684.675929][ C2] run_timer_softirq+0x72/0x100 [ 5684.676176][ C2] __do_softirq+0x1b9/0x7ff [ 5684.676406][ C2] irq_exit_rcu+0x98/0xc0 [ 5684.676626][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5684.676908][ C2] [ 5684.677059][ C2] [ 5684.677208][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5684.677512][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5684.677767][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5684.678728][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5684.679035][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5684.679432][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5684.679827][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5684.680221][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5684.680619][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5684.681017][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5684.681303][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5684.681563][ C2] default_idle_call+0x69/0xa0 [ 5684.681805][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5684.682063][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5684.682339][ C2] ? lock_release+0x1d5/0x250 [ 5684.682577][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5684.682850][ C2] do_idle+0xfb/0x160 [ 5684.683054][ C2] cpu_startup_entry+0x55/0x60 [ 5684.683295][ C2] start_secondary+0x21c/0x2b0 [ 5684.683535][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5684.683803][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5684.684111][ C2] [ 5712.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3129s! [perl:4135] [ 5712.569712][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5712.570970][ C1] irq event stamp: 209232 [ 5712.571191][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5712.571720][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5712.572200][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5712.572670][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5712.573132][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5712.573581][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5712.574195][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5712.574520][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5712.575494][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5712.575801][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5712.576202][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5712.576601][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5712.576998][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5712.577400][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5712.577801][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5712.578249][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5712.578582][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5712.578983][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5712.579386][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5712.579786][ C1] PKRU: 55555554 [ 5712.579968][ C1] Call Trace: [ 5712.580137][ C1] [ 5712.580292][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5712.580553][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5712.580796][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5712.581072][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5712.581344][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5712.581633][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5712.581901][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5712.582206][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5712.582469][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5712.582777][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5712.583077][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5712.583392][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5712.583680][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5712.583977][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5712.584265][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5712.584575][ C1] ? get_stack_info+0x36/0xc0 [ 5712.584817][ C1] ? lock_acquire+0x1c1/0x220 [ 5712.585057][ C1] ? lock_release+0x1d5/0x250 [ 5712.585301][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5712.585549][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5712.585821][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5712.586105][ C1] ? lock_acquire+0x1c1/0x220 [ 5712.586344][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5712.586585][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5712.586846][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5712.587079][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5712.587329][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5712.587587][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5712.587868][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5712.588147][ C1] ip_local_deliver+0x19d/0x480 [ 5712.588395][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5712.588667][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5712.588931][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5712.589278][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5712.589533][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5712.589854][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5712.590119][ C1] ip_rcv+0x564/0x740 [ 5712.590326][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5712.590556][ C1] ? set_track_prepare+0x8a/0xd0 [ 5712.590810][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5712.591087][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5712.591362][ C1] ? skb_clone+0x10b/0x330 [ 5712.591589][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5712.591913][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5712.592220][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5712.592501][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5712.592800][ C1] ? __tcf_classify+0x329/0x7d0 [ 5712.593050][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5712.593279][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5712.593581][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5712.593869][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5712.594196][ C1] ? lock_acquire+0x1c1/0x220 [ 5712.594436][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5712.594735][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5712.595020][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5712.595340][ C1] ? __copy_skb_header+0xaf/0x490 [ 5712.595598][ C1] ? __skb_clone+0x57a/0x760 [ 5712.595835][ C1] netif_receive_skb+0x55/0x280 [ 5712.596086][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5712.596401][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5712.596736][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5712.597034][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5712.597313][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5712.597602][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5712.597917][ C1] ? hlock_class+0x4e/0x130 [ 5712.598149][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5712.598429][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5712.598705][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5712.598969][ C1] ? hlock_class+0x4e/0x130 [ 5712.599203][ C1] ? mark_lock+0x38/0x3e0 [ 5712.599423][ C1] ? stack_access_ok+0xda/0x1f0 [ 5712.599674][ C1] ? __lock_acquire+0xb67/0x1610 [ 5712.599929][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5712.600207][ C1] ? get_stack_info+0x36/0xc0 [ 5712.600449][ C1] ? stack_access_ok+0xda/0x1f0 [ 5712.600697][ C1] ? get_reg+0x119/0x190 [ 5712.600915][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5712.601186][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5712.601494][ C1] __tcf_classify+0x329/0x7d0 [ 5712.601739][ C1] tcf_classify+0x283/0x930 [ 5712.601976][ C1] ? arch_stack_walk+0xa2/0x100 [ 5712.602227][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5712.602484][ C1] ? get_stack_info+0x36/0xc0 [ 5712.602724][ C1] tc_run+0x2e4/0x5d0 [ 5712.602932][ C1] ? __pfx_tc_run+0x10/0x10 [ 5712.603163][ C1] ? lock_acquire+0x1c1/0x220 [ 5712.603402][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5712.603664][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5712.603919][ C1] ? lock_acquire+0x1c1/0x220 [ 5712.604160][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5712.604426][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5712.604732][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5712.605005][ C1] ? neigh_hh_output+0x348/0x590 [ 5712.605259][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5712.605525][ C1] ip_finish_output2+0x786/0x18e0 [ 5712.605783][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5712.606062][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5712.606400][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5712.606679][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5712.606933][ C1] ? __ip_finish_output+0x10f/0x770 [ 5712.607199][ C1] ip_output+0x16b/0x4f0 [ 5712.607417][ C1] ? run_timer_softirq+0x72/0x100 [ 5712.607675][ C1] ? __pfx_ip_output+0x10/0x10 [ 5712.607920][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5712.608206][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5712.608459][ C1] ? ip_local_out+0x114/0x3b0 [ 5712.608702][ C1] __ip_queue_xmit+0x672/0x1910 [ 5712.608952][ C1] ? __create_object+0x5e/0xb0 [ 5712.609199][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5712.609467][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5712.609749][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5712.610025][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5712.610312][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5712.610585][ C1] tcp_delack_timer+0x84/0x240 [ 5712.610830][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5712.611102][ C1] call_timer_fn+0x173/0x430 [ 5712.611340][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5712.611604][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5712.611874][ C1] __run_timers.part.0+0x52d/0x890 [ 5712.612136][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5712.612411][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5712.612699][ C1] ? lock_acquire+0x1c1/0x220 [ 5712.612938][ C1] ? clockevents_program_event+0xf6/0x300 [ 5712.613233][ C1] ? lock_release+0x1d5/0x250 [ 5712.613475][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5712.613741][ C1] ? ktime_get+0xb3/0x190 [ 5712.613961][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5712.614261][ C1] run_timer_softirq+0x72/0x100 [ 5712.614512][ C1] __do_softirq+0x1b9/0x7ff [ 5712.614746][ C1] irq_exit_rcu+0x98/0xc0 [ 5712.614968][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5712.615254][ C1] [ 5712.615407][ C1] [ 5712.615558][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5712.615863][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5712.616190][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5712.617166][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5712.617477][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5712.617878][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5712.618277][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5712.618679][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5712.619080][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5712.619483][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5712.619782][ C1] pipe_read+0xa16/0xdf0 [ 5712.620003][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5712.620282][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5712.620527][ C1] ? iterate_tty_write+0x299/0x540 [ 5712.620788][ C1] ? lock_release+0x1d5/0x250 [ 5712.621031][ C1] vfs_read+0x911/0xc00 [ 5712.621244][ C1] ? lock_acquire+0x1c1/0x220 [ 5712.621484][ C1] ? __might_fault+0xc6/0x180 [ 5712.621725][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5712.621968][ C1] ? __might_fault+0xc6/0x180 [ 5712.622208][ C1] ? lock_release+0x1d5/0x250 [ 5712.622449][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5712.622714][ C1] ? __fget_light+0x54/0x1e0 [ 5712.622953][ C1] ksys_read+0x17a/0x1e0 [ 5712.623170][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5712.623415][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5712.623721][ C1] do_syscall_64+0xc9/0x1e0 [ 5712.623954][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5712.624256][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5712.624484][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5712.625456][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5712.625876][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5712.626282][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5712.626682][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5712.627081][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5712.627480][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5712.627886][ C1] [ 5712.628043][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3129s! [swapper/2:0] [ 5712.628470][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5712.629715][ C2] irq event stamp: 44114564 [ 5712.629941][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5712.630473][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5712.630982][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5712.631456][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5712.631924][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5712.632375][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5712.632981][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5712.633304][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5712.634267][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5712.634572][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5712.634968][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5712.635364][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5712.635761][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5712.636158][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5712.636554][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5712.636998][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5712.637331][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5712.637732][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5712.638130][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5712.638528][ C2] PKRU: 55555554 [ 5712.638709][ C2] Call Trace: [ 5712.638880][ C2] [ 5712.639027][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5712.639289][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5712.639532][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5712.639807][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5712.640078][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5712.640367][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5712.640631][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5712.640937][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5712.641198][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5712.641460][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5712.641774][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5712.642068][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5712.642382][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5712.642674][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5712.642967][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5712.643257][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5712.643569][ C2] ? get_stack_info+0x36/0xc0 [ 5712.643808][ C2] ? lock_acquire+0x1c1/0x220 [ 5712.644047][ C2] ? lock_release+0x1d5/0x250 [ 5712.644287][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5712.644535][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5712.644806][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5712.645091][ C2] ? lock_acquire+0x1c1/0x220 [ 5712.645328][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5712.645569][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5712.645828][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5712.646062][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5712.646308][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5712.646564][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5712.646838][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5712.647115][ C2] ip_local_deliver+0x19d/0x480 [ 5712.647362][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5712.647632][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5712.647894][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5712.648243][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5712.648495][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5712.648814][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5712.649075][ C2] ip_rcv+0x564/0x740 [ 5712.649279][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5712.649508][ C2] ? set_track_prepare+0x8a/0xd0 [ 5712.649760][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5712.650036][ C2] ? start_secondary+0x21c/0x2b0 [ 5712.650287][ C2] ? skb_clone+0x10b/0x330 [ 5712.650513][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5712.650830][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5712.651135][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5712.651414][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5712.651709][ C2] ? __tcf_classify+0x329/0x7d0 [ 5712.651962][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5712.652189][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5712.652489][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5712.652773][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5712.653097][ C2] ? lock_acquire+0x1c1/0x220 [ 5712.653334][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5712.653634][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5712.653916][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5712.654232][ C2] ? __copy_skb_header+0xaf/0x490 [ 5712.654491][ C2] ? __skb_clone+0x57a/0x760 [ 5712.654727][ C2] netif_receive_skb+0x55/0x280 [ 5712.654975][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5712.655286][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5712.655616][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5712.655912][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5712.656189][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5712.656475][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5712.656787][ C2] ? get_stack_info+0x36/0xc0 [ 5712.657028][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5712.657295][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5712.657610][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5712.657885][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5712.658159][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5712.658472][ C2] ? kernel_text_address+0x17/0xe0 [ 5712.658729][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5712.659039][ C2] ? arch_stack_walk+0x8c/0x100 [ 5712.659287][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5712.659549][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5712.659833][ C2] ? lock_acquire+0x1c1/0x220 [ 5712.660068][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5712.660349][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5712.660650][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5712.660928][ C2] ? get_stack_info+0x36/0xc0 [ 5712.661167][ C2] __tcf_classify+0x329/0x7d0 [ 5712.661406][ C2] tcf_classify+0x283/0x930 [ 5712.661639][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5712.661897][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5712.662209][ C2] tc_run+0x2e4/0x5d0 [ 5712.662411][ C2] ? __pfx_tc_run+0x10/0x10 [ 5712.662641][ C2] ? lock_acquire+0x1c1/0x220 [ 5712.662876][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5712.663135][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5712.663387][ C2] ? lock_acquire+0x1c1/0x220 [ 5712.663625][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5712.663890][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5712.664192][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5712.664462][ C2] ? neigh_hh_output+0x348/0x590 [ 5712.664712][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5712.664974][ C2] ip_finish_output2+0x786/0x18e0 [ 5712.665229][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5712.665564][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5712.665840][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5712.666092][ C2] ? __ip_finish_output+0x10f/0x770 [ 5712.666355][ C2] ip_output+0x16b/0x4f0 [ 5712.666570][ C2] ? __pfx_ip_output+0x10/0x10 [ 5712.666811][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5712.667085][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5712.667396][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5712.667670][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5712.667919][ C2] ? __alloc_skb+0xd4/0x280 [ 5712.668148][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5712.668415][ C2] ? tcp_fragment+0x168/0x1040 [ 5712.668657][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5712.668907][ C2] ? ip_local_out+0x114/0x3b0 [ 5712.669147][ C2] __ip_queue_xmit+0x672/0x1910 [ 5712.669393][ C2] ? __skb_clone+0x57a/0x760 [ 5712.669623][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5712.669888][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5712.670169][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5712.670412][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5712.670662][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5712.670960][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5712.671276][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5712.671518][ C2] tcp_send_loss_probe+0x348/0x830 [ 5712.671781][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5712.672046][ C2] tcp_write_timer+0x82/0x1d0 [ 5712.672284][ C2] call_timer_fn+0x173/0x430 [ 5712.672519][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5712.672778][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5712.673038][ C2] __run_timers.part.0+0x52d/0x890 [ 5712.673297][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5712.673565][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5712.673847][ C2] ? lock_acquire+0x1c1/0x220 [ 5712.674084][ C2] ? clockevents_program_event+0xf6/0x300 [ 5712.674373][ C2] ? lock_release+0x1d5/0x250 [ 5712.674609][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5712.674872][ C2] ? ktime_get+0xb3/0x190 [ 5712.675090][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5712.675385][ C2] run_timer_softirq+0x72/0x100 [ 5712.675632][ C2] __do_softirq+0x1b9/0x7ff [ 5712.675861][ C2] irq_exit_rcu+0x98/0xc0 [ 5712.676080][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5712.676364][ C2] [ 5712.676513][ C2] [ 5712.676663][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5712.676966][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5712.677221][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5712.678181][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5712.678486][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5712.678881][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5712.679277][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5712.679672][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5712.680066][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5712.680464][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5712.680749][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5712.681007][ C2] default_idle_call+0x69/0xa0 [ 5712.681249][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5712.681498][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5712.681774][ C2] ? lock_release+0x1d5/0x250 [ 5712.682012][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5712.682282][ C2] do_idle+0xfb/0x160 [ 5712.682488][ C2] cpu_startup_entry+0x55/0x60 [ 5712.682727][ C2] start_secondary+0x21c/0x2b0 [ 5712.682970][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5712.683236][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5712.683545][ C2] [ 5737.428102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5737.428445][ C1] rcu: 1-....: (3374060 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=826168 [ 5737.428983][ C1] rcu: (t=3382541 jiffies g=1882453 q=712 ncpus=4) [ 5737.429305][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5737.429740][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5737.430336][ C1] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 5737.430614][ C1] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 5737.431555][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000202 [ 5737.431876][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 5737.432276][ C1] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5737.432673][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 5737.433074][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5737.433460][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5737.433848][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5737.434283][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5737.434606][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5737.434995][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5737.435382][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5737.435770][ C1] PKRU: 55555554 [ 5737.435946][ C1] Call Trace: [ 5737.436110][ C1] [ 5737.436254][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5737.436519][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5737.436765][ C1] ? check_cpu_stall+0x284/0x500 [ 5737.437010][ C1] ? rcu_pending+0x92/0x360 [ 5737.437233][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5737.437495][ C1] ? update_process_times+0xb9/0x110 [ 5737.437761][ C1] ? tick_sched_handle+0x67/0x130 [ 5737.438010][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5737.438286][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5737.438523][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5737.438826][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5737.439091][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5737.439371][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5737.439630][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5737.439925][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5737.440178][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 5737.440433][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5737.440734][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5737.441027][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5737.441333][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5737.441614][ C1] ? kasan_check_range+0x84/0x1c0 [ 5737.441888][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5737.442168][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5737.442478][ C1] ? get_stack_info+0x36/0xc0 [ 5737.442717][ C1] ? lock_acquire+0x1c1/0x220 [ 5737.442965][ C1] ? lock_release+0x1d5/0x250 [ 5737.443199][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5737.443441][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5737.443705][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5737.443981][ C1] ? lock_acquire+0x1c1/0x220 [ 5737.444214][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5737.444448][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5737.444701][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5737.444929][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5737.445167][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5737.445419][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5737.445688][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5737.445956][ C1] ip_local_deliver+0x19d/0x480 [ 5737.446197][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5737.446464][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5737.446720][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5737.447061][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5737.447307][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5737.447619][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5737.447876][ C1] ip_rcv+0x564/0x740 [ 5737.448076][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5737.448300][ C1] ? set_track_prepare+0x8a/0xd0 [ 5737.448548][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5737.448820][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5737.449087][ C1] ? skb_clone+0x10b/0x330 [ 5737.449308][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5737.449620][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5737.449920][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5737.450196][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5737.450485][ C1] ? __tcf_classify+0x329/0x7d0 [ 5737.450730][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5737.450954][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5737.451247][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5737.451526][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5737.451868][ C1] ? lock_acquire+0x1c1/0x220 [ 5737.452105][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5737.452405][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5737.452692][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5737.453017][ C1] ? __copy_skb_header+0xaf/0x490 [ 5737.453268][ C1] ? __skb_clone+0x57a/0x760 [ 5737.453499][ C1] netif_receive_skb+0x55/0x280 [ 5737.453743][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5737.454049][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5737.454373][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5737.454664][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5737.454933][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5737.455215][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5737.455520][ C1] ? hlock_class+0x4e/0x130 [ 5737.455748][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5737.456018][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5737.456287][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5737.456544][ C1] ? hlock_class+0x4e/0x130 [ 5737.456772][ C1] ? mark_lock+0x38/0x3e0 [ 5737.456985][ C1] ? stack_access_ok+0xda/0x1f0 [ 5737.457229][ C1] ? __lock_acquire+0xb67/0x1610 [ 5737.457477][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5737.457747][ C1] ? get_stack_info+0x36/0xc0 [ 5737.457981][ C1] ? stack_access_ok+0xda/0x1f0 [ 5737.458222][ C1] ? get_reg+0x119/0x190 [ 5737.458434][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5737.458696][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5737.458997][ C1] __tcf_classify+0x329/0x7d0 [ 5737.459232][ C1] tcf_classify+0x283/0x930 [ 5737.459459][ C1] ? arch_stack_walk+0xa2/0x100 [ 5737.459703][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5737.459953][ C1] ? get_stack_info+0x36/0xc0 [ 5737.460188][ C1] tc_run+0x2e4/0x5d0 [ 5737.460389][ C1] ? __pfx_tc_run+0x10/0x10 [ 5737.460612][ C1] ? lock_acquire+0x1c1/0x220 [ 5737.460846][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5737.461101][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5737.461349][ C1] ? lock_acquire+0x1c1/0x220 [ 5737.461582][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5737.461864][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5737.462171][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5737.462444][ C1] ? neigh_hh_output+0x348/0x590 [ 5737.462697][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5737.462970][ C1] ip_finish_output2+0x786/0x18e0 [ 5737.463220][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5737.463490][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5737.463820][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5737.464090][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5737.464337][ C1] ? __ip_finish_output+0x10f/0x770 [ 5737.464596][ C1] ip_output+0x16b/0x4f0 [ 5737.464805][ C1] ? run_timer_softirq+0x72/0x100 [ 5737.465054][ C1] ? __pfx_ip_output+0x10/0x10 [ 5737.465293][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5737.465572][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5737.465817][ C1] ? ip_local_out+0x114/0x3b0 [ 5737.466052][ C1] __ip_queue_xmit+0x672/0x1910 [ 5737.466295][ C1] ? __create_object+0x5e/0xb0 [ 5737.466533][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5737.466793][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5737.467067][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5737.467335][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5737.467610][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5737.467874][ C1] tcp_delack_timer+0x84/0x240 [ 5737.468112][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5737.468377][ C1] call_timer_fn+0x173/0x430 [ 5737.468609][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5737.468864][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5737.469119][ C1] __run_timers.part.0+0x52d/0x890 [ 5737.469373][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5737.469640][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5737.469920][ C1] ? lock_acquire+0x1c1/0x220 [ 5737.470153][ C1] ? clockevents_program_event+0xf6/0x300 [ 5737.470436][ C1] ? lock_release+0x1d5/0x250 [ 5737.470670][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5737.470927][ C1] ? ktime_get+0xb3/0x190 [ 5737.471143][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5737.471433][ C1] run_timer_softirq+0x72/0x100 [ 5737.471696][ C1] __do_softirq+0x1b9/0x7ff [ 5737.471930][ C1] irq_exit_rcu+0x98/0xc0 [ 5737.472150][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5737.472436][ C1] [ 5737.472588][ C1] [ 5737.472738][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5737.473051][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5737.473368][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5737.474318][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5737.474619][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5737.475009][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5737.475401][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5737.475798][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5737.476188][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5737.476581][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5737.476872][ C1] pipe_read+0xa16/0xdf0 [ 5737.477085][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5737.477358][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5737.477594][ C1] ? iterate_tty_write+0x299/0x540 [ 5737.477851][ C1] ? lock_release+0x1d5/0x250 [ 5737.478086][ C1] vfs_read+0x911/0xc00 [ 5737.478295][ C1] ? lock_acquire+0x1c1/0x220 [ 5737.478528][ C1] ? __might_fault+0xc6/0x180 [ 5737.478763][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5737.478998][ C1] ? __might_fault+0xc6/0x180 [ 5737.479232][ C1] ? lock_release+0x1d5/0x250 [ 5737.479465][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5737.479723][ C1] ? __fget_light+0x54/0x1e0 [ 5737.479956][ C1] ksys_read+0x17a/0x1e0 [ 5737.480168][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5737.480407][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5737.480706][ C1] do_syscall_64+0xc9/0x1e0 [ 5737.480934][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5737.481226][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5737.481449][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5737.482434][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5737.482858][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5737.483260][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5737.483650][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5737.484039][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5737.484432][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5737.484827][ C1] [ 5737.484979][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5737.485246][ C2] NMI backtrace for cpu 2 [ 5737.485251][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5737.485257][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5737.485261][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5737.485268][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5737.485274][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5737.485278][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5737.485282][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5737.485284][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5737.485286][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5737.485287][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5737.485289][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5737.485291][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5737.485294][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5737.485296][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5737.485297][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5737.485299][ C2] PKRU: 55555554 [ 5737.485300][ C2] Call Trace: [ 5737.485302][ C2] [ 5737.485304][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5737.485310][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5737.485313][ C2] ? nmi_handle+0x153/0x420 [ 5737.485318][ C2] ? default_do_nmi+0x41/0x100 [ 5737.485320][ C2] ? exc_nmi+0xf3/0x120 [ 5737.485323][ C2] ? end_repeat_nmi+0xf/0x60 [ 5737.485328][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5737.485331][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5737.485334][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5737.485337][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5737.485340][ C2] [ 5737.485341][ C2] [ 5737.485342][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5737.485345][ C2] ? get_stack_info+0x36/0xc0 [ 5737.485349][ C2] ? lock_acquire+0x1c1/0x220 [ 5737.485352][ C2] ? lock_release+0x1d5/0x250 [ 5737.485355][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5737.485358][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5737.485361][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5737.485364][ C2] ? lock_acquire+0x1c1/0x220 [ 5737.485366][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5737.485370][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5737.485372][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5737.485378][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5737.485381][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5737.485385][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5737.485390][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5737.485393][ C2] ip_local_deliver+0x19d/0x480 [ 5737.485395][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5737.485397][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5737.485400][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5737.485405][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5737.485408][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5737.485411][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5737.485420][ C2] ip_rcv+0x564/0x740 [ 5737.485422][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5737.485425][ C2] ? set_track_prepare+0x8a/0xd0 [ 5737.485428][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5737.485432][ C2] ? start_secondary+0x21c/0x2b0 [ 5737.485434][ C2] ? skb_clone+0x10b/0x330 [ 5737.485437][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5737.485443][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5737.485448][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5737.485451][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5737.485459][ C2] ? __tcf_classify+0x329/0x7d0 [ 5737.485463][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5737.485465][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5737.485468][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5737.485471][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5737.485476][ C2] ? lock_acquire+0x1c1/0x220 [ 5737.485478][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5737.485482][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5737.485486][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5737.485489][ C2] ? __copy_skb_header+0xaf/0x490 [ 5737.485494][ C2] ? __skb_clone+0x57a/0x760 [ 5737.485496][ C2] netif_receive_skb+0x55/0x280 [ 5737.485499][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5737.485505][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5737.485512][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5737.485518][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5737.485522][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5737.485532][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5737.485539][ C2] ? get_stack_info+0x36/0xc0 [ 5737.485544][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5737.485547][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5737.485550][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5737.485552][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5737.485556][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5737.485558][ C2] ? kernel_text_address+0x17/0xe0 [ 5737.485561][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5737.485565][ C2] ? arch_stack_walk+0x8c/0x100 [ 5737.485568][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5737.485571][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5737.485575][ C2] ? lock_acquire+0x1c1/0x220 [ 5737.485577][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5737.485581][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5737.485585][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5737.485587][ C2] ? get_stack_info+0x36/0xc0 [ 5737.485592][ C2] __tcf_classify+0x329/0x7d0 [ 5737.485596][ C2] tcf_classify+0x283/0x930 [ 5737.485601][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5737.485604][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5737.485608][ C2] tc_run+0x2e4/0x5d0 [ 5737.485612][ C2] ? __pfx_tc_run+0x10/0x10 [ 5737.485615][ C2] ? lock_acquire+0x1c1/0x220 [ 5737.485617][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5737.485621][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5737.485625][ C2] ? lock_acquire+0x1c1/0x220 [ 5737.485627][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5737.485630][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5737.485633][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5737.485635][ C2] ? neigh_hh_output+0x348/0x590 [ 5737.485639][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5737.485642][ C2] ip_finish_output2+0x786/0x18e0 [ 5737.485646][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5737.485653][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5737.485656][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5737.485659][ C2] ? __ip_finish_output+0x10f/0x770 [ 5737.485663][ C2] ip_output+0x16b/0x4f0 [ 5737.485666][ C2] ? __pfx_ip_output+0x10/0x10 [ 5737.485668][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5737.485671][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5737.485674][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5737.485677][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5737.485679][ C2] ? __alloc_skb+0xd4/0x280 [ 5737.485682][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5737.485686][ C2] ? tcp_fragment+0x168/0x1040 [ 5737.485689][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5737.485692][ C2] ? ip_local_out+0x114/0x3b0 [ 5737.485695][ C2] __ip_queue_xmit+0x672/0x1910 [ 5737.485698][ C2] ? __skb_clone+0x57a/0x760 [ 5737.485701][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5737.485706][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5737.485709][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5737.485712][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5737.485716][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5737.485720][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5737.485723][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5737.485727][ C2] tcp_send_loss_probe+0x348/0x830 [ 5737.485730][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5737.485732][ C2] tcp_write_timer+0x82/0x1d0 [ 5737.485735][ C2] call_timer_fn+0x173/0x430 [ 5737.485739][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5737.485744][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5737.485748][ C2] __run_timers.part.0+0x52d/0x890 [ 5737.485750][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5737.485754][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5737.485757][ C2] ? lock_acquire+0x1c1/0x220 [ 5737.485759][ C2] ? clockevents_program_event+0xf6/0x300 [ 5737.485764][ C2] ? lock_release+0x1d5/0x250 [ 5737.485766][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5737.485769][ C2] ? ktime_get+0xb3/0x190 [ 5737.485772][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5737.485777][ C2] run_timer_softirq+0x72/0x100 [ 5737.485780][ C2] __do_softirq+0x1b9/0x7ff [ 5737.485784][ C2] irq_exit_rcu+0x98/0xc0 [ 5737.485787][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5737.485789][ C2] [ 5737.485790][ C2] [ 5737.485791][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5737.485794][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5737.485797][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5737.485799][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5737.485801][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5737.485803][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5737.485804][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5737.485806][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5737.485807][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5737.485810][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5737.485813][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5737.485816][ C2] default_idle_call+0x69/0xa0 [ 5737.485819][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5737.485821][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5737.485824][ C2] ? lock_release+0x1d5/0x250 [ 5737.485827][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5737.485830][ C2] do_idle+0xfb/0x160 [ 5737.485833][ C2] cpu_startup_entry+0x55/0x60 [ 5737.485835][ C2] start_secondary+0x21c/0x2b0 [ 5737.485837][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5737.485841][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5737.485847][ C2] [ 5764.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3177s! [perl:4135] [ 5764.569691][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5764.570912][ C1] irq event stamp: 209232 [ 5764.571123][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5764.571659][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5764.572138][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5764.572606][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5764.573071][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5764.573505][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5764.574102][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5764.574419][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5764.575360][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5764.575660][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5764.576047][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5764.576435][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5764.576824][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5764.577212][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5764.577599][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5764.578034][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5764.578357][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5764.578747][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5764.579136][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5764.579524][ C1] PKRU: 55555554 [ 5764.579701][ C1] Call Trace: [ 5764.579867][ C1] [ 5764.580010][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5764.580265][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5764.580503][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5764.580771][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5764.581035][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5764.581317][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5764.581595][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5764.581901][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5764.582163][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5764.582472][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5764.582775][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5764.583080][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5764.583363][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5764.583649][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5764.583931][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5764.584234][ C1] ? get_stack_info+0x36/0xc0 [ 5764.584467][ C1] ? lock_acquire+0x1c1/0x220 [ 5764.584702][ C1] ? lock_release+0x1d5/0x250 [ 5764.584937][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5764.585179][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5764.585443][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5764.585720][ C1] ? lock_acquire+0x1c1/0x220 [ 5764.585952][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5764.586187][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5764.586440][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5764.586669][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5764.586909][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5764.587160][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5764.587431][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5764.587699][ C1] ip_local_deliver+0x19d/0x480 [ 5764.587940][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5764.588204][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5764.588460][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5764.588799][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5764.589046][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5764.589357][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5764.589613][ C1] ip_rcv+0x564/0x740 [ 5764.589812][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5764.590035][ C1] ? set_track_prepare+0x8a/0xd0 [ 5764.590282][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5764.590553][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5764.590817][ C1] ? skb_clone+0x10b/0x330 [ 5764.591039][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5764.591349][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5764.591669][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5764.591950][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5764.592245][ C1] ? __tcf_classify+0x329/0x7d0 [ 5764.592494][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5764.592736][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5764.593025][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5764.593305][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5764.593622][ C1] ? lock_acquire+0x1c1/0x220 [ 5764.593853][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5764.594142][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5764.594421][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5764.594728][ C1] ? __copy_skb_header+0xaf/0x490 [ 5764.594979][ C1] ? __skb_clone+0x57a/0x760 [ 5764.595208][ C1] netif_receive_skb+0x55/0x280 [ 5764.595449][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5764.595753][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5764.596076][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5764.596368][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5764.596635][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5764.596914][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5764.597218][ C1] ? hlock_class+0x4e/0x130 [ 5764.597446][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5764.597714][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5764.597981][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5764.598238][ C1] ? hlock_class+0x4e/0x130 [ 5764.598463][ C1] ? mark_lock+0x38/0x3e0 [ 5764.598677][ C1] ? stack_access_ok+0xda/0x1f0 [ 5764.598917][ C1] ? __lock_acquire+0xb67/0x1610 [ 5764.599165][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5764.599435][ C1] ? get_stack_info+0x36/0xc0 [ 5764.599666][ C1] ? stack_access_ok+0xda/0x1f0 [ 5764.599907][ C1] ? get_reg+0x119/0x190 [ 5764.600118][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5764.600379][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5764.600680][ C1] __tcf_classify+0x329/0x7d0 [ 5764.600914][ C1] tcf_classify+0x283/0x930 [ 5764.601141][ C1] ? arch_stack_walk+0xa2/0x100 [ 5764.601383][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5764.601656][ C1] ? get_stack_info+0x36/0xc0 [ 5764.601897][ C1] tc_run+0x2e4/0x5d0 [ 5764.602102][ C1] ? __pfx_tc_run+0x10/0x10 [ 5764.602333][ C1] ? lock_acquire+0x1c1/0x220 [ 5764.602571][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5764.602842][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5764.603088][ C1] ? lock_acquire+0x1c1/0x220 [ 5764.603320][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5764.603577][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5764.603874][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5764.604139][ C1] ? neigh_hh_output+0x348/0x590 [ 5764.604387][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5764.604644][ C1] ip_finish_output2+0x786/0x18e0 [ 5764.604893][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5764.605164][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5764.605494][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5764.605763][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5764.606008][ C1] ? __ip_finish_output+0x10f/0x770 [ 5764.606266][ C1] ip_output+0x16b/0x4f0 [ 5764.606476][ C1] ? run_timer_softirq+0x72/0x100 [ 5764.606726][ C1] ? __pfx_ip_output+0x10/0x10 [ 5764.606963][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5764.607243][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5764.607487][ C1] ? ip_local_out+0x114/0x3b0 [ 5764.607720][ C1] __ip_queue_xmit+0x672/0x1910 [ 5764.607961][ C1] ? __create_object+0x5e/0xb0 [ 5764.608199][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5764.608458][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5764.608732][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5764.608999][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5764.609272][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5764.609536][ C1] tcp_delack_timer+0x84/0x240 [ 5764.609774][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5764.610038][ C1] call_timer_fn+0x173/0x430 [ 5764.610268][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5764.610521][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5764.610775][ C1] __run_timers.part.0+0x52d/0x890 [ 5764.611028][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5764.611296][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5764.611594][ C1] ? lock_acquire+0x1c1/0x220 [ 5764.611833][ C1] ? clockevents_program_event+0xf6/0x300 [ 5764.612123][ C1] ? lock_release+0x1d5/0x250 [ 5764.612362][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5764.612626][ C1] ? ktime_get+0xb3/0x190 [ 5764.612855][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5764.613142][ C1] run_timer_softirq+0x72/0x100 [ 5764.613384][ C1] __do_softirq+0x1b9/0x7ff [ 5764.613611][ C1] irq_exit_rcu+0x98/0xc0 [ 5764.613824][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5764.614102][ C1] [ 5764.614249][ C1] [ 5764.614395][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5764.614691][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5764.615007][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5764.615949][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5764.616250][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5764.616637][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5764.617026][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5764.617415][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5764.617802][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5764.618191][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5764.618481][ C1] pipe_read+0xa16/0xdf0 [ 5764.618694][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5764.618967][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5764.619203][ C1] ? iterate_tty_write+0x299/0x540 [ 5764.619458][ C1] ? lock_release+0x1d5/0x250 [ 5764.619691][ C1] vfs_read+0x911/0xc00 [ 5764.619905][ C1] ? lock_acquire+0x1c1/0x220 [ 5764.620136][ C1] ? __might_fault+0xc6/0x180 [ 5764.620372][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5764.620607][ C1] ? __might_fault+0xc6/0x180 [ 5764.620841][ C1] ? lock_release+0x1d5/0x250 [ 5764.621073][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5764.621331][ C1] ? __fget_light+0x54/0x1e0 [ 5764.621583][ C1] ksys_read+0x17a/0x1e0 [ 5764.621801][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5764.622044][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5764.622349][ C1] do_syscall_64+0xc9/0x1e0 [ 5764.622583][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5764.622889][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5764.623112][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5764.624077][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5764.624497][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5764.624894][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5764.625301][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5764.625687][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5764.626077][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5764.626472][ C1] [ 5764.626624][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3177s! [swapper/2:0] [ 5764.627025][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5764.628233][ C2] irq event stamp: 44114564 [ 5764.628453][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5764.628971][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5764.629467][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5764.629926][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5764.630378][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5764.630820][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5764.631410][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5764.631747][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5764.632716][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5764.633011][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5764.633394][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5764.633780][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5764.634166][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5764.634551][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5764.634934][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5764.635366][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5764.635688][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5764.636075][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5764.636461][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5764.636844][ C2] PKRU: 55555554 [ 5764.637024][ C2] Call Trace: [ 5764.637189][ C2] [ 5764.637330][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5764.637582][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5764.637818][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5764.638084][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5764.638351][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5764.638628][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5764.638883][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5764.639182][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5764.639434][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5764.639686][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5764.639985][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5764.640271][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5764.640575][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5764.640854][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5764.641140][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5764.641419][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5764.641745][ C2] ? get_stack_info+0x36/0xc0 [ 5764.641983][ C2] ? lock_acquire+0x1c1/0x220 [ 5764.642220][ C2] ? lock_release+0x1d5/0x250 [ 5764.642457][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5764.642703][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5764.642976][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5764.643253][ C2] ? lock_acquire+0x1c1/0x220 [ 5764.643484][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5764.643714][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5764.643966][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5764.644194][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5764.644433][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5764.644682][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5764.644946][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5764.645214][ C2] ip_local_deliver+0x19d/0x480 [ 5764.645453][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5764.645717][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5764.645971][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5764.646304][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5764.646548][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5764.646856][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5764.647110][ C2] ip_rcv+0x564/0x740 [ 5764.647306][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5764.647529][ C2] ? set_track_prepare+0x8a/0xd0 [ 5764.647774][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5764.648040][ C2] ? start_secondary+0x21c/0x2b0 [ 5764.648283][ C2] ? skb_clone+0x10b/0x330 [ 5764.648503][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5764.648811][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5764.649105][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5764.649379][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5764.649662][ C2] ? __tcf_classify+0x329/0x7d0 [ 5764.649902][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5764.650126][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5764.650414][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5764.650691][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5764.651004][ C2] ? lock_acquire+0x1c1/0x220 [ 5764.651235][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5764.651524][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5764.651824][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5764.652137][ C2] ? __copy_skb_header+0xaf/0x490 [ 5764.652393][ C2] ? __skb_clone+0x57a/0x760 [ 5764.652622][ C2] netif_receive_skb+0x55/0x280 [ 5764.652876][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5764.653177][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5764.653497][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5764.653786][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5764.654050][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5764.654327][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5764.654629][ C2] ? get_stack_info+0x36/0xc0 [ 5764.654862][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5764.655117][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5764.655423][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5764.655689][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5764.655960][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5764.656264][ C2] ? kernel_text_address+0x17/0xe0 [ 5764.656517][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5764.656821][ C2] ? arch_stack_walk+0x8c/0x100 [ 5764.657060][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5764.657316][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5764.657593][ C2] ? lock_acquire+0x1c1/0x220 [ 5764.657824][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5764.658095][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5764.658412][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5764.658684][ C2] ? get_stack_info+0x36/0xc0 [ 5764.658923][ C2] __tcf_classify+0x329/0x7d0 [ 5764.659163][ C2] tcf_classify+0x283/0x930 [ 5764.659402][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5764.659648][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5764.659950][ C2] tc_run+0x2e4/0x5d0 [ 5764.660148][ C2] ? __pfx_tc_run+0x10/0x10 [ 5764.660372][ C2] ? lock_acquire+0x1c1/0x220 [ 5764.660602][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5764.660854][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5764.661098][ C2] ? lock_acquire+0x1c1/0x220 [ 5764.661327][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5764.661603][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5764.661902][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5764.662173][ C2] ? neigh_hh_output+0x348/0x590 [ 5764.662423][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5764.662686][ C2] ip_finish_output2+0x786/0x18e0 [ 5764.662946][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5764.663271][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5764.663538][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5764.663780][ C2] ? __ip_finish_output+0x10f/0x770 [ 5764.664036][ C2] ip_output+0x16b/0x4f0 [ 5764.664245][ C2] ? __pfx_ip_output+0x10/0x10 [ 5764.664479][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5764.664747][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5764.665047][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5764.665315][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5764.665557][ C2] ? __alloc_skb+0xd4/0x280 [ 5764.665778][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5764.666039][ C2] ? tcp_fragment+0x168/0x1040 [ 5764.666273][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5764.666517][ C2] ? ip_local_out+0x114/0x3b0 [ 5764.666749][ C2] __ip_queue_xmit+0x672/0x1910 [ 5764.666988][ C2] ? __skb_clone+0x57a/0x760 [ 5764.667217][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5764.667474][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5764.667743][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5764.667979][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5764.668219][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5764.668509][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5764.668818][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5764.669052][ C2] tcp_send_loss_probe+0x348/0x830 [ 5764.669304][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5764.669565][ C2] tcp_write_timer+0x82/0x1d0 [ 5764.669795][ C2] call_timer_fn+0x173/0x430 [ 5764.670024][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5764.670277][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5764.670528][ C2] __run_timers.part.0+0x52d/0x890 [ 5764.670779][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5764.671038][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5764.671315][ C2] ? lock_acquire+0x1c1/0x220 [ 5764.671566][ C2] ? clockevents_program_event+0xf6/0x300 [ 5764.671852][ C2] ? lock_release+0x1d5/0x250 [ 5764.672090][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5764.672352][ C2] ? ktime_get+0xb3/0x190 [ 5764.672570][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5764.672873][ C2] run_timer_softirq+0x72/0x100 [ 5764.673112][ C2] __do_softirq+0x1b9/0x7ff [ 5764.673336][ C2] irq_exit_rcu+0x98/0xc0 [ 5764.673549][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5764.673822][ C2] [ 5764.673969][ C2] [ 5764.674113][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5764.674407][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5764.674655][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5764.675591][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5764.675888][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5764.676273][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5764.676656][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5764.677042][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5764.677427][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5764.677812][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5764.678092][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5764.678344][ C2] default_idle_call+0x69/0xa0 [ 5764.678578][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5764.678820][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5764.679090][ C2] ? lock_release+0x1d5/0x250 [ 5764.679320][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5764.679585][ C2] do_idle+0xfb/0x160 [ 5764.679781][ C2] cpu_startup_entry+0x55/0x60 [ 5764.680016][ C2] start_secondary+0x21c/0x2b0 [ 5764.680250][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5764.680511][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5764.680809][ C2] [ 5792.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3203s! [perl:4135] [ 5792.569686][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5792.570907][ C1] irq event stamp: 209232 [ 5792.571120][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5792.571659][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5792.572135][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5792.572615][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5792.573065][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5792.573501][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5792.574095][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5792.574412][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5792.575356][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5792.575655][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5792.576044][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5792.576433][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5792.576820][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5792.577212][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5792.577599][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5792.578034][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5792.578357][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5792.578746][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5792.579137][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5792.579525][ C1] PKRU: 55555554 [ 5792.579702][ C1] Call Trace: [ 5792.579867][ C1] [ 5792.580011][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5792.580267][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5792.580504][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5792.580773][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5792.581037][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5792.581319][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5792.581602][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5792.581908][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5792.582170][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5792.582478][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5792.582779][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5792.583085][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5792.583367][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5792.583654][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5792.583936][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5792.584239][ C1] ? get_stack_info+0x36/0xc0 [ 5792.584474][ C1] ? lock_acquire+0x1c1/0x220 [ 5792.584709][ C1] ? lock_release+0x1d5/0x250 [ 5792.584943][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5792.585185][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5792.585450][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5792.585726][ C1] ? lock_acquire+0x1c1/0x220 [ 5792.585960][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5792.586196][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5792.586450][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5792.586677][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5792.586917][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5792.587169][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5792.587438][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5792.587708][ C1] ip_local_deliver+0x19d/0x480 [ 5792.587952][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5792.588216][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5792.588472][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5792.588812][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5792.589057][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5792.589369][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5792.589625][ C1] ip_rcv+0x564/0x740 [ 5792.589824][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5792.590047][ C1] ? set_track_prepare+0x8a/0xd0 [ 5792.590294][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5792.590565][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5792.590831][ C1] ? skb_clone+0x10b/0x330 [ 5792.591050][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5792.591361][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5792.591686][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5792.591966][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5792.592262][ C1] ? __tcf_classify+0x329/0x7d0 [ 5792.592512][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5792.592749][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5792.593041][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5792.593319][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5792.593635][ C1] ? lock_acquire+0x1c1/0x220 [ 5792.593865][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5792.594156][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5792.594432][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5792.594739][ C1] ? __copy_skb_header+0xaf/0x490 [ 5792.594989][ C1] ? __skb_clone+0x57a/0x760 [ 5792.595219][ C1] netif_receive_skb+0x55/0x280 [ 5792.595460][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5792.595765][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5792.596088][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5792.596378][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5792.596646][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5792.596925][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5792.597229][ C1] ? hlock_class+0x4e/0x130 [ 5792.597457][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5792.597725][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5792.597992][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5792.598249][ C1] ? hlock_class+0x4e/0x130 [ 5792.598475][ C1] ? mark_lock+0x38/0x3e0 [ 5792.598687][ C1] ? stack_access_ok+0xda/0x1f0 [ 5792.598931][ C1] ? __lock_acquire+0xb67/0x1610 [ 5792.599179][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5792.599447][ C1] ? get_stack_info+0x36/0xc0 [ 5792.599680][ C1] ? stack_access_ok+0xda/0x1f0 [ 5792.599921][ C1] ? get_reg+0x119/0x190 [ 5792.600131][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5792.600393][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5792.600693][ C1] __tcf_classify+0x329/0x7d0 [ 5792.600927][ C1] tcf_classify+0x283/0x930 [ 5792.601153][ C1] ? arch_stack_walk+0xa2/0x100 [ 5792.601400][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5792.601671][ C1] ? get_stack_info+0x36/0xc0 [ 5792.601912][ C1] tc_run+0x2e4/0x5d0 [ 5792.602117][ C1] ? __pfx_tc_run+0x10/0x10 [ 5792.602346][ C1] ? lock_acquire+0x1c1/0x220 [ 5792.602585][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5792.602850][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5792.603096][ C1] ? lock_acquire+0x1c1/0x220 [ 5792.603329][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5792.603585][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5792.603882][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5792.604147][ C1] ? neigh_hh_output+0x348/0x590 [ 5792.604393][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5792.604650][ C1] ip_finish_output2+0x786/0x18e0 [ 5792.604898][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5792.605168][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5792.605497][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5792.605766][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5792.606014][ C1] ? __ip_finish_output+0x10f/0x770 [ 5792.606271][ C1] ip_output+0x16b/0x4f0 [ 5792.606480][ C1] ? run_timer_softirq+0x72/0x100 [ 5792.606730][ C1] ? __pfx_ip_output+0x10/0x10 [ 5792.606967][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5792.607246][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5792.607490][ C1] ? ip_local_out+0x114/0x3b0 [ 5792.607723][ C1] __ip_queue_xmit+0x672/0x1910 [ 5792.607964][ C1] ? __create_object+0x5e/0xb0 [ 5792.608202][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5792.608461][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5792.608735][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5792.609002][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5792.609276][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5792.609539][ C1] tcp_delack_timer+0x84/0x240 [ 5792.609776][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5792.610040][ C1] call_timer_fn+0x173/0x430 [ 5792.610270][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5792.610524][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5792.610777][ C1] __run_timers.part.0+0x52d/0x890 [ 5792.611030][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5792.611295][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5792.611598][ C1] ? lock_acquire+0x1c1/0x220 [ 5792.611836][ C1] ? clockevents_program_event+0xf6/0x300 [ 5792.612125][ C1] ? lock_release+0x1d5/0x250 [ 5792.612365][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5792.612639][ C1] ? ktime_get+0xb3/0x190 [ 5792.612854][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5792.613142][ C1] run_timer_softirq+0x72/0x100 [ 5792.613383][ C1] __do_softirq+0x1b9/0x7ff [ 5792.613610][ C1] irq_exit_rcu+0x98/0xc0 [ 5792.613823][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5792.614100][ C1] [ 5792.614247][ C1] [ 5792.614393][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5792.614689][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5792.615004][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5792.615946][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5792.616245][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5792.616631][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5792.617019][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5792.617428][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5792.617824][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5792.618226][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5792.618533][ C1] pipe_read+0xa16/0xdf0 [ 5792.618746][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5792.619017][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5792.619253][ C1] ? iterate_tty_write+0x299/0x540 [ 5792.619508][ C1] ? lock_release+0x1d5/0x250 [ 5792.619742][ C1] vfs_read+0x911/0xc00 [ 5792.619950][ C1] ? lock_acquire+0x1c1/0x220 [ 5792.620182][ C1] ? __might_fault+0xc6/0x180 [ 5792.620416][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5792.620650][ C1] ? __might_fault+0xc6/0x180 [ 5792.620882][ C1] ? lock_release+0x1d5/0x250 [ 5792.621115][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5792.621371][ C1] ? __fget_light+0x54/0x1e0 [ 5792.621627][ C1] ksys_read+0x17a/0x1e0 [ 5792.621847][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5792.622090][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5792.622396][ C1] do_syscall_64+0xc9/0x1e0 [ 5792.622639][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5792.622929][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5792.623152][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5792.624096][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5792.624507][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5792.624894][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5792.625282][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5792.625669][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5792.626061][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5792.626452][ C1] [ 5792.626603][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3203s! [swapper/2:0] [ 5792.627006][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5792.628213][ C2] irq event stamp: 44114564 [ 5792.628435][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5792.628951][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5792.629445][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5792.629909][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5792.630361][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5792.630800][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5792.631394][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 5792.631727][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 5792.632694][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5792.632989][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5792.633378][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5792.633762][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5792.634145][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5792.634531][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5792.634916][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5792.635347][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5792.635667][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5792.636053][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5792.636440][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5792.636825][ C2] PKRU: 55555554 [ 5792.637005][ C2] Call Trace: [ 5792.637167][ C2] [ 5792.637311][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5792.637564][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5792.637798][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5792.638066][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5792.638329][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5792.638608][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5792.638864][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5792.639159][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5792.639411][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5792.639665][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5792.639962][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5792.640248][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5792.640552][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5792.640830][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 5792.641110][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5792.641391][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5792.641714][ C2] ? get_stack_info+0x36/0xc0 [ 5792.641953][ C2] ? lock_acquire+0x1c1/0x220 [ 5792.642191][ C2] ? lock_release+0x1d5/0x250 [ 5792.642429][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5792.642682][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5792.642946][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5792.643221][ C2] ? lock_acquire+0x1c1/0x220 [ 5792.643452][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5792.643684][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5792.643935][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5792.644160][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5792.644398][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5792.644646][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5792.644910][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5792.645178][ C2] ip_local_deliver+0x19d/0x480 [ 5792.645417][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5792.645678][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5792.645931][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5792.646264][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5792.646509][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5792.646817][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5792.647070][ C2] ip_rcv+0x564/0x740 [ 5792.647268][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5792.647494][ C2] ? set_track_prepare+0x8a/0xd0 [ 5792.647737][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5792.648003][ C2] ? start_secondary+0x21c/0x2b0 [ 5792.648247][ C2] ? skb_clone+0x10b/0x330 [ 5792.648467][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5792.648774][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5792.649069][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5792.649343][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5792.649626][ C2] ? __tcf_classify+0x329/0x7d0 [ 5792.649866][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5792.650090][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5792.650381][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5792.650654][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5792.650967][ C2] ? lock_acquire+0x1c1/0x220 [ 5792.651198][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5792.651506][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5792.651788][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5792.652102][ C2] ? __copy_skb_header+0xaf/0x490 [ 5792.652357][ C2] ? __skb_clone+0x57a/0x760 [ 5792.652590][ C2] netif_receive_skb+0x55/0x280 [ 5792.652839][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5792.653139][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5792.653459][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5792.653748][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5792.654012][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5792.654291][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5792.654590][ C2] ? get_stack_info+0x36/0xc0 [ 5792.654823][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5792.655077][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5792.655382][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5792.655650][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5792.655917][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5792.656221][ C2] ? kernel_text_address+0x17/0xe0 [ 5792.656472][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5792.656775][ C2] ? arch_stack_walk+0x8c/0x100 [ 5792.657018][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5792.657274][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5792.657548][ C2] ? lock_acquire+0x1c1/0x220 [ 5792.657779][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5792.658049][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5792.658345][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5792.658629][ C2] ? get_stack_info+0x36/0xc0 [ 5792.658867][ C2] __tcf_classify+0x329/0x7d0 [ 5792.659107][ C2] tcf_classify+0x283/0x930 [ 5792.659338][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5792.659591][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5792.659911][ C2] tc_run+0x2e4/0x5d0 [ 5792.660111][ C2] ? __pfx_tc_run+0x10/0x10 [ 5792.660332][ C2] ? lock_acquire+0x1c1/0x220 [ 5792.660562][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5792.660814][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5792.661057][ C2] ? lock_acquire+0x1c1/0x220 [ 5792.661289][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5792.661566][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5792.661865][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5792.662135][ C2] ? neigh_hh_output+0x348/0x590 [ 5792.662386][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5792.662658][ C2] ip_finish_output2+0x786/0x18e0 [ 5792.662906][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5792.663232][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5792.663497][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5792.663740][ C2] ? __ip_finish_output+0x10f/0x770 [ 5792.663996][ C2] ip_output+0x16b/0x4f0 [ 5792.664206][ C2] ? __pfx_ip_output+0x10/0x10 [ 5792.664442][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5792.664708][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5792.665009][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5792.665275][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5792.665518][ C2] ? __alloc_skb+0xd4/0x280 [ 5792.665741][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5792.666000][ C2] ? tcp_fragment+0x168/0x1040 [ 5792.666236][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5792.666478][ C2] ? ip_local_out+0x114/0x3b0 [ 5792.666708][ C2] __ip_queue_xmit+0x672/0x1910 [ 5792.666948][ C2] ? __skb_clone+0x57a/0x760 [ 5792.667177][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5792.667433][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5792.667703][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5792.667938][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5792.668180][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5792.668470][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5792.668779][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5792.669015][ C2] tcp_send_loss_probe+0x348/0x830 [ 5792.669266][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5792.669524][ C2] tcp_write_timer+0x82/0x1d0 [ 5792.669756][ C2] call_timer_fn+0x173/0x430 [ 5792.669982][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5792.670234][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5792.670488][ C2] __run_timers.part.0+0x52d/0x890 [ 5792.670739][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5792.670999][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5792.671273][ C2] ? lock_acquire+0x1c1/0x220 [ 5792.671528][ C2] ? clockevents_program_event+0xf6/0x300 [ 5792.671813][ C2] ? lock_release+0x1d5/0x250 [ 5792.672051][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5792.672312][ C2] ? ktime_get+0xb3/0x190 [ 5792.672532][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5792.672828][ C2] run_timer_softirq+0x72/0x100 [ 5792.673069][ C2] __do_softirq+0x1b9/0x7ff [ 5792.673295][ C2] irq_exit_rcu+0x98/0xc0 [ 5792.673506][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5792.673782][ C2] [ 5792.673926][ C2] [ 5792.674070][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5792.674363][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5792.674610][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5792.675544][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5792.675844][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5792.676228][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5792.676615][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5792.676999][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5792.677384][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5792.677769][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5792.678050][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5792.678301][ C2] default_idle_call+0x69/0xa0 [ 5792.678537][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5792.678779][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5792.679046][ C2] ? lock_release+0x1d5/0x250 [ 5792.679278][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5792.679541][ C2] do_idle+0xfb/0x160 [ 5792.679738][ C2] cpu_startup_entry+0x55/0x60 [ 5792.679972][ C2] start_secondary+0x21c/0x2b0 [ 5792.680207][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5792.680468][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5792.680767][ C2] [ 5815.486102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5815.486449][ C1] rcu: 1-....: (3451949 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=845345 [ 5815.486990][ C1] rcu: (t=3460599 jiffies g=1882453 q=712 ncpus=4) [ 5815.487313][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5815.487749][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5815.488344][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5815.488662][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5815.489610][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5815.489912][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5815.490302][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5815.490690][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5815.491076][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5815.491489][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5815.491890][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5815.492336][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5815.492673][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5815.493059][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5815.493448][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5815.493837][ C1] PKRU: 55555554 [ 5815.494013][ C1] Call Trace: [ 5815.494177][ C1] [ 5815.494322][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5815.494587][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5815.494832][ C1] ? check_cpu_stall+0x284/0x500 [ 5815.495078][ C1] ? rcu_pending+0x92/0x360 [ 5815.495301][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5815.495565][ C1] ? update_process_times+0xb9/0x110 [ 5815.495828][ C1] ? tick_sched_handle+0x67/0x130 [ 5815.496077][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5815.496353][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5815.496590][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5815.496894][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5815.497159][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5815.497440][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5815.497699][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5815.497994][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5815.498249][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5815.498549][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5815.498838][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5815.499144][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5815.499423][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5815.499711][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5815.499992][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5815.500295][ C1] ? get_stack_info+0x36/0xc0 [ 5815.500530][ C1] ? lock_acquire+0x1c1/0x220 [ 5815.500764][ C1] ? lock_release+0x1d5/0x250 [ 5815.500997][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5815.501239][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5815.501530][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5815.501815][ C1] ? lock_acquire+0x1c1/0x220 [ 5815.502054][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5815.502295][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5815.502564][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5815.502790][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5815.503032][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5815.503281][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5815.503549][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5815.503819][ C1] ip_local_deliver+0x19d/0x480 [ 5815.504060][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5815.504324][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5815.504580][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5815.504916][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5815.505162][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5815.505474][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5815.505728][ C1] ip_rcv+0x564/0x740 [ 5815.505928][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5815.506152][ C1] ? set_track_prepare+0x8a/0xd0 [ 5815.506398][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5815.506666][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5815.506933][ C1] ? skb_clone+0x10b/0x330 [ 5815.507153][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5815.507464][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5815.507762][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5815.508035][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5815.508323][ C1] ? __tcf_classify+0x329/0x7d0 [ 5815.508565][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5815.508787][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5815.509079][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5815.509355][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5815.509672][ C1] ? lock_acquire+0x1c1/0x220 [ 5815.509904][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5815.510194][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5815.510469][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5815.510778][ C1] ? __copy_skb_header+0xaf/0x490 [ 5815.511028][ C1] ? __skb_clone+0x57a/0x760 [ 5815.511257][ C1] netif_receive_skb+0x55/0x280 [ 5815.511525][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5815.511836][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5815.512168][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5815.512476][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5815.512744][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5815.513024][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5815.513329][ C1] ? hlock_class+0x4e/0x130 [ 5815.513554][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5815.513824][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5815.514092][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5815.514348][ C1] ? hlock_class+0x4e/0x130 [ 5815.514573][ C1] ? mark_lock+0x38/0x3e0 [ 5815.514786][ C1] ? stack_access_ok+0xda/0x1f0 [ 5815.515028][ C1] ? __lock_acquire+0xb67/0x1610 [ 5815.515274][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5815.515542][ C1] ? get_stack_info+0x36/0xc0 [ 5815.515781][ C1] ? stack_access_ok+0xda/0x1f0 [ 5815.516021][ C1] ? get_reg+0x119/0x190 [ 5815.516230][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5815.516492][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5815.516792][ C1] __tcf_classify+0x329/0x7d0 [ 5815.517028][ C1] tcf_classify+0x283/0x930 [ 5815.517254][ C1] ? arch_stack_walk+0xa2/0x100 [ 5815.517495][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5815.517745][ C1] ? get_stack_info+0x36/0xc0 [ 5815.517977][ C1] tc_run+0x2e4/0x5d0 [ 5815.518177][ C1] ? __pfx_tc_run+0x10/0x10 [ 5815.518401][ C1] ? lock_acquire+0x1c1/0x220 [ 5815.518634][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5815.518888][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5815.519134][ C1] ? lock_acquire+0x1c1/0x220 [ 5815.519367][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5815.519624][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5815.519921][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5815.520187][ C1] ? neigh_hh_output+0x348/0x590 [ 5815.520433][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5815.520690][ C1] ip_finish_output2+0x786/0x18e0 [ 5815.520939][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5815.521207][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5815.521560][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5815.521838][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5815.522090][ C1] ? __ip_finish_output+0x10f/0x770 [ 5815.522355][ C1] ip_output+0x16b/0x4f0 [ 5815.522580][ C1] ? run_timer_softirq+0x72/0x100 [ 5815.522828][ C1] ? __pfx_ip_output+0x10/0x10 [ 5815.523064][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5815.523341][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5815.523586][ C1] ? ip_local_out+0x114/0x3b0 [ 5815.523821][ C1] __ip_queue_xmit+0x672/0x1910 [ 5815.524063][ C1] ? __create_object+0x5e/0xb0 [ 5815.524301][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5815.524560][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5815.524833][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5815.525098][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5815.525373][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5815.525637][ C1] tcp_delack_timer+0x84/0x240 [ 5815.525874][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5815.526138][ C1] call_timer_fn+0x173/0x430 [ 5815.526368][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5815.526622][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5815.526876][ C1] __run_timers.part.0+0x52d/0x890 [ 5815.527130][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5815.527395][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5815.527673][ C1] ? lock_acquire+0x1c1/0x220 [ 5815.527904][ C1] ? clockevents_program_event+0xf6/0x300 [ 5815.528210][ C1] ? lock_release+0x1d5/0x250 [ 5815.528448][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5815.528712][ C1] ? ktime_get+0xb3/0x190 [ 5815.528931][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5815.529238][ C1] run_timer_softirq+0x72/0x100 [ 5815.529480][ C1] __do_softirq+0x1b9/0x7ff [ 5815.529704][ C1] irq_exit_rcu+0x98/0xc0 [ 5815.529921][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5815.530197][ C1] [ 5815.530345][ C1] [ 5815.530489][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5815.530786][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5815.531101][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5815.532081][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5815.532389][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5815.532787][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5815.533171][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5815.533558][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5815.533945][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5815.534334][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5815.534623][ C1] pipe_read+0xa16/0xdf0 [ 5815.534836][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5815.535105][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5815.535342][ C1] ? iterate_tty_write+0x299/0x540 [ 5815.535596][ C1] ? lock_release+0x1d5/0x250 [ 5815.535830][ C1] vfs_read+0x911/0xc00 [ 5815.536037][ C1] ? lock_acquire+0x1c1/0x220 [ 5815.536270][ C1] ? __might_fault+0xc6/0x180 [ 5815.536504][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5815.536736][ C1] ? __might_fault+0xc6/0x180 [ 5815.536968][ C1] ? lock_release+0x1d5/0x250 [ 5815.537204][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5815.537461][ C1] ? __fget_light+0x54/0x1e0 [ 5815.537692][ C1] ksys_read+0x17a/0x1e0 [ 5815.537902][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5815.538140][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5815.538436][ C1] do_syscall_64+0xc9/0x1e0 [ 5815.538660][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5815.538953][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5815.539174][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5815.540118][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5815.540526][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5815.540916][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5815.541324][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5815.541719][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5815.542116][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5815.542529][ C1] [ 5815.542680][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5815.542944][ C2] NMI backtrace for cpu 2 [ 5815.542949][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5815.542954][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5815.542958][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5815.542965][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5815.542971][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5815.542975][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5815.542979][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5815.542983][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5815.542986][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5815.542990][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5815.542994][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5815.542998][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5815.543004][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5815.543007][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5815.543010][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5815.543014][ C2] PKRU: 55555554 [ 5815.543016][ C2] Call Trace: [ 5815.543018][ C2] [ 5815.543021][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5815.543032][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5815.543040][ C2] ? nmi_handle+0x153/0x420 [ 5815.543050][ C2] ? default_do_nmi+0x41/0x100 [ 5815.543056][ C2] ? exc_nmi+0xf3/0x120 [ 5815.543062][ C2] ? end_repeat_nmi+0xf/0x60 [ 5815.543073][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5815.543080][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5815.543088][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5815.543097][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5815.543104][ C2] [ 5815.543106][ C2] [ 5815.543109][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5815.543115][ C2] ? get_stack_info+0x36/0xc0 [ 5815.543123][ C2] ? lock_acquire+0x1c1/0x220 [ 5815.543131][ C2] ? lock_release+0x1d5/0x250 [ 5815.543140][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5815.543148][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5815.543154][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5815.543163][ C2] ? lock_acquire+0x1c1/0x220 [ 5815.543168][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5815.543176][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5815.543182][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5815.543199][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5815.543205][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5815.543216][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5815.543225][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5815.543233][ C2] ip_local_deliver+0x19d/0x480 [ 5815.543239][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5815.543244][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5815.543250][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5815.543260][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5815.543268][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5815.543275][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5815.543295][ C2] ip_rcv+0x564/0x740 [ 5815.543301][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5815.543307][ C2] ? set_track_prepare+0x8a/0xd0 [ 5815.543315][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5815.543322][ C2] ? start_secondary+0x21c/0x2b0 [ 5815.543329][ C2] ? skb_clone+0x10b/0x330 [ 5815.543334][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5815.543349][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5815.543363][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5815.543370][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5815.543389][ C2] ? __tcf_classify+0x329/0x7d0 [ 5815.543398][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5815.543403][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5815.543411][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5815.543419][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5815.543429][ C2] ? lock_acquire+0x1c1/0x220 [ 5815.543434][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5815.543445][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5815.543453][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5815.543463][ C2] ? __copy_skb_header+0xaf/0x490 [ 5815.543472][ C2] ? __skb_clone+0x57a/0x760 [ 5815.543478][ C2] netif_receive_skb+0x55/0x280 [ 5815.543486][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5815.543503][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5815.543520][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5815.543538][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5815.543549][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5815.543574][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5815.543594][ C2] ? get_stack_info+0x36/0xc0 [ 5815.543605][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5815.543611][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5815.543620][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5815.543626][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5815.543635][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5815.543641][ C2] ? kernel_text_address+0x17/0xe0 [ 5815.543647][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5815.543655][ C2] ? arch_stack_walk+0x8c/0x100 [ 5815.543663][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5815.543671][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5815.543679][ C2] ? lock_acquire+0x1c1/0x220 [ 5815.543684][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5815.543693][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5815.543701][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5815.543708][ C2] ? get_stack_info+0x36/0xc0 [ 5815.543718][ C2] __tcf_classify+0x329/0x7d0 [ 5815.543731][ C2] tcf_classify+0x283/0x930 [ 5815.543741][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5815.543749][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5815.543760][ C2] tc_run+0x2e4/0x5d0 [ 5815.543767][ C2] ? __pfx_tc_run+0x10/0x10 [ 5815.543774][ C2] ? lock_acquire+0x1c1/0x220 [ 5815.543780][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5815.543789][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5815.543799][ C2] ? lock_acquire+0x1c1/0x220 [ 5815.543804][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5815.543812][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5815.543819][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5815.543825][ C2] ? neigh_hh_output+0x348/0x590 [ 5815.543835][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5815.543844][ C2] ip_finish_output2+0x786/0x18e0 [ 5815.543852][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5815.543871][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5815.543877][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5815.543887][ C2] ? __ip_finish_output+0x10f/0x770 [ 5815.543896][ C2] ip_output+0x16b/0x4f0 [ 5815.543903][ C2] ? __pfx_ip_output+0x10/0x10 [ 5815.543909][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5815.543916][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5815.543923][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5815.543929][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5815.543935][ C2] ? __alloc_skb+0xd4/0x280 [ 5815.543941][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5815.543948][ C2] ? tcp_fragment+0x168/0x1040 [ 5815.543956][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5815.543962][ C2] ? ip_local_out+0x114/0x3b0 [ 5815.543971][ C2] __ip_queue_xmit+0x672/0x1910 [ 5815.543980][ C2] ? __skb_clone+0x57a/0x760 [ 5815.543987][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5815.544001][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5815.544008][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5815.544016][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5815.544025][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5815.544035][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5815.544042][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5815.544051][ C2] tcp_send_loss_probe+0x348/0x830 [ 5815.544059][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5815.544065][ C2] tcp_write_timer+0x82/0x1d0 [ 5815.544073][ C2] call_timer_fn+0x173/0x430 [ 5815.544081][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5815.544093][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5815.544103][ C2] __run_timers.part.0+0x52d/0x890 [ 5815.544110][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5815.544121][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5815.544128][ C2] ? lock_acquire+0x1c1/0x220 [ 5815.544134][ C2] ? clockevents_program_event+0xf6/0x300 [ 5815.544142][ C2] ? lock_release+0x1d5/0x250 [ 5815.544149][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5815.544156][ C2] ? ktime_get+0xb3/0x190 [ 5815.544163][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5815.544174][ C2] run_timer_softirq+0x72/0x100 [ 5815.544182][ C2] __do_softirq+0x1b9/0x7ff [ 5815.544193][ C2] irq_exit_rcu+0x98/0xc0 [ 5815.544198][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5815.544204][ C2] [ 5815.544206][ C2] [ 5815.544209][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5815.544216][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5815.544223][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5815.544228][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5815.544233][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5815.544237][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5815.544240][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5815.544244][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5815.544248][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5815.544256][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5815.544263][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5815.544271][ C2] default_idle_call+0x69/0xa0 [ 5815.544278][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5815.544283][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5815.544292][ C2] ? lock_release+0x1d5/0x250 [ 5815.544298][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5815.544307][ C2] do_idle+0xfb/0x160 [ 5815.544313][ C2] cpu_startup_entry+0x55/0x60 [ 5815.544319][ C2] start_secondary+0x21c/0x2b0 [ 5815.544326][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5815.544336][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5815.544350][ C2] [ 5815.544353][ C2] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.409 msecs [ 5840.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3248s! [perl:4135] [ 5840.569671][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5840.570891][ C1] irq event stamp: 209232 [ 5840.571104][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5840.571646][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5840.572120][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5840.572592][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5840.573039][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5840.573475][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5840.574068][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5840.574383][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5840.575327][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5840.575625][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5840.576014][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5840.576403][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5840.576790][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5840.577176][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5840.577564][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5840.577998][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5840.578324][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5840.578713][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5840.579100][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5840.579489][ C1] PKRU: 55555554 [ 5840.579665][ C1] Call Trace: [ 5840.579830][ C1] [ 5840.579973][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5840.580228][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5840.580464][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5840.580735][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5840.580999][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5840.581300][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5840.581566][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5840.581871][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5840.582132][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5840.582451][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5840.582739][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5840.583045][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5840.583325][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5840.583612][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5840.583892][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5840.584195][ C1] ? get_stack_info+0x36/0xc0 [ 5840.584429][ C1] ? lock_acquire+0x1c1/0x220 [ 5840.584664][ C1] ? lock_release+0x1d5/0x250 [ 5840.584895][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5840.585137][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5840.585403][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5840.585680][ C1] ? lock_acquire+0x1c1/0x220 [ 5840.585913][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5840.586145][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5840.586399][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5840.586626][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5840.586865][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5840.587115][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5840.587381][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5840.587651][ C1] ip_local_deliver+0x19d/0x480 [ 5840.587890][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5840.588156][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5840.588413][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5840.588749][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5840.588995][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5840.589305][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5840.589560][ C1] ip_rcv+0x564/0x740 [ 5840.589757][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5840.589982][ C1] ? set_track_prepare+0x8a/0xd0 [ 5840.590229][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5840.590498][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5840.590762][ C1] ? skb_clone+0x10b/0x330 [ 5840.590983][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5840.591317][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5840.591622][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5840.591902][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5840.592197][ C1] ? __tcf_classify+0x329/0x7d0 [ 5840.592453][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5840.592677][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5840.592970][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5840.593246][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5840.593561][ C1] ? lock_acquire+0x1c1/0x220 [ 5840.593794][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5840.594082][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5840.594360][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5840.594668][ C1] ? __copy_skb_header+0xaf/0x490 [ 5840.594918][ C1] ? __skb_clone+0x57a/0x760 [ 5840.595148][ C1] netif_receive_skb+0x55/0x280 [ 5840.595390][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5840.595692][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5840.596017][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5840.596307][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5840.596573][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5840.596856][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5840.597160][ C1] ? hlock_class+0x4e/0x130 [ 5840.597386][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5840.597655][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5840.597925][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5840.598182][ C1] ? hlock_class+0x4e/0x130 [ 5840.598407][ C1] ? mark_lock+0x38/0x3e0 [ 5840.598621][ C1] ? stack_access_ok+0xda/0x1f0 [ 5840.598863][ C1] ? __lock_acquire+0xb67/0x1610 [ 5840.599110][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5840.599378][ C1] ? get_stack_info+0x36/0xc0 [ 5840.599612][ C1] ? stack_access_ok+0xda/0x1f0 [ 5840.599854][ C1] ? get_reg+0x119/0x190 [ 5840.600063][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5840.600323][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5840.600625][ C1] __tcf_classify+0x329/0x7d0 [ 5840.600860][ C1] tcf_classify+0x283/0x930 [ 5840.601085][ C1] ? arch_stack_walk+0xa2/0x100 [ 5840.601351][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5840.601608][ C1] ? get_stack_info+0x36/0xc0 [ 5840.601850][ C1] tc_run+0x2e4/0x5d0 [ 5840.602053][ C1] ? __pfx_tc_run+0x10/0x10 [ 5840.602285][ C1] ? lock_acquire+0x1c1/0x220 [ 5840.602532][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5840.602785][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5840.603032][ C1] ? lock_acquire+0x1c1/0x220 [ 5840.603263][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5840.603521][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5840.603816][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5840.604081][ C1] ? neigh_hh_output+0x348/0x590 [ 5840.604326][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5840.604585][ C1] ip_finish_output2+0x786/0x18e0 [ 5840.604834][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5840.605103][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5840.605431][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5840.605699][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5840.605944][ C1] ? __ip_finish_output+0x10f/0x770 [ 5840.606204][ C1] ip_output+0x16b/0x4f0 [ 5840.606415][ C1] ? run_timer_softirq+0x72/0x100 [ 5840.606665][ C1] ? __pfx_ip_output+0x10/0x10 [ 5840.606902][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5840.607179][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5840.607424][ C1] ? ip_local_out+0x114/0x3b0 [ 5840.607658][ C1] __ip_queue_xmit+0x672/0x1910 [ 5840.607900][ C1] ? __create_object+0x5e/0xb0 [ 5840.608136][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5840.608399][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5840.608672][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5840.608937][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5840.609212][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5840.609477][ C1] tcp_delack_timer+0x84/0x240 [ 5840.609715][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5840.609979][ C1] call_timer_fn+0x173/0x430 [ 5840.610209][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5840.610464][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5840.610718][ C1] __run_timers.part.0+0x52d/0x890 [ 5840.610971][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5840.611259][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5840.611541][ C1] ? lock_acquire+0x1c1/0x220 [ 5840.611779][ C1] ? clockevents_program_event+0xf6/0x300 [ 5840.612071][ C1] ? lock_release+0x1d5/0x250 [ 5840.612309][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5840.612578][ C1] ? ktime_get+0xb3/0x190 [ 5840.612791][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5840.613080][ C1] run_timer_softirq+0x72/0x100 [ 5840.613321][ C1] __do_softirq+0x1b9/0x7ff [ 5840.613547][ C1] irq_exit_rcu+0x98/0xc0 [ 5840.613764][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5840.614040][ C1] [ 5840.614186][ C1] [ 5840.614334][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5840.614629][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5840.614946][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5840.615889][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5840.616189][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5840.616576][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5840.616963][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5840.617350][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5840.617739][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5840.618130][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5840.618417][ C1] pipe_read+0xa16/0xdf0 [ 5840.618631][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5840.618900][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5840.619137][ C1] ? iterate_tty_write+0x299/0x540 [ 5840.619391][ C1] ? lock_release+0x1d5/0x250 [ 5840.619626][ C1] vfs_read+0x911/0xc00 [ 5840.619833][ C1] ? lock_acquire+0x1c1/0x220 [ 5840.620065][ C1] ? __might_fault+0xc6/0x180 [ 5840.620298][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5840.620529][ C1] ? __might_fault+0xc6/0x180 [ 5840.620763][ C1] ? lock_release+0x1d5/0x250 [ 5840.620997][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5840.621274][ C1] ? __fget_light+0x54/0x1e0 [ 5840.621512][ C1] ksys_read+0x17a/0x1e0 [ 5840.621728][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5840.621973][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5840.622277][ C1] do_syscall_64+0xc9/0x1e0 [ 5840.622514][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5840.622805][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5840.623025][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5840.623969][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5840.624378][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5840.624765][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5840.625155][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5840.625543][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5840.625929][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5840.626320][ C1] [ 5840.626475][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3248s! [swapper/2:0] [ 5840.626869][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5840.628072][ C2] irq event stamp: 44114564 [ 5840.628293][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5840.628807][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5840.629300][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5840.629759][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5840.630210][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5840.630650][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5840.631261][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5840.631582][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5840.632544][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5840.632838][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5840.633222][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5840.633606][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5840.633988][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5840.634375][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5840.634759][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5840.635190][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5840.635509][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5840.635894][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5840.636281][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5840.636665][ C2] PKRU: 55555554 [ 5840.636840][ C2] Call Trace: [ 5840.637003][ C2] [ 5840.637146][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5840.637398][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5840.637632][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5840.637898][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5840.638160][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5840.638439][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5840.638694][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5840.638988][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5840.639240][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5840.639492][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5840.639790][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5840.640073][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5840.640376][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5840.640656][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5840.640940][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5840.641242][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5840.641550][ C2] ? get_stack_info+0x36/0xc0 [ 5840.641786][ C2] ? lock_acquire+0x1c1/0x220 [ 5840.642024][ C2] ? lock_release+0x1d5/0x250 [ 5840.642262][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5840.642515][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5840.642777][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5840.643051][ C2] ? lock_acquire+0x1c1/0x220 [ 5840.643282][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5840.643514][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5840.643764][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5840.643990][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5840.644227][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5840.644476][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5840.644741][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5840.645007][ C2] ip_local_deliver+0x19d/0x480 [ 5840.645245][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5840.645505][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5840.645758][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5840.646094][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5840.646337][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5840.646647][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5840.646898][ C2] ip_rcv+0x564/0x740 [ 5840.647095][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5840.647315][ C2] ? set_track_prepare+0x8a/0xd0 [ 5840.647562][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5840.647830][ C2] ? start_secondary+0x21c/0x2b0 [ 5840.648072][ C2] ? skb_clone+0x10b/0x330 [ 5840.648289][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5840.648595][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5840.648890][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5840.649160][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5840.649444][ C2] ? __tcf_classify+0x329/0x7d0 [ 5840.649684][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5840.649904][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5840.650193][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5840.650466][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5840.650780][ C2] ? lock_acquire+0x1c1/0x220 [ 5840.651011][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5840.651321][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5840.651600][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5840.651913][ C2] ? __copy_skb_header+0xaf/0x490 [ 5840.652167][ C2] ? __skb_clone+0x57a/0x760 [ 5840.652409][ C2] netif_receive_skb+0x55/0x280 [ 5840.652650][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5840.652950][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5840.653271][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5840.653558][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5840.653823][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5840.654101][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5840.654403][ C2] ? get_stack_info+0x36/0xc0 [ 5840.654634][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5840.654891][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5840.655195][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5840.655465][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5840.655731][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5840.656035][ C2] ? kernel_text_address+0x17/0xe0 [ 5840.656285][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5840.656585][ C2] ? arch_stack_walk+0x8c/0x100 [ 5840.656825][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5840.657080][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5840.657356][ C2] ? lock_acquire+0x1c1/0x220 [ 5840.657585][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5840.657857][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5840.658149][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5840.658416][ C2] ? get_stack_info+0x36/0xc0 [ 5840.658647][ C2] __tcf_classify+0x329/0x7d0 [ 5840.658881][ C2] tcf_classify+0x283/0x930 [ 5840.659106][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5840.659375][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5840.659683][ C2] tc_run+0x2e4/0x5d0 [ 5840.659884][ C2] ? __pfx_tc_run+0x10/0x10 [ 5840.660113][ C2] ? lock_acquire+0x1c1/0x220 [ 5840.660359][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5840.660609][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5840.660853][ C2] ? lock_acquire+0x1c1/0x220 [ 5840.661083][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5840.661360][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5840.661660][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5840.661929][ C2] ? neigh_hh_output+0x348/0x590 [ 5840.662179][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5840.662450][ C2] ip_finish_output2+0x786/0x18e0 [ 5840.662696][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5840.663020][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5840.663289][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5840.663532][ C2] ? __ip_finish_output+0x10f/0x770 [ 5840.663788][ C2] ip_output+0x16b/0x4f0 [ 5840.663998][ C2] ? __pfx_ip_output+0x10/0x10 [ 5840.664234][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5840.664499][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5840.664799][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5840.665064][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5840.665307][ C2] ? __alloc_skb+0xd4/0x280 [ 5840.665530][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5840.665789][ C2] ? tcp_fragment+0x168/0x1040 [ 5840.666024][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5840.666267][ C2] ? ip_local_out+0x114/0x3b0 [ 5840.666499][ C2] __ip_queue_xmit+0x672/0x1910 [ 5840.666737][ C2] ? __skb_clone+0x57a/0x760 [ 5840.666963][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5840.667219][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5840.667491][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5840.667725][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5840.667964][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5840.668255][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5840.668564][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5840.668799][ C2] tcp_send_loss_probe+0x348/0x830 [ 5840.669050][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5840.669309][ C2] tcp_write_timer+0x82/0x1d0 [ 5840.669541][ C2] call_timer_fn+0x173/0x430 [ 5840.669769][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5840.670022][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5840.670274][ C2] __run_timers.part.0+0x52d/0x890 [ 5840.670524][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5840.670784][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5840.671057][ C2] ? lock_acquire+0x1c1/0x220 [ 5840.671311][ C2] ? clockevents_program_event+0xf6/0x300 [ 5840.671599][ C2] ? lock_release+0x1d5/0x250 [ 5840.671833][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5840.672096][ C2] ? ktime_get+0xb3/0x190 [ 5840.672315][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5840.672612][ C2] run_timer_softirq+0x72/0x100 [ 5840.672850][ C2] __do_softirq+0x1b9/0x7ff [ 5840.673074][ C2] irq_exit_rcu+0x98/0xc0 [ 5840.673286][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5840.673560][ C2] [ 5840.673703][ C2] [ 5840.673852][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5840.674145][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5840.674392][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5840.675326][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5840.675620][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5840.676007][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5840.676392][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5840.676775][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5840.677159][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5840.677546][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5840.677823][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5840.678074][ C2] default_idle_call+0x69/0xa0 [ 5840.678310][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5840.678552][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5840.678819][ C2] ? lock_release+0x1d5/0x250 [ 5840.679050][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5840.679312][ C2] do_idle+0xfb/0x160 [ 5840.679509][ C2] cpu_startup_entry+0x55/0x60 [ 5840.679743][ C2] start_secondary+0x21c/0x2b0 [ 5840.679978][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5840.680238][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5840.680538][ C2] [ 5868.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3274s! [perl:4135] [ 5868.569672][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5868.570891][ C1] irq event stamp: 209232 [ 5868.571127][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5868.571652][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5868.572130][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5868.572600][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5868.573047][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5868.573484][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5868.574080][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5868.574397][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5868.575344][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5868.575643][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5868.576032][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5868.576420][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5868.576806][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5868.577195][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5868.577584][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5868.578020][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5868.578343][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5868.578732][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5868.579122][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5868.579511][ C1] PKRU: 55555554 [ 5868.579688][ C1] Call Trace: [ 5868.579851][ C1] [ 5868.579997][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5868.580252][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5868.580488][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5868.580758][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5868.581023][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5868.581331][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5868.581596][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5868.581901][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5868.582164][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5868.582475][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5868.582762][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5868.583068][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5868.583351][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5868.583639][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5868.583921][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5868.584223][ C1] ? get_stack_info+0x36/0xc0 [ 5868.584458][ C1] ? lock_acquire+0x1c1/0x220 [ 5868.584693][ C1] ? lock_release+0x1d5/0x250 [ 5868.584927][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5868.585169][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5868.585433][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5868.585710][ C1] ? lock_acquire+0x1c1/0x220 [ 5868.585943][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5868.586178][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5868.586431][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5868.586659][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5868.586899][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5868.587150][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5868.587419][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5868.587689][ C1] ip_local_deliver+0x19d/0x480 [ 5868.587931][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5868.588196][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5868.588452][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5868.588791][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5868.589037][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5868.589350][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5868.589605][ C1] ip_rcv+0x564/0x740 [ 5868.589809][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5868.590032][ C1] ? set_track_prepare+0x8a/0xd0 [ 5868.590279][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5868.590549][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5868.590815][ C1] ? skb_clone+0x10b/0x330 [ 5868.591037][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5868.591372][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5868.591679][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5868.591958][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5868.592254][ C1] ? __tcf_classify+0x329/0x7d0 [ 5868.592508][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5868.592731][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5868.593024][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5868.593302][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5868.593619][ C1] ? lock_acquire+0x1c1/0x220 [ 5868.593850][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5868.594142][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5868.594418][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5868.594728][ C1] ? __copy_skb_header+0xaf/0x490 [ 5868.594979][ C1] ? __skb_clone+0x57a/0x760 [ 5868.595210][ C1] netif_receive_skb+0x55/0x280 [ 5868.595453][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5868.595758][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5868.596081][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5868.596373][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5868.596641][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5868.596921][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5868.597227][ C1] ? hlock_class+0x4e/0x130 [ 5868.597453][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5868.597723][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5868.597992][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5868.598248][ C1] ? hlock_class+0x4e/0x130 [ 5868.598474][ C1] ? mark_lock+0x38/0x3e0 [ 5868.598687][ C1] ? stack_access_ok+0xda/0x1f0 [ 5868.598930][ C1] ? __lock_acquire+0xb67/0x1610 [ 5868.599178][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5868.599447][ C1] ? get_stack_info+0x36/0xc0 [ 5868.599680][ C1] ? stack_access_ok+0xda/0x1f0 [ 5868.599923][ C1] ? get_reg+0x119/0x190 [ 5868.600135][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5868.600398][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5868.600698][ C1] __tcf_classify+0x329/0x7d0 [ 5868.600934][ C1] tcf_classify+0x283/0x930 [ 5868.601184][ C1] ? arch_stack_walk+0xa2/0x100 [ 5868.601433][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5868.601692][ C1] ? get_stack_info+0x36/0xc0 [ 5868.601932][ C1] tc_run+0x2e4/0x5d0 [ 5868.602139][ C1] ? __pfx_tc_run+0x10/0x10 [ 5868.602377][ C1] ? lock_acquire+0x1c1/0x220 [ 5868.602609][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5868.602864][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5868.603111][ C1] ? lock_acquire+0x1c1/0x220 [ 5868.603344][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5868.603601][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5868.603900][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5868.604165][ C1] ? neigh_hh_output+0x348/0x590 [ 5868.604412][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5868.604670][ C1] ip_finish_output2+0x786/0x18e0 [ 5868.604920][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5868.605190][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5868.605519][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5868.605789][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5868.606035][ C1] ? __ip_finish_output+0x10f/0x770 [ 5868.606293][ C1] ip_output+0x16b/0x4f0 [ 5868.606503][ C1] ? run_timer_softirq+0x72/0x100 [ 5868.606752][ C1] ? __pfx_ip_output+0x10/0x10 [ 5868.606990][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5868.607268][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5868.607512][ C1] ? ip_local_out+0x114/0x3b0 [ 5868.607747][ C1] __ip_queue_xmit+0x672/0x1910 [ 5868.607989][ C1] ? __create_object+0x5e/0xb0 [ 5868.608228][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5868.608488][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5868.608760][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5868.609028][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5868.609305][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5868.609570][ C1] tcp_delack_timer+0x84/0x240 [ 5868.609808][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5868.610072][ C1] call_timer_fn+0x173/0x430 [ 5868.610304][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5868.610559][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5868.610813][ C1] __run_timers.part.0+0x52d/0x890 [ 5868.611089][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5868.611361][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5868.611649][ C1] ? lock_acquire+0x1c1/0x220 [ 5868.611888][ C1] ? clockevents_program_event+0xf6/0x300 [ 5868.612177][ C1] ? lock_release+0x1d5/0x250 [ 5868.612424][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5868.612681][ C1] ? ktime_get+0xb3/0x190 [ 5868.612895][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5868.613186][ C1] run_timer_softirq+0x72/0x100 [ 5868.613428][ C1] __do_softirq+0x1b9/0x7ff [ 5868.613654][ C1] irq_exit_rcu+0x98/0xc0 [ 5868.613868][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5868.614146][ C1] [ 5868.614295][ C1] [ 5868.614441][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5868.614739][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5868.615055][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5868.616001][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5868.616302][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5868.616690][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5868.617077][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5868.617469][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5868.617856][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5868.618247][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5868.618536][ C1] pipe_read+0xa16/0xdf0 [ 5868.618750][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5868.619020][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5868.619258][ C1] ? iterate_tty_write+0x299/0x540 [ 5868.619512][ C1] ? lock_release+0x1d5/0x250 [ 5868.619748][ C1] vfs_read+0x911/0xc00 [ 5868.619954][ C1] ? lock_acquire+0x1c1/0x220 [ 5868.620188][ C1] ? __might_fault+0xc6/0x180 [ 5868.620424][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5868.620658][ C1] ? __might_fault+0xc6/0x180 [ 5868.620889][ C1] ? lock_release+0x1d5/0x250 [ 5868.621146][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5868.621410][ C1] ? __fget_light+0x54/0x1e0 [ 5868.621648][ C1] ksys_read+0x17a/0x1e0 [ 5868.621865][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5868.622111][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5868.622421][ C1] do_syscall_64+0xc9/0x1e0 [ 5868.622648][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5868.622939][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5868.623162][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5868.624107][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5868.624519][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5868.624909][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5868.625298][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5868.625686][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5868.626075][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5868.626468][ C1] [ 5868.626620][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3274s! [swapper/2:0] [ 5868.627016][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5868.628220][ C2] irq event stamp: 44114564 [ 5868.628441][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5868.628957][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5868.629450][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5868.629907][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5868.630359][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5868.630799][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5868.631416][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5868.631737][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5868.632696][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5868.632990][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5868.633375][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5868.633762][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5868.634145][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5868.634529][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5868.634917][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5868.635347][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5868.635667][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5868.636052][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5868.636437][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5868.636821][ C2] PKRU: 55555554 [ 5868.636996][ C2] Call Trace: [ 5868.637156][ C2] [ 5868.637300][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5868.637552][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5868.637788][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5868.638055][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5868.638317][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5868.638595][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5868.638850][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5868.639144][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5868.639396][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5868.639651][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5868.639948][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5868.640233][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5868.640535][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5868.640814][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5868.641121][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5868.641406][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5868.641714][ C2] ? get_stack_info+0x36/0xc0 [ 5868.641951][ C2] ? lock_acquire+0x1c1/0x220 [ 5868.642189][ C2] ? lock_release+0x1d5/0x250 [ 5868.642431][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5868.642670][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5868.642933][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5868.643206][ C2] ? lock_acquire+0x1c1/0x220 [ 5868.643436][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5868.643668][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5868.643918][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5868.644143][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5868.644381][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5868.644629][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5868.644894][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5868.645161][ C2] ip_local_deliver+0x19d/0x480 [ 5868.645399][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5868.645660][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5868.645914][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5868.646248][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5868.646491][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5868.646799][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5868.647051][ C2] ip_rcv+0x564/0x740 [ 5868.647249][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5868.647470][ C2] ? set_track_prepare+0x8a/0xd0 [ 5868.647713][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5868.647980][ C2] ? start_secondary+0x21c/0x2b0 [ 5868.648222][ C2] ? skb_clone+0x10b/0x330 [ 5868.648441][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5868.648748][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5868.649044][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5868.649313][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5868.649597][ C2] ? __tcf_classify+0x329/0x7d0 [ 5868.649836][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5868.650058][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5868.650348][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5868.650622][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5868.650935][ C2] ? lock_acquire+0x1c1/0x220 [ 5868.651189][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5868.651482][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5868.651763][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5868.652077][ C2] ? __copy_skb_header+0xaf/0x490 [ 5868.652340][ C2] ? __skb_clone+0x57a/0x760 [ 5868.652566][ C2] netif_receive_skb+0x55/0x280 [ 5868.652805][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5868.653103][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5868.653425][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5868.653713][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5868.653976][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5868.654256][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5868.654557][ C2] ? get_stack_info+0x36/0xc0 [ 5868.654788][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5868.655042][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5868.655346][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5868.655615][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5868.655881][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5868.656185][ C2] ? kernel_text_address+0x17/0xe0 [ 5868.656435][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5868.656736][ C2] ? arch_stack_walk+0x8c/0x100 [ 5868.656976][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5868.657230][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5868.657504][ C2] ? lock_acquire+0x1c1/0x220 [ 5868.657735][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5868.658006][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5868.658300][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5868.658566][ C2] ? get_stack_info+0x36/0xc0 [ 5868.658797][ C2] __tcf_classify+0x329/0x7d0 [ 5868.659031][ C2] tcf_classify+0x283/0x930 [ 5868.659256][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5868.659503][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5868.659828][ C2] tc_run+0x2e4/0x5d0 [ 5868.660031][ C2] ? __pfx_tc_run+0x10/0x10 [ 5868.660258][ C2] ? lock_acquire+0x1c1/0x220 [ 5868.660495][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5868.660762][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5868.661004][ C2] ? lock_acquire+0x1c1/0x220 [ 5868.661260][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5868.661521][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5868.661821][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5868.662090][ C2] ? neigh_hh_output+0x348/0x590 [ 5868.662349][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5868.662603][ C2] ip_finish_output2+0x786/0x18e0 [ 5868.662850][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5868.663175][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5868.663441][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5868.663684][ C2] ? __ip_finish_output+0x10f/0x770 [ 5868.663941][ C2] ip_output+0x16b/0x4f0 [ 5868.664150][ C2] ? __pfx_ip_output+0x10/0x10 [ 5868.664384][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5868.664650][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5868.664950][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5868.665216][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5868.665458][ C2] ? __alloc_skb+0xd4/0x280 [ 5868.665681][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5868.665942][ C2] ? tcp_fragment+0x168/0x1040 [ 5868.666177][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5868.666420][ C2] ? ip_local_out+0x114/0x3b0 [ 5868.666653][ C2] __ip_queue_xmit+0x672/0x1910 [ 5868.666891][ C2] ? __skb_clone+0x57a/0x760 [ 5868.667119][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5868.667376][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5868.667647][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5868.667880][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5868.668121][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5868.668412][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5868.668721][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5868.668957][ C2] tcp_send_loss_probe+0x348/0x830 [ 5868.669208][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5868.669466][ C2] tcp_write_timer+0x82/0x1d0 [ 5868.669698][ C2] call_timer_fn+0x173/0x430 [ 5868.669925][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5868.670177][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5868.670430][ C2] __run_timers.part.0+0x52d/0x890 [ 5868.670681][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5868.670941][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5868.671240][ C2] ? lock_acquire+0x1c1/0x220 [ 5868.671476][ C2] ? clockevents_program_event+0xf6/0x300 [ 5868.671763][ C2] ? lock_release+0x1d5/0x250 [ 5868.671999][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5868.672270][ C2] ? ktime_get+0xb3/0x190 [ 5868.672485][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5868.672770][ C2] run_timer_softirq+0x72/0x100 [ 5868.673008][ C2] __do_softirq+0x1b9/0x7ff [ 5868.673234][ C2] irq_exit_rcu+0x98/0xc0 [ 5868.673444][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5868.673721][ C2] [ 5868.673865][ C2] [ 5868.674011][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5868.674302][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5868.674549][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5868.675483][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5868.675778][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5868.676163][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5868.676548][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5868.676931][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5868.677314][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5868.677703][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5868.677981][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5868.678232][ C2] default_idle_call+0x69/0xa0 [ 5868.678468][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5868.678710][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5868.678976][ C2] ? lock_release+0x1d5/0x250 [ 5868.679208][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5868.679470][ C2] do_idle+0xfb/0x160 [ 5868.679666][ C2] cpu_startup_entry+0x55/0x60 [ 5868.679904][ C2] start_secondary+0x21c/0x2b0 [ 5868.680139][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5868.680398][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5868.680698][ C2] [ 5893.544102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5893.544466][ C1] rcu: 1-....: (3529838 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=864606 [ 5893.545007][ C1] rcu: (t=3538657 jiffies g=1882453 q=715 ncpus=4) [ 5893.545332][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5893.545768][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5893.546364][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5893.546682][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5893.547625][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5893.547925][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5893.548312][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5893.548702][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5893.549093][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5893.549481][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5893.549868][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5893.550303][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5893.550626][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5893.551038][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5893.551435][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5893.551832][ C1] PKRU: 55555554 [ 5893.552014][ C1] Call Trace: [ 5893.552193][ C1] [ 5893.552335][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5893.552602][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5893.552847][ C1] ? check_cpu_stall+0x284/0x500 [ 5893.553092][ C1] ? rcu_pending+0x92/0x360 [ 5893.553319][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5893.553580][ C1] ? update_process_times+0xb9/0x110 [ 5893.553842][ C1] ? tick_sched_handle+0x67/0x130 [ 5893.554092][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5893.554371][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5893.554608][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5893.554911][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5893.555178][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5893.555456][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5893.555714][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5893.556013][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5893.556268][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5893.556569][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5893.556857][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5893.557161][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5893.557443][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5893.557731][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5893.558011][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5893.558315][ C1] ? get_stack_info+0x36/0xc0 [ 5893.558550][ C1] ? lock_acquire+0x1c1/0x220 [ 5893.558783][ C1] ? lock_release+0x1d5/0x250 [ 5893.559016][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5893.559259][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5893.559523][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5893.559803][ C1] ? lock_acquire+0x1c1/0x220 [ 5893.560034][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5893.560268][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5893.560521][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5893.560751][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5893.561013][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5893.561270][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5893.561545][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5893.561820][ C1] ip_local_deliver+0x19d/0x480 [ 5893.562068][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5893.562348][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5893.562605][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5893.562944][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5893.563191][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5893.563502][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5893.563758][ C1] ip_rcv+0x564/0x740 [ 5893.563956][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5893.564182][ C1] ? set_track_prepare+0x8a/0xd0 [ 5893.564429][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5893.564698][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5893.564961][ C1] ? skb_clone+0x10b/0x330 [ 5893.565184][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5893.565496][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5893.565793][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5893.566069][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5893.566354][ C1] ? __tcf_classify+0x329/0x7d0 [ 5893.566596][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5893.566822][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5893.567114][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5893.567392][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5893.567708][ C1] ? lock_acquire+0x1c1/0x220 [ 5893.567941][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5893.568229][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5893.568507][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5893.568816][ C1] ? __copy_skb_header+0xaf/0x490 [ 5893.569067][ C1] ? __skb_clone+0x57a/0x760 [ 5893.569295][ C1] netif_receive_skb+0x55/0x280 [ 5893.569535][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5893.569840][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5893.570163][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5893.570456][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5893.570722][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5893.571026][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5893.571337][ C1] ? hlock_class+0x4e/0x130 [ 5893.571572][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5893.571848][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5893.572136][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5893.572393][ C1] ? hlock_class+0x4e/0x130 [ 5893.572616][ C1] ? mark_lock+0x38/0x3e0 [ 5893.572831][ C1] ? stack_access_ok+0xda/0x1f0 [ 5893.573077][ C1] ? __lock_acquire+0xb67/0x1610 [ 5893.573324][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5893.573593][ C1] ? get_stack_info+0x36/0xc0 [ 5893.573827][ C1] ? stack_access_ok+0xda/0x1f0 [ 5893.574067][ C1] ? get_reg+0x119/0x190 [ 5893.574278][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5893.574539][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5893.574842][ C1] __tcf_classify+0x329/0x7d0 [ 5893.575079][ C1] tcf_classify+0x283/0x930 [ 5893.575306][ C1] ? arch_stack_walk+0xa2/0x100 [ 5893.575549][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5893.575797][ C1] ? get_stack_info+0x36/0xc0 [ 5893.576032][ C1] tc_run+0x2e4/0x5d0 [ 5893.576232][ C1] ? __pfx_tc_run+0x10/0x10 [ 5893.576458][ C1] ? lock_acquire+0x1c1/0x220 [ 5893.576690][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5893.576945][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5893.577190][ C1] ? lock_acquire+0x1c1/0x220 [ 5893.577422][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5893.577680][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5893.577978][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5893.578243][ C1] ? neigh_hh_output+0x348/0x590 [ 5893.578490][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5893.578747][ C1] ip_finish_output2+0x786/0x18e0 [ 5893.578997][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5893.579269][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5893.579598][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5893.579866][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5893.580112][ C1] ? __ip_finish_output+0x10f/0x770 [ 5893.580369][ C1] ip_output+0x16b/0x4f0 [ 5893.580582][ C1] ? run_timer_softirq+0x72/0x100 [ 5893.580831][ C1] ? __pfx_ip_output+0x10/0x10 [ 5893.581091][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5893.581376][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5893.581629][ C1] ? ip_local_out+0x114/0x3b0 [ 5893.581869][ C1] __ip_queue_xmit+0x672/0x1910 [ 5893.582117][ C1] ? __create_object+0x5e/0xb0 [ 5893.582366][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5893.582625][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5893.582901][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5893.583166][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5893.583439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5893.583706][ C1] tcp_delack_timer+0x84/0x240 [ 5893.583942][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5893.584207][ C1] call_timer_fn+0x173/0x430 [ 5893.584436][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5893.584690][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5893.584945][ C1] __run_timers.part.0+0x52d/0x890 [ 5893.585198][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5893.585464][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5893.585740][ C1] ? lock_acquire+0x1c1/0x220 [ 5893.585974][ C1] ? clockevents_program_event+0xf6/0x300 [ 5893.586257][ C1] ? lock_release+0x1d5/0x250 [ 5893.586488][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5893.586746][ C1] ? ktime_get+0xb3/0x190 [ 5893.586962][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5893.587251][ C1] run_timer_softirq+0x72/0x100 [ 5893.587492][ C1] __do_softirq+0x1b9/0x7ff [ 5893.587720][ C1] irq_exit_rcu+0x98/0xc0 [ 5893.587934][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5893.588213][ C1] [ 5893.588358][ C1] [ 5893.588506][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5893.588800][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5893.589116][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5893.590062][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5893.590359][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5893.590751][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5893.591164][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5893.591562][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5893.591959][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5893.592366][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5893.592653][ C1] pipe_read+0xa16/0xdf0 [ 5893.592870][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5893.593140][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5893.593377][ C1] ? iterate_tty_write+0x299/0x540 [ 5893.593631][ C1] ? lock_release+0x1d5/0x250 [ 5893.593865][ C1] vfs_read+0x911/0xc00 [ 5893.594073][ C1] ? lock_acquire+0x1c1/0x220 [ 5893.594306][ C1] ? __might_fault+0xc6/0x180 [ 5893.594538][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5893.594772][ C1] ? __might_fault+0xc6/0x180 [ 5893.595005][ C1] ? lock_release+0x1d5/0x250 [ 5893.595239][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5893.595497][ C1] ? __fget_light+0x54/0x1e0 [ 5893.595727][ C1] ksys_read+0x17a/0x1e0 [ 5893.595940][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5893.596179][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5893.596472][ C1] do_syscall_64+0xc9/0x1e0 [ 5893.596702][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5893.596994][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5893.597217][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5893.598162][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5893.598573][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5893.598960][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5893.599348][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5893.599738][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5893.600127][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5893.600517][ C1] [ 5893.600670][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5893.600937][ C2] NMI backtrace for cpu 2 [ 5893.600959][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5893.600965][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5893.600969][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5893.600978][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5893.600983][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5893.600988][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5893.600990][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5893.600992][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5893.600993][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5893.600995][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5893.600997][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5893.600999][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5893.601002][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5893.601004][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5893.601006][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5893.601007][ C2] PKRU: 55555554 [ 5893.601008][ C2] Call Trace: [ 5893.601010][ C2] [ 5893.601011][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5893.601018][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5893.601022][ C2] ? nmi_handle+0x153/0x420 [ 5893.601026][ C2] ? default_do_nmi+0x41/0x100 [ 5893.601029][ C2] ? exc_nmi+0xf3/0x120 [ 5893.601032][ C2] ? end_repeat_nmi+0xf/0x60 [ 5893.601037][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5893.601040][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5893.601043][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5893.601046][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5893.601049][ C2] [ 5893.601050][ C2] [ 5893.601051][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5893.601054][ C2] ? get_stack_info+0x36/0xc0 [ 5893.601058][ C2] ? lock_acquire+0x1c1/0x220 [ 5893.601062][ C2] ? lock_release+0x1d5/0x250 [ 5893.601065][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5893.601069][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5893.601072][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5893.601075][ C2] ? lock_acquire+0x1c1/0x220 [ 5893.601077][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5893.601081][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5893.601084][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5893.601090][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5893.601092][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5893.601096][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5893.601101][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5893.601104][ C2] ip_local_deliver+0x19d/0x480 [ 5893.601107][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5893.601109][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5893.601111][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5893.601116][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5893.601120][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5893.601123][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5893.601132][ C2] ip_rcv+0x564/0x740 [ 5893.601134][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5893.601137][ C2] ? set_track_prepare+0x8a/0xd0 [ 5893.601141][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5893.601144][ C2] ? start_secondary+0x21c/0x2b0 [ 5893.601147][ C2] ? skb_clone+0x10b/0x330 [ 5893.601150][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5893.601155][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5893.601160][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5893.601164][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5893.601172][ C2] ? __tcf_classify+0x329/0x7d0 [ 5893.601176][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5893.601178][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5893.601181][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5893.601185][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5893.601189][ C2] ? lock_acquire+0x1c1/0x220 [ 5893.601191][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5893.601196][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5893.601199][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5893.601203][ C2] ? __copy_skb_header+0xaf/0x490 [ 5893.601207][ C2] ? __skb_clone+0x57a/0x760 [ 5893.601209][ C2] netif_receive_skb+0x55/0x280 [ 5893.601213][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5893.601219][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5893.601226][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5893.601232][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5893.601236][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5893.601247][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5893.601254][ C2] ? get_stack_info+0x36/0xc0 [ 5893.601259][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5893.601261][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5893.601265][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5893.601267][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5893.601270][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5893.601273][ C2] ? kernel_text_address+0x17/0xe0 [ 5893.601276][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5893.601280][ C2] ? arch_stack_walk+0x8c/0x100 [ 5893.601283][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5893.601286][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5893.601289][ C2] ? lock_acquire+0x1c1/0x220 [ 5893.601292][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5893.601296][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5893.601300][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5893.601303][ C2] ? get_stack_info+0x36/0xc0 [ 5893.601307][ C2] __tcf_classify+0x329/0x7d0 [ 5893.601312][ C2] tcf_classify+0x283/0x930 [ 5893.601317][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5893.601320][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5893.601324][ C2] tc_run+0x2e4/0x5d0 [ 5893.601328][ C2] ? __pfx_tc_run+0x10/0x10 [ 5893.601331][ C2] ? lock_acquire+0x1c1/0x220 [ 5893.601333][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5893.601337][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5893.601341][ C2] ? lock_acquire+0x1c1/0x220 [ 5893.601343][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5893.601346][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5893.601349][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5893.601352][ C2] ? neigh_hh_output+0x348/0x590 [ 5893.601355][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5893.601359][ C2] ip_finish_output2+0x786/0x18e0 [ 5893.601362][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5893.601370][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5893.601372][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5893.601376][ C2] ? __ip_finish_output+0x10f/0x770 [ 5893.601380][ C2] ip_output+0x16b/0x4f0 [ 5893.601383][ C2] ? __pfx_ip_output+0x10/0x10 [ 5893.601385][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5893.601388][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5893.601391][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5893.601395][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5893.601397][ C2] ? __alloc_skb+0xd4/0x280 [ 5893.601399][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5893.601403][ C2] ? tcp_fragment+0x168/0x1040 [ 5893.601406][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5893.601409][ C2] ? ip_local_out+0x114/0x3b0 [ 5893.601413][ C2] __ip_queue_xmit+0x672/0x1910 [ 5893.601416][ C2] ? __skb_clone+0x57a/0x760 [ 5893.601419][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5893.601424][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5893.601427][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5893.601431][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5893.601435][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5893.601439][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5893.601442][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5893.601445][ C2] tcp_send_loss_probe+0x348/0x830 [ 5893.601448][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5893.601451][ C2] tcp_write_timer+0x82/0x1d0 [ 5893.601454][ C2] call_timer_fn+0x173/0x430 [ 5893.601458][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5893.601463][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5893.601467][ C2] __run_timers.part.0+0x52d/0x890 [ 5893.601470][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5893.601474][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5893.601477][ C2] ? lock_acquire+0x1c1/0x220 [ 5893.601479][ C2] ? clockevents_program_event+0xf6/0x300 [ 5893.601483][ C2] ? lock_release+0x1d5/0x250 [ 5893.601486][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5893.601489][ C2] ? ktime_get+0xb3/0x190 [ 5893.601492][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5893.601496][ C2] run_timer_softirq+0x72/0x100 [ 5893.601500][ C2] __do_softirq+0x1b9/0x7ff [ 5893.601504][ C2] irq_exit_rcu+0x98/0xc0 [ 5893.601506][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5893.601509][ C2] [ 5893.601510][ C2] [ 5893.601511][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5893.601514][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5893.601517][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5893.601519][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5893.601521][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5893.601523][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5893.601524][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5893.601526][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5893.601527][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5893.601530][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5893.601534][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5893.601537][ C2] default_idle_call+0x69/0xa0 [ 5893.601540][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5893.601542][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5893.601546][ C2] ? lock_release+0x1d5/0x250 [ 5893.601548][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5893.601552][ C2] do_idle+0xfb/0x160 [ 5893.601554][ C2] cpu_startup_entry+0x55/0x60 [ 5893.601557][ C2] start_secondary+0x21c/0x2b0 [ 5893.601559][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5893.601563][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5893.601569][ C2] [ 5920.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3322s! [perl:4135] [ 5920.569681][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5920.570932][ C1] irq event stamp: 209232 [ 5920.571152][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5920.571678][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5920.572161][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5920.572616][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5920.573064][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5920.573500][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5920.574097][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 5920.574375][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 5920.575319][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 5920.575618][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5920.576006][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5920.576394][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5920.576782][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5920.577170][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5920.577557][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5920.577992][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5920.578316][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5920.578707][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5920.579094][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5920.579482][ C1] PKRU: 55555554 [ 5920.579659][ C1] Call Trace: [ 5920.579826][ C1] [ 5920.579969][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5920.580223][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5920.580460][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5920.580728][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5920.581020][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5920.581306][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5920.581571][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5920.581877][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5920.582145][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5920.582445][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5920.582733][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5920.583038][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5920.583321][ C1] ? kasan_check_range+0x12/0x1c0 [ 5920.583570][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5920.583842][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5920.584146][ C1] ? get_stack_info+0x36/0xc0 [ 5920.584382][ C1] ? lock_acquire+0x1c1/0x220 [ 5920.584615][ C1] ? lock_release+0x1d5/0x250 [ 5920.584847][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5920.585089][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5920.585354][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5920.585631][ C1] ? lock_acquire+0x1c1/0x220 [ 5920.585864][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5920.586097][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5920.586351][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5920.586578][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5920.586819][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5920.587070][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5920.587338][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5920.587611][ C1] ip_local_deliver+0x19d/0x480 [ 5920.587850][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5920.588115][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5920.588371][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5920.588708][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5920.588954][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5920.589265][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5920.589521][ C1] ip_rcv+0x564/0x740 [ 5920.589718][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5920.589943][ C1] ? set_track_prepare+0x8a/0xd0 [ 5920.590190][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5920.590458][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5920.590722][ C1] ? skb_clone+0x10b/0x330 [ 5920.590966][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5920.591284][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5920.591591][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5920.591872][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5920.592174][ C1] ? __tcf_classify+0x329/0x7d0 [ 5920.592415][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5920.592642][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5920.592933][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5920.593209][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5920.593525][ C1] ? lock_acquire+0x1c1/0x220 [ 5920.593758][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5920.594047][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5920.594323][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5920.594631][ C1] ? __copy_skb_header+0xaf/0x490 [ 5920.594882][ C1] ? __skb_clone+0x57a/0x760 [ 5920.595112][ C1] netif_receive_skb+0x55/0x280 [ 5920.595353][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5920.595655][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5920.595980][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5920.596270][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5920.596535][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5920.596818][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5920.597121][ C1] ? hlock_class+0x4e/0x130 [ 5920.597346][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5920.597615][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5920.597885][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5920.598142][ C1] ? hlock_class+0x4e/0x130 [ 5920.598367][ C1] ? mark_lock+0x38/0x3e0 [ 5920.598580][ C1] ? stack_access_ok+0xda/0x1f0 [ 5920.598821][ C1] ? __lock_acquire+0xb67/0x1610 [ 5920.599069][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5920.599337][ C1] ? get_stack_info+0x36/0xc0 [ 5920.599571][ C1] ? stack_access_ok+0xda/0x1f0 [ 5920.599811][ C1] ? get_reg+0x119/0x190 [ 5920.600021][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5920.600280][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5920.600581][ C1] __tcf_classify+0x329/0x7d0 [ 5920.600838][ C1] tcf_classify+0x283/0x930 [ 5920.601070][ C1] ? arch_stack_walk+0xa2/0x100 [ 5920.601317][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5920.601574][ C1] ? get_stack_info+0x36/0xc0 [ 5920.601816][ C1] tc_run+0x2e4/0x5d0 [ 5920.602029][ C1] ? __pfx_tc_run+0x10/0x10 [ 5920.602255][ C1] ? lock_acquire+0x1c1/0x220 [ 5920.602488][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5920.602742][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5920.602988][ C1] ? lock_acquire+0x1c1/0x220 [ 5920.603219][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5920.603478][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5920.603774][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5920.604040][ C1] ? neigh_hh_output+0x348/0x590 [ 5920.604286][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5920.604543][ C1] ip_finish_output2+0x786/0x18e0 [ 5920.604792][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5920.605063][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5920.605391][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5920.605660][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5920.605905][ C1] ? __ip_finish_output+0x10f/0x770 [ 5920.606164][ C1] ip_output+0x16b/0x4f0 [ 5920.606375][ C1] ? run_timer_softirq+0x72/0x100 [ 5920.606625][ C1] ? __pfx_ip_output+0x10/0x10 [ 5920.606862][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5920.607143][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5920.607388][ C1] ? ip_local_out+0x114/0x3b0 [ 5920.607621][ C1] __ip_queue_xmit+0x672/0x1910 [ 5920.607863][ C1] ? __create_object+0x5e/0xb0 [ 5920.608099][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5920.608359][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5920.608632][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5920.608897][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5920.609172][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5920.609436][ C1] tcp_delack_timer+0x84/0x240 [ 5920.609677][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5920.609941][ C1] call_timer_fn+0x173/0x430 [ 5920.610172][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5920.610427][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5920.610680][ C1] __run_timers.part.0+0x52d/0x890 [ 5920.610957][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5920.611230][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5920.611514][ C1] ? lock_acquire+0x1c1/0x220 [ 5920.611752][ C1] ? clockevents_program_event+0xf6/0x300 [ 5920.612054][ C1] ? lock_release+0x1d5/0x250 [ 5920.612285][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5920.612543][ C1] ? ktime_get+0xb3/0x190 [ 5920.612757][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5920.613046][ C1] run_timer_softirq+0x72/0x100 [ 5920.613287][ C1] __do_softirq+0x1b9/0x7ff [ 5920.613513][ C1] irq_exit_rcu+0x98/0xc0 [ 5920.613727][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5920.614004][ C1] [ 5920.614150][ C1] [ 5920.614298][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5920.614594][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5920.614910][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5920.615850][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5920.616150][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5920.616538][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5920.616926][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5920.617312][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5920.617702][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5920.618091][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5920.618378][ C1] pipe_read+0xa16/0xdf0 [ 5920.618594][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5920.618863][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5920.619101][ C1] ? iterate_tty_write+0x299/0x540 [ 5920.619354][ C1] ? lock_release+0x1d5/0x250 [ 5920.619589][ C1] vfs_read+0x911/0xc00 [ 5920.619796][ C1] ? lock_acquire+0x1c1/0x220 [ 5920.620028][ C1] ? __might_fault+0xc6/0x180 [ 5920.620261][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5920.620493][ C1] ? __might_fault+0xc6/0x180 [ 5920.620726][ C1] ? lock_release+0x1d5/0x250 [ 5920.620983][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5920.621247][ C1] ? __fget_light+0x54/0x1e0 [ 5920.621484][ C1] ksys_read+0x17a/0x1e0 [ 5920.621700][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5920.621944][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5920.622251][ C1] do_syscall_64+0xc9/0x1e0 [ 5920.622475][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5920.622767][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5920.622987][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5920.623932][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5920.624342][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5920.624728][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5920.625118][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5920.625506][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5920.625892][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5920.626282][ C1] [ 5920.626437][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3322s! [swapper/2:0] [ 5920.626837][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5920.628044][ C2] irq event stamp: 44114564 [ 5920.628264][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5920.628780][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5920.629274][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5920.629732][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5920.630183][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5920.630624][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5920.631242][ C2] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 5920.631524][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 5920.632483][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000286 [ 5920.632777][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5920.633164][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5920.633573][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5920.633965][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5920.634359][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5920.634760][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5920.635191][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5920.635511][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5920.635896][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5920.636281][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5920.636666][ C2] PKRU: 55555554 [ 5920.636841][ C2] Call Trace: [ 5920.637003][ C2] [ 5920.637147][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5920.637399][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5920.637633][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5920.637904][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5920.638167][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5920.638445][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5920.638701][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5920.638993][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5920.639245][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 5920.639496][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5920.639748][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5920.640044][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5920.640331][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5920.640633][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5920.640932][ C2] ? kasan_check_range+0x1b/0x1c0 [ 5920.641186][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 5920.641465][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5920.641774][ C2] ? get_stack_info+0x36/0xc0 [ 5920.642020][ C2] ? lock_acquire+0x1c1/0x220 [ 5920.642253][ C2] ? lock_release+0x1d5/0x250 [ 5920.642485][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5920.642724][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5920.642984][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5920.643259][ C2] ? lock_acquire+0x1c1/0x220 [ 5920.643488][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5920.643719][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5920.643969][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5920.644196][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5920.644433][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5920.644681][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5920.644945][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5920.645212][ C2] ip_local_deliver+0x19d/0x480 [ 5920.645450][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5920.645713][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5920.645966][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5920.646301][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5920.646544][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5920.646853][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5920.647105][ C2] ip_rcv+0x564/0x740 [ 5920.647301][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5920.647522][ C2] ? set_track_prepare+0x8a/0xd0 [ 5920.647765][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5920.648032][ C2] ? start_secondary+0x21c/0x2b0 [ 5920.648275][ C2] ? skb_clone+0x10b/0x330 [ 5920.648492][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5920.648798][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5920.649094][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5920.649363][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5920.649648][ C2] ? __tcf_classify+0x329/0x7d0 [ 5920.649887][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5920.650107][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5920.650397][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5920.650669][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5920.651008][ C2] ? lock_acquire+0x1c1/0x220 [ 5920.651243][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5920.651537][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5920.651817][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5920.652139][ C2] ? __copy_skb_header+0xaf/0x490 [ 5920.652386][ C2] ? __skb_clone+0x57a/0x760 [ 5920.652613][ C2] netif_receive_skb+0x55/0x280 [ 5920.652852][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5920.653153][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5920.653472][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5920.653757][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5920.654024][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5920.654300][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5920.654601][ C2] ? get_stack_info+0x36/0xc0 [ 5920.654834][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5920.655088][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5920.655394][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5920.655659][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5920.655924][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5920.656227][ C2] ? kernel_text_address+0x17/0xe0 [ 5920.656477][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5920.656779][ C2] ? arch_stack_walk+0x8c/0x100 [ 5920.657018][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5920.657272][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5920.657546][ C2] ? lock_acquire+0x1c1/0x220 [ 5920.657774][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5920.658046][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5920.658339][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5920.658606][ C2] ? get_stack_info+0x36/0xc0 [ 5920.658836][ C2] __tcf_classify+0x329/0x7d0 [ 5920.659068][ C2] tcf_classify+0x283/0x930 [ 5920.659292][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5920.659538][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5920.659841][ C2] tc_run+0x2e4/0x5d0 [ 5920.660037][ C2] ? __pfx_tc_run+0x10/0x10 [ 5920.660278][ C2] ? lock_acquire+0x1c1/0x220 [ 5920.660511][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5920.660770][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5920.661022][ C2] ? lock_acquire+0x1c1/0x220 [ 5920.661259][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5920.661519][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5920.661820][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5920.662097][ C2] ? neigh_hh_output+0x348/0x590 [ 5920.662338][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5920.662592][ C2] ip_finish_output2+0x786/0x18e0 [ 5920.662839][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5920.663163][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5920.663430][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5920.663673][ C2] ? __ip_finish_output+0x10f/0x770 [ 5920.663927][ C2] ip_output+0x16b/0x4f0 [ 5920.664137][ C2] ? __pfx_ip_output+0x10/0x10 [ 5920.664371][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5920.664635][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5920.664935][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5920.665202][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5920.665444][ C2] ? __alloc_skb+0xd4/0x280 [ 5920.665665][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5920.665924][ C2] ? tcp_fragment+0x168/0x1040 [ 5920.666158][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5920.666400][ C2] ? ip_local_out+0x114/0x3b0 [ 5920.666632][ C2] __ip_queue_xmit+0x672/0x1910 [ 5920.666870][ C2] ? __skb_clone+0x57a/0x760 [ 5920.667095][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5920.667352][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5920.667624][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5920.667859][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5920.668098][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5920.668385][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5920.668693][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5920.668928][ C2] tcp_send_loss_probe+0x348/0x830 [ 5920.669178][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5920.669434][ C2] tcp_write_timer+0x82/0x1d0 [ 5920.669666][ C2] call_timer_fn+0x173/0x430 [ 5920.669893][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5920.670145][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5920.670396][ C2] __run_timers.part.0+0x52d/0x890 [ 5920.670646][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5920.670930][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5920.671211][ C2] ? lock_acquire+0x1c1/0x220 [ 5920.671446][ C2] ? clockevents_program_event+0xf6/0x300 [ 5920.671734][ C2] ? lock_release+0x1d5/0x250 [ 5920.671969][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5920.672235][ C2] ? ktime_get+0xb3/0x190 [ 5920.672447][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5920.672733][ C2] run_timer_softirq+0x72/0x100 [ 5920.672971][ C2] __do_softirq+0x1b9/0x7ff [ 5920.673194][ C2] irq_exit_rcu+0x98/0xc0 [ 5920.673407][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5920.673680][ C2] [ 5920.673824][ C2] [ 5920.673970][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5920.674263][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5920.674509][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5920.675480][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5920.675783][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5920.676181][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5920.676562][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5920.676944][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5920.677328][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5920.677713][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5920.677990][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5920.678240][ C2] default_idle_call+0x69/0xa0 [ 5920.678475][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5920.678716][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5920.678981][ C2] ? lock_release+0x1d5/0x250 [ 5920.679211][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5920.679472][ C2] do_idle+0xfb/0x160 [ 5920.679670][ C2] cpu_startup_entry+0x55/0x60 [ 5920.679902][ C2] start_secondary+0x21c/0x2b0 [ 5920.680137][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5920.680394][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5920.680695][ C2] [ 5948.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3349s! [perl:4135] [ 5948.569671][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5948.570914][ C1] irq event stamp: 209232 [ 5948.571133][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5948.571661][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5948.572139][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5948.572597][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5948.573045][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5948.573482][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5948.574075][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 5948.574360][ C1] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 5948.575308][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 5948.575607][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5948.575996][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5948.576383][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5948.576772][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5948.577163][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5948.577551][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5948.577985][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5948.578308][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5948.578699][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5948.579088][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5948.579477][ C1] PKRU: 55555554 [ 5948.579654][ C1] Call Trace: [ 5948.579819][ C1] [ 5948.579963][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5948.580217][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5948.580455][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5948.580748][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5948.581019][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5948.581310][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5948.581574][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5948.581881][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5948.582148][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5948.582448][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5948.582735][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5948.583041][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5948.583324][ C1] ? __kasan_check_read+0x8/0x20 [ 5948.583568][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5948.583843][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5948.584168][ C1] ? get_stack_info+0x36/0xc0 [ 5948.584408][ C1] ? lock_acquire+0x1c1/0x220 [ 5948.584648][ C1] ? lock_release+0x1d5/0x250 [ 5948.584888][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5948.585137][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5948.585413][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5948.585691][ C1] ? lock_acquire+0x1c1/0x220 [ 5948.585922][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5948.586157][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5948.586409][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5948.586639][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5948.586880][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5948.587132][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5948.587399][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5948.587668][ C1] ip_local_deliver+0x19d/0x480 [ 5948.587909][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5948.588172][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5948.588430][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5948.588770][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5948.589017][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5948.589330][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5948.589585][ C1] ip_rcv+0x564/0x740 [ 5948.589783][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5948.590009][ C1] ? set_track_prepare+0x8a/0xd0 [ 5948.590255][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5948.590525][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5948.590814][ C1] ? skb_clone+0x10b/0x330 [ 5948.591041][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5948.591361][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5948.591666][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5948.591960][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5948.592245][ C1] ? __tcf_classify+0x329/0x7d0 [ 5948.592487][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5948.592712][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5948.593003][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5948.593283][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5948.593600][ C1] ? lock_acquire+0x1c1/0x220 [ 5948.593833][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5948.594121][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5948.594400][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5948.594709][ C1] ? __copy_skb_header+0xaf/0x490 [ 5948.594959][ C1] ? __skb_clone+0x57a/0x760 [ 5948.595187][ C1] netif_receive_skb+0x55/0x280 [ 5948.595429][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5948.595733][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5948.596056][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5948.596349][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5948.596615][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5948.596895][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5948.597201][ C1] ? hlock_class+0x4e/0x130 [ 5948.597429][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5948.597697][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5948.597966][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5948.598224][ C1] ? hlock_class+0x4e/0x130 [ 5948.598448][ C1] ? mark_lock+0x38/0x3e0 [ 5948.598663][ C1] ? stack_access_ok+0xda/0x1f0 [ 5948.598904][ C1] ? __lock_acquire+0xb67/0x1610 [ 5948.599151][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5948.599421][ C1] ? get_stack_info+0x36/0xc0 [ 5948.599654][ C1] ? stack_access_ok+0xda/0x1f0 [ 5948.599893][ C1] ? get_reg+0x119/0x190 [ 5948.600106][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5948.600367][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5948.600673][ C1] __tcf_classify+0x329/0x7d0 [ 5948.600931][ C1] tcf_classify+0x283/0x930 [ 5948.601162][ C1] ? arch_stack_walk+0xa2/0x100 [ 5948.601411][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5948.601667][ C1] ? get_stack_info+0x36/0xc0 [ 5948.601919][ C1] tc_run+0x2e4/0x5d0 [ 5948.602118][ C1] ? __pfx_tc_run+0x10/0x10 [ 5948.602344][ C1] ? lock_acquire+0x1c1/0x220 [ 5948.602575][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5948.602829][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5948.603075][ C1] ? lock_acquire+0x1c1/0x220 [ 5948.603309][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5948.603566][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5948.603863][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5948.604128][ C1] ? neigh_hh_output+0x348/0x590 [ 5948.604374][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5948.604631][ C1] ip_finish_output2+0x786/0x18e0 [ 5948.604880][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5948.605152][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5948.605481][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5948.605749][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5948.605996][ C1] ? __ip_finish_output+0x10f/0x770 [ 5948.606253][ C1] ip_output+0x16b/0x4f0 [ 5948.606464][ C1] ? run_timer_softirq+0x72/0x100 [ 5948.606714][ C1] ? __pfx_ip_output+0x10/0x10 [ 5948.606950][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5948.607232][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5948.607477][ C1] ? ip_local_out+0x114/0x3b0 [ 5948.607710][ C1] __ip_queue_xmit+0x672/0x1910 [ 5948.607951][ C1] ? __create_object+0x5e/0xb0 [ 5948.608190][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5948.608448][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5948.608724][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5948.608990][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5948.609263][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5948.609529][ C1] tcp_delack_timer+0x84/0x240 [ 5948.609766][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5948.610033][ C1] call_timer_fn+0x173/0x430 [ 5948.610261][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5948.610518][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5948.610796][ C1] __run_timers.part.0+0x52d/0x890 [ 5948.611057][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5948.611332][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5948.611616][ C1] ? lock_acquire+0x1c1/0x220 [ 5948.611857][ C1] ? clockevents_program_event+0xf6/0x300 [ 5948.612149][ C1] ? lock_release+0x1d5/0x250 [ 5948.612382][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5948.612639][ C1] ? ktime_get+0xb3/0x190 [ 5948.612856][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5948.613144][ C1] run_timer_softirq+0x72/0x100 [ 5948.613385][ C1] __do_softirq+0x1b9/0x7ff [ 5948.613612][ C1] irq_exit_rcu+0x98/0xc0 [ 5948.613825][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5948.614105][ C1] [ 5948.614251][ C1] [ 5948.614397][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5948.614693][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5948.615008][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5948.615953][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5948.616254][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5948.616642][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5948.617031][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5948.617420][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5948.617807][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5948.618197][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5948.618486][ C1] pipe_read+0xa16/0xdf0 [ 5948.618700][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5948.618971][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5948.619208][ C1] ? iterate_tty_write+0x299/0x540 [ 5948.619463][ C1] ? lock_release+0x1d5/0x250 [ 5948.619694][ C1] vfs_read+0x911/0xc00 [ 5948.619906][ C1] ? lock_acquire+0x1c1/0x220 [ 5948.620138][ C1] ? __might_fault+0xc6/0x180 [ 5948.620371][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5948.620605][ C1] ? __might_fault+0xc6/0x180 [ 5948.620863][ C1] ? lock_release+0x1d5/0x250 [ 5948.621101][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5948.621367][ C1] ? __fget_light+0x54/0x1e0 [ 5948.621603][ C1] ksys_read+0x17a/0x1e0 [ 5948.621822][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5948.622070][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5948.622366][ C1] do_syscall_64+0xc9/0x1e0 [ 5948.622591][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5948.622883][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5948.623104][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5948.624049][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5948.624460][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5948.624847][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5948.625235][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5948.625625][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5948.626014][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5948.626405][ C1] [ 5948.626558][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3349s! [swapper/2:0] [ 5948.626952][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5948.628155][ C2] irq event stamp: 44114564 [ 5948.628375][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5948.628888][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5948.629382][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5948.629842][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5948.630292][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5948.630752][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5948.631357][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5948.631678][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5948.632625][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5948.632920][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5948.633303][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5948.633686][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5948.634071][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5948.634454][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5948.634837][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5948.635267][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5948.635585][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5948.635973][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5948.636357][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5948.636740][ C2] PKRU: 55555554 [ 5948.636915][ C2] Call Trace: [ 5948.637078][ C2] [ 5948.637219][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5948.637469][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5948.637703][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5948.637968][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5948.638231][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5948.638509][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5948.638762][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5948.639057][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5948.639308][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5948.639559][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5948.639856][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5948.640139][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5948.640440][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5948.640741][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5948.641031][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5948.641318][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5948.641627][ C2] ? get_stack_info+0x36/0xc0 [ 5948.641865][ C2] ? lock_acquire+0x1c1/0x220 [ 5948.642105][ C2] ? lock_release+0x1d5/0x250 [ 5948.642337][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5948.642576][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5948.642837][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5948.643113][ C2] ? lock_acquire+0x1c1/0x220 [ 5948.643340][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5948.643572][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5948.643822][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5948.644048][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5948.644287][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5948.644535][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5948.644798][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5948.645062][ C2] ip_local_deliver+0x19d/0x480 [ 5948.645301][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5948.645562][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5948.645818][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5948.646152][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5948.646396][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5948.646705][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5948.646956][ C2] ip_rcv+0x564/0x740 [ 5948.647152][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5948.647375][ C2] ? set_track_prepare+0x8a/0xd0 [ 5948.647617][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5948.647883][ C2] ? start_secondary+0x21c/0x2b0 [ 5948.648126][ C2] ? skb_clone+0x10b/0x330 [ 5948.648343][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5948.648650][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5948.648946][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5948.649216][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5948.649500][ C2] ? __tcf_classify+0x329/0x7d0 [ 5948.649740][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5948.649961][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5948.650249][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5948.650525][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5948.650862][ C2] ? lock_acquire+0x1c1/0x220 [ 5948.651096][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5948.651390][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5948.651672][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5948.651994][ C2] ? __copy_skb_header+0xaf/0x490 [ 5948.652241][ C2] ? __skb_clone+0x57a/0x760 [ 5948.652467][ C2] netif_receive_skb+0x55/0x280 [ 5948.652706][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5948.653006][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5948.653326][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5948.653615][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5948.653879][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5948.654156][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5948.654457][ C2] ? get_stack_info+0x36/0xc0 [ 5948.654690][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5948.654944][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5948.655249][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5948.655514][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5948.655780][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5948.656082][ C2] ? kernel_text_address+0x17/0xe0 [ 5948.656333][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5948.656633][ C2] ? arch_stack_walk+0x8c/0x100 [ 5948.656872][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5948.657126][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5948.657407][ C2] ? lock_acquire+0x1c1/0x220 [ 5948.657637][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5948.657908][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5948.658202][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5948.658467][ C2] ? get_stack_info+0x36/0xc0 [ 5948.658703][ C2] __tcf_classify+0x329/0x7d0 [ 5948.658934][ C2] tcf_classify+0x283/0x930 [ 5948.659159][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5948.659405][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5948.659707][ C2] tc_run+0x2e4/0x5d0 [ 5948.659903][ C2] ? __pfx_tc_run+0x10/0x10 [ 5948.660127][ C2] ? lock_acquire+0x1c1/0x220 [ 5948.660356][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5948.660625][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5948.660878][ C2] ? lock_acquire+0x1c1/0x220 [ 5948.661114][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5948.661375][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5948.661676][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5948.661953][ C2] ? neigh_hh_output+0x348/0x590 [ 5948.662197][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5948.662454][ C2] ip_finish_output2+0x786/0x18e0 [ 5948.662701][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5948.663028][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5948.663294][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5948.663539][ C2] ? __ip_finish_output+0x10f/0x770 [ 5948.663793][ C2] ip_output+0x16b/0x4f0 [ 5948.664000][ C2] ? __pfx_ip_output+0x10/0x10 [ 5948.664238][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5948.664505][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5948.664804][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5948.665073][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5948.665316][ C2] ? __alloc_skb+0xd4/0x280 [ 5948.665535][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5948.665795][ C2] ? tcp_fragment+0x168/0x1040 [ 5948.666029][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5948.666272][ C2] ? ip_local_out+0x114/0x3b0 [ 5948.666504][ C2] __ip_queue_xmit+0x672/0x1910 [ 5948.666744][ C2] ? __skb_clone+0x57a/0x760 [ 5948.666969][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5948.667228][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5948.667498][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5948.667733][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5948.667973][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5948.668261][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5948.668570][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5948.668806][ C2] tcp_send_loss_probe+0x348/0x830 [ 5948.669056][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5948.669315][ C2] tcp_write_timer+0x82/0x1d0 [ 5948.669547][ C2] call_timer_fn+0x173/0x430 [ 5948.669775][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5948.670026][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5948.670278][ C2] __run_timers.part.0+0x52d/0x890 [ 5948.670529][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5948.670812][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5948.671095][ C2] ? lock_acquire+0x1c1/0x220 [ 5948.671330][ C2] ? clockevents_program_event+0xf6/0x300 [ 5948.671617][ C2] ? lock_release+0x1d5/0x250 [ 5948.671855][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5948.672120][ C2] ? ktime_get+0xb3/0x190 [ 5948.672331][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5948.672618][ C2] run_timer_softirq+0x72/0x100 [ 5948.672859][ C2] __do_softirq+0x1b9/0x7ff [ 5948.673081][ C2] irq_exit_rcu+0x98/0xc0 [ 5948.673295][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5948.673568][ C2] [ 5948.673714][ C2] [ 5948.673860][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5948.674154][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5948.674400][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5948.675331][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5948.675628][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5948.676010][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5948.676393][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5948.676776][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5948.677162][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5948.677547][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5948.677825][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5948.678076][ C2] default_idle_call+0x69/0xa0 [ 5948.678309][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5948.678551][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5948.678819][ C2] ? lock_release+0x1d5/0x250 [ 5948.679047][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5948.679313][ C2] do_idle+0xfb/0x160 [ 5948.679509][ C2] cpu_startup_entry+0x55/0x60 [ 5948.679743][ C2] start_secondary+0x21c/0x2b0 [ 5948.679976][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5948.680237][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5948.680534][ C2] [ 5971.602113][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 5971.602457][ C1] rcu: 1-....: (3607728 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=883823 [ 5971.602995][ C1] rcu: (t=3616715 jiffies g=1882453 q=715 ncpus=4) [ 5971.603318][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5971.603753][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5971.604348][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5971.604665][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5971.605603][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 5971.605902][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5971.606289][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5971.606676][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5971.607064][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5971.607450][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5971.607835][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5971.608269][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5971.608591][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5971.608984][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5971.609370][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5971.609756][ C1] PKRU: 55555554 [ 5971.609932][ C1] Call Trace: [ 5971.610098][ C1] [ 5971.610241][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 5971.610504][ C1] ? print_cpu_stall+0x263/0x6a0 [ 5971.610773][ C1] ? check_cpu_stall+0x284/0x500 [ 5971.611026][ C1] ? rcu_pending+0x92/0x360 [ 5971.611257][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 5971.611526][ C1] ? update_process_times+0xb9/0x110 [ 5971.611804][ C1] ? tick_sched_handle+0x67/0x130 [ 5971.612052][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 5971.612330][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5971.612565][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 5971.612867][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5971.613135][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5971.613414][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5971.613670][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5971.613967][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5971.614220][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5971.614519][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5971.614806][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5971.615110][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5971.615393][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5971.615679][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5971.615959][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5971.616261][ C1] ? get_stack_info+0x36/0xc0 [ 5971.616495][ C1] ? lock_acquire+0x1c1/0x220 [ 5971.616726][ C1] ? lock_release+0x1d5/0x250 [ 5971.616960][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5971.617201][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5971.617464][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5971.617742][ C1] ? lock_acquire+0x1c1/0x220 [ 5971.617973][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5971.618206][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5971.618458][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5971.618686][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5971.618927][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5971.619177][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5971.619443][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5971.619710][ C1] ip_local_deliver+0x19d/0x480 [ 5971.619950][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5971.620214][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5971.620472][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5971.620832][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5971.621084][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5971.621403][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5971.621665][ C1] ip_rcv+0x564/0x740 [ 5971.621876][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5971.622102][ C1] ? set_track_prepare+0x8a/0xd0 [ 5971.622348][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5971.622616][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5971.622880][ C1] ? skb_clone+0x10b/0x330 [ 5971.623101][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5971.623412][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5971.623708][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5971.623983][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5971.624268][ C1] ? __tcf_classify+0x329/0x7d0 [ 5971.624510][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5971.624735][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5971.625027][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5971.625306][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5971.625622][ C1] ? lock_acquire+0x1c1/0x220 [ 5971.625855][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5971.626141][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5971.626421][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5971.626728][ C1] ? __copy_skb_header+0xaf/0x490 [ 5971.626982][ C1] ? __skb_clone+0x57a/0x760 [ 5971.627208][ C1] netif_receive_skb+0x55/0x280 [ 5971.627449][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5971.627753][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5971.628075][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5971.628367][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5971.628632][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5971.628912][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5971.629214][ C1] ? hlock_class+0x4e/0x130 [ 5971.629442][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5971.629709][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5971.629978][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5971.630235][ C1] ? hlock_class+0x4e/0x130 [ 5971.630457][ C1] ? mark_lock+0x38/0x3e0 [ 5971.630696][ C1] ? stack_access_ok+0xda/0x1f0 [ 5971.630943][ C1] ? __lock_acquire+0xb67/0x1610 [ 5971.631196][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5971.631471][ C1] ? get_stack_info+0x36/0xc0 [ 5971.631711][ C1] ? stack_access_ok+0xda/0x1f0 [ 5971.631962][ C1] ? get_reg+0x119/0x190 [ 5971.632172][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5971.632432][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5971.632732][ C1] __tcf_classify+0x329/0x7d0 [ 5971.632967][ C1] tcf_classify+0x283/0x930 [ 5971.633191][ C1] ? arch_stack_walk+0xa2/0x100 [ 5971.633432][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5971.633681][ C1] ? get_stack_info+0x36/0xc0 [ 5971.633915][ C1] tc_run+0x2e4/0x5d0 [ 5971.634114][ C1] ? __pfx_tc_run+0x10/0x10 [ 5971.634339][ C1] ? lock_acquire+0x1c1/0x220 [ 5971.634570][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5971.634824][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5971.635069][ C1] ? lock_acquire+0x1c1/0x220 [ 5971.635301][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5971.635557][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5971.635854][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5971.636117][ C1] ? neigh_hh_output+0x348/0x590 [ 5971.636365][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5971.636622][ C1] ip_finish_output2+0x786/0x18e0 [ 5971.636871][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5971.637143][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5971.637471][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5971.637738][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5971.637983][ C1] ? __ip_finish_output+0x10f/0x770 [ 5971.638240][ C1] ip_output+0x16b/0x4f0 [ 5971.638454][ C1] ? run_timer_softirq+0x72/0x100 [ 5971.638703][ C1] ? __pfx_ip_output+0x10/0x10 [ 5971.638938][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5971.639216][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5971.639461][ C1] ? ip_local_out+0x114/0x3b0 [ 5971.639695][ C1] __ip_queue_xmit+0x672/0x1910 [ 5971.639935][ C1] ? __create_object+0x5e/0xb0 [ 5971.640172][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5971.640430][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5971.640735][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5971.641006][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5971.641286][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5971.641560][ C1] tcp_delack_timer+0x84/0x240 [ 5971.641802][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5971.642078][ C1] call_timer_fn+0x173/0x430 [ 5971.642304][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5971.642560][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5971.642814][ C1] __run_timers.part.0+0x52d/0x890 [ 5971.643067][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5971.643334][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5971.643610][ C1] ? lock_acquire+0x1c1/0x220 [ 5971.643842][ C1] ? clockevents_program_event+0xf6/0x300 [ 5971.644124][ C1] ? lock_release+0x1d5/0x250 [ 5971.644355][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5971.644611][ C1] ? ktime_get+0xb3/0x190 [ 5971.644828][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5971.645116][ C1] run_timer_softirq+0x72/0x100 [ 5971.645357][ C1] __do_softirq+0x1b9/0x7ff [ 5971.645584][ C1] irq_exit_rcu+0x98/0xc0 [ 5971.645796][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5971.646075][ C1] [ 5971.646220][ C1] [ 5971.646367][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5971.646661][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5971.646975][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5971.647920][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5971.648218][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5971.648606][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5971.648994][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5971.649381][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5971.649766][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5971.650159][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5971.650446][ C1] pipe_read+0xa16/0xdf0 [ 5971.650682][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5971.650960][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5971.651203][ C1] ? iterate_tty_write+0x299/0x540 [ 5971.651464][ C1] ? lock_release+0x1d5/0x250 [ 5971.651703][ C1] vfs_read+0x911/0xc00 [ 5971.651922][ C1] ? lock_acquire+0x1c1/0x220 [ 5971.652155][ C1] ? __might_fault+0xc6/0x180 [ 5971.652386][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5971.652619][ C1] ? __might_fault+0xc6/0x180 [ 5971.652852][ C1] ? lock_release+0x1d5/0x250 [ 5971.653084][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5971.653342][ C1] ? __fget_light+0x54/0x1e0 [ 5971.653569][ C1] ksys_read+0x17a/0x1e0 [ 5971.653782][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5971.654020][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5971.654314][ C1] do_syscall_64+0xc9/0x1e0 [ 5971.654540][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5971.654832][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5971.655051][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5971.655992][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5971.656403][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5971.656789][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5971.657175][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5971.657565][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5971.657952][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5971.658343][ C1] [ 5971.658496][ C1] Sending NMI from CPU 1 to CPUs 2: [ 5971.658760][ C2] NMI backtrace for cpu 2 [ 5971.658765][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5971.658771][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5971.658774][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5971.658782][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5971.658787][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5971.658792][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5971.658795][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5971.658799][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5971.658803][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5971.658807][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5971.658810][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5971.658815][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5971.658820][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5971.658824][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5971.658827][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5971.658830][ C2] PKRU: 55555554 [ 5971.658833][ C2] Call Trace: [ 5971.658835][ C2] [ 5971.658838][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 5971.658849][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 5971.658857][ C2] ? nmi_handle+0x153/0x420 [ 5971.658867][ C2] ? default_do_nmi+0x41/0x100 [ 5971.658873][ C2] ? exc_nmi+0xf3/0x120 [ 5971.658879][ C2] ? end_repeat_nmi+0xf/0x60 [ 5971.658890][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5971.658898][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5971.658906][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5971.658914][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5971.658922][ C2] [ 5971.658923][ C2] [ 5971.658926][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5971.658933][ C2] ? get_stack_info+0x36/0xc0 [ 5971.658941][ C2] ? lock_acquire+0x1c1/0x220 [ 5971.658949][ C2] ? lock_release+0x1d5/0x250 [ 5971.658957][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5971.658965][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5971.658972][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5971.658980][ C2] ? lock_acquire+0x1c1/0x220 [ 5971.658985][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5971.658994][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5971.659000][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5971.659016][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5971.659022][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5971.659033][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5971.659042][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5971.659051][ C2] ip_local_deliver+0x19d/0x480 [ 5971.659057][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5971.659062][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5971.659067][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5971.659078][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5971.659085][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5971.659092][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5971.659113][ C2] ip_rcv+0x564/0x740 [ 5971.659119][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5971.659125][ C2] ? set_track_prepare+0x8a/0xd0 [ 5971.659133][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5971.659140][ C2] ? start_secondary+0x21c/0x2b0 [ 5971.659146][ C2] ? skb_clone+0x10b/0x330 [ 5971.659152][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5971.659166][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5971.659180][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5971.659187][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5971.659207][ C2] ? __tcf_classify+0x329/0x7d0 [ 5971.659215][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5971.659221][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5971.659228][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5971.659236][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5971.659246][ C2] ? lock_acquire+0x1c1/0x220 [ 5971.659252][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5971.659262][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5971.659271][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5971.659281][ C2] ? __copy_skb_header+0xaf/0x490 [ 5971.659289][ C2] ? __skb_clone+0x57a/0x760 [ 5971.659295][ C2] netif_receive_skb+0x55/0x280 [ 5971.659303][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5971.659320][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5971.659337][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5971.659354][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5971.659366][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5971.659391][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5971.659410][ C2] ? get_stack_info+0x36/0xc0 [ 5971.659422][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5971.659428][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5971.659436][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5971.659442][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5971.659451][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5971.659457][ C2] ? kernel_text_address+0x17/0xe0 [ 5971.659463][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5971.659472][ C2] ? arch_stack_walk+0x8c/0x100 [ 5971.659479][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5971.659487][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5971.659495][ C2] ? lock_acquire+0x1c1/0x220 [ 5971.659500][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5971.659509][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5971.659517][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5971.659524][ C2] ? get_stack_info+0x36/0xc0 [ 5971.659535][ C2] __tcf_classify+0x329/0x7d0 [ 5971.659547][ C2] tcf_classify+0x283/0x930 [ 5971.659558][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5971.659565][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5971.659577][ C2] tc_run+0x2e4/0x5d0 [ 5971.659584][ C2] ? __pfx_tc_run+0x10/0x10 [ 5971.659591][ C2] ? lock_acquire+0x1c1/0x220 [ 5971.659597][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5971.659606][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5971.659616][ C2] ? lock_acquire+0x1c1/0x220 [ 5971.659621][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5971.659626][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5971.659629][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5971.659632][ C2] ? neigh_hh_output+0x348/0x590 [ 5971.659635][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5971.659639][ C2] ip_finish_output2+0x786/0x18e0 [ 5971.659642][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5971.659649][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5971.659652][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5971.659655][ C2] ? __ip_finish_output+0x10f/0x770 [ 5971.659659][ C2] ip_output+0x16b/0x4f0 [ 5971.659661][ C2] ? __pfx_ip_output+0x10/0x10 [ 5971.659664][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5971.659667][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5971.659670][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5971.659672][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5971.659675][ C2] ? __alloc_skb+0xd4/0x280 [ 5971.659677][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5971.659680][ C2] ? tcp_fragment+0x168/0x1040 [ 5971.659683][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5971.659686][ C2] ? ip_local_out+0x114/0x3b0 [ 5971.659689][ C2] __ip_queue_xmit+0x672/0x1910 [ 5971.659692][ C2] ? __skb_clone+0x57a/0x760 [ 5971.659695][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5971.659700][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5971.659703][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5971.659706][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5971.659710][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5971.659714][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5971.659717][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5971.659720][ C2] tcp_send_loss_probe+0x348/0x830 [ 5971.659723][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5971.659725][ C2] tcp_write_timer+0x82/0x1d0 [ 5971.659728][ C2] call_timer_fn+0x173/0x430 [ 5971.659732][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5971.659736][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5971.659740][ C2] __run_timers.part.0+0x52d/0x890 [ 5971.659742][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5971.659747][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5971.659750][ C2] ? lock_acquire+0x1c1/0x220 [ 5971.659752][ C2] ? clockevents_program_event+0xf6/0x300 [ 5971.659755][ C2] ? lock_release+0x1d5/0x250 [ 5971.659758][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5971.659761][ C2] ? ktime_get+0xb3/0x190 [ 5971.659764][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5971.659768][ C2] run_timer_softirq+0x72/0x100 [ 5971.659772][ C2] __do_softirq+0x1b9/0x7ff [ 5971.659776][ C2] irq_exit_rcu+0x98/0xc0 [ 5971.659778][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5971.659782][ C2] [ 5971.659783][ C2] [ 5971.659784][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5971.659787][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5971.659790][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5971.659792][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5971.659794][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5971.659795][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5971.659796][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5971.659798][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5971.659799][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5971.659802][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5971.659805][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5971.659808][ C2] default_idle_call+0x69/0xa0 [ 5971.659811][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5971.659813][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5971.659816][ C2] ? lock_release+0x1d5/0x250 [ 5971.659818][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5971.659822][ C2] do_idle+0xfb/0x160 [ 5971.659824][ C2] cpu_startup_entry+0x55/0x60 [ 5971.659826][ C2] start_secondary+0x21c/0x2b0 [ 5971.659829][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5971.659833][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5971.659839][ C2] [ 5996.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3393s! [perl:4135] [ 5996.569670][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5996.570914][ C1] irq event stamp: 209232 [ 5996.571132][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5996.571668][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 5996.572132][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 5996.572587][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 5996.573034][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 5996.573469][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5996.574066][ C1] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 5996.574347][ C1] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 5996.575289][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000246 [ 5996.575589][ C1] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5996.575976][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 5996.576365][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 5996.576752][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 5996.577139][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 5996.577527][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 5996.577962][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5996.578286][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 5996.578676][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5996.579063][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5996.579452][ C1] PKRU: 55555554 [ 5996.579627][ C1] Call Trace: [ 5996.579793][ C1] [ 5996.579935][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5996.580190][ C1] ? __run_hrtimer+0x1c0/0x710 [ 5996.580426][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5996.580720][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 5996.580992][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5996.581279][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5996.581543][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5996.581853][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 5996.582106][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5996.582406][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5996.582693][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5996.582998][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5996.583280][ C1] ? kasan_check_range+0x10f/0x1c0 [ 5996.583532][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 5996.583805][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5996.584107][ C1] ? get_stack_info+0x36/0xc0 [ 5996.584342][ C1] ? lock_acquire+0x1c1/0x220 [ 5996.584576][ C1] ? lock_release+0x1d5/0x250 [ 5996.584810][ C1] do_raw_spin_lock+0x1ec/0x270 [ 5996.585050][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5996.585315][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5996.585591][ C1] ? lock_acquire+0x1c1/0x220 [ 5996.585823][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5996.586057][ C1] _raw_spin_lock_nested+0x65/0x80 [ 5996.586310][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 5996.586536][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5996.586777][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 5996.587026][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 5996.587295][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 5996.587567][ C1] ip_local_deliver+0x19d/0x480 [ 5996.587808][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 5996.588074][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5996.588331][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5996.588670][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5996.588917][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5996.589230][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5996.589486][ C1] ip_rcv+0x564/0x740 [ 5996.589687][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5996.589911][ C1] ? set_track_prepare+0x8a/0xd0 [ 5996.590158][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 5996.590428][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 5996.590721][ C1] ? skb_clone+0x10b/0x330 [ 5996.590947][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5996.591267][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5996.591574][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5996.591860][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5996.592148][ C1] ? __tcf_classify+0x329/0x7d0 [ 5996.592392][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 5996.592615][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 5996.592909][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5996.593187][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5996.593505][ C1] ? lock_acquire+0x1c1/0x220 [ 5996.593738][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 5996.594029][ C1] netif_receive_skb_internal+0xb0/0x300 [ 5996.594307][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5996.594616][ C1] ? __copy_skb_header+0xaf/0x490 [ 5996.594867][ C1] ? __skb_clone+0x57a/0x760 [ 5996.595097][ C1] netif_receive_skb+0x55/0x280 [ 5996.595341][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5996.595645][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5996.595970][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5996.596260][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 5996.596530][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 5996.596811][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5996.597117][ C1] ? hlock_class+0x4e/0x130 [ 5996.597343][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5996.597615][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5996.597884][ C1] ? __pfx_validate_chain+0x10/0x10 [ 5996.598141][ C1] ? hlock_class+0x4e/0x130 [ 5996.598369][ C1] ? mark_lock+0x38/0x3e0 [ 5996.598582][ C1] ? stack_access_ok+0xda/0x1f0 [ 5996.598825][ C1] ? __lock_acquire+0xb67/0x1610 [ 5996.599073][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 5996.599342][ C1] ? get_stack_info+0x36/0xc0 [ 5996.599578][ C1] ? stack_access_ok+0xda/0x1f0 [ 5996.599820][ C1] ? get_reg+0x119/0x190 [ 5996.600030][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 5996.600294][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5996.600619][ C1] __tcf_classify+0x329/0x7d0 [ 5996.600862][ C1] tcf_classify+0x283/0x930 [ 5996.601096][ C1] ? arch_stack_walk+0xa2/0x100 [ 5996.601345][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 5996.601603][ C1] ? get_stack_info+0x36/0xc0 [ 5996.601849][ C1] tc_run+0x2e4/0x5d0 [ 5996.602051][ C1] ? __pfx_tc_run+0x10/0x10 [ 5996.602275][ C1] ? lock_acquire+0x1c1/0x220 [ 5996.602509][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 5996.602764][ C1] __dev_queue_xmit+0x686/0x17e0 [ 5996.603012][ C1] ? lock_acquire+0x1c1/0x220 [ 5996.603246][ C1] ? ip_finish_output2+0x786/0x18e0 [ 5996.603504][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5996.603802][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5996.604069][ C1] ? neigh_hh_output+0x348/0x590 [ 5996.604317][ C1] ? ip_finish_output2+0x262/0x18e0 [ 5996.604576][ C1] ip_finish_output2+0x786/0x18e0 [ 5996.604826][ C1] ? stack_depot_save_flags+0x45/0x550 [ 5996.605100][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5996.605428][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 5996.605700][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5996.605948][ C1] ? __ip_finish_output+0x10f/0x770 [ 5996.606207][ C1] ip_output+0x16b/0x4f0 [ 5996.606417][ C1] ? run_timer_softirq+0x72/0x100 [ 5996.606667][ C1] ? __pfx_ip_output+0x10/0x10 [ 5996.606905][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5996.607183][ C1] ? rcu_read_lock_held+0xe/0x50 [ 5996.607429][ C1] ? ip_local_out+0x114/0x3b0 [ 5996.607664][ C1] __ip_queue_xmit+0x672/0x1910 [ 5996.607907][ C1] ? __create_object+0x5e/0xb0 [ 5996.608146][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 5996.608406][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5996.608679][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 5996.608946][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 5996.609222][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5996.609487][ C1] tcp_delack_timer+0x84/0x240 [ 5996.609725][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5996.609990][ C1] call_timer_fn+0x173/0x430 [ 5996.610221][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 5996.610499][ C1] ? next_expiry_recalc+0xcd/0x220 [ 5996.610761][ C1] __run_timers.part.0+0x52d/0x890 [ 5996.611022][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 5996.611296][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 5996.611584][ C1] ? lock_acquire+0x1c1/0x220 [ 5996.611831][ C1] ? clockevents_program_event+0xf6/0x300 [ 5996.612115][ C1] ? lock_release+0x1d5/0x250 [ 5996.612350][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5996.612608][ C1] ? ktime_get+0xb3/0x190 [ 5996.612822][ C1] ? clockevents_program_event+0x1ea/0x300 [ 5996.613113][ C1] run_timer_softirq+0x72/0x100 [ 5996.613356][ C1] __do_softirq+0x1b9/0x7ff [ 5996.613583][ C1] irq_exit_rcu+0x98/0xc0 [ 5996.613798][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 5996.614076][ C1] [ 5996.614225][ C1] [ 5996.614371][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5996.614669][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 5996.614986][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 5996.615934][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 5996.616235][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 5996.616624][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 5996.617013][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 5996.617405][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 5996.617794][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 5996.618186][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 5996.618476][ C1] pipe_read+0xa16/0xdf0 [ 5996.618690][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 5996.618960][ C1] ? __pfx_pipe_read+0x10/0x10 [ 5996.619199][ C1] ? iterate_tty_write+0x299/0x540 [ 5996.619453][ C1] ? lock_release+0x1d5/0x250 [ 5996.619689][ C1] vfs_read+0x911/0xc00 [ 5996.619896][ C1] ? lock_acquire+0x1c1/0x220 [ 5996.620131][ C1] ? __might_fault+0xc6/0x180 [ 5996.620366][ C1] ? __pfx_vfs_read+0x10/0x10 [ 5996.620622][ C1] ? __might_fault+0xc6/0x180 [ 5996.620861][ C1] ? lock_release+0x1d5/0x250 [ 5996.621102][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 5996.621367][ C1] ? __fget_light+0x54/0x1e0 [ 5996.621605][ C1] ksys_read+0x17a/0x1e0 [ 5996.621829][ C1] ? __pfx_ksys_read+0x10/0x10 [ 5996.622068][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5996.622366][ C1] do_syscall_64+0xc9/0x1e0 [ 5996.622592][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 5996.622885][ C1] RIP: 0033:0x7f08a1ea38b2 [ 5996.623108][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 5996.624056][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 5996.624466][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 5996.624857][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 5996.625247][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5996.625636][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 5996.626024][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 5996.626420][ C1] [ 5996.626573][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3393s! [swapper/2:0] [ 5996.626966][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 5996.628173][ C2] irq event stamp: 44114564 [ 5996.628392][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 5996.628909][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 5996.629403][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 5996.629862][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 5996.630313][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 5996.630782][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 5996.631388][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 5996.631720][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 5996.632656][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 5996.632952][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 5996.633337][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 5996.633724][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 5996.634109][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 5996.634492][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 5996.634876][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 5996.635308][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5996.635629][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 5996.636016][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 5996.636400][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 5996.636784][ C2] PKRU: 55555554 [ 5996.636960][ C2] Call Trace: [ 5996.637125][ C2] [ 5996.637265][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 5996.637517][ C2] ? __run_hrtimer+0x1c0/0x710 [ 5996.637752][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 5996.638019][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 5996.638283][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 5996.638560][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5996.638815][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 5996.639112][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 5996.639364][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 5996.639616][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 5996.639914][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 5996.640200][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5996.640524][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5996.640811][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 5996.641105][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 5996.641391][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 5996.641709][ C2] ? get_stack_info+0x36/0xc0 [ 5996.641941][ C2] ? lock_acquire+0x1c1/0x220 [ 5996.642171][ C2] ? lock_release+0x1d5/0x250 [ 5996.642403][ C2] do_raw_spin_lock+0x1ec/0x270 [ 5996.642643][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 5996.642905][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5996.643182][ C2] ? lock_acquire+0x1c1/0x220 [ 5996.643413][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 5996.643643][ C2] _raw_spin_lock_nested+0x65/0x80 [ 5996.643893][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 5996.644122][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 5996.644361][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 5996.644610][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 5996.644874][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 5996.645144][ C2] ip_local_deliver+0x19d/0x480 [ 5996.645382][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 5996.645645][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 5996.645900][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 5996.646234][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5996.646477][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 5996.646785][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 5996.647037][ C2] ip_rcv+0x564/0x740 [ 5996.647233][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5996.647457][ C2] ? set_track_prepare+0x8a/0xd0 [ 5996.647702][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5996.647968][ C2] ? start_secondary+0x21c/0x2b0 [ 5996.648211][ C2] ? skb_clone+0x10b/0x330 [ 5996.648429][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 5996.648737][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 5996.649032][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 5996.649304][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 5996.649586][ C2] ? __tcf_classify+0x329/0x7d0 [ 5996.649826][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 5996.650050][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 5996.650341][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5996.650642][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 5996.650965][ C2] ? lock_acquire+0x1c1/0x220 [ 5996.651202][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 5996.651495][ C2] netif_receive_skb_internal+0xb0/0x300 [ 5996.651786][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 5996.652091][ C2] ? __copy_skb_header+0xaf/0x490 [ 5996.652340][ C2] ? __skb_clone+0x57a/0x760 [ 5996.652567][ C2] netif_receive_skb+0x55/0x280 [ 5996.652806][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 5996.653107][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 5996.653427][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 5996.653717][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 5996.653981][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 5996.654258][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 5996.654559][ C2] ? get_stack_info+0x36/0xc0 [ 5996.654793][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 5996.655047][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5996.655352][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5996.655618][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 5996.655886][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 5996.656189][ C2] ? kernel_text_address+0x17/0xe0 [ 5996.656440][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5996.656742][ C2] ? arch_stack_walk+0x8c/0x100 [ 5996.656980][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 5996.657237][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 5996.657513][ C2] ? lock_acquire+0x1c1/0x220 [ 5996.657743][ C2] ? stack_depot_save_flags+0x281/0x550 [ 5996.658015][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5996.658309][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 5996.658575][ C2] ? get_stack_info+0x36/0xc0 [ 5996.658809][ C2] __tcf_classify+0x329/0x7d0 [ 5996.659042][ C2] tcf_classify+0x283/0x930 [ 5996.659265][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 5996.659511][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 5996.659814][ C2] tc_run+0x2e4/0x5d0 [ 5996.660010][ C2] ? __pfx_tc_run+0x10/0x10 [ 5996.660235][ C2] ? lock_acquire+0x1c1/0x220 [ 5996.660486][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 5996.660744][ C2] __dev_queue_xmit+0x686/0x17e0 [ 5996.660994][ C2] ? lock_acquire+0x1c1/0x220 [ 5996.661229][ C2] ? ip_finish_output2+0x786/0x18e0 [ 5996.661492][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 5996.661792][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 5996.662062][ C2] ? neigh_hh_output+0x348/0x590 [ 5996.662313][ C2] ? ip_finish_output2+0x262/0x18e0 [ 5996.662581][ C2] ip_finish_output2+0x786/0x18e0 [ 5996.662828][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 5996.663154][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 5996.663422][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5996.663666][ C2] ? __ip_finish_output+0x10f/0x770 [ 5996.663921][ C2] ip_output+0x16b/0x4f0 [ 5996.664131][ C2] ? __pfx_ip_output+0x10/0x10 [ 5996.664364][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 5996.664633][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5996.664933][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 5996.665201][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 5996.665443][ C2] ? __alloc_skb+0xd4/0x280 [ 5996.665664][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 5996.665926][ C2] ? tcp_fragment+0x168/0x1040 [ 5996.666161][ C2] ? rcu_read_lock_held+0xe/0x50 [ 5996.666405][ C2] ? ip_local_out+0x114/0x3b0 [ 5996.666638][ C2] __ip_queue_xmit+0x672/0x1910 [ 5996.666877][ C2] ? __skb_clone+0x57a/0x760 [ 5996.667105][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 5996.667362][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 5996.667633][ C2] ? ipv4_dst_check+0xe3/0x170 [ 5996.667868][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 5996.668109][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 5996.668400][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 5996.668710][ C2] ? tcp_fragment+0xb0e/0x1040 [ 5996.668944][ C2] tcp_send_loss_probe+0x348/0x830 [ 5996.669196][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5996.669456][ C2] tcp_write_timer+0x82/0x1d0 [ 5996.669686][ C2] call_timer_fn+0x173/0x430 [ 5996.669915][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 5996.670167][ C2] ? next_expiry_recalc+0xcd/0x220 [ 5996.670420][ C2] __run_timers.part.0+0x52d/0x890 [ 5996.670696][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 5996.670962][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 5996.671248][ C2] ? lock_acquire+0x1c1/0x220 [ 5996.671485][ C2] ? clockevents_program_event+0xf6/0x300 [ 5996.671779][ C2] ? lock_release+0x1d5/0x250 [ 5996.672010][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 5996.672266][ C2] ? ktime_get+0xb3/0x190 [ 5996.672478][ C2] ? clockevents_program_event+0x1ea/0x300 [ 5996.672766][ C2] run_timer_softirq+0x72/0x100 [ 5996.673006][ C2] __do_softirq+0x1b9/0x7ff [ 5996.673231][ C2] irq_exit_rcu+0x98/0xc0 [ 5996.673443][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 5996.673716][ C2] [ 5996.673863][ C2] [ 5996.674007][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5996.674302][ C2] RIP: 0010:default_idle+0xf/0x20 [ 5996.674549][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 5996.675483][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 5996.675782][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 5996.676166][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 5996.676549][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 5996.676935][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 5996.677321][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 5996.677705][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 5996.677984][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 5996.678236][ C2] default_idle_call+0x69/0xa0 [ 5996.678470][ C2] cpuidle_idle_call+0x1f6/0x280 [ 5996.678711][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 5996.678982][ C2] ? lock_release+0x1d5/0x250 [ 5996.679211][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 5996.679476][ C2] do_idle+0xfb/0x160 [ 5996.679672][ C2] cpu_startup_entry+0x55/0x60 [ 5996.679907][ C2] start_secondary+0x21c/0x2b0 [ 5996.680141][ C2] ? __pfx_start_secondary+0x10/0x10 [ 5996.680402][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 5996.680726][ C2] [ 6024.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3419s! [perl:4135] [ 6024.569690][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6024.570945][ C1] irq event stamp: 209232 [ 6024.571163][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6024.571697][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6024.572162][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6024.572618][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6024.573067][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6024.573504][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6024.574101][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6024.574418][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6024.575359][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6024.575659][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6024.576046][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6024.576434][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6024.576822][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6024.577212][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6024.577600][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6024.578035][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6024.578358][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6024.578749][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6024.579139][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6024.579526][ C1] PKRU: 55555554 [ 6024.579703][ C1] Call Trace: [ 6024.579870][ C1] [ 6024.580013][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6024.580269][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6024.580532][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6024.580808][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6024.581080][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6024.581370][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6024.581643][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6024.581941][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6024.582199][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6024.582501][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6024.582787][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6024.583094][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6024.583377][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6024.583663][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6024.583946][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6024.584250][ C1] ? get_stack_info+0x36/0xc0 [ 6024.584484][ C1] ? lock_acquire+0x1c1/0x220 [ 6024.584718][ C1] ? lock_release+0x1d5/0x250 [ 6024.584954][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6024.585198][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6024.585462][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6024.585739][ C1] ? lock_acquire+0x1c1/0x220 [ 6024.585971][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6024.586207][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6024.586459][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6024.586688][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6024.586928][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6024.587179][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6024.587447][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6024.587716][ C1] ip_local_deliver+0x19d/0x480 [ 6024.587958][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6024.588222][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6024.588478][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6024.588818][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6024.589065][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6024.589377][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6024.589633][ C1] ip_rcv+0x564/0x740 [ 6024.589831][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6024.590055][ C1] ? set_track_prepare+0x8a/0xd0 [ 6024.590303][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6024.590600][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6024.590871][ C1] ? skb_clone+0x10b/0x330 [ 6024.591099][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6024.591419][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6024.591728][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6024.592004][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6024.592290][ C1] ? __tcf_classify+0x329/0x7d0 [ 6024.592533][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6024.592758][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6024.593048][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6024.593328][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6024.593645][ C1] ? lock_acquire+0x1c1/0x220 [ 6024.593879][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6024.594166][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6024.594446][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6024.594755][ C1] ? __copy_skb_header+0xaf/0x490 [ 6024.595006][ C1] ? __skb_clone+0x57a/0x760 [ 6024.595233][ C1] netif_receive_skb+0x55/0x280 [ 6024.595475][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6024.595781][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6024.596104][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6024.596396][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6024.596663][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6024.596943][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6024.597248][ C1] ? hlock_class+0x4e/0x130 [ 6024.597476][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6024.597744][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6024.598013][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6024.598271][ C1] ? hlock_class+0x4e/0x130 [ 6024.598495][ C1] ? mark_lock+0x38/0x3e0 [ 6024.598711][ C1] ? stack_access_ok+0xda/0x1f0 [ 6024.598952][ C1] ? __lock_acquire+0xb67/0x1610 [ 6024.599199][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6024.599470][ C1] ? get_stack_info+0x36/0xc0 [ 6024.599703][ C1] ? stack_access_ok+0xda/0x1f0 [ 6024.599942][ C1] ? get_reg+0x119/0x190 [ 6024.600156][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6024.600439][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6024.600749][ C1] __tcf_classify+0x329/0x7d0 [ 6024.600990][ C1] tcf_classify+0x283/0x930 [ 6024.601222][ C1] ? arch_stack_walk+0xa2/0x100 [ 6024.601471][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6024.601734][ C1] ? get_stack_info+0x36/0xc0 [ 6024.601969][ C1] tc_run+0x2e4/0x5d0 [ 6024.602168][ C1] ? __pfx_tc_run+0x10/0x10 [ 6024.602394][ C1] ? lock_acquire+0x1c1/0x220 [ 6024.602625][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6024.602879][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6024.603129][ C1] ? lock_acquire+0x1c1/0x220 [ 6024.603362][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6024.603619][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6024.603917][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6024.604182][ C1] ? neigh_hh_output+0x348/0x590 [ 6024.604428][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6024.604685][ C1] ip_finish_output2+0x786/0x18e0 [ 6024.604935][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6024.605208][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6024.605537][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6024.605805][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6024.606052][ C1] ? __ip_finish_output+0x10f/0x770 [ 6024.606310][ C1] ip_output+0x16b/0x4f0 [ 6024.606521][ C1] ? run_timer_softirq+0x72/0x100 [ 6024.606771][ C1] ? __pfx_ip_output+0x10/0x10 [ 6024.607008][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6024.607289][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6024.607534][ C1] ? ip_local_out+0x114/0x3b0 [ 6024.607768][ C1] __ip_queue_xmit+0x672/0x1910 [ 6024.608028][ C1] ? __create_object+0x5e/0xb0 [ 6024.608272][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6024.608539][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6024.608823][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6024.609095][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6024.609376][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6024.609649][ C1] tcp_delack_timer+0x84/0x240 [ 6024.609893][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6024.610166][ C1] call_timer_fn+0x173/0x430 [ 6024.610406][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6024.610670][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6024.610931][ C1] __run_timers.part.0+0x52d/0x890 [ 6024.611193][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6024.611469][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6024.611756][ C1] ? lock_acquire+0x1c1/0x220 [ 6024.611989][ C1] ? clockevents_program_event+0xf6/0x300 [ 6024.612271][ C1] ? lock_release+0x1d5/0x250 [ 6024.612505][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6024.612762][ C1] ? ktime_get+0xb3/0x190 [ 6024.612978][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6024.613266][ C1] run_timer_softirq+0x72/0x100 [ 6024.613508][ C1] __do_softirq+0x1b9/0x7ff [ 6024.613735][ C1] irq_exit_rcu+0x98/0xc0 [ 6024.613948][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6024.614228][ C1] [ 6024.614374][ C1] [ 6024.614520][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6024.614817][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6024.615133][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6024.616076][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6024.616377][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6024.616766][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6024.617155][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6024.617544][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6024.617930][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6024.618321][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6024.618610][ C1] pipe_read+0xa16/0xdf0 [ 6024.618825][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6024.619097][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6024.619335][ C1] ? iterate_tty_write+0x299/0x540 [ 6024.619590][ C1] ? lock_release+0x1d5/0x250 [ 6024.619822][ C1] vfs_read+0x911/0xc00 [ 6024.620033][ C1] ? lock_acquire+0x1c1/0x220 [ 6024.620265][ C1] ? __might_fault+0xc6/0x180 [ 6024.620523][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6024.620763][ C1] ? __might_fault+0xc6/0x180 [ 6024.621003][ C1] ? lock_release+0x1d5/0x250 [ 6024.621242][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6024.621508][ C1] ? __fget_light+0x54/0x1e0 [ 6024.621749][ C1] ksys_read+0x17a/0x1e0 [ 6024.621962][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6024.622199][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6024.622496][ C1] do_syscall_64+0xc9/0x1e0 [ 6024.622723][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6024.623015][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6024.623237][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6024.624180][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6024.624592][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6024.624979][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6024.625368][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6024.625757][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6024.626147][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6024.626539][ C1] [ 6024.626692][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3419s! [swapper/2:0] [ 6024.627095][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6024.628299][ C2] irq event stamp: 44114564 [ 6024.628519][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6024.629037][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6024.629532][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6024.629993][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6024.630467][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6024.630917][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6024.631538][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6024.631850][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6024.632788][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6024.633086][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6024.633469][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6024.633855][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6024.634242][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6024.634627][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6024.635012][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6024.635442][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6024.635761][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6024.636151][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6024.636536][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6024.636922][ C2] PKRU: 55555554 [ 6024.637098][ C2] Call Trace: [ 6024.637262][ C2] [ 6024.637404][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6024.637656][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6024.637891][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6024.638157][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6024.638423][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6024.638700][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6024.638955][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6024.639251][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6024.639503][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6024.639756][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6024.640055][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6024.640361][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6024.640671][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6024.640960][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6024.641253][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6024.641550][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6024.641850][ C2] ? get_stack_info+0x36/0xc0 [ 6024.642083][ C2] ? lock_acquire+0x1c1/0x220 [ 6024.642313][ C2] ? lock_release+0x1d5/0x250 [ 6024.642546][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6024.642786][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6024.643048][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6024.643326][ C2] ? lock_acquire+0x1c1/0x220 [ 6024.643555][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6024.643787][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6024.644038][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6024.644269][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6024.644508][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6024.644756][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6024.645020][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6024.645286][ C2] ip_local_deliver+0x19d/0x480 [ 6024.645525][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6024.645787][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6024.646042][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6024.646377][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6024.646621][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6024.646930][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6024.647183][ C2] ip_rcv+0x564/0x740 [ 6024.647380][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6024.647604][ C2] ? set_track_prepare+0x8a/0xd0 [ 6024.647848][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6024.648115][ C2] ? start_secondary+0x21c/0x2b0 [ 6024.648358][ C2] ? skb_clone+0x10b/0x330 [ 6024.648576][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6024.648883][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6024.649180][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6024.649451][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6024.649738][ C2] ? __tcf_classify+0x329/0x7d0 [ 6024.649979][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6024.650202][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6024.650516][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6024.650799][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6024.651122][ C2] ? lock_acquire+0x1c1/0x220 [ 6024.651357][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6024.651658][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6024.651933][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6024.652240][ C2] ? __copy_skb_header+0xaf/0x490 [ 6024.652488][ C2] ? __skb_clone+0x57a/0x760 [ 6024.652714][ C2] netif_receive_skb+0x55/0x280 [ 6024.652954][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6024.653254][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6024.653574][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6024.653864][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6024.654130][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6024.654406][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6024.654712][ C2] ? get_stack_info+0x36/0xc0 [ 6024.654946][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6024.655202][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6024.655508][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6024.655774][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6024.656042][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6024.656345][ C2] ? kernel_text_address+0x17/0xe0 [ 6024.656598][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6024.656899][ C2] ? arch_stack_walk+0x8c/0x100 [ 6024.657139][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6024.657395][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6024.657672][ C2] ? lock_acquire+0x1c1/0x220 [ 6024.657902][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6024.658175][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6024.658469][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6024.658735][ C2] ? get_stack_info+0x36/0xc0 [ 6024.658968][ C2] __tcf_classify+0x329/0x7d0 [ 6024.659201][ C2] tcf_classify+0x283/0x930 [ 6024.659425][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6024.659672][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6024.659973][ C2] tc_run+0x2e4/0x5d0 [ 6024.660171][ C2] ? __pfx_tc_run+0x10/0x10 [ 6024.660417][ C2] ? lock_acquire+0x1c1/0x220 [ 6024.660652][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6024.660912][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6024.661163][ C2] ? lock_acquire+0x1c1/0x220 [ 6024.661399][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6024.661687][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6024.661988][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6024.662257][ C2] ? neigh_hh_output+0x348/0x590 [ 6024.662508][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6024.662781][ C2] ip_finish_output2+0x786/0x18e0 [ 6024.663028][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6024.663355][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6024.663625][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6024.663869][ C2] ? __ip_finish_output+0x10f/0x770 [ 6024.664125][ C2] ip_output+0x16b/0x4f0 [ 6024.664333][ C2] ? __pfx_ip_output+0x10/0x10 [ 6024.664569][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6024.664836][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6024.665136][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6024.665405][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6024.665648][ C2] ? __alloc_skb+0xd4/0x280 [ 6024.665869][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6024.666129][ C2] ? tcp_fragment+0x168/0x1040 [ 6024.666364][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6024.666608][ C2] ? ip_local_out+0x114/0x3b0 [ 6024.666841][ C2] __ip_queue_xmit+0x672/0x1910 [ 6024.667081][ C2] ? __skb_clone+0x57a/0x760 [ 6024.667309][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6024.667568][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6024.667838][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6024.668078][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6024.668318][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6024.668607][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6024.668916][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6024.669153][ C2] tcp_send_loss_probe+0x348/0x830 [ 6024.669404][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6024.669663][ C2] tcp_write_timer+0x82/0x1d0 [ 6024.669895][ C2] call_timer_fn+0x173/0x430 [ 6024.670124][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6024.670401][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6024.670660][ C2] __run_timers.part.0+0x52d/0x890 [ 6024.670918][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6024.671185][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6024.671468][ C2] ? lock_acquire+0x1c1/0x220 [ 6024.671710][ C2] ? clockevents_program_event+0xf6/0x300 [ 6024.671990][ C2] ? lock_release+0x1d5/0x250 [ 6024.672222][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6024.672478][ C2] ? ktime_get+0xb3/0x190 [ 6024.672690][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6024.672977][ C2] run_timer_softirq+0x72/0x100 [ 6024.673218][ C2] __do_softirq+0x1b9/0x7ff [ 6024.673441][ C2] irq_exit_rcu+0x98/0xc0 [ 6024.673656][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6024.673929][ C2] [ 6024.674076][ C2] [ 6024.674221][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6024.674515][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6024.674763][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6024.675700][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6024.675998][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6024.676383][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6024.676766][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6024.677151][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6024.677538][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6024.677924][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6024.678203][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6024.678454][ C2] default_idle_call+0x69/0xa0 [ 6024.678688][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6024.678931][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6024.679200][ C2] ? lock_release+0x1d5/0x250 [ 6024.679429][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6024.679694][ C2] do_idle+0xfb/0x160 [ 6024.679892][ C2] cpu_startup_entry+0x55/0x60 [ 6024.680126][ C2] start_secondary+0x21c/0x2b0 [ 6024.680380][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6024.680649][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6024.680956][ C2] [ 6049.661118][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6049.661487][ C1] rcu: 1-....: (3685618 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=903156 [ 6049.662050][ C1] rcu: (t=3694774 jiffies g=1882453 q=715 ncpus=4) [ 6049.662383][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6049.662831][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6049.663441][ C1] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 6049.663722][ C1] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 6049.664666][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000202 [ 6049.664966][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 6049.665356][ C1] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6049.665744][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 6049.666131][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6049.666521][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6049.666909][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6049.667344][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6049.667666][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6049.668057][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6049.668447][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6049.668835][ C1] PKRU: 55555554 [ 6049.669012][ C1] Call Trace: [ 6049.669177][ C1] [ 6049.669322][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6049.669587][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6049.669833][ C1] ? check_cpu_stall+0x284/0x500 [ 6049.670080][ C1] ? rcu_pending+0x92/0x360 [ 6049.670327][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6049.670597][ C1] ? update_process_times+0xb9/0x110 [ 6049.670866][ C1] ? tick_sched_handle+0x67/0x130 [ 6049.671123][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6049.671416][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6049.671653][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6049.671956][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6049.672221][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6049.672503][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6049.672762][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6049.673060][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6049.673314][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 6049.673568][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6049.673869][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6049.674156][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6049.674461][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6049.674745][ C1] ? kasan_check_range+0x84/0x1c0 [ 6049.674994][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6049.675268][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6049.675572][ C1] ? get_stack_info+0x36/0xc0 [ 6049.675806][ C1] ? lock_acquire+0x1c1/0x220 [ 6049.676038][ C1] ? lock_release+0x1d5/0x250 [ 6049.676272][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6049.676514][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6049.676778][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6049.677057][ C1] ? lock_acquire+0x1c1/0x220 [ 6049.677287][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6049.677523][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6049.677775][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6049.678005][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6049.678246][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6049.678499][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6049.678767][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6049.679036][ C1] ip_local_deliver+0x19d/0x480 [ 6049.679277][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6049.679544][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6049.679803][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6049.680142][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6049.680413][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6049.680734][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6049.680997][ C1] ip_rcv+0x564/0x740 [ 6049.681202][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6049.681443][ C1] ? set_track_prepare+0x8a/0xd0 [ 6049.681690][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6049.681959][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6049.682224][ C1] ? skb_clone+0x10b/0x330 [ 6049.682447][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6049.682759][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6049.683056][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6049.683335][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6049.683620][ C1] ? __tcf_classify+0x329/0x7d0 [ 6049.683864][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6049.684089][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6049.684381][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6049.684661][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6049.684978][ C1] ? lock_acquire+0x1c1/0x220 [ 6049.685212][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6049.685500][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6049.685780][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6049.686090][ C1] ? __copy_skb_header+0xaf/0x490 [ 6049.686342][ C1] ? __skb_clone+0x57a/0x760 [ 6049.686568][ C1] netif_receive_skb+0x55/0x280 [ 6049.686812][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6049.687117][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6049.687440][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6049.687733][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6049.688000][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6049.688280][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6049.688585][ C1] ? hlock_class+0x4e/0x130 [ 6049.688814][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6049.689083][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6049.689353][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6049.689612][ C1] ? hlock_class+0x4e/0x130 [ 6049.689836][ C1] ? mark_lock+0x38/0x3e0 [ 6049.690052][ C1] ? stack_access_ok+0xda/0x1f0 [ 6049.690317][ C1] ? __lock_acquire+0xb67/0x1610 [ 6049.690575][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6049.690853][ C1] ? get_stack_info+0x36/0xc0 [ 6049.691095][ C1] ? stack_access_ok+0xda/0x1f0 [ 6049.691341][ C1] ? get_reg+0x119/0x190 [ 6049.691565][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6049.691827][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6049.692129][ C1] __tcf_classify+0x329/0x7d0 [ 6049.692366][ C1] tcf_classify+0x283/0x930 [ 6049.692592][ C1] ? arch_stack_walk+0xa2/0x100 [ 6049.692834][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6049.693085][ C1] ? get_stack_info+0x36/0xc0 [ 6049.693321][ C1] tc_run+0x2e4/0x5d0 [ 6049.693521][ C1] ? __pfx_tc_run+0x10/0x10 [ 6049.693748][ C1] ? lock_acquire+0x1c1/0x220 [ 6049.693979][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6049.694235][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6049.694481][ C1] ? lock_acquire+0x1c1/0x220 [ 6049.694715][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6049.694972][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6049.695272][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6049.695537][ C1] ? neigh_hh_output+0x348/0x590 [ 6049.695783][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6049.696041][ C1] ip_finish_output2+0x786/0x18e0 [ 6049.696292][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6049.696565][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6049.696895][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6049.697164][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6049.697411][ C1] ? __ip_finish_output+0x10f/0x770 [ 6049.697669][ C1] ip_output+0x16b/0x4f0 [ 6049.697882][ C1] ? run_timer_softirq+0x72/0x100 [ 6049.698132][ C1] ? __pfx_ip_output+0x10/0x10 [ 6049.698369][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6049.698651][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6049.698919][ C1] ? ip_local_out+0x114/0x3b0 [ 6049.699159][ C1] __ip_queue_xmit+0x672/0x1910 [ 6049.699407][ C1] ? __create_object+0x5e/0xb0 [ 6049.699653][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6049.699931][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6049.700211][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6049.700501][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6049.700782][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6049.701056][ C1] tcp_delack_timer+0x84/0x240 [ 6049.701299][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6049.701581][ C1] call_timer_fn+0x173/0x430 [ 6049.701809][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6049.702064][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6049.702321][ C1] __run_timers.part.0+0x52d/0x890 [ 6049.702575][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6049.702847][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6049.703124][ C1] ? lock_acquire+0x1c1/0x220 [ 6049.703358][ C1] ? clockevents_program_event+0xf6/0x300 [ 6049.703641][ C1] ? lock_release+0x1d5/0x250 [ 6049.703875][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6049.704132][ C1] ? ktime_get+0xb3/0x190 [ 6049.704349][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6049.704637][ C1] run_timer_softirq+0x72/0x100 [ 6049.704881][ C1] __do_softirq+0x1b9/0x7ff [ 6049.705109][ C1] irq_exit_rcu+0x98/0xc0 [ 6049.705323][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6049.705604][ C1] [ 6049.705749][ C1] [ 6049.705897][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6049.706194][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6049.706510][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6049.707461][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6049.707761][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6049.708151][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6049.708542][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6049.708932][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6049.709321][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6049.709714][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6049.710003][ C1] pipe_read+0xa16/0xdf0 [ 6049.710238][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6049.710521][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6049.710766][ C1] ? iterate_tty_write+0x299/0x540 [ 6049.711028][ C1] ? lock_release+0x1d5/0x250 [ 6049.711268][ C1] vfs_read+0x911/0xc00 [ 6049.711494][ C1] ? lock_acquire+0x1c1/0x220 [ 6049.711727][ C1] ? __might_fault+0xc6/0x180 [ 6049.711960][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6049.712195][ C1] ? __might_fault+0xc6/0x180 [ 6049.712430][ C1] ? lock_release+0x1d5/0x250 [ 6049.712662][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6049.712923][ C1] ? __fget_light+0x54/0x1e0 [ 6049.713153][ C1] ksys_read+0x17a/0x1e0 [ 6049.713367][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6049.713605][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6049.713902][ C1] do_syscall_64+0xc9/0x1e0 [ 6049.714131][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6049.714424][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6049.714645][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6049.715590][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6049.716004][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6049.716393][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6049.716782][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6049.717173][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6049.717562][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6049.717954][ C1] [ 6049.718109][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6049.718374][ C2] NMI backtrace for cpu 2 [ 6049.718379][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6049.718385][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6049.718388][ C2] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 6049.718396][ C2] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 ca 35 0c fe 89 d8 [ 6049.718402][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000246 [ 6049.718406][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6049.718410][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6049.718414][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6049.718417][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6049.718421][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6049.718425][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6049.718429][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6049.718434][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6049.718438][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6049.718441][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6049.718445][ C2] PKRU: 55555554 [ 6049.718447][ C2] Call Trace: [ 6049.718449][ C2] [ 6049.718452][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6049.718464][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6049.718471][ C2] ? nmi_handle+0x153/0x420 [ 6049.718481][ C2] ? default_do_nmi+0x41/0x100 [ 6049.718487][ C2] ? exc_nmi+0xf3/0x120 [ 6049.718493][ C2] ? end_repeat_nmi+0xf/0x60 [ 6049.718504][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6049.718512][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 6049.718520][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 6049.718528][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 6049.718536][ C2] [ 6049.718538][ C2] [ 6049.718540][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6049.718547][ C2] ? get_stack_info+0x36/0xc0 [ 6049.718555][ C2] ? lock_acquire+0x1c1/0x220 [ 6049.718563][ C2] ? lock_release+0x1d5/0x250 [ 6049.718571][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6049.718580][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6049.718586][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6049.718594][ C2] ? lock_acquire+0x1c1/0x220 [ 6049.718600][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6049.718608][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6049.718614][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6049.718630][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6049.718636][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6049.718648][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6049.718657][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6049.718665][ C2] ip_local_deliver+0x19d/0x480 [ 6049.718671][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6049.718676][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6049.718682][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6049.718693][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6049.718700][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6049.718707][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6049.718728][ C2] ip_rcv+0x564/0x740 [ 6049.718734][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6049.718740][ C2] ? set_track_prepare+0x8a/0xd0 [ 6049.718748][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6049.718755][ C2] ? start_secondary+0x21c/0x2b0 [ 6049.718761][ C2] ? skb_clone+0x10b/0x330 [ 6049.718766][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6049.718781][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6049.718795][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6049.718802][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6049.718822][ C2] ? __tcf_classify+0x329/0x7d0 [ 6049.718830][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6049.718835][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6049.718843][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6049.718851][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6049.718861][ C2] ? lock_acquire+0x1c1/0x220 [ 6049.718866][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6049.718877][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6049.718885][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6049.718895][ C2] ? __copy_skb_header+0xaf/0x490 [ 6049.718904][ C2] ? __skb_clone+0x57a/0x760 [ 6049.718910][ C2] netif_receive_skb+0x55/0x280 [ 6049.718918][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6049.718935][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6049.718952][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6049.718970][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6049.718981][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6049.719007][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6049.719026][ C2] ? get_stack_info+0x36/0xc0 [ 6049.719038][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6049.719044][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6049.719052][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6049.719058][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6049.719067][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6049.719073][ C2] ? kernel_text_address+0x17/0xe0 [ 6049.719080][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6049.719088][ C2] ? arch_stack_walk+0x8c/0x100 [ 6049.719096][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6049.719103][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6049.719111][ C2] ? lock_acquire+0x1c1/0x220 [ 6049.719117][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6049.719125][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6049.719133][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6049.719140][ C2] ? get_stack_info+0x36/0xc0 [ 6049.719146][ C2] __tcf_classify+0x329/0x7d0 [ 6049.719151][ C2] tcf_classify+0x283/0x930 [ 6049.719155][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6049.719158][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6049.719162][ C2] tc_run+0x2e4/0x5d0 [ 6049.719166][ C2] ? __pfx_tc_run+0x10/0x10 [ 6049.719169][ C2] ? lock_acquire+0x1c1/0x220 [ 6049.719171][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6049.719175][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6049.719178][ C2] ? lock_acquire+0x1c1/0x220 [ 6049.719181][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6049.719184][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6049.719186][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6049.719189][ C2] ? neigh_hh_output+0x348/0x590 [ 6049.719193][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6049.719196][ C2] ip_finish_output2+0x786/0x18e0 [ 6049.719199][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6049.719207][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6049.719209][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6049.719213][ C2] ? __ip_finish_output+0x10f/0x770 [ 6049.719216][ C2] ip_output+0x16b/0x4f0 [ 6049.719219][ C2] ? __pfx_ip_output+0x10/0x10 [ 6049.719221][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6049.719224][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6049.719227][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6049.719230][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6049.719232][ C2] ? __alloc_skb+0xd4/0x280 [ 6049.719235][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6049.719238][ C2] ? tcp_fragment+0x168/0x1040 [ 6049.719241][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6049.719244][ C2] ? ip_local_out+0x114/0x3b0 [ 6049.719247][ C2] __ip_queue_xmit+0x672/0x1910 [ 6049.719251][ C2] ? __skb_clone+0x57a/0x760 [ 6049.719253][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6049.719259][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6049.719262][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6049.719265][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6049.719269][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6049.719273][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6049.719276][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6049.719279][ C2] tcp_send_loss_probe+0x348/0x830 [ 6049.719283][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6049.719285][ C2] tcp_write_timer+0x82/0x1d0 [ 6049.719288][ C2] call_timer_fn+0x173/0x430 [ 6049.719292][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6049.719296][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6049.719301][ C2] __run_timers.part.0+0x52d/0x890 [ 6049.719303][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6049.719307][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6049.719310][ C2] ? lock_acquire+0x1c1/0x220 [ 6049.719312][ C2] ? clockevents_program_event+0xf6/0x300 [ 6049.719316][ C2] ? lock_release+0x1d5/0x250 [ 6049.719319][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6049.719322][ C2] ? ktime_get+0xb3/0x190 [ 6049.719325][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6049.719329][ C2] run_timer_softirq+0x72/0x100 [ 6049.719333][ C2] __do_softirq+0x1b9/0x7ff [ 6049.719337][ C2] irq_exit_rcu+0x98/0xc0 [ 6049.719339][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6049.719342][ C2] [ 6049.719343][ C2] [ 6049.719344][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6049.719347][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6049.719350][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6049.719352][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6049.719353][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6049.719355][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6049.719356][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6049.719357][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6049.719359][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6049.719362][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6049.719365][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6049.719367][ C2] default_idle_call+0x69/0xa0 [ 6049.719370][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6049.719372][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6049.719376][ C2] ? lock_release+0x1d5/0x250 [ 6049.719378][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6049.719382][ C2] do_idle+0xfb/0x160 [ 6049.719384][ C2] cpu_startup_entry+0x55/0x60 [ 6049.719386][ C2] start_secondary+0x21c/0x2b0 [ 6049.719389][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6049.719393][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6049.719398][ C2] [ 6076.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3468s! [perl:4135] [ 6076.569672][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6076.570932][ C1] irq event stamp: 209232 [ 6076.571151][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6076.571676][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6076.572137][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6076.572594][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6076.573043][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6076.573479][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6076.574073][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6076.574387][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6076.575336][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6076.575635][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6076.576026][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6076.576416][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6076.576803][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6076.577192][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6076.577582][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6076.578018][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6076.578342][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6076.578732][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6076.579119][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6076.579511][ C1] PKRU: 55555554 [ 6076.579687][ C1] Call Trace: [ 6076.579852][ C1] [ 6076.579996][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6076.580274][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6076.580515][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6076.580794][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6076.581066][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6076.581362][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6076.581620][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6076.581916][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6076.582170][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6076.582471][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6076.582760][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6076.583065][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6076.583345][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6076.583634][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6076.583914][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6076.584218][ C1] ? get_stack_info+0x36/0xc0 [ 6076.584453][ C1] ? lock_acquire+0x1c1/0x220 [ 6076.584687][ C1] ? lock_release+0x1d5/0x250 [ 6076.584919][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6076.585161][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6076.585427][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6076.585704][ C1] ? lock_acquire+0x1c1/0x220 [ 6076.585937][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6076.586172][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6076.586426][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6076.586653][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6076.586893][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6076.587145][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6076.587411][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6076.587683][ C1] ip_local_deliver+0x19d/0x480 [ 6076.587923][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6076.588188][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6076.588445][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6076.588781][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6076.589027][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6076.589339][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6076.589593][ C1] ip_rcv+0x564/0x740 [ 6076.589791][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6076.590017][ C1] ? set_track_prepare+0x8a/0xd0 [ 6076.590287][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6076.590562][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6076.590834][ C1] ? skb_clone+0x10b/0x330 [ 6076.591061][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6076.591388][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6076.591686][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6076.591960][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6076.592248][ C1] ? __tcf_classify+0x329/0x7d0 [ 6076.592489][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6076.592714][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6076.593006][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6076.593282][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6076.593599][ C1] ? lock_acquire+0x1c1/0x220 [ 6076.593832][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6076.594122][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6076.594398][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6076.594707][ C1] ? __copy_skb_header+0xaf/0x490 [ 6076.594957][ C1] ? __skb_clone+0x57a/0x760 [ 6076.595187][ C1] netif_receive_skb+0x55/0x280 [ 6076.595428][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6076.595730][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6076.596055][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6076.596345][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6076.596612][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6076.596893][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6076.597197][ C1] ? hlock_class+0x4e/0x130 [ 6076.597422][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6076.597693][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6076.597961][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6076.598218][ C1] ? hlock_class+0x4e/0x130 [ 6076.598446][ C1] ? mark_lock+0x38/0x3e0 [ 6076.598659][ C1] ? stack_access_ok+0xda/0x1f0 [ 6076.598900][ C1] ? __lock_acquire+0xb67/0x1610 [ 6076.599148][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6076.599415][ C1] ? get_stack_info+0x36/0xc0 [ 6076.599650][ C1] ? stack_access_ok+0xda/0x1f0 [ 6076.599890][ C1] ? get_reg+0x119/0x190 [ 6076.600124][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6076.600391][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6076.600700][ C1] __tcf_classify+0x329/0x7d0 [ 6076.600942][ C1] tcf_classify+0x283/0x930 [ 6076.601175][ C1] ? arch_stack_walk+0xa2/0x100 [ 6076.601430][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6076.601680][ C1] ? get_stack_info+0x36/0xc0 [ 6076.601914][ C1] tc_run+0x2e4/0x5d0 [ 6076.602113][ C1] ? __pfx_tc_run+0x10/0x10 [ 6076.602341][ C1] ? lock_acquire+0x1c1/0x220 [ 6076.602573][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6076.602828][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6076.603074][ C1] ? lock_acquire+0x1c1/0x220 [ 6076.603306][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6076.603564][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6076.603859][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6076.604128][ C1] ? neigh_hh_output+0x348/0x590 [ 6076.604374][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6076.604633][ C1] ip_finish_output2+0x786/0x18e0 [ 6076.604881][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6076.605152][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6076.605480][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6076.605749][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6076.605995][ C1] ? __ip_finish_output+0x10f/0x770 [ 6076.606254][ C1] ip_output+0x16b/0x4f0 [ 6076.606464][ C1] ? run_timer_softirq+0x72/0x100 [ 6076.606713][ C1] ? __pfx_ip_output+0x10/0x10 [ 6076.606951][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6076.607229][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6076.607473][ C1] ? ip_local_out+0x114/0x3b0 [ 6076.607707][ C1] __ip_queue_xmit+0x672/0x1910 [ 6076.607948][ C1] ? __create_object+0x5e/0xb0 [ 6076.608186][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6076.608446][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6076.608721][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6076.608986][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6076.609262][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6076.609526][ C1] tcp_delack_timer+0x84/0x240 [ 6076.609764][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6076.610029][ C1] call_timer_fn+0x173/0x430 [ 6076.610285][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6076.610546][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6076.610808][ C1] __run_timers.part.0+0x52d/0x890 [ 6076.611067][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6076.611349][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6076.611627][ C1] ? lock_acquire+0x1c1/0x220 [ 6076.611858][ C1] ? clockevents_program_event+0xf6/0x300 [ 6076.612142][ C1] ? lock_release+0x1d5/0x250 [ 6076.612375][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6076.612632][ C1] ? ktime_get+0xb3/0x190 [ 6076.612845][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6076.613136][ C1] run_timer_softirq+0x72/0x100 [ 6076.613378][ C1] __do_softirq+0x1b9/0x7ff [ 6076.613603][ C1] irq_exit_rcu+0x98/0xc0 [ 6076.613818][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6076.614095][ C1] [ 6076.614242][ C1] [ 6076.614389][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6076.614685][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6076.615001][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6076.615944][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6076.616243][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6076.616632][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6076.617020][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6076.617407][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6076.617797][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6076.618187][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6076.618476][ C1] pipe_read+0xa16/0xdf0 [ 6076.618691][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6076.618960][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6076.619198][ C1] ? iterate_tty_write+0x299/0x540 [ 6076.619451][ C1] ? lock_release+0x1d5/0x250 [ 6076.619685][ C1] vfs_read+0x911/0xc00 [ 6076.619893][ C1] ? lock_acquire+0x1c1/0x220 [ 6076.620147][ C1] ? __might_fault+0xc6/0x180 [ 6076.620388][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6076.620625][ C1] ? __might_fault+0xc6/0x180 [ 6076.620866][ C1] ? lock_release+0x1d5/0x250 [ 6076.621105][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6076.621379][ C1] ? __fget_light+0x54/0x1e0 [ 6076.621611][ C1] ksys_read+0x17a/0x1e0 [ 6076.621821][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6076.622059][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6076.622356][ C1] do_syscall_64+0xc9/0x1e0 [ 6076.622581][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6076.622874][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6076.623095][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6076.624040][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6076.624449][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6076.624836][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6076.625226][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6076.625614][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6076.626001][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6076.626392][ C1] [ 6076.626546][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3468s! [swapper/2:0] [ 6076.626941][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6076.628149][ C2] irq event stamp: 44114564 [ 6076.628369][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6076.628885][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6076.629379][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6076.629836][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6076.630317][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6076.630769][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6076.631380][ C2] RIP: 0010:kasan_check_range+0x81/0x1c0 [ 6076.631657][ C2] Code: 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da <48> 29 ea 48 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d [ 6076.632591][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000282 [ 6076.632888][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [ 6076.633273][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6076.633656][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [ 6076.634039][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6076.634426][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6076.634810][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6076.635241][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6076.635561][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6076.635946][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6076.636333][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6076.636717][ C2] PKRU: 55555554 [ 6076.636893][ C2] Call Trace: [ 6076.637055][ C2] [ 6076.637198][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6076.637451][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6076.637685][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6076.637952][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6076.638214][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6076.638495][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6076.638749][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6076.639044][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6076.639295][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 6076.639546][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6076.639802][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6076.640120][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6076.640410][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6076.640722][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6076.641009][ C2] ? kasan_check_range+0x81/0x1c0 [ 6076.641264][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 6076.641545][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6076.641844][ C2] ? get_stack_info+0x36/0xc0 [ 6076.642076][ C2] ? lock_acquire+0x1c1/0x220 [ 6076.642306][ C2] ? lock_release+0x1d5/0x250 [ 6076.642538][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6076.642778][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6076.643039][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6076.643316][ C2] ? lock_acquire+0x1c1/0x220 [ 6076.643545][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6076.643776][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6076.644026][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6076.644253][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6076.644492][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6076.644740][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6076.645004][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6076.645270][ C2] ip_local_deliver+0x19d/0x480 [ 6076.645508][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6076.645769][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6076.646024][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6076.646358][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6076.646601][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6076.646910][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6076.647162][ C2] ip_rcv+0x564/0x740 [ 6076.647357][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6076.647580][ C2] ? set_track_prepare+0x8a/0xd0 [ 6076.647823][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6076.648089][ C2] ? start_secondary+0x21c/0x2b0 [ 6076.648332][ C2] ? skb_clone+0x10b/0x330 [ 6076.648549][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6076.648855][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6076.649151][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6076.649422][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6076.649708][ C2] ? __tcf_classify+0x329/0x7d0 [ 6076.649947][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6076.650192][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6076.650487][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6076.650771][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6076.651093][ C2] ? lock_acquire+0x1c1/0x220 [ 6076.651339][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6076.651624][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6076.651899][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6076.652204][ C2] ? __copy_skb_header+0xaf/0x490 [ 6076.652453][ C2] ? __skb_clone+0x57a/0x760 [ 6076.652679][ C2] netif_receive_skb+0x55/0x280 [ 6076.652918][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6076.653219][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6076.653539][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6076.653827][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6076.654092][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6076.654369][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6076.654671][ C2] ? get_stack_info+0x36/0xc0 [ 6076.654904][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6076.655158][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6076.655462][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6076.655727][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6076.655994][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6076.656297][ C2] ? kernel_text_address+0x17/0xe0 [ 6076.656549][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6076.656849][ C2] ? arch_stack_walk+0x8c/0x100 [ 6076.657089][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6076.657343][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6076.657619][ C2] ? lock_acquire+0x1c1/0x220 [ 6076.657849][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6076.658121][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6076.658415][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6076.658680][ C2] ? get_stack_info+0x36/0xc0 [ 6076.658913][ C2] __tcf_classify+0x329/0x7d0 [ 6076.659145][ C2] tcf_classify+0x283/0x930 [ 6076.659370][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6076.659616][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6076.659918][ C2] tc_run+0x2e4/0x5d0 [ 6076.660136][ C2] ? __pfx_tc_run+0x10/0x10 [ 6076.660364][ C2] ? lock_acquire+0x1c1/0x220 [ 6076.660600][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6076.660858][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6076.661109][ C2] ? lock_acquire+0x1c1/0x220 [ 6076.661354][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6076.661608][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6076.661901][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6076.662162][ C2] ? neigh_hh_output+0x348/0x590 [ 6076.662427][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6076.662692][ C2] ip_finish_output2+0x786/0x18e0 [ 6076.662946][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6076.663281][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6076.663560][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6076.663803][ C2] ? __ip_finish_output+0x10f/0x770 [ 6076.664058][ C2] ip_output+0x16b/0x4f0 [ 6076.664266][ C2] ? __pfx_ip_output+0x10/0x10 [ 6076.664501][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6076.664768][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6076.665066][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6076.665336][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6076.665580][ C2] ? __alloc_skb+0xd4/0x280 [ 6076.665801][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6076.666061][ C2] ? tcp_fragment+0x168/0x1040 [ 6076.666295][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6076.666537][ C2] ? ip_local_out+0x114/0x3b0 [ 6076.666768][ C2] __ip_queue_xmit+0x672/0x1910 [ 6076.667008][ C2] ? __skb_clone+0x57a/0x760 [ 6076.667234][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6076.667492][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6076.667762][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6076.667997][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6076.668237][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6076.668525][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6076.668834][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6076.669070][ C2] tcp_send_loss_probe+0x348/0x830 [ 6076.669320][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6076.669579][ C2] tcp_write_timer+0x82/0x1d0 [ 6076.669810][ C2] call_timer_fn+0x173/0x430 [ 6076.670038][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6076.670316][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6076.670575][ C2] __run_timers.part.0+0x52d/0x890 [ 6076.670833][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6076.671098][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6076.671390][ C2] ? lock_acquire+0x1c1/0x220 [ 6076.671618][ C2] ? clockevents_program_event+0xf6/0x300 [ 6076.671898][ C2] ? lock_release+0x1d5/0x250 [ 6076.672129][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6076.672384][ C2] ? ktime_get+0xb3/0x190 [ 6076.672595][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6076.672881][ C2] run_timer_softirq+0x72/0x100 [ 6076.673122][ C2] __do_softirq+0x1b9/0x7ff [ 6076.673344][ C2] irq_exit_rcu+0x98/0xc0 [ 6076.673558][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6076.673830][ C2] [ 6076.673977][ C2] [ 6076.674120][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6076.674416][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6076.674664][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6076.675597][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6076.675893][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6076.676277][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6076.676659][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6076.677043][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6076.677430][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6076.677814][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6076.678092][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6076.678343][ C2] default_idle_call+0x69/0xa0 [ 6076.678576][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6076.678821][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6076.679090][ C2] ? lock_release+0x1d5/0x250 [ 6076.679319][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6076.679584][ C2] do_idle+0xfb/0x160 [ 6076.679780][ C2] cpu_startup_entry+0x55/0x60 [ 6076.680013][ C2] start_secondary+0x21c/0x2b0 [ 6076.680270][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6076.680539][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6076.680844][ C2] [ 6104.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3494s! [perl:4135] [ 6104.569674][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6104.570937][ C1] irq event stamp: 209232 [ 6104.571167][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6104.571680][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6104.572142][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6104.572600][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6104.573049][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6104.573485][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6104.574081][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6104.574397][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6104.575341][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6104.575639][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6104.576030][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6104.576419][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6104.576805][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6104.577191][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6104.577582][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6104.578018][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6104.578341][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6104.578729][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6104.579117][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6104.579506][ C1] PKRU: 55555554 [ 6104.579683][ C1] Call Trace: [ 6104.579846][ C1] [ 6104.580011][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6104.580273][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6104.580515][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6104.580794][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6104.581066][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6104.581360][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6104.581617][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6104.581913][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6104.582169][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6104.582469][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6104.582758][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6104.583064][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6104.583344][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6104.583633][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6104.583912][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6104.584217][ C1] ? get_stack_info+0x36/0xc0 [ 6104.584452][ C1] ? lock_acquire+0x1c1/0x220 [ 6104.584687][ C1] ? lock_release+0x1d5/0x250 [ 6104.584920][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6104.585162][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6104.585428][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6104.585705][ C1] ? lock_acquire+0x1c1/0x220 [ 6104.585938][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6104.586172][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6104.586426][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6104.586653][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6104.586894][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6104.587144][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6104.587410][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6104.587685][ C1] ip_local_deliver+0x19d/0x480 [ 6104.587926][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6104.588191][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6104.588447][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6104.588784][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6104.589030][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6104.589343][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6104.589598][ C1] ip_rcv+0x564/0x740 [ 6104.589797][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6104.590044][ C1] ? set_track_prepare+0x8a/0xd0 [ 6104.590297][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6104.590573][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6104.590847][ C1] ? skb_clone+0x10b/0x330 [ 6104.591074][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6104.591396][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6104.591693][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6104.591966][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6104.592254][ C1] ? __tcf_classify+0x329/0x7d0 [ 6104.592496][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6104.592719][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6104.593013][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6104.593306][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6104.593632][ C1] ? lock_acquire+0x1c1/0x220 [ 6104.593872][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6104.594170][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6104.594454][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6104.594773][ C1] ? __copy_skb_header+0xaf/0x490 [ 6104.595023][ C1] ? __skb_clone+0x57a/0x760 [ 6104.595252][ C1] netif_receive_skb+0x55/0x280 [ 6104.595494][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6104.595798][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6104.596122][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6104.596413][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6104.596680][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6104.596964][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6104.597270][ C1] ? hlock_class+0x4e/0x130 [ 6104.597495][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6104.597765][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6104.598034][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6104.598291][ C1] ? hlock_class+0x4e/0x130 [ 6104.598517][ C1] ? mark_lock+0x38/0x3e0 [ 6104.598731][ C1] ? stack_access_ok+0xda/0x1f0 [ 6104.598972][ C1] ? __lock_acquire+0xb67/0x1610 [ 6104.599220][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6104.599489][ C1] ? get_stack_info+0x36/0xc0 [ 6104.599723][ C1] ? stack_access_ok+0xda/0x1f0 [ 6104.599998][ C1] ? get_reg+0x119/0x190 [ 6104.600214][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6104.600484][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6104.600792][ C1] __tcf_classify+0x329/0x7d0 [ 6104.601035][ C1] tcf_classify+0x283/0x930 [ 6104.601277][ C1] ? arch_stack_walk+0xa2/0x100 [ 6104.601519][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6104.601772][ C1] ? get_stack_info+0x36/0xc0 [ 6104.602008][ C1] tc_run+0x2e4/0x5d0 [ 6104.602209][ C1] ? __pfx_tc_run+0x10/0x10 [ 6104.602434][ C1] ? lock_acquire+0x1c1/0x220 [ 6104.602667][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6104.602921][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6104.603171][ C1] ? lock_acquire+0x1c1/0x220 [ 6104.603404][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6104.603662][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6104.603958][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6104.604224][ C1] ? neigh_hh_output+0x348/0x590 [ 6104.604470][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6104.604729][ C1] ip_finish_output2+0x786/0x18e0 [ 6104.604979][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6104.605249][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6104.605577][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6104.605847][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6104.606092][ C1] ? __ip_finish_output+0x10f/0x770 [ 6104.606351][ C1] ip_output+0x16b/0x4f0 [ 6104.606561][ C1] ? run_timer_softirq+0x72/0x100 [ 6104.606812][ C1] ? __pfx_ip_output+0x10/0x10 [ 6104.607049][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6104.607327][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6104.607572][ C1] ? ip_local_out+0x114/0x3b0 [ 6104.607807][ C1] __ip_queue_xmit+0x672/0x1910 [ 6104.608050][ C1] ? __create_object+0x5e/0xb0 [ 6104.608288][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6104.608548][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6104.608823][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6104.609087][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6104.609364][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6104.609629][ C1] tcp_delack_timer+0x84/0x240 [ 6104.609868][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6104.610160][ C1] call_timer_fn+0x173/0x430 [ 6104.610397][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6104.610657][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6104.610919][ C1] __run_timers.part.0+0x52d/0x890 [ 6104.611191][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6104.611456][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6104.611734][ C1] ? lock_acquire+0x1c1/0x220 [ 6104.611965][ C1] ? clockevents_program_event+0xf6/0x300 [ 6104.612249][ C1] ? lock_release+0x1d5/0x250 [ 6104.612482][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6104.612740][ C1] ? ktime_get+0xb3/0x190 [ 6104.612953][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6104.613243][ C1] run_timer_softirq+0x72/0x100 [ 6104.613485][ C1] __do_softirq+0x1b9/0x7ff [ 6104.613710][ C1] irq_exit_rcu+0x98/0xc0 [ 6104.613926][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6104.614204][ C1] [ 6104.614350][ C1] [ 6104.614497][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6104.614794][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6104.615110][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6104.616056][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6104.616356][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6104.616743][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6104.617130][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6104.617517][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6104.617908][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6104.618298][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6104.618587][ C1] pipe_read+0xa16/0xdf0 [ 6104.618801][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6104.619073][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6104.619311][ C1] ? iterate_tty_write+0x299/0x540 [ 6104.619565][ C1] ? lock_release+0x1d5/0x250 [ 6104.619800][ C1] vfs_read+0x911/0xc00 [ 6104.620029][ C1] ? lock_acquire+0x1c1/0x220 [ 6104.620268][ C1] ? __might_fault+0xc6/0x180 [ 6104.620509][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6104.620747][ C1] ? __might_fault+0xc6/0x180 [ 6104.620987][ C1] ? lock_release+0x1d5/0x250 [ 6104.621237][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6104.621494][ C1] ? __fget_light+0x54/0x1e0 [ 6104.621726][ C1] ksys_read+0x17a/0x1e0 [ 6104.621936][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6104.622175][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6104.622473][ C1] do_syscall_64+0xc9/0x1e0 [ 6104.622697][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6104.622992][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6104.623214][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6104.624158][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6104.624565][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6104.624956][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6104.625346][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6104.625733][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6104.626120][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6104.626513][ C1] [ 6104.626666][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3494s! [swapper/2:0] [ 6104.627062][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6104.628266][ C2] irq event stamp: 44114564 [ 6104.628487][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6104.629002][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6104.629496][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6104.629957][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6104.630438][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6104.630891][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6104.631496][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6104.631807][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6104.632745][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6104.633040][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6104.633426][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6104.633811][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6104.634195][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6104.634580][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6104.634990][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6104.635434][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6104.635766][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6104.636166][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6104.636549][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6104.636936][ C2] PKRU: 55555554 [ 6104.637111][ C2] Call Trace: [ 6104.637274][ C2] [ 6104.637416][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6104.637671][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6104.637904][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6104.638174][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6104.638438][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6104.638716][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6104.638972][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6104.639266][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6104.639519][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6104.639774][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6104.640094][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6104.640389][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6104.640699][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6104.640985][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6104.641288][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6104.641565][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6104.641865][ C2] ? get_stack_info+0x36/0xc0 [ 6104.642098][ C2] ? lock_acquire+0x1c1/0x220 [ 6104.642330][ C2] ? lock_release+0x1d5/0x250 [ 6104.642562][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6104.642800][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6104.643064][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6104.643338][ C2] ? lock_acquire+0x1c1/0x220 [ 6104.643569][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6104.643802][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6104.644052][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6104.644277][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6104.644516][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6104.644764][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6104.645029][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6104.645298][ C2] ip_local_deliver+0x19d/0x480 [ 6104.645536][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6104.645799][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6104.646053][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6104.646387][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6104.646630][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6104.646939][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6104.647192][ C2] ip_rcv+0x564/0x740 [ 6104.647390][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6104.647612][ C2] ? set_track_prepare+0x8a/0xd0 [ 6104.647855][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6104.648122][ C2] ? start_secondary+0x21c/0x2b0 [ 6104.648365][ C2] ? skb_clone+0x10b/0x330 [ 6104.648584][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6104.648891][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6104.649187][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6104.649457][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6104.649740][ C2] ? __tcf_classify+0x329/0x7d0 [ 6104.650000][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6104.650230][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6104.650526][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6104.650809][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6104.651131][ C2] ? lock_acquire+0x1c1/0x220 [ 6104.651374][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6104.651660][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6104.651937][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6104.652244][ C2] ? __copy_skb_header+0xaf/0x490 [ 6104.652495][ C2] ? __skb_clone+0x57a/0x760 [ 6104.652723][ C2] netif_receive_skb+0x55/0x280 [ 6104.652963][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6104.653264][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6104.653585][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6104.653874][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6104.654139][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6104.654419][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6104.654721][ C2] ? get_stack_info+0x36/0xc0 [ 6104.654954][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6104.655209][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6104.655516][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6104.655783][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6104.656051][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6104.656357][ C2] ? kernel_text_address+0x17/0xe0 [ 6104.656609][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6104.656911][ C2] ? arch_stack_walk+0x8c/0x100 [ 6104.657151][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6104.657408][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6104.657682][ C2] ? lock_acquire+0x1c1/0x220 [ 6104.657913][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6104.658183][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6104.658479][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6104.658744][ C2] ? get_stack_info+0x36/0xc0 [ 6104.658978][ C2] __tcf_classify+0x329/0x7d0 [ 6104.659212][ C2] tcf_classify+0x283/0x930 [ 6104.659437][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6104.659684][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6104.660005][ C2] tc_run+0x2e4/0x5d0 [ 6104.660209][ C2] ? __pfx_tc_run+0x10/0x10 [ 6104.660438][ C2] ? lock_acquire+0x1c1/0x220 [ 6104.660674][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6104.660933][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6104.661194][ C2] ? lock_acquire+0x1c1/0x220 [ 6104.661425][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6104.661680][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6104.661973][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6104.662235][ C2] ? neigh_hh_output+0x348/0x590 [ 6104.662479][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6104.662754][ C2] ip_finish_output2+0x786/0x18e0 [ 6104.663009][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6104.663342][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6104.663616][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6104.663876][ C2] ? __ip_finish_output+0x10f/0x770 [ 6104.664132][ C2] ip_output+0x16b/0x4f0 [ 6104.664343][ C2] ? __pfx_ip_output+0x10/0x10 [ 6104.664578][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6104.664844][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6104.665145][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6104.665411][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6104.665654][ C2] ? __alloc_skb+0xd4/0x280 [ 6104.665877][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6104.666137][ C2] ? tcp_fragment+0x168/0x1040 [ 6104.666372][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6104.666615][ C2] ? ip_local_out+0x114/0x3b0 [ 6104.666844][ C2] __ip_queue_xmit+0x672/0x1910 [ 6104.667084][ C2] ? __skb_clone+0x57a/0x760 [ 6104.667312][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6104.667568][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6104.667838][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6104.668073][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6104.668314][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6104.668605][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6104.668914][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6104.669152][ C2] tcp_send_loss_probe+0x348/0x830 [ 6104.669402][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6104.669661][ C2] tcp_write_timer+0x82/0x1d0 [ 6104.669893][ C2] call_timer_fn+0x173/0x430 [ 6104.670143][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6104.670402][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6104.670662][ C2] __run_timers.part.0+0x52d/0x890 [ 6104.670920][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6104.671199][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6104.671473][ C2] ? lock_acquire+0x1c1/0x220 [ 6104.671704][ C2] ? clockevents_program_event+0xf6/0x300 [ 6104.671982][ C2] ? lock_release+0x1d5/0x250 [ 6104.672213][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6104.672468][ C2] ? ktime_get+0xb3/0x190 [ 6104.672683][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6104.672967][ C2] run_timer_softirq+0x72/0x100 [ 6104.673208][ C2] __do_softirq+0x1b9/0x7ff [ 6104.673433][ C2] irq_exit_rcu+0x98/0xc0 [ 6104.673644][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6104.673921][ C2] [ 6104.674065][ C2] [ 6104.674211][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6104.674504][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6104.674751][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6104.675686][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6104.675983][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6104.676367][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6104.676755][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6104.677140][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6104.677524][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6104.677908][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6104.678189][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6104.678440][ C2] default_idle_call+0x69/0xa0 [ 6104.678677][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6104.678919][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6104.679186][ C2] ? lock_release+0x1d5/0x250 [ 6104.679417][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6104.679680][ C2] do_idle+0xfb/0x160 [ 6104.679877][ C2] cpu_startup_entry+0x55/0x60 [ 6104.680141][ C2] start_secondary+0x21c/0x2b0 [ 6104.680383][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6104.680650][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6104.680958][ C2] [ 6127.720118][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6127.720487][ C1] rcu: 1-....: (3763507 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=922403 [ 6127.721044][ C1] rcu: (t=3772833 jiffies g=1882453 q=715 ncpus=4) [ 6127.721379][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6127.721814][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6127.722413][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6127.722733][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6127.723678][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6127.723979][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6127.724367][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6127.724756][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6127.725145][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6127.725535][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6127.725923][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6127.726359][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6127.726683][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6127.727074][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6127.727466][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6127.727853][ C1] PKRU: 55555554 [ 6127.728031][ C1] Call Trace: [ 6127.728198][ C1] [ 6127.728342][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6127.728608][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6127.728855][ C1] ? check_cpu_stall+0x284/0x500 [ 6127.729101][ C1] ? rcu_pending+0x92/0x360 [ 6127.729327][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6127.729591][ C1] ? update_process_times+0xb9/0x110 [ 6127.729857][ C1] ? tick_sched_handle+0x67/0x130 [ 6127.730132][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6127.730416][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6127.730660][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6127.730973][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6127.731250][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6127.731532][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6127.731791][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6127.732091][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6127.732347][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6127.732649][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6127.732937][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6127.733245][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6127.733527][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6127.733814][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6127.734097][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6127.734401][ C1] ? get_stack_info+0x36/0xc0 [ 6127.734634][ C1] ? lock_acquire+0x1c1/0x220 [ 6127.734870][ C1] ? lock_release+0x1d5/0x250 [ 6127.735104][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6127.735347][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6127.735612][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6127.735892][ C1] ? lock_acquire+0x1c1/0x220 [ 6127.736127][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6127.736362][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6127.736616][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6127.736845][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6127.737085][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6127.737337][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6127.737609][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6127.737879][ C1] ip_local_deliver+0x19d/0x480 [ 6127.738121][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6127.738388][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6127.738646][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6127.738988][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6127.739236][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6127.739549][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6127.739807][ C1] ip_rcv+0x564/0x740 [ 6127.740032][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6127.740263][ C1] ? set_track_prepare+0x8a/0xd0 [ 6127.740519][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6127.740800][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6127.741085][ C1] ? skb_clone+0x10b/0x330 [ 6127.741308][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6127.741619][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6127.741922][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6127.742199][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6127.742489][ C1] ? __tcf_classify+0x329/0x7d0 [ 6127.742733][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6127.742958][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6127.743254][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6127.743535][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6127.743854][ C1] ? lock_acquire+0x1c1/0x220 [ 6127.744086][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6127.744377][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6127.744657][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6127.744966][ C1] ? __copy_skb_header+0xaf/0x490 [ 6127.745219][ C1] ? __skb_clone+0x57a/0x760 [ 6127.745449][ C1] netif_receive_skb+0x55/0x280 [ 6127.745693][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6127.746000][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6127.746326][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6127.746620][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6127.746889][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6127.747171][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6127.747477][ C1] ? hlock_class+0x4e/0x130 [ 6127.747706][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6127.747976][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6127.748246][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6127.748505][ C1] ? hlock_class+0x4e/0x130 [ 6127.748733][ C1] ? mark_lock+0x38/0x3e0 [ 6127.748949][ C1] ? stack_access_ok+0xda/0x1f0 [ 6127.749192][ C1] ? __lock_acquire+0xb67/0x1610 [ 6127.749440][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6127.749712][ C1] ? get_stack_info+0x36/0xc0 [ 6127.749970][ C1] ? stack_access_ok+0xda/0x1f0 [ 6127.750219][ C1] ? get_reg+0x119/0x190 [ 6127.750438][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6127.750709][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6127.751019][ C1] __tcf_classify+0x329/0x7d0 [ 6127.751266][ C1] tcf_classify+0x283/0x930 [ 6127.751494][ C1] ? arch_stack_walk+0xa2/0x100 [ 6127.751738][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6127.751991][ C1] ? get_stack_info+0x36/0xc0 [ 6127.752227][ C1] tc_run+0x2e4/0x5d0 [ 6127.752428][ C1] ? __pfx_tc_run+0x10/0x10 [ 6127.752652][ C1] ? lock_acquire+0x1c1/0x220 [ 6127.752887][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6127.753142][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6127.753410][ C1] ? lock_acquire+0x1c1/0x220 [ 6127.753650][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6127.753916][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6127.754225][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6127.754508][ C1] ? neigh_hh_output+0x348/0x590 [ 6127.754756][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6127.755015][ C1] ip_finish_output2+0x786/0x18e0 [ 6127.755266][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6127.755538][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6127.755871][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6127.756142][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6127.756390][ C1] ? __ip_finish_output+0x10f/0x770 [ 6127.756651][ C1] ip_output+0x16b/0x4f0 [ 6127.756862][ C1] ? run_timer_softirq+0x72/0x100 [ 6127.757113][ C1] ? __pfx_ip_output+0x10/0x10 [ 6127.757353][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6127.757634][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6127.757881][ C1] ? ip_local_out+0x114/0x3b0 [ 6127.758115][ C1] __ip_queue_xmit+0x672/0x1910 [ 6127.758360][ C1] ? __create_object+0x5e/0xb0 [ 6127.758599][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6127.758860][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6127.759135][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6127.759404][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6127.759680][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6127.759974][ C1] tcp_delack_timer+0x84/0x240 [ 6127.760221][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6127.760493][ C1] call_timer_fn+0x173/0x430 [ 6127.760732][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6127.760995][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6127.761264][ C1] __run_timers.part.0+0x52d/0x890 [ 6127.761518][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6127.761787][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6127.762066][ C1] ? lock_acquire+0x1c1/0x220 [ 6127.762301][ C1] ? clockevents_program_event+0xf6/0x300 [ 6127.762584][ C1] ? lock_release+0x1d5/0x250 [ 6127.762818][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6127.763076][ C1] ? ktime_get+0xb3/0x190 [ 6127.763295][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6127.763586][ C1] run_timer_softirq+0x72/0x100 [ 6127.763828][ C1] __do_softirq+0x1b9/0x7ff [ 6127.764058][ C1] irq_exit_rcu+0x98/0xc0 [ 6127.764273][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6127.764553][ C1] [ 6127.764701][ C1] [ 6127.764848][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6127.765148][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6127.765465][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6127.766418][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6127.766720][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6127.767110][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6127.767502][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6127.767893][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6127.768284][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6127.768675][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6127.768967][ C1] pipe_read+0xa16/0xdf0 [ 6127.769182][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6127.769456][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6127.769693][ C1] ? iterate_tty_write+0x299/0x540 [ 6127.769973][ C1] ? lock_release+0x1d5/0x250 [ 6127.770214][ C1] vfs_read+0x911/0xc00 [ 6127.770430][ C1] ? lock_acquire+0x1c1/0x220 [ 6127.770670][ C1] ? __might_fault+0xc6/0x180 [ 6127.770912][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6127.771162][ C1] ? __might_fault+0xc6/0x180 [ 6127.771395][ C1] ? lock_release+0x1d5/0x250 [ 6127.771629][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6127.771888][ C1] ? __fget_light+0x54/0x1e0 [ 6127.772122][ C1] ksys_read+0x17a/0x1e0 [ 6127.772335][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6127.772574][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6127.772872][ C1] do_syscall_64+0xc9/0x1e0 [ 6127.773100][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6127.773393][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6127.773617][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6127.774569][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6127.774981][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6127.775373][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6127.775763][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6127.776154][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6127.776546][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6127.776940][ C1] [ 6127.777092][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6127.777378][ C2] NMI backtrace for cpu 2 [ 6127.777383][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6127.777389][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6127.777393][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6127.777402][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6127.777405][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6127.777408][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6127.777409][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6127.777411][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6127.777412][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6127.777414][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6127.777416][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6127.777418][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6127.777421][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6127.777423][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6127.777424][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6127.777425][ C2] PKRU: 55555554 [ 6127.777427][ C2] Call Trace: [ 6127.777428][ C2] [ 6127.777430][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6127.777436][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6127.777440][ C2] ? nmi_handle+0x153/0x420 [ 6127.777445][ C2] ? default_do_nmi+0x41/0x100 [ 6127.777448][ C2] ? exc_nmi+0xf3/0x120 [ 6127.777450][ C2] ? end_repeat_nmi+0xf/0x60 [ 6127.777455][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6127.777458][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6127.777462][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6127.777465][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6127.777468][ C2] [ 6127.777469][ C2] [ 6127.777470][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6127.777473][ C2] ? get_stack_info+0x36/0xc0 [ 6127.777476][ C2] ? lock_acquire+0x1c1/0x220 [ 6127.777480][ C2] ? lock_release+0x1d5/0x250 [ 6127.777484][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6127.777487][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6127.777490][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6127.777493][ C2] ? lock_acquire+0x1c1/0x220 [ 6127.777495][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6127.777499][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6127.777502][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6127.777508][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6127.777510][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6127.777515][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6127.777519][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6127.777523][ C2] ip_local_deliver+0x19d/0x480 [ 6127.777525][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6127.777527][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6127.777530][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6127.777535][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6127.777539][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6127.777542][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6127.777551][ C2] ip_rcv+0x564/0x740 [ 6127.777553][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6127.777556][ C2] ? set_track_prepare+0x8a/0xd0 [ 6127.777560][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6127.777563][ C2] ? start_secondary+0x21c/0x2b0 [ 6127.777566][ C2] ? skb_clone+0x10b/0x330 [ 6127.777568][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6127.777574][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6127.777579][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6127.777583][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6127.777591][ C2] ? __tcf_classify+0x329/0x7d0 [ 6127.777595][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6127.777597][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6127.777600][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6127.777603][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6127.777607][ C2] ? lock_acquire+0x1c1/0x220 [ 6127.777610][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6127.777614][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6127.777617][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6127.777621][ C2] ? __copy_skb_header+0xaf/0x490 [ 6127.777626][ C2] ? __skb_clone+0x57a/0x760 [ 6127.777628][ C2] netif_receive_skb+0x55/0x280 [ 6127.777631][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6127.777638][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6127.777645][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6127.777651][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6127.777656][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6127.777666][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6127.777673][ C2] ? get_stack_info+0x36/0xc0 [ 6127.777678][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6127.777680][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6127.777684][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6127.777686][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6127.777690][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6127.777692][ C2] ? kernel_text_address+0x17/0xe0 [ 6127.777695][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6127.777699][ C2] ? arch_stack_walk+0x8c/0x100 [ 6127.777702][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6127.777706][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6127.777709][ C2] ? lock_acquire+0x1c1/0x220 [ 6127.777711][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6127.777715][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6127.777720][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6127.777722][ C2] ? get_stack_info+0x36/0xc0 [ 6127.777727][ C2] __tcf_classify+0x329/0x7d0 [ 6127.777732][ C2] tcf_classify+0x283/0x930 [ 6127.777736][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6127.777739][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6127.777743][ C2] tc_run+0x2e4/0x5d0 [ 6127.777747][ C2] ? __pfx_tc_run+0x10/0x10 [ 6127.777750][ C2] ? lock_acquire+0x1c1/0x220 [ 6127.777752][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6127.777756][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6127.777760][ C2] ? lock_acquire+0x1c1/0x220 [ 6127.777762][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6127.777765][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6127.777768][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6127.777771][ C2] ? neigh_hh_output+0x348/0x590 [ 6127.777775][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6127.777778][ C2] ip_finish_output2+0x786/0x18e0 [ 6127.777782][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6127.777789][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6127.777792][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6127.777796][ C2] ? __ip_finish_output+0x10f/0x770 [ 6127.777799][ C2] ip_output+0x16b/0x4f0 [ 6127.777802][ C2] ? __pfx_ip_output+0x10/0x10 [ 6127.777805][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6127.777808][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6127.777811][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6127.777813][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6127.777815][ C2] ? __alloc_skb+0xd4/0x280 [ 6127.777818][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6127.777821][ C2] ? tcp_fragment+0x168/0x1040 [ 6127.777825][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6127.777827][ C2] ? ip_local_out+0x114/0x3b0 [ 6127.777831][ C2] __ip_queue_xmit+0x672/0x1910 [ 6127.777834][ C2] ? __skb_clone+0x57a/0x760 [ 6127.777837][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6127.777842][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6127.777845][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6127.777849][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6127.777852][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6127.777856][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6127.777859][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6127.777863][ C2] tcp_send_loss_probe+0x348/0x830 [ 6127.777866][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6127.777869][ C2] tcp_write_timer+0x82/0x1d0 [ 6127.777872][ C2] call_timer_fn+0x173/0x430 [ 6127.777876][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6127.777880][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6127.777884][ C2] __run_timers.part.0+0x52d/0x890 [ 6127.777887][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6127.777892][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6127.777894][ C2] ? lock_acquire+0x1c1/0x220 [ 6127.777897][ C2] ? clockevents_program_event+0xf6/0x300 [ 6127.777901][ C2] ? lock_release+0x1d5/0x250 [ 6127.777904][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6127.777907][ C2] ? ktime_get+0xb3/0x190 [ 6127.777910][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6127.777914][ C2] run_timer_softirq+0x72/0x100 [ 6127.777918][ C2] __do_softirq+0x1b9/0x7ff [ 6127.777922][ C2] irq_exit_rcu+0x98/0xc0 [ 6127.777924][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6127.777927][ C2] [ 6127.777928][ C2] [ 6127.777929][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6127.777932][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6127.777935][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6127.777937][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6127.777939][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6127.777941][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6127.777942][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6127.777944][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6127.777945][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6127.777948][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6127.777951][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6127.777955][ C2] default_idle_call+0x69/0xa0 [ 6127.777957][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6127.777960][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6127.777963][ C2] ? lock_release+0x1d5/0x250 [ 6127.777966][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6127.777970][ C2] do_idle+0xfb/0x160 [ 6127.777973][ C2] cpu_startup_entry+0x55/0x60 [ 6127.777975][ C2] start_secondary+0x21c/0x2b0 [ 6127.777977][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6127.777981][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6127.777987][ C2] [ 6152.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3539s! [perl:4135] [ 6152.569714][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6152.570977][ C1] irq event stamp: 209232 [ 6152.571195][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6152.571726][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6152.572204][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6152.572677][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6152.573129][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6152.573565][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6152.574163][ C1] RIP: 0010:kasan_check_range+0x77/0x1c0 [ 6152.574441][ C1] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [ 6152.575390][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [ 6152.575708][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6152.576109][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6152.576508][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 6152.576907][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6152.577314][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6152.577705][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6152.578142][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6152.578466][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6152.578859][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6152.579248][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6152.579638][ C1] PKRU: 55555554 [ 6152.579838][ C1] Call Trace: [ 6152.580005][ C1] [ 6152.580156][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6152.580418][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6152.580661][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6152.580939][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6152.581214][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6152.581496][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6152.581755][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6152.582052][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6152.582305][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 6152.582560][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6152.582860][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6152.583149][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6152.583455][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6152.583736][ C1] ? kasan_check_range+0x77/0x1c0 [ 6152.583986][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6152.584262][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6152.584565][ C1] ? get_stack_info+0x36/0xc0 [ 6152.584798][ C1] ? lock_acquire+0x1c1/0x220 [ 6152.585033][ C1] ? lock_release+0x1d5/0x250 [ 6152.585268][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6152.585510][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6152.585775][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6152.586053][ C1] ? lock_acquire+0x1c1/0x220 [ 6152.586285][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6152.586521][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6152.586774][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6152.587004][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6152.587244][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6152.587495][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6152.587766][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6152.588035][ C1] ip_local_deliver+0x19d/0x480 [ 6152.588276][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6152.588539][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6152.588795][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6152.589136][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6152.589383][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6152.589695][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6152.589976][ C1] ip_rcv+0x564/0x740 [ 6152.590180][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6152.590411][ C1] ? set_track_prepare+0x8a/0xd0 [ 6152.590663][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6152.590953][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6152.591218][ C1] ? skb_clone+0x10b/0x330 [ 6152.591439][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6152.591749][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6152.592047][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6152.592322][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6152.592608][ C1] ? __tcf_classify+0x329/0x7d0 [ 6152.592850][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6152.593075][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6152.593365][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6152.593645][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6152.593962][ C1] ? lock_acquire+0x1c1/0x220 [ 6152.594193][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6152.594482][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6152.594760][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6152.595068][ C1] ? __copy_skb_header+0xaf/0x490 [ 6152.595319][ C1] ? __skb_clone+0x57a/0x760 [ 6152.595547][ C1] netif_receive_skb+0x55/0x280 [ 6152.595789][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6152.596094][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6152.596417][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6152.596709][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6152.596976][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6152.597256][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6152.597562][ C1] ? hlock_class+0x4e/0x130 [ 6152.597788][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6152.598076][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6152.598350][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6152.598615][ C1] ? hlock_class+0x4e/0x130 [ 6152.598846][ C1] ? mark_lock+0x38/0x3e0 [ 6152.599066][ C1] ? stack_access_ok+0xda/0x1f0 [ 6152.599313][ C1] ? __lock_acquire+0xb67/0x1610 [ 6152.599567][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6152.599851][ C1] ? get_stack_info+0x36/0xc0 [ 6152.600089][ C1] ? stack_access_ok+0xda/0x1f0 [ 6152.600337][ C1] ? get_reg+0x119/0x190 [ 6152.600555][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6152.600823][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6152.601140][ C1] __tcf_classify+0x329/0x7d0 [ 6152.601373][ C1] tcf_classify+0x283/0x930 [ 6152.601620][ C1] ? arch_stack_walk+0xa2/0x100 [ 6152.601869][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6152.602127][ C1] ? get_stack_info+0x36/0xc0 [ 6152.602368][ C1] tc_run+0x2e4/0x5d0 [ 6152.602573][ C1] ? __pfx_tc_run+0x10/0x10 [ 6152.602803][ C1] ? lock_acquire+0x1c1/0x220 [ 6152.603042][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6152.603303][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6152.603580][ C1] ? lock_acquire+0x1c1/0x220 [ 6152.603819][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6152.604083][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6152.604389][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6152.604671][ C1] ? neigh_hh_output+0x348/0x590 [ 6152.604934][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6152.605198][ C1] ip_finish_output2+0x786/0x18e0 [ 6152.605453][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6152.605730][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6152.606069][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6152.606345][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6152.606604][ C1] ? __ip_finish_output+0x10f/0x770 [ 6152.606861][ C1] ip_output+0x16b/0x4f0 [ 6152.607071][ C1] ? run_timer_softirq+0x72/0x100 [ 6152.607321][ C1] ? __pfx_ip_output+0x10/0x10 [ 6152.607559][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6152.607838][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6152.608083][ C1] ? ip_local_out+0x114/0x3b0 [ 6152.608315][ C1] __ip_queue_xmit+0x672/0x1910 [ 6152.608557][ C1] ? __create_object+0x5e/0xb0 [ 6152.608795][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6152.609054][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6152.609329][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6152.609596][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6152.609901][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6152.610172][ C1] tcp_delack_timer+0x84/0x240 [ 6152.610417][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6152.610688][ C1] call_timer_fn+0x173/0x430 [ 6152.610924][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6152.611186][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6152.611448][ C1] __run_timers.part.0+0x52d/0x890 [ 6152.611708][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6152.611983][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6152.612276][ C1] ? lock_acquire+0x1c1/0x220 [ 6152.612508][ C1] ? clockevents_program_event+0xf6/0x300 [ 6152.612790][ C1] ? lock_release+0x1d5/0x250 [ 6152.613024][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6152.613281][ C1] ? ktime_get+0xb3/0x190 [ 6152.613497][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6152.613785][ C1] run_timer_softirq+0x72/0x100 [ 6152.614027][ C1] __do_softirq+0x1b9/0x7ff [ 6152.614254][ C1] irq_exit_rcu+0x98/0xc0 [ 6152.614467][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6152.614746][ C1] [ 6152.614892][ C1] [ 6152.615037][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6152.615335][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6152.615654][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6152.616596][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6152.616895][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6152.617283][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6152.617672][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6152.618059][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6152.618448][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6152.618837][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6152.619130][ C1] pipe_read+0xa16/0xdf0 [ 6152.619343][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6152.619615][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6152.619874][ C1] ? iterate_tty_write+0x299/0x540 [ 6152.620139][ C1] ? lock_release+0x1d5/0x250 [ 6152.620378][ C1] vfs_read+0x911/0xc00 [ 6152.620594][ C1] ? lock_acquire+0x1c1/0x220 [ 6152.620831][ C1] ? __might_fault+0xc6/0x180 [ 6152.621081][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6152.621314][ C1] ? __might_fault+0xc6/0x180 [ 6152.621548][ C1] ? lock_release+0x1d5/0x250 [ 6152.621780][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6152.622039][ C1] ? __fget_light+0x54/0x1e0 [ 6152.622270][ C1] ksys_read+0x17a/0x1e0 [ 6152.622482][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6152.622720][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6152.623017][ C1] do_syscall_64+0xc9/0x1e0 [ 6152.623244][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6152.623534][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6152.623758][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6152.624699][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6152.625111][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6152.625499][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6152.625887][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6152.626274][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6152.626664][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6152.627055][ C1] [ 6152.627206][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3539s! [swapper/2:0] [ 6152.627606][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6152.628813][ C2] irq event stamp: 44114564 [ 6152.629031][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6152.629549][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6152.630069][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6152.630540][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6152.631012][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6152.631452][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6152.632043][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6152.632356][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6152.633291][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6152.633588][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6152.633972][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6152.634358][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6152.634743][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6152.635127][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6152.635527][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6152.635970][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6152.636300][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6152.636700][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6152.637095][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6152.637498][ C2] PKRU: 55555554 [ 6152.637673][ C2] Call Trace: [ 6152.637837][ C2] [ 6152.637978][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6152.638230][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6152.638465][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6152.638731][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6152.638995][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6152.639273][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6152.639527][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6152.639845][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6152.640103][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6152.640362][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6152.640668][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6152.640972][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6152.641275][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6152.641554][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6152.641838][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6152.642117][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6152.642417][ C2] ? get_stack_info+0x36/0xc0 [ 6152.642650][ C2] ? lock_acquire+0x1c1/0x220 [ 6152.642881][ C2] ? lock_release+0x1d5/0x250 [ 6152.643111][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6152.643352][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6152.643613][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6152.643891][ C2] ? lock_acquire+0x1c1/0x220 [ 6152.644121][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6152.644350][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6152.644601][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6152.644828][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6152.645067][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6152.645315][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6152.645578][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6152.645845][ C2] ip_local_deliver+0x19d/0x480 [ 6152.646083][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6152.646347][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6152.646601][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6152.646934][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6152.647177][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6152.647485][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6152.647738][ C2] ip_rcv+0x564/0x740 [ 6152.647934][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6152.648158][ C2] ? set_track_prepare+0x8a/0xd0 [ 6152.648403][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6152.648668][ C2] ? start_secondary+0x21c/0x2b0 [ 6152.648932][ C2] ? skb_clone+0x10b/0x330 [ 6152.649156][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6152.649472][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6152.649777][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6152.650057][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6152.650347][ C2] ? __tcf_classify+0x329/0x7d0 [ 6152.650592][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6152.650822][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6152.651143][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6152.651427][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6152.651749][ C2] ? lock_acquire+0x1c1/0x220 [ 6152.651986][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6152.652278][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6152.652571][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6152.652876][ C2] ? __copy_skb_header+0xaf/0x490 [ 6152.653127][ C2] ? __skb_clone+0x57a/0x760 [ 6152.653352][ C2] netif_receive_skb+0x55/0x280 [ 6152.653590][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6152.653891][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6152.654210][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6152.654499][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6152.654763][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6152.655039][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6152.655343][ C2] ? get_stack_info+0x36/0xc0 [ 6152.655576][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6152.655831][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6152.656136][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6152.656402][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6152.656670][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6152.656973][ C2] ? kernel_text_address+0x17/0xe0 [ 6152.657224][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6152.657524][ C2] ? arch_stack_walk+0x8c/0x100 [ 6152.657763][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6152.658018][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6152.658294][ C2] ? lock_acquire+0x1c1/0x220 [ 6152.658525][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6152.658796][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6152.659090][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6152.659356][ C2] ? get_stack_info+0x36/0xc0 [ 6152.659589][ C2] __tcf_classify+0x329/0x7d0 [ 6152.659843][ C2] tcf_classify+0x283/0x930 [ 6152.660072][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6152.660325][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6152.660635][ C2] tc_run+0x2e4/0x5d0 [ 6152.660837][ C2] ? __pfx_tc_run+0x10/0x10 [ 6152.661076][ C2] ? lock_acquire+0x1c1/0x220 [ 6152.661307][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6152.661559][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6152.661802][ C2] ? lock_acquire+0x1c1/0x220 [ 6152.662030][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6152.662291][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6152.662582][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6152.662845][ C2] ? neigh_hh_output+0x348/0x590 [ 6152.663088][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6152.663363][ C2] ip_finish_output2+0x786/0x18e0 [ 6152.663617][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6152.663952][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6152.664225][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6152.664485][ C2] ? __ip_finish_output+0x10f/0x770 [ 6152.664740][ C2] ip_output+0x16b/0x4f0 [ 6152.664949][ C2] ? __pfx_ip_output+0x10/0x10 [ 6152.665183][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6152.665451][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6152.665750][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6152.666016][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6152.666259][ C2] ? __alloc_skb+0xd4/0x280 [ 6152.666479][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6152.666741][ C2] ? tcp_fragment+0x168/0x1040 [ 6152.666973][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6152.667217][ C2] ? ip_local_out+0x114/0x3b0 [ 6152.667450][ C2] __ip_queue_xmit+0x672/0x1910 [ 6152.667689][ C2] ? __skb_clone+0x57a/0x760 [ 6152.667916][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6152.668173][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6152.668443][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6152.668679][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6152.668919][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6152.669209][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6152.669518][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6152.669773][ C2] tcp_send_loss_probe+0x348/0x830 [ 6152.670030][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6152.670299][ C2] tcp_write_timer+0x82/0x1d0 [ 6152.670535][ C2] call_timer_fn+0x173/0x430 [ 6152.670770][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6152.671036][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6152.671288][ C2] __run_timers.part.0+0x52d/0x890 [ 6152.671539][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6152.671798][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6152.672075][ C2] ? lock_acquire+0x1c1/0x220 [ 6152.672305][ C2] ? clockevents_program_event+0xf6/0x300 [ 6152.672584][ C2] ? lock_release+0x1d5/0x250 [ 6152.672815][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6152.673069][ C2] ? ktime_get+0xb3/0x190 [ 6152.673281][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6152.673569][ C2] run_timer_softirq+0x72/0x100 [ 6152.673808][ C2] __do_softirq+0x1b9/0x7ff [ 6152.674032][ C2] irq_exit_rcu+0x98/0xc0 [ 6152.674244][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6152.674517][ C2] [ 6152.674664][ C2] [ 6152.674809][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6152.675102][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6152.675349][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6152.676282][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6152.676578][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6152.676962][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6152.677345][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6152.677730][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6152.678115][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6152.678499][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6152.678778][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6152.679029][ C2] default_idle_call+0x69/0xa0 [ 6152.679263][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6152.679504][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6152.679794][ C2] ? lock_release+0x1d5/0x250 [ 6152.680029][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6152.680302][ C2] do_idle+0xfb/0x160 [ 6152.680504][ C2] cpu_startup_entry+0x55/0x60 [ 6152.680746][ C2] start_secondary+0x21c/0x2b0 [ 6152.680996][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6152.681256][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6152.681554][ C2] [ 6180.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3565s! [perl:4135] [ 6180.569695][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6180.570949][ C1] irq event stamp: 209232 [ 6180.571162][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6180.571676][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6180.572139][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6180.572595][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6180.573045][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6180.573480][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6180.574075][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6180.574391][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6180.575333][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6180.575632][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6180.576020][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6180.576408][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6180.576794][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6180.577184][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6180.577571][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6180.578007][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6180.578330][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6180.578718][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6180.579108][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6180.579495][ C1] PKRU: 55555554 [ 6180.579694][ C1] Call Trace: [ 6180.579862][ C1] [ 6180.580011][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6180.580273][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6180.580517][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6180.580794][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6180.581070][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6180.581351][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6180.581610][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6180.581907][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6180.582163][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6180.582463][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6180.582750][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6180.583055][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6180.583336][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6180.583624][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6180.583905][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6180.584208][ C1] ? get_stack_info+0x36/0xc0 [ 6180.584442][ C1] ? lock_acquire+0x1c1/0x220 [ 6180.584676][ C1] ? lock_release+0x1d5/0x250 [ 6180.584911][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6180.585152][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6180.585418][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6180.585694][ C1] ? lock_acquire+0x1c1/0x220 [ 6180.585927][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6180.586162][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6180.586415][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6180.586643][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6180.586883][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6180.587134][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6180.587402][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6180.587671][ C1] ip_local_deliver+0x19d/0x480 [ 6180.587912][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6180.588176][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6180.588433][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6180.588771][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6180.589016][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6180.589328][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6180.589584][ C1] ip_rcv+0x564/0x740 [ 6180.589808][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6180.590037][ C1] ? set_track_prepare+0x8a/0xd0 [ 6180.590291][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6180.590568][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6180.590852][ C1] ? skb_clone+0x10b/0x330 [ 6180.591071][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6180.591382][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6180.591681][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6180.591954][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6180.592242][ C1] ? __tcf_classify+0x329/0x7d0 [ 6180.592484][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6180.592706][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6180.593018][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6180.593303][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6180.593630][ C1] ? lock_acquire+0x1c1/0x220 [ 6180.593867][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6180.594177][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6180.594452][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6180.594761][ C1] ? __copy_skb_header+0xaf/0x490 [ 6180.595011][ C1] ? __skb_clone+0x57a/0x760 [ 6180.595242][ C1] netif_receive_skb+0x55/0x280 [ 6180.595485][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6180.595789][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6180.596113][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6180.596404][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6180.596673][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6180.596952][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6180.597257][ C1] ? hlock_class+0x4e/0x130 [ 6180.597483][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6180.597753][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6180.598021][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6180.598277][ C1] ? hlock_class+0x4e/0x130 [ 6180.598503][ C1] ? mark_lock+0x38/0x3e0 [ 6180.598716][ C1] ? stack_access_ok+0xda/0x1f0 [ 6180.598958][ C1] ? __lock_acquire+0xb67/0x1610 [ 6180.599206][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6180.599474][ C1] ? get_stack_info+0x36/0xc0 [ 6180.599740][ C1] ? stack_access_ok+0xda/0x1f0 [ 6180.599987][ C1] ? get_reg+0x119/0x190 [ 6180.600204][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6180.600473][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6180.600783][ C1] __tcf_classify+0x329/0x7d0 [ 6180.601029][ C1] tcf_classify+0x283/0x930 [ 6180.601255][ C1] ? arch_stack_walk+0xa2/0x100 [ 6180.601498][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6180.601748][ C1] ? get_stack_info+0x36/0xc0 [ 6180.601982][ C1] tc_run+0x2e4/0x5d0 [ 6180.602183][ C1] ? __pfx_tc_run+0x10/0x10 [ 6180.602406][ C1] ? lock_acquire+0x1c1/0x220 [ 6180.602639][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6180.602893][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6180.603139][ C1] ? lock_acquire+0x1c1/0x220 [ 6180.603373][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6180.603630][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6180.603927][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6180.604191][ C1] ? neigh_hh_output+0x348/0x590 [ 6180.604437][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6180.604695][ C1] ip_finish_output2+0x786/0x18e0 [ 6180.604944][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6180.605214][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6180.605543][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6180.605812][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6180.606058][ C1] ? __ip_finish_output+0x10f/0x770 [ 6180.606316][ C1] ip_output+0x16b/0x4f0 [ 6180.606526][ C1] ? run_timer_softirq+0x72/0x100 [ 6180.606775][ C1] ? __pfx_ip_output+0x10/0x10 [ 6180.607012][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6180.607290][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6180.607535][ C1] ? ip_local_out+0x114/0x3b0 [ 6180.607770][ C1] __ip_queue_xmit+0x672/0x1910 [ 6180.608011][ C1] ? __create_object+0x5e/0xb0 [ 6180.608250][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6180.608510][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6180.608783][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6180.609051][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6180.609324][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6180.609588][ C1] tcp_delack_timer+0x84/0x240 [ 6180.609853][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6180.610124][ C1] call_timer_fn+0x173/0x430 [ 6180.610360][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6180.610621][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6180.610892][ C1] __run_timers.part.0+0x52d/0x890 [ 6180.611145][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6180.611410][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6180.611688][ C1] ? lock_acquire+0x1c1/0x220 [ 6180.611921][ C1] ? clockevents_program_event+0xf6/0x300 [ 6180.612200][ C1] ? lock_release+0x1d5/0x250 [ 6180.612434][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6180.612690][ C1] ? ktime_get+0xb3/0x190 [ 6180.612904][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6180.613193][ C1] run_timer_softirq+0x72/0x100 [ 6180.613434][ C1] __do_softirq+0x1b9/0x7ff [ 6180.613660][ C1] irq_exit_rcu+0x98/0xc0 [ 6180.613873][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6180.614151][ C1] [ 6180.614298][ C1] [ 6180.614444][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6180.614740][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6180.615055][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6180.615995][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6180.616295][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6180.616681][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6180.617068][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6180.617458][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6180.617844][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6180.618233][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6180.618522][ C1] pipe_read+0xa16/0xdf0 [ 6180.618736][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6180.619006][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6180.619242][ C1] ? iterate_tty_write+0x299/0x540 [ 6180.619495][ C1] ? lock_release+0x1d5/0x250 [ 6180.619752][ C1] vfs_read+0x911/0xc00 [ 6180.619965][ C1] ? lock_acquire+0x1c1/0x220 [ 6180.620204][ C1] ? __might_fault+0xc6/0x180 [ 6180.620445][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6180.620685][ C1] ? __might_fault+0xc6/0x180 [ 6180.620931][ C1] ? lock_release+0x1d5/0x250 [ 6180.621164][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6180.621421][ C1] ? __fget_light+0x54/0x1e0 [ 6180.621652][ C1] ksys_read+0x17a/0x1e0 [ 6180.621863][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6180.622106][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6180.622404][ C1] do_syscall_64+0xc9/0x1e0 [ 6180.622631][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6180.622921][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6180.623144][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6180.624088][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6180.624497][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6180.624885][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6180.625273][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6180.625658][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6180.626046][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6180.626438][ C1] [ 6180.626590][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3565s! [swapper/2:0] [ 6180.626988][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6180.628193][ C2] irq event stamp: 44114564 [ 6180.628415][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6180.628931][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6180.629425][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6180.629911][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6180.630377][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6180.630839][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6180.631429][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6180.631744][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6180.632680][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6180.632976][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6180.633363][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6180.633748][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6180.634132][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6180.634518][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6180.634904][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6180.635339][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6180.635661][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6180.636050][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6180.636436][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6180.636821][ C2] PKRU: 55555554 [ 6180.636997][ C2] Call Trace: [ 6180.637159][ C2] [ 6180.637304][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6180.637556][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6180.637790][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6180.638057][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6180.638320][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6180.638599][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6180.638854][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6180.639149][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6180.639402][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6180.639678][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6180.639982][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6180.640275][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6180.640586][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6180.640882][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6180.641168][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6180.641447][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6180.641748][ C2] ? get_stack_info+0x36/0xc0 [ 6180.641979][ C2] ? lock_acquire+0x1c1/0x220 [ 6180.642212][ C2] ? lock_release+0x1d5/0x250 [ 6180.642445][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6180.642686][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6180.642948][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6180.643222][ C2] ? lock_acquire+0x1c1/0x220 [ 6180.643454][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6180.643686][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6180.643937][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6180.644163][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6180.644401][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6180.644650][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6180.644916][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6180.645183][ C2] ip_local_deliver+0x19d/0x480 [ 6180.645422][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6180.645684][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6180.645937][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6180.646273][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6180.646516][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6180.646826][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6180.647079][ C2] ip_rcv+0x564/0x740 [ 6180.647277][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6180.647498][ C2] ? set_track_prepare+0x8a/0xd0 [ 6180.647742][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6180.648011][ C2] ? start_secondary+0x21c/0x2b0 [ 6180.648253][ C2] ? skb_clone+0x10b/0x330 [ 6180.648471][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6180.648778][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6180.649074][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6180.649344][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6180.649650][ C2] ? __tcf_classify+0x329/0x7d0 [ 6180.649894][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6180.650122][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6180.650420][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6180.650701][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6180.651028][ C2] ? lock_acquire+0x1c1/0x220 [ 6180.651259][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6180.651546][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6180.651820][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6180.652126][ C2] ? __copy_skb_header+0xaf/0x490 [ 6180.652373][ C2] ? __skb_clone+0x57a/0x760 [ 6180.652600][ C2] netif_receive_skb+0x55/0x280 [ 6180.652839][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6180.653140][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6180.653461][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6180.653748][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6180.654013][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6180.654292][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6180.654592][ C2] ? get_stack_info+0x36/0xc0 [ 6180.654823][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6180.655079][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6180.655385][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6180.655652][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6180.655919][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6180.656224][ C2] ? kernel_text_address+0x17/0xe0 [ 6180.656475][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6180.656776][ C2] ? arch_stack_walk+0x8c/0x100 [ 6180.657016][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6180.657271][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6180.657545][ C2] ? lock_acquire+0x1c1/0x220 [ 6180.657776][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6180.658048][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6180.658341][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6180.658608][ C2] ? get_stack_info+0x36/0xc0 [ 6180.658840][ C2] __tcf_classify+0x329/0x7d0 [ 6180.659073][ C2] tcf_classify+0x283/0x930 [ 6180.659298][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6180.659546][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6180.659874][ C2] tc_run+0x2e4/0x5d0 [ 6180.660078][ C2] ? __pfx_tc_run+0x10/0x10 [ 6180.660305][ C2] ? lock_acquire+0x1c1/0x220 [ 6180.660543][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6180.660811][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6180.661054][ C2] ? lock_acquire+0x1c1/0x220 [ 6180.661286][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6180.661540][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6180.661836][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6180.662098][ C2] ? neigh_hh_output+0x348/0x590 [ 6180.662344][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6180.662599][ C2] ip_finish_output2+0x786/0x18e0 [ 6180.662846][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6180.663170][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6180.663438][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6180.663699][ C2] ? __ip_finish_output+0x10f/0x770 [ 6180.663961][ C2] ip_output+0x16b/0x4f0 [ 6180.664175][ C2] ? __pfx_ip_output+0x10/0x10 [ 6180.664417][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6180.664690][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6180.665005][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6180.665270][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6180.665512][ C2] ? __alloc_skb+0xd4/0x280 [ 6180.665735][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6180.665994][ C2] ? tcp_fragment+0x168/0x1040 [ 6180.666230][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6180.666473][ C2] ? ip_local_out+0x114/0x3b0 [ 6180.666705][ C2] __ip_queue_xmit+0x672/0x1910 [ 6180.666943][ C2] ? __skb_clone+0x57a/0x760 [ 6180.667170][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6180.667427][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6180.667699][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6180.667934][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6180.668174][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6180.668465][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6180.668773][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6180.669010][ C2] tcp_send_loss_probe+0x348/0x830 [ 6180.669261][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6180.669520][ C2] tcp_write_timer+0x82/0x1d0 [ 6180.669775][ C2] call_timer_fn+0x173/0x430 [ 6180.670008][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6180.670269][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6180.670528][ C2] __run_timers.part.0+0x52d/0x890 [ 6180.670786][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6180.671058][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6180.671331][ C2] ? lock_acquire+0x1c1/0x220 [ 6180.671563][ C2] ? clockevents_program_event+0xf6/0x300 [ 6180.671843][ C2] ? lock_release+0x1d5/0x250 [ 6180.672072][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6180.672327][ C2] ? ktime_get+0xb3/0x190 [ 6180.672541][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6180.672826][ C2] run_timer_softirq+0x72/0x100 [ 6180.673065][ C2] __do_softirq+0x1b9/0x7ff [ 6180.673292][ C2] irq_exit_rcu+0x98/0xc0 [ 6180.673504][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6180.673779][ C2] [ 6180.673923][ C2] [ 6180.674069][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6180.674360][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6180.674608][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6180.675546][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6180.675841][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6180.676228][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6180.676614][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6180.676998][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6180.677382][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6180.677770][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6180.678050][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6180.678302][ C2] default_idle_call+0x69/0xa0 [ 6180.678537][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6180.678780][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6180.679047][ C2] ? lock_release+0x1d5/0x250 [ 6180.679278][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6180.679541][ C2] do_idle+0xfb/0x160 [ 6180.679764][ C2] cpu_startup_entry+0x55/0x60 [ 6180.680004][ C2] start_secondary+0x21c/0x2b0 [ 6180.680247][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6180.680513][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6180.680831][ C2] [ 6205.779102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6205.779450][ C1] rcu: 1-....: (3841396 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=941498 [ 6205.780022][ C1] rcu: (t=3850892 jiffies g=1882453 q=715 ncpus=4) [ 6205.780355][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6205.780809][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6205.781403][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 6205.781681][ C1] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 6205.782626][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 6205.782926][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6205.783315][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6205.783702][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6205.784090][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6205.784481][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6205.784870][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6205.785306][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6205.785629][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6205.786017][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6205.786410][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6205.786799][ C1] PKRU: 55555554 [ 6205.786977][ C1] Call Trace: [ 6205.787141][ C1] [ 6205.787288][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6205.787554][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6205.787800][ C1] ? check_cpu_stall+0x284/0x500 [ 6205.788046][ C1] ? rcu_pending+0x92/0x360 [ 6205.788271][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6205.788534][ C1] ? update_process_times+0xb9/0x110 [ 6205.788796][ C1] ? tick_sched_handle+0x67/0x130 [ 6205.789047][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6205.789323][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6205.789581][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6205.789893][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6205.790166][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6205.790455][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6205.790731][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6205.791029][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6205.791285][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6205.791584][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6205.791871][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6205.792177][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6205.792459][ C1] ? __kasan_check_read+0x8/0x20 [ 6205.792705][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6205.792980][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6205.793284][ C1] ? get_stack_info+0x36/0xc0 [ 6205.793517][ C1] ? lock_acquire+0x1c1/0x220 [ 6205.793751][ C1] ? lock_release+0x1d5/0x250 [ 6205.793987][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6205.794230][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6205.794495][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6205.794773][ C1] ? lock_acquire+0x1c1/0x220 [ 6205.795005][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6205.795240][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6205.795493][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6205.795722][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6205.795963][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6205.796214][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6205.796482][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6205.796751][ C1] ip_local_deliver+0x19d/0x480 [ 6205.796992][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6205.797256][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6205.797512][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6205.797852][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6205.798098][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6205.798410][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6205.798666][ C1] ip_rcv+0x564/0x740 [ 6205.798864][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6205.799089][ C1] ? set_track_prepare+0x8a/0xd0 [ 6205.799335][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6205.799643][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6205.799916][ C1] ? skb_clone+0x10b/0x330 [ 6205.800144][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6205.800464][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6205.800771][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6205.801063][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6205.801349][ C1] ? __tcf_classify+0x329/0x7d0 [ 6205.801593][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6205.801819][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6205.802111][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6205.802392][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6205.802711][ C1] ? lock_acquire+0x1c1/0x220 [ 6205.802944][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6205.803234][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6205.803514][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6205.803824][ C1] ? __copy_skb_header+0xaf/0x490 [ 6205.804076][ C1] ? __skb_clone+0x57a/0x760 [ 6205.804305][ C1] netif_receive_skb+0x55/0x280 [ 6205.804548][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6205.804854][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6205.805178][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6205.805472][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6205.805740][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6205.806020][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6205.806326][ C1] ? hlock_class+0x4e/0x130 [ 6205.806554][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6205.806823][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6205.807092][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6205.807353][ C1] ? hlock_class+0x4e/0x130 [ 6205.807579][ C1] ? mark_lock+0x38/0x3e0 [ 6205.807795][ C1] ? stack_access_ok+0xda/0x1f0 [ 6205.808037][ C1] ? __lock_acquire+0xb67/0x1610 [ 6205.808285][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6205.808560][ C1] ? get_stack_info+0x36/0xc0 [ 6205.808794][ C1] ? stack_access_ok+0xda/0x1f0 [ 6205.809035][ C1] ? get_reg+0x119/0x190 [ 6205.809248][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6205.809532][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6205.809842][ C1] __tcf_classify+0x329/0x7d0 [ 6205.810084][ C1] tcf_classify+0x283/0x930 [ 6205.810317][ C1] ? arch_stack_walk+0xa2/0x100 [ 6205.810567][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6205.810832][ C1] ? get_stack_info+0x36/0xc0 [ 6205.811068][ C1] tc_run+0x2e4/0x5d0 [ 6205.811269][ C1] ? __pfx_tc_run+0x10/0x10 [ 6205.811495][ C1] ? lock_acquire+0x1c1/0x220 [ 6205.811727][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6205.811983][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6205.812230][ C1] ? lock_acquire+0x1c1/0x220 [ 6205.812465][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6205.812723][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6205.813022][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6205.813288][ C1] ? neigh_hh_output+0x348/0x590 [ 6205.813535][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6205.813793][ C1] ip_finish_output2+0x786/0x18e0 [ 6205.814043][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6205.814315][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6205.814647][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6205.814917][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6205.815165][ C1] ? __ip_finish_output+0x10f/0x770 [ 6205.815424][ C1] ip_output+0x16b/0x4f0 [ 6205.815636][ C1] ? run_timer_softirq+0x72/0x100 [ 6205.815886][ C1] ? __pfx_ip_output+0x10/0x10 [ 6205.816125][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6205.816406][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6205.816654][ C1] ? ip_local_out+0x114/0x3b0 [ 6205.816887][ C1] __ip_queue_xmit+0x672/0x1910 [ 6205.817130][ C1] ? __create_object+0x5e/0xb0 [ 6205.817369][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6205.817630][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6205.817906][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6205.818174][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6205.818449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6205.818714][ C1] tcp_delack_timer+0x84/0x240 [ 6205.818952][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6205.819220][ C1] call_timer_fn+0x173/0x430 [ 6205.819450][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6205.819731][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6205.819992][ C1] __run_timers.part.0+0x52d/0x890 [ 6205.820253][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6205.820531][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6205.820823][ C1] ? lock_acquire+0x1c1/0x220 [ 6205.821057][ C1] ? clockevents_program_event+0xf6/0x300 [ 6205.821339][ C1] ? lock_release+0x1d5/0x250 [ 6205.821574][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6205.821831][ C1] ? ktime_get+0xb3/0x190 [ 6205.822048][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6205.822337][ C1] run_timer_softirq+0x72/0x100 [ 6205.822580][ C1] __do_softirq+0x1b9/0x7ff [ 6205.822808][ C1] irq_exit_rcu+0x98/0xc0 [ 6205.823022][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6205.823302][ C1] [ 6205.823448][ C1] [ 6205.823594][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6205.823895][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6205.824212][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6205.825162][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6205.825465][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6205.825854][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6205.826246][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6205.826636][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6205.827026][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6205.827418][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6205.827710][ C1] pipe_read+0xa16/0xdf0 [ 6205.827923][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6205.828198][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6205.828435][ C1] ? iterate_tty_write+0x299/0x540 [ 6205.828691][ C1] ? lock_release+0x1d5/0x250 [ 6205.828925][ C1] vfs_read+0x911/0xc00 [ 6205.829136][ C1] ? lock_acquire+0x1c1/0x220 [ 6205.829368][ C1] ? __might_fault+0xc6/0x180 [ 6205.829629][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6205.829870][ C1] ? __might_fault+0xc6/0x180 [ 6205.830111][ C1] ? lock_release+0x1d5/0x250 [ 6205.830350][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6205.830617][ C1] ? __fget_light+0x54/0x1e0 [ 6205.830859][ C1] ksys_read+0x17a/0x1e0 [ 6205.831073][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6205.831309][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6205.831608][ C1] do_syscall_64+0xc9/0x1e0 [ 6205.831836][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6205.832149][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6205.832377][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6205.833362][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6205.833774][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6205.834164][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6205.834553][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6205.834942][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6205.835333][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6205.835726][ C1] [ 6205.835879][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6205.836148][ C2] NMI backtrace for cpu 2 [ 6205.836153][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6205.836159][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6205.836162][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 6205.836170][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 6205.836175][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [ 6205.836180][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6205.836183][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6205.836187][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6205.836191][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6205.836194][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6205.836198][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6205.836202][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6205.836207][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6205.836211][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6205.836214][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6205.836217][ C2] PKRU: 55555554 [ 6205.836220][ C2] Call Trace: [ 6205.836222][ C2] [ 6205.836225][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6205.836236][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6205.836244][ C2] ? nmi_handle+0x153/0x420 [ 6205.836253][ C2] ? default_do_nmi+0x41/0x100 [ 6205.836260][ C2] ? exc_nmi+0xf3/0x120 [ 6205.836265][ C2] ? end_repeat_nmi+0xf/0x60 [ 6205.836277][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6205.836284][ C2] ? kasan_check_range+0x12/0x1c0 [ 6205.836292][ C2] ? kasan_check_range+0x12/0x1c0 [ 6205.836300][ C2] ? kasan_check_range+0x12/0x1c0 [ 6205.836307][ C2] [ 6205.836309][ C2] [ 6205.836311][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 6205.836319][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6205.836325][ C2] ? get_stack_info+0x36/0xc0 [ 6205.836330][ C2] ? lock_acquire+0x1c1/0x220 [ 6205.836333][ C2] ? lock_release+0x1d5/0x250 [ 6205.836336][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6205.836340][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6205.836342][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6205.836346][ C2] ? lock_acquire+0x1c1/0x220 [ 6205.836348][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6205.836351][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6205.836353][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6205.836359][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6205.836362][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6205.836366][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6205.836371][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6205.836374][ C2] ip_local_deliver+0x19d/0x480 [ 6205.836376][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6205.836379][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6205.836381][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6205.836386][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6205.836390][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6205.836393][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6205.836401][ C2] ip_rcv+0x564/0x740 [ 6205.836403][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6205.836406][ C2] ? set_track_prepare+0x8a/0xd0 [ 6205.836409][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6205.836412][ C2] ? start_secondary+0x21c/0x2b0 [ 6205.836415][ C2] ? skb_clone+0x10b/0x330 [ 6205.836418][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6205.836423][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6205.836428][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6205.836432][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6205.836439][ C2] ? __tcf_classify+0x329/0x7d0 [ 6205.836443][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6205.836445][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6205.836448][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6205.836451][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6205.836455][ C2] ? lock_acquire+0x1c1/0x220 [ 6205.836457][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6205.836461][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6205.836465][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6205.836468][ C2] ? __copy_skb_header+0xaf/0x490 [ 6205.836472][ C2] ? __skb_clone+0x57a/0x760 [ 6205.836475][ C2] netif_receive_skb+0x55/0x280 [ 6205.836478][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6205.836484][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6205.836490][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6205.836497][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6205.836501][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6205.836510][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6205.836517][ C2] ? get_stack_info+0x36/0xc0 [ 6205.836522][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6205.836524][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6205.836528][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6205.836530][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6205.836533][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6205.836536][ C2] ? kernel_text_address+0x17/0xe0 [ 6205.836539][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6205.836543][ C2] ? arch_stack_walk+0x8c/0x100 [ 6205.836546][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6205.836549][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6205.836552][ C2] ? lock_acquire+0x1c1/0x220 [ 6205.836555][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6205.836558][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6205.836562][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6205.836565][ C2] ? get_stack_info+0x36/0xc0 [ 6205.836569][ C2] __tcf_classify+0x329/0x7d0 [ 6205.836574][ C2] tcf_classify+0x283/0x930 [ 6205.836578][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6205.836581][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6205.836585][ C2] tc_run+0x2e4/0x5d0 [ 6205.836588][ C2] ? __pfx_tc_run+0x10/0x10 [ 6205.836591][ C2] ? lock_acquire+0x1c1/0x220 [ 6205.836593][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6205.836597][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6205.836601][ C2] ? lock_acquire+0x1c1/0x220 [ 6205.836603][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6205.836606][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6205.836609][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6205.836612][ C2] ? neigh_hh_output+0x348/0x590 [ 6205.836615][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6205.836619][ C2] ip_finish_output2+0x786/0x18e0 [ 6205.836623][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6205.836630][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6205.836633][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6205.836636][ C2] ? __ip_finish_output+0x10f/0x770 [ 6205.836640][ C2] ip_output+0x16b/0x4f0 [ 6205.836643][ C2] ? __pfx_ip_output+0x10/0x10 [ 6205.836645][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6205.836648][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6205.836651][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6205.836653][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6205.836656][ C2] ? __alloc_skb+0xd4/0x280 [ 6205.836658][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6205.836662][ C2] ? tcp_fragment+0x168/0x1040 [ 6205.836664][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6205.836667][ C2] ? ip_local_out+0x114/0x3b0 [ 6205.836670][ C2] __ip_queue_xmit+0x672/0x1910 [ 6205.836674][ C2] ? __skb_clone+0x57a/0x760 [ 6205.836677][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6205.836682][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6205.836685][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6205.836688][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6205.836692][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6205.836696][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6205.836699][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6205.836702][ C2] tcp_send_loss_probe+0x348/0x830 [ 6205.836705][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6205.836707][ C2] tcp_write_timer+0x82/0x1d0 [ 6205.836710][ C2] call_timer_fn+0x173/0x430 [ 6205.836714][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6205.836719][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6205.836722][ C2] __run_timers.part.0+0x52d/0x890 [ 6205.836725][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6205.836729][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6205.836732][ C2] ? lock_acquire+0x1c1/0x220 [ 6205.836735][ C2] ? clockevents_program_event+0xf6/0x300 [ 6205.836738][ C2] ? lock_release+0x1d5/0x250 [ 6205.836741][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6205.836744][ C2] ? ktime_get+0xb3/0x190 [ 6205.836747][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6205.836751][ C2] run_timer_softirq+0x72/0x100 [ 6205.836754][ C2] __do_softirq+0x1b9/0x7ff [ 6205.836758][ C2] irq_exit_rcu+0x98/0xc0 [ 6205.836761][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6205.836764][ C2] [ 6205.836764][ C2] [ 6205.836766][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6205.836769][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6205.836772][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6205.836774][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6205.836776][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6205.836777][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6205.836778][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6205.836780][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6205.836781][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6205.836784][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6205.836787][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6205.836790][ C2] default_idle_call+0x69/0xa0 [ 6205.836792][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6205.836794][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6205.836798][ C2] ? lock_release+0x1d5/0x250 [ 6205.836800][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6205.836804][ C2] do_idle+0xfb/0x160 [ 6205.836806][ C2] cpu_startup_entry+0x55/0x60 [ 6205.836808][ C2] start_secondary+0x21c/0x2b0 [ 6205.836811][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6205.836815][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6205.836820][ C2] [ 6232.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3613s! [perl:4135] [ 6232.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6232.570955][ C1] irq event stamp: 209232 [ 6232.571166][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6232.571682][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6232.572147][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6232.572602][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6232.573053][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6232.573490][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6232.574086][ C1] RIP: 0010:kasan_check_range+0x16/0x1c0 [ 6232.574365][ C1] Code: 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 <48> 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe [ 6232.575312][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 6232.575610][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6232.576001][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6232.576390][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6232.576777][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6232.577167][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6232.577558][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6232.577993][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6232.578317][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6232.578706][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6232.579095][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6232.579509][ C1] PKRU: 55555554 [ 6232.579691][ C1] Call Trace: [ 6232.579859][ C1] [ 6232.580009][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6232.580272][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6232.580515][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6232.580797][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6232.581063][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6232.581345][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6232.581604][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6232.581902][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6232.582158][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6232.582458][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6232.582748][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6232.583058][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6232.583338][ C1] ? kasan_check_range+0x16/0x1c0 [ 6232.583588][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6232.583865][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6232.584168][ C1] ? get_stack_info+0x36/0xc0 [ 6232.584403][ C1] ? lock_acquire+0x1c1/0x220 [ 6232.584638][ C1] ? lock_release+0x1d5/0x250 [ 6232.584873][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6232.585116][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6232.585381][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6232.585658][ C1] ? lock_acquire+0x1c1/0x220 [ 6232.585892][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6232.586128][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6232.586381][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6232.586611][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6232.586851][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6232.587103][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6232.587372][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6232.587642][ C1] ip_local_deliver+0x19d/0x480 [ 6232.587885][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6232.588149][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6232.588406][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6232.588745][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6232.588991][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6232.589304][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6232.589592][ C1] ip_rcv+0x564/0x740 [ 6232.589797][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6232.590027][ C1] ? set_track_prepare+0x8a/0xd0 [ 6232.590281][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6232.590560][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6232.590836][ C1] ? skb_clone+0x10b/0x330 [ 6232.591057][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6232.591367][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6232.591667][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6232.591941][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6232.592229][ C1] ? __tcf_classify+0x329/0x7d0 [ 6232.592471][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6232.592695][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6232.592988][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6232.593267][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6232.593586][ C1] ? lock_acquire+0x1c1/0x220 [ 6232.593817][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6232.594106][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6232.594385][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6232.594694][ C1] ? __copy_skb_header+0xaf/0x490 [ 6232.594945][ C1] ? __skb_clone+0x57a/0x760 [ 6232.595175][ C1] netif_receive_skb+0x55/0x280 [ 6232.595416][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6232.595721][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6232.596045][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6232.596341][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6232.596608][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6232.596888][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6232.597192][ C1] ? hlock_class+0x4e/0x130 [ 6232.597419][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6232.597689][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6232.597957][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6232.598214][ C1] ? hlock_class+0x4e/0x130 [ 6232.598441][ C1] ? mark_lock+0x38/0x3e0 [ 6232.598655][ C1] ? stack_access_ok+0xda/0x1f0 [ 6232.598896][ C1] ? __lock_acquire+0xb67/0x1610 [ 6232.599145][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6232.599437][ C1] ? get_stack_info+0x36/0xc0 [ 6232.599676][ C1] ? stack_access_ok+0xda/0x1f0 [ 6232.599923][ C1] ? get_reg+0x119/0x190 [ 6232.600141][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6232.600410][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6232.600726][ C1] __tcf_classify+0x329/0x7d0 [ 6232.600960][ C1] tcf_classify+0x283/0x930 [ 6232.601187][ C1] ? arch_stack_walk+0xa2/0x100 [ 6232.601430][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6232.601680][ C1] ? get_stack_info+0x36/0xc0 [ 6232.601916][ C1] tc_run+0x2e4/0x5d0 [ 6232.602115][ C1] ? __pfx_tc_run+0x10/0x10 [ 6232.602339][ C1] ? lock_acquire+0x1c1/0x220 [ 6232.602573][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6232.602827][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6232.603073][ C1] ? lock_acquire+0x1c1/0x220 [ 6232.603305][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6232.603563][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6232.603861][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6232.604126][ C1] ? neigh_hh_output+0x348/0x590 [ 6232.604372][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6232.604631][ C1] ip_finish_output2+0x786/0x18e0 [ 6232.604881][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6232.605150][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6232.605481][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6232.605751][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6232.605998][ C1] ? __ip_finish_output+0x10f/0x770 [ 6232.606256][ C1] ip_output+0x16b/0x4f0 [ 6232.606465][ C1] ? run_timer_softirq+0x72/0x100 [ 6232.606716][ C1] ? __pfx_ip_output+0x10/0x10 [ 6232.606955][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6232.607235][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6232.607480][ C1] ? ip_local_out+0x114/0x3b0 [ 6232.607714][ C1] __ip_queue_xmit+0x672/0x1910 [ 6232.607956][ C1] ? __create_object+0x5e/0xb0 [ 6232.608195][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6232.608455][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6232.608729][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6232.608997][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6232.609288][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6232.609563][ C1] tcp_delack_timer+0x84/0x240 [ 6232.609807][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6232.610079][ C1] call_timer_fn+0x173/0x430 [ 6232.610317][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6232.610589][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6232.610843][ C1] __run_timers.part.0+0x52d/0x890 [ 6232.611095][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6232.611363][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6232.611641][ C1] ? lock_acquire+0x1c1/0x220 [ 6232.611875][ C1] ? clockevents_program_event+0xf6/0x300 [ 6232.612159][ C1] ? lock_release+0x1d5/0x250 [ 6232.612393][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6232.612649][ C1] ? ktime_get+0xb3/0x190 [ 6232.612864][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6232.613154][ C1] run_timer_softirq+0x72/0x100 [ 6232.613396][ C1] __do_softirq+0x1b9/0x7ff [ 6232.613623][ C1] irq_exit_rcu+0x98/0xc0 [ 6232.613836][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6232.614114][ C1] [ 6232.614261][ C1] [ 6232.614406][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6232.614704][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6232.615021][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6232.615965][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6232.616266][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6232.616654][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6232.617043][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6232.617435][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6232.617823][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6232.618214][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6232.618504][ C1] pipe_read+0xa16/0xdf0 [ 6232.618717][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6232.618988][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6232.619224][ C1] ? iterate_tty_write+0x299/0x540 [ 6232.619502][ C1] ? lock_release+0x1d5/0x250 [ 6232.619743][ C1] vfs_read+0x911/0xc00 [ 6232.619957][ C1] ? lock_acquire+0x1c1/0x220 [ 6232.620195][ C1] ? __might_fault+0xc6/0x180 [ 6232.620436][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6232.620684][ C1] ? __might_fault+0xc6/0x180 [ 6232.620916][ C1] ? lock_release+0x1d5/0x250 [ 6232.621149][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6232.621407][ C1] ? __fget_light+0x54/0x1e0 [ 6232.621638][ C1] ksys_read+0x17a/0x1e0 [ 6232.621849][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6232.622087][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6232.622385][ C1] do_syscall_64+0xc9/0x1e0 [ 6232.622612][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6232.622902][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6232.623124][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6232.624069][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6232.624480][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6232.624870][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6232.625259][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6232.625645][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6232.626038][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6232.626431][ C1] [ 6232.626583][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3613s! [swapper/2:0] [ 6232.626981][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6232.628188][ C2] irq event stamp: 44114564 [ 6232.628409][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6232.628924][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6232.629439][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6232.629910][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6232.630376][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6232.630831][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6232.631420][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6232.631734][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6232.632670][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6232.632966][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6232.633352][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6232.633736][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6232.634119][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6232.634504][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6232.634890][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6232.635321][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6232.635640][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6232.636026][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6232.636412][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6232.636797][ C2] PKRU: 55555554 [ 6232.636973][ C2] Call Trace: [ 6232.637135][ C2] [ 6232.637279][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6232.637531][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6232.637765][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6232.638032][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6232.638295][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6232.638575][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6232.638830][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6232.639124][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6232.639396][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6232.639655][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6232.639960][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6232.640255][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6232.640577][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6232.640855][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6232.641141][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6232.641419][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6232.641719][ C2] ? get_stack_info+0x36/0xc0 [ 6232.641955][ C2] ? lock_acquire+0x1c1/0x220 [ 6232.642187][ C2] ? lock_release+0x1d5/0x250 [ 6232.642419][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6232.642658][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6232.642921][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6232.643195][ C2] ? lock_acquire+0x1c1/0x220 [ 6232.643426][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6232.643659][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6232.643910][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6232.644136][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6232.644373][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6232.644621][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6232.644887][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6232.645155][ C2] ip_local_deliver+0x19d/0x480 [ 6232.645398][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6232.645660][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6232.645914][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6232.646249][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6232.646493][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6232.646800][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6232.647052][ C2] ip_rcv+0x564/0x740 [ 6232.647250][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6232.647471][ C2] ? set_track_prepare+0x8a/0xd0 [ 6232.647714][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6232.647981][ C2] ? start_secondary+0x21c/0x2b0 [ 6232.648223][ C2] ? skb_clone+0x10b/0x330 [ 6232.648443][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6232.648750][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6232.649045][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6232.649315][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6232.649625][ C2] ? __tcf_classify+0x329/0x7d0 [ 6232.649869][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6232.650099][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6232.650399][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6232.650704][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6232.651026][ C2] ? lock_acquire+0x1c1/0x220 [ 6232.651264][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6232.651558][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6232.651840][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6232.652158][ C2] ? __copy_skb_header+0xaf/0x490 [ 6232.652404][ C2] ? __skb_clone+0x57a/0x760 [ 6232.652631][ C2] netif_receive_skb+0x55/0x280 [ 6232.652870][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6232.653170][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6232.653494][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6232.653782][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6232.654044][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6232.654325][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6232.654626][ C2] ? get_stack_info+0x36/0xc0 [ 6232.654857][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6232.655112][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6232.655417][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6232.655685][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6232.655952][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6232.656256][ C2] ? kernel_text_address+0x17/0xe0 [ 6232.656507][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6232.656810][ C2] ? arch_stack_walk+0x8c/0x100 [ 6232.657050][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6232.657304][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6232.657578][ C2] ? lock_acquire+0x1c1/0x220 [ 6232.657809][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6232.658080][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6232.658374][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6232.658641][ C2] ? get_stack_info+0x36/0xc0 [ 6232.658871][ C2] __tcf_classify+0x329/0x7d0 [ 6232.659105][ C2] tcf_classify+0x283/0x930 [ 6232.659330][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6232.659602][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6232.659910][ C2] tc_run+0x2e4/0x5d0 [ 6232.660114][ C2] ? __pfx_tc_run+0x10/0x10 [ 6232.660340][ C2] ? lock_acquire+0x1c1/0x220 [ 6232.660588][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6232.660844][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6232.661088][ C2] ? lock_acquire+0x1c1/0x220 [ 6232.661319][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6232.661575][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6232.661868][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6232.662131][ C2] ? neigh_hh_output+0x348/0x590 [ 6232.662375][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6232.662630][ C2] ip_finish_output2+0x786/0x18e0 [ 6232.662878][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6232.663203][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6232.663469][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6232.663713][ C2] ? __ip_finish_output+0x10f/0x770 [ 6232.663970][ C2] ip_output+0x16b/0x4f0 [ 6232.664179][ C2] ? __pfx_ip_output+0x10/0x10 [ 6232.664432][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6232.664704][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6232.665013][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6232.665286][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6232.665546][ C2] ? __alloc_skb+0xd4/0x280 [ 6232.665768][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6232.666027][ C2] ? tcp_fragment+0x168/0x1040 [ 6232.666266][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6232.666509][ C2] ? ip_local_out+0x114/0x3b0 [ 6232.666739][ C2] __ip_queue_xmit+0x672/0x1910 [ 6232.666977][ C2] ? __skb_clone+0x57a/0x760 [ 6232.667206][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6232.667463][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6232.667734][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6232.667967][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6232.668209][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6232.668500][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6232.668809][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6232.669045][ C2] tcp_send_loss_probe+0x348/0x830 [ 6232.669296][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6232.669579][ C2] tcp_write_timer+0x82/0x1d0 [ 6232.669817][ C2] call_timer_fn+0x173/0x430 [ 6232.670050][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6232.670311][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6232.670581][ C2] __run_timers.part.0+0x52d/0x890 [ 6232.670832][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6232.671092][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6232.671366][ C2] ? lock_acquire+0x1c1/0x220 [ 6232.671597][ C2] ? clockevents_program_event+0xf6/0x300 [ 6232.671877][ C2] ? lock_release+0x1d5/0x250 [ 6232.672107][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6232.672362][ C2] ? ktime_get+0xb3/0x190 [ 6232.672577][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6232.672862][ C2] run_timer_softirq+0x72/0x100 [ 6232.673101][ C2] __do_softirq+0x1b9/0x7ff [ 6232.673327][ C2] irq_exit_rcu+0x98/0xc0 [ 6232.673539][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6232.673815][ C2] [ 6232.673959][ C2] [ 6232.674106][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6232.674396][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6232.674644][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6232.675580][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6232.675875][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6232.676262][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6232.676646][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6232.677029][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6232.677415][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6232.677802][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6232.678081][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6232.678332][ C2] default_idle_call+0x69/0xa0 [ 6232.678566][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6232.678809][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6232.679075][ C2] ? lock_release+0x1d5/0x250 [ 6232.679308][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6232.679595][ C2] do_idle+0xfb/0x160 [ 6232.679796][ C2] cpu_startup_entry+0x55/0x60 [ 6232.680037][ C2] start_secondary+0x21c/0x2b0 [ 6232.680279][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6232.680557][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6232.680856][ C2] [ 6260.569284][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3639s! [swapper/2:0] [ 6260.569719][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6260.570959][ C2] irq event stamp: 44114564 [ 6260.571179][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6260.571699][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6260.572195][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6260.572653][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6260.573106][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6260.573549][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6260.574141][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6260.574455][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6260.575391][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6260.575689][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6260.576073][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6260.576461][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6260.576846][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6260.577232][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6260.577615][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6260.578048][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6260.578371][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6260.578759][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6260.579144][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6260.579554][ C2] PKRU: 55555554 [ 6260.579733][ C2] Call Trace: [ 6260.579902][ C2] [ 6260.580048][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6260.580309][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6260.580559][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6260.580826][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6260.581091][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6260.581368][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6260.581624][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6260.581921][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6260.582173][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6260.582425][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6260.582725][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6260.583013][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6260.583318][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6260.583597][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6260.583883][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6260.584161][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6260.584463][ C2] ? get_stack_info+0x36/0xc0 [ 6260.584696][ C2] ? lock_acquire+0x1c1/0x220 [ 6260.584929][ C2] ? lock_release+0x1d5/0x250 [ 6260.585159][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6260.585401][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6260.585664][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6260.585941][ C2] ? lock_acquire+0x1c1/0x220 [ 6260.586173][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6260.586404][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6260.586657][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6260.586883][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6260.587122][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6260.587371][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6260.587640][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6260.587908][ C2] ip_local_deliver+0x19d/0x480 [ 6260.588146][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6260.588411][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6260.588665][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6260.589001][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6260.589250][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6260.589584][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6260.589844][ C2] ip_rcv+0x564/0x740 [ 6260.590046][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6260.590277][ C2] ? set_track_prepare+0x8a/0xd0 [ 6260.590536][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6260.590802][ C2] ? start_secondary+0x21c/0x2b0 [ 6260.591045][ C2] ? skb_clone+0x10b/0x330 [ 6260.591265][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6260.591573][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6260.591867][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6260.592142][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6260.592426][ C2] ? __tcf_classify+0x329/0x7d0 [ 6260.592667][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6260.592890][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6260.593179][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6260.593456][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6260.593770][ C2] ? lock_acquire+0x1c1/0x220 [ 6260.594001][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6260.594286][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6260.594564][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6260.594870][ C2] ? __copy_skb_header+0xaf/0x490 [ 6260.595119][ C2] ? __skb_clone+0x57a/0x760 [ 6260.595344][ C2] netif_receive_skb+0x55/0x280 [ 6260.595585][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6260.595888][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6260.596208][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6260.596499][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6260.596762][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6260.597041][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6260.597345][ C2] ? get_stack_info+0x36/0xc0 [ 6260.597579][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6260.597834][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6260.598140][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6260.598405][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6260.598675][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6260.598979][ C2] ? kernel_text_address+0x17/0xe0 [ 6260.599234][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6260.599559][ C2] ? arch_stack_walk+0x8c/0x100 [ 6260.599804][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6260.600067][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6260.600351][ C2] ? lock_acquire+0x1c1/0x220 [ 6260.600596][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6260.600868][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6260.601164][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6260.601430][ C2] ? get_stack_info+0x36/0xc0 [ 6260.601663][ C2] __tcf_classify+0x329/0x7d0 [ 6260.601897][ C2] tcf_classify+0x283/0x930 [ 6260.602121][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6260.602368][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6260.602671][ C2] tc_run+0x2e4/0x5d0 [ 6260.602868][ C2] ? __pfx_tc_run+0x10/0x10 [ 6260.603092][ C2] ? lock_acquire+0x1c1/0x220 [ 6260.603324][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6260.603577][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6260.603822][ C2] ? lock_acquire+0x1c1/0x220 [ 6260.604051][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6260.604308][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6260.604599][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6260.604864][ C2] ? neigh_hh_output+0x348/0x590 [ 6260.605108][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6260.605365][ C2] ip_finish_output2+0x786/0x18e0 [ 6260.605613][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6260.605943][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6260.606208][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6260.606452][ C2] ? __ip_finish_output+0x10f/0x770 [ 6260.606709][ C2] ip_output+0x16b/0x4f0 [ 6260.606920][ C2] ? __pfx_ip_output+0x10/0x10 [ 6260.607156][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6260.607426][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6260.607726][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6260.607993][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6260.608236][ C2] ? __alloc_skb+0xd4/0x280 [ 6260.608458][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6260.608720][ C2] ? tcp_fragment+0x168/0x1040 [ 6260.608954][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6260.609196][ C2] ? ip_local_out+0x114/0x3b0 [ 6260.609453][ C2] __ip_queue_xmit+0x672/0x1910 [ 6260.609699][ C2] ? __skb_clone+0x57a/0x760 [ 6260.609934][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6260.610199][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6260.610487][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6260.610722][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6260.610963][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6260.611254][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6260.611562][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6260.611798][ C2] tcp_send_loss_probe+0x348/0x830 [ 6260.612051][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6260.612312][ C2] tcp_write_timer+0x82/0x1d0 [ 6260.612542][ C2] call_timer_fn+0x173/0x430 [ 6260.612772][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6260.613024][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6260.613276][ C2] __run_timers.part.0+0x52d/0x890 [ 6260.613528][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6260.613788][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6260.614065][ C2] ? lock_acquire+0x1c1/0x220 [ 6260.614296][ C2] ? clockevents_program_event+0xf6/0x300 [ 6260.614576][ C2] ? lock_release+0x1d5/0x250 [ 6260.614806][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6260.615061][ C2] ? ktime_get+0xb3/0x190 [ 6260.615274][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6260.615560][ C2] run_timer_softirq+0x72/0x100 [ 6260.615801][ C2] __do_softirq+0x1b9/0x7ff [ 6260.616025][ C2] irq_exit_rcu+0x98/0xc0 [ 6260.616237][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6260.616513][ C2] [ 6260.616659][ C2] [ 6260.616803][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6260.617098][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6260.617346][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6260.618281][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6260.618578][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6260.618963][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6260.619368][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6260.619765][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6260.620162][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6260.620566][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6260.620844][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6260.621095][ C2] default_idle_call+0x69/0xa0 [ 6260.621330][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6260.621573][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6260.621842][ C2] ? lock_release+0x1d5/0x250 [ 6260.622072][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6260.622338][ C2] do_idle+0xfb/0x160 [ 6260.622533][ C2] cpu_startup_entry+0x55/0x60 [ 6260.622768][ C2] start_secondary+0x21c/0x2b0 [ 6260.623003][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6260.623263][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6260.623563][ C2] [ 6260.623714][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3639s! [perl:4135] [ 6260.624120][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6260.625340][ C1] irq event stamp: 209232 [ 6260.625557][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6260.626072][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6260.626536][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6260.626993][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6260.627444][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6260.627880][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6260.628475][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6260.628791][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6260.629775][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6260.630084][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6260.630494][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6260.630883][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6260.631273][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6260.631661][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6260.632049][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6260.632486][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6260.632812][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6260.633203][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6260.633591][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6260.633981][ C1] PKRU: 55555554 [ 6260.634157][ C1] Call Trace: [ 6260.634324][ C1] [ 6260.634467][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6260.634723][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6260.634960][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6260.635232][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6260.635499][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6260.635782][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6260.636041][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6260.636338][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6260.636594][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6260.636896][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6260.637185][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6260.637492][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6260.637773][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6260.638062][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6260.638343][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6260.638647][ C1] ? get_stack_info+0x36/0xc0 [ 6260.638882][ C1] ? lock_acquire+0x1c1/0x220 [ 6260.639117][ C1] ? lock_release+0x1d5/0x250 [ 6260.639373][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6260.639623][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6260.639897][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6260.640184][ C1] ? lock_acquire+0x1c1/0x220 [ 6260.640424][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6260.640671][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6260.640925][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6260.641155][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6260.641397][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6260.641648][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6260.641916][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6260.642187][ C1] ip_local_deliver+0x19d/0x480 [ 6260.642427][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6260.642695][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6260.642953][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6260.643290][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6260.643537][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6260.643849][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6260.644104][ C1] ip_rcv+0x564/0x740 [ 6260.644303][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6260.644531][ C1] ? set_track_prepare+0x8a/0xd0 [ 6260.644778][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6260.645047][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6260.645312][ C1] ? skb_clone+0x10b/0x330 [ 6260.645535][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6260.645846][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6260.646146][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6260.646420][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6260.646707][ C1] ? __tcf_classify+0x329/0x7d0 [ 6260.646949][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6260.647175][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6260.647468][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6260.647745][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6260.648062][ C1] ? lock_acquire+0x1c1/0x220 [ 6260.648296][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6260.648587][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6260.648864][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6260.649174][ C1] ? __copy_skb_header+0xaf/0x490 [ 6260.649453][ C1] ? __skb_clone+0x57a/0x760 [ 6260.649688][ C1] netif_receive_skb+0x55/0x280 [ 6260.649937][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6260.650249][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6260.650590][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6260.650882][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6260.651148][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6260.651432][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6260.651736][ C1] ? hlock_class+0x4e/0x130 [ 6260.651964][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6260.652233][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6260.652504][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6260.652763][ C1] ? hlock_class+0x4e/0x130 [ 6260.652988][ C1] ? mark_lock+0x38/0x3e0 [ 6260.653202][ C1] ? stack_access_ok+0xda/0x1f0 [ 6260.653446][ C1] ? __lock_acquire+0xb67/0x1610 [ 6260.653693][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6260.653962][ C1] ? get_stack_info+0x36/0xc0 [ 6260.654198][ C1] ? stack_access_ok+0xda/0x1f0 [ 6260.654440][ C1] ? get_reg+0x119/0x190 [ 6260.654650][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6260.654910][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6260.655212][ C1] __tcf_classify+0x329/0x7d0 [ 6260.655449][ C1] tcf_classify+0x283/0x930 [ 6260.655674][ C1] ? arch_stack_walk+0xa2/0x100 [ 6260.655916][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6260.656167][ C1] ? get_stack_info+0x36/0xc0 [ 6260.656403][ C1] tc_run+0x2e4/0x5d0 [ 6260.656602][ C1] ? __pfx_tc_run+0x10/0x10 [ 6260.656829][ C1] ? lock_acquire+0x1c1/0x220 [ 6260.657062][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6260.657318][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6260.657565][ C1] ? lock_acquire+0x1c1/0x220 [ 6260.657796][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6260.658058][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6260.658354][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6260.658620][ C1] ? neigh_hh_output+0x348/0x590 [ 6260.658867][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6260.659126][ C1] ip_finish_output2+0x786/0x18e0 [ 6260.659399][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6260.659678][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6260.660015][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6260.660292][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6260.660553][ C1] ? __ip_finish_output+0x10f/0x770 [ 6260.660813][ C1] ip_output+0x16b/0x4f0 [ 6260.661025][ C1] ? run_timer_softirq+0x72/0x100 [ 6260.661277][ C1] ? __pfx_ip_output+0x10/0x10 [ 6260.661515][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6260.661793][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6260.662039][ C1] ? ip_local_out+0x114/0x3b0 [ 6260.662275][ C1] __ip_queue_xmit+0x672/0x1910 [ 6260.662518][ C1] ? __create_object+0x5e/0xb0 [ 6260.662755][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6260.663016][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6260.663290][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6260.663556][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6260.663832][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6260.664097][ C1] tcp_delack_timer+0x84/0x240 [ 6260.664336][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6260.664601][ C1] call_timer_fn+0x173/0x430 [ 6260.664850][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6260.665112][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6260.665374][ C1] __run_timers.part.0+0x52d/0x890 [ 6260.665635][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6260.665909][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6260.666198][ C1] ? lock_acquire+0x1c1/0x220 [ 6260.666430][ C1] ? clockevents_program_event+0xf6/0x300 [ 6260.666714][ C1] ? lock_release+0x1d5/0x250 [ 6260.666947][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6260.667207][ C1] ? ktime_get+0xb3/0x190 [ 6260.667422][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6260.667712][ C1] run_timer_softirq+0x72/0x100 [ 6260.667954][ C1] __do_softirq+0x1b9/0x7ff [ 6260.668180][ C1] irq_exit_rcu+0x98/0xc0 [ 6260.668396][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6260.668675][ C1] [ 6260.668820][ C1] [ 6260.668969][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6260.669287][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6260.669615][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6260.670596][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6260.670894][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6260.671285][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6260.671675][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6260.672063][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6260.672452][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6260.672843][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6260.673131][ C1] pipe_read+0xa16/0xdf0 [ 6260.673348][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6260.673621][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6260.673860][ C1] ? iterate_tty_write+0x299/0x540 [ 6260.674115][ C1] ? lock_release+0x1d5/0x250 [ 6260.674351][ C1] vfs_read+0x911/0xc00 [ 6260.674560][ C1] ? lock_acquire+0x1c1/0x220 [ 6260.674794][ C1] ? __might_fault+0xc6/0x180 [ 6260.675028][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6260.675261][ C1] ? __might_fault+0xc6/0x180 [ 6260.675496][ C1] ? lock_release+0x1d5/0x250 [ 6260.675730][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6260.675991][ C1] ? __fget_light+0x54/0x1e0 [ 6260.676224][ C1] ksys_read+0x17a/0x1e0 [ 6260.676436][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6260.676675][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6260.676972][ C1] do_syscall_64+0xc9/0x1e0 [ 6260.677198][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6260.677491][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6260.677711][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6260.678659][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6260.679071][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6260.679486][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6260.679887][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6260.680286][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6260.680694][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6260.681084][ C1] [ 6283.837102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6283.837451][ C1] rcu: 1-....: (3919230 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=960644 [ 6283.837991][ C1] rcu: (t=3928950 jiffies g=1882453 q=715 ncpus=4) [ 6283.838317][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6283.838755][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6283.839377][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 6283.839663][ C1] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 6283.840637][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 6283.840936][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6283.841327][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6283.841718][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6283.842106][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6283.842495][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6283.842886][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6283.843322][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6283.843646][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6283.844035][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6283.844425][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6283.844815][ C1] PKRU: 55555554 [ 6283.844993][ C1] Call Trace: [ 6283.845157][ C1] [ 6283.845303][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6283.845570][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6283.845817][ C1] ? check_cpu_stall+0x284/0x500 [ 6283.846062][ C1] ? rcu_pending+0x92/0x360 [ 6283.846286][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6283.846550][ C1] ? update_process_times+0xb9/0x110 [ 6283.846815][ C1] ? tick_sched_handle+0x67/0x130 [ 6283.847065][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6283.847341][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6283.847581][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6283.847886][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6283.848152][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6283.848434][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6283.848693][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6283.848990][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6283.849268][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6283.849575][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6283.849873][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6283.850188][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6283.850483][ C1] ? __kasan_check_read+0x8/0x20 [ 6283.850729][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6283.851004][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6283.851308][ C1] ? get_stack_info+0x36/0xc0 [ 6283.851541][ C1] ? lock_acquire+0x1c1/0x220 [ 6283.851776][ C1] ? lock_release+0x1d5/0x250 [ 6283.852011][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6283.852253][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6283.852519][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6283.852795][ C1] ? lock_acquire+0x1c1/0x220 [ 6283.853028][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6283.853264][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6283.853517][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6283.853746][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6283.853986][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6283.854237][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6283.854508][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6283.854777][ C1] ip_local_deliver+0x19d/0x480 [ 6283.855018][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6283.855283][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6283.855541][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6283.855881][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6283.856127][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6283.856440][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6283.856696][ C1] ip_rcv+0x564/0x740 [ 6283.856896][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6283.857120][ C1] ? set_track_prepare+0x8a/0xd0 [ 6283.857367][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6283.857638][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6283.857904][ C1] ? skb_clone+0x10b/0x330 [ 6283.858124][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6283.858437][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6283.858736][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6283.859011][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6283.859324][ C1] ? __tcf_classify+0x329/0x7d0 [ 6283.859572][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6283.859802][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6283.860103][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6283.860398][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6283.860716][ C1] ? lock_acquire+0x1c1/0x220 [ 6283.860948][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6283.861238][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6283.861517][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6283.861826][ C1] ? __copy_skb_header+0xaf/0x490 [ 6283.862077][ C1] ? __skb_clone+0x57a/0x760 [ 6283.862308][ C1] netif_receive_skb+0x55/0x280 [ 6283.862551][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6283.862857][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6283.863182][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6283.863475][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6283.863744][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6283.864024][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6283.864330][ C1] ? hlock_class+0x4e/0x130 [ 6283.864557][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6283.864827][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6283.865096][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6283.865358][ C1] ? hlock_class+0x4e/0x130 [ 6283.865584][ C1] ? mark_lock+0x38/0x3e0 [ 6283.865798][ C1] ? stack_access_ok+0xda/0x1f0 [ 6283.866041][ C1] ? __lock_acquire+0xb67/0x1610 [ 6283.866289][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6283.866558][ C1] ? get_stack_info+0x36/0xc0 [ 6283.866792][ C1] ? stack_access_ok+0xda/0x1f0 [ 6283.867034][ C1] ? get_reg+0x119/0x190 [ 6283.867246][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6283.867512][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6283.867813][ C1] __tcf_classify+0x329/0x7d0 [ 6283.868048][ C1] tcf_classify+0x283/0x930 [ 6283.868276][ C1] ? arch_stack_walk+0xa2/0x100 [ 6283.868519][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6283.868770][ C1] ? get_stack_info+0x36/0xc0 [ 6283.869004][ C1] tc_run+0x2e4/0x5d0 [ 6283.869228][ C1] ? __pfx_tc_run+0x10/0x10 [ 6283.869458][ C1] ? lock_acquire+0x1c1/0x220 [ 6283.869698][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6283.869960][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6283.870213][ C1] ? lock_acquire+0x1c1/0x220 [ 6283.870461][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6283.870718][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6283.871016][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6283.871281][ C1] ? neigh_hh_output+0x348/0x590 [ 6283.871527][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6283.871785][ C1] ip_finish_output2+0x786/0x18e0 [ 6283.872034][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6283.872305][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6283.872634][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6283.872904][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6283.873151][ C1] ? __ip_finish_output+0x10f/0x770 [ 6283.873411][ C1] ip_output+0x16b/0x4f0 [ 6283.873623][ C1] ? run_timer_softirq+0x72/0x100 [ 6283.873873][ C1] ? __pfx_ip_output+0x10/0x10 [ 6283.874110][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6283.874388][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6283.874634][ C1] ? ip_local_out+0x114/0x3b0 [ 6283.874890][ C1] __ip_queue_xmit+0x672/0x1910 [ 6283.875139][ C1] ? __create_object+0x5e/0xb0 [ 6283.875383][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6283.875650][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6283.875931][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6283.876211][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6283.876485][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6283.876750][ C1] tcp_delack_timer+0x84/0x240 [ 6283.876988][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6283.877252][ C1] call_timer_fn+0x173/0x430 [ 6283.877483][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6283.877738][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6283.877993][ C1] __run_timers.part.0+0x52d/0x890 [ 6283.878247][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6283.878514][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6283.878793][ C1] ? lock_acquire+0x1c1/0x220 [ 6283.879026][ C1] ? clockevents_program_event+0xf6/0x300 [ 6283.879335][ C1] ? lock_release+0x1d5/0x250 [ 6283.879575][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6283.879839][ C1] ? ktime_get+0xb3/0x190 [ 6283.880060][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6283.880357][ C1] run_timer_softirq+0x72/0x100 [ 6283.880610][ C1] __do_softirq+0x1b9/0x7ff [ 6283.880837][ C1] irq_exit_rcu+0x98/0xc0 [ 6283.881052][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6283.881330][ C1] [ 6283.881478][ C1] [ 6283.881623][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6283.881922][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6283.882239][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6283.883187][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6283.883488][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6283.883877][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6283.884267][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6283.884657][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6283.885048][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6283.885439][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6283.885729][ C1] pipe_read+0xa16/0xdf0 [ 6283.885943][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6283.886215][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6283.886450][ C1] ? iterate_tty_write+0x299/0x540 [ 6283.886707][ C1] ? lock_release+0x1d5/0x250 [ 6283.886942][ C1] vfs_read+0x911/0xc00 [ 6283.887150][ C1] ? lock_acquire+0x1c1/0x220 [ 6283.887383][ C1] ? __might_fault+0xc6/0x180 [ 6283.887618][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6283.887852][ C1] ? __might_fault+0xc6/0x180 [ 6283.888085][ C1] ? lock_release+0x1d5/0x250 [ 6283.888318][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6283.888575][ C1] ? __fget_light+0x54/0x1e0 [ 6283.888808][ C1] ksys_read+0x17a/0x1e0 [ 6283.889019][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6283.889280][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6283.889589][ C1] do_syscall_64+0xc9/0x1e0 [ 6283.889823][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6283.890122][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6283.890366][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6283.891307][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6283.891719][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6283.892109][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6283.892497][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6283.892884][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6283.893275][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6283.893666][ C1] [ 6283.893818][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6283.894084][ C2] NMI backtrace for cpu 2 [ 6283.894090][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6283.894095][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6283.894099][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6283.894107][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6283.894113][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6283.894117][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6283.894121][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6283.894125][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6283.894128][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6283.894132][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6283.894136][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6283.894140][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6283.894146][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6283.894149][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6283.894152][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6283.894156][ C2] PKRU: 55555554 [ 6283.894158][ C2] Call Trace: [ 6283.894160][ C2] [ 6283.894163][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6283.894174][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6283.894182][ C2] ? nmi_handle+0x153/0x420 [ 6283.894191][ C2] ? default_do_nmi+0x41/0x100 [ 6283.894197][ C2] ? exc_nmi+0xf3/0x120 [ 6283.894203][ C2] ? end_repeat_nmi+0xf/0x60 [ 6283.894214][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6283.894222][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6283.894230][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6283.894238][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6283.894246][ C2] [ 6283.894248][ C2] [ 6283.894251][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6283.894257][ C2] ? get_stack_info+0x36/0xc0 [ 6283.894266][ C2] ? lock_acquire+0x1c1/0x220 [ 6283.894273][ C2] ? lock_release+0x1d5/0x250 [ 6283.894282][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6283.894290][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6283.894297][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6283.894305][ C2] ? lock_acquire+0x1c1/0x220 [ 6283.894310][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6283.894318][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6283.894325][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6283.894341][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6283.894347][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6283.894358][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6283.894368][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6283.894376][ C2] ip_local_deliver+0x19d/0x480 [ 6283.894382][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6283.894386][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6283.894392][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6283.894403][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6283.894411][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6283.894418][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6283.894438][ C2] ip_rcv+0x564/0x740 [ 6283.894444][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6283.894451][ C2] ? set_track_prepare+0x8a/0xd0 [ 6283.894459][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6283.894466][ C2] ? start_secondary+0x21c/0x2b0 [ 6283.894472][ C2] ? skb_clone+0x10b/0x330 [ 6283.894477][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6283.894492][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6283.894506][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6283.894513][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6283.894532][ C2] ? __tcf_classify+0x329/0x7d0 [ 6283.894541][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6283.894546][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6283.894554][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6283.894561][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6283.894572][ C2] ? lock_acquire+0x1c1/0x220 [ 6283.894577][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6283.894588][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6283.894596][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6283.894606][ C2] ? __copy_skb_header+0xaf/0x490 [ 6283.894615][ C2] ? __skb_clone+0x57a/0x760 [ 6283.894621][ C2] netif_receive_skb+0x55/0x280 [ 6283.894629][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6283.894646][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6283.894663][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6283.894681][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6283.894692][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6283.894718][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6283.894737][ C2] ? get_stack_info+0x36/0xc0 [ 6283.894749][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6283.894755][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6283.894763][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6283.894769][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6283.894778][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6283.894784][ C2] ? kernel_text_address+0x17/0xe0 [ 6283.894791][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6283.894800][ C2] ? arch_stack_walk+0x8c/0x100 [ 6283.894807][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6283.894815][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6283.894823][ C2] ? lock_acquire+0x1c1/0x220 [ 6283.894828][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6283.894837][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6283.894845][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6283.894852][ C2] ? get_stack_info+0x36/0xc0 [ 6283.894862][ C2] __tcf_classify+0x329/0x7d0 [ 6283.894875][ C2] tcf_classify+0x283/0x930 [ 6283.894885][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6283.894893][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6283.894904][ C2] tc_run+0x2e4/0x5d0 [ 6283.894911][ C2] ? __pfx_tc_run+0x10/0x10 [ 6283.894916][ C2] ? lock_acquire+0x1c1/0x220 [ 6283.894918][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6283.894922][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6283.894926][ C2] ? lock_acquire+0x1c1/0x220 [ 6283.894928][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6283.894931][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6283.894934][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6283.894936][ C2] ? neigh_hh_output+0x348/0x590 [ 6283.894940][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6283.894944][ C2] ip_finish_output2+0x786/0x18e0 [ 6283.894947][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6283.894954][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6283.894956][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6283.894960][ C2] ? __ip_finish_output+0x10f/0x770 [ 6283.894964][ C2] ip_output+0x16b/0x4f0 [ 6283.894967][ C2] ? __pfx_ip_output+0x10/0x10 [ 6283.894969][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6283.894972][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6283.894975][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6283.894977][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6283.894980][ C2] ? __alloc_skb+0xd4/0x280 [ 6283.894982][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6283.894986][ C2] ? tcp_fragment+0x168/0x1040 [ 6283.894989][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6283.894992][ C2] ? ip_local_out+0x114/0x3b0 [ 6283.894995][ C2] __ip_queue_xmit+0x672/0x1910 [ 6283.894999][ C2] ? __skb_clone+0x57a/0x760 [ 6283.895001][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6283.895006][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6283.895009][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6283.895013][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6283.895016][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6283.895020][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6283.895023][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6283.895026][ C2] tcp_send_loss_probe+0x348/0x830 [ 6283.895030][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6283.895032][ C2] tcp_write_timer+0x82/0x1d0 [ 6283.895035][ C2] call_timer_fn+0x173/0x430 [ 6283.895039][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6283.895043][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6283.895047][ C2] __run_timers.part.0+0x52d/0x890 [ 6283.895050][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6283.895054][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6283.895057][ C2] ? lock_acquire+0x1c1/0x220 [ 6283.895059][ C2] ? clockevents_program_event+0xf6/0x300 [ 6283.895063][ C2] ? lock_release+0x1d5/0x250 [ 6283.895066][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6283.895069][ C2] ? ktime_get+0xb3/0x190 [ 6283.895072][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6283.895076][ C2] run_timer_softirq+0x72/0x100 [ 6283.895079][ C2] __do_softirq+0x1b9/0x7ff [ 6283.895083][ C2] irq_exit_rcu+0x98/0xc0 [ 6283.895085][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6283.895088][ C2] [ 6283.895089][ C2] [ 6283.895090][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6283.895093][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6283.895096][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6283.895098][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6283.895100][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6283.895101][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6283.895103][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6283.895104][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6283.895106][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6283.895109][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6283.895112][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6283.895115][ C2] default_idle_call+0x69/0xa0 [ 6283.895118][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6283.895120][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6283.895123][ C2] ? lock_release+0x1d5/0x250 [ 6283.895126][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6283.895129][ C2] do_idle+0xfb/0x160 [ 6283.895132][ C2] cpu_startup_entry+0x55/0x60 [ 6283.895134][ C2] start_secondary+0x21c/0x2b0 [ 6283.895137][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6283.895141][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6283.895146][ C2] [ 6308.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3684s! [perl:4135] [ 6308.569701][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6308.570947][ C1] irq event stamp: 209232 [ 6308.571159][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6308.571672][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6308.572138][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6308.572596][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6308.573045][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6308.573482][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6308.574078][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6308.574395][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6308.575341][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6308.575641][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6308.576030][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6308.576418][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6308.576805][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6308.577196][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6308.577586][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6308.578021][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6308.578346][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6308.578735][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6308.579148][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6308.579546][ C1] PKRU: 55555554 [ 6308.579728][ C1] Call Trace: [ 6308.579898][ C1] [ 6308.580046][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6308.580317][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6308.580554][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6308.580822][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6308.581086][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6308.581369][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6308.581627][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6308.581925][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6308.582183][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6308.582482][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6308.582769][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6308.583078][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6308.583359][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6308.583645][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6308.583927][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6308.584229][ C1] ? get_stack_info+0x36/0xc0 [ 6308.584463][ C1] ? lock_acquire+0x1c1/0x220 [ 6308.584697][ C1] ? lock_release+0x1d5/0x250 [ 6308.584930][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6308.585172][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6308.585437][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6308.585712][ C1] ? lock_acquire+0x1c1/0x220 [ 6308.585946][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6308.586181][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6308.586434][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6308.586661][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6308.586901][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6308.587151][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6308.587423][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6308.587694][ C1] ip_local_deliver+0x19d/0x480 [ 6308.587936][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6308.588201][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6308.588458][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6308.588797][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6308.589065][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6308.589386][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6308.589649][ C1] ip_rcv+0x564/0x740 [ 6308.589854][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6308.590084][ C1] ? set_track_prepare+0x8a/0xd0 [ 6308.590345][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6308.590616][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6308.590882][ C1] ? skb_clone+0x10b/0x330 [ 6308.591103][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6308.591415][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6308.591714][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6308.591988][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6308.592277][ C1] ? __tcf_classify+0x329/0x7d0 [ 6308.592521][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6308.592746][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6308.593039][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6308.593318][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6308.593637][ C1] ? lock_acquire+0x1c1/0x220 [ 6308.593868][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6308.594159][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6308.594436][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6308.594745][ C1] ? __copy_skb_header+0xaf/0x490 [ 6308.594996][ C1] ? __skb_clone+0x57a/0x760 [ 6308.595227][ C1] netif_receive_skb+0x55/0x280 [ 6308.595469][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6308.595774][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6308.596099][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6308.596391][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6308.596660][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6308.596940][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6308.597246][ C1] ? hlock_class+0x4e/0x130 [ 6308.597474][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6308.597743][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6308.598011][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6308.598268][ C1] ? hlock_class+0x4e/0x130 [ 6308.598494][ C1] ? mark_lock+0x38/0x3e0 [ 6308.598707][ C1] ? stack_access_ok+0xda/0x1f0 [ 6308.598951][ C1] ? __lock_acquire+0xb67/0x1610 [ 6308.599246][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6308.599523][ C1] ? get_stack_info+0x36/0xc0 [ 6308.599763][ C1] ? stack_access_ok+0xda/0x1f0 [ 6308.600011][ C1] ? get_reg+0x119/0x190 [ 6308.600238][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6308.600500][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6308.600803][ C1] __tcf_classify+0x329/0x7d0 [ 6308.601038][ C1] tcf_classify+0x283/0x930 [ 6308.601267][ C1] ? arch_stack_walk+0xa2/0x100 [ 6308.601511][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6308.601762][ C1] ? get_stack_info+0x36/0xc0 [ 6308.601997][ C1] tc_run+0x2e4/0x5d0 [ 6308.602198][ C1] ? __pfx_tc_run+0x10/0x10 [ 6308.602422][ C1] ? lock_acquire+0x1c1/0x220 [ 6308.602658][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6308.602913][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6308.603161][ C1] ? lock_acquire+0x1c1/0x220 [ 6308.603394][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6308.603653][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6308.603951][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6308.604217][ C1] ? neigh_hh_output+0x348/0x590 [ 6308.604465][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6308.604723][ C1] ip_finish_output2+0x786/0x18e0 [ 6308.604973][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6308.605245][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6308.605577][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6308.605848][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6308.606096][ C1] ? __ip_finish_output+0x10f/0x770 [ 6308.606355][ C1] ip_output+0x16b/0x4f0 [ 6308.606565][ C1] ? run_timer_softirq+0x72/0x100 [ 6308.606817][ C1] ? __pfx_ip_output+0x10/0x10 [ 6308.607055][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6308.607334][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6308.607580][ C1] ? ip_local_out+0x114/0x3b0 [ 6308.607815][ C1] __ip_queue_xmit+0x672/0x1910 [ 6308.608058][ C1] ? __create_object+0x5e/0xb0 [ 6308.608297][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6308.608558][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6308.608832][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6308.609124][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6308.609409][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6308.609682][ C1] tcp_delack_timer+0x84/0x240 [ 6308.609927][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6308.610199][ C1] call_timer_fn+0x173/0x430 [ 6308.610443][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6308.610699][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6308.610954][ C1] __run_timers.part.0+0x52d/0x890 [ 6308.611208][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6308.611475][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6308.611755][ C1] ? lock_acquire+0x1c1/0x220 [ 6308.611989][ C1] ? clockevents_program_event+0xf6/0x300 [ 6308.612272][ C1] ? lock_release+0x1d5/0x250 [ 6308.612506][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6308.612765][ C1] ? ktime_get+0xb3/0x190 [ 6308.612980][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6308.613270][ C1] run_timer_softirq+0x72/0x100 [ 6308.613513][ C1] __do_softirq+0x1b9/0x7ff [ 6308.613741][ C1] irq_exit_rcu+0x98/0xc0 [ 6308.613956][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6308.614236][ C1] [ 6308.614384][ C1] [ 6308.614530][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6308.614828][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6308.615146][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6308.616095][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6308.616397][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6308.616786][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6308.617176][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6308.617568][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6308.617958][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6308.618349][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6308.618640][ C1] pipe_read+0xa16/0xdf0 [ 6308.618854][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6308.619151][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6308.619394][ C1] ? iterate_tty_write+0x299/0x540 [ 6308.619658][ C1] ? lock_release+0x1d5/0x250 [ 6308.619900][ C1] vfs_read+0x911/0xc00 [ 6308.620115][ C1] ? lock_acquire+0x1c1/0x220 [ 6308.620360][ C1] ? __might_fault+0xc6/0x180 [ 6308.620596][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6308.620831][ C1] ? __might_fault+0xc6/0x180 [ 6308.621064][ C1] ? lock_release+0x1d5/0x250 [ 6308.621298][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6308.621556][ C1] ? __fget_light+0x54/0x1e0 [ 6308.621790][ C1] ksys_read+0x17a/0x1e0 [ 6308.622003][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6308.622243][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6308.622541][ C1] do_syscall_64+0xc9/0x1e0 [ 6308.622769][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6308.623060][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6308.623288][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6308.624237][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6308.624649][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6308.625040][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6308.625429][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6308.625818][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6308.626209][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6308.626608][ C1] [ 6308.626761][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3684s! [swapper/2:0] [ 6308.627166][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6308.628379][ C2] irq event stamp: 44114564 [ 6308.628599][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6308.629144][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6308.629652][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6308.630125][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6308.630589][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6308.631028][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6308.631621][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 6308.631893][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 6308.632834][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 6308.633133][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6308.633522][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6308.633907][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6308.634293][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6308.634677][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6308.635064][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6308.635497][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6308.635818][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6308.636205][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6308.636589][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6308.636977][ C2] PKRU: 55555554 [ 6308.637153][ C2] Call Trace: [ 6308.637316][ C2] [ 6308.637458][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6308.637712][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6308.637946][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6308.638217][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6308.638480][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6308.638758][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6308.639019][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6308.639337][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6308.639596][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6308.639856][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6308.640164][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6308.640463][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6308.640767][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6308.641049][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 6308.641323][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 6308.641594][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6308.641897][ C2] ? get_stack_info+0x36/0xc0 [ 6308.642131][ C2] ? lock_acquire+0x1c1/0x220 [ 6308.642361][ C2] ? lock_release+0x1d5/0x250 [ 6308.642594][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6308.642834][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6308.643096][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6308.643374][ C2] ? lock_acquire+0x1c1/0x220 [ 6308.643603][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6308.643835][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6308.644086][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6308.644314][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6308.644554][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6308.644802][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6308.645067][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6308.645334][ C2] ip_local_deliver+0x19d/0x480 [ 6308.645573][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6308.645835][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6308.646092][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6308.646427][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6308.646672][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6308.646982][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6308.647235][ C2] ip_rcv+0x564/0x740 [ 6308.647432][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6308.647656][ C2] ? set_track_prepare+0x8a/0xd0 [ 6308.647901][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6308.648168][ C2] ? start_secondary+0x21c/0x2b0 [ 6308.648413][ C2] ? skb_clone+0x10b/0x330 [ 6308.648632][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6308.648939][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6308.649261][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6308.649540][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6308.649832][ C2] ? __tcf_classify+0x329/0x7d0 [ 6308.650079][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6308.650317][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6308.650605][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6308.650882][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6308.651198][ C2] ? lock_acquire+0x1c1/0x220 [ 6308.651427][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6308.651714][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6308.651990][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6308.652296][ C2] ? __copy_skb_header+0xaf/0x490 [ 6308.652545][ C2] ? __skb_clone+0x57a/0x760 [ 6308.652772][ C2] netif_receive_skb+0x55/0x280 [ 6308.653012][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6308.653315][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6308.653637][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6308.653927][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6308.654193][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6308.654472][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6308.654776][ C2] ? get_stack_info+0x36/0xc0 [ 6308.655010][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6308.655266][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6308.655572][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6308.655838][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6308.656106][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6308.656410][ C2] ? kernel_text_address+0x17/0xe0 [ 6308.656662][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6308.656966][ C2] ? arch_stack_walk+0x8c/0x100 [ 6308.657206][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6308.657460][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6308.657738][ C2] ? lock_acquire+0x1c1/0x220 [ 6308.657968][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6308.658242][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6308.658538][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6308.658805][ C2] ? get_stack_info+0x36/0xc0 [ 6308.659059][ C2] __tcf_classify+0x329/0x7d0 [ 6308.659297][ C2] tcf_classify+0x283/0x930 [ 6308.659529][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6308.659784][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6308.660095][ C2] tc_run+0x2e4/0x5d0 [ 6308.660307][ C2] ? __pfx_tc_run+0x10/0x10 [ 6308.660530][ C2] ? lock_acquire+0x1c1/0x220 [ 6308.660760][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6308.661013][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6308.661258][ C2] ? lock_acquire+0x1c1/0x220 [ 6308.661488][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6308.661743][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6308.662037][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6308.662304][ C2] ? neigh_hh_output+0x348/0x590 [ 6308.662548][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6308.662803][ C2] ip_finish_output2+0x786/0x18e0 [ 6308.663052][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6308.663381][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6308.663647][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6308.663893][ C2] ? __ip_finish_output+0x10f/0x770 [ 6308.664153][ C2] ip_output+0x16b/0x4f0 [ 6308.664362][ C2] ? __pfx_ip_output+0x10/0x10 [ 6308.664597][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6308.664865][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6308.665167][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6308.665454][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6308.665704][ C2] ? __alloc_skb+0xd4/0x280 [ 6308.665932][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6308.666198][ C2] ? tcp_fragment+0x168/0x1040 [ 6308.666442][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6308.666698][ C2] ? ip_local_out+0x114/0x3b0 [ 6308.666930][ C2] __ip_queue_xmit+0x672/0x1910 [ 6308.667172][ C2] ? __skb_clone+0x57a/0x760 [ 6308.667398][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6308.667657][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6308.667928][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6308.668166][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6308.668408][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6308.668697][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6308.669011][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6308.669270][ C2] tcp_send_loss_probe+0x348/0x830 [ 6308.669527][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6308.669793][ C2] tcp_write_timer+0x82/0x1d0 [ 6308.670032][ C2] call_timer_fn+0x173/0x430 [ 6308.670277][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6308.670531][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6308.670784][ C2] __run_timers.part.0+0x52d/0x890 [ 6308.671035][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6308.671295][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6308.671572][ C2] ? lock_acquire+0x1c1/0x220 [ 6308.671800][ C2] ? clockevents_program_event+0xf6/0x300 [ 6308.672083][ C2] ? lock_release+0x1d5/0x250 [ 6308.672315][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6308.672570][ C2] ? ktime_get+0xb3/0x190 [ 6308.672782][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6308.673070][ C2] run_timer_softirq+0x72/0x100 [ 6308.673310][ C2] __do_softirq+0x1b9/0x7ff [ 6308.673533][ C2] irq_exit_rcu+0x98/0xc0 [ 6308.673748][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6308.674023][ C2] [ 6308.674169][ C2] [ 6308.674314][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6308.674609][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6308.674856][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6308.675796][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6308.676093][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6308.676479][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6308.676864][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6308.677250][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6308.677638][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6308.678025][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6308.678304][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6308.678557][ C2] default_idle_call+0x69/0xa0 [ 6308.678793][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6308.679056][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6308.679332][ C2] ? lock_release+0x1d5/0x250 [ 6308.679569][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6308.679842][ C2] do_idle+0xfb/0x160 [ 6308.680046][ C2] cpu_startup_entry+0x55/0x60 [ 6308.680297][ C2] start_secondary+0x21c/0x2b0 [ 6308.680532][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6308.680792][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6308.681091][ C2] [ 6336.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3710s! [perl:4135] [ 6336.569693][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6336.570933][ C1] irq event stamp: 209232 [ 6336.571147][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6336.571661][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6336.572125][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6336.572583][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6336.573037][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6336.573476][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6336.574073][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6336.574396][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6336.575346][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6336.575646][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6336.576036][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6336.576425][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6336.576814][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6336.577206][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6336.577596][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6336.578033][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6336.578356][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6336.578746][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6336.579164][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6336.579563][ C1] PKRU: 55555554 [ 6336.579746][ C1] Call Trace: [ 6336.579915][ C1] [ 6336.580063][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6336.580329][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6336.580566][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6336.580836][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6336.581101][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6336.581383][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6336.581642][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6336.581941][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6336.582197][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6336.582497][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6336.582785][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6336.583092][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6336.583375][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6336.583662][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6336.583945][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6336.584248][ C1] ? get_stack_info+0x36/0xc0 [ 6336.584483][ C1] ? lock_acquire+0x1c1/0x220 [ 6336.584718][ C1] ? lock_release+0x1d5/0x250 [ 6336.584953][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6336.585195][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6336.585461][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6336.585738][ C1] ? lock_acquire+0x1c1/0x220 [ 6336.585973][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6336.586209][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6336.586463][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6336.586690][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6336.586931][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6336.587183][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6336.587452][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6336.587722][ C1] ip_local_deliver+0x19d/0x480 [ 6336.587964][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6336.588228][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6336.588484][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6336.588826][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6336.589097][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6336.589418][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6336.589681][ C1] ip_rcv+0x564/0x740 [ 6336.589887][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6336.590116][ C1] ? set_track_prepare+0x8a/0xd0 [ 6336.590374][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6336.590643][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6336.590910][ C1] ? skb_clone+0x10b/0x330 [ 6336.591130][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6336.591444][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6336.591742][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6336.592014][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6336.592322][ C1] ? __tcf_classify+0x329/0x7d0 [ 6336.592572][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6336.592801][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6336.593103][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6336.593388][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6336.593716][ C1] ? lock_acquire+0x1c1/0x220 [ 6336.593947][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6336.594237][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6336.594514][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6336.594824][ C1] ? __copy_skb_header+0xaf/0x490 [ 6336.595075][ C1] ? __skb_clone+0x57a/0x760 [ 6336.595304][ C1] netif_receive_skb+0x55/0x280 [ 6336.595547][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6336.595853][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6336.596176][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6336.596467][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6336.596735][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6336.597015][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6336.597321][ C1] ? hlock_class+0x4e/0x130 [ 6336.597547][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6336.597818][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6336.598086][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6336.598342][ C1] ? hlock_class+0x4e/0x130 [ 6336.598569][ C1] ? mark_lock+0x38/0x3e0 [ 6336.598782][ C1] ? stack_access_ok+0xda/0x1f0 [ 6336.599050][ C1] ? __lock_acquire+0xb67/0x1610 [ 6336.599305][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6336.599582][ C1] ? get_stack_info+0x36/0xc0 [ 6336.599822][ C1] ? stack_access_ok+0xda/0x1f0 [ 6336.600069][ C1] ? get_reg+0x119/0x190 [ 6336.600293][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6336.600555][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6336.600855][ C1] __tcf_classify+0x329/0x7d0 [ 6336.601092][ C1] tcf_classify+0x283/0x930 [ 6336.601319][ C1] ? arch_stack_walk+0xa2/0x100 [ 6336.601562][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6336.601812][ C1] ? get_stack_info+0x36/0xc0 [ 6336.602046][ C1] tc_run+0x2e4/0x5d0 [ 6336.602247][ C1] ? __pfx_tc_run+0x10/0x10 [ 6336.602471][ C1] ? lock_acquire+0x1c1/0x220 [ 6336.602705][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6336.602959][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6336.603206][ C1] ? lock_acquire+0x1c1/0x220 [ 6336.603439][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6336.603697][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6336.603995][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6336.604261][ C1] ? neigh_hh_output+0x348/0x590 [ 6336.604507][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6336.604765][ C1] ip_finish_output2+0x786/0x18e0 [ 6336.605015][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6336.605285][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6336.605614][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6336.605885][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6336.606133][ C1] ? __ip_finish_output+0x10f/0x770 [ 6336.606389][ C1] ip_output+0x16b/0x4f0 [ 6336.606599][ C1] ? run_timer_softirq+0x72/0x100 [ 6336.606850][ C1] ? __pfx_ip_output+0x10/0x10 [ 6336.607087][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6336.607366][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6336.607611][ C1] ? ip_local_out+0x114/0x3b0 [ 6336.607846][ C1] __ip_queue_xmit+0x672/0x1910 [ 6336.608088][ C1] ? __create_object+0x5e/0xb0 [ 6336.608328][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6336.608589][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6336.608862][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6336.609158][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6336.609439][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6336.609710][ C1] tcp_delack_timer+0x84/0x240 [ 6336.609955][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6336.610234][ C1] call_timer_fn+0x173/0x430 [ 6336.610465][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6336.610724][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6336.610979][ C1] __run_timers.part.0+0x52d/0x890 [ 6336.611235][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6336.611501][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6336.611780][ C1] ? lock_acquire+0x1c1/0x220 [ 6336.612013][ C1] ? clockevents_program_event+0xf6/0x300 [ 6336.612295][ C1] ? lock_release+0x1d5/0x250 [ 6336.612529][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6336.612786][ C1] ? ktime_get+0xb3/0x190 [ 6336.613000][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6336.613291][ C1] run_timer_softirq+0x72/0x100 [ 6336.613534][ C1] __do_softirq+0x1b9/0x7ff [ 6336.613760][ C1] irq_exit_rcu+0x98/0xc0 [ 6336.613975][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6336.614252][ C1] [ 6336.614400][ C1] [ 6336.614546][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6336.614843][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6336.615160][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6336.616104][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6336.616403][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6336.616791][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6336.617179][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6336.617569][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6336.617958][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6336.618348][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6336.618637][ C1] pipe_read+0xa16/0xdf0 [ 6336.618852][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6336.619148][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6336.619391][ C1] ? iterate_tty_write+0x299/0x540 [ 6336.619652][ C1] ? lock_release+0x1d5/0x250 [ 6336.619894][ C1] vfs_read+0x911/0xc00 [ 6336.620118][ C1] ? lock_acquire+0x1c1/0x220 [ 6336.620351][ C1] ? __might_fault+0xc6/0x180 [ 6336.620586][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6336.620820][ C1] ? __might_fault+0xc6/0x180 [ 6336.621051][ C1] ? lock_release+0x1d5/0x250 [ 6336.621287][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6336.621544][ C1] ? __fget_light+0x54/0x1e0 [ 6336.621776][ C1] ksys_read+0x17a/0x1e0 [ 6336.621988][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6336.622227][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6336.622524][ C1] do_syscall_64+0xc9/0x1e0 [ 6336.622751][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6336.623042][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6336.623265][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6336.624211][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6336.624621][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6336.625011][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6336.625400][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6336.625787][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6336.626175][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6336.626569][ C1] [ 6336.626722][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3710s! [swapper/2:0] [ 6336.627121][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6336.628328][ C2] irq event stamp: 44114564 [ 6336.628550][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6336.629088][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6336.629594][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6336.630067][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6336.630529][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6336.630966][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6336.631557][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6336.631869][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6336.632807][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6336.633104][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6336.633489][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6336.633872][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6336.634257][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6336.634644][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6336.635028][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6336.635459][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6336.635777][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6336.636163][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6336.636552][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6336.636935][ C2] PKRU: 55555554 [ 6336.637111][ C2] Call Trace: [ 6336.637274][ C2] [ 6336.637417][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6336.637668][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6336.637903][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6336.638169][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6336.638431][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6336.638711][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6336.638987][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6336.639290][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6336.639549][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6336.639808][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6336.640124][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6336.640406][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6336.640708][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6336.640987][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6336.641272][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6336.641552][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6336.641852][ C2] ? get_stack_info+0x36/0xc0 [ 6336.642081][ C2] ? lock_acquire+0x1c1/0x220 [ 6336.642313][ C2] ? lock_release+0x1d5/0x250 [ 6336.642545][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6336.642785][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6336.643047][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6336.643321][ C2] ? lock_acquire+0x1c1/0x220 [ 6336.643552][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6336.643783][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6336.644034][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6336.644261][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6336.644498][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6336.644747][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6336.645012][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6336.645278][ C2] ip_local_deliver+0x19d/0x480 [ 6336.645517][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6336.645778][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6336.646031][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6336.646367][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6336.646610][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6336.646919][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6336.647171][ C2] ip_rcv+0x564/0x740 [ 6336.647368][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6336.647590][ C2] ? set_track_prepare+0x8a/0xd0 [ 6336.647834][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6336.648103][ C2] ? start_secondary+0x21c/0x2b0 [ 6336.648346][ C2] ? skb_clone+0x10b/0x330 [ 6336.648564][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6336.648874][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6336.649197][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6336.649474][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6336.649766][ C2] ? __tcf_classify+0x329/0x7d0 [ 6336.650013][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6336.650248][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6336.650539][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6336.650813][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6336.651129][ C2] ? lock_acquire+0x1c1/0x220 [ 6336.651359][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6336.651647][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6336.651921][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6336.652228][ C2] ? __copy_skb_header+0xaf/0x490 [ 6336.652475][ C2] ? __skb_clone+0x57a/0x760 [ 6336.652703][ C2] netif_receive_skb+0x55/0x280 [ 6336.652943][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6336.653245][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6336.653566][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6336.653854][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6336.654121][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6336.654399][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6336.654701][ C2] ? get_stack_info+0x36/0xc0 [ 6336.654933][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6336.655190][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6336.655496][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6336.655763][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6336.656030][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6336.656334][ C2] ? kernel_text_address+0x17/0xe0 [ 6336.656584][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6336.656887][ C2] ? arch_stack_walk+0x8c/0x100 [ 6336.657127][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6336.657381][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6336.657657][ C2] ? lock_acquire+0x1c1/0x220 [ 6336.657886][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6336.658160][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6336.658451][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6336.658720][ C2] ? get_stack_info+0x36/0xc0 [ 6336.658973][ C2] __tcf_classify+0x329/0x7d0 [ 6336.659212][ C2] tcf_classify+0x283/0x930 [ 6336.659443][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6336.659697][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6336.660007][ C2] tc_run+0x2e4/0x5d0 [ 6336.660217][ C2] ? __pfx_tc_run+0x10/0x10 [ 6336.660440][ C2] ? lock_acquire+0x1c1/0x220 [ 6336.660670][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6336.660921][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6336.661166][ C2] ? lock_acquire+0x1c1/0x220 [ 6336.661397][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6336.661652][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6336.661946][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6336.662208][ C2] ? neigh_hh_output+0x348/0x590 [ 6336.662452][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6336.662707][ C2] ip_finish_output2+0x786/0x18e0 [ 6336.662954][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6336.663279][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6336.663549][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6336.663793][ C2] ? __ip_finish_output+0x10f/0x770 [ 6336.664067][ C2] ip_output+0x16b/0x4f0 [ 6336.664282][ C2] ? __pfx_ip_output+0x10/0x10 [ 6336.664523][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6336.664797][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6336.665106][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6336.665385][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6336.665629][ C2] ? __alloc_skb+0xd4/0x280 [ 6336.665872][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6336.666139][ C2] ? tcp_fragment+0x168/0x1040 [ 6336.666380][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6336.666630][ C2] ? ip_local_out+0x114/0x3b0 [ 6336.666869][ C2] __ip_queue_xmit+0x672/0x1910 [ 6336.667120][ C2] ? __skb_clone+0x57a/0x760 [ 6336.667346][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6336.667602][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6336.667874][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6336.668110][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6336.668349][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6336.668639][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6336.668970][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6336.669211][ C2] tcp_send_loss_probe+0x348/0x830 [ 6336.669468][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6336.669733][ C2] tcp_write_timer+0x82/0x1d0 [ 6336.669971][ C2] call_timer_fn+0x173/0x430 [ 6336.670215][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6336.670468][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6336.670720][ C2] __run_timers.part.0+0x52d/0x890 [ 6336.670972][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6336.671231][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6336.671509][ C2] ? lock_acquire+0x1c1/0x220 [ 6336.671739][ C2] ? clockevents_program_event+0xf6/0x300 [ 6336.672020][ C2] ? lock_release+0x1d5/0x250 [ 6336.672250][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6336.672506][ C2] ? ktime_get+0xb3/0x190 [ 6336.672722][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6336.673008][ C2] run_timer_softirq+0x72/0x100 [ 6336.673248][ C2] __do_softirq+0x1b9/0x7ff [ 6336.673473][ C2] irq_exit_rcu+0x98/0xc0 [ 6336.673686][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6336.673960][ C2] [ 6336.674105][ C2] [ 6336.674252][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6336.674544][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6336.674792][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6336.675731][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6336.676027][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6336.676414][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6336.676798][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6336.677181][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6336.677565][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6336.677954][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6336.678232][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6336.678482][ C2] default_idle_call+0x69/0xa0 [ 6336.678718][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6336.678982][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6336.679255][ C2] ? lock_release+0x1d5/0x250 [ 6336.679493][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6336.679763][ C2] do_idle+0xfb/0x160 [ 6336.679966][ C2] cpu_startup_entry+0x55/0x60 [ 6336.680215][ C2] start_secondary+0x21c/0x2b0 [ 6336.680450][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6336.680709][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6336.681010][ C2] [ 6361.895102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6361.895447][ C1] rcu: 1-....: (3997119 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=979854 [ 6361.895990][ C1] rcu: (t=4007008 jiffies g=1882453 q=715 ncpus=4) [ 6361.896314][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6361.896750][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6361.897346][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6361.897665][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6361.898611][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6361.898933][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6361.899333][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6361.899732][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6361.900137][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6361.900526][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6361.900917][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6361.901354][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6361.901678][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6361.902068][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6361.902458][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6361.902849][ C1] PKRU: 55555554 [ 6361.903026][ C1] Call Trace: [ 6361.903190][ C1] [ 6361.903336][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6361.903601][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6361.903848][ C1] ? check_cpu_stall+0x284/0x500 [ 6361.904094][ C1] ? rcu_pending+0x92/0x360 [ 6361.904317][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6361.904581][ C1] ? update_process_times+0xb9/0x110 [ 6361.904844][ C1] ? tick_sched_handle+0x67/0x130 [ 6361.905094][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6361.905371][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6361.905608][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6361.905913][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6361.906177][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6361.906460][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6361.906718][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6361.907014][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6361.907270][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6361.907570][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6361.907859][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6361.908166][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6361.908445][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6361.908734][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6361.909039][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6361.909349][ C1] ? get_stack_info+0x36/0xc0 [ 6361.909590][ C1] ? lock_acquire+0x1c1/0x220 [ 6361.909831][ C1] ? lock_release+0x1d5/0x250 [ 6361.910080][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6361.910321][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6361.910587][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6361.910868][ C1] ? lock_acquire+0x1c1/0x220 [ 6361.911101][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6361.911336][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6361.911590][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6361.911817][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6361.912058][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6361.912308][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6361.912576][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6361.912848][ C1] ip_local_deliver+0x19d/0x480 [ 6361.913089][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6361.913353][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6361.913610][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6361.913947][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6361.914194][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6361.914505][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6361.914760][ C1] ip_rcv+0x564/0x740 [ 6361.914959][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6361.915184][ C1] ? set_track_prepare+0x8a/0xd0 [ 6361.915431][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6361.915699][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6361.915967][ C1] ? skb_clone+0x10b/0x330 [ 6361.916187][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6361.916497][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6361.916797][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6361.917071][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6361.917360][ C1] ? __tcf_classify+0x329/0x7d0 [ 6361.917602][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6361.917825][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6361.918118][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6361.918395][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6361.918713][ C1] ? lock_acquire+0x1c1/0x220 [ 6361.918968][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6361.919266][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6361.919550][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6361.919868][ C1] ? __copy_skb_header+0xaf/0x490 [ 6361.920131][ C1] ? __skb_clone+0x57a/0x760 [ 6361.920361][ C1] netif_receive_skb+0x55/0x280 [ 6361.920603][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6361.920908][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6361.921231][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6361.921521][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6361.921790][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6361.922071][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6361.922376][ C1] ? hlock_class+0x4e/0x130 [ 6361.922601][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6361.922872][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6361.923140][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6361.923397][ C1] ? hlock_class+0x4e/0x130 [ 6361.923623][ C1] ? mark_lock+0x38/0x3e0 [ 6361.923836][ C1] ? stack_access_ok+0xda/0x1f0 [ 6361.924078][ C1] ? __lock_acquire+0xb67/0x1610 [ 6361.924325][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6361.924593][ C1] ? get_stack_info+0x36/0xc0 [ 6361.924829][ C1] ? stack_access_ok+0xda/0x1f0 [ 6361.925069][ C1] ? get_reg+0x119/0x190 [ 6361.925280][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6361.925542][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6361.925844][ C1] __tcf_classify+0x329/0x7d0 [ 6361.926080][ C1] tcf_classify+0x283/0x930 [ 6361.926307][ C1] ? arch_stack_walk+0xa2/0x100 [ 6361.926551][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6361.926804][ C1] ? get_stack_info+0x36/0xc0 [ 6361.927037][ C1] tc_run+0x2e4/0x5d0 [ 6361.927238][ C1] ? __pfx_tc_run+0x10/0x10 [ 6361.927463][ C1] ? lock_acquire+0x1c1/0x220 [ 6361.927696][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6361.927951][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6361.928198][ C1] ? lock_acquire+0x1c1/0x220 [ 6361.928431][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6361.928688][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6361.929010][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6361.929284][ C1] ? neigh_hh_output+0x348/0x590 [ 6361.929537][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6361.929802][ C1] ip_finish_output2+0x786/0x18e0 [ 6361.930068][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6361.930336][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6361.930665][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6361.930936][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6361.931184][ C1] ? __ip_finish_output+0x10f/0x770 [ 6361.931443][ C1] ip_output+0x16b/0x4f0 [ 6361.931653][ C1] ? run_timer_softirq+0x72/0x100 [ 6361.931903][ C1] ? __pfx_ip_output+0x10/0x10 [ 6361.932141][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6361.932422][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6361.932668][ C1] ? ip_local_out+0x114/0x3b0 [ 6361.932903][ C1] __ip_queue_xmit+0x672/0x1910 [ 6361.933145][ C1] ? __create_object+0x5e/0xb0 [ 6361.933383][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6361.933643][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6361.933920][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6361.934186][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6361.934463][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6361.934728][ C1] tcp_delack_timer+0x84/0x240 [ 6361.934966][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6361.935231][ C1] call_timer_fn+0x173/0x430 [ 6361.935461][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6361.935716][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6361.935971][ C1] __run_timers.part.0+0x52d/0x890 [ 6361.936225][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6361.936491][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6361.936770][ C1] ? lock_acquire+0x1c1/0x220 [ 6361.937001][ C1] ? clockevents_program_event+0xf6/0x300 [ 6361.937285][ C1] ? lock_release+0x1d5/0x250 [ 6361.937520][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6361.937777][ C1] ? ktime_get+0xb3/0x190 [ 6361.937991][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6361.938281][ C1] run_timer_softirq+0x72/0x100 [ 6361.938524][ C1] __do_softirq+0x1b9/0x7ff [ 6361.938748][ C1] irq_exit_rcu+0x98/0xc0 [ 6361.938990][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6361.939274][ C1] [ 6361.939426][ C1] [ 6361.939576][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6361.939881][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6361.940210][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6361.941152][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6361.941452][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6361.941841][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6361.942229][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6361.942617][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6361.943006][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6361.943396][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6361.943686][ C1] pipe_read+0xa16/0xdf0 [ 6361.943900][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6361.944169][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6361.944407][ C1] ? iterate_tty_write+0x299/0x540 [ 6361.944661][ C1] ? lock_release+0x1d5/0x250 [ 6361.944896][ C1] vfs_read+0x911/0xc00 [ 6361.945103][ C1] ? lock_acquire+0x1c1/0x220 [ 6361.945337][ C1] ? __might_fault+0xc6/0x180 [ 6361.945571][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6361.945803][ C1] ? __might_fault+0xc6/0x180 [ 6361.946035][ C1] ? lock_release+0x1d5/0x250 [ 6361.946270][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6361.946528][ C1] ? __fget_light+0x54/0x1e0 [ 6361.946761][ C1] ksys_read+0x17a/0x1e0 [ 6361.946971][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6361.947210][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6361.947506][ C1] do_syscall_64+0xc9/0x1e0 [ 6361.947732][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6361.948026][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6361.948248][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6361.949224][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6361.949643][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6361.950053][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6361.950440][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6361.950828][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6361.951215][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6361.951612][ C1] [ 6361.951768][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6361.952037][ C2] NMI backtrace for cpu 2 [ 6361.952045][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6361.952050][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6361.952054][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6361.952062][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6361.952067][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6361.952071][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6361.952075][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6361.952079][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6361.952083][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6361.952086][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6361.952090][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6361.952094][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6361.952100][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6361.952103][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6361.952106][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6361.952110][ C2] PKRU: 55555554 [ 6361.952112][ C2] Call Trace: [ 6361.952114][ C2] [ 6361.952117][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6361.952128][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6361.952135][ C2] ? nmi_handle+0x153/0x420 [ 6361.952144][ C2] ? default_do_nmi+0x41/0x100 [ 6361.952150][ C2] ? exc_nmi+0xf3/0x120 [ 6361.952156][ C2] ? end_repeat_nmi+0xf/0x60 [ 6361.952167][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6361.952175][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6361.952183][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6361.952191][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6361.952199][ C2] [ 6361.952201][ C2] [ 6361.952204][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6361.952210][ C2] ? get_stack_info+0x36/0xc0 [ 6361.952219][ C2] ? lock_acquire+0x1c1/0x220 [ 6361.952226][ C2] ? lock_release+0x1d5/0x250 [ 6361.952235][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6361.952243][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6361.952249][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6361.952258][ C2] ? lock_acquire+0x1c1/0x220 [ 6361.952263][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6361.952271][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6361.952277][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6361.952293][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6361.952299][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6361.952310][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6361.952320][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6361.952328][ C2] ip_local_deliver+0x19d/0x480 [ 6361.952334][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6361.952339][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6361.952345][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6361.952355][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6361.952362][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6361.952370][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6361.952390][ C2] ip_rcv+0x564/0x740 [ 6361.952396][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6361.952402][ C2] ? set_track_prepare+0x8a/0xd0 [ 6361.952410][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6361.952417][ C2] ? start_secondary+0x21c/0x2b0 [ 6361.952423][ C2] ? skb_clone+0x10b/0x330 [ 6361.952429][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6361.952439][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6361.952444][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6361.952447][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6361.952454][ C2] ? __tcf_classify+0x329/0x7d0 [ 6361.952458][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6361.952460][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6361.952463][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6361.952467][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6361.952471][ C2] ? lock_acquire+0x1c1/0x220 [ 6361.952473][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6361.952477][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6361.952480][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6361.952484][ C2] ? __copy_skb_header+0xaf/0x490 [ 6361.952488][ C2] ? __skb_clone+0x57a/0x760 [ 6361.952490][ C2] netif_receive_skb+0x55/0x280 [ 6361.952494][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6361.952500][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6361.952506][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6361.952513][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6361.952517][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6361.952527][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6361.952534][ C2] ? get_stack_info+0x36/0xc0 [ 6361.952538][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6361.952541][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6361.952544][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6361.952546][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6361.952549][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6361.952552][ C2] ? kernel_text_address+0x17/0xe0 [ 6361.952555][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6361.952558][ C2] ? arch_stack_walk+0x8c/0x100 [ 6361.952561][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6361.952564][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6361.952568][ C2] ? lock_acquire+0x1c1/0x220 [ 6361.952570][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6361.952574][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6361.952577][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6361.952580][ C2] ? get_stack_info+0x36/0xc0 [ 6361.952584][ C2] __tcf_classify+0x329/0x7d0 [ 6361.952589][ C2] tcf_classify+0x283/0x930 [ 6361.952593][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6361.952596][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6361.952600][ C2] tc_run+0x2e4/0x5d0 [ 6361.952603][ C2] ? __pfx_tc_run+0x10/0x10 [ 6361.952606][ C2] ? lock_acquire+0x1c1/0x220 [ 6361.952608][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6361.952612][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6361.952616][ C2] ? lock_acquire+0x1c1/0x220 [ 6361.952618][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6361.952621][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6361.952624][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6361.952627][ C2] ? neigh_hh_output+0x348/0x590 [ 6361.952630][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6361.952634][ C2] ip_finish_output2+0x786/0x18e0 [ 6361.952637][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6361.952645][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6361.952647][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6361.952651][ C2] ? __ip_finish_output+0x10f/0x770 [ 6361.952654][ C2] ip_output+0x16b/0x4f0 [ 6361.952657][ C2] ? __pfx_ip_output+0x10/0x10 [ 6361.952660][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6361.952663][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6361.952666][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6361.952668][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6361.952671][ C2] ? __alloc_skb+0xd4/0x280 [ 6361.952673][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6361.952676][ C2] ? tcp_fragment+0x168/0x1040 [ 6361.952679][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6361.952682][ C2] ? ip_local_out+0x114/0x3b0 [ 6361.952685][ C2] __ip_queue_xmit+0x672/0x1910 [ 6361.952689][ C2] ? __skb_clone+0x57a/0x760 [ 6361.952691][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6361.952696][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6361.952699][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6361.952703][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6361.952706][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6361.952710][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6361.952713][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6361.952716][ C2] tcp_send_loss_probe+0x348/0x830 [ 6361.952719][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6361.952722][ C2] tcp_write_timer+0x82/0x1d0 [ 6361.952725][ C2] call_timer_fn+0x173/0x430 [ 6361.952728][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6361.952732][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6361.952736][ C2] __run_timers.part.0+0x52d/0x890 [ 6361.952739][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6361.952743][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6361.952746][ C2] ? lock_acquire+0x1c1/0x220 [ 6361.952748][ C2] ? clockevents_program_event+0xf6/0x300 [ 6361.952752][ C2] ? lock_release+0x1d5/0x250 [ 6361.952754][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6361.952757][ C2] ? ktime_get+0xb3/0x190 [ 6361.952760][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6361.952764][ C2] run_timer_softirq+0x72/0x100 [ 6361.952768][ C2] __do_softirq+0x1b9/0x7ff [ 6361.952772][ C2] irq_exit_rcu+0x98/0xc0 [ 6361.952774][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6361.952777][ C2] [ 6361.952778][ C2] [ 6361.952779][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6361.952782][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6361.952785][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6361.952787][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6361.952789][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6361.952790][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6361.952791][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6361.952793][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6361.952794][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6361.952797][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6361.952800][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6361.952802][ C2] default_idle_call+0x69/0xa0 [ 6361.952805][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6361.952807][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6361.952811][ C2] ? lock_release+0x1d5/0x250 [ 6361.952813][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6361.952817][ C2] do_idle+0xfb/0x160 [ 6361.952819][ C2] cpu_startup_entry+0x55/0x60 [ 6361.952821][ C2] start_secondary+0x21c/0x2b0 [ 6361.952824][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6361.952828][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6361.952834][ C2] [ 6388.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3758s! [perl:4135] [ 6388.569708][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6388.570942][ C1] irq event stamp: 209232 [ 6388.571153][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6388.571675][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6388.572138][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6388.572593][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6388.573048][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6388.573485][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6388.574080][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6388.574397][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6388.575346][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6388.575643][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6388.576053][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6388.576452][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6388.576850][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6388.577257][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6388.577647][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6388.578083][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6388.578406][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6388.578820][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6388.579218][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6388.579621][ C1] PKRU: 55555554 [ 6388.579802][ C1] Call Trace: [ 6388.579971][ C1] [ 6388.580120][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6388.580383][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6388.580625][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6388.580904][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6388.581176][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6388.581464][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6388.581731][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6388.582036][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6388.582299][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6388.582608][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6388.582905][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6388.583221][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6388.583509][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6388.583805][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6388.584093][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6388.584405][ C1] ? get_stack_info+0x36/0xc0 [ 6388.584647][ C1] ? lock_acquire+0x1c1/0x220 [ 6388.584888][ C1] ? lock_release+0x1d5/0x250 [ 6388.585127][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6388.585375][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6388.585649][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6388.585934][ C1] ? lock_acquire+0x1c1/0x220 [ 6388.586173][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6388.586413][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6388.586674][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6388.586908][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6388.587156][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6388.587414][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6388.587688][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6388.587968][ C1] ip_local_deliver+0x19d/0x480 [ 6388.588215][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6388.588488][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6388.588755][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6388.589100][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6388.589353][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6388.589672][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6388.589937][ C1] ip_rcv+0x564/0x740 [ 6388.590141][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6388.590375][ C1] ? set_track_prepare+0x8a/0xd0 [ 6388.590629][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6388.590905][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6388.591178][ C1] ? skb_clone+0x10b/0x330 [ 6388.591405][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6388.591723][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6388.592030][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6388.592311][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6388.592607][ C1] ? __tcf_classify+0x329/0x7d0 [ 6388.592857][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6388.593087][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6388.593386][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6388.593670][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6388.593995][ C1] ? lock_acquire+0x1c1/0x220 [ 6388.594234][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6388.594532][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6388.594817][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6388.595134][ C1] ? __copy_skb_header+0xaf/0x490 [ 6388.595392][ C1] ? __skb_clone+0x57a/0x760 [ 6388.595627][ C1] netif_receive_skb+0x55/0x280 [ 6388.595875][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6388.596188][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6388.596521][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6388.596818][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6388.597094][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6388.597383][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6388.597697][ C1] ? hlock_class+0x4e/0x130 [ 6388.597928][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6388.598206][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6388.598482][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6388.598750][ C1] ? hlock_class+0x4e/0x130 [ 6388.598982][ C1] ? mark_lock+0x38/0x3e0 [ 6388.599201][ C1] ? stack_access_ok+0xda/0x1f0 [ 6388.599450][ C1] ? __lock_acquire+0xb67/0x1610 [ 6388.599704][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6388.599979][ C1] ? get_stack_info+0x36/0xc0 [ 6388.600220][ C1] ? stack_access_ok+0xda/0x1f0 [ 6388.600467][ C1] ? get_reg+0x119/0x190 [ 6388.600682][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6388.600951][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6388.601261][ C1] __tcf_classify+0x329/0x7d0 [ 6388.601503][ C1] tcf_classify+0x283/0x930 [ 6388.601736][ C1] ? arch_stack_walk+0xa2/0x100 [ 6388.601984][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6388.602240][ C1] ? get_stack_info+0x36/0xc0 [ 6388.602480][ C1] tc_run+0x2e4/0x5d0 [ 6388.602686][ C1] ? __pfx_tc_run+0x10/0x10 [ 6388.602917][ C1] ? lock_acquire+0x1c1/0x220 [ 6388.603158][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6388.603418][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6388.603672][ C1] ? lock_acquire+0x1c1/0x220 [ 6388.603910][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6388.604176][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6388.604480][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6388.604754][ C1] ? neigh_hh_output+0x348/0x590 [ 6388.605007][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6388.605273][ C1] ip_finish_output2+0x786/0x18e0 [ 6388.605529][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6388.605806][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6388.606143][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6388.606421][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6388.606674][ C1] ? __ip_finish_output+0x10f/0x770 [ 6388.606939][ C1] ip_output+0x16b/0x4f0 [ 6388.607156][ C1] ? run_timer_softirq+0x72/0x100 [ 6388.607416][ C1] ? __pfx_ip_output+0x10/0x10 [ 6388.607659][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6388.607944][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6388.608197][ C1] ? ip_local_out+0x114/0x3b0 [ 6388.608436][ C1] __ip_queue_xmit+0x672/0x1910 [ 6388.608688][ C1] ? __create_object+0x5e/0xb0 [ 6388.608933][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6388.609200][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6388.609481][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6388.609752][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6388.610037][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6388.610308][ C1] tcp_delack_timer+0x84/0x240 [ 6388.610553][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6388.610824][ C1] call_timer_fn+0x173/0x430 [ 6388.611061][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6388.611323][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6388.611585][ C1] __run_timers.part.0+0x52d/0x890 [ 6388.611844][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6388.612117][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6388.612403][ C1] ? lock_acquire+0x1c1/0x220 [ 6388.612640][ C1] ? clockevents_program_event+0xf6/0x300 [ 6388.612932][ C1] ? lock_release+0x1d5/0x250 [ 6388.613171][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6388.613435][ C1] ? ktime_get+0xb3/0x190 [ 6388.613655][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6388.613952][ C1] run_timer_softirq+0x72/0x100 [ 6388.614201][ C1] __do_softirq+0x1b9/0x7ff [ 6388.614432][ C1] irq_exit_rcu+0x98/0xc0 [ 6388.614654][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6388.614938][ C1] [ 6388.615089][ C1] [ 6388.615239][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6388.615545][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6388.615869][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6388.616840][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6388.617147][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6388.617546][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6388.617943][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6388.618342][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6388.618746][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6388.619146][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6388.619442][ C1] pipe_read+0xa16/0xdf0 [ 6388.619661][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6388.619938][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6388.620183][ C1] ? iterate_tty_write+0x299/0x540 [ 6388.620443][ C1] ? lock_release+0x1d5/0x250 [ 6388.620685][ C1] vfs_read+0x911/0xc00 [ 6388.620897][ C1] ? lock_acquire+0x1c1/0x220 [ 6388.621136][ C1] ? __might_fault+0xc6/0x180 [ 6388.621377][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6388.621615][ C1] ? __might_fault+0xc6/0x180 [ 6388.621854][ C1] ? lock_release+0x1d5/0x250 [ 6388.622094][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6388.622358][ C1] ? __fget_light+0x54/0x1e0 [ 6388.622596][ C1] ksys_read+0x17a/0x1e0 [ 6388.622812][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6388.623057][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6388.623362][ C1] do_syscall_64+0xc9/0x1e0 [ 6388.623593][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6388.623893][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6388.624124][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6388.625094][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6388.625514][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6388.625916][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6388.626314][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6388.626711][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6388.627109][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6388.627513][ C1] [ 6388.627669][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3758s! [swapper/2:0] [ 6388.628083][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6388.629331][ C2] irq event stamp: 44114564 [ 6388.629560][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6388.630091][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6388.630600][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6388.631074][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6388.631541][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6388.631992][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6388.632599][ C2] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 6388.632883][ C2] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 6388.633846][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000216 [ 6388.634152][ C2] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6388.634547][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6388.634942][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6388.635342][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6388.635738][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6388.636133][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6388.636576][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6388.636904][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6388.637306][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6388.637703][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6388.638097][ C2] PKRU: 55555554 [ 6388.638278][ C2] Call Trace: [ 6388.638446][ C2] [ 6388.638592][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6388.638856][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6388.639098][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6388.639372][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6388.639644][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6388.639931][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6388.640193][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6388.640497][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6388.640754][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 6388.641012][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6388.641271][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6388.641578][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6388.641872][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6388.642183][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6388.642473][ C2] ? kasan_check_range+0x54/0x1c0 [ 6388.642727][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 6388.643005][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6388.643315][ C2] ? get_stack_info+0x36/0xc0 [ 6388.643554][ C2] ? lock_acquire+0x1c1/0x220 [ 6388.643793][ C2] ? lock_release+0x1d5/0x250 [ 6388.644028][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6388.644276][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6388.644547][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6388.644831][ C2] ? lock_acquire+0x1c1/0x220 [ 6388.645068][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6388.645305][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6388.645564][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6388.645796][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6388.646041][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6388.646297][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6388.646567][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6388.646843][ C2] ip_local_deliver+0x19d/0x480 [ 6388.647088][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6388.647359][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6388.647620][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6388.647964][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6388.648214][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6388.648532][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6388.648795][ C2] ip_rcv+0x564/0x740 [ 6388.648997][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6388.649227][ C2] ? set_track_prepare+0x8a/0xd0 [ 6388.649478][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6388.649752][ C2] ? start_secondary+0x21c/0x2b0 [ 6388.650000][ C2] ? skb_clone+0x10b/0x330 [ 6388.650225][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6388.650541][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6388.650843][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6388.651124][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6388.651414][ C2] ? __tcf_classify+0x329/0x7d0 [ 6388.651661][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6388.651890][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6388.652187][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6388.652470][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6388.652793][ C2] ? lock_acquire+0x1c1/0x220 [ 6388.653031][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6388.653323][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6388.653608][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6388.653923][ C2] ? __copy_skb_header+0xaf/0x490 [ 6388.654178][ C2] ? __skb_clone+0x57a/0x760 [ 6388.654409][ C2] netif_receive_skb+0x55/0x280 [ 6388.654656][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6388.654965][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6388.655294][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6388.655592][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6388.655863][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6388.656149][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6388.656458][ C2] ? get_stack_info+0x36/0xc0 [ 6388.656698][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6388.656959][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6388.657273][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6388.657545][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6388.657823][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6388.658135][ C2] ? kernel_text_address+0x17/0xe0 [ 6388.658393][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6388.658705][ C2] ? arch_stack_walk+0x8c/0x100 [ 6388.658950][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6388.659214][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6388.659495][ C2] ? lock_acquire+0x1c1/0x220 [ 6388.659734][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6388.660012][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6388.660315][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6388.660588][ C2] ? get_stack_info+0x36/0xc0 [ 6388.660827][ C2] __tcf_classify+0x329/0x7d0 [ 6388.661068][ C2] tcf_classify+0x283/0x930 [ 6388.661297][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6388.661551][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6388.661862][ C2] tc_run+0x2e4/0x5d0 [ 6388.662064][ C2] ? __pfx_tc_run+0x10/0x10 [ 6388.662295][ C2] ? lock_acquire+0x1c1/0x220 [ 6388.662533][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6388.662792][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6388.663043][ C2] ? lock_acquire+0x1c1/0x220 [ 6388.663282][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6388.663545][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6388.663844][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6388.664116][ C2] ? neigh_hh_output+0x348/0x590 [ 6388.664367][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6388.664629][ C2] ip_finish_output2+0x786/0x18e0 [ 6388.664884][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6388.665218][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6388.665491][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6388.665742][ C2] ? __ip_finish_output+0x10f/0x770 [ 6388.666004][ C2] ip_output+0x16b/0x4f0 [ 6388.666220][ C2] ? __pfx_ip_output+0x10/0x10 [ 6388.666460][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6388.666735][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6388.667045][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6388.667318][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6388.667568][ C2] ? __alloc_skb+0xd4/0x280 [ 6388.667796][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6388.668063][ C2] ? tcp_fragment+0x168/0x1040 [ 6388.668304][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6388.668554][ C2] ? ip_local_out+0x114/0x3b0 [ 6388.668795][ C2] __ip_queue_xmit+0x672/0x1910 [ 6388.669042][ C2] ? __skb_clone+0x57a/0x760 [ 6388.669276][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6388.669540][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6388.669817][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6388.670061][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6388.670308][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6388.670606][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6388.670924][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6388.671165][ C2] tcp_send_loss_probe+0x348/0x830 [ 6388.671423][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6388.671690][ C2] tcp_write_timer+0x82/0x1d0 [ 6388.671926][ C2] call_timer_fn+0x173/0x430 [ 6388.672161][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6388.672419][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6388.672678][ C2] __run_timers.part.0+0x52d/0x890 [ 6388.672935][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6388.673205][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6388.673488][ C2] ? lock_acquire+0x1c1/0x220 [ 6388.673726][ C2] ? clockevents_program_event+0xf6/0x300 [ 6388.674014][ C2] ? lock_release+0x1d5/0x250 [ 6388.674252][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6388.674514][ C2] ? ktime_get+0xb3/0x190 [ 6388.674732][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6388.675027][ C2] run_timer_softirq+0x72/0x100 [ 6388.675273][ C2] __do_softirq+0x1b9/0x7ff [ 6388.675505][ C2] irq_exit_rcu+0x98/0xc0 [ 6388.675721][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6388.676004][ C2] [ 6388.676154][ C2] [ 6388.676302][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6388.676604][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6388.676858][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6388.677818][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6388.678124][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6388.678518][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6388.678918][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6388.679315][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6388.679709][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6388.680105][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6388.680393][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6388.680650][ C2] default_idle_call+0x69/0xa0 [ 6388.680892][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6388.681141][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6388.681416][ C2] ? lock_release+0x1d5/0x250 [ 6388.681653][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6388.681924][ C2] do_idle+0xfb/0x160 [ 6388.682125][ C2] cpu_startup_entry+0x55/0x60 [ 6388.682368][ C2] start_secondary+0x21c/0x2b0 [ 6388.682610][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6388.682877][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6388.683186][ C2] [ 6416.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3784s! [perl:4135] [ 6416.569689][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6416.570934][ C1] irq event stamp: 209232 [ 6416.571147][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6416.571662][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6416.572126][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6416.572582][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6416.573032][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6416.573468][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6416.574063][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6416.574378][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6416.575324][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6416.575623][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6416.576013][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6416.576403][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6416.576791][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6416.577178][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6416.577566][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6416.578004][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6416.578330][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6416.578744][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6416.579141][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6416.579540][ C1] PKRU: 55555554 [ 6416.579721][ C1] Call Trace: [ 6416.579898][ C1] [ 6416.580041][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6416.580296][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6416.580533][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6416.580804][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6416.581069][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6416.581349][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6416.581609][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6416.581906][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6416.582160][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6416.582461][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6416.582749][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6416.583054][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6416.583334][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6416.583621][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6416.583902][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6416.584205][ C1] ? get_stack_info+0x36/0xc0 [ 6416.584440][ C1] ? lock_acquire+0x1c1/0x220 [ 6416.584674][ C1] ? lock_release+0x1d5/0x250 [ 6416.584906][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6416.585148][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6416.585413][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6416.585691][ C1] ? lock_acquire+0x1c1/0x220 [ 6416.585924][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6416.586156][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6416.586411][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6416.586639][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6416.586880][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6416.587131][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6416.587399][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6416.587669][ C1] ip_local_deliver+0x19d/0x480 [ 6416.587912][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6416.588179][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6416.588436][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6416.588798][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6416.589051][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6416.589371][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6416.589632][ C1] ip_rcv+0x564/0x740 [ 6416.589836][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6416.590069][ C1] ? set_track_prepare+0x8a/0xd0 [ 6416.590322][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6416.590598][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6416.590869][ C1] ? skb_clone+0x10b/0x330 [ 6416.591098][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6416.591418][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6416.591724][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6416.592006][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6416.592300][ C1] ? __tcf_classify+0x329/0x7d0 [ 6416.592547][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6416.592778][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6416.593079][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6416.593362][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6416.593687][ C1] ? lock_acquire+0x1c1/0x220 [ 6416.593925][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6416.594223][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6416.594507][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6416.594824][ C1] ? __copy_skb_header+0xaf/0x490 [ 6416.595081][ C1] ? __skb_clone+0x57a/0x760 [ 6416.595317][ C1] netif_receive_skb+0x55/0x280 [ 6416.595565][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6416.595876][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6416.596209][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6416.596508][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6416.596781][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6416.597071][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6416.597383][ C1] ? hlock_class+0x4e/0x130 [ 6416.597615][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6416.597890][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6416.598167][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6416.598430][ C1] ? hlock_class+0x4e/0x130 [ 6416.598665][ C1] ? mark_lock+0x38/0x3e0 [ 6416.598884][ C1] ? stack_access_ok+0xda/0x1f0 [ 6416.599133][ C1] ? __lock_acquire+0xb67/0x1610 [ 6416.599387][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6416.599662][ C1] ? get_stack_info+0x36/0xc0 [ 6416.599903][ C1] ? stack_access_ok+0xda/0x1f0 [ 6416.600150][ C1] ? get_reg+0x119/0x190 [ 6416.600365][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6416.600631][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6416.600941][ C1] __tcf_classify+0x329/0x7d0 [ 6416.601183][ C1] tcf_classify+0x283/0x930 [ 6416.601414][ C1] ? arch_stack_walk+0xa2/0x100 [ 6416.601662][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6416.601918][ C1] ? get_stack_info+0x36/0xc0 [ 6416.602161][ C1] tc_run+0x2e4/0x5d0 [ 6416.602364][ C1] ? __pfx_tc_run+0x10/0x10 [ 6416.602597][ C1] ? lock_acquire+0x1c1/0x220 [ 6416.602837][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6416.603098][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6416.603351][ C1] ? lock_acquire+0x1c1/0x220 [ 6416.603588][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6416.603853][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6416.604156][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6416.604430][ C1] ? neigh_hh_output+0x348/0x590 [ 6416.604681][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6416.604947][ C1] ip_finish_output2+0x786/0x18e0 [ 6416.605202][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6416.605481][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6416.605817][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6416.606092][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6416.606343][ C1] ? __ip_finish_output+0x10f/0x770 [ 6416.606610][ C1] ip_output+0x16b/0x4f0 [ 6416.606826][ C1] ? run_timer_softirq+0x72/0x100 [ 6416.607083][ C1] ? __pfx_ip_output+0x10/0x10 [ 6416.607328][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6416.607612][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6416.607864][ C1] ? ip_local_out+0x114/0x3b0 [ 6416.608104][ C1] __ip_queue_xmit+0x672/0x1910 [ 6416.608353][ C1] ? __create_object+0x5e/0xb0 [ 6416.608600][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6416.608867][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6416.609148][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6416.609420][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6416.609703][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6416.609974][ C1] tcp_delack_timer+0x84/0x240 [ 6416.610219][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6416.610490][ C1] call_timer_fn+0x173/0x430 [ 6416.610727][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6416.610989][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6416.611251][ C1] __run_timers.part.0+0x52d/0x890 [ 6416.611511][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6416.611784][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6416.612068][ C1] ? lock_acquire+0x1c1/0x220 [ 6416.612306][ C1] ? clockevents_program_event+0xf6/0x300 [ 6416.612598][ C1] ? lock_release+0x1d5/0x250 [ 6416.612836][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6416.613102][ C1] ? ktime_get+0xb3/0x190 [ 6416.613321][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6416.613618][ C1] run_timer_softirq+0x72/0x100 [ 6416.613866][ C1] __do_softirq+0x1b9/0x7ff [ 6416.614097][ C1] irq_exit_rcu+0x98/0xc0 [ 6416.614321][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6416.614605][ C1] [ 6416.614755][ C1] [ 6416.614907][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6416.615211][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6416.615536][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6416.616506][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6416.616813][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6416.617212][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6416.617610][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6416.618008][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6416.618408][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6416.618812][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6416.619107][ C1] pipe_read+0xa16/0xdf0 [ 6416.619329][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6416.619605][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6416.619848][ C1] ? iterate_tty_write+0x299/0x540 [ 6416.620109][ C1] ? lock_release+0x1d5/0x250 [ 6416.620350][ C1] vfs_read+0x911/0xc00 [ 6416.620563][ C1] ? lock_acquire+0x1c1/0x220 [ 6416.620802][ C1] ? __might_fault+0xc6/0x180 [ 6416.621041][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6416.621279][ C1] ? __might_fault+0xc6/0x180 [ 6416.621519][ C1] ? lock_release+0x1d5/0x250 [ 6416.621760][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6416.622024][ C1] ? __fget_light+0x54/0x1e0 [ 6416.622261][ C1] ksys_read+0x17a/0x1e0 [ 6416.622478][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6416.622723][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6416.623027][ C1] do_syscall_64+0xc9/0x1e0 [ 6416.623258][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6416.623558][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6416.623784][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6416.624757][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6416.625177][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6416.625574][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6416.625975][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6416.626376][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6416.626772][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6416.627173][ C1] [ 6416.627332][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3784s! [swapper/2:0] [ 6416.627740][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6416.628982][ C2] irq event stamp: 44114564 [ 6416.629210][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6416.629740][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6416.630248][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6416.630722][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6416.631186][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6416.631638][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6416.632247][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6416.632570][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6416.633534][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6416.633839][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6416.634234][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6416.634627][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6416.635023][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6416.635419][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6416.635813][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6416.636256][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6416.636584][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6416.636981][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6416.637377][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6416.637771][ C2] PKRU: 55555554 [ 6416.637951][ C2] Call Trace: [ 6416.638120][ C2] [ 6416.638266][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6416.638528][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6416.638770][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6416.639044][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6416.639314][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6416.639602][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6416.639865][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6416.640169][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6416.640431][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6416.640693][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6416.641000][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6416.641291][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6416.641603][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6416.641890][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6416.642182][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6416.642470][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6416.642780][ C2] ? get_stack_info+0x36/0xc0 [ 6416.643017][ C2] ? lock_acquire+0x1c1/0x220 [ 6416.643256][ C2] ? lock_release+0x1d5/0x250 [ 6416.643494][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6416.643741][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6416.644010][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6416.644295][ C2] ? lock_acquire+0x1c1/0x220 [ 6416.644532][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6416.644771][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6416.645028][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6416.645262][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6416.645507][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6416.645762][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6416.646034][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6416.646309][ C2] ip_local_deliver+0x19d/0x480 [ 6416.646554][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6416.646822][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6416.647083][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6416.647429][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6416.647680][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6416.647997][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6416.648258][ C2] ip_rcv+0x564/0x740 [ 6416.648459][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6416.648692][ C2] ? set_track_prepare+0x8a/0xd0 [ 6416.648943][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6416.649219][ C2] ? start_secondary+0x21c/0x2b0 [ 6416.649468][ C2] ? skb_clone+0x10b/0x330 [ 6416.649692][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6416.650008][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6416.650312][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6416.650590][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6416.650886][ C2] ? __tcf_classify+0x329/0x7d0 [ 6416.651134][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6416.651361][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6416.651662][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6416.651944][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6416.652268][ C2] ? lock_acquire+0x1c1/0x220 [ 6416.652504][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6416.652800][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6416.653081][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6416.653396][ C2] ? __copy_skb_header+0xaf/0x490 [ 6416.653651][ C2] ? __skb_clone+0x57a/0x760 [ 6416.653885][ C2] netif_receive_skb+0x55/0x280 [ 6416.654132][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6416.654441][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6416.654771][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6416.655065][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6416.655339][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6416.655624][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6416.655934][ C2] ? get_stack_info+0x36/0xc0 [ 6416.656174][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6416.656436][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6416.656751][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6416.657024][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6416.657298][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6416.657610][ C2] ? kernel_text_address+0x17/0xe0 [ 6416.657868][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6416.658179][ C2] ? arch_stack_walk+0x8c/0x100 [ 6416.658426][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6416.658694][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6416.658977][ C2] ? lock_acquire+0x1c1/0x220 [ 6416.659213][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6416.659494][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6416.659795][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6416.660071][ C2] ? get_stack_info+0x36/0xc0 [ 6416.660309][ C2] __tcf_classify+0x329/0x7d0 [ 6416.660548][ C2] tcf_classify+0x283/0x930 [ 6416.660780][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6416.661035][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6416.661346][ C2] tc_run+0x2e4/0x5d0 [ 6416.661549][ C2] ? __pfx_tc_run+0x10/0x10 [ 6416.661778][ C2] ? lock_acquire+0x1c1/0x220 [ 6416.662013][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6416.662272][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6416.662523][ C2] ? lock_acquire+0x1c1/0x220 [ 6416.662760][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6416.663022][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6416.663323][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6416.663592][ C2] ? neigh_hh_output+0x348/0x590 [ 6416.663842][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6416.664104][ C2] ip_finish_output2+0x786/0x18e0 [ 6416.664358][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6416.664693][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6416.664968][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6416.665219][ C2] ? __ip_finish_output+0x10f/0x770 [ 6416.665482][ C2] ip_output+0x16b/0x4f0 [ 6416.665696][ C2] ? __pfx_ip_output+0x10/0x10 [ 6416.665937][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6416.666210][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6416.666520][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6416.666794][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6416.667043][ C2] ? __alloc_skb+0xd4/0x280 [ 6416.667272][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6416.667539][ C2] ? tcp_fragment+0x168/0x1040 [ 6416.667782][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6416.668033][ C2] ? ip_local_out+0x114/0x3b0 [ 6416.668272][ C2] __ip_queue_xmit+0x672/0x1910 [ 6416.668521][ C2] ? __skb_clone+0x57a/0x760 [ 6416.668752][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6416.669018][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6416.669297][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6416.669540][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6416.669786][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6416.670083][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6416.670401][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6416.670643][ C2] tcp_send_loss_probe+0x348/0x830 [ 6416.670901][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6416.671166][ C2] tcp_write_timer+0x82/0x1d0 [ 6416.671405][ C2] call_timer_fn+0x173/0x430 [ 6416.671640][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6416.671900][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6416.672160][ C2] __run_timers.part.0+0x52d/0x890 [ 6416.672418][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6416.672684][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6416.672967][ C2] ? lock_acquire+0x1c1/0x220 [ 6416.673203][ C2] ? clockevents_program_event+0xf6/0x300 [ 6416.673492][ C2] ? lock_release+0x1d5/0x250 [ 6416.673729][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6416.673992][ C2] ? ktime_get+0xb3/0x190 [ 6416.674209][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6416.674504][ C2] run_timer_softirq+0x72/0x100 [ 6416.674750][ C2] __do_softirq+0x1b9/0x7ff [ 6416.674980][ C2] irq_exit_rcu+0x98/0xc0 [ 6416.675199][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6416.675481][ C2] [ 6416.675630][ C2] [ 6416.675780][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6416.676082][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6416.676336][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6416.677297][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6416.677600][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6416.677997][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6416.678392][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6416.678790][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6416.679186][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6416.679583][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6416.679868][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6416.680126][ C2] default_idle_call+0x69/0xa0 [ 6416.680368][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6416.680616][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6416.680889][ C2] ? lock_release+0x1d5/0x250 [ 6416.681127][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6416.681396][ C2] do_idle+0xfb/0x160 [ 6416.681601][ C2] cpu_startup_entry+0x55/0x60 [ 6416.681840][ C2] start_secondary+0x21c/0x2b0 [ 6416.682082][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6416.682349][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6416.682658][ C2] [ 6439.953102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6439.953448][ C1] rcu: 1-....: (4075007 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=998807 [ 6439.953988][ C1] rcu: (t=4085066 jiffies g=1882453 q=715 ncpus=4) [ 6439.954310][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6439.954746][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6439.955343][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6439.955662][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6439.956603][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6439.956903][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6439.957291][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6439.957676][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6439.958065][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6439.958473][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6439.958874][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6439.959322][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6439.959662][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6439.960052][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6439.960441][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6439.960829][ C1] PKRU: 55555554 [ 6439.961006][ C1] Call Trace: [ 6439.961172][ C1] [ 6439.961315][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6439.961580][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6439.961826][ C1] ? check_cpu_stall+0x284/0x500 [ 6439.962071][ C1] ? rcu_pending+0x92/0x360 [ 6439.962297][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6439.962559][ C1] ? update_process_times+0xb9/0x110 [ 6439.962820][ C1] ? tick_sched_handle+0x67/0x130 [ 6439.963070][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6439.963346][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6439.963581][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6439.963885][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6439.964149][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6439.964431][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6439.964689][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6439.964987][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6439.965243][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6439.965544][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6439.965831][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6439.966137][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6439.966419][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6439.966704][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6439.966987][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6439.967290][ C1] ? get_stack_info+0x36/0xc0 [ 6439.967522][ C1] ? lock_acquire+0x1c1/0x220 [ 6439.967756][ C1] ? lock_release+0x1d5/0x250 [ 6439.967990][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6439.968233][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6439.968519][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6439.968803][ C1] ? lock_acquire+0x1c1/0x220 [ 6439.969042][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6439.969283][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6439.969543][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6439.969786][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6439.970025][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6439.970276][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6439.970543][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6439.970812][ C1] ip_local_deliver+0x19d/0x480 [ 6439.971053][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6439.971317][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6439.971572][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6439.971910][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6439.972157][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6439.972468][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6439.972723][ C1] ip_rcv+0x564/0x740 [ 6439.972921][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6439.973144][ C1] ? set_track_prepare+0x8a/0xd0 [ 6439.973390][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6439.973662][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6439.973927][ C1] ? skb_clone+0x10b/0x330 [ 6439.974148][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6439.974457][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6439.974755][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6439.975029][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6439.975314][ C1] ? __tcf_classify+0x329/0x7d0 [ 6439.975556][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6439.975781][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6439.976070][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6439.976349][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6439.976665][ C1] ? lock_acquire+0x1c1/0x220 [ 6439.976896][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6439.977184][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6439.977462][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6439.977770][ C1] ? __copy_skb_header+0xaf/0x490 [ 6439.978019][ C1] ? __skb_clone+0x57a/0x760 [ 6439.978247][ C1] netif_receive_skb+0x55/0x280 [ 6439.978511][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6439.978823][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6439.979154][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6439.979452][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6439.979734][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6439.980012][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6439.980316][ C1] ? hlock_class+0x4e/0x130 [ 6439.980543][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6439.980811][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6439.981078][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6439.981336][ C1] ? hlock_class+0x4e/0x130 [ 6439.981561][ C1] ? mark_lock+0x38/0x3e0 [ 6439.981774][ C1] ? stack_access_ok+0xda/0x1f0 [ 6439.982015][ C1] ? __lock_acquire+0xb67/0x1610 [ 6439.982262][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6439.982532][ C1] ? get_stack_info+0x36/0xc0 [ 6439.982763][ C1] ? stack_access_ok+0xda/0x1f0 [ 6439.983003][ C1] ? get_reg+0x119/0x190 [ 6439.983215][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6439.983475][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6439.983775][ C1] __tcf_classify+0x329/0x7d0 [ 6439.984026][ C1] tcf_classify+0x283/0x930 [ 6439.984260][ C1] ? arch_stack_walk+0xa2/0x100 [ 6439.984509][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6439.984765][ C1] ? get_stack_info+0x36/0xc0 [ 6439.985006][ C1] tc_run+0x2e4/0x5d0 [ 6439.985221][ C1] ? __pfx_tc_run+0x10/0x10 [ 6439.985444][ C1] ? lock_acquire+0x1c1/0x220 [ 6439.985676][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6439.985930][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6439.986176][ C1] ? lock_acquire+0x1c1/0x220 [ 6439.986408][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6439.986664][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6439.986959][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6439.987224][ C1] ? neigh_hh_output+0x348/0x590 [ 6439.987469][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6439.987727][ C1] ip_finish_output2+0x786/0x18e0 [ 6439.987975][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6439.988245][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6439.988598][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6439.988873][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6439.989125][ C1] ? __ip_finish_output+0x10f/0x770 [ 6439.989390][ C1] ip_output+0x16b/0x4f0 [ 6439.989606][ C1] ? run_timer_softirq+0x72/0x100 [ 6439.989867][ C1] ? __pfx_ip_output+0x10/0x10 [ 6439.990102][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6439.990383][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6439.990629][ C1] ? ip_local_out+0x114/0x3b0 [ 6439.990860][ C1] __ip_queue_xmit+0x672/0x1910 [ 6439.991102][ C1] ? __create_object+0x5e/0xb0 [ 6439.991340][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6439.991600][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6439.991874][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6439.992140][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6439.992413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6439.992677][ C1] tcp_delack_timer+0x84/0x240 [ 6439.992914][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6439.993180][ C1] call_timer_fn+0x173/0x430 [ 6439.993409][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6439.993663][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6439.993917][ C1] __run_timers.part.0+0x52d/0x890 [ 6439.994170][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6439.994439][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6439.994715][ C1] ? lock_acquire+0x1c1/0x220 [ 6439.994950][ C1] ? clockevents_program_event+0xf6/0x300 [ 6439.995234][ C1] ? lock_release+0x1d5/0x250 [ 6439.995468][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6439.995724][ C1] ? ktime_get+0xb3/0x190 [ 6439.995940][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6439.996228][ C1] run_timer_softirq+0x72/0x100 [ 6439.996469][ C1] __do_softirq+0x1b9/0x7ff [ 6439.996696][ C1] irq_exit_rcu+0x98/0xc0 [ 6439.996909][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6439.997188][ C1] [ 6439.997334][ C1] [ 6439.997479][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6439.997776][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6439.998091][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6439.999067][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6439.999375][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6439.999779][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6440.000170][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6440.000557][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6440.000945][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6440.001335][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6440.001629][ C1] pipe_read+0xa16/0xdf0 [ 6440.001842][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6440.002114][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6440.002350][ C1] ? iterate_tty_write+0x299/0x540 [ 6440.002603][ C1] ? lock_release+0x1d5/0x250 [ 6440.002835][ C1] vfs_read+0x911/0xc00 [ 6440.003046][ C1] ? lock_acquire+0x1c1/0x220 [ 6440.003276][ C1] ? __might_fault+0xc6/0x180 [ 6440.003511][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6440.003745][ C1] ? __might_fault+0xc6/0x180 [ 6440.003977][ C1] ? lock_release+0x1d5/0x250 [ 6440.004209][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6440.004469][ C1] ? __fget_light+0x54/0x1e0 [ 6440.004699][ C1] ksys_read+0x17a/0x1e0 [ 6440.004910][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6440.005147][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6440.005445][ C1] do_syscall_64+0xc9/0x1e0 [ 6440.005671][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6440.005962][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6440.006183][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6440.007127][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6440.007537][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6440.007925][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6440.008312][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6440.008727][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6440.009127][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6440.009528][ C1] [ 6440.009700][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6440.009968][ C2] NMI backtrace for cpu 2 [ 6440.009973][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6440.009978][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6440.009982][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6440.009989][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6440.009995][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6440.009999][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6440.010002][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6440.010006][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6440.010009][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6440.010013][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6440.010017][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6440.010021][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6440.010026][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6440.010029][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6440.010032][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6440.010036][ C2] PKRU: 55555554 [ 6440.010038][ C2] Call Trace: [ 6440.010040][ C2] [ 6440.010043][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6440.010054][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6440.010061][ C2] ? nmi_handle+0x153/0x420 [ 6440.010071][ C2] ? default_do_nmi+0x41/0x100 [ 6440.010077][ C2] ? exc_nmi+0xf3/0x120 [ 6440.010083][ C2] ? end_repeat_nmi+0xf/0x60 [ 6440.010094][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6440.010102][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6440.010109][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6440.010118][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6440.010125][ C2] [ 6440.010127][ C2] [ 6440.010130][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6440.010136][ C2] ? get_stack_info+0x36/0xc0 [ 6440.010145][ C2] ? lock_acquire+0x1c1/0x220 [ 6440.010152][ C2] ? lock_release+0x1d5/0x250 [ 6440.010161][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6440.010169][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6440.010176][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6440.010184][ C2] ? lock_acquire+0x1c1/0x220 [ 6440.010189][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6440.010197][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6440.010203][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6440.010219][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6440.010225][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6440.010236][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6440.010246][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6440.010254][ C2] ip_local_deliver+0x19d/0x480 [ 6440.010260][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6440.010265][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6440.010271][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6440.010281][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6440.010288][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6440.010295][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6440.010316][ C2] ip_rcv+0x564/0x740 [ 6440.010322][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6440.010328][ C2] ? set_track_prepare+0x8a/0xd0 [ 6440.010336][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6440.010343][ C2] ? start_secondary+0x21c/0x2b0 [ 6440.010349][ C2] ? skb_clone+0x10b/0x330 [ 6440.010354][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6440.010369][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6440.010379][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6440.010382][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6440.010389][ C2] ? __tcf_classify+0x329/0x7d0 [ 6440.010393][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6440.010395][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6440.010398][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6440.010401][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6440.010405][ C2] ? lock_acquire+0x1c1/0x220 [ 6440.010408][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6440.010412][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6440.010415][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6440.010419][ C2] ? __copy_skb_header+0xaf/0x490 [ 6440.010423][ C2] ? __skb_clone+0x57a/0x760 [ 6440.010425][ C2] netif_receive_skb+0x55/0x280 [ 6440.010428][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6440.010435][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6440.010441][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6440.010447][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6440.010451][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6440.010461][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6440.010468][ C2] ? get_stack_info+0x36/0xc0 [ 6440.010472][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6440.010475][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6440.010478][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6440.010480][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6440.010484][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6440.010486][ C2] ? kernel_text_address+0x17/0xe0 [ 6440.010488][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6440.010492][ C2] ? arch_stack_walk+0x8c/0x100 [ 6440.010495][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6440.010498][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6440.010501][ C2] ? lock_acquire+0x1c1/0x220 [ 6440.010503][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6440.010507][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6440.010511][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6440.010514][ C2] ? get_stack_info+0x36/0xc0 [ 6440.010518][ C2] __tcf_classify+0x329/0x7d0 [ 6440.010522][ C2] tcf_classify+0x283/0x930 [ 6440.010527][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6440.010529][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6440.010534][ C2] tc_run+0x2e4/0x5d0 [ 6440.010537][ C2] ? __pfx_tc_run+0x10/0x10 [ 6440.010540][ C2] ? lock_acquire+0x1c1/0x220 [ 6440.010542][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6440.010546][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6440.010549][ C2] ? lock_acquire+0x1c1/0x220 [ 6440.010552][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6440.010555][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6440.010557][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6440.010560][ C2] ? neigh_hh_output+0x348/0x590 [ 6440.010564][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6440.010567][ C2] ip_finish_output2+0x786/0x18e0 [ 6440.010571][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6440.010578][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6440.010581][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6440.010584][ C2] ? __ip_finish_output+0x10f/0x770 [ 6440.010588][ C2] ip_output+0x16b/0x4f0 [ 6440.010591][ C2] ? __pfx_ip_output+0x10/0x10 [ 6440.010594][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6440.010596][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6440.010599][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6440.010602][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6440.010605][ C2] ? __alloc_skb+0xd4/0x280 [ 6440.010607][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6440.010610][ C2] ? tcp_fragment+0x168/0x1040 [ 6440.010613][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6440.010616][ C2] ? ip_local_out+0x114/0x3b0 [ 6440.010619][ C2] __ip_queue_xmit+0x672/0x1910 [ 6440.010623][ C2] ? __skb_clone+0x57a/0x760 [ 6440.010625][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6440.010630][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6440.010633][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6440.010636][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6440.010641][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6440.010644][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6440.010647][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6440.010651][ C2] tcp_send_loss_probe+0x348/0x830 [ 6440.010654][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6440.010656][ C2] tcp_write_timer+0x82/0x1d0 [ 6440.010659][ C2] call_timer_fn+0x173/0x430 [ 6440.010662][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6440.010667][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6440.010671][ C2] __run_timers.part.0+0x52d/0x890 [ 6440.010673][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6440.010677][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6440.010680][ C2] ? lock_acquire+0x1c1/0x220 [ 6440.010683][ C2] ? clockevents_program_event+0xf6/0x300 [ 6440.010686][ C2] ? lock_release+0x1d5/0x250 [ 6440.010689][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6440.010692][ C2] ? ktime_get+0xb3/0x190 [ 6440.010695][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6440.010699][ C2] run_timer_softirq+0x72/0x100 [ 6440.010703][ C2] __do_softirq+0x1b9/0x7ff [ 6440.010707][ C2] irq_exit_rcu+0x98/0xc0 [ 6440.010709][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6440.010712][ C2] [ 6440.010713][ C2] [ 6440.010714][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6440.010717][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6440.010720][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6440.010722][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6440.010724][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6440.010725][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6440.010726][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6440.010728][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6440.010729][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6440.010732][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6440.010735][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6440.010738][ C2] default_idle_call+0x69/0xa0 [ 6440.010740][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6440.010742][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6440.010746][ C2] ? lock_release+0x1d5/0x250 [ 6440.010748][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6440.010752][ C2] do_idle+0xfb/0x160 [ 6440.010754][ C2] cpu_startup_entry+0x55/0x60 [ 6440.010756][ C2] start_secondary+0x21c/0x2b0 [ 6440.010759][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6440.010762][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6440.010768][ C2] [ 6464.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3829s! [perl:4135] [ 6464.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6464.570908][ C1] irq event stamp: 209232 [ 6464.571122][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6464.571636][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6464.572099][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6464.572556][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6464.573004][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6464.573439][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6464.574033][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6464.574350][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6464.575297][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6464.575595][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6464.575984][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6464.576372][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6464.576759][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6464.577148][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6464.577537][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6464.577971][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6464.578298][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6464.578712][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6464.579112][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6464.579521][ C1] PKRU: 55555554 [ 6464.579697][ C1] Call Trace: [ 6464.579863][ C1] [ 6464.580007][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6464.580262][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6464.580499][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6464.580768][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6464.581031][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6464.581313][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6464.581571][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6464.581869][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6464.582124][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6464.582423][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6464.582710][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6464.583016][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6464.583297][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6464.583584][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6464.583866][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6464.584171][ C1] ? get_stack_info+0x36/0xc0 [ 6464.584404][ C1] ? lock_acquire+0x1c1/0x220 [ 6464.584638][ C1] ? lock_release+0x1d5/0x250 [ 6464.584875][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6464.585117][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6464.585381][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6464.585658][ C1] ? lock_acquire+0x1c1/0x220 [ 6464.585891][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6464.586125][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6464.586378][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6464.586606][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6464.586845][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6464.587096][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6464.587368][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6464.587637][ C1] ip_local_deliver+0x19d/0x480 [ 6464.587878][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6464.588143][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6464.588420][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6464.588768][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6464.589020][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6464.589341][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6464.589612][ C1] ip_rcv+0x564/0x740 [ 6464.589811][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6464.590034][ C1] ? set_track_prepare+0x8a/0xd0 [ 6464.590281][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6464.590552][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6464.590817][ C1] ? skb_clone+0x10b/0x330 [ 6464.591037][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6464.591349][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6464.591649][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6464.591923][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6464.592210][ C1] ? __tcf_classify+0x329/0x7d0 [ 6464.592453][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6464.592677][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6464.592969][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6464.593248][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6464.593566][ C1] ? lock_acquire+0x1c1/0x220 [ 6464.593796][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6464.594087][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6464.594365][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6464.594673][ C1] ? __copy_skb_header+0xaf/0x490 [ 6464.594925][ C1] ? __skb_clone+0x57a/0x760 [ 6464.595155][ C1] netif_receive_skb+0x55/0x280 [ 6464.595400][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6464.595706][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6464.596029][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6464.596320][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6464.596589][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6464.596868][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6464.597173][ C1] ? hlock_class+0x4e/0x130 [ 6464.597401][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6464.597670][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6464.597938][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6464.598195][ C1] ? hlock_class+0x4e/0x130 [ 6464.598445][ C1] ? mark_lock+0x38/0x3e0 [ 6464.598663][ C1] ? stack_access_ok+0xda/0x1f0 [ 6464.598912][ C1] ? __lock_acquire+0xb67/0x1610 [ 6464.599167][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6464.599445][ C1] ? get_stack_info+0x36/0xc0 [ 6464.599690][ C1] ? stack_access_ok+0xda/0x1f0 [ 6464.599930][ C1] ? get_reg+0x119/0x190 [ 6464.600142][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6464.600403][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6464.600704][ C1] __tcf_classify+0x329/0x7d0 [ 6464.600938][ C1] tcf_classify+0x283/0x930 [ 6464.601164][ C1] ? arch_stack_walk+0xa2/0x100 [ 6464.601407][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6464.601657][ C1] ? get_stack_info+0x36/0xc0 [ 6464.601892][ C1] tc_run+0x2e4/0x5d0 [ 6464.602093][ C1] ? __pfx_tc_run+0x10/0x10 [ 6464.602316][ C1] ? lock_acquire+0x1c1/0x220 [ 6464.602550][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6464.602804][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6464.603050][ C1] ? lock_acquire+0x1c1/0x220 [ 6464.603283][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6464.603540][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6464.603837][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6464.604101][ C1] ? neigh_hh_output+0x348/0x590 [ 6464.604347][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6464.604605][ C1] ip_finish_output2+0x786/0x18e0 [ 6464.604853][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6464.605122][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6464.605452][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6464.605721][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6464.605967][ C1] ? __ip_finish_output+0x10f/0x770 [ 6464.606224][ C1] ip_output+0x16b/0x4f0 [ 6464.606433][ C1] ? run_timer_softirq+0x72/0x100 [ 6464.606682][ C1] ? __pfx_ip_output+0x10/0x10 [ 6464.606920][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6464.607199][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6464.607443][ C1] ? ip_local_out+0x114/0x3b0 [ 6464.607675][ C1] __ip_queue_xmit+0x672/0x1910 [ 6464.607916][ C1] ? __create_object+0x5e/0xb0 [ 6464.608155][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6464.608437][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6464.608719][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6464.608993][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6464.609274][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6464.609555][ C1] tcp_delack_timer+0x84/0x240 [ 6464.609792][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6464.610055][ C1] call_timer_fn+0x173/0x430 [ 6464.610286][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6464.610540][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6464.610793][ C1] __run_timers.part.0+0x52d/0x890 [ 6464.611045][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6464.611313][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6464.611590][ C1] ? lock_acquire+0x1c1/0x220 [ 6464.611823][ C1] ? clockevents_program_event+0xf6/0x300 [ 6464.612104][ C1] ? lock_release+0x1d5/0x250 [ 6464.612337][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6464.612594][ C1] ? ktime_get+0xb3/0x190 [ 6464.612809][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6464.613097][ C1] run_timer_softirq+0x72/0x100 [ 6464.613339][ C1] __do_softirq+0x1b9/0x7ff [ 6464.613566][ C1] irq_exit_rcu+0x98/0xc0 [ 6464.613778][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6464.614056][ C1] [ 6464.614203][ C1] [ 6464.614348][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6464.614645][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6464.614960][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6464.615902][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6464.616202][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6464.616589][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6464.616977][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6464.617366][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6464.617754][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6464.618142][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6464.618454][ C1] pipe_read+0xa16/0xdf0 [ 6464.618672][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6464.618951][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6464.619193][ C1] ? iterate_tty_write+0x299/0x540 [ 6464.619455][ C1] ? lock_release+0x1d5/0x250 [ 6464.619702][ C1] vfs_read+0x911/0xc00 [ 6464.619909][ C1] ? lock_acquire+0x1c1/0x220 [ 6464.620142][ C1] ? __might_fault+0xc6/0x180 [ 6464.620377][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6464.620611][ C1] ? __might_fault+0xc6/0x180 [ 6464.620843][ C1] ? lock_release+0x1d5/0x250 [ 6464.621076][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6464.621336][ C1] ? __fget_light+0x54/0x1e0 [ 6464.621567][ C1] ksys_read+0x17a/0x1e0 [ 6464.621778][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6464.622015][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6464.622312][ C1] do_syscall_64+0xc9/0x1e0 [ 6464.622539][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6464.622828][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6464.623050][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6464.623994][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6464.624404][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6464.624792][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6464.625178][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6464.625564][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6464.625952][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6464.626343][ C1] [ 6464.626495][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3829s! [swapper/2:0] [ 6464.626895][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6464.628108][ C2] irq event stamp: 44114564 [ 6464.628348][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6464.628881][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6464.629390][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6464.629862][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6464.630312][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6464.630754][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6464.631345][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6464.631658][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6464.632596][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6464.632893][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6464.633278][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6464.633664][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6464.634049][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6464.634434][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6464.634817][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6464.635249][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6464.635572][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6464.635959][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6464.636343][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6464.636729][ C2] PKRU: 55555554 [ 6464.636904][ C2] Call Trace: [ 6464.637068][ C2] [ 6464.637210][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6464.637462][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6464.637698][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6464.637966][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6464.638231][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6464.638532][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6464.638794][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6464.639098][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6464.639357][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6464.639625][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6464.639926][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6464.640213][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6464.640515][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6464.640794][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6464.641080][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6464.641358][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6464.641661][ C2] ? get_stack_info+0x36/0xc0 [ 6464.641894][ C2] ? lock_acquire+0x1c1/0x220 [ 6464.642125][ C2] ? lock_release+0x1d5/0x250 [ 6464.642356][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6464.642596][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6464.642859][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6464.643139][ C2] ? lock_acquire+0x1c1/0x220 [ 6464.643370][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6464.643600][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6464.643853][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6464.644079][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6464.644318][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6464.644567][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6464.644831][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6464.645099][ C2] ip_local_deliver+0x19d/0x480 [ 6464.645336][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6464.645602][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6464.645857][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6464.646191][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6464.646435][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6464.646744][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6464.646997][ C2] ip_rcv+0x564/0x740 [ 6464.647194][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6464.647418][ C2] ? set_track_prepare+0x8a/0xd0 [ 6464.647662][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6464.647928][ C2] ? start_secondary+0x21c/0x2b0 [ 6464.648170][ C2] ? skb_clone+0x10b/0x330 [ 6464.648412][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6464.648728][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6464.649031][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6464.649312][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6464.649612][ C2] ? __tcf_classify+0x329/0x7d0 [ 6464.649851][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6464.650074][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6464.650362][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6464.650639][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6464.650954][ C2] ? lock_acquire+0x1c1/0x220 [ 6464.651184][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6464.651469][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6464.651746][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6464.652052][ C2] ? __copy_skb_header+0xaf/0x490 [ 6464.652300][ C2] ? __skb_clone+0x57a/0x760 [ 6464.652525][ C2] netif_receive_skb+0x55/0x280 [ 6464.652765][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6464.653066][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6464.653386][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6464.653675][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6464.653939][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6464.654215][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6464.654517][ C2] ? get_stack_info+0x36/0xc0 [ 6464.654750][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6464.655005][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6464.655311][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6464.655577][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6464.655846][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6464.656151][ C2] ? kernel_text_address+0x17/0xe0 [ 6464.656402][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6464.656702][ C2] ? arch_stack_walk+0x8c/0x100 [ 6464.656941][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6464.657198][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6464.657473][ C2] ? lock_acquire+0x1c1/0x220 [ 6464.657705][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6464.657976][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6464.658271][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6464.658564][ C2] ? get_stack_info+0x36/0xc0 [ 6464.658803][ C2] __tcf_classify+0x329/0x7d0 [ 6464.659043][ C2] tcf_classify+0x283/0x930 [ 6464.659273][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6464.659537][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6464.659838][ C2] tc_run+0x2e4/0x5d0 [ 6464.660035][ C2] ? __pfx_tc_run+0x10/0x10 [ 6464.660260][ C2] ? lock_acquire+0x1c1/0x220 [ 6464.660490][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6464.660741][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6464.660985][ C2] ? lock_acquire+0x1c1/0x220 [ 6464.661215][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6464.661470][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6464.661762][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6464.662025][ C2] ? neigh_hh_output+0x348/0x590 [ 6464.662268][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6464.662524][ C2] ip_finish_output2+0x786/0x18e0 [ 6464.662772][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6464.663097][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6464.663364][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6464.663607][ C2] ? __ip_finish_output+0x10f/0x770 [ 6464.663862][ C2] ip_output+0x16b/0x4f0 [ 6464.664072][ C2] ? __pfx_ip_output+0x10/0x10 [ 6464.664304][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6464.664574][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6464.664874][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6464.665140][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6464.665383][ C2] ? __alloc_skb+0xd4/0x280 [ 6464.665606][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6464.665867][ C2] ? tcp_fragment+0x168/0x1040 [ 6464.666101][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6464.666344][ C2] ? ip_local_out+0x114/0x3b0 [ 6464.666576][ C2] __ip_queue_xmit+0x672/0x1910 [ 6464.666816][ C2] ? __skb_clone+0x57a/0x760 [ 6464.667044][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6464.667302][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6464.667592][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6464.667835][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6464.668081][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6464.668384][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6464.668701][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6464.668941][ C2] tcp_send_loss_probe+0x348/0x830 [ 6464.669201][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6464.669468][ C2] tcp_write_timer+0x82/0x1d0 [ 6464.669708][ C2] call_timer_fn+0x173/0x430 [ 6464.669936][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6464.670188][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6464.670440][ C2] __run_timers.part.0+0x52d/0x890 [ 6464.670691][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6464.670951][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6464.671226][ C2] ? lock_acquire+0x1c1/0x220 [ 6464.671457][ C2] ? clockevents_program_event+0xf6/0x300 [ 6464.671735][ C2] ? lock_release+0x1d5/0x250 [ 6464.671966][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6464.672221][ C2] ? ktime_get+0xb3/0x190 [ 6464.672434][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6464.672720][ C2] run_timer_softirq+0x72/0x100 [ 6464.672959][ C2] __do_softirq+0x1b9/0x7ff [ 6464.673184][ C2] irq_exit_rcu+0x98/0xc0 [ 6464.673396][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6464.673670][ C2] [ 6464.673817][ C2] [ 6464.673961][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6464.674254][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6464.674502][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6464.675437][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6464.675734][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6464.676119][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6464.676502][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6464.676887][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6464.677272][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6464.677657][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6464.677937][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6464.678189][ C2] default_idle_call+0x69/0xa0 [ 6464.678445][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6464.678694][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6464.678970][ C2] ? lock_release+0x1d5/0x250 [ 6464.679206][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6464.679477][ C2] do_idle+0xfb/0x160 [ 6464.679686][ C2] cpu_startup_entry+0x55/0x60 [ 6464.679921][ C2] start_secondary+0x21c/0x2b0 [ 6464.680177][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6464.680444][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6464.680752][ C2] [ 6492.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3855s! [perl:4135] [ 6492.569704][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6492.570921][ C1] irq event stamp: 209232 [ 6492.571133][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6492.571649][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6492.572114][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6492.572569][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6492.573018][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6492.573454][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6492.574051][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6492.574367][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6492.575310][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6492.575610][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6492.575997][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6492.576385][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6492.576773][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6492.577163][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6492.577552][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6492.577986][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6492.578332][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6492.578734][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6492.579133][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6492.579536][ C1] PKRU: 55555554 [ 6492.579713][ C1] Call Trace: [ 6492.579879][ C1] [ 6492.580022][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6492.580276][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6492.580513][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6492.580781][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6492.581049][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6492.581328][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6492.581587][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6492.581885][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6492.582140][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6492.582442][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6492.582731][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6492.583037][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6492.583320][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6492.583607][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6492.583888][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6492.584193][ C1] ? get_stack_info+0x36/0xc0 [ 6492.584428][ C1] ? lock_acquire+0x1c1/0x220 [ 6492.584660][ C1] ? lock_release+0x1d5/0x250 [ 6492.584895][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6492.585136][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6492.585401][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6492.585679][ C1] ? lock_acquire+0x1c1/0x220 [ 6492.585910][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6492.586146][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6492.586398][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6492.586627][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6492.586868][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6492.587120][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6492.587408][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6492.587683][ C1] ip_local_deliver+0x19d/0x480 [ 6492.587931][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6492.588203][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6492.588467][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6492.588814][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6492.589067][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6492.589388][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6492.589651][ C1] ip_rcv+0x564/0x740 [ 6492.589854][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6492.590085][ C1] ? set_track_prepare+0x8a/0xd0 [ 6492.590339][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6492.590618][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6492.590894][ C1] ? skb_clone+0x10b/0x330 [ 6492.591123][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6492.591442][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6492.591745][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6492.592028][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6492.592321][ C1] ? __tcf_classify+0x329/0x7d0 [ 6492.592571][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6492.592801][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6492.593099][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6492.593389][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6492.593714][ C1] ? lock_acquire+0x1c1/0x220 [ 6492.593954][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6492.594248][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6492.594535][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6492.594852][ C1] ? __copy_skb_header+0xaf/0x490 [ 6492.595110][ C1] ? __skb_clone+0x57a/0x760 [ 6492.595342][ C1] netif_receive_skb+0x55/0x280 [ 6492.595590][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6492.595904][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6492.596236][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6492.596536][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6492.596809][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6492.597097][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6492.597410][ C1] ? hlock_class+0x4e/0x130 [ 6492.597644][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6492.597921][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6492.598200][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6492.598466][ C1] ? hlock_class+0x4e/0x130 [ 6492.598695][ C1] ? mark_lock+0x38/0x3e0 [ 6492.598918][ C1] ? stack_access_ok+0xda/0x1f0 [ 6492.599166][ C1] ? __lock_acquire+0xb67/0x1610 [ 6492.599420][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6492.599700][ C1] ? get_stack_info+0x36/0xc0 [ 6492.599940][ C1] ? stack_access_ok+0xda/0x1f0 [ 6492.600186][ C1] ? get_reg+0x119/0x190 [ 6492.600404][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6492.600671][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6492.600981][ C1] __tcf_classify+0x329/0x7d0 [ 6492.601223][ C1] tcf_classify+0x283/0x930 [ 6492.601453][ C1] ? arch_stack_walk+0xa2/0x100 [ 6492.601702][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6492.601958][ C1] ? get_stack_info+0x36/0xc0 [ 6492.602200][ C1] tc_run+0x2e4/0x5d0 [ 6492.602406][ C1] ? __pfx_tc_run+0x10/0x10 [ 6492.602638][ C1] ? lock_acquire+0x1c1/0x220 [ 6492.602875][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6492.603138][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6492.603390][ C1] ? lock_acquire+0x1c1/0x220 [ 6492.603630][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6492.603894][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6492.604199][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6492.604470][ C1] ? neigh_hh_output+0x348/0x590 [ 6492.604724][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6492.604988][ C1] ip_finish_output2+0x786/0x18e0 [ 6492.605244][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6492.605525][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6492.605862][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6492.606138][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6492.606391][ C1] ? __ip_finish_output+0x10f/0x770 [ 6492.606655][ C1] ip_output+0x16b/0x4f0 [ 6492.606873][ C1] ? run_timer_softirq+0x72/0x100 [ 6492.607130][ C1] ? __pfx_ip_output+0x10/0x10 [ 6492.607372][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6492.607661][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6492.607916][ C1] ? ip_local_out+0x114/0x3b0 [ 6492.608156][ C1] __ip_queue_xmit+0x672/0x1910 [ 6492.608406][ C1] ? __create_object+0x5e/0xb0 [ 6492.608651][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6492.608917][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6492.609200][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6492.609476][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6492.609760][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6492.610035][ C1] tcp_delack_timer+0x84/0x240 [ 6492.610277][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6492.610552][ C1] call_timer_fn+0x173/0x430 [ 6492.610786][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6492.611047][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6492.611310][ C1] __run_timers.part.0+0x52d/0x890 [ 6492.611571][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6492.611845][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6492.612131][ C1] ? lock_acquire+0x1c1/0x220 [ 6492.612370][ C1] ? clockevents_program_event+0xf6/0x300 [ 6492.612660][ C1] ? lock_release+0x1d5/0x250 [ 6492.612899][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6492.613163][ C1] ? ktime_get+0xb3/0x190 [ 6492.613386][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6492.613681][ C1] run_timer_softirq+0x72/0x100 [ 6492.613929][ C1] __do_softirq+0x1b9/0x7ff [ 6492.614163][ C1] irq_exit_rcu+0x98/0xc0 [ 6492.614382][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6492.614670][ C1] [ 6492.614823][ C1] [ 6492.614974][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6492.615277][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6492.615601][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6492.616573][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6492.616880][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6492.617280][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6492.617679][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6492.618077][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6492.618479][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6492.618881][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6492.619177][ C1] pipe_read+0xa16/0xdf0 [ 6492.619399][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6492.619677][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6492.619921][ C1] ? iterate_tty_write+0x299/0x540 [ 6492.620183][ C1] ? lock_release+0x1d5/0x250 [ 6492.620423][ C1] vfs_read+0x911/0xc00 [ 6492.620638][ C1] ? lock_acquire+0x1c1/0x220 [ 6492.620876][ C1] ? __might_fault+0xc6/0x180 [ 6492.621117][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6492.621356][ C1] ? __might_fault+0xc6/0x180 [ 6492.621596][ C1] ? lock_release+0x1d5/0x250 [ 6492.621835][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6492.622101][ C1] ? __fget_light+0x54/0x1e0 [ 6492.622337][ C1] ksys_read+0x17a/0x1e0 [ 6492.622556][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6492.622799][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6492.623103][ C1] do_syscall_64+0xc9/0x1e0 [ 6492.623337][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6492.623636][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6492.623864][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6492.624833][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6492.625257][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6492.625655][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6492.626052][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6492.626452][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6492.626851][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6492.627252][ C1] [ 6492.627411][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3855s! [swapper/2:0] [ 6492.627821][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6492.629066][ C2] irq event stamp: 44114564 [ 6492.629294][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6492.629825][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6492.630333][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6492.630805][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6492.631272][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6492.631723][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6492.632328][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 6492.632610][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 6492.633572][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 6492.633877][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6492.634273][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6492.634667][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6492.635063][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6492.635459][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6492.635853][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6492.636296][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6492.636624][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6492.637022][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6492.637419][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6492.637814][ C2] PKRU: 55555554 [ 6492.637994][ C2] Call Trace: [ 6492.638164][ C2] [ 6492.638312][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6492.638571][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6492.638813][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6492.639087][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6492.639358][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6492.639645][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6492.639907][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6492.640210][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6492.640469][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6492.640729][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6492.641036][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6492.641328][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6492.641641][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6492.641928][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 6492.642207][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 6492.642486][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6492.642793][ C2] ? get_stack_info+0x36/0xc0 [ 6492.643033][ C2] ? lock_acquire+0x1c1/0x220 [ 6492.643273][ C2] ? lock_release+0x1d5/0x250 [ 6492.643511][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6492.643756][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6492.644027][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6492.644309][ C2] ? lock_acquire+0x1c1/0x220 [ 6492.644546][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6492.644786][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6492.645043][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6492.645276][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6492.645522][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6492.645778][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6492.646050][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6492.646326][ C2] ip_local_deliver+0x19d/0x480 [ 6492.646572][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6492.646841][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6492.647102][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6492.647445][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6492.647695][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6492.648014][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6492.648280][ C2] ip_rcv+0x564/0x740 [ 6492.648483][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6492.648711][ C2] ? set_track_prepare+0x8a/0xd0 [ 6492.648963][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6492.649238][ C2] ? start_secondary+0x21c/0x2b0 [ 6492.649488][ C2] ? skb_clone+0x10b/0x330 [ 6492.649713][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6492.650031][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6492.650335][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6492.650615][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6492.650907][ C2] ? __tcf_classify+0x329/0x7d0 [ 6492.651153][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6492.651382][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6492.651679][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6492.651961][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6492.652283][ C2] ? lock_acquire+0x1c1/0x220 [ 6492.652524][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6492.652818][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6492.653101][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6492.653415][ C2] ? __copy_skb_header+0xaf/0x490 [ 6492.653670][ C2] ? __skb_clone+0x57a/0x760 [ 6492.653904][ C2] netif_receive_skb+0x55/0x280 [ 6492.654150][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6492.654458][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6492.654789][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6492.655085][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6492.655357][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6492.655646][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6492.655955][ C2] ? get_stack_info+0x36/0xc0 [ 6492.656193][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6492.656456][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6492.656769][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6492.657046][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6492.657320][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6492.657632][ C2] ? kernel_text_address+0x17/0xe0 [ 6492.657889][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6492.658203][ C2] ? arch_stack_walk+0x8c/0x100 [ 6492.658449][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6492.658711][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6492.658993][ C2] ? lock_acquire+0x1c1/0x220 [ 6492.659231][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6492.659510][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6492.659812][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6492.660085][ C2] ? get_stack_info+0x36/0xc0 [ 6492.660324][ C2] __tcf_classify+0x329/0x7d0 [ 6492.660564][ C2] tcf_classify+0x283/0x930 [ 6492.660795][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6492.661049][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6492.661359][ C2] tc_run+0x2e4/0x5d0 [ 6492.661563][ C2] ? __pfx_tc_run+0x10/0x10 [ 6492.661791][ C2] ? lock_acquire+0x1c1/0x220 [ 6492.662028][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6492.662287][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6492.662538][ C2] ? lock_acquire+0x1c1/0x220 [ 6492.662776][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6492.663038][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6492.663340][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6492.663608][ C2] ? neigh_hh_output+0x348/0x590 [ 6492.663860][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6492.664122][ C2] ip_finish_output2+0x786/0x18e0 [ 6492.664377][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6492.664711][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6492.664986][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6492.665236][ C2] ? __ip_finish_output+0x10f/0x770 [ 6492.665500][ C2] ip_output+0x16b/0x4f0 [ 6492.665714][ C2] ? __pfx_ip_output+0x10/0x10 [ 6492.665957][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6492.666230][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6492.666541][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6492.666814][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6492.667063][ C2] ? __alloc_skb+0xd4/0x280 [ 6492.667293][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6492.667560][ C2] ? tcp_fragment+0x168/0x1040 [ 6492.667802][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6492.668052][ C2] ? ip_local_out+0x114/0x3b0 [ 6492.668294][ C2] __ip_queue_xmit+0x672/0x1910 [ 6492.668539][ C2] ? __skb_clone+0x57a/0x760 [ 6492.668773][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6492.669037][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6492.669316][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6492.669556][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6492.669807][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6492.670106][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6492.670424][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6492.670666][ C2] tcp_send_loss_probe+0x348/0x830 [ 6492.670925][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6492.671190][ C2] tcp_write_timer+0x82/0x1d0 [ 6492.671430][ C2] call_timer_fn+0x173/0x430 [ 6492.671662][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6492.671923][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6492.672183][ C2] __run_timers.part.0+0x52d/0x890 [ 6492.672441][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6492.672709][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6492.672990][ C2] ? lock_acquire+0x1c1/0x220 [ 6492.673228][ C2] ? clockevents_program_event+0xf6/0x300 [ 6492.673515][ C2] ? lock_release+0x1d5/0x250 [ 6492.673750][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6492.674012][ C2] ? ktime_get+0xb3/0x190 [ 6492.674233][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6492.674527][ C2] run_timer_softirq+0x72/0x100 [ 6492.674776][ C2] __do_softirq+0x1b9/0x7ff [ 6492.675008][ C2] irq_exit_rcu+0x98/0xc0 [ 6492.675224][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6492.675510][ C2] [ 6492.675657][ C2] [ 6492.675808][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6492.676107][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6492.676362][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6492.677324][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6492.677627][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6492.678027][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6492.678429][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6492.678823][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6492.679217][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6492.679615][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6492.679901][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6492.680159][ C2] default_idle_call+0x69/0xa0 [ 6492.680401][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6492.680651][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6492.680925][ C2] ? lock_release+0x1d5/0x250 [ 6492.681163][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6492.681433][ C2] do_idle+0xfb/0x160 [ 6492.681635][ C2] cpu_startup_entry+0x55/0x60 [ 6492.681876][ C2] start_secondary+0x21c/0x2b0 [ 6492.682119][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6492.682386][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6492.682694][ C2] [ 6518.011108][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6518.011471][ C1] rcu: 1-....: (4152896 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1017958 [ 6518.012018][ C1] rcu: (t=4163124 jiffies g=1882453 q=715 ncpus=4) [ 6518.012341][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6518.012778][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6518.013375][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6518.013693][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6518.014638][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6518.014937][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6518.015326][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6518.015715][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6518.016104][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6518.016492][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6518.016879][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6518.017314][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6518.017638][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6518.018029][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6518.018446][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6518.018843][ C1] PKRU: 55555554 [ 6518.019025][ C1] Call Trace: [ 6518.019196][ C1] [ 6518.019352][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6518.019618][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6518.019864][ C1] ? check_cpu_stall+0x284/0x500 [ 6518.020108][ C1] ? rcu_pending+0x92/0x360 [ 6518.020334][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6518.020595][ C1] ? update_process_times+0xb9/0x110 [ 6518.020857][ C1] ? tick_sched_handle+0x67/0x130 [ 6518.021107][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6518.021386][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6518.021622][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6518.021924][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6518.022190][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6518.022470][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6518.022728][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6518.023026][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6518.023281][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6518.023581][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6518.023868][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6518.024173][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6518.024454][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6518.024742][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6518.025021][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6518.025324][ C1] ? get_stack_info+0x36/0xc0 [ 6518.025559][ C1] ? lock_acquire+0x1c1/0x220 [ 6518.025793][ C1] ? lock_release+0x1d5/0x250 [ 6518.026025][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6518.026267][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6518.026530][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6518.026810][ C1] ? lock_acquire+0x1c1/0x220 [ 6518.027041][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6518.027274][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6518.027526][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6518.027755][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6518.027997][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6518.028270][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6518.028546][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6518.028825][ C1] ip_local_deliver+0x19d/0x480 [ 6518.029070][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6518.029352][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6518.029609][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6518.029948][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6518.030211][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6518.030531][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6518.030797][ C1] ip_rcv+0x564/0x740 [ 6518.031001][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6518.031235][ C1] ? set_track_prepare+0x8a/0xd0 [ 6518.031489][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6518.031766][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6518.032039][ C1] ? skb_clone+0x10b/0x330 [ 6518.032268][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6518.032587][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6518.032897][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6518.033178][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6518.033475][ C1] ? __tcf_classify+0x329/0x7d0 [ 6518.033724][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6518.033955][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6518.034257][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6518.034542][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6518.034868][ C1] ? lock_acquire+0x1c1/0x220 [ 6518.035108][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6518.035406][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6518.035692][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6518.036010][ C1] ? __copy_skb_header+0xaf/0x490 [ 6518.036268][ C1] ? __skb_clone+0x57a/0x760 [ 6518.036504][ C1] netif_receive_skb+0x55/0x280 [ 6518.036753][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6518.037065][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6518.037399][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6518.037698][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6518.037974][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6518.038267][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6518.038582][ C1] ? hlock_class+0x4e/0x130 [ 6518.038814][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6518.039093][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6518.039369][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6518.039634][ C1] ? hlock_class+0x4e/0x130 [ 6518.039866][ C1] ? mark_lock+0x38/0x3e0 [ 6518.040085][ C1] ? stack_access_ok+0xda/0x1f0 [ 6518.040335][ C1] ? __lock_acquire+0xb67/0x1610 [ 6518.040590][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6518.040866][ C1] ? get_stack_info+0x36/0xc0 [ 6518.041107][ C1] ? stack_access_ok+0xda/0x1f0 [ 6518.041355][ C1] ? get_reg+0x119/0x190 [ 6518.041572][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6518.041841][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6518.042152][ C1] __tcf_classify+0x329/0x7d0 [ 6518.042396][ C1] tcf_classify+0x283/0x930 [ 6518.042629][ C1] ? arch_stack_walk+0xa2/0x100 [ 6518.042876][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6518.043134][ C1] ? get_stack_info+0x36/0xc0 [ 6518.043375][ C1] tc_run+0x2e4/0x5d0 [ 6518.043580][ C1] ? __pfx_tc_run+0x10/0x10 [ 6518.043814][ C1] ? lock_acquire+0x1c1/0x220 [ 6518.044054][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6518.044316][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6518.044570][ C1] ? lock_acquire+0x1c1/0x220 [ 6518.044809][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6518.045075][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6518.045379][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6518.045655][ C1] ? neigh_hh_output+0x348/0x590 [ 6518.045907][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6518.046173][ C1] ip_finish_output2+0x786/0x18e0 [ 6518.046430][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6518.046707][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6518.047044][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6518.047322][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6518.047575][ C1] ? __ip_finish_output+0x10f/0x770 [ 6518.047842][ C1] ip_output+0x16b/0x4f0 [ 6518.048062][ C1] ? run_timer_softirq+0x72/0x100 [ 6518.048320][ C1] ? __pfx_ip_output+0x10/0x10 [ 6518.048565][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6518.048851][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6518.049103][ C1] ? ip_local_out+0x114/0x3b0 [ 6518.049344][ C1] __ip_queue_xmit+0x672/0x1910 [ 6518.049594][ C1] ? __create_object+0x5e/0xb0 [ 6518.049839][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6518.050107][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6518.050389][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6518.050661][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6518.050946][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6518.051219][ C1] tcp_delack_timer+0x84/0x240 [ 6518.051464][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6518.051736][ C1] call_timer_fn+0x173/0x430 [ 6518.051975][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6518.052238][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6518.052500][ C1] __run_timers.part.0+0x52d/0x890 [ 6518.052760][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6518.053034][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6518.053321][ C1] ? lock_acquire+0x1c1/0x220 [ 6518.053558][ C1] ? clockevents_program_event+0xf6/0x300 [ 6518.053851][ C1] ? lock_release+0x1d5/0x250 [ 6518.054093][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6518.054359][ C1] ? ktime_get+0xb3/0x190 [ 6518.054579][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6518.054878][ C1] run_timer_softirq+0x72/0x100 [ 6518.055127][ C1] __do_softirq+0x1b9/0x7ff [ 6518.055359][ C1] irq_exit_rcu+0x98/0xc0 [ 6518.055580][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6518.055866][ C1] [ 6518.056017][ C1] [ 6518.056169][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6518.056477][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6518.056802][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6518.057773][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6518.058086][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6518.058487][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6518.058885][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6518.059284][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6518.059686][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6518.060086][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6518.060382][ C1] pipe_read+0xa16/0xdf0 [ 6518.060604][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6518.060882][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6518.061127][ C1] ? iterate_tty_write+0x299/0x540 [ 6518.061389][ C1] ? lock_release+0x1d5/0x250 [ 6518.061631][ C1] vfs_read+0x911/0xc00 [ 6518.061845][ C1] ? lock_acquire+0x1c1/0x220 [ 6518.062085][ C1] ? __might_fault+0xc6/0x180 [ 6518.062327][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6518.062564][ C1] ? __might_fault+0xc6/0x180 [ 6518.062806][ C1] ? lock_release+0x1d5/0x250 [ 6518.063047][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6518.063313][ C1] ? __fget_light+0x54/0x1e0 [ 6518.063552][ C1] ksys_read+0x17a/0x1e0 [ 6518.063770][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6518.064016][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6518.064322][ C1] do_syscall_64+0xc9/0x1e0 [ 6518.064553][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6518.064854][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6518.065082][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6518.066058][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6518.066480][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6518.066880][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6518.067282][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6518.067682][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6518.068085][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6518.068489][ C1] [ 6518.068648][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6518.068922][ C2] NMI backtrace for cpu 2 [ 6518.068927][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6518.068933][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6518.068937][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6518.068945][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6518.068951][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6518.068954][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6518.068955][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6518.068957][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6518.068959][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6518.068960][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6518.068962][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6518.068964][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6518.068967][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6518.068969][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6518.068970][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6518.068971][ C2] PKRU: 55555554 [ 6518.068972][ C2] Call Trace: [ 6518.068974][ C2] [ 6518.068976][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6518.068982][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6518.068986][ C2] ? nmi_handle+0x153/0x420 [ 6518.068990][ C2] ? default_do_nmi+0x41/0x100 [ 6518.068993][ C2] ? exc_nmi+0xf3/0x120 [ 6518.068995][ C2] ? end_repeat_nmi+0xf/0x60 [ 6518.069000][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6518.069004][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6518.069007][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6518.069010][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6518.069013][ C2] [ 6518.069014][ C2] [ 6518.069015][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6518.069018][ C2] ? get_stack_info+0x36/0xc0 [ 6518.069022][ C2] ? lock_acquire+0x1c1/0x220 [ 6518.069026][ C2] ? lock_release+0x1d5/0x250 [ 6518.069029][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6518.069033][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6518.069036][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6518.069039][ C2] ? lock_acquire+0x1c1/0x220 [ 6518.069041][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6518.069045][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6518.069047][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6518.069054][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6518.069056][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6518.069061][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6518.069066][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6518.069069][ C2] ip_local_deliver+0x19d/0x480 [ 6518.069072][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6518.069074][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6518.069076][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6518.069081][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6518.069085][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6518.069088][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6518.069097][ C2] ip_rcv+0x564/0x740 [ 6518.069099][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6518.069102][ C2] ? set_track_prepare+0x8a/0xd0 [ 6518.069106][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6518.069109][ C2] ? start_secondary+0x21c/0x2b0 [ 6518.069112][ C2] ? skb_clone+0x10b/0x330 [ 6518.069114][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6518.069120][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6518.069125][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6518.069129][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6518.069137][ C2] ? __tcf_classify+0x329/0x7d0 [ 6518.069140][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6518.069143][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6518.069146][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6518.069149][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6518.069153][ C2] ? lock_acquire+0x1c1/0x220 [ 6518.069156][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6518.069160][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6518.069163][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6518.069167][ C2] ? __copy_skb_header+0xaf/0x490 [ 6518.069171][ C2] ? __skb_clone+0x57a/0x760 [ 6518.069173][ C2] netif_receive_skb+0x55/0x280 [ 6518.069177][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6518.069183][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6518.069190][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6518.069196][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6518.069200][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6518.069210][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6518.069217][ C2] ? get_stack_info+0x36/0xc0 [ 6518.069222][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6518.069225][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6518.069228][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6518.069231][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6518.069234][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6518.069236][ C2] ? kernel_text_address+0x17/0xe0 [ 6518.069240][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6518.069243][ C2] ? arch_stack_walk+0x8c/0x100 [ 6518.069246][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6518.069250][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6518.069253][ C2] ? lock_acquire+0x1c1/0x220 [ 6518.069255][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6518.069259][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6518.069263][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6518.069265][ C2] ? get_stack_info+0x36/0xc0 [ 6518.069270][ C2] __tcf_classify+0x329/0x7d0 [ 6518.069275][ C2] tcf_classify+0x283/0x930 [ 6518.069279][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6518.069282][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6518.069286][ C2] tc_run+0x2e4/0x5d0 [ 6518.069290][ C2] ? __pfx_tc_run+0x10/0x10 [ 6518.069292][ C2] ? lock_acquire+0x1c1/0x220 [ 6518.069295][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6518.069299][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6518.069302][ C2] ? lock_acquire+0x1c1/0x220 [ 6518.069304][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6518.069307][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6518.069310][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6518.069313][ C2] ? neigh_hh_output+0x348/0x590 [ 6518.069317][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6518.069320][ C2] ip_finish_output2+0x786/0x18e0 [ 6518.069324][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6518.069331][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6518.069334][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6518.069338][ C2] ? __ip_finish_output+0x10f/0x770 [ 6518.069341][ C2] ip_output+0x16b/0x4f0 [ 6518.069344][ C2] ? __pfx_ip_output+0x10/0x10 [ 6518.069347][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6518.069350][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6518.069353][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6518.069356][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6518.069358][ C2] ? __alloc_skb+0xd4/0x280 [ 6518.069361][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6518.069364][ C2] ? tcp_fragment+0x168/0x1040 [ 6518.069368][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6518.069370][ C2] ? ip_local_out+0x114/0x3b0 [ 6518.069374][ C2] __ip_queue_xmit+0x672/0x1910 [ 6518.069378][ C2] ? __skb_clone+0x57a/0x760 [ 6518.069381][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6518.069386][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6518.069389][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6518.069393][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6518.069397][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6518.069400][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6518.069403][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6518.069407][ C2] tcp_send_loss_probe+0x348/0x830 [ 6518.069410][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6518.069412][ C2] tcp_write_timer+0x82/0x1d0 [ 6518.069415][ C2] call_timer_fn+0x173/0x430 [ 6518.069419][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6518.069424][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6518.069428][ C2] __run_timers.part.0+0x52d/0x890 [ 6518.069430][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6518.069434][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6518.069437][ C2] ? lock_acquire+0x1c1/0x220 [ 6518.069439][ C2] ? clockevents_program_event+0xf6/0x300 [ 6518.069443][ C2] ? lock_release+0x1d5/0x250 [ 6518.069446][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6518.069449][ C2] ? ktime_get+0xb3/0x190 [ 6518.069452][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6518.069456][ C2] run_timer_softirq+0x72/0x100 [ 6518.069459][ C2] __do_softirq+0x1b9/0x7ff [ 6518.069464][ C2] irq_exit_rcu+0x98/0xc0 [ 6518.069466][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6518.069469][ C2] [ 6518.069470][ C2] [ 6518.069471][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6518.069474][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6518.069477][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6518.069479][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6518.069481][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6518.069483][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6518.069484][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6518.069486][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6518.069487][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6518.069490][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6518.069493][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6518.069496][ C2] default_idle_call+0x69/0xa0 [ 6518.069499][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6518.069501][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6518.069505][ C2] ? lock_release+0x1d5/0x250 [ 6518.069508][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6518.069511][ C2] do_idle+0xfb/0x160 [ 6518.069514][ C2] cpu_startup_entry+0x55/0x60 [ 6518.069516][ C2] start_secondary+0x21c/0x2b0 [ 6518.069519][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6518.069523][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6518.069529][ C2] [ 6544.569279][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3904s! [perl:4135] [ 6544.569683][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6544.570909][ C1] irq event stamp: 209232 [ 6544.571124][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6544.571639][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6544.572101][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6544.572558][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6544.573008][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6544.573445][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6544.574040][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6544.574355][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6544.575302][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6544.575600][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6544.575989][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6544.576379][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6544.576766][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6544.577154][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6544.577543][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6544.577998][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6544.578330][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6544.578733][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6544.579131][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6544.579533][ C1] PKRU: 55555554 [ 6544.579709][ C1] Call Trace: [ 6544.579874][ C1] [ 6544.580018][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6544.580278][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6544.580514][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6544.580786][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6544.581051][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6544.581331][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6544.581589][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6544.581887][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6544.582142][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6544.582443][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6544.582732][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6544.583038][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6544.583320][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6544.583608][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6544.583888][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6544.584192][ C1] ? get_stack_info+0x36/0xc0 [ 6544.584427][ C1] ? lock_acquire+0x1c1/0x220 [ 6544.584661][ C1] ? lock_release+0x1d5/0x250 [ 6544.584892][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6544.585136][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6544.585422][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6544.585707][ C1] ? lock_acquire+0x1c1/0x220 [ 6544.585947][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6544.586187][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6544.586447][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6544.586688][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6544.586928][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6544.587180][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6544.587446][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6544.587718][ C1] ip_local_deliver+0x19d/0x480 [ 6544.587978][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6544.588251][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6544.588515][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6544.588861][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6544.589113][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6544.589435][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6544.589689][ C1] ip_rcv+0x564/0x740 [ 6544.589887][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6544.590114][ C1] ? set_track_prepare+0x8a/0xd0 [ 6544.590360][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6544.590629][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6544.590895][ C1] ? skb_clone+0x10b/0x330 [ 6544.591117][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6544.591428][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6544.591728][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6544.592001][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6544.592289][ C1] ? __tcf_classify+0x329/0x7d0 [ 6544.592530][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6544.592756][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6544.593049][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6544.593327][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6544.593644][ C1] ? lock_acquire+0x1c1/0x220 [ 6544.593876][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6544.594166][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6544.594444][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6544.594752][ C1] ? __copy_skb_header+0xaf/0x490 [ 6544.595003][ C1] ? __skb_clone+0x57a/0x760 [ 6544.595233][ C1] netif_receive_skb+0x55/0x280 [ 6544.595474][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6544.595777][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6544.596103][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6544.596394][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6544.596661][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6544.596944][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6544.597248][ C1] ? hlock_class+0x4e/0x130 [ 6544.597474][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6544.597743][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6544.598035][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6544.598299][ C1] ? hlock_class+0x4e/0x130 [ 6544.598531][ C1] ? mark_lock+0x38/0x3e0 [ 6544.598750][ C1] ? stack_access_ok+0xda/0x1f0 [ 6544.598999][ C1] ? __lock_acquire+0xb67/0x1610 [ 6544.599262][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6544.599530][ C1] ? get_stack_info+0x36/0xc0 [ 6544.599765][ C1] ? stack_access_ok+0xda/0x1f0 [ 6544.600006][ C1] ? get_reg+0x119/0x190 [ 6544.600215][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6544.600475][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6544.600777][ C1] __tcf_classify+0x329/0x7d0 [ 6544.601012][ C1] tcf_classify+0x283/0x930 [ 6544.601238][ C1] ? arch_stack_walk+0xa2/0x100 [ 6544.601479][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6544.601729][ C1] ? get_stack_info+0x36/0xc0 [ 6544.601964][ C1] tc_run+0x2e4/0x5d0 [ 6544.602163][ C1] ? __pfx_tc_run+0x10/0x10 [ 6544.602390][ C1] ? lock_acquire+0x1c1/0x220 [ 6544.602623][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6544.602878][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6544.603123][ C1] ? lock_acquire+0x1c1/0x220 [ 6544.603355][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6544.603614][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6544.603909][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6544.604176][ C1] ? neigh_hh_output+0x348/0x590 [ 6544.604421][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6544.604679][ C1] ip_finish_output2+0x786/0x18e0 [ 6544.604928][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6544.605200][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6544.605530][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6544.605799][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6544.606044][ C1] ? __ip_finish_output+0x10f/0x770 [ 6544.606304][ C1] ip_output+0x16b/0x4f0 [ 6544.606515][ C1] ? run_timer_softirq+0x72/0x100 [ 6544.606766][ C1] ? __pfx_ip_output+0x10/0x10 [ 6544.607004][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6544.607282][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6544.607528][ C1] ? ip_local_out+0x114/0x3b0 [ 6544.607762][ C1] __ip_queue_xmit+0x672/0x1910 [ 6544.608025][ C1] ? __create_object+0x5e/0xb0 [ 6544.608269][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6544.608537][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6544.608818][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6544.609090][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6544.609378][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6544.609642][ C1] tcp_delack_timer+0x84/0x240 [ 6544.609880][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6544.610145][ C1] call_timer_fn+0x173/0x430 [ 6544.610375][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6544.610630][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6544.610884][ C1] __run_timers.part.0+0x52d/0x890 [ 6544.611138][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6544.611404][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6544.611682][ C1] ? lock_acquire+0x1c1/0x220 [ 6544.611914][ C1] ? clockevents_program_event+0xf6/0x300 [ 6544.612198][ C1] ? lock_release+0x1d5/0x250 [ 6544.612431][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6544.612689][ C1] ? ktime_get+0xb3/0x190 [ 6544.612904][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6544.613194][ C1] run_timer_softirq+0x72/0x100 [ 6544.613436][ C1] __do_softirq+0x1b9/0x7ff [ 6544.613664][ C1] irq_exit_rcu+0x98/0xc0 [ 6544.613879][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6544.614156][ C1] [ 6544.614304][ C1] [ 6544.614452][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6544.614748][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6544.615067][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6544.616011][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6544.616311][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6544.616700][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6544.617088][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6544.617475][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6544.617865][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6544.618282][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6544.618578][ C1] pipe_read+0xa16/0xdf0 [ 6544.618800][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6544.619076][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6544.619327][ C1] ? iterate_tty_write+0x299/0x540 [ 6544.619581][ C1] ? lock_release+0x1d5/0x250 [ 6544.619815][ C1] vfs_read+0x911/0xc00 [ 6544.620023][ C1] ? lock_acquire+0x1c1/0x220 [ 6544.620256][ C1] ? __might_fault+0xc6/0x180 [ 6544.620490][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6544.620721][ C1] ? __might_fault+0xc6/0x180 [ 6544.620955][ C1] ? lock_release+0x1d5/0x250 [ 6544.621189][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6544.621447][ C1] ? __fget_light+0x54/0x1e0 [ 6544.621678][ C1] ksys_read+0x17a/0x1e0 [ 6544.621888][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6544.622127][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6544.622424][ C1] do_syscall_64+0xc9/0x1e0 [ 6544.622649][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6544.622941][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6544.623162][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6544.624107][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6544.624517][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6544.624904][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6544.625294][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6544.625683][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6544.626070][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6544.626461][ C1] [ 6544.626616][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3904s! [swapper/2:0] [ 6544.627040][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6544.628307][ C2] irq event stamp: 44114564 [ 6544.628534][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6544.629064][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6544.629569][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6544.630028][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6544.630482][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6544.630922][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6544.631512][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6544.631825][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6544.632764][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6544.633059][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6544.633445][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6544.633830][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6544.634215][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6544.634599][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6544.634986][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6544.635417][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6544.635737][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6544.636122][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6544.636508][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6544.636893][ C2] PKRU: 55555554 [ 6544.637068][ C2] Call Trace: [ 6544.637230][ C2] [ 6544.637374][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6544.637626][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6544.637860][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6544.638154][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6544.638425][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6544.638711][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6544.638973][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6544.639284][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6544.639536][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6544.639790][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6544.640085][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6544.640372][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6544.640675][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6544.640955][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6544.641244][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6544.641522][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6544.641822][ C2] ? get_stack_info+0x36/0xc0 [ 6544.642056][ C2] ? lock_acquire+0x1c1/0x220 [ 6544.642288][ C2] ? lock_release+0x1d5/0x250 [ 6544.642520][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6544.642760][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6544.643024][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6544.643298][ C2] ? lock_acquire+0x1c1/0x220 [ 6544.643529][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6544.643762][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6544.644013][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6544.644238][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6544.644478][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6544.644727][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6544.644992][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6544.645261][ C2] ip_local_deliver+0x19d/0x480 [ 6544.645500][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6544.645761][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6544.646015][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6544.646350][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6544.646592][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6544.646902][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6544.647155][ C2] ip_rcv+0x564/0x740 [ 6544.647353][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6544.647575][ C2] ? set_track_prepare+0x8a/0xd0 [ 6544.647820][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6544.648111][ C2] ? start_secondary+0x21c/0x2b0 [ 6544.648359][ C2] ? skb_clone+0x10b/0x330 [ 6544.648586][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6544.648901][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6544.649216][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6544.649487][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6544.649769][ C2] ? __tcf_classify+0x329/0x7d0 [ 6544.650008][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6544.650233][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6544.650523][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6544.650797][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6544.651110][ C2] ? lock_acquire+0x1c1/0x220 [ 6544.651342][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6544.651628][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6544.651903][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6544.652208][ C2] ? __copy_skb_header+0xaf/0x490 [ 6544.652457][ C2] ? __skb_clone+0x57a/0x760 [ 6544.652684][ C2] netif_receive_skb+0x55/0x280 [ 6544.652922][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6544.653224][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6544.653546][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6544.653835][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6544.654098][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6544.654378][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6544.654679][ C2] ? get_stack_info+0x36/0xc0 [ 6544.654912][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6544.655166][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6544.655472][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6544.655740][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6544.656007][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6544.656311][ C2] ? kernel_text_address+0x17/0xe0 [ 6544.656562][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6544.656865][ C2] ? arch_stack_walk+0x8c/0x100 [ 6544.657105][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6544.657359][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6544.657633][ C2] ? lock_acquire+0x1c1/0x220 [ 6544.657864][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6544.658158][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6544.658460][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6544.658735][ C2] ? get_stack_info+0x36/0xc0 [ 6544.658974][ C2] __tcf_classify+0x329/0x7d0 [ 6544.659223][ C2] tcf_classify+0x283/0x930 [ 6544.659448][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6544.659695][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6544.659996][ C2] tc_run+0x2e4/0x5d0 [ 6544.660195][ C2] ? __pfx_tc_run+0x10/0x10 [ 6544.660416][ C2] ? lock_acquire+0x1c1/0x220 [ 6544.660647][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6544.660898][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6544.661143][ C2] ? lock_acquire+0x1c1/0x220 [ 6544.661373][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6544.661629][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6544.661922][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6544.662184][ C2] ? neigh_hh_output+0x348/0x590 [ 6544.662428][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6544.662684][ C2] ip_finish_output2+0x786/0x18e0 [ 6544.662932][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6544.663257][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6544.663523][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6544.663766][ C2] ? __ip_finish_output+0x10f/0x770 [ 6544.664024][ C2] ip_output+0x16b/0x4f0 [ 6544.664235][ C2] ? __pfx_ip_output+0x10/0x10 [ 6544.664470][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6544.664737][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6544.665038][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6544.665305][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6544.665546][ C2] ? __alloc_skb+0xd4/0x280 [ 6544.665769][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6544.666028][ C2] ? tcp_fragment+0x168/0x1040 [ 6544.666264][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6544.666509][ C2] ? ip_local_out+0x114/0x3b0 [ 6544.666739][ C2] __ip_queue_xmit+0x672/0x1910 [ 6544.666978][ C2] ? __skb_clone+0x57a/0x760 [ 6544.667206][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6544.667463][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6544.667734][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6544.667990][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6544.668237][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6544.668535][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6544.668852][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6544.669094][ C2] tcp_send_loss_probe+0x348/0x830 [ 6544.669352][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6544.669617][ C2] tcp_write_timer+0x82/0x1d0 [ 6544.669859][ C2] call_timer_fn+0x173/0x430 [ 6544.670084][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6544.670338][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6544.670590][ C2] __run_timers.part.0+0x52d/0x890 [ 6544.670841][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6544.671102][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6544.671375][ C2] ? lock_acquire+0x1c1/0x220 [ 6544.671606][ C2] ? clockevents_program_event+0xf6/0x300 [ 6544.671885][ C2] ? lock_release+0x1d5/0x250 [ 6544.672118][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6544.672373][ C2] ? ktime_get+0xb3/0x190 [ 6544.672588][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6544.672871][ C2] run_timer_softirq+0x72/0x100 [ 6544.673112][ C2] __do_softirq+0x1b9/0x7ff [ 6544.673339][ C2] irq_exit_rcu+0x98/0xc0 [ 6544.673550][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6544.673826][ C2] [ 6544.673971][ C2] [ 6544.674119][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6544.674411][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6544.674658][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6544.675591][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6544.675888][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6544.676272][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6544.676657][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6544.677040][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6544.677422][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6544.677807][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6544.678109][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6544.678367][ C2] default_idle_call+0x69/0xa0 [ 6544.678609][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6544.678858][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6544.679132][ C2] ? lock_release+0x1d5/0x250 [ 6544.679374][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6544.679636][ C2] do_idle+0xfb/0x160 [ 6544.679832][ C2] cpu_startup_entry+0x55/0x60 [ 6544.680067][ C2] start_secondary+0x21c/0x2b0 [ 6544.680303][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6544.680562][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6544.680862][ C2] [ 6572.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3930s! [perl:4135] [ 6572.569674][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6572.570893][ C1] irq event stamp: 209232 [ 6572.571104][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6572.571616][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6572.572083][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6572.572539][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6572.572986][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6572.573423][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6572.574020][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6572.574336][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6572.575280][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6572.575580][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6572.575968][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6572.576356][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6572.576746][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6572.577135][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6572.577523][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6572.577982][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6572.578314][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6572.578716][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6572.579124][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6572.579511][ C1] PKRU: 55555554 [ 6572.579689][ C1] Call Trace: [ 6572.579856][ C1] [ 6572.579998][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6572.580253][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6572.580491][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6572.580760][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6572.581026][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6572.581307][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6572.581565][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6572.581863][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6572.582119][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6572.582420][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6572.582706][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6572.583013][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6572.583297][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6572.583583][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6572.583869][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6572.584173][ C1] ? get_stack_info+0x36/0xc0 [ 6572.584407][ C1] ? lock_acquire+0x1c1/0x220 [ 6572.584641][ C1] ? lock_release+0x1d5/0x250 [ 6572.584875][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6572.585118][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6572.585383][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6572.585662][ C1] ? lock_acquire+0x1c1/0x220 [ 6572.585893][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6572.586129][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6572.586382][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6572.586611][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6572.586852][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6572.587103][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6572.587371][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6572.587641][ C1] ip_local_deliver+0x19d/0x480 [ 6572.587904][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6572.588175][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6572.588443][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6572.588794][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6572.589057][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6572.589369][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6572.589626][ C1] ip_rcv+0x564/0x740 [ 6572.589824][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6572.590049][ C1] ? set_track_prepare+0x8a/0xd0 [ 6572.590296][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6572.590567][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6572.590832][ C1] ? skb_clone+0x10b/0x330 [ 6572.591054][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6572.591365][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6572.591662][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6572.591938][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6572.592225][ C1] ? __tcf_classify+0x329/0x7d0 [ 6572.592467][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6572.592693][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6572.592983][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6572.593264][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6572.593581][ C1] ? lock_acquire+0x1c1/0x220 [ 6572.593814][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6572.594102][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6572.594381][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6572.594690][ C1] ? __copy_skb_header+0xaf/0x490 [ 6572.594940][ C1] ? __skb_clone+0x57a/0x760 [ 6572.595168][ C1] netif_receive_skb+0x55/0x280 [ 6572.595411][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6572.595717][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6572.596040][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6572.596332][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6572.596600][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6572.596880][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6572.597185][ C1] ? hlock_class+0x4e/0x130 [ 6572.597413][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6572.597682][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6572.597987][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6572.598253][ C1] ? hlock_class+0x4e/0x130 [ 6572.598483][ C1] ? mark_lock+0x38/0x3e0 [ 6572.598704][ C1] ? stack_access_ok+0xda/0x1f0 [ 6572.598952][ C1] ? __lock_acquire+0xb67/0x1610 [ 6572.599212][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6572.599483][ C1] ? get_stack_info+0x36/0xc0 [ 6572.599716][ C1] ? stack_access_ok+0xda/0x1f0 [ 6572.599956][ C1] ? get_reg+0x119/0x190 [ 6572.600169][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6572.600433][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6572.600735][ C1] __tcf_classify+0x329/0x7d0 [ 6572.600970][ C1] tcf_classify+0x283/0x930 [ 6572.601196][ C1] ? arch_stack_walk+0xa2/0x100 [ 6572.601439][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6572.601689][ C1] ? get_stack_info+0x36/0xc0 [ 6572.601925][ C1] tc_run+0x2e4/0x5d0 [ 6572.602125][ C1] ? __pfx_tc_run+0x10/0x10 [ 6572.602350][ C1] ? lock_acquire+0x1c1/0x220 [ 6572.602582][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6572.602836][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6572.603083][ C1] ? lock_acquire+0x1c1/0x220 [ 6572.603316][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6572.603574][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6572.603870][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6572.604136][ C1] ? neigh_hh_output+0x348/0x590 [ 6572.604382][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6572.604639][ C1] ip_finish_output2+0x786/0x18e0 [ 6572.604889][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6572.605160][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6572.605489][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6572.605758][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6572.606005][ C1] ? __ip_finish_output+0x10f/0x770 [ 6572.606264][ C1] ip_output+0x16b/0x4f0 [ 6572.606475][ C1] ? run_timer_softirq+0x72/0x100 [ 6572.606725][ C1] ? __pfx_ip_output+0x10/0x10 [ 6572.606962][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6572.607244][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6572.607489][ C1] ? ip_local_out+0x114/0x3b0 [ 6572.607722][ C1] __ip_queue_xmit+0x672/0x1910 [ 6572.607987][ C1] ? __create_object+0x5e/0xb0 [ 6572.608233][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6572.608499][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6572.608785][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6572.609070][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6572.609343][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6572.609608][ C1] tcp_delack_timer+0x84/0x240 [ 6572.609845][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6572.610110][ C1] call_timer_fn+0x173/0x430 [ 6572.610339][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6572.610597][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6572.610851][ C1] __run_timers.part.0+0x52d/0x890 [ 6572.611108][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6572.611377][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6572.611654][ C1] ? lock_acquire+0x1c1/0x220 [ 6572.611887][ C1] ? clockevents_program_event+0xf6/0x300 [ 6572.612169][ C1] ? lock_release+0x1d5/0x250 [ 6572.612403][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6572.612660][ C1] ? ktime_get+0xb3/0x190 [ 6572.612877][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6572.613165][ C1] run_timer_softirq+0x72/0x100 [ 6572.613407][ C1] __do_softirq+0x1b9/0x7ff [ 6572.613635][ C1] irq_exit_rcu+0x98/0xc0 [ 6572.613849][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6572.614129][ C1] [ 6572.614275][ C1] [ 6572.614420][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6572.614718][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6572.615033][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6572.615981][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6572.616282][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6572.616670][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6572.617060][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6572.617449][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6572.617858][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6572.618259][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6572.618557][ C1] pipe_read+0xa16/0xdf0 [ 6572.618777][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6572.619066][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6572.619303][ C1] ? iterate_tty_write+0x299/0x540 [ 6572.619558][ C1] ? lock_release+0x1d5/0x250 [ 6572.619790][ C1] vfs_read+0x911/0xc00 [ 6572.620001][ C1] ? lock_acquire+0x1c1/0x220 [ 6572.620235][ C1] ? __might_fault+0xc6/0x180 [ 6572.620469][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6572.620703][ C1] ? __might_fault+0xc6/0x180 [ 6572.620937][ C1] ? lock_release+0x1d5/0x250 [ 6572.621170][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6572.621429][ C1] ? __fget_light+0x54/0x1e0 [ 6572.621659][ C1] ksys_read+0x17a/0x1e0 [ 6572.621872][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6572.622110][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6572.622406][ C1] do_syscall_64+0xc9/0x1e0 [ 6572.622634][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6572.622926][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6572.623147][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6572.624093][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6572.624505][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6572.624894][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6572.625282][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6572.625672][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6572.626060][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6572.626452][ C1] [ 6572.626606][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3930s! [swapper/2:0] [ 6572.627005][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6572.628245][ C2] irq event stamp: 44114564 [ 6572.628473][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6572.629004][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6572.629506][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6572.629964][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6572.630421][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6572.630861][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6572.631450][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6572.631766][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6572.632707][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6572.633002][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6572.633390][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6572.633774][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6572.634160][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6572.634544][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6572.634936][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6572.635368][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6572.635688][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6572.636075][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6572.636462][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6572.636851][ C2] PKRU: 55555554 [ 6572.637026][ C2] Call Trace: [ 6572.637190][ C2] [ 6572.637334][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6572.637587][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6572.637823][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6572.638115][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6572.638385][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6572.638671][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6572.638934][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6572.639243][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6572.639496][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6572.639750][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6572.640047][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6572.640335][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6572.640639][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6572.640917][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6572.641205][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6572.641482][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6572.641783][ C2] ? get_stack_info+0x36/0xc0 [ 6572.642017][ C2] ? lock_acquire+0x1c1/0x220 [ 6572.642250][ C2] ? lock_release+0x1d5/0x250 [ 6572.642481][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6572.642720][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6572.642984][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6572.643259][ C2] ? lock_acquire+0x1c1/0x220 [ 6572.643490][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6572.643723][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6572.643975][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6572.644200][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6572.644439][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6572.644688][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6572.644953][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6572.645222][ C2] ip_local_deliver+0x19d/0x480 [ 6572.645462][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6572.645724][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6572.645978][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6572.646312][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6572.646556][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6572.646865][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6572.647119][ C2] ip_rcv+0x564/0x740 [ 6572.647316][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6572.647540][ C2] ? set_track_prepare+0x8a/0xd0 [ 6572.647783][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6572.648076][ C2] ? start_secondary+0x21c/0x2b0 [ 6572.648327][ C2] ? skb_clone+0x10b/0x330 [ 6572.648553][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6572.648870][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6572.649182][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6572.649452][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6572.649736][ C2] ? __tcf_classify+0x329/0x7d0 [ 6572.649977][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6572.650201][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6572.650492][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6572.650767][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6572.651080][ C2] ? lock_acquire+0x1c1/0x220 [ 6572.651316][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6572.651602][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6572.651878][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6572.652186][ C2] ? __copy_skb_header+0xaf/0x490 [ 6572.652435][ C2] ? __skb_clone+0x57a/0x760 [ 6572.652661][ C2] netif_receive_skb+0x55/0x280 [ 6572.652900][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6572.653202][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6572.653522][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6572.653814][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6572.654077][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6572.654357][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6572.654658][ C2] ? get_stack_info+0x36/0xc0 [ 6572.654891][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6572.655146][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6572.655453][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6572.655721][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6572.655989][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6572.656294][ C2] ? kernel_text_address+0x17/0xe0 [ 6572.656546][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6572.656849][ C2] ? arch_stack_walk+0x8c/0x100 [ 6572.657089][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6572.657345][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6572.657618][ C2] ? lock_acquire+0x1c1/0x220 [ 6572.657872][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6572.658150][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6572.658452][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6572.658725][ C2] ? get_stack_info+0x36/0xc0 [ 6572.658966][ C2] __tcf_classify+0x329/0x7d0 [ 6572.659214][ C2] tcf_classify+0x283/0x930 [ 6572.659438][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6572.659686][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6572.659987][ C2] tc_run+0x2e4/0x5d0 [ 6572.660188][ C2] ? __pfx_tc_run+0x10/0x10 [ 6572.660411][ C2] ? lock_acquire+0x1c1/0x220 [ 6572.660642][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6572.660894][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6572.661140][ C2] ? lock_acquire+0x1c1/0x220 [ 6572.661371][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6572.661626][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6572.661919][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6572.662183][ C2] ? neigh_hh_output+0x348/0x590 [ 6572.662427][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6572.662685][ C2] ip_finish_output2+0x786/0x18e0 [ 6572.662934][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6572.663260][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6572.663526][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6572.663771][ C2] ? __ip_finish_output+0x10f/0x770 [ 6572.664027][ C2] ip_output+0x16b/0x4f0 [ 6572.664239][ C2] ? __pfx_ip_output+0x10/0x10 [ 6572.664474][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6572.664742][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6572.665044][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6572.665310][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6572.665553][ C2] ? __alloc_skb+0xd4/0x280 [ 6572.665776][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6572.666036][ C2] ? tcp_fragment+0x168/0x1040 [ 6572.666272][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6572.666516][ C2] ? ip_local_out+0x114/0x3b0 [ 6572.666745][ C2] __ip_queue_xmit+0x672/0x1910 [ 6572.666985][ C2] ? __skb_clone+0x57a/0x760 [ 6572.667214][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6572.667471][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6572.667741][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6572.668000][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6572.668247][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6572.668546][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6572.668865][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6572.669108][ C2] tcp_send_loss_probe+0x348/0x830 [ 6572.669367][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6572.669633][ C2] tcp_write_timer+0x82/0x1d0 [ 6572.669872][ C2] call_timer_fn+0x173/0x430 [ 6572.670110][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6572.670363][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6572.670616][ C2] __run_timers.part.0+0x52d/0x890 [ 6572.670868][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6572.671130][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6572.671405][ C2] ? lock_acquire+0x1c1/0x220 [ 6572.671635][ C2] ? clockevents_program_event+0xf6/0x300 [ 6572.671915][ C2] ? lock_release+0x1d5/0x250 [ 6572.672147][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6572.672405][ C2] ? ktime_get+0xb3/0x190 [ 6572.672621][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6572.672905][ C2] run_timer_softirq+0x72/0x100 [ 6572.673146][ C2] __do_softirq+0x1b9/0x7ff [ 6572.673373][ C2] irq_exit_rcu+0x98/0xc0 [ 6572.673584][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6572.673861][ C2] [ 6572.674005][ C2] [ 6572.674151][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6572.674443][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6572.674692][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6572.675628][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6572.675926][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6572.676310][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6572.676697][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6572.677082][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6572.677466][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6572.677872][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6572.678161][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6572.678420][ C2] default_idle_call+0x69/0xa0 [ 6572.678661][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6572.678911][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6572.679194][ C2] ? lock_release+0x1d5/0x250 [ 6572.679425][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6572.679689][ C2] do_idle+0xfb/0x160 [ 6572.679885][ C2] cpu_startup_entry+0x55/0x60 [ 6572.680120][ C2] start_secondary+0x21c/0x2b0 [ 6572.680359][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6572.680618][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6572.680919][ C2] [ 6596.069112][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6596.069458][ C1] rcu: 1-....: (4230785 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1037125 [ 6596.070000][ C1] rcu: (t=4241182 jiffies g=1882453 q=718 ncpus=4) [ 6596.070324][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6596.070760][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6596.071355][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 6596.071668][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 6596.072610][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6596.072909][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6596.073296][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6596.073684][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6596.074073][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6596.074461][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6596.074847][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6596.075282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6596.075605][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6596.075996][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6596.076383][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6596.076770][ C1] PKRU: 55555554 [ 6596.076947][ C1] Call Trace: [ 6596.077112][ C1] [ 6596.077255][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6596.077519][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6596.077785][ C1] ? check_cpu_stall+0x284/0x500 [ 6596.078037][ C1] ? rcu_pending+0x92/0x360 [ 6596.078267][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6596.078535][ C1] ? update_process_times+0xb9/0x110 [ 6596.078803][ C1] ? tick_sched_handle+0x67/0x130 [ 6596.079065][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6596.079343][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6596.079579][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6596.079881][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6596.080149][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6596.080429][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6596.080685][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6596.080983][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6596.081238][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6596.081538][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6596.081825][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6596.082130][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6596.082414][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 6596.082693][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6596.082976][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6596.083280][ C1] ? get_stack_info+0x36/0xc0 [ 6596.083513][ C1] ? lock_acquire+0x1c1/0x220 [ 6596.083745][ C1] ? lock_release+0x1d5/0x250 [ 6596.083979][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6596.084222][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6596.084486][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6596.084763][ C1] ? lock_acquire+0x1c1/0x220 [ 6596.084995][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6596.085229][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6596.085481][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6596.085710][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6596.085951][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6596.086202][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6596.086468][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6596.086737][ C1] ip_local_deliver+0x19d/0x480 [ 6596.086977][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6596.087240][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6596.087497][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6596.087859][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6596.088111][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6596.088431][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6596.088693][ C1] ip_rcv+0x564/0x740 [ 6596.088896][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6596.089133][ C1] ? set_track_prepare+0x8a/0xd0 [ 6596.089377][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6596.089647][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6596.089911][ C1] ? skb_clone+0x10b/0x330 [ 6596.090132][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6596.090443][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6596.090738][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6596.091013][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6596.091298][ C1] ? __tcf_classify+0x329/0x7d0 [ 6596.091540][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6596.091764][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6596.092054][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6596.092334][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6596.092650][ C1] ? lock_acquire+0x1c1/0x220 [ 6596.092883][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6596.093170][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6596.093449][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6596.093757][ C1] ? __copy_skb_header+0xaf/0x490 [ 6596.094007][ C1] ? __skb_clone+0x57a/0x760 [ 6596.094234][ C1] netif_receive_skb+0x55/0x280 [ 6596.094475][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6596.094779][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6596.095102][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6596.095394][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6596.095659][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6596.095938][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6596.096243][ C1] ? hlock_class+0x4e/0x130 [ 6596.096470][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6596.096738][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6596.097007][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6596.097264][ C1] ? hlock_class+0x4e/0x130 [ 6596.097487][ C1] ? mark_lock+0x38/0x3e0 [ 6596.097704][ C1] ? stack_access_ok+0xda/0x1f0 [ 6596.097966][ C1] ? __lock_acquire+0xb67/0x1610 [ 6596.098218][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6596.098496][ C1] ? get_stack_info+0x36/0xc0 [ 6596.098734][ C1] ? stack_access_ok+0xda/0x1f0 [ 6596.098988][ C1] ? get_reg+0x119/0x190 [ 6596.099201][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6596.099461][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6596.099763][ C1] __tcf_classify+0x329/0x7d0 [ 6596.099997][ C1] tcf_classify+0x283/0x930 [ 6596.100222][ C1] ? arch_stack_walk+0xa2/0x100 [ 6596.100464][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6596.100714][ C1] ? get_stack_info+0x36/0xc0 [ 6596.100949][ C1] tc_run+0x2e4/0x5d0 [ 6596.101148][ C1] ? __pfx_tc_run+0x10/0x10 [ 6596.101373][ C1] ? lock_acquire+0x1c1/0x220 [ 6596.101604][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6596.101859][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6596.102106][ C1] ? lock_acquire+0x1c1/0x220 [ 6596.102339][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6596.102596][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6596.102893][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6596.103157][ C1] ? neigh_hh_output+0x348/0x590 [ 6596.103402][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6596.103660][ C1] ip_finish_output2+0x786/0x18e0 [ 6596.103908][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6596.104179][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6596.104509][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6596.104776][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6596.105022][ C1] ? __ip_finish_output+0x10f/0x770 [ 6596.105279][ C1] ip_output+0x16b/0x4f0 [ 6596.105489][ C1] ? run_timer_softirq+0x72/0x100 [ 6596.105739][ C1] ? __pfx_ip_output+0x10/0x10 [ 6596.105974][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6596.106255][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6596.106501][ C1] ? ip_local_out+0x114/0x3b0 [ 6596.106733][ C1] __ip_queue_xmit+0x672/0x1910 [ 6596.106975][ C1] ? __create_object+0x5e/0xb0 [ 6596.107213][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6596.107471][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6596.107767][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6596.108039][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6596.108318][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6596.108591][ C1] tcp_delack_timer+0x84/0x240 [ 6596.108833][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6596.109112][ C1] call_timer_fn+0x173/0x430 [ 6596.109340][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6596.109596][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6596.109850][ C1] __run_timers.part.0+0x52d/0x890 [ 6596.110104][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6596.110372][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6596.110648][ C1] ? lock_acquire+0x1c1/0x220 [ 6596.110881][ C1] ? clockevents_program_event+0xf6/0x300 [ 6596.111161][ C1] ? lock_release+0x1d5/0x250 [ 6596.111394][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6596.111650][ C1] ? ktime_get+0xb3/0x190 [ 6596.111867][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6596.112154][ C1] run_timer_softirq+0x72/0x100 [ 6596.112396][ C1] __do_softirq+0x1b9/0x7ff [ 6596.112622][ C1] irq_exit_rcu+0x98/0xc0 [ 6596.112835][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6596.113115][ C1] [ 6596.113262][ C1] [ 6596.113408][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6596.113704][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6596.114018][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6596.114965][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6596.115265][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6596.115654][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6596.116043][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6596.116431][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6596.116816][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6596.117206][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6596.117495][ C1] pipe_read+0xa16/0xdf0 [ 6596.117712][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6596.118007][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6596.118250][ C1] ? iterate_tty_write+0x299/0x540 [ 6596.118513][ C1] ? lock_release+0x1d5/0x250 [ 6596.118751][ C1] vfs_read+0x911/0xc00 [ 6596.118978][ C1] ? lock_acquire+0x1c1/0x220 [ 6596.119209][ C1] ? __might_fault+0xc6/0x180 [ 6596.119443][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6596.119675][ C1] ? __might_fault+0xc6/0x180 [ 6596.119909][ C1] ? lock_release+0x1d5/0x250 [ 6596.120141][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6596.120401][ C1] ? __fget_light+0x54/0x1e0 [ 6596.120631][ C1] ksys_read+0x17a/0x1e0 [ 6596.120844][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6596.121081][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6596.121376][ C1] do_syscall_64+0xc9/0x1e0 [ 6596.121603][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6596.121893][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6596.122114][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6596.123058][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6596.123468][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6596.123856][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6596.124242][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6596.124630][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6596.125018][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6596.125408][ C1] [ 6596.125561][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6596.125825][ C2] NMI backtrace for cpu 2 [ 6596.125830][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6596.125835][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6596.125839][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6596.125847][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6596.125853][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6596.125857][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6596.125861][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6596.125865][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6596.125869][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6596.125872][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6596.125876][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6596.125881][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6596.125886][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6596.125890][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6596.125893][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6596.125896][ C2] PKRU: 55555554 [ 6596.125898][ C2] Call Trace: [ 6596.125901][ C2] [ 6596.125903][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6596.125915][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6596.125922][ C2] ? nmi_handle+0x153/0x420 [ 6596.125931][ C2] ? default_do_nmi+0x41/0x100 [ 6596.125938][ C2] ? exc_nmi+0xf3/0x120 [ 6596.125943][ C2] ? end_repeat_nmi+0xf/0x60 [ 6596.125955][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6596.125963][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6596.125970][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6596.125979][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6596.125986][ C2] [ 6596.125988][ C2] [ 6596.125991][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6596.125998][ C2] ? get_stack_info+0x36/0xc0 [ 6596.126006][ C2] ? lock_acquire+0x1c1/0x220 [ 6596.126014][ C2] ? lock_release+0x1d5/0x250 [ 6596.126022][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6596.126030][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6596.126037][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6596.126045][ C2] ? lock_acquire+0x1c1/0x220 [ 6596.126051][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6596.126059][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6596.126065][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6596.126081][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6596.126087][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6596.126098][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6596.126107][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6596.126115][ C2] ip_local_deliver+0x19d/0x480 [ 6596.126121][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6596.126126][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6596.126132][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6596.126143][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6596.126150][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6596.126157][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6596.126178][ C2] ip_rcv+0x564/0x740 [ 6596.126183][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6596.126190][ C2] ? set_track_prepare+0x8a/0xd0 [ 6596.126198][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6596.126205][ C2] ? start_secondary+0x21c/0x2b0 [ 6596.126211][ C2] ? skb_clone+0x10b/0x330 [ 6596.126216][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6596.126231][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6596.126245][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6596.126252][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6596.126272][ C2] ? __tcf_classify+0x329/0x7d0 [ 6596.126280][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6596.126286][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6596.126293][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6596.126301][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6596.126311][ C2] ? lock_acquire+0x1c1/0x220 [ 6596.126316][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6596.126327][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6596.126336][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6596.126345][ C2] ? __copy_skb_header+0xaf/0x490 [ 6596.126355][ C2] ? __skb_clone+0x57a/0x760 [ 6596.126360][ C2] netif_receive_skb+0x55/0x280 [ 6596.126368][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6596.126380][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6596.126386][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6596.126392][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6596.126396][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6596.126406][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6596.126413][ C2] ? get_stack_info+0x36/0xc0 [ 6596.126417][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6596.126420][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6596.126423][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6596.126425][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6596.126429][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6596.126431][ C2] ? kernel_text_address+0x17/0xe0 [ 6596.126434][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6596.126437][ C2] ? arch_stack_walk+0x8c/0x100 [ 6596.126440][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6596.126444][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6596.126447][ C2] ? lock_acquire+0x1c1/0x220 [ 6596.126449][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6596.126453][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6596.126457][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6596.126459][ C2] ? get_stack_info+0x36/0xc0 [ 6596.126464][ C2] __tcf_classify+0x329/0x7d0 [ 6596.126469][ C2] tcf_classify+0x283/0x930 [ 6596.126473][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6596.126476][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6596.126480][ C2] tc_run+0x2e4/0x5d0 [ 6596.126483][ C2] ? __pfx_tc_run+0x10/0x10 [ 6596.126486][ C2] ? lock_acquire+0x1c1/0x220 [ 6596.126488][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6596.126492][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6596.126496][ C2] ? lock_acquire+0x1c1/0x220 [ 6596.126498][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6596.126501][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6596.126504][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6596.126507][ C2] ? neigh_hh_output+0x348/0x590 [ 6596.126510][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6596.126513][ C2] ip_finish_output2+0x786/0x18e0 [ 6596.126517][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6596.126524][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6596.126526][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6596.126530][ C2] ? __ip_finish_output+0x10f/0x770 [ 6596.126533][ C2] ip_output+0x16b/0x4f0 [ 6596.126536][ C2] ? __pfx_ip_output+0x10/0x10 [ 6596.126539][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6596.126541][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6596.126544][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6596.126547][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6596.126549][ C2] ? __alloc_skb+0xd4/0x280 [ 6596.126552][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6596.126555][ C2] ? tcp_fragment+0x168/0x1040 [ 6596.126558][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6596.126561][ C2] ? ip_local_out+0x114/0x3b0 [ 6596.126564][ C2] __ip_queue_xmit+0x672/0x1910 [ 6596.126568][ C2] ? __skb_clone+0x57a/0x760 [ 6596.126571][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6596.126576][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6596.126579][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6596.126582][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6596.126586][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6596.126590][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6596.126593][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6596.126596][ C2] tcp_send_loss_probe+0x348/0x830 [ 6596.126599][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6596.126602][ C2] tcp_write_timer+0x82/0x1d0 [ 6596.126605][ C2] call_timer_fn+0x173/0x430 [ 6596.126609][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6596.126613][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6596.126617][ C2] __run_timers.part.0+0x52d/0x890 [ 6596.126620][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6596.126624][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6596.126627][ C2] ? lock_acquire+0x1c1/0x220 [ 6596.126629][ C2] ? clockevents_program_event+0xf6/0x300 [ 6596.126633][ C2] ? lock_release+0x1d5/0x250 [ 6596.126635][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6596.126638][ C2] ? ktime_get+0xb3/0x190 [ 6596.126642][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6596.126646][ C2] run_timer_softirq+0x72/0x100 [ 6596.126649][ C2] __do_softirq+0x1b9/0x7ff [ 6596.126653][ C2] irq_exit_rcu+0x98/0xc0 [ 6596.126655][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6596.126658][ C2] [ 6596.126659][ C2] [ 6596.126660][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6596.126663][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6596.126666][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6596.126669][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6596.126670][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6596.126672][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6596.126673][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6596.126674][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6596.126676][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6596.126679][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6596.126682][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6596.126685][ C2] default_idle_call+0x69/0xa0 [ 6596.126688][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6596.126690][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6596.126694][ C2] ? lock_release+0x1d5/0x250 [ 6596.126696][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6596.126700][ C2] do_idle+0xfb/0x160 [ 6596.126702][ C2] cpu_startup_entry+0x55/0x60 [ 6596.126704][ C2] start_secondary+0x21c/0x2b0 [ 6596.126707][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6596.126711][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6596.126716][ C2] [ 6620.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 3974s! [perl:4135] [ 6620.569688][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6620.570912][ C1] irq event stamp: 209232 [ 6620.571126][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6620.571641][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6620.572107][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6620.572564][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6620.573013][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6620.573450][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6620.574047][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6620.574364][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6620.575310][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6620.575609][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6620.575998][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6620.576386][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6620.576772][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6620.577164][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6620.577553][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6620.578016][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6620.578349][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6620.578749][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6620.579153][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6620.579540][ C1] PKRU: 55555554 [ 6620.579718][ C1] Call Trace: [ 6620.579883][ C1] [ 6620.580028][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6620.580283][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6620.580521][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6620.580790][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6620.581055][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6620.581338][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6620.581597][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6620.581896][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6620.582152][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6620.582452][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6620.582741][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6620.583048][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6620.583330][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6620.583618][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6620.583900][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6620.584202][ C1] ? get_stack_info+0x36/0xc0 [ 6620.584436][ C1] ? lock_acquire+0x1c1/0x220 [ 6620.584672][ C1] ? lock_release+0x1d5/0x250 [ 6620.584907][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6620.585153][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6620.585419][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6620.585696][ C1] ? lock_acquire+0x1c1/0x220 [ 6620.585930][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6620.586166][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6620.586419][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6620.586647][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6620.586887][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6620.587139][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6620.587412][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6620.587704][ C1] ip_local_deliver+0x19d/0x480 [ 6620.587952][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6620.588224][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6620.588487][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6620.588848][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6620.589093][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6620.589406][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6620.589665][ C1] ip_rcv+0x564/0x740 [ 6620.589866][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6620.590089][ C1] ? set_track_prepare+0x8a/0xd0 [ 6620.590338][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6620.590609][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6620.590875][ C1] ? skb_clone+0x10b/0x330 [ 6620.591095][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6620.591407][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6620.591706][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6620.591981][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6620.592269][ C1] ? __tcf_classify+0x329/0x7d0 [ 6620.592513][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6620.592740][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6620.593034][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6620.593313][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6620.593630][ C1] ? lock_acquire+0x1c1/0x220 [ 6620.593861][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6620.594153][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6620.594432][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6620.594740][ C1] ? __copy_skb_header+0xaf/0x490 [ 6620.594992][ C1] ? __skb_clone+0x57a/0x760 [ 6620.595222][ C1] netif_receive_skb+0x55/0x280 [ 6620.595465][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6620.595771][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6620.596096][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6620.596388][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6620.596656][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6620.596937][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6620.597242][ C1] ? hlock_class+0x4e/0x130 [ 6620.597471][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6620.597764][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6620.598039][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6620.598304][ C1] ? hlock_class+0x4e/0x130 [ 6620.598536][ C1] ? mark_lock+0x38/0x3e0 [ 6620.598755][ C1] ? stack_access_ok+0xda/0x1f0 [ 6620.599010][ C1] ? __lock_acquire+0xb67/0x1610 [ 6620.599258][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6620.599527][ C1] ? get_stack_info+0x36/0xc0 [ 6620.599761][ C1] ? stack_access_ok+0xda/0x1f0 [ 6620.600001][ C1] ? get_reg+0x119/0x190 [ 6620.600215][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6620.600477][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6620.600777][ C1] __tcf_classify+0x329/0x7d0 [ 6620.601012][ C1] tcf_classify+0x283/0x930 [ 6620.601240][ C1] ? arch_stack_walk+0xa2/0x100 [ 6620.601483][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6620.601734][ C1] ? get_stack_info+0x36/0xc0 [ 6620.601968][ C1] tc_run+0x2e4/0x5d0 [ 6620.602170][ C1] ? __pfx_tc_run+0x10/0x10 [ 6620.602394][ C1] ? lock_acquire+0x1c1/0x220 [ 6620.602627][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6620.602881][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6620.603129][ C1] ? lock_acquire+0x1c1/0x220 [ 6620.603362][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6620.603620][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6620.603919][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6620.604184][ C1] ? neigh_hh_output+0x348/0x590 [ 6620.604430][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6620.604689][ C1] ip_finish_output2+0x786/0x18e0 [ 6620.604939][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6620.605209][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6620.605540][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6620.605810][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6620.606057][ C1] ? __ip_finish_output+0x10f/0x770 [ 6620.606316][ C1] ip_output+0x16b/0x4f0 [ 6620.606526][ C1] ? run_timer_softirq+0x72/0x100 [ 6620.606775][ C1] ? __pfx_ip_output+0x10/0x10 [ 6620.607013][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6620.607292][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6620.607537][ C1] ? ip_local_out+0x114/0x3b0 [ 6620.607795][ C1] __ip_queue_xmit+0x672/0x1910 [ 6620.608044][ C1] ? __create_object+0x5e/0xb0 [ 6620.608289][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6620.608557][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6620.608848][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6620.609116][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6620.609391][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6620.609656][ C1] tcp_delack_timer+0x84/0x240 [ 6620.609894][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6620.610158][ C1] call_timer_fn+0x173/0x430 [ 6620.610390][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6620.610646][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6620.610900][ C1] __run_timers.part.0+0x52d/0x890 [ 6620.611154][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6620.611422][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6620.611701][ C1] ? lock_acquire+0x1c1/0x220 [ 6620.611934][ C1] ? clockevents_program_event+0xf6/0x300 [ 6620.612217][ C1] ? lock_release+0x1d5/0x250 [ 6620.612451][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6620.612709][ C1] ? ktime_get+0xb3/0x190 [ 6620.612925][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6620.613215][ C1] run_timer_softirq+0x72/0x100 [ 6620.613457][ C1] __do_softirq+0x1b9/0x7ff [ 6620.613684][ C1] irq_exit_rcu+0x98/0xc0 [ 6620.613899][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6620.614178][ C1] [ 6620.614326][ C1] [ 6620.614472][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6620.614769][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6620.615088][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6620.616035][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6620.616335][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6620.616724][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6620.617112][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6620.617502][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6620.617917][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6620.618318][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6620.618616][ C1] pipe_read+0xa16/0xdf0 [ 6620.618845][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6620.619115][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6620.619352][ C1] ? iterate_tty_write+0x299/0x540 [ 6620.619606][ C1] ? lock_release+0x1d5/0x250 [ 6620.619842][ C1] vfs_read+0x911/0xc00 [ 6620.620051][ C1] ? lock_acquire+0x1c1/0x220 [ 6620.620283][ C1] ? __might_fault+0xc6/0x180 [ 6620.620519][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6620.620753][ C1] ? __might_fault+0xc6/0x180 [ 6620.620985][ C1] ? lock_release+0x1d5/0x250 [ 6620.621218][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6620.621475][ C1] ? __fget_light+0x54/0x1e0 [ 6620.621708][ C1] ksys_read+0x17a/0x1e0 [ 6620.621919][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6620.622159][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6620.622455][ C1] do_syscall_64+0xc9/0x1e0 [ 6620.622682][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6620.622973][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6620.623196][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6620.624142][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6620.624551][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6620.624941][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6620.625331][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6620.625719][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6620.626108][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6620.626500][ C1] [ 6620.626652][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 3974s! [swapper/2:0] [ 6620.627054][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6620.628296][ C2] irq event stamp: 44114564 [ 6620.628523][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6620.629056][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6620.629547][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6620.630007][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6620.630460][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6620.630900][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6620.631490][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 6620.631799][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 6620.632736][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6620.633030][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6620.633418][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6620.633803][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6620.634187][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6620.634570][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6620.634957][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6620.635387][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6620.635708][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6620.636093][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6620.636478][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6620.636863][ C2] PKRU: 55555554 [ 6620.637038][ C2] Call Trace: [ 6620.637201][ C2] [ 6620.637344][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6620.637599][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6620.637854][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6620.638129][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6620.638399][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6620.638684][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6620.638955][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6620.639249][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6620.639502][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6620.639756][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6620.640052][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6620.640338][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6620.640642][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6620.640918][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 6620.641202][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6620.641479][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6620.641781][ C2] ? get_stack_info+0x36/0xc0 [ 6620.642013][ C2] ? lock_acquire+0x1c1/0x220 [ 6620.642246][ C2] ? lock_release+0x1d5/0x250 [ 6620.642477][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6620.642716][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6620.642983][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6620.643259][ C2] ? lock_acquire+0x1c1/0x220 [ 6620.643489][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6620.643720][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6620.643972][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6620.644198][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6620.644436][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6620.644687][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6620.644951][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6620.645221][ C2] ip_local_deliver+0x19d/0x480 [ 6620.645458][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6620.645722][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6620.645979][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6620.646313][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6620.646558][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6620.646865][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6620.647118][ C2] ip_rcv+0x564/0x740 [ 6620.647314][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6620.647538][ C2] ? set_track_prepare+0x8a/0xd0 [ 6620.647807][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6620.648079][ C2] ? start_secondary+0x21c/0x2b0 [ 6620.648328][ C2] ? skb_clone+0x10b/0x330 [ 6620.648553][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6620.648879][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6620.649172][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6620.649445][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6620.649727][ C2] ? __tcf_classify+0x329/0x7d0 [ 6620.649966][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6620.650189][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6620.650478][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6620.650753][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6620.651066][ C2] ? lock_acquire+0x1c1/0x220 [ 6620.651298][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6620.651582][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6620.651858][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6620.652165][ C2] ? __copy_skb_header+0xaf/0x490 [ 6620.652413][ C2] ? __skb_clone+0x57a/0x760 [ 6620.652638][ C2] netif_receive_skb+0x55/0x280 [ 6620.652877][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6620.653179][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6620.653498][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6620.653788][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6620.654053][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6620.654331][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6620.654632][ C2] ? get_stack_info+0x36/0xc0 [ 6620.654866][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6620.655119][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6620.655425][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6620.655691][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6620.655960][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6620.656267][ C2] ? kernel_text_address+0x17/0xe0 [ 6620.656518][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6620.656819][ C2] ? arch_stack_walk+0x8c/0x100 [ 6620.657058][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6620.657314][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6620.657593][ C2] ? lock_acquire+0x1c1/0x220 [ 6620.657846][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6620.658123][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6620.658424][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6620.658696][ C2] ? get_stack_info+0x36/0xc0 [ 6620.658944][ C2] __tcf_classify+0x329/0x7d0 [ 6620.659178][ C2] tcf_classify+0x283/0x930 [ 6620.659400][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6620.659647][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6620.659949][ C2] tc_run+0x2e4/0x5d0 [ 6620.660147][ C2] ? __pfx_tc_run+0x10/0x10 [ 6620.660371][ C2] ? lock_acquire+0x1c1/0x220 [ 6620.660602][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6620.660853][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6620.661098][ C2] ? lock_acquire+0x1c1/0x220 [ 6620.661329][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6620.661584][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6620.661878][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6620.662142][ C2] ? neigh_hh_output+0x348/0x590 [ 6620.662386][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6620.662642][ C2] ip_finish_output2+0x786/0x18e0 [ 6620.662889][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6620.663214][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6620.663479][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6620.663722][ C2] ? __ip_finish_output+0x10f/0x770 [ 6620.663976][ C2] ip_output+0x16b/0x4f0 [ 6620.664188][ C2] ? __pfx_ip_output+0x10/0x10 [ 6620.664421][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6620.664690][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6620.664992][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6620.665258][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6620.665500][ C2] ? __alloc_skb+0xd4/0x280 [ 6620.665723][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6620.665983][ C2] ? tcp_fragment+0x168/0x1040 [ 6620.666218][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6620.666461][ C2] ? ip_local_out+0x114/0x3b0 [ 6620.666691][ C2] __ip_queue_xmit+0x672/0x1910 [ 6620.666931][ C2] ? __skb_clone+0x57a/0x760 [ 6620.667159][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6620.667416][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6620.667707][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6620.667949][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6620.668197][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6620.668494][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6620.668824][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6620.669057][ C2] tcp_send_loss_probe+0x348/0x830 [ 6620.669309][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6620.669588][ C2] tcp_write_timer+0x82/0x1d0 [ 6620.669824][ C2] call_timer_fn+0x173/0x430 [ 6620.670058][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6620.670317][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6620.670575][ C2] __run_timers.part.0+0x52d/0x890 [ 6620.670835][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6620.671096][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6620.671371][ C2] ? lock_acquire+0x1c1/0x220 [ 6620.671603][ C2] ? clockevents_program_event+0xf6/0x300 [ 6620.671881][ C2] ? lock_release+0x1d5/0x250 [ 6620.672114][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6620.672368][ C2] ? ktime_get+0xb3/0x190 [ 6620.672581][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6620.672866][ C2] run_timer_softirq+0x72/0x100 [ 6620.673105][ C2] __do_softirq+0x1b9/0x7ff [ 6620.673330][ C2] irq_exit_rcu+0x98/0xc0 [ 6620.673541][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6620.673816][ C2] [ 6620.673961][ C2] [ 6620.674104][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6620.674398][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6620.674646][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6620.675579][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6620.675879][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6620.676262][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6620.676646][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6620.677031][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6620.677414][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6620.677823][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6620.678112][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6620.678370][ C2] default_idle_call+0x69/0xa0 [ 6620.678612][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6620.678872][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6620.679139][ C2] ? lock_release+0x1d5/0x250 [ 6620.679370][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6620.679634][ C2] do_idle+0xfb/0x160 [ 6620.679830][ C2] cpu_startup_entry+0x55/0x60 [ 6620.680064][ C2] start_secondary+0x21c/0x2b0 [ 6620.680300][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6620.680560][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6620.680859][ C2] [ 6648.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4000s! [perl:4135] [ 6648.569680][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6648.570899][ C1] irq event stamp: 209232 [ 6648.571111][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6648.571633][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6648.572097][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6648.572552][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6648.573006][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6648.573443][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6648.574037][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6648.574353][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6648.575298][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6648.575599][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6648.575988][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6648.576377][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6648.576766][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6648.577154][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6648.577564][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6648.578011][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6648.578345][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6648.578753][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6648.579141][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6648.579531][ C1] PKRU: 55555554 [ 6648.579707][ C1] Call Trace: [ 6648.579874][ C1] [ 6648.580022][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6648.580281][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6648.580518][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6648.580788][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6648.581053][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6648.581335][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6648.581593][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6648.581890][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6648.582147][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6648.582446][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6648.582735][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6648.583041][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6648.583324][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6648.583613][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6648.583894][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6648.584198][ C1] ? get_stack_info+0x36/0xc0 [ 6648.584434][ C1] ? lock_acquire+0x1c1/0x220 [ 6648.584669][ C1] ? lock_release+0x1d5/0x250 [ 6648.584903][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6648.585144][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6648.585411][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6648.585687][ C1] ? lock_acquire+0x1c1/0x220 [ 6648.585920][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6648.586155][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6648.586408][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6648.586634][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6648.586876][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6648.587127][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6648.587395][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6648.587690][ C1] ip_local_deliver+0x19d/0x480 [ 6648.587938][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6648.588209][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6648.588472][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6648.588825][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6648.589071][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6648.589384][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6648.589640][ C1] ip_rcv+0x564/0x740 [ 6648.589841][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6648.590065][ C1] ? set_track_prepare+0x8a/0xd0 [ 6648.590311][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6648.590581][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6648.590847][ C1] ? skb_clone+0x10b/0x330 [ 6648.591066][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6648.591378][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6648.591677][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6648.591952][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6648.592242][ C1] ? __tcf_classify+0x329/0x7d0 [ 6648.592485][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6648.592707][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6648.593000][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6648.593278][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6648.593595][ C1] ? lock_acquire+0x1c1/0x220 [ 6648.593827][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6648.594118][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6648.594395][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6648.594703][ C1] ? __copy_skb_header+0xaf/0x490 [ 6648.594954][ C1] ? __skb_clone+0x57a/0x760 [ 6648.595184][ C1] netif_receive_skb+0x55/0x280 [ 6648.595426][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6648.595731][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6648.596055][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6648.596345][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6648.596615][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6648.596895][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6648.597200][ C1] ? hlock_class+0x4e/0x130 [ 6648.597426][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6648.597722][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6648.597997][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6648.598261][ C1] ? hlock_class+0x4e/0x130 [ 6648.598493][ C1] ? mark_lock+0x38/0x3e0 [ 6648.598723][ C1] ? stack_access_ok+0xda/0x1f0 [ 6648.598965][ C1] ? __lock_acquire+0xb67/0x1610 [ 6648.599213][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6648.599480][ C1] ? get_stack_info+0x36/0xc0 [ 6648.599716][ C1] ? stack_access_ok+0xda/0x1f0 [ 6648.599955][ C1] ? get_reg+0x119/0x190 [ 6648.600165][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6648.600429][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6648.600728][ C1] __tcf_classify+0x329/0x7d0 [ 6648.600964][ C1] tcf_classify+0x283/0x930 [ 6648.601190][ C1] ? arch_stack_walk+0xa2/0x100 [ 6648.601432][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6648.601682][ C1] ? get_stack_info+0x36/0xc0 [ 6648.601914][ C1] tc_run+0x2e4/0x5d0 [ 6648.602116][ C1] ? __pfx_tc_run+0x10/0x10 [ 6648.602339][ C1] ? lock_acquire+0x1c1/0x220 [ 6648.602572][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6648.602826][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6648.603073][ C1] ? lock_acquire+0x1c1/0x220 [ 6648.603306][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6648.603564][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6648.603862][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6648.604127][ C1] ? neigh_hh_output+0x348/0x590 [ 6648.604372][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6648.604630][ C1] ip_finish_output2+0x786/0x18e0 [ 6648.604880][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6648.605149][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6648.605476][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6648.605748][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6648.605994][ C1] ? __ip_finish_output+0x10f/0x770 [ 6648.606253][ C1] ip_output+0x16b/0x4f0 [ 6648.606462][ C1] ? run_timer_softirq+0x72/0x100 [ 6648.606711][ C1] ? __pfx_ip_output+0x10/0x10 [ 6648.606948][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6648.607226][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6648.607511][ C1] ? ip_local_out+0x114/0x3b0 [ 6648.607753][ C1] __ip_queue_xmit+0x672/0x1910 [ 6648.608003][ C1] ? __create_object+0x5e/0xb0 [ 6648.608250][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6648.608517][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6648.608808][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6648.609074][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6648.609353][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6648.609618][ C1] tcp_delack_timer+0x84/0x240 [ 6648.609857][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6648.610123][ C1] call_timer_fn+0x173/0x430 [ 6648.610355][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6648.610610][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6648.610867][ C1] __run_timers.part.0+0x52d/0x890 [ 6648.611121][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6648.611387][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6648.611669][ C1] ? lock_acquire+0x1c1/0x220 [ 6648.611901][ C1] ? clockevents_program_event+0xf6/0x300 [ 6648.612187][ C1] ? lock_release+0x1d5/0x250 [ 6648.612422][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6648.612681][ C1] ? ktime_get+0xb3/0x190 [ 6648.612896][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6648.613188][ C1] run_timer_softirq+0x72/0x100 [ 6648.613432][ C1] __do_softirq+0x1b9/0x7ff [ 6648.613660][ C1] irq_exit_rcu+0x98/0xc0 [ 6648.613877][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6648.614156][ C1] [ 6648.614305][ C1] [ 6648.614452][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6648.614751][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6648.615069][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6648.616020][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6648.616323][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6648.616714][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6648.617104][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6648.617520][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6648.617922][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6648.618324][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6648.618625][ C1] pipe_read+0xa16/0xdf0 [ 6648.618853][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6648.619124][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6648.619364][ C1] ? iterate_tty_write+0x299/0x540 [ 6648.619620][ C1] ? lock_release+0x1d5/0x250 [ 6648.619856][ C1] vfs_read+0x911/0xc00 [ 6648.620064][ C1] ? lock_acquire+0x1c1/0x220 [ 6648.620298][ C1] ? __might_fault+0xc6/0x180 [ 6648.620534][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6648.620769][ C1] ? __might_fault+0xc6/0x180 [ 6648.621002][ C1] ? lock_release+0x1d5/0x250 [ 6648.621237][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6648.621495][ C1] ? __fget_light+0x54/0x1e0 [ 6648.621727][ C1] ksys_read+0x17a/0x1e0 [ 6648.621939][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6648.622179][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6648.622477][ C1] do_syscall_64+0xc9/0x1e0 [ 6648.622703][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6648.622995][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6648.623225][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6648.624172][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6648.624584][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6648.624975][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6648.625365][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6648.625754][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6648.626145][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6648.626538][ C1] [ 6648.626691][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4000s! [swapper/2:0] [ 6648.627090][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6648.628332][ C2] irq event stamp: 44114564 [ 6648.628558][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6648.629088][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6648.629580][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6648.630041][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6648.630493][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6648.630932][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6648.631524][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6648.631837][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6648.632772][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6648.633068][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6648.633452][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6648.633836][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6648.634225][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6648.634610][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6648.634994][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6648.635426][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6648.635745][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6648.636135][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6648.636520][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6648.636905][ C2] PKRU: 55555554 [ 6648.637080][ C2] Call Trace: [ 6648.637244][ C2] [ 6648.637386][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6648.637662][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6648.637902][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6648.638176][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6648.638447][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6648.638742][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6648.638996][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6648.639292][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6648.639544][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6648.639798][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6648.640117][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6648.640408][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6648.640719][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6648.641008][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6648.641309][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6648.641589][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6648.641890][ C2] ? get_stack_info+0x36/0xc0 [ 6648.642123][ C2] ? lock_acquire+0x1c1/0x220 [ 6648.642352][ C2] ? lock_release+0x1d5/0x250 [ 6648.642585][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6648.642826][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6648.643088][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6648.643365][ C2] ? lock_acquire+0x1c1/0x220 [ 6648.643593][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6648.643826][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6648.644077][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6648.644305][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6648.644545][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6648.644794][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6648.645058][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6648.645325][ C2] ip_local_deliver+0x19d/0x480 [ 6648.645564][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6648.645826][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6648.646082][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6648.646418][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6648.646662][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6648.646972][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6648.647225][ C2] ip_rcv+0x564/0x740 [ 6648.647422][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6648.647670][ C2] ? set_track_prepare+0x8a/0xd0 [ 6648.647921][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6648.648197][ C2] ? start_secondary+0x21c/0x2b0 [ 6648.648447][ C2] ? skb_clone+0x10b/0x330 [ 6648.648681][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6648.648988][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6648.649285][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6648.649557][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6648.649842][ C2] ? __tcf_classify+0x329/0x7d0 [ 6648.650084][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6648.650306][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6648.650596][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6648.650872][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6648.651187][ C2] ? lock_acquire+0x1c1/0x220 [ 6648.651417][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6648.651705][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6648.651983][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6648.652289][ C2] ? __copy_skb_header+0xaf/0x490 [ 6648.652538][ C2] ? __skb_clone+0x57a/0x760 [ 6648.652766][ C2] netif_receive_skb+0x55/0x280 [ 6648.653007][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6648.653309][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6648.653630][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6648.653919][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6648.654186][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6648.654464][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6648.654766][ C2] ? get_stack_info+0x36/0xc0 [ 6648.655001][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6648.655256][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6648.655564][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6648.655830][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6648.656096][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6648.656402][ C2] ? kernel_text_address+0x17/0xe0 [ 6648.656653][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6648.656956][ C2] ? arch_stack_walk+0x8c/0x100 [ 6648.657197][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6648.657452][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6648.657759][ C2] ? lock_acquire+0x1c1/0x220 [ 6648.657995][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6648.658275][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6648.658577][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6648.658856][ C2] ? get_stack_info+0x36/0xc0 [ 6648.659089][ C2] __tcf_classify+0x329/0x7d0 [ 6648.659321][ C2] tcf_classify+0x283/0x930 [ 6648.659546][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6648.659793][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6648.660095][ C2] tc_run+0x2e4/0x5d0 [ 6648.660293][ C2] ? __pfx_tc_run+0x10/0x10 [ 6648.660516][ C2] ? lock_acquire+0x1c1/0x220 [ 6648.660746][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6648.660999][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6648.661244][ C2] ? lock_acquire+0x1c1/0x220 [ 6648.661474][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6648.661728][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6648.662022][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6648.662284][ C2] ? neigh_hh_output+0x348/0x590 [ 6648.662529][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6648.662785][ C2] ip_finish_output2+0x786/0x18e0 [ 6648.663033][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6648.663361][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6648.663626][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6648.663871][ C2] ? __ip_finish_output+0x10f/0x770 [ 6648.664126][ C2] ip_output+0x16b/0x4f0 [ 6648.664334][ C2] ? __pfx_ip_output+0x10/0x10 [ 6648.664570][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6648.664838][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6648.665137][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6648.665407][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6648.665649][ C2] ? __alloc_skb+0xd4/0x280 [ 6648.665871][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6648.666131][ C2] ? tcp_fragment+0x168/0x1040 [ 6648.666366][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6648.666609][ C2] ? ip_local_out+0x114/0x3b0 [ 6648.666842][ C2] __ip_queue_xmit+0x672/0x1910 [ 6648.667082][ C2] ? __skb_clone+0x57a/0x760 [ 6648.667309][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6648.667591][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6648.667867][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6648.668110][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6648.668358][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6648.668665][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6648.668975][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6648.669213][ C2] tcp_send_loss_probe+0x348/0x830 [ 6648.669464][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6648.669723][ C2] tcp_write_timer+0x82/0x1d0 [ 6648.669976][ C2] call_timer_fn+0x173/0x430 [ 6648.670211][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6648.670471][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6648.670731][ C2] __run_timers.part.0+0x52d/0x890 [ 6648.670999][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6648.671258][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6648.671536][ C2] ? lock_acquire+0x1c1/0x220 [ 6648.671766][ C2] ? clockevents_program_event+0xf6/0x300 [ 6648.672047][ C2] ? lock_release+0x1d5/0x250 [ 6648.672279][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6648.672534][ C2] ? ktime_get+0xb3/0x190 [ 6648.672747][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6648.673035][ C2] run_timer_softirq+0x72/0x100 [ 6648.673276][ C2] __do_softirq+0x1b9/0x7ff [ 6648.673498][ C2] irq_exit_rcu+0x98/0xc0 [ 6648.673713][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6648.673986][ C2] [ 6648.674134][ C2] [ 6648.674278][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6648.674573][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6648.674821][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6648.675758][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6648.676054][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6648.676440][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6648.676824][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6648.677209][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6648.677619][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6648.678015][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6648.678302][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6648.678561][ C2] default_idle_call+0x69/0xa0 [ 6648.678809][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6648.679051][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6648.679321][ C2] ? lock_release+0x1d5/0x250 [ 6648.679550][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6648.679815][ C2] do_idle+0xfb/0x160 [ 6648.680012][ C2] cpu_startup_entry+0x55/0x60 [ 6648.680247][ C2] start_secondary+0x21c/0x2b0 [ 6648.680480][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6648.680743][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6648.681040][ C2] [ 6674.128118][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6674.128473][ C1] rcu: 1-....: (4308676 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1056365 [ 6674.129029][ C1] rcu: (t=4319241 jiffies g=1882453 q=718 ncpus=4) [ 6674.129353][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6674.129790][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6674.130385][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6674.130703][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6674.131646][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6674.131946][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6674.132336][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6674.132726][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6674.133114][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6674.133501][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6674.133889][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6674.134325][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6674.134649][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6674.135039][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6674.135426][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6674.135815][ C1] PKRU: 55555554 [ 6674.135991][ C1] Call Trace: [ 6674.136157][ C1] [ 6674.136301][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6674.136568][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6674.136814][ C1] ? check_cpu_stall+0x284/0x500 [ 6674.137058][ C1] ? rcu_pending+0x92/0x360 [ 6674.137283][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6674.137568][ C1] ? update_process_times+0xb9/0x110 [ 6674.137838][ C1] ? tick_sched_handle+0x67/0x130 [ 6674.138094][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6674.138379][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6674.138631][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6674.138936][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6674.139202][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6674.139481][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6674.139740][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6674.140037][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6674.140292][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6674.140593][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6674.140882][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6674.141187][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6674.141468][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6674.141756][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6674.142036][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6674.142339][ C1] ? get_stack_info+0x36/0xc0 [ 6674.142575][ C1] ? lock_acquire+0x1c1/0x220 [ 6674.142809][ C1] ? lock_release+0x1d5/0x250 [ 6674.143040][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6674.143282][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6674.143548][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6674.143826][ C1] ? lock_acquire+0x1c1/0x220 [ 6674.144059][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6674.144292][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6674.144546][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6674.144774][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6674.145014][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6674.145265][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6674.145531][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6674.145803][ C1] ip_local_deliver+0x19d/0x480 [ 6674.146043][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6674.146310][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6674.146567][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6674.146904][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6674.147151][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6674.147486][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6674.147749][ C1] ip_rcv+0x564/0x740 [ 6674.147953][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6674.148185][ C1] ? set_track_prepare+0x8a/0xd0 [ 6674.148439][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6674.148722][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6674.148988][ C1] ? skb_clone+0x10b/0x330 [ 6674.149210][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6674.149522][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6674.149821][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6674.150095][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6674.150383][ C1] ? __tcf_classify+0x329/0x7d0 [ 6674.150625][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6674.150849][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6674.151142][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6674.151418][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6674.151733][ C1] ? lock_acquire+0x1c1/0x220 [ 6674.151967][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6674.152256][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6674.152532][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6674.152841][ C1] ? __copy_skb_header+0xaf/0x490 [ 6674.153090][ C1] ? __skb_clone+0x57a/0x760 [ 6674.153320][ C1] netif_receive_skb+0x55/0x280 [ 6674.153561][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6674.153868][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6674.154192][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6674.154483][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6674.154769][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6674.155057][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6674.155371][ C1] ? hlock_class+0x4e/0x130 [ 6674.155603][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6674.155881][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6674.156160][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6674.156416][ C1] ? hlock_class+0x4e/0x130 [ 6674.156641][ C1] ? mark_lock+0x38/0x3e0 [ 6674.156854][ C1] ? stack_access_ok+0xda/0x1f0 [ 6674.157096][ C1] ? __lock_acquire+0xb67/0x1610 [ 6674.157346][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6674.157637][ C1] ? get_stack_info+0x36/0xc0 [ 6674.157877][ C1] ? stack_access_ok+0xda/0x1f0 [ 6674.158124][ C1] ? get_reg+0x119/0x190 [ 6674.158339][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6674.158615][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6674.158917][ C1] __tcf_classify+0x329/0x7d0 [ 6674.159153][ C1] tcf_classify+0x283/0x930 [ 6674.159378][ C1] ? arch_stack_walk+0xa2/0x100 [ 6674.159618][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6674.159868][ C1] ? get_stack_info+0x36/0xc0 [ 6674.160101][ C1] tc_run+0x2e4/0x5d0 [ 6674.160300][ C1] ? __pfx_tc_run+0x10/0x10 [ 6674.160526][ C1] ? lock_acquire+0x1c1/0x220 [ 6674.160759][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6674.161012][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6674.161259][ C1] ? lock_acquire+0x1c1/0x220 [ 6674.161491][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6674.161749][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6674.162044][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6674.162311][ C1] ? neigh_hh_output+0x348/0x590 [ 6674.162557][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6674.162815][ C1] ip_finish_output2+0x786/0x18e0 [ 6674.163064][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6674.163334][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6674.163661][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6674.163930][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6674.164178][ C1] ? __ip_finish_output+0x10f/0x770 [ 6674.164436][ C1] ip_output+0x16b/0x4f0 [ 6674.164646][ C1] ? run_timer_softirq+0x72/0x100 [ 6674.164897][ C1] ? __pfx_ip_output+0x10/0x10 [ 6674.165134][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6674.165412][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6674.165657][ C1] ? ip_local_out+0x114/0x3b0 [ 6674.165890][ C1] __ip_queue_xmit+0x672/0x1910 [ 6674.166133][ C1] ? __create_object+0x5e/0xb0 [ 6674.166371][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6674.166631][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6674.166905][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6674.167170][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6674.167467][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6674.167738][ C1] tcp_delack_timer+0x84/0x240 [ 6674.167982][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6674.168254][ C1] call_timer_fn+0x173/0x430 [ 6674.168490][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6674.168757][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6674.169012][ C1] __run_timers.part.0+0x52d/0x890 [ 6674.169264][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6674.169529][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6674.169807][ C1] ? lock_acquire+0x1c1/0x220 [ 6674.170037][ C1] ? clockevents_program_event+0xf6/0x300 [ 6674.170322][ C1] ? lock_release+0x1d5/0x250 [ 6674.170554][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6674.170812][ C1] ? ktime_get+0xb3/0x190 [ 6674.171026][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6674.171316][ C1] run_timer_softirq+0x72/0x100 [ 6674.171558][ C1] __do_softirq+0x1b9/0x7ff [ 6674.171784][ C1] irq_exit_rcu+0x98/0xc0 [ 6674.172000][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6674.172276][ C1] [ 6674.172422][ C1] [ 6674.172569][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6674.172865][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6674.173181][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6674.174126][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6674.174426][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6674.174815][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6674.175202][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6674.175589][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6674.175979][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6674.176369][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6674.176656][ C1] pipe_read+0xa16/0xdf0 [ 6674.176871][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6674.177141][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6674.177398][ C1] ? iterate_tty_write+0x299/0x540 [ 6674.177658][ C1] ? lock_release+0x1d5/0x250 [ 6674.177899][ C1] vfs_read+0x911/0xc00 [ 6674.178111][ C1] ? lock_acquire+0x1c1/0x220 [ 6674.178351][ C1] ? __might_fault+0xc6/0x180 [ 6674.178600][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6674.178830][ C1] ? __might_fault+0xc6/0x180 [ 6674.179064][ C1] ? lock_release+0x1d5/0x250 [ 6674.179298][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6674.179556][ C1] ? __fget_light+0x54/0x1e0 [ 6674.179786][ C1] ksys_read+0x17a/0x1e0 [ 6674.179996][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6674.180235][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6674.180532][ C1] do_syscall_64+0xc9/0x1e0 [ 6674.180756][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6674.181049][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6674.181270][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6674.182217][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6674.182625][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6674.183013][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6674.183402][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6674.183792][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6674.184179][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6674.184570][ C1] [ 6674.184723][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6674.184986][ C2] NMI backtrace for cpu 2 [ 6674.184995][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6674.185001][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6674.185004][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6674.185012][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6674.185017][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6674.185022][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6674.185025][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6674.185029][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6674.185033][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6674.185036][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6674.185040][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6674.185045][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6674.185050][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6674.185053][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6674.185056][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6674.185060][ C2] PKRU: 55555554 [ 6674.185062][ C2] Call Trace: [ 6674.185064][ C2] [ 6674.185067][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6674.185079][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6674.185086][ C2] ? nmi_handle+0x153/0x420 [ 6674.185095][ C2] ? default_do_nmi+0x41/0x100 [ 6674.185101][ C2] ? exc_nmi+0xf3/0x120 [ 6674.185107][ C2] ? end_repeat_nmi+0xf/0x60 [ 6674.185118][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6674.185126][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6674.185134][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6674.185142][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6674.185150][ C2] [ 6674.185152][ C2] [ 6674.185155][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6674.185161][ C2] ? get_stack_info+0x36/0xc0 [ 6674.185169][ C2] ? lock_acquire+0x1c1/0x220 [ 6674.185177][ C2] ? lock_release+0x1d5/0x250 [ 6674.185185][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6674.185193][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6674.185200][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6674.185208][ C2] ? lock_acquire+0x1c1/0x220 [ 6674.185213][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6674.185221][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6674.185228][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6674.185244][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6674.185250][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6674.185261][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6674.185270][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6674.185278][ C2] ip_local_deliver+0x19d/0x480 [ 6674.185284][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6674.185289][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6674.185295][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6674.185305][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6674.185312][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6674.185319][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6674.185340][ C2] ip_rcv+0x564/0x740 [ 6674.185343][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6674.185346][ C2] ? set_track_prepare+0x8a/0xd0 [ 6674.185349][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6674.185352][ C2] ? start_secondary+0x21c/0x2b0 [ 6674.185355][ C2] ? skb_clone+0x10b/0x330 [ 6674.185357][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6674.185363][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6674.185368][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6674.185371][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6674.185378][ C2] ? __tcf_classify+0x329/0x7d0 [ 6674.185382][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6674.185384][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6674.185387][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6674.185390][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6674.185394][ C2] ? lock_acquire+0x1c1/0x220 [ 6674.185396][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6674.185400][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6674.185404][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6674.185407][ C2] ? __copy_skb_header+0xaf/0x490 [ 6674.185411][ C2] ? __skb_clone+0x57a/0x760 [ 6674.185414][ C2] netif_receive_skb+0x55/0x280 [ 6674.185417][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6674.185423][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6674.185430][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6674.185437][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6674.185441][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6674.185450][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6674.185457][ C2] ? get_stack_info+0x36/0xc0 [ 6674.185462][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6674.185464][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6674.185467][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6674.185470][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6674.185473][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6674.185475][ C2] ? kernel_text_address+0x17/0xe0 [ 6674.185478][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6674.185481][ C2] ? arch_stack_walk+0x8c/0x100 [ 6674.185484][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6674.185488][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6674.185491][ C2] ? lock_acquire+0x1c1/0x220 [ 6674.185493][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6674.185496][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6674.185500][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6674.185503][ C2] ? get_stack_info+0x36/0xc0 [ 6674.185507][ C2] __tcf_classify+0x329/0x7d0 [ 6674.185511][ C2] tcf_classify+0x283/0x930 [ 6674.185515][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6674.185518][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6674.185523][ C2] tc_run+0x2e4/0x5d0 [ 6674.185526][ C2] ? __pfx_tc_run+0x10/0x10 [ 6674.185529][ C2] ? lock_acquire+0x1c1/0x220 [ 6674.185531][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6674.185534][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6674.185538][ C2] ? lock_acquire+0x1c1/0x220 [ 6674.185540][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6674.185543][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6674.185546][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6674.185549][ C2] ? neigh_hh_output+0x348/0x590 [ 6674.185552][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6674.185556][ C2] ip_finish_output2+0x786/0x18e0 [ 6674.185559][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6674.185566][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6674.185569][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6674.185573][ C2] ? __ip_finish_output+0x10f/0x770 [ 6674.185576][ C2] ip_output+0x16b/0x4f0 [ 6674.185579][ C2] ? __pfx_ip_output+0x10/0x10 [ 6674.185582][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6674.185585][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6674.185587][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6674.185590][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6674.185592][ C2] ? __alloc_skb+0xd4/0x280 [ 6674.185595][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6674.185598][ C2] ? tcp_fragment+0x168/0x1040 [ 6674.185601][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6674.185603][ C2] ? ip_local_out+0x114/0x3b0 [ 6674.185607][ C2] __ip_queue_xmit+0x672/0x1910 [ 6674.185610][ C2] ? __skb_clone+0x57a/0x760 [ 6674.185613][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6674.185618][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6674.185621][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6674.185624][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6674.185628][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6674.185631][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6674.185634][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6674.185637][ C2] tcp_send_loss_probe+0x348/0x830 [ 6674.185640][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6674.185643][ C2] tcp_write_timer+0x82/0x1d0 [ 6674.185646][ C2] call_timer_fn+0x173/0x430 [ 6674.185649][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6674.185653][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6674.185657][ C2] __run_timers.part.0+0x52d/0x890 [ 6674.185660][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6674.185664][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6674.185667][ C2] ? lock_acquire+0x1c1/0x220 [ 6674.185669][ C2] ? clockevents_program_event+0xf6/0x300 [ 6674.185673][ C2] ? lock_release+0x1d5/0x250 [ 6674.185675][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6674.185678][ C2] ? ktime_get+0xb3/0x190 [ 6674.185681][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6674.185685][ C2] run_timer_softirq+0x72/0x100 [ 6674.185688][ C2] __do_softirq+0x1b9/0x7ff [ 6674.185693][ C2] irq_exit_rcu+0x98/0xc0 [ 6674.185695][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6674.185697][ C2] [ 6674.185698][ C2] [ 6674.185699][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6674.185703][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6674.185706][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6674.185708][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6674.185710][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6674.185711][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6674.185713][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6674.185714][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6674.185716][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6674.185718][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6674.185721][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6674.185724][ C2] default_idle_call+0x69/0xa0 [ 6674.185727][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6674.185729][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6674.185733][ C2] ? lock_release+0x1d5/0x250 [ 6674.185735][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6674.185739][ C2] do_idle+0xfb/0x160 [ 6674.185741][ C2] cpu_startup_entry+0x55/0x60 [ 6674.185743][ C2] start_secondary+0x21c/0x2b0 [ 6674.185746][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6674.185749][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6674.185755][ C2] [ 6700.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4049s! [perl:4135] [ 6700.569676][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6700.570898][ C1] irq event stamp: 209232 [ 6700.571112][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6700.571627][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6700.572090][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6700.572548][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6700.572998][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6700.573436][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6700.574031][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6700.574350][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6700.575299][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6700.575596][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6700.575988][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6700.576378][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6700.576765][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6700.577153][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6700.577572][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6700.578020][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6700.578353][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6700.578754][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6700.579143][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6700.579533][ C1] PKRU: 55555554 [ 6700.579710][ C1] Call Trace: [ 6700.579874][ C1] [ 6700.580019][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6700.580274][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6700.580509][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6700.580780][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6700.581045][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6700.581325][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6700.581584][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6700.581879][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6700.582136][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6700.582436][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6700.582724][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6700.583030][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6700.583310][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6700.583599][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6700.583878][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6700.584182][ C1] ? get_stack_info+0x36/0xc0 [ 6700.584418][ C1] ? lock_acquire+0x1c1/0x220 [ 6700.584653][ C1] ? lock_release+0x1d5/0x250 [ 6700.584886][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6700.585128][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6700.585394][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6700.585671][ C1] ? lock_acquire+0x1c1/0x220 [ 6700.585904][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6700.586138][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6700.586391][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6700.586618][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6700.586859][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6700.587110][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6700.587400][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6700.587681][ C1] ip_local_deliver+0x19d/0x480 [ 6700.587928][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6700.588201][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6700.588473][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6700.588812][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6700.589060][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6700.589372][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6700.589627][ C1] ip_rcv+0x564/0x740 [ 6700.589827][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6700.590052][ C1] ? set_track_prepare+0x8a/0xd0 [ 6700.590299][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6700.590568][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6700.590834][ C1] ? skb_clone+0x10b/0x330 [ 6700.591054][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6700.591365][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6700.591664][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6700.591936][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6700.592224][ C1] ? __tcf_classify+0x329/0x7d0 [ 6700.592467][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6700.592691][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6700.592983][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6700.593260][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6700.593576][ C1] ? lock_acquire+0x1c1/0x220 [ 6700.593809][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6700.594099][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6700.594376][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6700.594683][ C1] ? __copy_skb_header+0xaf/0x490 [ 6700.594934][ C1] ? __skb_clone+0x57a/0x760 [ 6700.595164][ C1] netif_receive_skb+0x55/0x280 [ 6700.595407][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6700.595711][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6700.596034][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6700.596324][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6700.596592][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6700.596874][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6700.597179][ C1] ? hlock_class+0x4e/0x130 [ 6700.597430][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6700.597708][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6700.597984][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6700.598247][ C1] ? hlock_class+0x4e/0x130 [ 6700.598489][ C1] ? mark_lock+0x38/0x3e0 [ 6700.598702][ C1] ? stack_access_ok+0xda/0x1f0 [ 6700.598944][ C1] ? __lock_acquire+0xb67/0x1610 [ 6700.599192][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6700.599460][ C1] ? get_stack_info+0x36/0xc0 [ 6700.599695][ C1] ? stack_access_ok+0xda/0x1f0 [ 6700.599936][ C1] ? get_reg+0x119/0x190 [ 6700.600146][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6700.600407][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6700.600709][ C1] __tcf_classify+0x329/0x7d0 [ 6700.600945][ C1] tcf_classify+0x283/0x930 [ 6700.601172][ C1] ? arch_stack_walk+0xa2/0x100 [ 6700.601413][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6700.601663][ C1] ? get_stack_info+0x36/0xc0 [ 6700.601897][ C1] tc_run+0x2e4/0x5d0 [ 6700.602097][ C1] ? __pfx_tc_run+0x10/0x10 [ 6700.602322][ C1] ? lock_acquire+0x1c1/0x220 [ 6700.602556][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6700.602810][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6700.603057][ C1] ? lock_acquire+0x1c1/0x220 [ 6700.603290][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6700.603548][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6700.603843][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6700.604110][ C1] ? neigh_hh_output+0x348/0x590 [ 6700.604356][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6700.604614][ C1] ip_finish_output2+0x786/0x18e0 [ 6700.604864][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6700.605134][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6700.605462][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6700.605732][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6700.605978][ C1] ? __ip_finish_output+0x10f/0x770 [ 6700.606237][ C1] ip_output+0x16b/0x4f0 [ 6700.606447][ C1] ? run_timer_softirq+0x72/0x100 [ 6700.606697][ C1] ? __pfx_ip_output+0x10/0x10 [ 6700.606934][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6700.607213][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6700.607483][ C1] ? ip_local_out+0x114/0x3b0 [ 6700.607723][ C1] __ip_queue_xmit+0x672/0x1910 [ 6700.607972][ C1] ? __create_object+0x5e/0xb0 [ 6700.608216][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6700.608494][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6700.608767][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6700.609031][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6700.609308][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6700.609573][ C1] tcp_delack_timer+0x84/0x240 [ 6700.609811][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6700.610074][ C1] call_timer_fn+0x173/0x430 [ 6700.610306][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6700.610561][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6700.610816][ C1] __run_timers.part.0+0x52d/0x890 [ 6700.611070][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6700.611336][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6700.611613][ C1] ? lock_acquire+0x1c1/0x220 [ 6700.611844][ C1] ? clockevents_program_event+0xf6/0x300 [ 6700.612130][ C1] ? lock_release+0x1d5/0x250 [ 6700.612364][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6700.612623][ C1] ? ktime_get+0xb3/0x190 [ 6700.612836][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6700.613126][ C1] run_timer_softirq+0x72/0x100 [ 6700.613368][ C1] __do_softirq+0x1b9/0x7ff [ 6700.613593][ C1] irq_exit_rcu+0x98/0xc0 [ 6700.613809][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6700.614086][ C1] [ 6700.614234][ C1] [ 6700.614380][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6700.614677][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6700.614996][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6700.615943][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6700.616243][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6700.616632][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6700.617019][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6700.617433][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6700.617833][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6700.618235][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6700.618541][ C1] pipe_read+0xa16/0xdf0 [ 6700.618755][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6700.619023][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6700.619262][ C1] ? iterate_tty_write+0x299/0x540 [ 6700.619516][ C1] ? lock_release+0x1d5/0x250 [ 6700.619750][ C1] vfs_read+0x911/0xc00 [ 6700.619957][ C1] ? lock_acquire+0x1c1/0x220 [ 6700.620190][ C1] ? __might_fault+0xc6/0x180 [ 6700.620425][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6700.620657][ C1] ? __might_fault+0xc6/0x180 [ 6700.620890][ C1] ? lock_release+0x1d5/0x250 [ 6700.621124][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6700.621382][ C1] ? __fget_light+0x54/0x1e0 [ 6700.621613][ C1] ksys_read+0x17a/0x1e0 [ 6700.621826][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6700.622066][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6700.622363][ C1] do_syscall_64+0xc9/0x1e0 [ 6700.622587][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6700.622880][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6700.623102][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6700.624049][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6700.624457][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6700.624847][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6700.625236][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6700.625623][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6700.626011][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6700.626404][ C1] [ 6700.626557][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4049s! [swapper/2:0] [ 6700.626956][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6700.628204][ C2] irq event stamp: 44114564 [ 6700.628429][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6700.628957][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6700.629450][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6700.629912][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6700.630364][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6700.630803][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6700.631397][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6700.631710][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6700.632648][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6700.632947][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6700.633331][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6700.633720][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6700.634109][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6700.634496][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6700.634882][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6700.635314][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6700.635635][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6700.636026][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6700.636414][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6700.636799][ C2] PKRU: 55555554 [ 6700.636975][ C2] Call Trace: [ 6700.637141][ C2] [ 6700.637306][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6700.637565][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6700.637806][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6700.638080][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6700.638353][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6700.638642][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6700.638896][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6700.639192][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6700.639445][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6700.639698][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6700.639997][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6700.640282][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6700.640585][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6700.640867][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6700.641152][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6700.641432][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6700.641733][ C2] ? get_stack_info+0x36/0xc0 [ 6700.641966][ C2] ? lock_acquire+0x1c1/0x220 [ 6700.642197][ C2] ? lock_release+0x1d5/0x250 [ 6700.642430][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6700.642671][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6700.642934][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6700.643211][ C2] ? lock_acquire+0x1c1/0x220 [ 6700.643441][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6700.643672][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6700.643923][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6700.644151][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6700.644390][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6700.644639][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6700.644903][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6700.645170][ C2] ip_local_deliver+0x19d/0x480 [ 6700.645412][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6700.645675][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6700.645931][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6700.646266][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6700.646511][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6700.646820][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6700.647074][ C2] ip_rcv+0x564/0x740 [ 6700.647293][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6700.647522][ C2] ? set_track_prepare+0x8a/0xd0 [ 6700.647773][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6700.648047][ C2] ? start_secondary+0x21c/0x2b0 [ 6700.648298][ C2] ? skb_clone+0x10b/0x330 [ 6700.648531][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6700.648838][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6700.649135][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6700.649407][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6700.649690][ C2] ? __tcf_classify+0x329/0x7d0 [ 6700.649931][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6700.650154][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6700.650444][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6700.650720][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6700.651035][ C2] ? lock_acquire+0x1c1/0x220 [ 6700.651265][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6700.651551][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6700.651826][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6700.652132][ C2] ? __copy_skb_header+0xaf/0x490 [ 6700.652381][ C2] ? __skb_clone+0x57a/0x760 [ 6700.652607][ C2] netif_receive_skb+0x55/0x280 [ 6700.652847][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6700.653149][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6700.653469][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6700.653758][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6700.654023][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6700.654300][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6700.654602][ C2] ? get_stack_info+0x36/0xc0 [ 6700.654836][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6700.655091][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6700.655397][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6700.655666][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6700.655934][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6700.656237][ C2] ? kernel_text_address+0x17/0xe0 [ 6700.656491][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6700.656792][ C2] ? arch_stack_walk+0x8c/0x100 [ 6700.657032][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6700.657308][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6700.657592][ C2] ? lock_acquire+0x1c1/0x220 [ 6700.657827][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6700.658108][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6700.658422][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6700.658688][ C2] ? get_stack_info+0x36/0xc0 [ 6700.658922][ C2] __tcf_classify+0x329/0x7d0 [ 6700.659155][ C2] tcf_classify+0x283/0x930 [ 6700.659380][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6700.659627][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6700.659932][ C2] tc_run+0x2e4/0x5d0 [ 6700.660129][ C2] ? __pfx_tc_run+0x10/0x10 [ 6700.660352][ C2] ? lock_acquire+0x1c1/0x220 [ 6700.660582][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6700.660834][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6700.661078][ C2] ? lock_acquire+0x1c1/0x220 [ 6700.661308][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6700.661562][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6700.661856][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6700.662118][ C2] ? neigh_hh_output+0x348/0x590 [ 6700.662363][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6700.662619][ C2] ip_finish_output2+0x786/0x18e0 [ 6700.662868][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6700.663197][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6700.663463][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6700.663708][ C2] ? __ip_finish_output+0x10f/0x770 [ 6700.663964][ C2] ip_output+0x16b/0x4f0 [ 6700.664173][ C2] ? __pfx_ip_output+0x10/0x10 [ 6700.664410][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6700.664678][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6700.664978][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6700.665248][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6700.665491][ C2] ? __alloc_skb+0xd4/0x280 [ 6700.665711][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6700.665972][ C2] ? tcp_fragment+0x168/0x1040 [ 6700.666207][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6700.666450][ C2] ? ip_local_out+0x114/0x3b0 [ 6700.666682][ C2] __ip_queue_xmit+0x672/0x1910 [ 6700.666923][ C2] ? __skb_clone+0x57a/0x760 [ 6700.667150][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6700.667434][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6700.667711][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6700.667953][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6700.668201][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6700.668507][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6700.668816][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6700.669052][ C2] tcp_send_loss_probe+0x348/0x830 [ 6700.669303][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6700.669562][ C2] tcp_write_timer+0x82/0x1d0 [ 6700.669793][ C2] call_timer_fn+0x173/0x430 [ 6700.670024][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6700.670277][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6700.670529][ C2] __run_timers.part.0+0x52d/0x890 [ 6700.670802][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6700.671069][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6700.671354][ C2] ? lock_acquire+0x1c1/0x220 [ 6700.671590][ C2] ? clockevents_program_event+0xf6/0x300 [ 6700.671884][ C2] ? lock_release+0x1d5/0x250 [ 6700.672116][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6700.672371][ C2] ? ktime_get+0xb3/0x190 [ 6700.672583][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6700.672871][ C2] run_timer_softirq+0x72/0x100 [ 6700.673112][ C2] __do_softirq+0x1b9/0x7ff [ 6700.673336][ C2] irq_exit_rcu+0x98/0xc0 [ 6700.673550][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6700.673823][ C2] [ 6700.673970][ C2] [ 6700.674115][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6700.674409][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6700.674657][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6700.675593][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6700.675890][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6700.676275][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6700.676659][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6700.677044][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6700.677454][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6700.677850][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6700.678136][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6700.678396][ C2] default_idle_call+0x69/0xa0 [ 6700.678641][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6700.678882][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6700.679152][ C2] ? lock_release+0x1d5/0x250 [ 6700.679383][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6700.679649][ C2] do_idle+0xfb/0x160 [ 6700.679845][ C2] cpu_startup_entry+0x55/0x60 [ 6700.680081][ C2] start_secondary+0x21c/0x2b0 [ 6700.680315][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6700.680576][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6700.680875][ C2] [ 6728.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4075s! [perl:4135] [ 6728.569690][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6728.570913][ C1] irq event stamp: 209232 [ 6728.571127][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6728.571643][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6728.572108][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6728.572563][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6728.573015][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6728.573451][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6728.574047][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 6728.574323][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 6728.575269][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 6728.575567][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6728.575958][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6728.576346][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6728.576734][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6728.577143][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6728.577544][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6728.577995][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6728.578337][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6728.578727][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6728.579117][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6728.579508][ C1] PKRU: 55555554 [ 6728.579686][ C1] Call Trace: [ 6728.579849][ C1] [ 6728.579996][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6728.580253][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6728.580490][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6728.580761][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6728.581027][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6728.581309][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6728.581569][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6728.581867][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6728.582124][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6728.582424][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6728.582714][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6728.583021][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6728.583302][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 6728.583578][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6728.583852][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6728.584156][ C1] ? get_stack_info+0x36/0xc0 [ 6728.584393][ C1] ? lock_acquire+0x1c1/0x220 [ 6728.584627][ C1] ? lock_release+0x1d5/0x250 [ 6728.584861][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6728.585104][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6728.585371][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6728.585650][ C1] ? lock_acquire+0x1c1/0x220 [ 6728.585882][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6728.586118][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6728.586370][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6728.586601][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6728.586864][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6728.587125][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6728.587401][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6728.587677][ C1] ip_local_deliver+0x19d/0x480 [ 6728.587926][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6728.588199][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6728.588472][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6728.588811][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6728.589058][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6728.589370][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6728.589627][ C1] ip_rcv+0x564/0x740 [ 6728.589826][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6728.590052][ C1] ? set_track_prepare+0x8a/0xd0 [ 6728.590301][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6728.590571][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6728.590837][ C1] ? skb_clone+0x10b/0x330 [ 6728.591061][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6728.591373][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6728.591671][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6728.591947][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6728.592234][ C1] ? __tcf_classify+0x329/0x7d0 [ 6728.592478][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6728.592704][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6728.592997][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6728.593274][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6728.593592][ C1] ? lock_acquire+0x1c1/0x220 [ 6728.593826][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6728.594115][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6728.594395][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6728.594705][ C1] ? __copy_skb_header+0xaf/0x490 [ 6728.594957][ C1] ? __skb_clone+0x57a/0x760 [ 6728.595187][ C1] netif_receive_skb+0x55/0x280 [ 6728.595428][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6728.595734][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6728.596057][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6728.596350][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6728.596617][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6728.596901][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6728.597226][ C1] ? hlock_class+0x4e/0x130 [ 6728.597461][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6728.597737][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6728.598015][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6728.598292][ C1] ? hlock_class+0x4e/0x130 [ 6728.598515][ C1] ? mark_lock+0x38/0x3e0 [ 6728.598732][ C1] ? stack_access_ok+0xda/0x1f0 [ 6728.598975][ C1] ? __lock_acquire+0xb67/0x1610 [ 6728.599224][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6728.599492][ C1] ? get_stack_info+0x36/0xc0 [ 6728.599728][ C1] ? stack_access_ok+0xda/0x1f0 [ 6728.599969][ C1] ? get_reg+0x119/0x190 [ 6728.600181][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6728.600442][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6728.600745][ C1] __tcf_classify+0x329/0x7d0 [ 6728.600981][ C1] tcf_classify+0x283/0x930 [ 6728.601206][ C1] ? arch_stack_walk+0xa2/0x100 [ 6728.601450][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6728.601701][ C1] ? get_stack_info+0x36/0xc0 [ 6728.601937][ C1] tc_run+0x2e4/0x5d0 [ 6728.602137][ C1] ? __pfx_tc_run+0x10/0x10 [ 6728.602363][ C1] ? lock_acquire+0x1c1/0x220 [ 6728.602596][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6728.602851][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6728.603098][ C1] ? lock_acquire+0x1c1/0x220 [ 6728.603330][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6728.603588][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6728.603887][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6728.604151][ C1] ? neigh_hh_output+0x348/0x590 [ 6728.604398][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6728.604657][ C1] ip_finish_output2+0x786/0x18e0 [ 6728.604911][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6728.605184][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6728.605514][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6728.605782][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6728.606029][ C1] ? __ip_finish_output+0x10f/0x770 [ 6728.606287][ C1] ip_output+0x16b/0x4f0 [ 6728.606500][ C1] ? run_timer_softirq+0x72/0x100 [ 6728.606751][ C1] ? __pfx_ip_output+0x10/0x10 [ 6728.606988][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6728.607292][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6728.607546][ C1] ? ip_local_out+0x114/0x3b0 [ 6728.607787][ C1] __ip_queue_xmit+0x672/0x1910 [ 6728.608035][ C1] ? __create_object+0x5e/0xb0 [ 6728.608278][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6728.608551][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6728.608826][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6728.609092][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6728.609367][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6728.609634][ C1] tcp_delack_timer+0x84/0x240 [ 6728.609872][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6728.610138][ C1] call_timer_fn+0x173/0x430 [ 6728.610370][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6728.610626][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6728.610882][ C1] __run_timers.part.0+0x52d/0x890 [ 6728.611138][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6728.611404][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6728.611680][ C1] ? lock_acquire+0x1c1/0x220 [ 6728.611914][ C1] ? clockevents_program_event+0xf6/0x300 [ 6728.612198][ C1] ? lock_release+0x1d5/0x250 [ 6728.612430][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6728.612689][ C1] ? ktime_get+0xb3/0x190 [ 6728.612905][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6728.613195][ C1] run_timer_softirq+0x72/0x100 [ 6728.613436][ C1] __do_softirq+0x1b9/0x7ff [ 6728.613665][ C1] irq_exit_rcu+0x98/0xc0 [ 6728.613880][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6728.614160][ C1] [ 6728.614304][ C1] [ 6728.614453][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6728.614749][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6728.615067][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6728.616014][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6728.616313][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6728.616705][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6728.617099][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6728.617513][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6728.617911][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6728.618325][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6728.618613][ C1] pipe_read+0xa16/0xdf0 [ 6728.618831][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6728.619101][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6728.619341][ C1] ? iterate_tty_write+0x299/0x540 [ 6728.619596][ C1] ? lock_release+0x1d5/0x250 [ 6728.619831][ C1] vfs_read+0x911/0xc00 [ 6728.620039][ C1] ? lock_acquire+0x1c1/0x220 [ 6728.620274][ C1] ? __might_fault+0xc6/0x180 [ 6728.620506][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6728.620742][ C1] ? __might_fault+0xc6/0x180 [ 6728.620976][ C1] ? lock_release+0x1d5/0x250 [ 6728.621212][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6728.621471][ C1] ? __fget_light+0x54/0x1e0 [ 6728.621702][ C1] ksys_read+0x17a/0x1e0 [ 6728.621915][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6728.622155][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6728.622451][ C1] do_syscall_64+0xc9/0x1e0 [ 6728.622679][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6728.622973][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6728.623195][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6728.624141][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6728.624554][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6728.624942][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6728.625335][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6728.625725][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6728.626114][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6728.626506][ C1] [ 6728.626661][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4075s! [swapper/2:0] [ 6728.627062][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6728.628331][ C2] irq event stamp: 44114564 [ 6728.628552][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6728.629069][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6728.629563][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6728.630024][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6728.630479][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6728.630920][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6728.631511][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6728.631825][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6728.632761][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6728.633057][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6728.633443][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6728.633828][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6728.634211][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6728.634595][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6728.634980][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6728.635412][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6728.635733][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6728.636119][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6728.636505][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6728.636890][ C2] PKRU: 55555554 [ 6728.637066][ C2] Call Trace: [ 6728.637251][ C2] [ 6728.637399][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6728.637659][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6728.637901][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6728.638176][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6728.638452][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6728.638731][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6728.638988][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6728.639283][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6728.639536][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6728.639790][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6728.640087][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6728.640373][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6728.640677][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6728.640956][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6728.641242][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6728.641521][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6728.641820][ C2] ? get_stack_info+0x36/0xc0 [ 6728.642052][ C2] ? lock_acquire+0x1c1/0x220 [ 6728.642286][ C2] ? lock_release+0x1d5/0x250 [ 6728.642518][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6728.642757][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6728.643021][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6728.643295][ C2] ? lock_acquire+0x1c1/0x220 [ 6728.643531][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6728.643765][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6728.644017][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6728.644244][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6728.644482][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6728.644730][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6728.644996][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6728.645265][ C2] ip_local_deliver+0x19d/0x480 [ 6728.645504][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6728.645767][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6728.646021][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6728.646357][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6728.646601][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6728.646911][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6728.647187][ C2] ip_rcv+0x564/0x740 [ 6728.647391][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6728.647619][ C2] ? set_track_prepare+0x8a/0xd0 [ 6728.647870][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6728.648148][ C2] ? start_secondary+0x21c/0x2b0 [ 6728.648406][ C2] ? skb_clone+0x10b/0x330 [ 6728.648626][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6728.648934][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6728.649231][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6728.649503][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6728.649788][ C2] ? __tcf_classify+0x329/0x7d0 [ 6728.650027][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6728.650250][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6728.650540][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6728.650815][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6728.651129][ C2] ? lock_acquire+0x1c1/0x220 [ 6728.651361][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6728.651647][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6728.651922][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6728.652229][ C2] ? __copy_skb_header+0xaf/0x490 [ 6728.652478][ C2] ? __skb_clone+0x57a/0x760 [ 6728.652706][ C2] netif_receive_skb+0x55/0x280 [ 6728.652946][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6728.653245][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6728.653568][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6728.653856][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6728.654120][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6728.654401][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6728.654703][ C2] ? get_stack_info+0x36/0xc0 [ 6728.654934][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6728.655190][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6728.655495][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6728.655765][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6728.656032][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6728.656337][ C2] ? kernel_text_address+0x17/0xe0 [ 6728.656588][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6728.656890][ C2] ? arch_stack_walk+0x8c/0x100 [ 6728.657153][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6728.657415][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6728.657696][ C2] ? lock_acquire+0x1c1/0x220 [ 6728.657934][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6728.658213][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6728.658519][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6728.658786][ C2] ? get_stack_info+0x36/0xc0 [ 6728.659021][ C2] __tcf_classify+0x329/0x7d0 [ 6728.659255][ C2] tcf_classify+0x283/0x930 [ 6728.659481][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6728.659729][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6728.660029][ C2] tc_run+0x2e4/0x5d0 [ 6728.660229][ C2] ? __pfx_tc_run+0x10/0x10 [ 6728.660451][ C2] ? lock_acquire+0x1c1/0x220 [ 6728.660682][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6728.660933][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6728.661177][ C2] ? lock_acquire+0x1c1/0x220 [ 6728.661408][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6728.661663][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6728.661958][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6728.662220][ C2] ? neigh_hh_output+0x348/0x590 [ 6728.662463][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6728.662719][ C2] ip_finish_output2+0x786/0x18e0 [ 6728.662967][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6728.663292][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6728.663559][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6728.663803][ C2] ? __ip_finish_output+0x10f/0x770 [ 6728.664061][ C2] ip_output+0x16b/0x4f0 [ 6728.664271][ C2] ? __pfx_ip_output+0x10/0x10 [ 6728.664506][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6728.664772][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6728.665074][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6728.665340][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6728.665585][ C2] ? __alloc_skb+0xd4/0x280 [ 6728.665809][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6728.666069][ C2] ? tcp_fragment+0x168/0x1040 [ 6728.666306][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6728.666552][ C2] ? ip_local_out+0x114/0x3b0 [ 6728.666784][ C2] __ip_queue_xmit+0x672/0x1910 [ 6728.667023][ C2] ? __skb_clone+0x57a/0x760 [ 6728.667276][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6728.667539][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6728.667818][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6728.668058][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6728.668306][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6728.668609][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6728.668919][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6728.669156][ C2] tcp_send_loss_probe+0x348/0x830 [ 6728.669407][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6728.669665][ C2] tcp_write_timer+0x82/0x1d0 [ 6728.669898][ C2] call_timer_fn+0x173/0x430 [ 6728.670125][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6728.670378][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6728.670631][ C2] __run_timers.part.0+0x52d/0x890 [ 6728.670883][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6728.671166][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6728.671447][ C2] ? lock_acquire+0x1c1/0x220 [ 6728.671685][ C2] ? clockevents_program_event+0xf6/0x300 [ 6728.671973][ C2] ? lock_release+0x1d5/0x250 [ 6728.672218][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6728.672471][ C2] ? ktime_get+0xb3/0x190 [ 6728.672687][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6728.672976][ C2] run_timer_softirq+0x72/0x100 [ 6728.673215][ C2] __do_softirq+0x1b9/0x7ff [ 6728.673441][ C2] irq_exit_rcu+0x98/0xc0 [ 6728.673652][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6728.673930][ C2] [ 6728.674074][ C2] [ 6728.674221][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6728.674514][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6728.674762][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6728.675699][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6728.675996][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6728.676382][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6728.676768][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6728.677173][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6728.677567][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6728.677965][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6728.678253][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6728.678516][ C2] default_idle_call+0x69/0xa0 [ 6728.678751][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6728.678994][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6728.679262][ C2] ? lock_release+0x1d5/0x250 [ 6728.679497][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6728.679761][ C2] do_idle+0xfb/0x160 [ 6728.679957][ C2] cpu_startup_entry+0x55/0x60 [ 6728.680194][ C2] start_secondary+0x21c/0x2b0 [ 6728.680429][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6728.680689][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6728.680990][ C2] [ 6752.187118][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6752.187480][ C1] rcu: 1-....: (4386567 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1075522 [ 6752.188040][ C1] rcu: (t=4397300 jiffies g=1882453 q=718 ncpus=4) [ 6752.188378][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6752.188814][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6752.189410][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 6752.189688][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 6752.190634][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 6752.190934][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6752.191326][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6752.191714][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6752.192102][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6752.192493][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6752.192882][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6752.193317][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6752.193641][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6752.194034][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6752.194426][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6752.194815][ C1] PKRU: 55555554 [ 6752.194993][ C1] Call Trace: [ 6752.195159][ C1] [ 6752.195302][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6752.195567][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6752.195813][ C1] ? check_cpu_stall+0x284/0x500 [ 6752.196059][ C1] ? rcu_pending+0x92/0x360 [ 6752.196285][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6752.196547][ C1] ? update_process_times+0xb9/0x110 [ 6752.196809][ C1] ? tick_sched_handle+0x67/0x130 [ 6752.197079][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6752.197363][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6752.197607][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6752.197920][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6752.198192][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6752.198482][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6752.198753][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6752.199051][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6752.199307][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6752.199608][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6752.199895][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6752.200202][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6752.200485][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 6752.200759][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6752.201034][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6752.201338][ C1] ? get_stack_info+0x36/0xc0 [ 6752.201573][ C1] ? lock_acquire+0x1c1/0x220 [ 6752.201808][ C1] ? lock_release+0x1d5/0x250 [ 6752.202041][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6752.202282][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6752.202555][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6752.202832][ C1] ? lock_acquire+0x1c1/0x220 [ 6752.203066][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6752.203299][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6752.203553][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6752.203780][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6752.204021][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6752.204273][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6752.204541][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6752.204813][ C1] ip_local_deliver+0x19d/0x480 [ 6752.205053][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6752.205320][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6752.205578][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6752.205915][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6752.206162][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6752.206473][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6752.206728][ C1] ip_rcv+0x564/0x740 [ 6752.206925][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6752.207175][ C1] ? set_track_prepare+0x8a/0xd0 [ 6752.207428][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6752.207705][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6752.207978][ C1] ? skb_clone+0x10b/0x330 [ 6752.208215][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6752.208526][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6752.208825][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6752.209099][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6752.209387][ C1] ? __tcf_classify+0x329/0x7d0 [ 6752.209630][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6752.209854][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6752.210147][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6752.210424][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6752.210741][ C1] ? lock_acquire+0x1c1/0x220 [ 6752.210975][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6752.211265][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6752.211542][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6752.211851][ C1] ? __copy_skb_header+0xaf/0x490 [ 6752.212103][ C1] ? __skb_clone+0x57a/0x760 [ 6752.212333][ C1] netif_receive_skb+0x55/0x280 [ 6752.212576][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6752.212880][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6752.213205][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6752.213496][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6752.213765][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6752.214047][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6752.214352][ C1] ? hlock_class+0x4e/0x130 [ 6752.214576][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6752.214846][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6752.215135][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6752.215398][ C1] ? hlock_class+0x4e/0x130 [ 6752.215630][ C1] ? mark_lock+0x38/0x3e0 [ 6752.215850][ C1] ? stack_access_ok+0xda/0x1f0 [ 6752.216099][ C1] ? __lock_acquire+0xb67/0x1610 [ 6752.216354][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6752.216630][ C1] ? get_stack_info+0x36/0xc0 [ 6752.216872][ C1] ? stack_access_ok+0xda/0x1f0 [ 6752.217123][ C1] ? get_reg+0x119/0x190 [ 6752.217339][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6752.217607][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6752.217919][ C1] __tcf_classify+0x329/0x7d0 [ 6752.218162][ C1] tcf_classify+0x283/0x930 [ 6752.218395][ C1] ? arch_stack_walk+0xa2/0x100 [ 6752.218643][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6752.218900][ C1] ? get_stack_info+0x36/0xc0 [ 6752.219143][ C1] tc_run+0x2e4/0x5d0 [ 6752.219348][ C1] ? __pfx_tc_run+0x10/0x10 [ 6752.219582][ C1] ? lock_acquire+0x1c1/0x220 [ 6752.219822][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6752.220084][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6752.220338][ C1] ? lock_acquire+0x1c1/0x220 [ 6752.220577][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6752.220843][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6752.221148][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6752.221423][ C1] ? neigh_hh_output+0x348/0x590 [ 6752.221676][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6752.221943][ C1] ip_finish_output2+0x786/0x18e0 [ 6752.222199][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6752.222477][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6752.222814][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6752.223090][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6752.223343][ C1] ? __ip_finish_output+0x10f/0x770 [ 6752.223611][ C1] ip_output+0x16b/0x4f0 [ 6752.223829][ C1] ? run_timer_softirq+0x72/0x100 [ 6752.224087][ C1] ? __pfx_ip_output+0x10/0x10 [ 6752.224332][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6752.224618][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6752.224870][ C1] ? ip_local_out+0x114/0x3b0 [ 6752.225111][ C1] __ip_queue_xmit+0x672/0x1910 [ 6752.225360][ C1] ? __create_object+0x5e/0xb0 [ 6752.225607][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6752.225875][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6752.226158][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6752.226430][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6752.226713][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6752.226986][ C1] tcp_delack_timer+0x84/0x240 [ 6752.227235][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6752.227508][ C1] call_timer_fn+0x173/0x430 [ 6752.227746][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6752.228009][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6752.228271][ C1] __run_timers.part.0+0x52d/0x890 [ 6752.228532][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6752.228806][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6752.229091][ C1] ? lock_acquire+0x1c1/0x220 [ 6752.229330][ C1] ? clockevents_program_event+0xf6/0x300 [ 6752.229623][ C1] ? lock_release+0x1d5/0x250 [ 6752.229862][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6752.230128][ C1] ? ktime_get+0xb3/0x190 [ 6752.230348][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6752.230647][ C1] run_timer_softirq+0x72/0x100 [ 6752.230896][ C1] __do_softirq+0x1b9/0x7ff [ 6752.231128][ C1] irq_exit_rcu+0x98/0xc0 [ 6752.231350][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6752.231636][ C1] [ 6752.231787][ C1] [ 6752.231939][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6752.232244][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6752.232570][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6752.233545][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6752.233854][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6752.234253][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6752.234653][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6752.235053][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6752.235454][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6752.235857][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6752.236154][ C1] pipe_read+0xa16/0xdf0 [ 6752.236376][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6752.236653][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6752.236898][ C1] ? iterate_tty_write+0x299/0x540 [ 6752.237163][ C1] ? lock_release+0x1d5/0x250 [ 6752.237405][ C1] vfs_read+0x911/0xc00 [ 6752.237618][ C1] ? lock_acquire+0x1c1/0x220 [ 6752.237858][ C1] ? __might_fault+0xc6/0x180 [ 6752.238099][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6752.238337][ C1] ? __might_fault+0xc6/0x180 [ 6752.238579][ C1] ? lock_release+0x1d5/0x250 [ 6752.238819][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6752.239085][ C1] ? __fget_light+0x54/0x1e0 [ 6752.239323][ C1] ksys_read+0x17a/0x1e0 [ 6752.239540][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6752.239786][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6752.240092][ C1] do_syscall_64+0xc9/0x1e0 [ 6752.240324][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6752.240625][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6752.240853][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6752.241825][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6752.242247][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6752.242645][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6752.243048][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6752.243448][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6752.243847][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6752.244248][ C1] [ 6752.244408][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6752.244680][ C2] NMI backtrace for cpu 2 [ 6752.244685][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6752.244691][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6752.244695][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6752.244702][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6752.244708][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6752.244712][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6752.244716][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6752.244720][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6752.244724][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6752.244728][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6752.244732][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6752.244736][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6752.244741][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6752.244745][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6752.244748][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6752.244752][ C2] PKRU: 55555554 [ 6752.244754][ C2] Call Trace: [ 6752.244756][ C2] [ 6752.244759][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6752.244771][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6752.244778][ C2] ? nmi_handle+0x153/0x420 [ 6752.244788][ C2] ? default_do_nmi+0x41/0x100 [ 6752.244794][ C2] ? exc_nmi+0xf3/0x120 [ 6752.244800][ C2] ? end_repeat_nmi+0xf/0x60 [ 6752.244812][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6752.244820][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6752.244828][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6752.244836][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6752.244844][ C2] [ 6752.244846][ C2] [ 6752.244849][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6752.244856][ C2] ? get_stack_info+0x36/0xc0 [ 6752.244864][ C2] ? lock_acquire+0x1c1/0x220 [ 6752.244872][ C2] ? lock_release+0x1d5/0x250 [ 6752.244881][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6752.244889][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6752.244894][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6752.244897][ C2] ? lock_acquire+0x1c1/0x220 [ 6752.244900][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6752.244903][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6752.244906][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6752.244912][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6752.244914][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6752.244919][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6752.244923][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6752.244926][ C2] ip_local_deliver+0x19d/0x480 [ 6752.244929][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6752.244931][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6752.244933][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6752.244938][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6752.244942][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6752.244945][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6752.244953][ C2] ip_rcv+0x564/0x740 [ 6752.244956][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6752.244958][ C2] ? set_track_prepare+0x8a/0xd0 [ 6752.244962][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6752.244965][ C2] ? start_secondary+0x21c/0x2b0 [ 6752.244968][ C2] ? skb_clone+0x10b/0x330 [ 6752.244970][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6752.244976][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6752.244981][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6752.244984][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6752.244992][ C2] ? __tcf_classify+0x329/0x7d0 [ 6752.244995][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6752.244998][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6752.245001][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6752.245004][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6752.245008][ C2] ? lock_acquire+0x1c1/0x220 [ 6752.245011][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6752.245015][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6752.245018][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6752.245022][ C2] ? __copy_skb_header+0xaf/0x490 [ 6752.245026][ C2] ? __skb_clone+0x57a/0x760 [ 6752.245029][ C2] netif_receive_skb+0x55/0x280 [ 6752.245032][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6752.245038][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6752.245045][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6752.245051][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6752.245056][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6752.245066][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6752.245073][ C2] ? get_stack_info+0x36/0xc0 [ 6752.245078][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6752.245081][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6752.245084][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6752.245087][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6752.245090][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6752.245092][ C2] ? kernel_text_address+0x17/0xe0 [ 6752.245096][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6752.245099][ C2] ? arch_stack_walk+0x8c/0x100 [ 6752.245102][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6752.245106][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6752.245109][ C2] ? lock_acquire+0x1c1/0x220 [ 6752.245111][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6752.245115][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6752.245118][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6752.245121][ C2] ? get_stack_info+0x36/0xc0 [ 6752.245125][ C2] __tcf_classify+0x329/0x7d0 [ 6752.245130][ C2] tcf_classify+0x283/0x930 [ 6752.245134][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6752.245137][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6752.245142][ C2] tc_run+0x2e4/0x5d0 [ 6752.245145][ C2] ? __pfx_tc_run+0x10/0x10 [ 6752.245148][ C2] ? lock_acquire+0x1c1/0x220 [ 6752.245150][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6752.245154][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6752.245158][ C2] ? lock_acquire+0x1c1/0x220 [ 6752.245160][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6752.245163][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6752.245166][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6752.245169][ C2] ? neigh_hh_output+0x348/0x590 [ 6752.245172][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6752.245176][ C2] ip_finish_output2+0x786/0x18e0 [ 6752.245179][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6752.245187][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6752.245189][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6752.245193][ C2] ? __ip_finish_output+0x10f/0x770 [ 6752.245197][ C2] ip_output+0x16b/0x4f0 [ 6752.245200][ C2] ? __pfx_ip_output+0x10/0x10 [ 6752.245202][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6752.245205][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6752.245208][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6752.245211][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6752.245213][ C2] ? __alloc_skb+0xd4/0x280 [ 6752.245216][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6752.245219][ C2] ? tcp_fragment+0x168/0x1040 [ 6752.245222][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6752.245225][ C2] ? ip_local_out+0x114/0x3b0 [ 6752.245229][ C2] __ip_queue_xmit+0x672/0x1910 [ 6752.245232][ C2] ? __skb_clone+0x57a/0x760 [ 6752.245235][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6752.245241][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6752.245244][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6752.245247][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6752.245251][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6752.245255][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6752.245258][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6752.245261][ C2] tcp_send_loss_probe+0x348/0x830 [ 6752.245264][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6752.245267][ C2] tcp_write_timer+0x82/0x1d0 [ 6752.245270][ C2] call_timer_fn+0x173/0x430 [ 6752.245274][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6752.245278][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6752.245282][ C2] __run_timers.part.0+0x52d/0x890 [ 6752.245285][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6752.245289][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6752.245292][ C2] ? lock_acquire+0x1c1/0x220 [ 6752.245294][ C2] ? clockevents_program_event+0xf6/0x300 [ 6752.245298][ C2] ? lock_release+0x1d5/0x250 [ 6752.245301][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6752.245304][ C2] ? ktime_get+0xb3/0x190 [ 6752.245307][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6752.245311][ C2] run_timer_softirq+0x72/0x100 [ 6752.245315][ C2] __do_softirq+0x1b9/0x7ff [ 6752.245319][ C2] irq_exit_rcu+0x98/0xc0 [ 6752.245321][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6752.245324][ C2] [ 6752.245325][ C2] [ 6752.245326][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6752.245329][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6752.245332][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6752.245334][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6752.245336][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6752.245338][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6752.245339][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6752.245340][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6752.245342][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6752.245344][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6752.245347][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6752.245350][ C2] default_idle_call+0x69/0xa0 [ 6752.245353][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6752.245356][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6752.245359][ C2] ? lock_release+0x1d5/0x250 [ 6752.245362][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6752.245365][ C2] do_idle+0xfb/0x160 [ 6752.245368][ C2] cpu_startup_entry+0x55/0x60 [ 6752.245370][ C2] start_secondary+0x21c/0x2b0 [ 6752.245373][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6752.245377][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6752.245383][ C2] [ 6776.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4120s! [perl:4135] [ 6776.569677][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6776.570897][ C1] irq event stamp: 209232 [ 6776.571112][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6776.571626][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6776.572089][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6776.572547][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6776.572996][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6776.573432][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6776.574027][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6776.574345][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6776.575291][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6776.575589][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6776.575981][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6776.576370][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6776.576758][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6776.577171][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6776.577577][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6776.578025][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6776.578365][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6776.578754][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6776.579143][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6776.579533][ C1] PKRU: 55555554 [ 6776.579710][ C1] Call Trace: [ 6776.579874][ C1] [ 6776.580019][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6776.580274][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6776.580510][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6776.580781][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6776.581046][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6776.581327][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6776.581587][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6776.581882][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6776.582139][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6776.582439][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6776.582728][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6776.583035][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6776.583315][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6776.583604][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6776.583884][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6776.584190][ C1] ? get_stack_info+0x36/0xc0 [ 6776.584425][ C1] ? lock_acquire+0x1c1/0x220 [ 6776.584660][ C1] ? lock_release+0x1d5/0x250 [ 6776.584893][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6776.585134][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6776.585402][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6776.585678][ C1] ? lock_acquire+0x1c1/0x220 [ 6776.585912][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6776.586147][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6776.586400][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6776.586627][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6776.586868][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6776.587141][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6776.587415][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6776.587695][ C1] ip_local_deliver+0x19d/0x480 [ 6776.587943][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6776.588224][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6776.588480][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6776.588816][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6776.589063][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6776.589375][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6776.589630][ C1] ip_rcv+0x564/0x740 [ 6776.589830][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6776.590055][ C1] ? set_track_prepare+0x8a/0xd0 [ 6776.590303][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6776.590571][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6776.590838][ C1] ? skb_clone+0x10b/0x330 [ 6776.591059][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6776.591370][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6776.591669][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6776.591942][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6776.592231][ C1] ? __tcf_classify+0x329/0x7d0 [ 6776.592472][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6776.592695][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6776.592989][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6776.593267][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6776.593584][ C1] ? lock_acquire+0x1c1/0x220 [ 6776.593817][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6776.594108][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6776.594384][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6776.594693][ C1] ? __copy_skb_header+0xaf/0x490 [ 6776.594943][ C1] ? __skb_clone+0x57a/0x760 [ 6776.595172][ C1] netif_receive_skb+0x55/0x280 [ 6776.595414][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6776.595719][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6776.596044][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6776.596334][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6776.596602][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6776.596884][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6776.597217][ C1] ? hlock_class+0x4e/0x130 [ 6776.597448][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6776.597727][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6776.598004][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6776.598274][ C1] ? hlock_class+0x4e/0x130 [ 6776.598500][ C1] ? mark_lock+0x38/0x3e0 [ 6776.598713][ C1] ? stack_access_ok+0xda/0x1f0 [ 6776.598956][ C1] ? __lock_acquire+0xb67/0x1610 [ 6776.599204][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6776.599472][ C1] ? get_stack_info+0x36/0xc0 [ 6776.599708][ C1] ? stack_access_ok+0xda/0x1f0 [ 6776.599949][ C1] ? get_reg+0x119/0x190 [ 6776.600159][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6776.600422][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6776.600722][ C1] __tcf_classify+0x329/0x7d0 [ 6776.600958][ C1] tcf_classify+0x283/0x930 [ 6776.601185][ C1] ? arch_stack_walk+0xa2/0x100 [ 6776.601427][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6776.601677][ C1] ? get_stack_info+0x36/0xc0 [ 6776.601910][ C1] tc_run+0x2e4/0x5d0 [ 6776.602111][ C1] ? __pfx_tc_run+0x10/0x10 [ 6776.602337][ C1] ? lock_acquire+0x1c1/0x220 [ 6776.602570][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6776.602825][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6776.603072][ C1] ? lock_acquire+0x1c1/0x220 [ 6776.603306][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6776.603564][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6776.603862][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6776.604129][ C1] ? neigh_hh_output+0x348/0x590 [ 6776.604376][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6776.604633][ C1] ip_finish_output2+0x786/0x18e0 [ 6776.604883][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6776.605152][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6776.605481][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6776.605752][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6776.605998][ C1] ? __ip_finish_output+0x10f/0x770 [ 6776.606257][ C1] ip_output+0x16b/0x4f0 [ 6776.606466][ C1] ? run_timer_softirq+0x72/0x100 [ 6776.606717][ C1] ? __pfx_ip_output+0x10/0x10 [ 6776.606988][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6776.607275][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6776.607527][ C1] ? ip_local_out+0x114/0x3b0 [ 6776.607769][ C1] __ip_queue_xmit+0x672/0x1910 [ 6776.608018][ C1] ? __create_object+0x5e/0xb0 [ 6776.608271][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6776.608531][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6776.608806][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6776.609072][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6776.609349][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6776.609614][ C1] tcp_delack_timer+0x84/0x240 [ 6776.609852][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6776.610118][ C1] call_timer_fn+0x173/0x430 [ 6776.610350][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6776.610606][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6776.610862][ C1] __run_timers.part.0+0x52d/0x890 [ 6776.611116][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6776.611383][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6776.611664][ C1] ? lock_acquire+0x1c1/0x220 [ 6776.611896][ C1] ? clockevents_program_event+0xf6/0x300 [ 6776.612182][ C1] ? lock_release+0x1d5/0x250 [ 6776.612417][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6776.612675][ C1] ? ktime_get+0xb3/0x190 [ 6776.612889][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6776.613180][ C1] run_timer_softirq+0x72/0x100 [ 6776.613424][ C1] __do_softirq+0x1b9/0x7ff [ 6776.613650][ C1] irq_exit_rcu+0x98/0xc0 [ 6776.613868][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6776.614147][ C1] [ 6776.614296][ C1] [ 6776.614442][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6776.614740][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6776.615058][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6776.616008][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6776.616310][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6776.616700][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6776.617113][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6776.617516][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6776.617918][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6776.618325][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6776.618615][ C1] pipe_read+0xa16/0xdf0 [ 6776.618830][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6776.619100][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6776.619340][ C1] ? iterate_tty_write+0x299/0x540 [ 6776.619595][ C1] ? lock_release+0x1d5/0x250 [ 6776.619831][ C1] vfs_read+0x911/0xc00 [ 6776.620041][ C1] ? lock_acquire+0x1c1/0x220 [ 6776.620276][ C1] ? __might_fault+0xc6/0x180 [ 6776.620512][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6776.620746][ C1] ? __might_fault+0xc6/0x180 [ 6776.620980][ C1] ? lock_release+0x1d5/0x250 [ 6776.621215][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6776.621476][ C1] ? __fget_light+0x54/0x1e0 [ 6776.621709][ C1] ksys_read+0x17a/0x1e0 [ 6776.621920][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6776.622161][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6776.622460][ C1] do_syscall_64+0xc9/0x1e0 [ 6776.622686][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6776.622982][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6776.623206][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6776.624157][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6776.624571][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6776.624964][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6776.625355][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6776.625746][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6776.626139][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6776.626533][ C1] [ 6776.626686][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4120s! [swapper/2:0] [ 6776.627109][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6776.628353][ C2] irq event stamp: 44114564 [ 6776.628575][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6776.629093][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6776.629587][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6776.630046][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6776.630503][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6776.630943][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6776.631534][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6776.631849][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6776.632791][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6776.633086][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6776.633475][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6776.633860][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6776.634246][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6776.634630][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6776.635018][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6776.635452][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6776.635773][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6776.636161][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6776.636548][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6776.636956][ C2] PKRU: 55555554 [ 6776.637136][ C2] Call Trace: [ 6776.637303][ C2] [ 6776.637451][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6776.637711][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6776.637951][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6776.638235][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6776.638497][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6776.638776][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6776.639033][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6776.639326][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6776.639580][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6776.639834][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6776.640132][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6776.640418][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6776.640722][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6776.641001][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6776.641289][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6776.641568][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6776.641868][ C2] ? get_stack_info+0x36/0xc0 [ 6776.642101][ C2] ? lock_acquire+0x1c1/0x220 [ 6776.642334][ C2] ? lock_release+0x1d5/0x250 [ 6776.642566][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6776.642805][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6776.643070][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6776.643344][ C2] ? lock_acquire+0x1c1/0x220 [ 6776.643576][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6776.643808][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6776.644061][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6776.644286][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6776.644526][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6776.644774][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6776.645038][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6776.645307][ C2] ip_local_deliver+0x19d/0x480 [ 6776.645547][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6776.645808][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6776.646063][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6776.646396][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6776.646640][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6776.646971][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6776.647231][ C2] ip_rcv+0x564/0x740 [ 6776.647435][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6776.647663][ C2] ? set_track_prepare+0x8a/0xd0 [ 6776.647914][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6776.648195][ C2] ? start_secondary+0x21c/0x2b0 [ 6776.648438][ C2] ? skb_clone+0x10b/0x330 [ 6776.648658][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6776.648967][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6776.649263][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6776.649535][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6776.649819][ C2] ? __tcf_classify+0x329/0x7d0 [ 6776.650058][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6776.650282][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6776.650572][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6776.650847][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6776.651161][ C2] ? lock_acquire+0x1c1/0x220 [ 6776.651392][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6776.651677][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6776.651953][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6776.652260][ C2] ? __copy_skb_header+0xaf/0x490 [ 6776.652509][ C2] ? __skb_clone+0x57a/0x760 [ 6776.652736][ C2] netif_receive_skb+0x55/0x280 [ 6776.652975][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6776.653276][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6776.653596][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6776.653886][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6776.654150][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6776.654430][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6776.654731][ C2] ? get_stack_info+0x36/0xc0 [ 6776.654964][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6776.655218][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6776.655524][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6776.655793][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6776.656080][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6776.656396][ C2] ? kernel_text_address+0x17/0xe0 [ 6776.656654][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6776.656969][ C2] ? arch_stack_walk+0x8c/0x100 [ 6776.657216][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6776.657481][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6776.657762][ C2] ? lock_acquire+0x1c1/0x220 [ 6776.657999][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6776.658284][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6776.658578][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6776.658843][ C2] ? get_stack_info+0x36/0xc0 [ 6776.659077][ C2] __tcf_classify+0x329/0x7d0 [ 6776.659311][ C2] tcf_classify+0x283/0x930 [ 6776.659535][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6776.659783][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6776.660085][ C2] tc_run+0x2e4/0x5d0 [ 6776.660284][ C2] ? __pfx_tc_run+0x10/0x10 [ 6776.660507][ C2] ? lock_acquire+0x1c1/0x220 [ 6776.660738][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6776.660991][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6776.661235][ C2] ? lock_acquire+0x1c1/0x220 [ 6776.661467][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6776.661722][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6776.662014][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6776.662278][ C2] ? neigh_hh_output+0x348/0x590 [ 6776.662522][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6776.662778][ C2] ip_finish_output2+0x786/0x18e0 [ 6776.663027][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6776.663352][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6776.663618][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6776.663862][ C2] ? __ip_finish_output+0x10f/0x770 [ 6776.664119][ C2] ip_output+0x16b/0x4f0 [ 6776.664330][ C2] ? __pfx_ip_output+0x10/0x10 [ 6776.664565][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6776.664831][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6776.665132][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6776.665399][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6776.665641][ C2] ? __alloc_skb+0xd4/0x280 [ 6776.665865][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6776.666125][ C2] ? tcp_fragment+0x168/0x1040 [ 6776.666361][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6776.666604][ C2] ? ip_local_out+0x114/0x3b0 [ 6776.666833][ C2] __ip_queue_xmit+0x672/0x1910 [ 6776.667098][ C2] ? __skb_clone+0x57a/0x760 [ 6776.667333][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6776.667597][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6776.667875][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6776.668127][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6776.668368][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6776.668659][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6776.668966][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6776.669203][ C2] tcp_send_loss_probe+0x348/0x830 [ 6776.669455][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6776.669714][ C2] tcp_write_timer+0x82/0x1d0 [ 6776.669945][ C2] call_timer_fn+0x173/0x430 [ 6776.670172][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6776.670425][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6776.670679][ C2] __run_timers.part.0+0x52d/0x890 [ 6776.670931][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6776.671195][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6776.671469][ C2] ? lock_acquire+0x1c1/0x220 [ 6776.671720][ C2] ? clockevents_program_event+0xf6/0x300 [ 6776.672005][ C2] ? lock_release+0x1d5/0x250 [ 6776.672244][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6776.672505][ C2] ? ktime_get+0xb3/0x190 [ 6776.672726][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6776.673021][ C2] run_timer_softirq+0x72/0x100 [ 6776.673261][ C2] __do_softirq+0x1b9/0x7ff [ 6776.673486][ C2] irq_exit_rcu+0x98/0xc0 [ 6776.673697][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6776.673974][ C2] [ 6776.674119][ C2] [ 6776.674264][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6776.674557][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6776.674804][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6776.675739][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6776.676037][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6776.676420][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6776.676808][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6776.677218][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6776.677611][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6776.678008][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6776.678304][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6776.678556][ C2] default_idle_call+0x69/0xa0 [ 6776.678792][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6776.679036][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6776.679303][ C2] ? lock_release+0x1d5/0x250 [ 6776.679535][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6776.679798][ C2] do_idle+0xfb/0x160 [ 6776.679996][ C2] cpu_startup_entry+0x55/0x60 [ 6776.680231][ C2] start_secondary+0x21c/0x2b0 [ 6776.680467][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6776.680727][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6776.681026][ C2] [ 6804.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4146s! [perl:4135] [ 6804.569675][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6804.570893][ C1] irq event stamp: 209232 [ 6804.571106][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6804.571618][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6804.572084][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6804.572541][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6804.572992][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6804.573429][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6804.574027][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6804.574343][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6804.575289][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6804.575590][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6804.575978][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6804.576367][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6804.576757][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6804.577177][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6804.577576][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6804.578032][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6804.578356][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6804.578749][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6804.579139][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6804.579529][ C1] PKRU: 55555554 [ 6804.579707][ C1] Call Trace: [ 6804.579873][ C1] [ 6804.580017][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6804.580272][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6804.580509][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6804.580778][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6804.581043][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6804.581326][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6804.581587][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6804.581885][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6804.582141][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6804.582442][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6804.582728][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6804.583034][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6804.583318][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6804.583605][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6804.583889][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6804.584193][ C1] ? get_stack_info+0x36/0xc0 [ 6804.584426][ C1] ? lock_acquire+0x1c1/0x220 [ 6804.584662][ C1] ? lock_release+0x1d5/0x250 [ 6804.584896][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6804.585140][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6804.585404][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6804.585681][ C1] ? lock_acquire+0x1c1/0x220 [ 6804.585914][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6804.586149][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6804.586403][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6804.586633][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6804.586894][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6804.587152][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6804.587428][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6804.587705][ C1] ip_local_deliver+0x19d/0x480 [ 6804.587953][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6804.588229][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6804.588485][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6804.588825][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6804.589072][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6804.589385][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6804.589641][ C1] ip_rcv+0x564/0x740 [ 6804.589843][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6804.590068][ C1] ? set_track_prepare+0x8a/0xd0 [ 6804.590315][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6804.590587][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6804.590853][ C1] ? skb_clone+0x10b/0x330 [ 6804.591075][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6804.591386][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6804.591686][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6804.591961][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6804.592248][ C1] ? __tcf_classify+0x329/0x7d0 [ 6804.592491][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6804.592717][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6804.593007][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6804.593288][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6804.593606][ C1] ? lock_acquire+0x1c1/0x220 [ 6804.593838][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6804.594127][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6804.594406][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6804.594715][ C1] ? __copy_skb_header+0xaf/0x490 [ 6804.594967][ C1] ? __skb_clone+0x57a/0x760 [ 6804.595196][ C1] netif_receive_skb+0x55/0x280 [ 6804.595439][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6804.595744][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6804.596068][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6804.596361][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6804.596628][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6804.596931][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6804.597246][ C1] ? hlock_class+0x4e/0x130 [ 6804.597479][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6804.597755][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6804.598039][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6804.598298][ C1] ? hlock_class+0x4e/0x130 [ 6804.598525][ C1] ? mark_lock+0x38/0x3e0 [ 6804.598739][ C1] ? stack_access_ok+0xda/0x1f0 [ 6804.598979][ C1] ? __lock_acquire+0xb67/0x1610 [ 6804.599227][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6804.599499][ C1] ? get_stack_info+0x36/0xc0 [ 6804.599731][ C1] ? stack_access_ok+0xda/0x1f0 [ 6804.599973][ C1] ? get_reg+0x119/0x190 [ 6804.600186][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6804.600447][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6804.600749][ C1] __tcf_classify+0x329/0x7d0 [ 6804.600983][ C1] tcf_classify+0x283/0x930 [ 6804.601212][ C1] ? arch_stack_walk+0xa2/0x100 [ 6804.601454][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6804.601705][ C1] ? get_stack_info+0x36/0xc0 [ 6804.601941][ C1] tc_run+0x2e4/0x5d0 [ 6804.602141][ C1] ? __pfx_tc_run+0x10/0x10 [ 6804.602366][ C1] ? lock_acquire+0x1c1/0x220 [ 6804.602599][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6804.602854][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6804.603101][ C1] ? lock_acquire+0x1c1/0x220 [ 6804.603334][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6804.603592][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6804.603891][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6804.604156][ C1] ? neigh_hh_output+0x348/0x590 [ 6804.604402][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6804.604661][ C1] ip_finish_output2+0x786/0x18e0 [ 6804.604909][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6804.605180][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6804.605510][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6804.605779][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6804.606027][ C1] ? __ip_finish_output+0x10f/0x770 [ 6804.606285][ C1] ip_output+0x16b/0x4f0 [ 6804.606494][ C1] ? run_timer_softirq+0x72/0x100 [ 6804.606745][ C1] ? __pfx_ip_output+0x10/0x10 [ 6804.607008][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6804.607297][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6804.607550][ C1] ? ip_local_out+0x114/0x3b0 [ 6804.607789][ C1] __ip_queue_xmit+0x672/0x1910 [ 6804.608049][ C1] ? __create_object+0x5e/0xb0 [ 6804.608287][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6804.608547][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6804.608822][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6804.609090][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6804.609364][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6804.609629][ C1] tcp_delack_timer+0x84/0x240 [ 6804.609866][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6804.610132][ C1] call_timer_fn+0x173/0x430 [ 6804.610363][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6804.610618][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6804.610872][ C1] __run_timers.part.0+0x52d/0x890 [ 6804.611125][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6804.611395][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6804.611672][ C1] ? lock_acquire+0x1c1/0x220 [ 6804.611906][ C1] ? clockevents_program_event+0xf6/0x300 [ 6804.612189][ C1] ? lock_release+0x1d5/0x250 [ 6804.612423][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6804.612683][ C1] ? ktime_get+0xb3/0x190 [ 6804.612899][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6804.613188][ C1] run_timer_softirq+0x72/0x100 [ 6804.613430][ C1] __do_softirq+0x1b9/0x7ff [ 6804.613660][ C1] irq_exit_rcu+0x98/0xc0 [ 6804.613874][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6804.614153][ C1] [ 6804.614300][ C1] [ 6804.614445][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6804.614742][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6804.615058][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6804.616005][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6804.616306][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6804.616697][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6804.617116][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6804.617513][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6804.617912][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6804.618313][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6804.618603][ C1] pipe_read+0xa16/0xdf0 [ 6804.618817][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6804.619089][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6804.619325][ C1] ? iterate_tty_write+0x299/0x540 [ 6804.619580][ C1] ? lock_release+0x1d5/0x250 [ 6804.619815][ C1] vfs_read+0x911/0xc00 [ 6804.620024][ C1] ? lock_acquire+0x1c1/0x220 [ 6804.620256][ C1] ? __might_fault+0xc6/0x180 [ 6804.620491][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6804.620724][ C1] ? __might_fault+0xc6/0x180 [ 6804.620958][ C1] ? lock_release+0x1d5/0x250 [ 6804.621191][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6804.621453][ C1] ? __fget_light+0x54/0x1e0 [ 6804.621685][ C1] ksys_read+0x17a/0x1e0 [ 6804.621897][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6804.622135][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6804.622432][ C1] do_syscall_64+0xc9/0x1e0 [ 6804.622661][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6804.622952][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6804.623175][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6804.624123][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6804.624534][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6804.624923][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6804.625312][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6804.625700][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6804.626091][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6804.626483][ C1] [ 6804.626635][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4146s! [swapper/2:0] [ 6804.627055][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6804.628296][ C2] irq event stamp: 44114564 [ 6804.628517][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6804.629032][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6804.629526][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6804.629983][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6804.630438][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6804.630878][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6804.631466][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6804.631778][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6804.632716][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6804.633011][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6804.633397][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6804.633783][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6804.634167][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6804.634551][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6804.634937][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6804.635369][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6804.635689][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6804.636075][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6804.636459][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6804.636867][ C2] PKRU: 55555554 [ 6804.637045][ C2] Call Trace: [ 6804.637213][ C2] [ 6804.637362][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6804.637621][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6804.637860][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6804.638144][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6804.638406][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6804.638684][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6804.638941][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6804.639234][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6804.639487][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6804.639740][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6804.640038][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6804.640325][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6804.640628][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6804.640906][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6804.641193][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6804.641470][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6804.641772][ C2] ? get_stack_info+0x36/0xc0 [ 6804.642004][ C2] ? lock_acquire+0x1c1/0x220 [ 6804.642237][ C2] ? lock_release+0x1d5/0x250 [ 6804.642468][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6804.642707][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6804.642973][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6804.643248][ C2] ? lock_acquire+0x1c1/0x220 [ 6804.643480][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6804.643712][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6804.643964][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6804.644190][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6804.644428][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6804.644676][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6804.644939][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6804.645210][ C2] ip_local_deliver+0x19d/0x480 [ 6804.645449][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6804.645712][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6804.645966][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6804.646300][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6804.646544][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6804.646875][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6804.647135][ C2] ip_rcv+0x564/0x740 [ 6804.647338][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6804.647567][ C2] ? set_track_prepare+0x8a/0xd0 [ 6804.647818][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6804.648100][ C2] ? start_secondary+0x21c/0x2b0 [ 6804.648343][ C2] ? skb_clone+0x10b/0x330 [ 6804.648564][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6804.648872][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6804.649166][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6804.649460][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6804.649750][ C2] ? __tcf_classify+0x329/0x7d0 [ 6804.649997][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6804.650227][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6804.650535][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6804.650809][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6804.651123][ C2] ? lock_acquire+0x1c1/0x220 [ 6804.651355][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6804.651640][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6804.651916][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6804.652223][ C2] ? __copy_skb_header+0xaf/0x490 [ 6804.652473][ C2] ? __skb_clone+0x57a/0x760 [ 6804.652699][ C2] netif_receive_skb+0x55/0x280 [ 6804.652938][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6804.653242][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6804.653562][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6804.653853][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6804.654116][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6804.654396][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6804.654695][ C2] ? get_stack_info+0x36/0xc0 [ 6804.654931][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6804.655187][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6804.655493][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6804.655760][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6804.656028][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6804.656334][ C2] ? kernel_text_address+0x17/0xe0 [ 6804.656586][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6804.656911][ C2] ? arch_stack_walk+0x8c/0x100 [ 6804.657158][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6804.657421][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6804.657702][ C2] ? lock_acquire+0x1c1/0x220 [ 6804.657939][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6804.658221][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6804.658514][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6804.658780][ C2] ? get_stack_info+0x36/0xc0 [ 6804.659013][ C2] __tcf_classify+0x329/0x7d0 [ 6804.659248][ C2] tcf_classify+0x283/0x930 [ 6804.659471][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6804.659719][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6804.660020][ C2] tc_run+0x2e4/0x5d0 [ 6804.660219][ C2] ? __pfx_tc_run+0x10/0x10 [ 6804.660442][ C2] ? lock_acquire+0x1c1/0x220 [ 6804.660673][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6804.660925][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6804.661171][ C2] ? lock_acquire+0x1c1/0x220 [ 6804.661402][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6804.661659][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6804.661951][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6804.662215][ C2] ? neigh_hh_output+0x348/0x590 [ 6804.662459][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6804.662715][ C2] ip_finish_output2+0x786/0x18e0 [ 6804.662963][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6804.663290][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6804.663556][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6804.663800][ C2] ? __ip_finish_output+0x10f/0x770 [ 6804.664055][ C2] ip_output+0x16b/0x4f0 [ 6804.664268][ C2] ? __pfx_ip_output+0x10/0x10 [ 6804.664503][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6804.664770][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6804.665072][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6804.665338][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6804.665580][ C2] ? __alloc_skb+0xd4/0x280 [ 6804.665804][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6804.666066][ C2] ? tcp_fragment+0x168/0x1040 [ 6804.666303][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6804.666546][ C2] ? ip_local_out+0x114/0x3b0 [ 6804.666781][ C2] __ip_queue_xmit+0x672/0x1910 [ 6804.667043][ C2] ? __skb_clone+0x57a/0x760 [ 6804.667277][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6804.667541][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6804.667819][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6804.668071][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6804.668311][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6804.668601][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6804.668911][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6804.669147][ C2] tcp_send_loss_probe+0x348/0x830 [ 6804.669398][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6804.669657][ C2] tcp_write_timer+0x82/0x1d0 [ 6804.669889][ C2] call_timer_fn+0x173/0x430 [ 6804.670116][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6804.670368][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6804.670620][ C2] __run_timers.part.0+0x52d/0x890 [ 6804.670872][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6804.671134][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6804.671408][ C2] ? lock_acquire+0x1c1/0x220 [ 6804.671639][ C2] ? clockevents_program_event+0xf6/0x300 [ 6804.671933][ C2] ? lock_release+0x1d5/0x250 [ 6804.672172][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6804.672434][ C2] ? ktime_get+0xb3/0x190 [ 6804.672654][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6804.672947][ C2] run_timer_softirq+0x72/0x100 [ 6804.673204][ C2] __do_softirq+0x1b9/0x7ff [ 6804.673429][ C2] irq_exit_rcu+0x98/0xc0 [ 6804.673641][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6804.673918][ C2] [ 6804.674063][ C2] [ 6804.674207][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6804.674502][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6804.674749][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6804.675682][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6804.675980][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6804.676365][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6804.676752][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6804.677169][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6804.677562][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6804.677959][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6804.678251][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6804.678502][ C2] default_idle_call+0x69/0xa0 [ 6804.678738][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6804.678980][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6804.679248][ C2] ? lock_release+0x1d5/0x250 [ 6804.679479][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6804.679743][ C2] do_idle+0xfb/0x160 [ 6804.679940][ C2] cpu_startup_entry+0x55/0x60 [ 6804.680175][ C2] start_secondary+0x21c/0x2b0 [ 6804.680411][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6804.680671][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6804.680971][ C2] [ 6830.246102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6830.246450][ C1] rcu: 1-....: (4464457 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1094653 [ 6830.247022][ C1] rcu: (t=4475359 jiffies g=1882453 q=718 ncpus=4) [ 6830.247354][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6830.247803][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6830.248410][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6830.248729][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6830.249674][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6830.249973][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6830.250363][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6830.250751][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6830.251139][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6830.251529][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6830.251918][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6830.252355][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6830.252679][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6830.253067][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6830.253458][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6830.253846][ C1] PKRU: 55555554 [ 6830.254023][ C1] Call Trace: [ 6830.254187][ C1] [ 6830.254333][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6830.254599][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6830.254846][ C1] ? check_cpu_stall+0x284/0x500 [ 6830.255092][ C1] ? rcu_pending+0x92/0x360 [ 6830.255315][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6830.255580][ C1] ? update_process_times+0xb9/0x110 [ 6830.255842][ C1] ? tick_sched_handle+0x67/0x130 [ 6830.256093][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6830.256370][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6830.256608][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6830.256937][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6830.257210][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6830.257500][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6830.257765][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6830.258071][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6830.258335][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6830.258650][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6830.258937][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6830.259244][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6830.259524][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6830.259814][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6830.260096][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6830.260398][ C1] ? get_stack_info+0x36/0xc0 [ 6830.260634][ C1] ? lock_acquire+0x1c1/0x220 [ 6830.260869][ C1] ? lock_release+0x1d5/0x250 [ 6830.261103][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6830.261345][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6830.261612][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6830.261890][ C1] ? lock_acquire+0x1c1/0x220 [ 6830.262123][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6830.262358][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6830.262612][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6830.262839][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6830.263080][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6830.263332][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6830.263600][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6830.263870][ C1] ip_local_deliver+0x19d/0x480 [ 6830.264112][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6830.264378][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6830.264636][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6830.264974][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6830.265219][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6830.265531][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6830.265787][ C1] ip_rcv+0x564/0x740 [ 6830.265989][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6830.266213][ C1] ? set_track_prepare+0x8a/0xd0 [ 6830.266460][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6830.266752][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6830.267025][ C1] ? skb_clone+0x10b/0x330 [ 6830.267251][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6830.267571][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6830.267878][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6830.268163][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6830.268451][ C1] ? __tcf_classify+0x329/0x7d0 [ 6830.268694][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6830.268917][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6830.269210][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6830.269488][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6830.269806][ C1] ? lock_acquire+0x1c1/0x220 [ 6830.270038][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6830.270328][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6830.270605][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6830.270915][ C1] ? __copy_skb_header+0xaf/0x490 [ 6830.271166][ C1] ? __skb_clone+0x57a/0x760 [ 6830.271396][ C1] netif_receive_skb+0x55/0x280 [ 6830.271639][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6830.271944][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6830.272269][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6830.272558][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6830.272827][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6830.273108][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6830.273413][ C1] ? hlock_class+0x4e/0x130 [ 6830.273639][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6830.273910][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6830.274179][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6830.274435][ C1] ? hlock_class+0x4e/0x130 [ 6830.274662][ C1] ? mark_lock+0x38/0x3e0 [ 6830.274874][ C1] ? stack_access_ok+0xda/0x1f0 [ 6830.275117][ C1] ? __lock_acquire+0xb67/0x1610 [ 6830.275364][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6830.275632][ C1] ? get_stack_info+0x36/0xc0 [ 6830.275868][ C1] ? stack_access_ok+0xda/0x1f0 [ 6830.276109][ C1] ? get_reg+0x119/0x190 [ 6830.276319][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6830.276583][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6830.276908][ C1] __tcf_classify+0x329/0x7d0 [ 6830.277151][ C1] tcf_classify+0x283/0x930 [ 6830.277384][ C1] ? arch_stack_walk+0xa2/0x100 [ 6830.277633][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6830.277900][ C1] ? get_stack_info+0x36/0xc0 [ 6830.278134][ C1] tc_run+0x2e4/0x5d0 [ 6830.278336][ C1] ? __pfx_tc_run+0x10/0x10 [ 6830.278560][ C1] ? lock_acquire+0x1c1/0x220 [ 6830.278794][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6830.279049][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6830.279296][ C1] ? lock_acquire+0x1c1/0x220 [ 6830.279530][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6830.279788][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6830.280085][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6830.280352][ C1] ? neigh_hh_output+0x348/0x590 [ 6830.280599][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6830.280858][ C1] ip_finish_output2+0x786/0x18e0 [ 6830.281108][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6830.281378][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6830.281706][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6830.281977][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6830.282225][ C1] ? __ip_finish_output+0x10f/0x770 [ 6830.282484][ C1] ip_output+0x16b/0x4f0 [ 6830.282694][ C1] ? run_timer_softirq+0x72/0x100 [ 6830.282944][ C1] ? __pfx_ip_output+0x10/0x10 [ 6830.283182][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6830.283460][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6830.283706][ C1] ? ip_local_out+0x114/0x3b0 [ 6830.283941][ C1] __ip_queue_xmit+0x672/0x1910 [ 6830.284184][ C1] ? __create_object+0x5e/0xb0 [ 6830.284423][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6830.284683][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6830.284957][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6830.285224][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6830.285500][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6830.285765][ C1] tcp_delack_timer+0x84/0x240 [ 6830.286003][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6830.286267][ C1] call_timer_fn+0x173/0x430 [ 6830.286498][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6830.286775][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6830.287037][ C1] __run_timers.part.0+0x52d/0x890 [ 6830.287297][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6830.287569][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6830.287857][ C1] ? lock_acquire+0x1c1/0x220 [ 6830.288100][ C1] ? clockevents_program_event+0xf6/0x300 [ 6830.288382][ C1] ? lock_release+0x1d5/0x250 [ 6830.288616][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6830.288873][ C1] ? ktime_get+0xb3/0x190 [ 6830.289087][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6830.289377][ C1] run_timer_softirq+0x72/0x100 [ 6830.289620][ C1] __do_softirq+0x1b9/0x7ff [ 6830.289846][ C1] irq_exit_rcu+0x98/0xc0 [ 6830.290062][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6830.290339][ C1] [ 6830.290488][ C1] [ 6830.290633][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6830.290931][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6830.291247][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6830.292191][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6830.292492][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6830.292880][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6830.293268][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6830.293659][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6830.294047][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6830.294438][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6830.294728][ C1] pipe_read+0xa16/0xdf0 [ 6830.294941][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6830.295211][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6830.295449][ C1] ? iterate_tty_write+0x299/0x540 [ 6830.295703][ C1] ? lock_release+0x1d5/0x250 [ 6830.295938][ C1] vfs_read+0x911/0xc00 [ 6830.296145][ C1] ? lock_acquire+0x1c1/0x220 [ 6830.296380][ C1] ? __might_fault+0xc6/0x180 [ 6830.296614][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6830.296871][ C1] ? __might_fault+0xc6/0x180 [ 6830.297109][ C1] ? lock_release+0x1d5/0x250 [ 6830.297349][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6830.297613][ C1] ? __fget_light+0x54/0x1e0 [ 6830.297862][ C1] ksys_read+0x17a/0x1e0 [ 6830.298072][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6830.298311][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6830.298609][ C1] do_syscall_64+0xc9/0x1e0 [ 6830.298834][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6830.299127][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6830.299350][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6830.300298][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6830.300707][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6830.301098][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6830.301488][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6830.301876][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6830.302264][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6830.302658][ C1] [ 6830.302810][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6830.303073][ C2] NMI backtrace for cpu 2 [ 6830.303083][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6830.303089][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6830.303092][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6830.303101][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6830.303106][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6830.303111][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6830.303115][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6830.303117][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6830.303119][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6830.303120][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6830.303122][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6830.303124][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6830.303127][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6830.303129][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6830.303130][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6830.303131][ C2] PKRU: 55555554 [ 6830.303132][ C2] Call Trace: [ 6830.303134][ C2] [ 6830.303136][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6830.303141][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6830.303146][ C2] ? nmi_handle+0x153/0x420 [ 6830.303150][ C2] ? default_do_nmi+0x41/0x100 [ 6830.303152][ C2] ? exc_nmi+0xf3/0x120 [ 6830.303155][ C2] ? end_repeat_nmi+0xf/0x60 [ 6830.303159][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6830.303162][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6830.303165][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6830.303168][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6830.303171][ C2] [ 6830.303172][ C2] [ 6830.303173][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6830.303176][ C2] ? get_stack_info+0x36/0xc0 [ 6830.303180][ C2] ? lock_acquire+0x1c1/0x220 [ 6830.303183][ C2] ? lock_release+0x1d5/0x250 [ 6830.303186][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6830.303190][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6830.303193][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6830.303196][ C2] ? lock_acquire+0x1c1/0x220 [ 6830.303198][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6830.303201][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6830.303204][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6830.303210][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6830.303212][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6830.303216][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6830.303221][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6830.303224][ C2] ip_local_deliver+0x19d/0x480 [ 6830.303227][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6830.303229][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6830.303231][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6830.303236][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6830.303240][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6830.303242][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6830.303251][ C2] ip_rcv+0x564/0x740 [ 6830.303254][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6830.303256][ C2] ? set_track_prepare+0x8a/0xd0 [ 6830.303260][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6830.303263][ C2] ? start_secondary+0x21c/0x2b0 [ 6830.303266][ C2] ? skb_clone+0x10b/0x330 [ 6830.303269][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6830.303274][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6830.303279][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6830.303283][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6830.303290][ C2] ? __tcf_classify+0x329/0x7d0 [ 6830.303294][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6830.303296][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6830.303299][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6830.303302][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6830.303306][ C2] ? lock_acquire+0x1c1/0x220 [ 6830.303309][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6830.303313][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6830.303316][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6830.303320][ C2] ? __copy_skb_header+0xaf/0x490 [ 6830.303324][ C2] ? __skb_clone+0x57a/0x760 [ 6830.303326][ C2] netif_receive_skb+0x55/0x280 [ 6830.303329][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6830.303336][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6830.303342][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6830.303348][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6830.303352][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6830.303362][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6830.303369][ C2] ? get_stack_info+0x36/0xc0 [ 6830.303374][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6830.303376][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6830.303380][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6830.303382][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6830.303385][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6830.303387][ C2] ? kernel_text_address+0x17/0xe0 [ 6830.303390][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6830.303394][ C2] ? arch_stack_walk+0x8c/0x100 [ 6830.303397][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6830.303400][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6830.303404][ C2] ? lock_acquire+0x1c1/0x220 [ 6830.303406][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6830.303409][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6830.303413][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6830.303416][ C2] ? get_stack_info+0x36/0xc0 [ 6830.303420][ C2] __tcf_classify+0x329/0x7d0 [ 6830.303425][ C2] tcf_classify+0x283/0x930 [ 6830.303429][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6830.303433][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6830.303437][ C2] tc_run+0x2e4/0x5d0 [ 6830.303440][ C2] ? __pfx_tc_run+0x10/0x10 [ 6830.303443][ C2] ? lock_acquire+0x1c1/0x220 [ 6830.303445][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6830.303449][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6830.303453][ C2] ? lock_acquire+0x1c1/0x220 [ 6830.303455][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6830.303458][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6830.303461][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6830.303464][ C2] ? neigh_hh_output+0x348/0x590 [ 6830.303467][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6830.303471][ C2] ip_finish_output2+0x786/0x18e0 [ 6830.303474][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6830.303481][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6830.303483][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6830.303487][ C2] ? __ip_finish_output+0x10f/0x770 [ 6830.303491][ C2] ip_output+0x16b/0x4f0 [ 6830.303494][ C2] ? __pfx_ip_output+0x10/0x10 [ 6830.303496][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6830.303499][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6830.303502][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6830.303505][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6830.303507][ C2] ? __alloc_skb+0xd4/0x280 [ 6830.303510][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6830.303514][ C2] ? tcp_fragment+0x168/0x1040 [ 6830.303517][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6830.303520][ C2] ? ip_local_out+0x114/0x3b0 [ 6830.303523][ C2] __ip_queue_xmit+0x672/0x1910 [ 6830.303527][ C2] ? __skb_clone+0x57a/0x760 [ 6830.303529][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6830.303534][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6830.303537][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6830.303541][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6830.303544][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6830.303548][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6830.303551][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6830.303555][ C2] tcp_send_loss_probe+0x348/0x830 [ 6830.303558][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6830.303560][ C2] tcp_write_timer+0x82/0x1d0 [ 6830.303563][ C2] call_timer_fn+0x173/0x430 [ 6830.303567][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6830.303571][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6830.303575][ C2] __run_timers.part.0+0x52d/0x890 [ 6830.303578][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6830.303582][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6830.303585][ C2] ? lock_acquire+0x1c1/0x220 [ 6830.303587][ C2] ? clockevents_program_event+0xf6/0x300 [ 6830.303590][ C2] ? lock_release+0x1d5/0x250 [ 6830.303593][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6830.303595][ C2] ? ktime_get+0xb3/0x190 [ 6830.303598][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6830.303602][ C2] run_timer_softirq+0x72/0x100 [ 6830.303606][ C2] __do_softirq+0x1b9/0x7ff [ 6830.303610][ C2] irq_exit_rcu+0x98/0xc0 [ 6830.303612][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6830.303615][ C2] [ 6830.303615][ C2] [ 6830.303616][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6830.303620][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6830.303623][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6830.303625][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6830.303626][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6830.303628][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6830.303629][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6830.303631][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6830.303632][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6830.303635][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6830.303638][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6830.303641][ C2] default_idle_call+0x69/0xa0 [ 6830.303644][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6830.303646][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6830.303650][ C2] ? lock_release+0x1d5/0x250 [ 6830.303652][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6830.303656][ C2] do_idle+0xfb/0x160 [ 6830.303658][ C2] cpu_startup_entry+0x55/0x60 [ 6830.303660][ C2] start_secondary+0x21c/0x2b0 [ 6830.303663][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6830.303667][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6830.303673][ C2] [ 6856.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4194s! [perl:4135] [ 6856.569688][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6856.570912][ C1] irq event stamp: 209232 [ 6856.571126][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6856.571643][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6856.572110][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6856.572567][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6856.573018][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6856.573455][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6856.574052][ C1] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 6856.574331][ C1] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 6856.575275][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 6856.575575][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6856.575963][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6856.576353][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffff88800a3a0e1b [ 6856.576766][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6856.577164][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6856.577562][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6856.578012][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6856.578336][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6856.578728][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6856.579117][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6856.579504][ C1] PKRU: 55555554 [ 6856.579681][ C1] Call Trace: [ 6856.579847][ C1] [ 6856.579991][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6856.580246][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6856.580484][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6856.580752][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6856.581020][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6856.581301][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6856.581559][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6856.581857][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6856.582111][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 6856.582365][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6856.582666][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6856.582955][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6856.583261][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6856.583544][ C1] ? kasan_check_range+0x69/0x1c0 [ 6856.583794][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 6856.584067][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6856.584371][ C1] ? get_stack_info+0x36/0xc0 [ 6856.584607][ C1] ? lock_acquire+0x1c1/0x220 [ 6856.584842][ C1] ? lock_release+0x1d5/0x250 [ 6856.585074][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6856.585316][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6856.585582][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6856.585860][ C1] ? lock_acquire+0x1c1/0x220 [ 6856.586094][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6856.586328][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6856.586602][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6856.586836][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6856.587084][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6856.587342][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6856.587620][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6856.587907][ C1] ip_local_deliver+0x19d/0x480 [ 6856.588148][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6856.588415][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6856.588674][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6856.589013][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6856.589261][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6856.589574][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6856.589831][ C1] ip_rcv+0x564/0x740 [ 6856.590030][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6856.590258][ C1] ? set_track_prepare+0x8a/0xd0 [ 6856.590506][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6856.590776][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6856.591044][ C1] ? skb_clone+0x10b/0x330 [ 6856.591267][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6856.591579][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6856.591880][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6856.592156][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6856.592445][ C1] ? __tcf_classify+0x329/0x7d0 [ 6856.592688][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6856.592913][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6856.593208][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6856.593487][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6856.593805][ C1] ? lock_acquire+0x1c1/0x220 [ 6856.594040][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6856.594331][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6856.594610][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6856.594920][ C1] ? __copy_skb_header+0xaf/0x490 [ 6856.595173][ C1] ? __skb_clone+0x57a/0x760 [ 6856.595404][ C1] netif_receive_skb+0x55/0x280 [ 6856.595647][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6856.595952][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6856.596279][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6856.596590][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6856.596867][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6856.597159][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6856.597473][ C1] ? hlock_class+0x4e/0x130 [ 6856.597706][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6856.597992][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6856.598263][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6856.598521][ C1] ? hlock_class+0x4e/0x130 [ 6856.598749][ C1] ? mark_lock+0x38/0x3e0 [ 6856.598963][ C1] ? stack_access_ok+0xda/0x1f0 [ 6856.599207][ C1] ? __lock_acquire+0xb67/0x1610 [ 6856.599456][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6856.599726][ C1] ? get_stack_info+0x36/0xc0 [ 6856.599965][ C1] ? stack_access_ok+0xda/0x1f0 [ 6856.600208][ C1] ? get_reg+0x119/0x190 [ 6856.600420][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6856.600681][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6856.600986][ C1] __tcf_classify+0x329/0x7d0 [ 6856.601224][ C1] tcf_classify+0x283/0x930 [ 6856.601452][ C1] ? arch_stack_walk+0xa2/0x100 [ 6856.601696][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6856.601947][ C1] ? get_stack_info+0x36/0xc0 [ 6856.602183][ C1] tc_run+0x2e4/0x5d0 [ 6856.602384][ C1] ? __pfx_tc_run+0x10/0x10 [ 6856.602612][ C1] ? lock_acquire+0x1c1/0x220 [ 6856.602871][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6856.603134][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6856.603389][ C1] ? lock_acquire+0x1c1/0x220 [ 6856.603627][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6856.603907][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6856.604204][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6856.604474][ C1] ? neigh_hh_output+0x348/0x590 [ 6856.604722][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6856.604982][ C1] ip_finish_output2+0x786/0x18e0 [ 6856.605232][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6856.605504][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6856.605834][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6856.606105][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6856.606352][ C1] ? __ip_finish_output+0x10f/0x770 [ 6856.606634][ C1] ip_output+0x16b/0x4f0 [ 6856.606851][ C1] ? run_timer_softirq+0x72/0x100 [ 6856.607110][ C1] ? __pfx_ip_output+0x10/0x10 [ 6856.607357][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6856.607644][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6856.607905][ C1] ? ip_local_out+0x114/0x3b0 [ 6856.608141][ C1] __ip_queue_xmit+0x672/0x1910 [ 6856.608385][ C1] ? __create_object+0x5e/0xb0 [ 6856.608623][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6856.608884][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6856.609159][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6856.609426][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6856.609703][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6856.609970][ C1] tcp_delack_timer+0x84/0x240 [ 6856.610209][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6856.610475][ C1] call_timer_fn+0x173/0x430 [ 6856.610707][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6856.610964][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6856.611221][ C1] __run_timers.part.0+0x52d/0x890 [ 6856.611476][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6856.611743][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6856.612022][ C1] ? lock_acquire+0x1c1/0x220 [ 6856.612255][ C1] ? clockevents_program_event+0xf6/0x300 [ 6856.612541][ C1] ? lock_release+0x1d5/0x250 [ 6856.612775][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6856.613034][ C1] ? ktime_get+0xb3/0x190 [ 6856.613249][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6856.613541][ C1] run_timer_softirq+0x72/0x100 [ 6856.613784][ C1] __do_softirq+0x1b9/0x7ff [ 6856.614010][ C1] irq_exit_rcu+0x98/0xc0 [ 6856.614228][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6856.614507][ C1] [ 6856.614654][ C1] [ 6856.614802][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6856.615100][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6856.615419][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6856.616369][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6856.616695][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6856.617097][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6856.617497][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6856.617903][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6856.618297][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6856.618690][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6856.618981][ C1] pipe_read+0xa16/0xdf0 [ 6856.619198][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6856.619469][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6856.619712][ C1] ? iterate_tty_write+0x299/0x540 [ 6856.619969][ C1] ? lock_release+0x1d5/0x250 [ 6856.620207][ C1] vfs_read+0x911/0xc00 [ 6856.620416][ C1] ? lock_acquire+0x1c1/0x220 [ 6856.620651][ C1] ? __might_fault+0xc6/0x180 [ 6856.620888][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6856.621120][ C1] ? __might_fault+0xc6/0x180 [ 6856.621357][ C1] ? lock_release+0x1d5/0x250 [ 6856.621593][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6856.621852][ C1] ? __fget_light+0x54/0x1e0 [ 6856.622086][ C1] ksys_read+0x17a/0x1e0 [ 6856.622299][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6856.622539][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6856.622838][ C1] do_syscall_64+0xc9/0x1e0 [ 6856.623065][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6856.623361][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6856.623585][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6856.624537][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6856.624948][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6856.625341][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6856.625735][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6856.626127][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6856.626519][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6856.626941][ C1] [ 6856.627101][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4194s! [swapper/2:0] [ 6856.627514][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6856.628741][ C2] irq event stamp: 44114564 [ 6856.628960][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6856.629480][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6856.629976][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6856.630438][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6856.630890][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6856.631332][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6856.631925][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6856.632238][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6856.633178][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6856.633476][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6856.633860][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6856.634248][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6856.634634][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6856.635019][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6856.635405][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6856.635837][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6856.636160][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6856.636553][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6856.636963][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6856.637356][ C2] PKRU: 55555554 [ 6856.637537][ C2] Call Trace: [ 6856.637707][ C2] [ 6856.637859][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6856.638111][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6856.638347][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6856.638613][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6856.638880][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6856.639158][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6856.639414][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6856.639710][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6856.639962][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6856.640216][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6856.640516][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6856.640803][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6856.641105][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6856.641386][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6856.641672][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6856.641950][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6856.642252][ C2] ? get_stack_info+0x36/0xc0 [ 6856.642485][ C2] ? lock_acquire+0x1c1/0x220 [ 6856.642717][ C2] ? lock_release+0x1d5/0x250 [ 6856.642949][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6856.643191][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6856.643452][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6856.643730][ C2] ? lock_acquire+0x1c1/0x220 [ 6856.643961][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6856.644192][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6856.644443][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6856.644671][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6856.644910][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6856.645160][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6856.645425][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6856.645692][ C2] ip_local_deliver+0x19d/0x480 [ 6856.645931][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6856.646195][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6856.646450][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6856.646810][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6856.647064][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6856.647383][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6856.647643][ C2] ip_rcv+0x564/0x740 [ 6856.647854][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6856.648077][ C2] ? set_track_prepare+0x8a/0xd0 [ 6856.648322][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6856.648589][ C2] ? start_secondary+0x21c/0x2b0 [ 6856.648832][ C2] ? skb_clone+0x10b/0x330 [ 6856.649052][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6856.649360][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6856.649656][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6856.649928][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6856.650212][ C2] ? __tcf_classify+0x329/0x7d0 [ 6856.650453][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6856.650676][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6856.650964][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6856.651242][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6856.651557][ C2] ? lock_acquire+0x1c1/0x220 [ 6856.651787][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6856.652073][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6856.652350][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6856.652657][ C2] ? __copy_skb_header+0xaf/0x490 [ 6856.652905][ C2] ? __skb_clone+0x57a/0x760 [ 6856.653132][ C2] netif_receive_skb+0x55/0x280 [ 6856.653371][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6856.653674][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6856.653996][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6856.654287][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6856.654552][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6856.654833][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6856.655135][ C2] ? get_stack_info+0x36/0xc0 [ 6856.655370][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6856.655626][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6856.655937][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6856.656204][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6856.656473][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6856.656803][ C2] ? kernel_text_address+0x17/0xe0 [ 6856.657063][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6856.657373][ C2] ? arch_stack_walk+0x8c/0x100 [ 6856.657621][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6856.657889][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6856.658168][ C2] ? lock_acquire+0x1c1/0x220 [ 6856.658399][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6856.658671][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6856.658966][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6856.659233][ C2] ? get_stack_info+0x36/0xc0 [ 6856.659467][ C2] __tcf_classify+0x329/0x7d0 [ 6856.659701][ C2] tcf_classify+0x283/0x930 [ 6856.659925][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6856.660173][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6856.660476][ C2] tc_run+0x2e4/0x5d0 [ 6856.660674][ C2] ? __pfx_tc_run+0x10/0x10 [ 6856.660898][ C2] ? lock_acquire+0x1c1/0x220 [ 6856.661130][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6856.661383][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6856.661627][ C2] ? lock_acquire+0x1c1/0x220 [ 6856.661857][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6856.662114][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6856.662408][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6856.662672][ C2] ? neigh_hh_output+0x348/0x590 [ 6856.662919][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6856.663176][ C2] ip_finish_output2+0x786/0x18e0 [ 6856.663425][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6856.663752][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6856.664019][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6856.664264][ C2] ? __ip_finish_output+0x10f/0x770 [ 6856.664520][ C2] ip_output+0x16b/0x4f0 [ 6856.664730][ C2] ? __pfx_ip_output+0x10/0x10 [ 6856.664964][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6856.665233][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6856.665534][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6856.665803][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6856.666047][ C2] ? __alloc_skb+0xd4/0x280 [ 6856.666268][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6856.666529][ C2] ? tcp_fragment+0x168/0x1040 [ 6856.666788][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6856.667038][ C2] ? ip_local_out+0x114/0x3b0 [ 6856.667278][ C2] __ip_queue_xmit+0x672/0x1910 [ 6856.667526][ C2] ? __skb_clone+0x57a/0x760 [ 6856.667771][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6856.668030][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6856.668302][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6856.668539][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6856.668782][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6856.669072][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6856.669383][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6856.669619][ C2] tcp_send_loss_probe+0x348/0x830 [ 6856.669872][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6856.670132][ C2] tcp_write_timer+0x82/0x1d0 [ 6856.670364][ C2] call_timer_fn+0x173/0x430 [ 6856.670594][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6856.670847][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6856.671101][ C2] __run_timers.part.0+0x52d/0x890 [ 6856.671353][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6856.671613][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6856.671891][ C2] ? lock_acquire+0x1c1/0x220 [ 6856.672122][ C2] ? clockevents_program_event+0xf6/0x300 [ 6856.672404][ C2] ? lock_release+0x1d5/0x250 [ 6856.672654][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6856.672916][ C2] ? ktime_get+0xb3/0x190 [ 6856.673135][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6856.673432][ C2] run_timer_softirq+0x72/0x100 [ 6856.673680][ C2] __do_softirq+0x1b9/0x7ff [ 6856.673917][ C2] irq_exit_rcu+0x98/0xc0 [ 6856.674131][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6856.674406][ C2] [ 6856.674553][ C2] [ 6856.674697][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6856.674991][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6856.675240][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6856.676180][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6856.676478][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6856.676895][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6856.677290][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6856.677686][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6856.678086][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6856.678472][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6856.678751][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6856.679004][ C2] default_idle_call+0x69/0xa0 [ 6856.679239][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6856.679485][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6856.679755][ C2] ? lock_release+0x1d5/0x250 [ 6856.679984][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6856.680252][ C2] do_idle+0xfb/0x160 [ 6856.680449][ C2] cpu_startup_entry+0x55/0x60 [ 6856.680685][ C2] start_secondary+0x21c/0x2b0 [ 6856.680919][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6856.681182][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6856.681481][ C2] [ 6884.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4220s! [perl:4135] [ 6884.569690][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6884.570910][ C1] irq event stamp: 209232 [ 6884.571123][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6884.571639][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6884.572104][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6884.572559][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6884.573007][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6884.573443][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6884.574039][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6884.574356][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6884.575297][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6884.575598][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6884.575987][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6884.576374][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6884.576790][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6884.577189][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6884.577587][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6884.578036][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6884.578360][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6884.578753][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6884.579144][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6884.579532][ C1] PKRU: 55555554 [ 6884.579710][ C1] Call Trace: [ 6884.579877][ C1] [ 6884.580020][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6884.580276][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6884.580514][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6884.580782][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6884.581047][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6884.581331][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6884.581589][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6884.581888][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6884.582144][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6884.582446][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6884.582732][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6884.583040][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6884.583323][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6884.583609][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6884.583892][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6884.584196][ C1] ? get_stack_info+0x36/0xc0 [ 6884.584429][ C1] ? lock_acquire+0x1c1/0x220 [ 6884.584666][ C1] ? lock_release+0x1d5/0x250 [ 6884.584900][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6884.585143][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6884.585407][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6884.585686][ C1] ? lock_acquire+0x1c1/0x220 [ 6884.585919][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6884.586155][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6884.586409][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6884.586662][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6884.586909][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6884.587167][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6884.587444][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6884.587729][ C1] ip_local_deliver+0x19d/0x480 [ 6884.587970][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6884.588234][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6884.588489][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6884.588830][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6884.589076][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6884.589388][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6884.589647][ C1] ip_rcv+0x564/0x740 [ 6884.589846][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6884.590070][ C1] ? set_track_prepare+0x8a/0xd0 [ 6884.590317][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6884.590588][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6884.590853][ C1] ? skb_clone+0x10b/0x330 [ 6884.591074][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6884.591384][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6884.591682][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6884.591959][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6884.592245][ C1] ? __tcf_classify+0x329/0x7d0 [ 6884.592488][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6884.592713][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6884.593003][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6884.593282][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6884.593599][ C1] ? lock_acquire+0x1c1/0x220 [ 6884.593831][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6884.594119][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6884.594398][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6884.594706][ C1] ? __copy_skb_header+0xaf/0x490 [ 6884.594957][ C1] ? __skb_clone+0x57a/0x760 [ 6884.595185][ C1] netif_receive_skb+0x55/0x280 [ 6884.595428][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6884.595732][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6884.596055][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6884.596347][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6884.596640][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6884.596928][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6884.597240][ C1] ? hlock_class+0x4e/0x130 [ 6884.597474][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6884.597757][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6884.598025][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6884.598283][ C1] ? hlock_class+0x4e/0x130 [ 6884.598508][ C1] ? mark_lock+0x38/0x3e0 [ 6884.598722][ C1] ? stack_access_ok+0xda/0x1f0 [ 6884.598962][ C1] ? __lock_acquire+0xb67/0x1610 [ 6884.599210][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6884.599480][ C1] ? get_stack_info+0x36/0xc0 [ 6884.599713][ C1] ? stack_access_ok+0xda/0x1f0 [ 6884.599954][ C1] ? get_reg+0x119/0x190 [ 6884.600167][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6884.600427][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6884.600727][ C1] __tcf_classify+0x329/0x7d0 [ 6884.600960][ C1] tcf_classify+0x283/0x930 [ 6884.601187][ C1] ? arch_stack_walk+0xa2/0x100 [ 6884.601429][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6884.601679][ C1] ? get_stack_info+0x36/0xc0 [ 6884.601914][ C1] tc_run+0x2e4/0x5d0 [ 6884.602113][ C1] ? __pfx_tc_run+0x10/0x10 [ 6884.602337][ C1] ? lock_acquire+0x1c1/0x220 [ 6884.602569][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6884.602823][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6884.603070][ C1] ? lock_acquire+0x1c1/0x220 [ 6884.603303][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6884.603559][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6884.603860][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6884.604124][ C1] ? neigh_hh_output+0x348/0x590 [ 6884.604371][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6884.604628][ C1] ip_finish_output2+0x786/0x18e0 [ 6884.604877][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6884.605147][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6884.605477][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6884.605746][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6884.605993][ C1] ? __ip_finish_output+0x10f/0x770 [ 6884.606252][ C1] ip_output+0x16b/0x4f0 [ 6884.606481][ C1] ? run_timer_softirq+0x72/0x100 [ 6884.606736][ C1] ? __pfx_ip_output+0x10/0x10 [ 6884.606980][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6884.607268][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6884.607520][ C1] ? ip_local_out+0x114/0x3b0 [ 6884.607767][ C1] __ip_queue_xmit+0x672/0x1910 [ 6884.608009][ C1] ? __create_object+0x5e/0xb0 [ 6884.608247][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6884.608506][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6884.608781][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6884.609047][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6884.609321][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6884.609585][ C1] tcp_delack_timer+0x84/0x240 [ 6884.609823][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6884.610088][ C1] call_timer_fn+0x173/0x430 [ 6884.610318][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6884.610573][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6884.610827][ C1] __run_timers.part.0+0x52d/0x890 [ 6884.611080][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6884.611349][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6884.611626][ C1] ? lock_acquire+0x1c1/0x220 [ 6884.611860][ C1] ? clockevents_program_event+0xf6/0x300 [ 6884.612141][ C1] ? lock_release+0x1d5/0x250 [ 6884.612375][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6884.612632][ C1] ? ktime_get+0xb3/0x190 [ 6884.612847][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6884.613136][ C1] run_timer_softirq+0x72/0x100 [ 6884.613377][ C1] __do_softirq+0x1b9/0x7ff [ 6884.613604][ C1] irq_exit_rcu+0x98/0xc0 [ 6884.613817][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6884.614096][ C1] [ 6884.614242][ C1] [ 6884.614388][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6884.614685][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6884.615000][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6884.615946][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6884.616245][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6884.616657][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6884.617058][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6884.617457][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6884.617860][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6884.618250][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6884.618539][ C1] pipe_read+0xa16/0xdf0 [ 6884.618754][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6884.619027][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6884.619264][ C1] ? iterate_tty_write+0x299/0x540 [ 6884.619519][ C1] ? lock_release+0x1d5/0x250 [ 6884.619752][ C1] vfs_read+0x911/0xc00 [ 6884.619962][ C1] ? lock_acquire+0x1c1/0x220 [ 6884.620197][ C1] ? __might_fault+0xc6/0x180 [ 6884.620432][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6884.620666][ C1] ? __might_fault+0xc6/0x180 [ 6884.620900][ C1] ? lock_release+0x1d5/0x250 [ 6884.621132][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6884.621390][ C1] ? __fget_light+0x54/0x1e0 [ 6884.621620][ C1] ksys_read+0x17a/0x1e0 [ 6884.621832][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6884.622070][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6884.622370][ C1] do_syscall_64+0xc9/0x1e0 [ 6884.622597][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6884.622887][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6884.623112][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6884.624058][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6884.624469][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6884.624857][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6884.625245][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6884.625632][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6884.626022][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6884.626414][ C1] [ 6884.626591][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4220s! [swapper/2:0] [ 6884.627003][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6884.628235][ C2] irq event stamp: 44114564 [ 6884.628454][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6884.628972][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6884.629466][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6884.629926][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6884.630376][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6884.630814][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6884.631408][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6884.631721][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6884.632659][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6884.632956][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6884.633340][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6884.633725][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6884.634112][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6884.634496][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6884.634880][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6884.635312][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6884.635631][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6884.636021][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6884.636406][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6884.636818][ C2] PKRU: 55555554 [ 6884.636997][ C2] Call Trace: [ 6884.637167][ C2] [ 6884.637312][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6884.637571][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6884.637818][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6884.638084][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6884.638351][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6884.638628][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6884.638882][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6884.639179][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6884.639431][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6884.639683][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6884.639982][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6884.640269][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6884.640571][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6884.640852][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6884.641139][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6884.641419][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6884.641721][ C2] ? get_stack_info+0x36/0xc0 [ 6884.641954][ C2] ? lock_acquire+0x1c1/0x220 [ 6884.642186][ C2] ? lock_release+0x1d5/0x250 [ 6884.642418][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6884.642659][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6884.642921][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6884.643199][ C2] ? lock_acquire+0x1c1/0x220 [ 6884.643430][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6884.643661][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6884.643911][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6884.644140][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6884.644380][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6884.644629][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6884.644894][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6884.645160][ C2] ip_local_deliver+0x19d/0x480 [ 6884.645400][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6884.645663][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6884.645918][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6884.646254][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6884.646521][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6884.646838][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6884.647099][ C2] ip_rcv+0x564/0x740 [ 6884.647301][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6884.647531][ C2] ? set_track_prepare+0x8a/0xd0 [ 6884.647790][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6884.648056][ C2] ? start_secondary+0x21c/0x2b0 [ 6884.648300][ C2] ? skb_clone+0x10b/0x330 [ 6884.648522][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6884.648830][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6884.649126][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6884.649399][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6884.649683][ C2] ? __tcf_classify+0x329/0x7d0 [ 6884.649924][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6884.650148][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6884.650437][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6884.650714][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6884.651029][ C2] ? lock_acquire+0x1c1/0x220 [ 6884.651260][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6884.651547][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6884.651824][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6884.652130][ C2] ? __copy_skb_header+0xaf/0x490 [ 6884.652379][ C2] ? __skb_clone+0x57a/0x760 [ 6884.652609][ C2] netif_receive_skb+0x55/0x280 [ 6884.652849][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6884.653152][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6884.653472][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6884.653761][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6884.654026][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6884.654303][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6884.654605][ C2] ? get_stack_info+0x36/0xc0 [ 6884.654840][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6884.655095][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6884.655402][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6884.655668][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6884.655937][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6884.656241][ C2] ? kernel_text_address+0x17/0xe0 [ 6884.656520][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6884.656827][ C2] ? arch_stack_walk+0x8c/0x100 [ 6884.657075][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6884.657338][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6884.657626][ C2] ? lock_acquire+0x1c1/0x220 [ 6884.657870][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6884.658141][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6884.658436][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6884.658703][ C2] ? get_stack_info+0x36/0xc0 [ 6884.658937][ C2] __tcf_classify+0x329/0x7d0 [ 6884.659170][ C2] tcf_classify+0x283/0x930 [ 6884.659395][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6884.659642][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6884.659944][ C2] tc_run+0x2e4/0x5d0 [ 6884.660142][ C2] ? __pfx_tc_run+0x10/0x10 [ 6884.660366][ C2] ? lock_acquire+0x1c1/0x220 [ 6884.660598][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6884.660850][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6884.661094][ C2] ? lock_acquire+0x1c1/0x220 [ 6884.661323][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6884.661580][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6884.661873][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6884.662137][ C2] ? neigh_hh_output+0x348/0x590 [ 6884.662381][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6884.662638][ C2] ip_finish_output2+0x786/0x18e0 [ 6884.662886][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6884.663213][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6884.663479][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6884.663724][ C2] ? __ip_finish_output+0x10f/0x770 [ 6884.663980][ C2] ip_output+0x16b/0x4f0 [ 6884.664189][ C2] ? __pfx_ip_output+0x10/0x10 [ 6884.664427][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6884.664696][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6884.664996][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6884.665265][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6884.665508][ C2] ? __alloc_skb+0xd4/0x280 [ 6884.665729][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6884.665990][ C2] ? tcp_fragment+0x168/0x1040 [ 6884.666225][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6884.666489][ C2] ? ip_local_out+0x114/0x3b0 [ 6884.666727][ C2] __ip_queue_xmit+0x672/0x1910 [ 6884.666975][ C2] ? __skb_clone+0x57a/0x760 [ 6884.667209][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6884.667474][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6884.667759][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6884.667996][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6884.668237][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6884.668527][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6884.668836][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6884.669072][ C2] tcp_send_loss_probe+0x348/0x830 [ 6884.669324][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6884.669584][ C2] tcp_write_timer+0x82/0x1d0 [ 6884.669815][ C2] call_timer_fn+0x173/0x430 [ 6884.670045][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6884.670297][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6884.670550][ C2] __run_timers.part.0+0x52d/0x890 [ 6884.670801][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6884.671060][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6884.671337][ C2] ? lock_acquire+0x1c1/0x220 [ 6884.671567][ C2] ? clockevents_program_event+0xf6/0x300 [ 6884.671848][ C2] ? lock_release+0x1d5/0x250 [ 6884.672080][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6884.672336][ C2] ? ktime_get+0xb3/0x190 [ 6884.672548][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6884.672836][ C2] run_timer_softirq+0x72/0x100 [ 6884.673097][ C2] __do_softirq+0x1b9/0x7ff [ 6884.673327][ C2] irq_exit_rcu+0x98/0xc0 [ 6884.673547][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6884.673828][ C2] [ 6884.673980][ C2] [ 6884.674140][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6884.674434][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6884.674681][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6884.675616][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6884.675914][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6884.676299][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6884.676709][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6884.677103][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6884.677500][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6884.677900][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6884.678180][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6884.678432][ C2] default_idle_call+0x69/0xa0 [ 6884.678665][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6884.678908][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6884.679178][ C2] ? lock_release+0x1d5/0x250 [ 6884.679408][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6884.679675][ C2] do_idle+0xfb/0x160 [ 6884.679871][ C2] cpu_startup_entry+0x55/0x60 [ 6884.680106][ C2] start_secondary+0x21c/0x2b0 [ 6884.680341][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6884.680603][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6884.680903][ C2] [ 6908.304102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6908.304451][ C1] rcu: 1-....: (4542346 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1113890 [ 6908.304999][ C1] rcu: (t=4553417 jiffies g=1882453 q=718 ncpus=4) [ 6908.305324][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6908.305762][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6908.306384][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6908.306711][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6908.307689][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6908.307990][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6908.308380][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6908.308769][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6908.309162][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6908.309552][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6908.309943][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6908.310380][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6908.310704][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6908.311099][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6908.311488][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6908.311879][ C1] PKRU: 55555554 [ 6908.312056][ C1] Call Trace: [ 6908.312224][ C1] [ 6908.312367][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6908.312632][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6908.312879][ C1] ? check_cpu_stall+0x284/0x500 [ 6908.313124][ C1] ? rcu_pending+0x92/0x360 [ 6908.313351][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6908.313614][ C1] ? update_process_times+0xb9/0x110 [ 6908.313878][ C1] ? tick_sched_handle+0x67/0x130 [ 6908.314129][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6908.314412][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6908.314647][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6908.314953][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6908.315220][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6908.315503][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6908.315762][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6908.316062][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6908.316340][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6908.316650][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6908.316947][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6908.317264][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6908.317557][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6908.317852][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6908.318144][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6908.318458][ C1] ? get_stack_info+0x36/0xc0 [ 6908.318699][ C1] ? lock_acquire+0x1c1/0x220 [ 6908.318941][ C1] ? lock_release+0x1d5/0x250 [ 6908.319182][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6908.319433][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6908.319705][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6908.319992][ C1] ? lock_acquire+0x1c1/0x220 [ 6908.320231][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6908.320473][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6908.320734][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6908.320971][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6908.321219][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6908.321478][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6908.321754][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6908.322032][ C1] ip_local_deliver+0x19d/0x480 [ 6908.322281][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6908.322553][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6908.322819][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6908.323169][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6908.323423][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6908.323745][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6908.324009][ C1] ip_rcv+0x564/0x740 [ 6908.324214][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6908.324447][ C1] ? set_track_prepare+0x8a/0xd0 [ 6908.324701][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6908.324980][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6908.325254][ C1] ? skb_clone+0x10b/0x330 [ 6908.325482][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6908.325802][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6908.326108][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6908.326396][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6908.326691][ C1] ? __tcf_classify+0x329/0x7d0 [ 6908.326941][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6908.327173][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6908.327472][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6908.327768][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6908.328086][ C1] ? lock_acquire+0x1c1/0x220 [ 6908.328320][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6908.328608][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6908.328889][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6908.329200][ C1] ? __copy_skb_header+0xaf/0x490 [ 6908.329451][ C1] ? __skb_clone+0x57a/0x760 [ 6908.329679][ C1] netif_receive_skb+0x55/0x280 [ 6908.329922][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6908.330227][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6908.330551][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6908.330845][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6908.331112][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6908.331392][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6908.331701][ C1] ? hlock_class+0x4e/0x130 [ 6908.331930][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6908.332200][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6908.332469][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6908.332727][ C1] ? hlock_class+0x4e/0x130 [ 6908.332952][ C1] ? mark_lock+0x38/0x3e0 [ 6908.333169][ C1] ? stack_access_ok+0xda/0x1f0 [ 6908.333415][ C1] ? __lock_acquire+0xb67/0x1610 [ 6908.333663][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6908.333935][ C1] ? get_stack_info+0x36/0xc0 [ 6908.334169][ C1] ? stack_access_ok+0xda/0x1f0 [ 6908.334409][ C1] ? get_reg+0x119/0x190 [ 6908.334623][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6908.334885][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6908.335188][ C1] __tcf_classify+0x329/0x7d0 [ 6908.335424][ C1] tcf_classify+0x283/0x930 [ 6908.335649][ C1] ? arch_stack_walk+0xa2/0x100 [ 6908.335893][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6908.336167][ C1] ? get_stack_info+0x36/0xc0 [ 6908.336415][ C1] tc_run+0x2e4/0x5d0 [ 6908.336621][ C1] ? __pfx_tc_run+0x10/0x10 [ 6908.336853][ C1] ? lock_acquire+0x1c1/0x220 [ 6908.337091][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6908.337353][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6908.337617][ C1] ? lock_acquire+0x1c1/0x220 [ 6908.337851][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6908.338109][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6908.338407][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6908.338672][ C1] ? neigh_hh_output+0x348/0x590 [ 6908.338918][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6908.339177][ C1] ip_finish_output2+0x786/0x18e0 [ 6908.339427][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6908.339703][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6908.340033][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6908.340302][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6908.340551][ C1] ? __ip_finish_output+0x10f/0x770 [ 6908.340810][ C1] ip_output+0x16b/0x4f0 [ 6908.341022][ C1] ? run_timer_softirq+0x72/0x100 [ 6908.341273][ C1] ? __pfx_ip_output+0x10/0x10 [ 6908.341510][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6908.341791][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6908.342037][ C1] ? ip_local_out+0x114/0x3b0 [ 6908.342271][ C1] __ip_queue_xmit+0x672/0x1910 [ 6908.342513][ C1] ? __create_object+0x5e/0xb0 [ 6908.342752][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6908.343012][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6908.343289][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6908.343556][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6908.343830][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6908.344096][ C1] tcp_delack_timer+0x84/0x240 [ 6908.344334][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6908.344601][ C1] call_timer_fn+0x173/0x430 [ 6908.344831][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6908.345086][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6908.345341][ C1] __run_timers.part.0+0x52d/0x890 [ 6908.345597][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6908.345866][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6908.346144][ C1] ? lock_acquire+0x1c1/0x220 [ 6908.346399][ C1] ? clockevents_program_event+0xf6/0x300 [ 6908.346688][ C1] ? lock_release+0x1d5/0x250 [ 6908.346930][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6908.347194][ C1] ? ktime_get+0xb3/0x190 [ 6908.347418][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6908.347720][ C1] run_timer_softirq+0x72/0x100 [ 6908.347963][ C1] __do_softirq+0x1b9/0x7ff [ 6908.348192][ C1] irq_exit_rcu+0x98/0xc0 [ 6908.348406][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6908.348687][ C1] [ 6908.348833][ C1] [ 6908.348980][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6908.349278][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6908.349595][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6908.350545][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6908.350846][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6908.351236][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6908.351628][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6908.352017][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6908.352406][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6908.352798][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6908.353089][ C1] pipe_read+0xa16/0xdf0 [ 6908.353305][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6908.353578][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6908.353816][ C1] ? iterate_tty_write+0x299/0x540 [ 6908.354071][ C1] ? lock_release+0x1d5/0x250 [ 6908.354305][ C1] vfs_read+0x911/0xc00 [ 6908.354517][ C1] ? lock_acquire+0x1c1/0x220 [ 6908.354749][ C1] ? __might_fault+0xc6/0x180 [ 6908.354984][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6908.355218][ C1] ? __might_fault+0xc6/0x180 [ 6908.355453][ C1] ? lock_release+0x1d5/0x250 [ 6908.355686][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6908.355945][ C1] ? __fget_light+0x54/0x1e0 [ 6908.356176][ C1] ksys_read+0x17a/0x1e0 [ 6908.356413][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6908.356657][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6908.356962][ C1] do_syscall_64+0xc9/0x1e0 [ 6908.357196][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6908.357497][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6908.357730][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6908.358677][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6908.359089][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6908.359479][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6908.359868][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6908.360258][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6908.360648][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6908.361040][ C1] [ 6908.361194][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6908.361459][ C2] NMI backtrace for cpu 2 [ 6908.361463][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6908.361469][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6908.361473][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6908.361480][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6908.361486][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6908.361490][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6908.361494][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6908.361498][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6908.361502][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6908.361505][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6908.361509][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6908.361514][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6908.361519][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6908.361523][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6908.361526][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6908.361529][ C2] PKRU: 55555554 [ 6908.361531][ C2] Call Trace: [ 6908.361533][ C2] [ 6908.361536][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6908.361547][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6908.361555][ C2] ? nmi_handle+0x153/0x420 [ 6908.361565][ C2] ? default_do_nmi+0x41/0x100 [ 6908.361571][ C2] ? exc_nmi+0xf3/0x120 [ 6908.361577][ C2] ? end_repeat_nmi+0xf/0x60 [ 6908.361588][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6908.361596][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6908.361603][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6908.361612][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6908.361620][ C2] [ 6908.361621][ C2] [ 6908.361624][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6908.361631][ C2] ? get_stack_info+0x36/0xc0 [ 6908.361639][ C2] ? lock_acquire+0x1c1/0x220 [ 6908.361647][ C2] ? lock_release+0x1d5/0x250 [ 6908.361655][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6908.361664][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6908.361670][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6908.361679][ C2] ? lock_acquire+0x1c1/0x220 [ 6908.361684][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6908.361692][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6908.361699][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6908.361715][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6908.361721][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6908.361732][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6908.361741][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6908.361749][ C2] ip_local_deliver+0x19d/0x480 [ 6908.361755][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6908.361760][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6908.361766][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6908.361777][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6908.361784][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6908.361791][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6908.361812][ C2] ip_rcv+0x564/0x740 [ 6908.361818][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6908.361824][ C2] ? set_track_prepare+0x8a/0xd0 [ 6908.361832][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6908.361839][ C2] ? start_secondary+0x21c/0x2b0 [ 6908.361845][ C2] ? skb_clone+0x10b/0x330 [ 6908.361850][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6908.361865][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6908.361879][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6908.361886][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6908.361906][ C2] ? __tcf_classify+0x329/0x7d0 [ 6908.361914][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6908.361919][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6908.361927][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6908.361934][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6908.361945][ C2] ? lock_acquire+0x1c1/0x220 [ 6908.361950][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6908.361961][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6908.361969][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6908.361979][ C2] ? __copy_skb_header+0xaf/0x490 [ 6908.361988][ C2] ? __skb_clone+0x57a/0x760 [ 6908.361994][ C2] netif_receive_skb+0x55/0x280 [ 6908.362002][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6908.362019][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6908.362036][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6908.362054][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6908.362065][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6908.362091][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6908.362110][ C2] ? get_stack_info+0x36/0xc0 [ 6908.362121][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6908.362128][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6908.362136][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6908.362142][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6908.362151][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6908.362157][ C2] ? kernel_text_address+0x17/0xe0 [ 6908.362164][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6908.362173][ C2] ? arch_stack_walk+0x8c/0x100 [ 6908.362180][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6908.362188][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6908.362196][ C2] ? lock_acquire+0x1c1/0x220 [ 6908.362202][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6908.362210][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6908.362218][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6908.362225][ C2] ? get_stack_info+0x36/0xc0 [ 6908.362236][ C2] __tcf_classify+0x329/0x7d0 [ 6908.362248][ C2] tcf_classify+0x283/0x930 [ 6908.362259][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6908.362266][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6908.362277][ C2] tc_run+0x2e4/0x5d0 [ 6908.362284][ C2] ? __pfx_tc_run+0x10/0x10 [ 6908.362292][ C2] ? lock_acquire+0x1c1/0x220 [ 6908.362297][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6908.362307][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6908.362318][ C2] ? lock_acquire+0x1c1/0x220 [ 6908.362323][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6908.362330][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6908.362337][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6908.362344][ C2] ? neigh_hh_output+0x348/0x590 [ 6908.362353][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6908.362362][ C2] ip_finish_output2+0x786/0x18e0 [ 6908.362370][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6908.362390][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6908.362396][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6908.362405][ C2] ? __ip_finish_output+0x10f/0x770 [ 6908.362414][ C2] ip_output+0x16b/0x4f0 [ 6908.362422][ C2] ? __pfx_ip_output+0x10/0x10 [ 6908.362428][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6908.362435][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6908.362442][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6908.362448][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6908.362454][ C2] ? __alloc_skb+0xd4/0x280 [ 6908.362460][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6908.362468][ C2] ? tcp_fragment+0x168/0x1040 [ 6908.362475][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6908.362482][ C2] ? ip_local_out+0x114/0x3b0 [ 6908.362490][ C2] __ip_queue_xmit+0x672/0x1910 [ 6908.362499][ C2] ? __skb_clone+0x57a/0x760 [ 6908.362506][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6908.362520][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6908.362528][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6908.362531][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6908.362535][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6908.362539][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6908.362542][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6908.362546][ C2] tcp_send_loss_probe+0x348/0x830 [ 6908.362549][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6908.362552][ C2] tcp_write_timer+0x82/0x1d0 [ 6908.362555][ C2] call_timer_fn+0x173/0x430 [ 6908.362558][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6908.362563][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6908.362566][ C2] __run_timers.part.0+0x52d/0x890 [ 6908.362569][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6908.362573][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6908.362576][ C2] ? lock_acquire+0x1c1/0x220 [ 6908.362578][ C2] ? clockevents_program_event+0xf6/0x300 [ 6908.362582][ C2] ? lock_release+0x1d5/0x250 [ 6908.362585][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6908.362588][ C2] ? ktime_get+0xb3/0x190 [ 6908.362591][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6908.362595][ C2] run_timer_softirq+0x72/0x100 [ 6908.362599][ C2] __do_softirq+0x1b9/0x7ff [ 6908.362603][ C2] irq_exit_rcu+0x98/0xc0 [ 6908.362605][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6908.362608][ C2] [ 6908.362609][ C2] [ 6908.362610][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6908.362613][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6908.362616][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6908.362618][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6908.362620][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6908.362621][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6908.362623][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6908.362624][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6908.362625][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6908.362628][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6908.362631][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6908.362634][ C2] default_idle_call+0x69/0xa0 [ 6908.362636][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6908.362639][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6908.362642][ C2] ? lock_release+0x1d5/0x250 [ 6908.362644][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6908.362648][ C2] do_idle+0xfb/0x160 [ 6908.362650][ C2] cpu_startup_entry+0x55/0x60 [ 6908.362652][ C2] start_secondary+0x21c/0x2b0 [ 6908.362655][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6908.362659][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6908.362664][ C2] [ 6932.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4265s! [perl:4135] [ 6932.569694][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6932.570925][ C1] irq event stamp: 209232 [ 6932.571137][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6932.571655][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6932.572124][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6932.572585][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6932.573036][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6932.573474][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6932.574075][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6932.574393][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6932.575341][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6932.575643][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6932.576033][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6932.576446][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6932.576848][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6932.577249][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6932.577656][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6932.578094][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6932.578419][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6932.578814][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6932.579205][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6932.579594][ C1] PKRU: 55555554 [ 6932.579771][ C1] Call Trace: [ 6932.579943][ C1] [ 6932.580087][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6932.580343][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6932.580582][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6932.580851][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6932.581119][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6932.581400][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6932.581660][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6932.581959][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6932.582215][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6932.582519][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6932.582806][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6932.583113][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6932.583398][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6932.583685][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6932.583969][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6932.584274][ C1] ? get_stack_info+0x36/0xc0 [ 6932.584509][ C1] ? lock_acquire+0x1c1/0x220 [ 6932.584744][ C1] ? lock_release+0x1d5/0x250 [ 6932.584979][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6932.585223][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6932.585489][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6932.585768][ C1] ? lock_acquire+0x1c1/0x220 [ 6932.585999][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6932.586254][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6932.586515][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6932.586751][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6932.587004][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6932.587264][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6932.587550][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6932.587820][ C1] ip_local_deliver+0x19d/0x480 [ 6932.588063][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6932.588329][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6932.588588][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6932.588930][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6932.589179][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6932.589492][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6932.589750][ C1] ip_rcv+0x564/0x740 [ 6932.589950][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6932.590177][ C1] ? set_track_prepare+0x8a/0xd0 [ 6932.590426][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6932.590698][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6932.590965][ C1] ? skb_clone+0x10b/0x330 [ 6932.591189][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6932.591502][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6932.591800][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6932.592079][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6932.592368][ C1] ? __tcf_classify+0x329/0x7d0 [ 6932.592613][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6932.592841][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6932.593134][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6932.593416][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6932.593737][ C1] ? lock_acquire+0x1c1/0x220 [ 6932.593972][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6932.594262][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6932.594544][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6932.594856][ C1] ? __copy_skb_header+0xaf/0x490 [ 6932.595109][ C1] ? __skb_clone+0x57a/0x760 [ 6932.595338][ C1] netif_receive_skb+0x55/0x280 [ 6932.595581][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6932.595889][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6932.596219][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6932.596538][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6932.596814][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6932.597104][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6932.597429][ C1] ? hlock_class+0x4e/0x130 [ 6932.597659][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6932.597929][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6932.598199][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6932.598459][ C1] ? hlock_class+0x4e/0x130 [ 6932.598685][ C1] ? mark_lock+0x38/0x3e0 [ 6932.598901][ C1] ? stack_access_ok+0xda/0x1f0 [ 6932.599145][ C1] ? __lock_acquire+0xb67/0x1610 [ 6932.599393][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6932.599665][ C1] ? get_stack_info+0x36/0xc0 [ 6932.599902][ C1] ? stack_access_ok+0xda/0x1f0 [ 6932.600144][ C1] ? get_reg+0x119/0x190 [ 6932.600358][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6932.600620][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6932.600925][ C1] __tcf_classify+0x329/0x7d0 [ 6932.601162][ C1] tcf_classify+0x283/0x930 [ 6932.601393][ C1] ? arch_stack_walk+0xa2/0x100 [ 6932.601638][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6932.601889][ C1] ? get_stack_info+0x36/0xc0 [ 6932.602127][ C1] tc_run+0x2e4/0x5d0 [ 6932.602329][ C1] ? __pfx_tc_run+0x10/0x10 [ 6932.602556][ C1] ? lock_acquire+0x1c1/0x220 [ 6932.602789][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6932.603046][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6932.603295][ C1] ? lock_acquire+0x1c1/0x220 [ 6932.603530][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6932.603789][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6932.604089][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6932.604356][ C1] ? neigh_hh_output+0x348/0x590 [ 6932.604604][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6932.604863][ C1] ip_finish_output2+0x786/0x18e0 [ 6932.605114][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6932.605388][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6932.605720][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6932.605989][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6932.606258][ C1] ? __ip_finish_output+0x10f/0x770 [ 6932.606524][ C1] ip_output+0x16b/0x4f0 [ 6932.606743][ C1] ? run_timer_softirq+0x72/0x100 [ 6932.607002][ C1] ? __pfx_ip_output+0x10/0x10 [ 6932.607246][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6932.607545][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6932.607791][ C1] ? ip_local_out+0x114/0x3b0 [ 6932.608026][ C1] __ip_queue_xmit+0x672/0x1910 [ 6932.608269][ C1] ? __create_object+0x5e/0xb0 [ 6932.608510][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6932.608771][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6932.609052][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6932.609320][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6932.609595][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6932.609863][ C1] tcp_delack_timer+0x84/0x240 [ 6932.610101][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6932.610370][ C1] call_timer_fn+0x173/0x430 [ 6932.610600][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6932.610857][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6932.611113][ C1] __run_timers.part.0+0x52d/0x890 [ 6932.611370][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6932.611639][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6932.611918][ C1] ? lock_acquire+0x1c1/0x220 [ 6932.612154][ C1] ? clockevents_program_event+0xf6/0x300 [ 6932.612438][ C1] ? lock_release+0x1d5/0x250 [ 6932.612673][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6932.612932][ C1] ? ktime_get+0xb3/0x190 [ 6932.613150][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6932.613440][ C1] run_timer_softirq+0x72/0x100 [ 6932.613684][ C1] __do_softirq+0x1b9/0x7ff [ 6932.613913][ C1] irq_exit_rcu+0x98/0xc0 [ 6932.614128][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6932.614410][ C1] [ 6932.614557][ C1] [ 6932.614704][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6932.615003][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6932.615321][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6932.616295][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6932.616605][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6932.617006][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6932.617421][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6932.617811][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6932.618201][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6932.618595][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6932.618886][ C1] pipe_read+0xa16/0xdf0 [ 6932.619101][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6932.619376][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6932.619614][ C1] ? iterate_tty_write+0x299/0x540 [ 6932.619872][ C1] ? lock_release+0x1d5/0x250 [ 6932.620106][ C1] vfs_read+0x911/0xc00 [ 6932.620319][ C1] ? lock_acquire+0x1c1/0x220 [ 6932.620551][ C1] ? __might_fault+0xc6/0x180 [ 6932.620787][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6932.621022][ C1] ? __might_fault+0xc6/0x180 [ 6932.621258][ C1] ? lock_release+0x1d5/0x250 [ 6932.621492][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6932.621752][ C1] ? __fget_light+0x54/0x1e0 [ 6932.621983][ C1] ksys_read+0x17a/0x1e0 [ 6932.622199][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6932.622438][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6932.622736][ C1] do_syscall_64+0xc9/0x1e0 [ 6932.622966][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6932.623260][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6932.623482][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6932.624435][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6932.624849][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6932.625240][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6932.625630][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6932.626021][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6932.626441][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6932.626845][ C1] [ 6932.627003][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4265s! [swapper/2:0] [ 6932.627428][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6932.628633][ C2] irq event stamp: 44114564 [ 6932.628853][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6932.629371][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6932.629865][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6932.630326][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6932.630777][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6932.631219][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6932.631812][ C2] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 6932.632087][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 6932.633025][ C2] RSP: 0018:ffffc9000021fa80 EFLAGS: 00000286 [ 6932.633320][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6932.633706][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6932.634091][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6932.634478][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6932.634861][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6932.635247][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6932.635678][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6932.635998][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6932.636408][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6932.636800][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6932.637198][ C2] PKRU: 55555554 [ 6932.637377][ C2] Call Trace: [ 6932.637552][ C2] [ 6932.637694][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6932.637946][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6932.638179][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6932.638448][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6932.638711][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6932.638988][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6932.639245][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6932.639538][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6932.639789][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6932.640046][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6932.640344][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6932.640631][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6932.640935][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6932.641212][ C2] ? kasan_check_range+0x1a/0x1c0 [ 6932.641460][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 6932.641731][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6932.642030][ C2] ? get_stack_info+0x36/0xc0 [ 6932.642263][ C2] ? lock_acquire+0x1c1/0x220 [ 6932.642495][ C2] ? lock_release+0x1d5/0x250 [ 6932.642727][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6932.642967][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6932.643230][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6932.643504][ C2] ? lock_acquire+0x1c1/0x220 [ 6932.643735][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6932.643967][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6932.644218][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6932.644444][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6932.644680][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6932.644929][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6932.645196][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6932.645463][ C2] ip_local_deliver+0x19d/0x480 [ 6932.645702][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6932.645963][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6932.646220][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6932.646581][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6932.646830][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6932.647147][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6932.647406][ C2] ip_rcv+0x564/0x740 [ 6932.647614][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6932.647834][ C2] ? set_track_prepare+0x8a/0xd0 [ 6932.648078][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6932.648346][ C2] ? start_secondary+0x21c/0x2b0 [ 6932.648587][ C2] ? skb_clone+0x10b/0x330 [ 6932.648805][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6932.649113][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6932.649408][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6932.649677][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6932.649962][ C2] ? __tcf_classify+0x329/0x7d0 [ 6932.650201][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6932.650422][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6932.650711][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6932.650984][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6932.651298][ C2] ? lock_acquire+0x1c1/0x220 [ 6932.651529][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6932.651817][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6932.652092][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6932.652398][ C2] ? __copy_skb_header+0xaf/0x490 [ 6932.652645][ C2] ? __skb_clone+0x57a/0x760 [ 6932.652872][ C2] netif_receive_skb+0x55/0x280 [ 6932.653111][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6932.653411][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6932.653732][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6932.654020][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6932.654284][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6932.654564][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6932.654865][ C2] ? get_stack_info+0x36/0xc0 [ 6932.655096][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6932.655352][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6932.655658][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6932.655925][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6932.656192][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6932.656522][ C2] ? kernel_text_address+0x17/0xe0 [ 6932.656780][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6932.657090][ C2] ? arch_stack_walk+0x8c/0x100 [ 6932.657337][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6932.657603][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6932.657876][ C2] ? lock_acquire+0x1c1/0x220 [ 6932.658108][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6932.658381][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6932.658673][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6932.658941][ C2] ? get_stack_info+0x36/0xc0 [ 6932.659173][ C2] __tcf_classify+0x329/0x7d0 [ 6932.659409][ C2] tcf_classify+0x283/0x930 [ 6932.659634][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6932.659881][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6932.660183][ C2] tc_run+0x2e4/0x5d0 [ 6932.660381][ C2] ? __pfx_tc_run+0x10/0x10 [ 6932.660601][ C2] ? lock_acquire+0x1c1/0x220 [ 6932.660832][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6932.661083][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6932.661327][ C2] ? lock_acquire+0x1c1/0x220 [ 6932.661558][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6932.661812][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6932.662104][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6932.662366][ C2] ? neigh_hh_output+0x348/0x590 [ 6932.662610][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6932.662864][ C2] ip_finish_output2+0x786/0x18e0 [ 6932.663112][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6932.663436][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6932.663704][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6932.663947][ C2] ? __ip_finish_output+0x10f/0x770 [ 6932.664204][ C2] ip_output+0x16b/0x4f0 [ 6932.664412][ C2] ? __pfx_ip_output+0x10/0x10 [ 6932.664648][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6932.664914][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6932.665216][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6932.665502][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6932.665750][ C2] ? __alloc_skb+0xd4/0x280 [ 6932.665979][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6932.666248][ C2] ? tcp_fragment+0x168/0x1040 [ 6932.666489][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6932.666738][ C2] ? ip_local_out+0x114/0x3b0 [ 6932.666975][ C2] __ip_queue_xmit+0x672/0x1910 [ 6932.667220][ C2] ? __skb_clone+0x57a/0x760 [ 6932.667462][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6932.667717][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6932.667989][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6932.668224][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6932.668463][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6932.668754][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6932.669062][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6932.669298][ C2] tcp_send_loss_probe+0x348/0x830 [ 6932.669549][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6932.669807][ C2] tcp_write_timer+0x82/0x1d0 [ 6932.670039][ C2] call_timer_fn+0x173/0x430 [ 6932.670266][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6932.670519][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6932.670771][ C2] __run_timers.part.0+0x52d/0x890 [ 6932.671022][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6932.671282][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6932.671556][ C2] ? lock_acquire+0x1c1/0x220 [ 6932.671787][ C2] ? clockevents_program_event+0xf6/0x300 [ 6932.672067][ C2] ? lock_release+0x1d5/0x250 [ 6932.672296][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6932.672552][ C2] ? ktime_get+0xb3/0x190 [ 6932.672766][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6932.673051][ C2] run_timer_softirq+0x72/0x100 [ 6932.673290][ C2] __do_softirq+0x1b9/0x7ff [ 6932.673515][ C2] irq_exit_rcu+0x98/0xc0 [ 6932.673747][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6932.674030][ C2] [ 6932.674178][ C2] [ 6932.674328][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6932.674628][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6932.674889][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6932.675819][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6932.676115][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6932.676529][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6932.676924][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6932.677318][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6932.677715][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6932.678101][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6932.678379][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6932.678631][ C2] default_idle_call+0x69/0xa0 [ 6932.678866][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6932.679110][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6932.679376][ C2] ? lock_release+0x1d5/0x250 [ 6932.679606][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6932.679870][ C2] do_idle+0xfb/0x160 [ 6932.680066][ C2] cpu_startup_entry+0x55/0x60 [ 6932.680304][ C2] start_secondary+0x21c/0x2b0 [ 6932.680539][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6932.680799][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6932.681099][ C2] [ 6960.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4291s! [perl:4135] [ 6960.569683][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6960.570911][ C1] irq event stamp: 209232 [ 6960.571127][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6960.571644][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 6960.572110][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 6960.572572][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 6960.573024][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6960.573462][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6960.574061][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6960.574380][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6960.575332][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6960.575633][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6960.576025][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6960.576444][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6960.576845][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6960.577259][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6960.577650][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6960.578089][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6960.578415][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6960.578806][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6960.579199][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6960.579590][ C1] PKRU: 55555554 [ 6960.579768][ C1] Call Trace: [ 6960.579933][ C1] [ 6960.580079][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6960.580336][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6960.580573][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6960.580845][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6960.581112][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6960.581395][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6960.581656][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6960.581954][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6960.582212][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6960.582514][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6960.582805][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6960.583114][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6960.583396][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6960.583685][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6960.583968][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6960.584273][ C1] ? get_stack_info+0x36/0xc0 [ 6960.584509][ C1] ? lock_acquire+0x1c1/0x220 [ 6960.584745][ C1] ? lock_release+0x1d5/0x250 [ 6960.584981][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6960.585223][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6960.585491][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6960.585769][ C1] ? lock_acquire+0x1c1/0x220 [ 6960.586003][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6960.586264][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6960.586526][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6960.586760][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6960.587008][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6960.587268][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6960.587548][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6960.587821][ C1] ip_local_deliver+0x19d/0x480 [ 6960.588063][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6960.588329][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6960.588587][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6960.588926][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6960.589175][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6960.589488][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6960.589746][ C1] ip_rcv+0x564/0x740 [ 6960.589948][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6960.590173][ C1] ? set_track_prepare+0x8a/0xd0 [ 6960.590421][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6960.590691][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6960.590960][ C1] ? skb_clone+0x10b/0x330 [ 6960.591181][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6960.591493][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6960.591792][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6960.592067][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6960.592358][ C1] ? __tcf_classify+0x329/0x7d0 [ 6960.592602][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6960.592826][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6960.593121][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6960.593398][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6960.593717][ C1] ? lock_acquire+0x1c1/0x220 [ 6960.593951][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6960.594242][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6960.594520][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6960.594831][ C1] ? __copy_skb_header+0xaf/0x490 [ 6960.595082][ C1] ? __skb_clone+0x57a/0x760 [ 6960.595313][ C1] netif_receive_skb+0x55/0x280 [ 6960.595557][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6960.595863][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6960.596221][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6960.596520][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6960.596797][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6960.597087][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6960.597414][ C1] ? hlock_class+0x4e/0x130 [ 6960.597641][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6960.597914][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6960.598184][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6960.598441][ C1] ? hlock_class+0x4e/0x130 [ 6960.598689][ C1] ? mark_lock+0x38/0x3e0 [ 6960.598911][ C1] ? stack_access_ok+0xda/0x1f0 [ 6960.599162][ C1] ? __lock_acquire+0xb67/0x1610 [ 6960.599417][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6960.599694][ C1] ? get_stack_info+0x36/0xc0 [ 6960.599936][ C1] ? stack_access_ok+0xda/0x1f0 [ 6960.600185][ C1] ? get_reg+0x119/0x190 [ 6960.600401][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6960.600672][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6960.600982][ C1] __tcf_classify+0x329/0x7d0 [ 6960.601225][ C1] tcf_classify+0x283/0x930 [ 6960.601466][ C1] ? arch_stack_walk+0xa2/0x100 [ 6960.601709][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6960.601960][ C1] ? get_stack_info+0x36/0xc0 [ 6960.602193][ C1] tc_run+0x2e4/0x5d0 [ 6960.602395][ C1] ? __pfx_tc_run+0x10/0x10 [ 6960.602621][ C1] ? lock_acquire+0x1c1/0x220 [ 6960.602856][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6960.603112][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6960.603360][ C1] ? lock_acquire+0x1c1/0x220 [ 6960.603594][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6960.603853][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6960.604152][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6960.604419][ C1] ? neigh_hh_output+0x348/0x590 [ 6960.604667][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6960.604925][ C1] ip_finish_output2+0x786/0x18e0 [ 6960.605176][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6960.605448][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6960.605777][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6960.606048][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6960.606321][ C1] ? __ip_finish_output+0x10f/0x770 [ 6960.606587][ C1] ip_output+0x16b/0x4f0 [ 6960.606804][ C1] ? run_timer_softirq+0x72/0x100 [ 6960.607062][ C1] ? __pfx_ip_output+0x10/0x10 [ 6960.607318][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6960.607597][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6960.607843][ C1] ? ip_local_out+0x114/0x3b0 [ 6960.608079][ C1] __ip_queue_xmit+0x672/0x1910 [ 6960.608323][ C1] ? __create_object+0x5e/0xb0 [ 6960.608563][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6960.608825][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6960.609099][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6960.609367][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6960.609644][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6960.609910][ C1] tcp_delack_timer+0x84/0x240 [ 6960.610149][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6960.610415][ C1] call_timer_fn+0x173/0x430 [ 6960.610647][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6960.610903][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6960.611159][ C1] __run_timers.part.0+0x52d/0x890 [ 6960.611414][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6960.611681][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6960.611962][ C1] ? lock_acquire+0x1c1/0x220 [ 6960.612195][ C1] ? clockevents_program_event+0xf6/0x300 [ 6960.612480][ C1] ? lock_release+0x1d5/0x250 [ 6960.612715][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6960.612973][ C1] ? ktime_get+0xb3/0x190 [ 6960.613188][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6960.613480][ C1] run_timer_softirq+0x72/0x100 [ 6960.613723][ C1] __do_softirq+0x1b9/0x7ff [ 6960.613949][ C1] irq_exit_rcu+0x98/0xc0 [ 6960.614168][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6960.614447][ C1] [ 6960.614595][ C1] [ 6960.614741][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6960.615040][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6960.615356][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6960.616342][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6960.616652][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6960.617052][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6960.617460][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6960.617850][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6960.618242][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6960.618634][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6960.618925][ C1] pipe_read+0xa16/0xdf0 [ 6960.619141][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6960.619412][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6960.619651][ C1] ? iterate_tty_write+0x299/0x540 [ 6960.619906][ C1] ? lock_release+0x1d5/0x250 [ 6960.620143][ C1] vfs_read+0x911/0xc00 [ 6960.620352][ C1] ? lock_acquire+0x1c1/0x220 [ 6960.620587][ C1] ? __might_fault+0xc6/0x180 [ 6960.620824][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6960.621058][ C1] ? __might_fault+0xc6/0x180 [ 6960.621292][ C1] ? lock_release+0x1d5/0x250 [ 6960.621528][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6960.621786][ C1] ? __fget_light+0x54/0x1e0 [ 6960.622019][ C1] ksys_read+0x17a/0x1e0 [ 6960.622232][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6960.622492][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6960.622798][ C1] do_syscall_64+0xc9/0x1e0 [ 6960.623030][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6960.623332][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6960.623562][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6960.624538][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6960.624963][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6960.625365][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6960.625766][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6960.626170][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6960.626570][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6960.626976][ C1] [ 6960.627134][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4291s! [swapper/2:0] [ 6960.627548][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 6960.628753][ C2] irq event stamp: 44114564 [ 6960.628974][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 6960.629491][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 6960.629984][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 6960.630446][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 6960.630898][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6960.631338][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6960.631934][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6960.632247][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6960.633185][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6960.633482][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6960.633867][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6960.634253][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6960.634639][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6960.635024][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6960.635409][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6960.635841][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6960.636186][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6960.636587][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6960.636982][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6960.637385][ C2] PKRU: 55555554 [ 6960.637561][ C2] Call Trace: [ 6960.637726][ C2] [ 6960.637867][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 6960.638119][ C2] ? __run_hrtimer+0x1c0/0x710 [ 6960.638355][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 6960.638621][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 6960.638888][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6960.639166][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6960.639421][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6960.639717][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 6960.639969][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 6960.640223][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6960.640521][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6960.640808][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6960.641111][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6960.641391][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6960.641677][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6960.641956][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6960.642258][ C2] ? get_stack_info+0x36/0xc0 [ 6960.642491][ C2] ? lock_acquire+0x1c1/0x220 [ 6960.642722][ C2] ? lock_release+0x1d5/0x250 [ 6960.642954][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6960.643194][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6960.643456][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6960.643734][ C2] ? lock_acquire+0x1c1/0x220 [ 6960.643964][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6960.644196][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6960.644447][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6960.644675][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6960.644915][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6960.645165][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6960.645429][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6960.645695][ C2] ip_local_deliver+0x19d/0x480 [ 6960.645935][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6960.646221][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6960.646482][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6960.646825][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6960.647076][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6960.647401][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6960.647657][ C2] ip_rcv+0x564/0x740 [ 6960.647853][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6960.648076][ C2] ? set_track_prepare+0x8a/0xd0 [ 6960.648321][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6960.648588][ C2] ? start_secondary+0x21c/0x2b0 [ 6960.648832][ C2] ? skb_clone+0x10b/0x330 [ 6960.649051][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6960.649358][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6960.649653][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6960.649925][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6960.650209][ C2] ? __tcf_classify+0x329/0x7d0 [ 6960.650449][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6960.650672][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6960.650960][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6960.651237][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6960.651552][ C2] ? lock_acquire+0x1c1/0x220 [ 6960.651781][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6960.652067][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6960.652344][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6960.652648][ C2] ? __copy_skb_header+0xaf/0x490 [ 6960.652896][ C2] ? __skb_clone+0x57a/0x760 [ 6960.653123][ C2] netif_receive_skb+0x55/0x280 [ 6960.653362][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6960.653663][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6960.653983][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6960.654272][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6960.654537][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6960.654814][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6960.655116][ C2] ? get_stack_info+0x36/0xc0 [ 6960.655350][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6960.655604][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6960.655910][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6960.656198][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6960.656471][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6960.656784][ C2] ? kernel_text_address+0x17/0xe0 [ 6960.657042][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6960.657360][ C2] ? arch_stack_walk+0x8c/0x100 [ 6960.657600][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6960.657856][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6960.658134][ C2] ? lock_acquire+0x1c1/0x220 [ 6960.658365][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6960.658636][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6960.658931][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6960.659197][ C2] ? get_stack_info+0x36/0xc0 [ 6960.659431][ C2] __tcf_classify+0x329/0x7d0 [ 6960.659664][ C2] tcf_classify+0x283/0x930 [ 6960.659892][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6960.660139][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6960.660441][ C2] tc_run+0x2e4/0x5d0 [ 6960.660638][ C2] ? __pfx_tc_run+0x10/0x10 [ 6960.660863][ C2] ? lock_acquire+0x1c1/0x220 [ 6960.661094][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6960.661347][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6960.661591][ C2] ? lock_acquire+0x1c1/0x220 [ 6960.661820][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6960.662075][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6960.662368][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6960.662633][ C2] ? neigh_hh_output+0x348/0x590 [ 6960.662875][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6960.663133][ C2] ip_finish_output2+0x786/0x18e0 [ 6960.663381][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6960.663707][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6960.663973][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6960.664218][ C2] ? __ip_finish_output+0x10f/0x770 [ 6960.664473][ C2] ip_output+0x16b/0x4f0 [ 6960.664682][ C2] ? __pfx_ip_output+0x10/0x10 [ 6960.664916][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6960.665184][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6960.665485][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6960.665754][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6960.665997][ C2] ? __alloc_skb+0xd4/0x280 [ 6960.666242][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6960.666509][ C2] ? tcp_fragment+0x168/0x1040 [ 6960.666749][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6960.666999][ C2] ? ip_local_out+0x114/0x3b0 [ 6960.667238][ C2] __ip_queue_xmit+0x672/0x1910 [ 6960.667490][ C2] ? __skb_clone+0x57a/0x760 [ 6960.667717][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6960.667975][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6960.668245][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6960.668481][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6960.668722][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6960.669011][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6960.669321][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6960.669556][ C2] tcp_send_loss_probe+0x348/0x830 [ 6960.669806][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6960.670066][ C2] tcp_write_timer+0x82/0x1d0 [ 6960.670297][ C2] call_timer_fn+0x173/0x430 [ 6960.670526][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6960.670779][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6960.671032][ C2] __run_timers.part.0+0x52d/0x890 [ 6960.671283][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6960.671543][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6960.671821][ C2] ? lock_acquire+0x1c1/0x220 [ 6960.672051][ C2] ? clockevents_program_event+0xf6/0x300 [ 6960.672333][ C2] ? lock_release+0x1d5/0x250 [ 6960.672565][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6960.672820][ C2] ? ktime_get+0xb3/0x190 [ 6960.673032][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6960.673322][ C2] run_timer_softirq+0x72/0x100 [ 6960.673563][ C2] __do_softirq+0x1b9/0x7ff [ 6960.673787][ C2] irq_exit_rcu+0x98/0xc0 [ 6960.674017][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6960.674299][ C2] [ 6960.674450][ C2] [ 6960.674598][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6960.674903][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6960.675169][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6960.676124][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6960.676429][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6960.676823][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6960.677218][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6960.677616][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6960.678000][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6960.678387][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6960.678666][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6960.678917][ C2] default_idle_call+0x69/0xa0 [ 6960.679151][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6960.679394][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6960.679662][ C2] ? lock_release+0x1d5/0x250 [ 6960.679890][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6960.680157][ C2] do_idle+0xfb/0x160 [ 6960.680354][ C2] cpu_startup_entry+0x55/0x60 [ 6960.680588][ C2] start_secondary+0x21c/0x2b0 [ 6960.680822][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6960.681083][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6960.681383][ C2] [ 6986.362102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 6986.362467][ C1] rcu: 1-....: (4620233 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1133175 [ 6986.363015][ C1] rcu: (t=4631475 jiffies g=1882453 q=718 ncpus=4) [ 6986.363340][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 6986.363777][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6986.364378][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6986.364699][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6986.365649][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 6986.365954][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6986.366370][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 6986.366770][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 6986.367184][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 6986.367572][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 6986.367962][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 6986.368399][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6986.368725][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 6986.369119][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6986.369510][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6986.369900][ C1] PKRU: 55555554 [ 6986.370078][ C1] Call Trace: [ 6986.370246][ C1] [ 6986.370389][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 6986.370656][ C1] ? print_cpu_stall+0x263/0x6a0 [ 6986.370926][ C1] ? check_cpu_stall+0x284/0x500 [ 6986.371179][ C1] ? rcu_pending+0x92/0x360 [ 6986.371413][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 6986.371686][ C1] ? update_process_times+0xb9/0x110 [ 6986.371972][ C1] ? tick_sched_handle+0x67/0x130 [ 6986.372224][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 6986.372504][ C1] ? __run_hrtimer+0x1c0/0x710 [ 6986.372739][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 6986.373044][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 6986.373331][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 6986.373622][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6986.373889][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 6986.374198][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 6986.374461][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 6986.374782][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 6986.375070][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6986.375379][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6986.375663][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6986.375952][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6986.376260][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6986.376572][ C1] ? get_stack_info+0x36/0xc0 [ 6986.376814][ C1] ? lock_acquire+0x1c1/0x220 [ 6986.377055][ C1] ? lock_release+0x1d5/0x250 [ 6986.377304][ C1] do_raw_spin_lock+0x1ec/0x270 [ 6986.377548][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6986.377813][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6986.378093][ C1] ? lock_acquire+0x1c1/0x220 [ 6986.378325][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6986.378561][ C1] _raw_spin_lock_nested+0x65/0x80 [ 6986.378815][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 6986.379045][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6986.379287][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 6986.379539][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 6986.379809][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 6986.380080][ C1] ip_local_deliver+0x19d/0x480 [ 6986.380323][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 6986.380587][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6986.380845][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6986.381188][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6986.381437][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6986.381749][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6986.382009][ C1] ip_rcv+0x564/0x740 [ 6986.382208][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6986.382435][ C1] ? set_track_prepare+0x8a/0xd0 [ 6986.382682][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 6986.382954][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 6986.383221][ C1] ? skb_clone+0x10b/0x330 [ 6986.383445][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6986.383757][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6986.384054][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6986.384333][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6986.384622][ C1] ? __tcf_classify+0x329/0x7d0 [ 6986.384864][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 6986.385090][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 6986.385382][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6986.385662][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6986.386002][ C1] ? lock_acquire+0x1c1/0x220 [ 6986.386242][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 6986.386537][ C1] netif_receive_skb_internal+0xb0/0x300 [ 6986.386828][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6986.387158][ C1] ? __copy_skb_header+0xaf/0x490 [ 6986.387410][ C1] ? __skb_clone+0x57a/0x760 [ 6986.387638][ C1] netif_receive_skb+0x55/0x280 [ 6986.387881][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6986.388189][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6986.388514][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6986.388808][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 6986.389075][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 6986.389356][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6986.389663][ C1] ? hlock_class+0x4e/0x130 [ 6986.389891][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6986.390160][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6986.390430][ C1] ? __pfx_validate_chain+0x10/0x10 [ 6986.390689][ C1] ? hlock_class+0x4e/0x130 [ 6986.390914][ C1] ? mark_lock+0x38/0x3e0 [ 6986.391131][ C1] ? stack_access_ok+0xda/0x1f0 [ 6986.391374][ C1] ? __lock_acquire+0xb67/0x1610 [ 6986.391621][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 6986.391892][ C1] ? get_stack_info+0x36/0xc0 [ 6986.392126][ C1] ? stack_access_ok+0xda/0x1f0 [ 6986.392367][ C1] ? get_reg+0x119/0x190 [ 6986.392582][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 6986.392844][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6986.393149][ C1] __tcf_classify+0x329/0x7d0 [ 6986.393385][ C1] tcf_classify+0x283/0x930 [ 6986.393611][ C1] ? arch_stack_walk+0xa2/0x100 [ 6986.393854][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 6986.394105][ C1] ? get_stack_info+0x36/0xc0 [ 6986.394343][ C1] tc_run+0x2e4/0x5d0 [ 6986.394543][ C1] ? __pfx_tc_run+0x10/0x10 [ 6986.394770][ C1] ? lock_acquire+0x1c1/0x220 [ 6986.395002][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 6986.395258][ C1] __dev_queue_xmit+0x686/0x17e0 [ 6986.395505][ C1] ? lock_acquire+0x1c1/0x220 [ 6986.395740][ C1] ? ip_finish_output2+0x786/0x18e0 [ 6986.396019][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6986.396325][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6986.396599][ C1] ? neigh_hh_output+0x348/0x590 [ 6986.396853][ C1] ? ip_finish_output2+0x262/0x18e0 [ 6986.397120][ C1] ip_finish_output2+0x786/0x18e0 [ 6986.397383][ C1] ? stack_depot_save_flags+0x45/0x550 [ 6986.397655][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6986.397986][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 6986.398255][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6986.398503][ C1] ? __ip_finish_output+0x10f/0x770 [ 6986.398768][ C1] ip_output+0x16b/0x4f0 [ 6986.398980][ C1] ? run_timer_softirq+0x72/0x100 [ 6986.399231][ C1] ? __pfx_ip_output+0x10/0x10 [ 6986.399468][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6986.399750][ C1] ? rcu_read_lock_held+0xe/0x50 [ 6986.399996][ C1] ? ip_local_out+0x114/0x3b0 [ 6986.400230][ C1] __ip_queue_xmit+0x672/0x1910 [ 6986.400472][ C1] ? __create_object+0x5e/0xb0 [ 6986.400712][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 6986.400972][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6986.401250][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 6986.401517][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 6986.401792][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6986.402058][ C1] tcp_delack_timer+0x84/0x240 [ 6986.402296][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6986.402563][ C1] call_timer_fn+0x173/0x430 [ 6986.402793][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 6986.403048][ C1] ? next_expiry_recalc+0xcd/0x220 [ 6986.403303][ C1] __run_timers.part.0+0x52d/0x890 [ 6986.403559][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 6986.403828][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 6986.404105][ C1] ? lock_acquire+0x1c1/0x220 [ 6986.404340][ C1] ? clockevents_program_event+0xf6/0x300 [ 6986.404622][ C1] ? lock_release+0x1d5/0x250 [ 6986.404856][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6986.405114][ C1] ? ktime_get+0xb3/0x190 [ 6986.405331][ C1] ? clockevents_program_event+0x1ea/0x300 [ 6986.405620][ C1] run_timer_softirq+0x72/0x100 [ 6986.405863][ C1] __do_softirq+0x1b9/0x7ff [ 6986.406114][ C1] irq_exit_rcu+0x98/0xc0 [ 6986.406334][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 6986.406622][ C1] [ 6986.406772][ C1] [ 6986.406924][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6986.407239][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 6986.407556][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 6986.408506][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 6986.408808][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 6986.409198][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 6986.409590][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 6986.409980][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 6986.410370][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 6986.410762][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 6986.411052][ C1] pipe_read+0xa16/0xdf0 [ 6986.411267][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 6986.411541][ C1] ? __pfx_pipe_read+0x10/0x10 [ 6986.411779][ C1] ? iterate_tty_write+0x299/0x540 [ 6986.412036][ C1] ? lock_release+0x1d5/0x250 [ 6986.412271][ C1] vfs_read+0x911/0xc00 [ 6986.412483][ C1] ? lock_acquire+0x1c1/0x220 [ 6986.412716][ C1] ? __might_fault+0xc6/0x180 [ 6986.412950][ C1] ? __pfx_vfs_read+0x10/0x10 [ 6986.413185][ C1] ? __might_fault+0xc6/0x180 [ 6986.413420][ C1] ? lock_release+0x1d5/0x250 [ 6986.413653][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 6986.413913][ C1] ? __fget_light+0x54/0x1e0 [ 6986.414143][ C1] ksys_read+0x17a/0x1e0 [ 6986.414358][ C1] ? __pfx_ksys_read+0x10/0x10 [ 6986.414596][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6986.414893][ C1] do_syscall_64+0xc9/0x1e0 [ 6986.415120][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 6986.415414][ C1] RIP: 0033:0x7f08a1ea38b2 [ 6986.415636][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 6986.416622][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 6986.417047][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 6986.417451][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 6986.417840][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6986.418235][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 6986.418626][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 6986.419018][ C1] [ 6986.419172][ C1] Sending NMI from CPU 1 to CPUs 2: [ 6986.419438][ C2] NMI backtrace for cpu 2 [ 6986.419444][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 6986.419450][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 6986.419454][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 6986.419462][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 6986.419467][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 6986.419472][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 6986.419475][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 6986.419476][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 6986.419478][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 6986.419480][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 6986.419481][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 6986.419483][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 6986.419486][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 6986.419487][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 6986.419489][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 6986.419490][ C2] PKRU: 55555554 [ 6986.419491][ C2] Call Trace: [ 6986.419492][ C2] [ 6986.419494][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 6986.419500][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 6986.419505][ C2] ? nmi_handle+0x153/0x420 [ 6986.419509][ C2] ? default_do_nmi+0x41/0x100 [ 6986.419512][ C2] ? exc_nmi+0xf3/0x120 [ 6986.419514][ C2] ? end_repeat_nmi+0xf/0x60 [ 6986.419519][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 6986.419522][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6986.419525][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6986.419528][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 6986.419531][ C2] [ 6986.419532][ C2] [ 6986.419533][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 6986.419536][ C2] ? get_stack_info+0x36/0xc0 [ 6986.419540][ C2] ? lock_acquire+0x1c1/0x220 [ 6986.419544][ C2] ? lock_release+0x1d5/0x250 [ 6986.419547][ C2] do_raw_spin_lock+0x1ec/0x270 [ 6986.419550][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 6986.419553][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6986.419556][ C2] ? lock_acquire+0x1c1/0x220 [ 6986.419558][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 6986.419562][ C2] _raw_spin_lock_nested+0x65/0x80 [ 6986.419565][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 6986.419571][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 6986.419574][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 6986.419578][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 6986.419583][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 6986.419586][ C2] ip_local_deliver+0x19d/0x480 [ 6986.419588][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 6986.419590][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 6986.419593][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 6986.419598][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6986.419602][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 6986.419605][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 6986.419614][ C2] ip_rcv+0x564/0x740 [ 6986.419616][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6986.419619][ C2] ? set_track_prepare+0x8a/0xd0 [ 6986.419623][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6986.419626][ C2] ? start_secondary+0x21c/0x2b0 [ 6986.419629][ C2] ? skb_clone+0x10b/0x330 [ 6986.419632][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 6986.419637][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 6986.419642][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 6986.419646][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 6986.419654][ C2] ? __tcf_classify+0x329/0x7d0 [ 6986.419657][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 6986.419659][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 6986.419663][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6986.419666][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 6986.419670][ C2] ? lock_acquire+0x1c1/0x220 [ 6986.419672][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 6986.419676][ C2] netif_receive_skb_internal+0xb0/0x300 [ 6986.419679][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 6986.419683][ C2] ? __copy_skb_header+0xaf/0x490 [ 6986.419687][ C2] ? __skb_clone+0x57a/0x760 [ 6986.419690][ C2] netif_receive_skb+0x55/0x280 [ 6986.419693][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 6986.419699][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 6986.419706][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 6986.419712][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 6986.419716][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 6986.419726][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 6986.419733][ C2] ? get_stack_info+0x36/0xc0 [ 6986.419738][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 6986.419741][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6986.419744][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6986.419746][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 6986.419750][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 6986.419752][ C2] ? kernel_text_address+0x17/0xe0 [ 6986.419755][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6986.419759][ C2] ? arch_stack_walk+0x8c/0x100 [ 6986.419762][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 6986.419766][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 6986.419769][ C2] ? lock_acquire+0x1c1/0x220 [ 6986.419771][ C2] ? stack_depot_save_flags+0x281/0x550 [ 6986.419775][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6986.419779][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 6986.419782][ C2] ? get_stack_info+0x36/0xc0 [ 6986.419786][ C2] __tcf_classify+0x329/0x7d0 [ 6986.419791][ C2] tcf_classify+0x283/0x930 [ 6986.419795][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 6986.419798][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 6986.419802][ C2] tc_run+0x2e4/0x5d0 [ 6986.419805][ C2] ? __pfx_tc_run+0x10/0x10 [ 6986.419808][ C2] ? lock_acquire+0x1c1/0x220 [ 6986.419811][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 6986.419815][ C2] __dev_queue_xmit+0x686/0x17e0 [ 6986.419819][ C2] ? lock_acquire+0x1c1/0x220 [ 6986.419821][ C2] ? ip_finish_output2+0x786/0x18e0 [ 6986.419824][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 6986.419827][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 6986.419829][ C2] ? neigh_hh_output+0x348/0x590 [ 6986.419833][ C2] ? ip_finish_output2+0x262/0x18e0 [ 6986.419836][ C2] ip_finish_output2+0x786/0x18e0 [ 6986.419840][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 6986.419847][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 6986.419849][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6986.419853][ C2] ? __ip_finish_output+0x10f/0x770 [ 6986.419856][ C2] ip_output+0x16b/0x4f0 [ 6986.419859][ C2] ? __pfx_ip_output+0x10/0x10 [ 6986.419862][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 6986.419865][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6986.419868][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 6986.419870][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 6986.419873][ C2] ? __alloc_skb+0xd4/0x280 [ 6986.419875][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 6986.419878][ C2] ? tcp_fragment+0x168/0x1040 [ 6986.419881][ C2] ? rcu_read_lock_held+0xe/0x50 [ 6986.419884][ C2] ? ip_local_out+0x114/0x3b0 [ 6986.419888][ C2] __ip_queue_xmit+0x672/0x1910 [ 6986.419891][ C2] ? __skb_clone+0x57a/0x760 [ 6986.419894][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 6986.419899][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 6986.419902][ C2] ? ipv4_dst_check+0xe3/0x170 [ 6986.419905][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 6986.419909][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 6986.419913][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 6986.419916][ C2] ? tcp_fragment+0xb0e/0x1040 [ 6986.419919][ C2] tcp_send_loss_probe+0x348/0x830 [ 6986.419922][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6986.419925][ C2] tcp_write_timer+0x82/0x1d0 [ 6986.419928][ C2] call_timer_fn+0x173/0x430 [ 6986.419932][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 6986.419936][ C2] ? next_expiry_recalc+0xcd/0x220 [ 6986.419940][ C2] __run_timers.part.0+0x52d/0x890 [ 6986.419943][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 6986.419947][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 6986.419950][ C2] ? lock_acquire+0x1c1/0x220 [ 6986.419952][ C2] ? clockevents_program_event+0xf6/0x300 [ 6986.419956][ C2] ? lock_release+0x1d5/0x250 [ 6986.419959][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 6986.419962][ C2] ? ktime_get+0xb3/0x190 [ 6986.419965][ C2] ? clockevents_program_event+0x1ea/0x300 [ 6986.419969][ C2] run_timer_softirq+0x72/0x100 [ 6986.419973][ C2] __do_softirq+0x1b9/0x7ff [ 6986.419977][ C2] irq_exit_rcu+0x98/0xc0 [ 6986.419979][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 6986.419982][ C2] [ 6986.419983][ C2] [ 6986.419984][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6986.419987][ C2] RIP: 0010:default_idle+0xf/0x20 [ 6986.419990][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 6986.419992][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 6986.419994][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 6986.419995][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 6986.419997][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 6986.419998][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 6986.420000][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 6986.420003][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 6986.420006][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 6986.420009][ C2] default_idle_call+0x69/0xa0 [ 6986.420012][ C2] cpuidle_idle_call+0x1f6/0x280 [ 6986.420014][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 6986.420017][ C2] ? lock_release+0x1d5/0x250 [ 6986.420019][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 6986.420023][ C2] do_idle+0xfb/0x160 [ 6986.420025][ C2] cpu_startup_entry+0x55/0x60 [ 6986.420028][ C2] start_secondary+0x21c/0x2b0 [ 6986.420030][ C2] ? __pfx_start_secondary+0x10/0x10 [ 6986.420034][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 6986.420040][ C2] [ 7012.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4339s! [perl:4135] [ 7012.569683][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7012.570911][ C1] irq event stamp: 209232 [ 7012.571125][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7012.571644][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7012.572111][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7012.572568][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7012.573021][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7012.573460][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7012.574059][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7012.574376][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7012.575326][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7012.575627][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7012.576041][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7012.576443][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7012.576844][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7012.577250][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7012.577639][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7012.578077][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7012.578403][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7012.578797][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7012.579188][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7012.579578][ C1] PKRU: 55555554 [ 7012.579756][ C1] Call Trace: [ 7012.579923][ C1] [ 7012.580068][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7012.580324][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7012.580562][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7012.580832][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7012.581101][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7012.581382][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7012.581641][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7012.581940][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7012.582195][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7012.582498][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7012.582790][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7012.583097][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7012.583381][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7012.583670][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7012.583951][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7012.584256][ C1] ? get_stack_info+0x36/0xc0 [ 7012.584493][ C1] ? lock_acquire+0x1c1/0x220 [ 7012.584727][ C1] ? lock_release+0x1d5/0x250 [ 7012.584962][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7012.585205][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7012.585471][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7012.585751][ C1] ? lock_acquire+0x1c1/0x220 [ 7012.586006][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7012.586246][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7012.586506][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7012.586743][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7012.586991][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7012.587254][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7012.587524][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7012.587794][ C1] ip_local_deliver+0x19d/0x480 [ 7012.588036][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7012.588301][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7012.588560][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7012.588899][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7012.589147][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7012.589460][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7012.589718][ C1] ip_rcv+0x564/0x740 [ 7012.589917][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7012.590143][ C1] ? set_track_prepare+0x8a/0xd0 [ 7012.590390][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7012.590659][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7012.590925][ C1] ? skb_clone+0x10b/0x330 [ 7012.591148][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7012.591460][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7012.591758][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7012.592034][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7012.592320][ C1] ? __tcf_classify+0x329/0x7d0 [ 7012.592564][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7012.592790][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7012.593083][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7012.593361][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7012.593680][ C1] ? lock_acquire+0x1c1/0x220 [ 7012.593913][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7012.594202][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7012.594483][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7012.594794][ C1] ? __copy_skb_header+0xaf/0x490 [ 7012.595046][ C1] ? __skb_clone+0x57a/0x760 [ 7012.595277][ C1] netif_receive_skb+0x55/0x280 [ 7012.595518][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7012.595825][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7012.596178][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7012.596479][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7012.596754][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7012.597044][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7012.597360][ C1] ? hlock_class+0x4e/0x130 [ 7012.597589][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7012.597857][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7012.598129][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7012.598387][ C1] ? hlock_class+0x4e/0x130 [ 7012.598611][ C1] ? mark_lock+0x38/0x3e0 [ 7012.598827][ C1] ? stack_access_ok+0xda/0x1f0 [ 7012.599070][ C1] ? __lock_acquire+0xb67/0x1610 [ 7012.599319][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7012.599588][ C1] ? get_stack_info+0x36/0xc0 [ 7012.599823][ C1] ? stack_access_ok+0xda/0x1f0 [ 7012.600065][ C1] ? get_reg+0x119/0x190 [ 7012.600276][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7012.600536][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7012.600838][ C1] __tcf_classify+0x329/0x7d0 [ 7012.601075][ C1] tcf_classify+0x283/0x930 [ 7012.601300][ C1] ? arch_stack_walk+0xa2/0x100 [ 7012.601543][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7012.601794][ C1] ? get_stack_info+0x36/0xc0 [ 7012.602030][ C1] tc_run+0x2e4/0x5d0 [ 7012.602230][ C1] ? __pfx_tc_run+0x10/0x10 [ 7012.602457][ C1] ? lock_acquire+0x1c1/0x220 [ 7012.602690][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7012.602946][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7012.603193][ C1] ? lock_acquire+0x1c1/0x220 [ 7012.603426][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7012.603683][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7012.603983][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7012.604248][ C1] ? neigh_hh_output+0x348/0x590 [ 7012.604495][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7012.604755][ C1] ip_finish_output2+0x786/0x18e0 [ 7012.605006][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7012.605278][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7012.605608][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7012.605898][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7012.606152][ C1] ? __ip_finish_output+0x10f/0x770 [ 7012.606418][ C1] ip_output+0x16b/0x4f0 [ 7012.606637][ C1] ? run_timer_softirq+0x72/0x100 [ 7012.606895][ C1] ? __pfx_ip_output+0x10/0x10 [ 7012.607147][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7012.607426][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7012.607673][ C1] ? ip_local_out+0x114/0x3b0 [ 7012.607909][ C1] __ip_queue_xmit+0x672/0x1910 [ 7012.608151][ C1] ? __create_object+0x5e/0xb0 [ 7012.608389][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7012.608651][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7012.608927][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7012.609194][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7012.609469][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7012.609737][ C1] tcp_delack_timer+0x84/0x240 [ 7012.609975][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7012.610243][ C1] call_timer_fn+0x173/0x430 [ 7012.610472][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7012.610729][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7012.610985][ C1] __run_timers.part.0+0x52d/0x890 [ 7012.611241][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7012.611508][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7012.611785][ C1] ? lock_acquire+0x1c1/0x220 [ 7012.612020][ C1] ? clockevents_program_event+0xf6/0x300 [ 7012.612305][ C1] ? lock_release+0x1d5/0x250 [ 7012.612537][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7012.612797][ C1] ? ktime_get+0xb3/0x190 [ 7012.613014][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7012.613304][ C1] run_timer_softirq+0x72/0x100 [ 7012.613545][ C1] __do_softirq+0x1b9/0x7ff [ 7012.613774][ C1] irq_exit_rcu+0x98/0xc0 [ 7012.613989][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7012.614269][ C1] [ 7012.614417][ C1] [ 7012.614566][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7012.614862][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7012.615182][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7012.616162][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7012.616469][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7012.616873][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7012.617279][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7012.617667][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7012.618057][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7012.618455][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7012.618743][ C1] pipe_read+0xa16/0xdf0 [ 7012.618959][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7012.619231][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7012.619470][ C1] ? iterate_tty_write+0x299/0x540 [ 7012.619726][ C1] ? lock_release+0x1d5/0x250 [ 7012.619961][ C1] vfs_read+0x911/0xc00 [ 7012.620171][ C1] ? lock_acquire+0x1c1/0x220 [ 7012.620405][ C1] ? __might_fault+0xc6/0x180 [ 7012.620637][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7012.620872][ C1] ? __might_fault+0xc6/0x180 [ 7012.621107][ C1] ? lock_release+0x1d5/0x250 [ 7012.621342][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7012.621604][ C1] ? __fget_light+0x54/0x1e0 [ 7012.621835][ C1] ksys_read+0x17a/0x1e0 [ 7012.622048][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7012.622287][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7012.622584][ C1] do_syscall_64+0xc9/0x1e0 [ 7012.622812][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7012.623107][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7012.623329][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7012.624279][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7012.624693][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7012.625086][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7012.625477][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7012.625889][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7012.626289][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7012.626693][ C1] [ 7012.626851][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4339s! [swapper/2:0] [ 7012.627267][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7012.628469][ C2] irq event stamp: 44114564 [ 7012.628692][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7012.629207][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7012.629701][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7012.630164][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7012.630615][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7012.631053][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7012.631643][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7012.631955][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7012.632890][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7012.633186][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7012.633570][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7012.633953][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7012.634337][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7012.634723][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7012.635106][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7012.635536][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7012.635877][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7012.636272][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7012.636668][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7012.637072][ C2] PKRU: 55555554 [ 7012.637248][ C2] Call Trace: [ 7012.637412][ C2] [ 7012.637554][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7012.637805][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7012.638041][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7012.638307][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7012.638569][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7012.638850][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7012.639106][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7012.639401][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7012.639653][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7012.639906][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7012.640207][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7012.640491][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7012.640795][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7012.641075][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7012.641360][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7012.641640][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7012.641942][ C2] ? get_stack_info+0x36/0xc0 [ 7012.642173][ C2] ? lock_acquire+0x1c1/0x220 [ 7012.642407][ C2] ? lock_release+0x1d5/0x250 [ 7012.642638][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7012.642879][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7012.643142][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7012.643417][ C2] ? lock_acquire+0x1c1/0x220 [ 7012.643647][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7012.643880][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7012.644130][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7012.644357][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7012.644596][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7012.644844][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7012.645110][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7012.645377][ C2] ip_local_deliver+0x19d/0x480 [ 7012.645615][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7012.645897][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7012.646157][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7012.646503][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7012.646752][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7012.647081][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7012.647334][ C2] ip_rcv+0x564/0x740 [ 7012.647531][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7012.647754][ C2] ? set_track_prepare+0x8a/0xd0 [ 7012.647996][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7012.648266][ C2] ? start_secondary+0x21c/0x2b0 [ 7012.648509][ C2] ? skb_clone+0x10b/0x330 [ 7012.648726][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7012.649033][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7012.649330][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7012.649599][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7012.649884][ C2] ? __tcf_classify+0x329/0x7d0 [ 7012.650125][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7012.650345][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7012.650635][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7012.650909][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7012.651226][ C2] ? lock_acquire+0x1c1/0x220 [ 7012.651457][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7012.651745][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7012.652018][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7012.652325][ C2] ? __copy_skb_header+0xaf/0x490 [ 7012.652573][ C2] ? __skb_clone+0x57a/0x760 [ 7012.652801][ C2] netif_receive_skb+0x55/0x280 [ 7012.653041][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7012.653344][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7012.653665][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7012.653952][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7012.654219][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7012.654497][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7012.654799][ C2] ? get_stack_info+0x36/0xc0 [ 7012.655031][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7012.655288][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7012.655594][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7012.655881][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7012.656154][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7012.656465][ C2] ? kernel_text_address+0x17/0xe0 [ 7012.656723][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7012.657043][ C2] ? arch_stack_walk+0x8c/0x100 [ 7012.657283][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7012.657537][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7012.657813][ C2] ? lock_acquire+0x1c1/0x220 [ 7012.658042][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7012.658316][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7012.658607][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7012.658875][ C2] ? get_stack_info+0x36/0xc0 [ 7012.659107][ C2] __tcf_classify+0x329/0x7d0 [ 7012.659340][ C2] tcf_classify+0x283/0x930 [ 7012.659564][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7012.659812][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7012.660115][ C2] tc_run+0x2e4/0x5d0 [ 7012.660312][ C2] ? __pfx_tc_run+0x10/0x10 [ 7012.660534][ C2] ? lock_acquire+0x1c1/0x220 [ 7012.660763][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7012.661014][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7012.661259][ C2] ? lock_acquire+0x1c1/0x220 [ 7012.661490][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7012.661744][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7012.662038][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7012.662300][ C2] ? neigh_hh_output+0x348/0x590 [ 7012.662543][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7012.662797][ C2] ip_finish_output2+0x786/0x18e0 [ 7012.663044][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7012.663369][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7012.663638][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7012.663881][ C2] ? __ip_finish_output+0x10f/0x770 [ 7012.664137][ C2] ip_output+0x16b/0x4f0 [ 7012.664345][ C2] ? __pfx_ip_output+0x10/0x10 [ 7012.664580][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7012.664846][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7012.665148][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7012.665417][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7012.665659][ C2] ? __alloc_skb+0xd4/0x280 [ 7012.665904][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7012.666170][ C2] ? tcp_fragment+0x168/0x1040 [ 7012.666412][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7012.666659][ C2] ? ip_local_out+0x114/0x3b0 [ 7012.666898][ C2] __ip_queue_xmit+0x672/0x1910 [ 7012.667152][ C2] ? __skb_clone+0x57a/0x760 [ 7012.667378][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7012.667634][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7012.667908][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7012.668144][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7012.668382][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7012.668673][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7012.668981][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7012.669217][ C2] tcp_send_loss_probe+0x348/0x830 [ 7012.669468][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7012.669726][ C2] tcp_write_timer+0x82/0x1d0 [ 7012.669958][ C2] call_timer_fn+0x173/0x430 [ 7012.670188][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7012.670440][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7012.670692][ C2] __run_timers.part.0+0x52d/0x890 [ 7012.670943][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7012.671203][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7012.671477][ C2] ? lock_acquire+0x1c1/0x220 [ 7012.671707][ C2] ? clockevents_program_event+0xf6/0x300 [ 7012.671988][ C2] ? lock_release+0x1d5/0x250 [ 7012.672218][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7012.672473][ C2] ? ktime_get+0xb3/0x190 [ 7012.672686][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7012.672971][ C2] run_timer_softirq+0x72/0x100 [ 7012.673211][ C2] __do_softirq+0x1b9/0x7ff [ 7012.673435][ C2] irq_exit_rcu+0x98/0xc0 [ 7012.673648][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7012.673923][ C2] [ 7012.674066][ C2] [ 7012.674214][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7012.674506][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7012.674772][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7012.675729][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7012.676037][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7012.676434][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7012.676828][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7012.677226][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7012.677611][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7012.678000][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7012.678279][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7012.678530][ C2] default_idle_call+0x69/0xa0 [ 7012.678766][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7012.679007][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7012.679274][ C2] ? lock_release+0x1d5/0x250 [ 7012.679506][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7012.679769][ C2] do_idle+0xfb/0x160 [ 7012.679966][ C2] cpu_startup_entry+0x55/0x60 [ 7012.680200][ C2] start_secondary+0x21c/0x2b0 [ 7012.680435][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7012.680694][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7012.680994][ C2] [ 7040.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4366s! [perl:4135] [ 7040.569678][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7040.570904][ C1] irq event stamp: 209232 [ 7040.571119][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7040.571635][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7040.572104][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7040.572564][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7040.573016][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7040.573454][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7040.574056][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7040.574375][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7040.575325][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7040.575627][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7040.576045][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7040.576445][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7040.576845][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7040.577251][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7040.577641][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7040.578079][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7040.578406][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7040.578798][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7040.579193][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7040.579583][ C1] PKRU: 55555554 [ 7040.579761][ C1] Call Trace: [ 7040.579927][ C1] [ 7040.580072][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7040.580329][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7040.580568][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7040.580839][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7040.581106][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7040.581391][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7040.581651][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7040.581952][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7040.582209][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7040.582512][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7040.582801][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7040.583109][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7040.583392][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7040.583682][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7040.583966][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7040.584271][ C1] ? get_stack_info+0x36/0xc0 [ 7040.584507][ C1] ? lock_acquire+0x1c1/0x220 [ 7040.584743][ C1] ? lock_release+0x1d5/0x250 [ 7040.584979][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7040.585224][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7040.585491][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7040.585789][ C1] ? lock_acquire+0x1c1/0x220 [ 7040.586031][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7040.586273][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7040.586536][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7040.586772][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7040.587028][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7040.587281][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7040.587553][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7040.587825][ C1] ip_local_deliver+0x19d/0x480 [ 7040.588068][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7040.588335][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7040.588594][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7040.588937][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7040.589185][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7040.589499][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7040.589757][ C1] ip_rcv+0x564/0x740 [ 7040.589958][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7040.590184][ C1] ? set_track_prepare+0x8a/0xd0 [ 7040.590432][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7040.590705][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7040.590973][ C1] ? skb_clone+0x10b/0x330 [ 7040.591194][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7040.591507][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7040.591808][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7040.592085][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7040.592374][ C1] ? __tcf_classify+0x329/0x7d0 [ 7040.592619][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7040.592844][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7040.593139][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7040.593419][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7040.593739][ C1] ? lock_acquire+0x1c1/0x220 [ 7040.593971][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7040.594264][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7040.594544][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7040.594854][ C1] ? __copy_skb_header+0xaf/0x490 [ 7040.595107][ C1] ? __skb_clone+0x57a/0x760 [ 7040.595339][ C1] netif_receive_skb+0x55/0x280 [ 7040.595583][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7040.595914][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7040.596248][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7040.596550][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7040.596827][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7040.597122][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7040.597428][ C1] ? hlock_class+0x4e/0x130 [ 7040.597656][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7040.597926][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7040.598196][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7040.598453][ C1] ? hlock_class+0x4e/0x130 [ 7040.598681][ C1] ? mark_lock+0x38/0x3e0 [ 7040.598895][ C1] ? stack_access_ok+0xda/0x1f0 [ 7040.599140][ C1] ? __lock_acquire+0xb67/0x1610 [ 7040.599388][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7040.599659][ C1] ? get_stack_info+0x36/0xc0 [ 7040.599895][ C1] ? stack_access_ok+0xda/0x1f0 [ 7040.600137][ C1] ? get_reg+0x119/0x190 [ 7040.600349][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7040.600613][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7040.600916][ C1] __tcf_classify+0x329/0x7d0 [ 7040.601153][ C1] tcf_classify+0x283/0x930 [ 7040.601381][ C1] ? arch_stack_walk+0xa2/0x100 [ 7040.601628][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7040.601879][ C1] ? get_stack_info+0x36/0xc0 [ 7040.602115][ C1] tc_run+0x2e4/0x5d0 [ 7040.602318][ C1] ? __pfx_tc_run+0x10/0x10 [ 7040.602543][ C1] ? lock_acquire+0x1c1/0x220 [ 7040.602778][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7040.603034][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7040.603282][ C1] ? lock_acquire+0x1c1/0x220 [ 7040.603517][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7040.603777][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7040.604077][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7040.604343][ C1] ? neigh_hh_output+0x348/0x590 [ 7040.604592][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7040.604852][ C1] ip_finish_output2+0x786/0x18e0 [ 7040.605103][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7040.605375][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7040.605706][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7040.606005][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7040.606260][ C1] ? __ip_finish_output+0x10f/0x770 [ 7040.606527][ C1] ip_output+0x16b/0x4f0 [ 7040.606744][ C1] ? run_timer_softirq+0x72/0x100 [ 7040.607013][ C1] ? __pfx_ip_output+0x10/0x10 [ 7040.607252][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7040.607532][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7040.607779][ C1] ? ip_local_out+0x114/0x3b0 [ 7040.608014][ C1] __ip_queue_xmit+0x672/0x1910 [ 7040.608258][ C1] ? __create_object+0x5e/0xb0 [ 7040.608498][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7040.608759][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7040.609034][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7040.609303][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7040.609579][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7040.609845][ C1] tcp_delack_timer+0x84/0x240 [ 7040.610085][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7040.610351][ C1] call_timer_fn+0x173/0x430 [ 7040.610583][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7040.610838][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7040.611094][ C1] __run_timers.part.0+0x52d/0x890 [ 7040.611349][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7040.611617][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7040.611900][ C1] ? lock_acquire+0x1c1/0x220 [ 7040.612135][ C1] ? clockevents_program_event+0xf6/0x300 [ 7040.612417][ C1] ? lock_release+0x1d5/0x250 [ 7040.612652][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7040.612912][ C1] ? ktime_get+0xb3/0x190 [ 7040.613129][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7040.613421][ C1] run_timer_softirq+0x72/0x100 [ 7040.613664][ C1] __do_softirq+0x1b9/0x7ff [ 7040.613893][ C1] irq_exit_rcu+0x98/0xc0 [ 7040.614108][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7040.614389][ C1] [ 7040.614537][ C1] [ 7040.614684][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7040.614982][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7040.615301][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7040.616285][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7040.616596][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7040.617007][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7040.617398][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7040.617791][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7040.618182][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7040.618573][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7040.618864][ C1] pipe_read+0xa16/0xdf0 [ 7040.619079][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7040.619352][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7040.619590][ C1] ? iterate_tty_write+0x299/0x540 [ 7040.619846][ C1] ? lock_release+0x1d5/0x250 [ 7040.620083][ C1] vfs_read+0x911/0xc00 [ 7040.620292][ C1] ? lock_acquire+0x1c1/0x220 [ 7040.620526][ C1] ? __might_fault+0xc6/0x180 [ 7040.620762][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7040.620998][ C1] ? __might_fault+0xc6/0x180 [ 7040.621232][ C1] ? lock_release+0x1d5/0x250 [ 7040.621468][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7040.621726][ C1] ? __fget_light+0x54/0x1e0 [ 7040.621959][ C1] ksys_read+0x17a/0x1e0 [ 7040.622172][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7040.622413][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7040.622712][ C1] do_syscall_64+0xc9/0x1e0 [ 7040.622940][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7040.623232][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7040.623456][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7040.624410][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7040.624823][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7040.625215][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7040.625606][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7040.626023][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7040.626426][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7040.626832][ C1] [ 7040.626999][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4366s! [swapper/2:0] [ 7040.627394][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7040.628596][ C2] irq event stamp: 44114564 [ 7040.628816][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7040.629330][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7040.629822][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7040.630282][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7040.630732][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7040.631170][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7040.631761][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7040.632073][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7040.633008][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7040.633304][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7040.633686][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7040.634071][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7040.634456][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7040.634842][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7040.635226][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7040.635655][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7040.636001][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7040.636399][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7040.636794][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7040.637191][ C2] PKRU: 55555554 [ 7040.637365][ C2] Call Trace: [ 7040.637529][ C2] [ 7040.637670][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7040.637920][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7040.638155][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7040.638421][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7040.638685][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7040.638961][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7040.639216][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7040.639510][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7040.639761][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7040.640013][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7040.640311][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7040.640595][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7040.640896][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7040.641176][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7040.641460][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7040.641738][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7040.642038][ C2] ? get_stack_info+0x36/0xc0 [ 7040.642271][ C2] ? lock_acquire+0x1c1/0x220 [ 7040.642500][ C2] ? lock_release+0x1d5/0x250 [ 7040.642731][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7040.642970][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7040.643232][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7040.643508][ C2] ? lock_acquire+0x1c1/0x220 [ 7040.643737][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7040.643968][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7040.644218][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7040.644445][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7040.644683][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7040.644931][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7040.645194][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7040.645460][ C2] ip_local_deliver+0x19d/0x480 [ 7040.645699][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7040.645985][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7040.646248][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7040.646590][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7040.646840][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7040.647161][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7040.647413][ C2] ip_rcv+0x564/0x740 [ 7040.647608][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7040.647831][ C2] ? set_track_prepare+0x8a/0xd0 [ 7040.648075][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7040.648340][ C2] ? start_secondary+0x21c/0x2b0 [ 7040.648583][ C2] ? skb_clone+0x10b/0x330 [ 7040.648801][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7040.649107][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7040.649403][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7040.649673][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7040.649956][ C2] ? __tcf_classify+0x329/0x7d0 [ 7040.650196][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7040.650417][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7040.650705][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7040.650980][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7040.651296][ C2] ? lock_acquire+0x1c1/0x220 [ 7040.651525][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7040.651811][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7040.652086][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7040.652392][ C2] ? __copy_skb_header+0xaf/0x490 [ 7040.652640][ C2] ? __skb_clone+0x57a/0x760 [ 7040.652866][ C2] netif_receive_skb+0x55/0x280 [ 7040.653105][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7040.653406][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7040.653727][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7040.654016][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7040.654280][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7040.654557][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7040.654859][ C2] ? get_stack_info+0x36/0xc0 [ 7040.655091][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7040.655346][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7040.655651][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7040.655941][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7040.656215][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7040.656525][ C2] ? kernel_text_address+0x17/0xe0 [ 7040.656783][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7040.657096][ C2] ? arch_stack_walk+0x8c/0x100 [ 7040.657334][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7040.657588][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7040.657864][ C2] ? lock_acquire+0x1c1/0x220 [ 7040.658094][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7040.658365][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7040.658658][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7040.658923][ C2] ? get_stack_info+0x36/0xc0 [ 7040.659157][ C2] __tcf_classify+0x329/0x7d0 [ 7040.659388][ C2] tcf_classify+0x283/0x930 [ 7040.659612][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7040.659858][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7040.660160][ C2] tc_run+0x2e4/0x5d0 [ 7040.660357][ C2] ? __pfx_tc_run+0x10/0x10 [ 7040.660580][ C2] ? lock_acquire+0x1c1/0x220 [ 7040.660809][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7040.661061][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7040.661304][ C2] ? lock_acquire+0x1c1/0x220 [ 7040.661533][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7040.661787][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7040.662080][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7040.662343][ C2] ? neigh_hh_output+0x348/0x590 [ 7040.662586][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7040.662841][ C2] ip_finish_output2+0x786/0x18e0 [ 7040.663088][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7040.663415][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7040.663680][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7040.663924][ C2] ? __ip_finish_output+0x10f/0x770 [ 7040.664179][ C2] ip_output+0x16b/0x4f0 [ 7040.664386][ C2] ? __pfx_ip_output+0x10/0x10 [ 7040.664621][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7040.664888][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7040.665188][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7040.665456][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7040.665698][ C2] ? __alloc_skb+0xd4/0x280 [ 7040.665943][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7040.666208][ C2] ? tcp_fragment+0x168/0x1040 [ 7040.666450][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7040.666699][ C2] ? ip_local_out+0x114/0x3b0 [ 7040.666937][ C2] __ip_queue_xmit+0x672/0x1910 [ 7040.667188][ C2] ? __skb_clone+0x57a/0x760 [ 7040.667414][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7040.667671][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7040.667940][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7040.668177][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7040.668418][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7040.668706][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7040.669014][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7040.669249][ C2] tcp_send_loss_probe+0x348/0x830 [ 7040.669499][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7040.669757][ C2] tcp_write_timer+0x82/0x1d0 [ 7040.669988][ C2] call_timer_fn+0x173/0x430 [ 7040.670216][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7040.670468][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7040.670719][ C2] __run_timers.part.0+0x52d/0x890 [ 7040.670969][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7040.671228][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7040.671504][ C2] ? lock_acquire+0x1c1/0x220 [ 7040.671732][ C2] ? clockevents_program_event+0xf6/0x300 [ 7040.672012][ C2] ? lock_release+0x1d5/0x250 [ 7040.672243][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7040.672496][ C2] ? ktime_get+0xb3/0x190 [ 7040.672708][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7040.672995][ C2] run_timer_softirq+0x72/0x100 [ 7040.673234][ C2] __do_softirq+0x1b9/0x7ff [ 7040.673456][ C2] irq_exit_rcu+0x98/0xc0 [ 7040.673670][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7040.673942][ C2] [ 7040.674088][ C2] [ 7040.674233][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7040.674526][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7040.674772][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7040.675739][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7040.676042][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7040.676436][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7040.676829][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7040.677225][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7040.677610][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7040.677994][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7040.678272][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7040.678523][ C2] default_idle_call+0x69/0xa0 [ 7040.678757][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7040.678998][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7040.679266][ C2] ? lock_release+0x1d5/0x250 [ 7040.679495][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7040.679760][ C2] do_idle+0xfb/0x160 [ 7040.679956][ C2] cpu_startup_entry+0x55/0x60 [ 7040.680190][ C2] start_secondary+0x21c/0x2b0 [ 7040.680423][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7040.680685][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7040.680982][ C2] [ 7064.420102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7064.420457][ C1] rcu: 1-....: (4698122 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1152302 [ 7064.421006][ C1] rcu: (t=4709533 jiffies g=1882453 q=718 ncpus=4) [ 7064.421333][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7064.421771][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7064.422371][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7064.422690][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7064.423637][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7064.423939][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7064.424330][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7064.424721][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7064.425111][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7064.425502][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7064.425920][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7064.426369][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7064.426705][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7064.427111][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7064.427500][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7064.427891][ C1] PKRU: 55555554 [ 7064.428067][ C1] Call Trace: [ 7064.428235][ C1] [ 7064.428378][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7064.428648][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7064.428895][ C1] ? check_cpu_stall+0x284/0x500 [ 7064.429142][ C1] ? rcu_pending+0x92/0x360 [ 7064.429368][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7064.429632][ C1] ? update_process_times+0xb9/0x110 [ 7064.429896][ C1] ? tick_sched_handle+0x67/0x130 [ 7064.430149][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7064.430430][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7064.430668][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7064.430974][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7064.431241][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7064.431522][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7064.431783][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7064.432082][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7064.432338][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7064.432641][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7064.432930][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7064.433238][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7064.433520][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7064.433809][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7064.434091][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7064.434396][ C1] ? get_stack_info+0x36/0xc0 [ 7064.434631][ C1] ? lock_acquire+0x1c1/0x220 [ 7064.434867][ C1] ? lock_release+0x1d5/0x250 [ 7064.435100][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7064.435344][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7064.435611][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7064.435917][ C1] ? lock_acquire+0x1c1/0x220 [ 7064.436157][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7064.436398][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7064.436659][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7064.436895][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7064.437150][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7064.437401][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7064.437669][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7064.437942][ C1] ip_local_deliver+0x19d/0x480 [ 7064.438184][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7064.438451][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7064.438710][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7064.439048][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7064.439295][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7064.439608][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7064.439864][ C1] ip_rcv+0x564/0x740 [ 7064.440082][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7064.440315][ C1] ? set_track_prepare+0x8a/0xd0 [ 7064.440570][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7064.440847][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7064.441121][ C1] ? skb_clone+0x10b/0x330 [ 7064.441356][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7064.441668][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7064.441969][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7064.442244][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7064.442533][ C1] ? __tcf_classify+0x329/0x7d0 [ 7064.442776][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7064.443002][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7064.443297][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7064.443576][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7064.443895][ C1] ? lock_acquire+0x1c1/0x220 [ 7064.444129][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7064.444420][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7064.444699][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7064.445010][ C1] ? __copy_skb_header+0xaf/0x490 [ 7064.445262][ C1] ? __skb_clone+0x57a/0x760 [ 7064.445493][ C1] netif_receive_skb+0x55/0x280 [ 7064.445759][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7064.446072][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7064.446407][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7064.446707][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7064.446989][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7064.447273][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7064.447579][ C1] ? hlock_class+0x4e/0x130 [ 7064.447805][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7064.448076][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7064.448347][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7064.448605][ C1] ? hlock_class+0x4e/0x130 [ 7064.448831][ C1] ? mark_lock+0x38/0x3e0 [ 7064.449046][ C1] ? stack_access_ok+0xda/0x1f0 [ 7064.449290][ C1] ? __lock_acquire+0xb67/0x1610 [ 7064.449539][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7064.449808][ C1] ? get_stack_info+0x36/0xc0 [ 7064.450043][ C1] ? stack_access_ok+0xda/0x1f0 [ 7064.450285][ C1] ? get_reg+0x119/0x190 [ 7064.450496][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7064.450756][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7064.451059][ C1] __tcf_classify+0x329/0x7d0 [ 7064.451297][ C1] tcf_classify+0x283/0x930 [ 7064.451523][ C1] ? arch_stack_walk+0xa2/0x100 [ 7064.451765][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7064.452016][ C1] ? get_stack_info+0x36/0xc0 [ 7064.452253][ C1] tc_run+0x2e4/0x5d0 [ 7064.452452][ C1] ? __pfx_tc_run+0x10/0x10 [ 7064.452680][ C1] ? lock_acquire+0x1c1/0x220 [ 7064.452915][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7064.453171][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7064.453419][ C1] ? lock_acquire+0x1c1/0x220 [ 7064.453652][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7064.453911][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7064.454209][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7064.454477][ C1] ? neigh_hh_output+0x348/0x590 [ 7064.454724][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7064.454984][ C1] ip_finish_output2+0x786/0x18e0 [ 7064.455235][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7064.455506][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7064.455860][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7064.456138][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7064.456390][ C1] ? __ip_finish_output+0x10f/0x770 [ 7064.456657][ C1] ip_output+0x16b/0x4f0 [ 7064.456885][ C1] ? run_timer_softirq+0x72/0x100 [ 7064.457136][ C1] ? __pfx_ip_output+0x10/0x10 [ 7064.457375][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7064.457654][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7064.457900][ C1] ? ip_local_out+0x114/0x3b0 [ 7064.458135][ C1] __ip_queue_xmit+0x672/0x1910 [ 7064.458379][ C1] ? __create_object+0x5e/0xb0 [ 7064.458617][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7064.458878][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7064.459154][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7064.459419][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7064.459696][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7064.459961][ C1] tcp_delack_timer+0x84/0x240 [ 7064.460201][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7064.460467][ C1] call_timer_fn+0x173/0x430 [ 7064.460698][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7064.460954][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7064.461213][ C1] __run_timers.part.0+0x52d/0x890 [ 7064.461467][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7064.461735][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7064.462014][ C1] ? lock_acquire+0x1c1/0x220 [ 7064.462248][ C1] ? clockevents_program_event+0xf6/0x300 [ 7064.462535][ C1] ? lock_release+0x1d5/0x250 [ 7064.462769][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7064.463028][ C1] ? ktime_get+0xb3/0x190 [ 7064.463243][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7064.463535][ C1] run_timer_softirq+0x72/0x100 [ 7064.463779][ C1] __do_softirq+0x1b9/0x7ff [ 7064.464006][ C1] irq_exit_rcu+0x98/0xc0 [ 7064.464223][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7064.464503][ C1] [ 7064.464650][ C1] [ 7064.464798][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7064.465096][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7064.465415][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7064.466406][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7064.466715][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7064.467118][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7064.467506][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7064.467896][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7064.468288][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7064.468680][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7064.468969][ C1] pipe_read+0xa16/0xdf0 [ 7064.469186][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7064.469457][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7064.469695][ C1] ? iterate_tty_write+0x299/0x540 [ 7064.469951][ C1] ? lock_release+0x1d5/0x250 [ 7064.470192][ C1] vfs_read+0x911/0xc00 [ 7064.470401][ C1] ? lock_acquire+0x1c1/0x220 [ 7064.470636][ C1] ? __might_fault+0xc6/0x180 [ 7064.470871][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7064.471105][ C1] ? __might_fault+0xc6/0x180 [ 7064.471341][ C1] ? lock_release+0x1d5/0x250 [ 7064.471577][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7064.471836][ C1] ? __fget_light+0x54/0x1e0 [ 7064.472069][ C1] ksys_read+0x17a/0x1e0 [ 7064.472281][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7064.472520][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7064.472818][ C1] do_syscall_64+0xc9/0x1e0 [ 7064.473044][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7064.473339][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7064.473561][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7064.474511][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7064.474923][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7064.475313][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7064.475728][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7064.476129][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7064.476529][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7064.476940][ C1] [ 7064.477096][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7064.477361][ C2] NMI backtrace for cpu 2 [ 7064.477367][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7064.477373][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7064.477377][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7064.477385][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7064.477390][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7064.477395][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7064.477399][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7064.477402][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7064.477406][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7064.477409][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7064.477410][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7064.477412][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7064.477416][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7064.477417][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7064.477418][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7064.477420][ C2] PKRU: 55555554 [ 7064.477421][ C2] Call Trace: [ 7064.477422][ C2] [ 7064.477424][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7064.477431][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7064.477435][ C2] ? nmi_handle+0x153/0x420 [ 7064.477439][ C2] ? default_do_nmi+0x41/0x100 [ 7064.477442][ C2] ? exc_nmi+0xf3/0x120 [ 7064.477444][ C2] ? end_repeat_nmi+0xf/0x60 [ 7064.477449][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7064.477452][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7064.477455][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7064.477458][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7064.477461][ C2] [ 7064.477462][ C2] [ 7064.477463][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7064.477466][ C2] ? get_stack_info+0x36/0xc0 [ 7064.477469][ C2] ? lock_acquire+0x1c1/0x220 [ 7064.477473][ C2] ? lock_release+0x1d5/0x250 [ 7064.477476][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7064.477479][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7064.477482][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7064.477485][ C2] ? lock_acquire+0x1c1/0x220 [ 7064.477487][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7064.477491][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7064.477493][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7064.477499][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7064.477502][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7064.477506][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7064.477510][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7064.477513][ C2] ip_local_deliver+0x19d/0x480 [ 7064.477516][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7064.477518][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7064.477520][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7064.477525][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7064.477529][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7064.477532][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7064.477540][ C2] ip_rcv+0x564/0x740 [ 7064.477543][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7064.477545][ C2] ? set_track_prepare+0x8a/0xd0 [ 7064.477549][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7064.477552][ C2] ? start_secondary+0x21c/0x2b0 [ 7064.477556][ C2] ? skb_clone+0x10b/0x330 [ 7064.477558][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7064.477564][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7064.477569][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7064.477572][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7064.477579][ C2] ? __tcf_classify+0x329/0x7d0 [ 7064.477583][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7064.477585][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7064.477588][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7064.477592][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7064.477596][ C2] ? lock_acquire+0x1c1/0x220 [ 7064.477598][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7064.477602][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7064.477605][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7064.477609][ C2] ? __copy_skb_header+0xaf/0x490 [ 7064.477613][ C2] ? __skb_clone+0x57a/0x760 [ 7064.477615][ C2] netif_receive_skb+0x55/0x280 [ 7064.477618][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7064.477625][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7064.477631][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7064.477637][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7064.477642][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7064.477651][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7064.477658][ C2] ? get_stack_info+0x36/0xc0 [ 7064.477663][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7064.477665][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7064.477669][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7064.477671][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7064.477674][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7064.477677][ C2] ? kernel_text_address+0x17/0xe0 [ 7064.477680][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7064.477683][ C2] ? arch_stack_walk+0x8c/0x100 [ 7064.477687][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7064.477690][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7064.477693][ C2] ? lock_acquire+0x1c1/0x220 [ 7064.477695][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7064.477699][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7064.477703][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7064.477705][ C2] ? get_stack_info+0x36/0xc0 [ 7064.477710][ C2] __tcf_classify+0x329/0x7d0 [ 7064.477714][ C2] tcf_classify+0x283/0x930 [ 7064.477719][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7064.477722][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7064.477726][ C2] tc_run+0x2e4/0x5d0 [ 7064.477729][ C2] ? __pfx_tc_run+0x10/0x10 [ 7064.477732][ C2] ? lock_acquire+0x1c1/0x220 [ 7064.477734][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7064.477738][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7064.477742][ C2] ? lock_acquire+0x1c1/0x220 [ 7064.477744][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7064.477747][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7064.477750][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7064.477753][ C2] ? neigh_hh_output+0x348/0x590 [ 7064.477756][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7064.477760][ C2] ip_finish_output2+0x786/0x18e0 [ 7064.477763][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7064.477771][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7064.477773][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7064.477777][ C2] ? __ip_finish_output+0x10f/0x770 [ 7064.477780][ C2] ip_output+0x16b/0x4f0 [ 7064.477783][ C2] ? __pfx_ip_output+0x10/0x10 [ 7064.477786][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7064.477788][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7064.477791][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7064.477794][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7064.477796][ C2] ? __alloc_skb+0xd4/0x280 [ 7064.477799][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7064.477802][ C2] ? tcp_fragment+0x168/0x1040 [ 7064.477805][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7064.477808][ C2] ? ip_local_out+0x114/0x3b0 [ 7064.477811][ C2] __ip_queue_xmit+0x672/0x1910 [ 7064.477815][ C2] ? __skb_clone+0x57a/0x760 [ 7064.477817][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7064.477823][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7064.477826][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7064.477829][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7064.477833][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7064.477837][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7064.477840][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7064.477843][ C2] tcp_send_loss_probe+0x348/0x830 [ 7064.477846][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7064.477849][ C2] tcp_write_timer+0x82/0x1d0 [ 7064.477852][ C2] call_timer_fn+0x173/0x430 [ 7064.477856][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7064.477860][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7064.477864][ C2] __run_timers.part.0+0x52d/0x890 [ 7064.477867][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7064.477871][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7064.477874][ C2] ? lock_acquire+0x1c1/0x220 [ 7064.477876][ C2] ? clockevents_program_event+0xf6/0x300 [ 7064.477880][ C2] ? lock_release+0x1d5/0x250 [ 7064.477883][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7064.477886][ C2] ? ktime_get+0xb3/0x190 [ 7064.477889][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7064.477893][ C2] run_timer_softirq+0x72/0x100 [ 7064.477897][ C2] __do_softirq+0x1b9/0x7ff [ 7064.477901][ C2] irq_exit_rcu+0x98/0xc0 [ 7064.477903][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7064.477906][ C2] [ 7064.477907][ C2] [ 7064.477908][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7064.477911][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7064.477914][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7064.477916][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7064.477918][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7064.477920][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7064.477921][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7064.477923][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7064.477924][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7064.477928][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7064.477931][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7064.477934][ C2] default_idle_call+0x69/0xa0 [ 7064.477937][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7064.477939][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7064.477942][ C2] ? lock_release+0x1d5/0x250 [ 7064.477944][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7064.477948][ C2] do_idle+0xfb/0x160 [ 7064.477951][ C2] cpu_startup_entry+0x55/0x60 [ 7064.477953][ C2] start_secondary+0x21c/0x2b0 [ 7064.477955][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7064.477959][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7064.477965][ C2] [ 7088.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4410s! [perl:4135] [ 7088.569693][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7088.570924][ C1] irq event stamp: 209232 [ 7088.571137][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7088.571654][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7088.572122][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7088.572580][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7088.573032][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7088.573471][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7088.574074][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7088.574391][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7088.575342][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7088.575667][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7088.576067][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7088.576469][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7088.576878][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7088.577267][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7088.577657][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7088.578094][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7088.578420][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7088.578815][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7088.579206][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7088.579595][ C1] PKRU: 55555554 [ 7088.579773][ C1] Call Trace: [ 7088.579941][ C1] [ 7088.580086][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7088.580342][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7088.580581][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7088.580850][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7088.581119][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7088.581401][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7088.581661][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7088.581961][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7088.582217][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7088.582520][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7088.582808][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7088.583119][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7088.583404][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7088.583692][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7088.583975][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7088.584281][ C1] ? get_stack_info+0x36/0xc0 [ 7088.584517][ C1] ? lock_acquire+0x1c1/0x220 [ 7088.584750][ C1] ? lock_release+0x1d5/0x250 [ 7088.584986][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7088.585229][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7088.585495][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7088.585799][ C1] ? lock_acquire+0x1c1/0x220 [ 7088.586036][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7088.586279][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7088.586540][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7088.586787][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7088.587030][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7088.587283][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7088.587553][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7088.587821][ C1] ip_local_deliver+0x19d/0x480 [ 7088.588062][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7088.588326][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7088.588585][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7088.588944][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7088.589198][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7088.589519][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7088.589782][ C1] ip_rcv+0x564/0x740 [ 7088.589986][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7088.590225][ C1] ? set_track_prepare+0x8a/0xd0 [ 7088.590489][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7088.590767][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7088.591041][ C1] ? skb_clone+0x10b/0x330 [ 7088.591270][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7088.591590][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7088.591895][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7088.592181][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7088.592475][ C1] ? __tcf_classify+0x329/0x7d0 [ 7088.592726][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7088.592958][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7088.593258][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7088.593545][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7088.593872][ C1] ? lock_acquire+0x1c1/0x220 [ 7088.594113][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7088.594408][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7088.594697][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7088.595016][ C1] ? __copy_skb_header+0xaf/0x490 [ 7088.595276][ C1] ? __skb_clone+0x57a/0x760 [ 7088.595511][ C1] netif_receive_skb+0x55/0x280 [ 7088.595761][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7088.596077][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7088.596409][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7088.596710][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7088.596986][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7088.597276][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7088.597590][ C1] ? hlock_class+0x4e/0x130 [ 7088.597824][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7088.598100][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7088.598377][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7088.598642][ C1] ? hlock_class+0x4e/0x130 [ 7088.598872][ C1] ? mark_lock+0x38/0x3e0 [ 7088.599095][ C1] ? stack_access_ok+0xda/0x1f0 [ 7088.599344][ C1] ? __lock_acquire+0xb67/0x1610 [ 7088.599599][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7088.599877][ C1] ? get_stack_info+0x36/0xc0 [ 7088.600118][ C1] ? stack_access_ok+0xda/0x1f0 [ 7088.600365][ C1] ? get_reg+0x119/0x190 [ 7088.600583][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7088.600852][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7088.601164][ C1] __tcf_classify+0x329/0x7d0 [ 7088.601407][ C1] tcf_classify+0x283/0x930 [ 7088.601639][ C1] ? arch_stack_walk+0xa2/0x100 [ 7088.601889][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7088.602147][ C1] ? get_stack_info+0x36/0xc0 [ 7088.602390][ C1] tc_run+0x2e4/0x5d0 [ 7088.602595][ C1] ? __pfx_tc_run+0x10/0x10 [ 7088.602828][ C1] ? lock_acquire+0x1c1/0x220 [ 7088.603066][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7088.603331][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7088.603584][ C1] ? lock_acquire+0x1c1/0x220 [ 7088.603826][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7088.604090][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7088.604398][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7088.604669][ C1] ? neigh_hh_output+0x348/0x590 [ 7088.604923][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7088.605189][ C1] ip_finish_output2+0x786/0x18e0 [ 7088.605445][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7088.605752][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7088.606091][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7088.606369][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7088.606624][ C1] ? __ip_finish_output+0x10f/0x770 [ 7088.606890][ C1] ip_output+0x16b/0x4f0 [ 7088.607110][ C1] ? run_timer_softirq+0x72/0x100 [ 7088.607369][ C1] ? __pfx_ip_output+0x10/0x10 [ 7088.607614][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7088.607904][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7088.608159][ C1] ? ip_local_out+0x114/0x3b0 [ 7088.608400][ C1] __ip_queue_xmit+0x672/0x1910 [ 7088.608650][ C1] ? __create_object+0x5e/0xb0 [ 7088.608897][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7088.609166][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7088.609452][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7088.609727][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7088.610009][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7088.610285][ C1] tcp_delack_timer+0x84/0x240 [ 7088.610529][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7088.610806][ C1] call_timer_fn+0x173/0x430 [ 7088.611043][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7088.611307][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7088.611571][ C1] __run_timers.part.0+0x52d/0x890 [ 7088.611834][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7088.612111][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7088.612397][ C1] ? lock_acquire+0x1c1/0x220 [ 7088.612638][ C1] ? clockevents_program_event+0xf6/0x300 [ 7088.612932][ C1] ? lock_release+0x1d5/0x250 [ 7088.613175][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7088.613440][ C1] ? ktime_get+0xb3/0x190 [ 7088.613665][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7088.613963][ C1] run_timer_softirq+0x72/0x100 [ 7088.614215][ C1] __do_softirq+0x1b9/0x7ff [ 7088.614451][ C1] irq_exit_rcu+0x98/0xc0 [ 7088.614671][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7088.614961][ C1] [ 7088.615112][ C1] [ 7088.615264][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7088.615573][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7088.615900][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7088.616881][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7088.617190][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7088.617592][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7088.617995][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7088.618396][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7088.618798][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7088.619203][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7088.619501][ C1] pipe_read+0xa16/0xdf0 [ 7088.619725][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7088.620005][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7088.620252][ C1] ? iterate_tty_write+0x299/0x540 [ 7088.620516][ C1] ? lock_release+0x1d5/0x250 [ 7088.620758][ C1] vfs_read+0x911/0xc00 [ 7088.620976][ C1] ? lock_acquire+0x1c1/0x220 [ 7088.621216][ C1] ? __might_fault+0xc6/0x180 [ 7088.621458][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7088.621700][ C1] ? __might_fault+0xc6/0x180 [ 7088.621943][ C1] ? lock_release+0x1d5/0x250 [ 7088.622184][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7088.622452][ C1] ? __fget_light+0x54/0x1e0 [ 7088.622689][ C1] ksys_read+0x17a/0x1e0 [ 7088.622911][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7088.623157][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7088.623464][ C1] do_syscall_64+0xc9/0x1e0 [ 7088.623701][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7088.624004][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7088.624233][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7088.625213][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7088.625643][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7088.626046][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7088.626449][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7088.626853][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7088.627258][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7088.627664][ C1] [ 7088.627825][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4410s! [swapper/2:0] [ 7088.628234][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7088.629473][ C2] irq event stamp: 44114564 [ 7088.629701][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7088.630229][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7088.630736][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7088.631209][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7088.631672][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7088.632123][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7088.632729][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7088.633050][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7088.634013][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7088.634317][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7088.634712][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7088.635106][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7088.635499][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7088.635897][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7088.636293][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7088.636734][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7088.637062][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7088.637458][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7088.637854][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7088.638249][ C2] PKRU: 55555554 [ 7088.638429][ C2] Call Trace: [ 7088.638595][ C2] [ 7088.638742][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7088.639000][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7088.639241][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7088.639517][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7088.639786][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7088.640073][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7088.640335][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7088.640639][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7088.640897][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7088.641157][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7088.641462][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7088.641754][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7088.642065][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7088.642352][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7088.642644][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7088.642930][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7088.643238][ C2] ? get_stack_info+0x36/0xc0 [ 7088.643475][ C2] ? lock_acquire+0x1c1/0x220 [ 7088.643713][ C2] ? lock_release+0x1d5/0x250 [ 7088.643952][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7088.644200][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7088.644472][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7088.644752][ C2] ? lock_acquire+0x1c1/0x220 [ 7088.644989][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7088.645228][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7088.645486][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7088.645721][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7088.645966][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7088.646221][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7088.646494][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7088.646768][ C2] ip_local_deliver+0x19d/0x480 [ 7088.647013][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7088.647282][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7088.647543][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7088.647887][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7088.648137][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7088.648454][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7088.648714][ C2] ip_rcv+0x564/0x740 [ 7088.648916][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7088.649144][ C2] ? set_track_prepare+0x8a/0xd0 [ 7088.649394][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7088.649671][ C2] ? start_secondary+0x21c/0x2b0 [ 7088.649920][ C2] ? skb_clone+0x10b/0x330 [ 7088.650145][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7088.650461][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7088.650765][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7088.651043][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7088.651334][ C2] ? __tcf_classify+0x329/0x7d0 [ 7088.651581][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7088.651809][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7088.652108][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7088.652389][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7088.652711][ C2] ? lock_acquire+0x1c1/0x220 [ 7088.652948][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7088.653242][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7088.653523][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7088.653837][ C2] ? __copy_skb_header+0xaf/0x490 [ 7088.654092][ C2] ? __skb_clone+0x57a/0x760 [ 7088.654325][ C2] netif_receive_skb+0x55/0x280 [ 7088.654571][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7088.654879][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7088.655210][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7088.655510][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7088.655783][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7088.656068][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7088.656379][ C2] ? get_stack_info+0x36/0xc0 [ 7088.656617][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7088.656880][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7088.657193][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7088.657467][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7088.657742][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7088.658054][ C2] ? kernel_text_address+0x17/0xe0 [ 7088.658311][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7088.658621][ C2] ? arch_stack_walk+0x8c/0x100 [ 7088.658867][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7088.659129][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7088.659412][ C2] ? lock_acquire+0x1c1/0x220 [ 7088.659646][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7088.659927][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7088.660227][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7088.660502][ C2] ? get_stack_info+0x36/0xc0 [ 7088.660740][ C2] __tcf_classify+0x329/0x7d0 [ 7088.660983][ C2] tcf_classify+0x283/0x930 [ 7088.661214][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7088.661468][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7088.661779][ C2] tc_run+0x2e4/0x5d0 [ 7088.661982][ C2] ? __pfx_tc_run+0x10/0x10 [ 7088.662209][ C2] ? lock_acquire+0x1c1/0x220 [ 7088.662446][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7088.662704][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7088.662955][ C2] ? lock_acquire+0x1c1/0x220 [ 7088.663192][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7088.663455][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7088.663756][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7088.664024][ C2] ? neigh_hh_output+0x348/0x590 [ 7088.664274][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7088.664536][ C2] ip_finish_output2+0x786/0x18e0 [ 7088.664791][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7088.665124][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7088.665400][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7088.665655][ C2] ? __ip_finish_output+0x10f/0x770 [ 7088.665920][ C2] ip_output+0x16b/0x4f0 [ 7088.666133][ C2] ? __pfx_ip_output+0x10/0x10 [ 7088.666375][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7088.666648][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7088.666958][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7088.667230][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7088.667480][ C2] ? __alloc_skb+0xd4/0x280 [ 7088.667709][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7088.667976][ C2] ? tcp_fragment+0x168/0x1040 [ 7088.668218][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7088.668468][ C2] ? ip_local_out+0x114/0x3b0 [ 7088.668706][ C2] __ip_queue_xmit+0x672/0x1910 [ 7088.668952][ C2] ? __skb_clone+0x57a/0x760 [ 7088.669185][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7088.669452][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7088.669731][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7088.669972][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7088.670218][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7088.670518][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7088.670834][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7088.671076][ C2] tcp_send_loss_probe+0x348/0x830 [ 7088.671335][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7088.671600][ C2] tcp_write_timer+0x82/0x1d0 [ 7088.671839][ C2] call_timer_fn+0x173/0x430 [ 7088.672073][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7088.672333][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7088.672591][ C2] __run_timers.part.0+0x52d/0x890 [ 7088.672851][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7088.673118][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7088.673399][ C2] ? lock_acquire+0x1c1/0x220 [ 7088.673637][ C2] ? clockevents_program_event+0xf6/0x300 [ 7088.673924][ C2] ? lock_release+0x1d5/0x250 [ 7088.674158][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7088.674421][ C2] ? ktime_get+0xb3/0x190 [ 7088.674640][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7088.674935][ C2] run_timer_softirq+0x72/0x100 [ 7088.675180][ C2] __do_softirq+0x1b9/0x7ff [ 7088.675410][ C2] irq_exit_rcu+0x98/0xc0 [ 7088.675631][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7088.675914][ C2] [ 7088.676061][ C2] [ 7088.676212][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7088.676513][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7088.676767][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7088.677729][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7088.678031][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7088.678428][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7088.678823][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7088.679218][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7088.679611][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7088.680010][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7088.680295][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7088.680553][ C2] default_idle_call+0x69/0xa0 [ 7088.680794][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7088.681043][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7088.681317][ C2] ? lock_release+0x1d5/0x250 [ 7088.681554][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7088.681824][ C2] do_idle+0xfb/0x160 [ 7088.682026][ C2] cpu_startup_entry+0x55/0x60 [ 7088.682266][ C2] start_secondary+0x21c/0x2b0 [ 7088.682508][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7088.682774][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7088.683082][ C2] [ 7116.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4436s! [perl:4135] [ 7116.569689][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7116.570921][ C1] irq event stamp: 209232 [ 7116.571134][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7116.571671][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7116.572153][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7116.572623][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7116.573086][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7116.573543][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7116.574144][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7116.574462][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7116.575436][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7116.575746][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7116.576148][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7116.576549][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7116.576954][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7116.577345][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7116.577736][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7116.578175][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7116.578499][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7116.578895][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7116.579289][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7116.579680][ C1] PKRU: 55555554 [ 7116.579862][ C1] Call Trace: [ 7116.580030][ C1] [ 7116.580173][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7116.580430][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7116.580669][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7116.580939][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7116.581206][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7116.581489][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7116.581747][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7116.582047][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7116.582304][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7116.582606][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7116.582893][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7116.583202][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7116.583486][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7116.583774][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7116.584059][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7116.584365][ C1] ? get_stack_info+0x36/0xc0 [ 7116.584600][ C1] ? lock_acquire+0x1c1/0x220 [ 7116.584834][ C1] ? lock_release+0x1d5/0x250 [ 7116.585069][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7116.585314][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7116.585605][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7116.585891][ C1] ? lock_acquire+0x1c1/0x220 [ 7116.586130][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7116.586373][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7116.586643][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7116.586874][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7116.587116][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7116.587368][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7116.587638][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7116.587909][ C1] ip_local_deliver+0x19d/0x480 [ 7116.588151][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7116.588416][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7116.588675][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7116.589016][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7116.589264][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7116.589578][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7116.589836][ C1] ip_rcv+0x564/0x740 [ 7116.590035][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7116.590262][ C1] ? set_track_prepare+0x8a/0xd0 [ 7116.590509][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7116.590781][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7116.591048][ C1] ? skb_clone+0x10b/0x330 [ 7116.591270][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7116.591582][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7116.591880][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7116.592158][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7116.592464][ C1] ? __tcf_classify+0x329/0x7d0 [ 7116.592713][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7116.592945][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7116.593246][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7116.593535][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7116.593862][ C1] ? lock_acquire+0x1c1/0x220 [ 7116.594104][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7116.594401][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7116.594690][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7116.595010][ C1] ? __copy_skb_header+0xaf/0x490 [ 7116.595269][ C1] ? __skb_clone+0x57a/0x760 [ 7116.595507][ C1] netif_receive_skb+0x55/0x280 [ 7116.595758][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7116.596073][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7116.596406][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7116.596709][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7116.596985][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7116.597274][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7116.597590][ C1] ? hlock_class+0x4e/0x130 [ 7116.597825][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7116.598102][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7116.598381][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7116.598647][ C1] ? hlock_class+0x4e/0x130 [ 7116.598879][ C1] ? mark_lock+0x38/0x3e0 [ 7116.599101][ C1] ? stack_access_ok+0xda/0x1f0 [ 7116.599350][ C1] ? __lock_acquire+0xb67/0x1610 [ 7116.599605][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7116.599884][ C1] ? get_stack_info+0x36/0xc0 [ 7116.600126][ C1] ? stack_access_ok+0xda/0x1f0 [ 7116.600372][ C1] ? get_reg+0x119/0x190 [ 7116.600593][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7116.600861][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7116.601173][ C1] __tcf_classify+0x329/0x7d0 [ 7116.601415][ C1] tcf_classify+0x283/0x930 [ 7116.601649][ C1] ? arch_stack_walk+0xa2/0x100 [ 7116.601899][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7116.602158][ C1] ? get_stack_info+0x36/0xc0 [ 7116.602401][ C1] tc_run+0x2e4/0x5d0 [ 7116.602609][ C1] ? __pfx_tc_run+0x10/0x10 [ 7116.602843][ C1] ? lock_acquire+0x1c1/0x220 [ 7116.603082][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7116.603345][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7116.603600][ C1] ? lock_acquire+0x1c1/0x220 [ 7116.603840][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7116.604106][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7116.604414][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7116.604686][ C1] ? neigh_hh_output+0x348/0x590 [ 7116.604940][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7116.605206][ C1] ip_finish_output2+0x786/0x18e0 [ 7116.605466][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7116.605748][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7116.606088][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7116.606365][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7116.606620][ C1] ? __ip_finish_output+0x10f/0x770 [ 7116.606887][ C1] ip_output+0x16b/0x4f0 [ 7116.607105][ C1] ? run_timer_softirq+0x72/0x100 [ 7116.607364][ C1] ? __pfx_ip_output+0x10/0x10 [ 7116.607607][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7116.607897][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7116.608151][ C1] ? ip_local_out+0x114/0x3b0 [ 7116.608392][ C1] __ip_queue_xmit+0x672/0x1910 [ 7116.608641][ C1] ? __create_object+0x5e/0xb0 [ 7116.608886][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7116.609154][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7116.609438][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7116.609713][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7116.609995][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7116.610270][ C1] tcp_delack_timer+0x84/0x240 [ 7116.610513][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7116.610788][ C1] call_timer_fn+0x173/0x430 [ 7116.611024][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7116.611287][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7116.611550][ C1] __run_timers.part.0+0x52d/0x890 [ 7116.611813][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7116.612090][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7116.612375][ C1] ? lock_acquire+0x1c1/0x220 [ 7116.612616][ C1] ? clockevents_program_event+0xf6/0x300 [ 7116.612906][ C1] ? lock_release+0x1d5/0x250 [ 7116.613148][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7116.613413][ C1] ? ktime_get+0xb3/0x190 [ 7116.613637][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7116.613934][ C1] run_timer_softirq+0x72/0x100 [ 7116.614185][ C1] __do_softirq+0x1b9/0x7ff [ 7116.614419][ C1] irq_exit_rcu+0x98/0xc0 [ 7116.614639][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7116.614930][ C1] [ 7116.615080][ C1] [ 7116.615232][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7116.615540][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7116.615865][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7116.616841][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7116.617151][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7116.617552][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7116.617955][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7116.618356][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7116.618757][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7116.619159][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7116.619458][ C1] pipe_read+0xa16/0xdf0 [ 7116.619679][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7116.619961][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7116.620206][ C1] ? iterate_tty_write+0x299/0x540 [ 7116.620469][ C1] ? lock_release+0x1d5/0x250 [ 7116.620709][ C1] vfs_read+0x911/0xc00 [ 7116.620927][ C1] ? lock_acquire+0x1c1/0x220 [ 7116.621166][ C1] ? __might_fault+0xc6/0x180 [ 7116.621407][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7116.621648][ C1] ? __might_fault+0xc6/0x180 [ 7116.621890][ C1] ? lock_release+0x1d5/0x250 [ 7116.622130][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7116.622397][ C1] ? __fget_light+0x54/0x1e0 [ 7116.622635][ C1] ksys_read+0x17a/0x1e0 [ 7116.622855][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7116.623100][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7116.623406][ C1] do_syscall_64+0xc9/0x1e0 [ 7116.623640][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7116.623942][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7116.624170][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7116.625149][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7116.625578][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7116.625979][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7116.626381][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7116.626783][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7116.627187][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7116.627591][ C1] [ 7116.627750][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4436s! [swapper/2:0] [ 7116.628160][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7116.629400][ C2] irq event stamp: 44114564 [ 7116.629627][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7116.630157][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7116.630664][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7116.631137][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7116.631604][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7116.632056][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7116.632660][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7116.632982][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7116.633945][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7116.634248][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7116.634645][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7116.635038][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7116.635435][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7116.635830][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7116.636226][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7116.636670][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7116.636999][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7116.637395][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7116.637791][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7116.638187][ C2] PKRU: 55555554 [ 7116.638368][ C2] Call Trace: [ 7116.638534][ C2] [ 7116.638681][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7116.638941][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7116.639182][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7116.639457][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7116.639727][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7116.640012][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7116.640274][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7116.640576][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7116.640835][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7116.641095][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7116.641399][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7116.641693][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7116.642004][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7116.642289][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7116.642583][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7116.642870][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7116.643177][ C2] ? get_stack_info+0x36/0xc0 [ 7116.643417][ C2] ? lock_acquire+0x1c1/0x220 [ 7116.643654][ C2] ? lock_release+0x1d5/0x250 [ 7116.643893][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7116.644138][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7116.644408][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7116.644689][ C2] ? lock_acquire+0x1c1/0x220 [ 7116.644927][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7116.645165][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7116.645426][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7116.645662][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7116.645909][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7116.646165][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7116.646436][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7116.646711][ C2] ip_local_deliver+0x19d/0x480 [ 7116.646957][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7116.647226][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7116.647486][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7116.647832][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7116.648081][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7116.648397][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7116.648657][ C2] ip_rcv+0x564/0x740 [ 7116.648861][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7116.649088][ C2] ? set_track_prepare+0x8a/0xd0 [ 7116.649339][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7116.649611][ C2] ? start_secondary+0x21c/0x2b0 [ 7116.649859][ C2] ? skb_clone+0x10b/0x330 [ 7116.650085][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7116.650402][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7116.650705][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7116.650982][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7116.651273][ C2] ? __tcf_classify+0x329/0x7d0 [ 7116.651518][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7116.651747][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7116.652045][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7116.652327][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7116.652649][ C2] ? lock_acquire+0x1c1/0x220 [ 7116.652885][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7116.653180][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7116.653462][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7116.653776][ C2] ? __copy_skb_header+0xaf/0x490 [ 7116.654031][ C2] ? __skb_clone+0x57a/0x760 [ 7116.654264][ C2] netif_receive_skb+0x55/0x280 [ 7116.654508][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7116.654816][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7116.655146][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7116.655445][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7116.655716][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7116.656003][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7116.656311][ C2] ? get_stack_info+0x36/0xc0 [ 7116.656550][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7116.656811][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7116.657125][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7116.657401][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7116.657675][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7116.657986][ C2] ? kernel_text_address+0x17/0xe0 [ 7116.658245][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7116.658555][ C2] ? arch_stack_walk+0x8c/0x100 [ 7116.658802][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7116.659064][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7116.659345][ C2] ? lock_acquire+0x1c1/0x220 [ 7116.659582][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7116.659860][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7116.660164][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7116.660437][ C2] ? get_stack_info+0x36/0xc0 [ 7116.660675][ C2] __tcf_classify+0x329/0x7d0 [ 7116.660915][ C2] tcf_classify+0x283/0x930 [ 7116.661145][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7116.661399][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7116.661709][ C2] tc_run+0x2e4/0x5d0 [ 7116.661913][ C2] ? __pfx_tc_run+0x10/0x10 [ 7116.662141][ C2] ? lock_acquire+0x1c1/0x220 [ 7116.662378][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7116.662636][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7116.662887][ C2] ? lock_acquire+0x1c1/0x220 [ 7116.663124][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7116.663385][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7116.663687][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7116.663956][ C2] ? neigh_hh_output+0x348/0x590 [ 7116.664206][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7116.664467][ C2] ip_finish_output2+0x786/0x18e0 [ 7116.664721][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7116.665055][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7116.665329][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7116.665582][ C2] ? __ip_finish_output+0x10f/0x770 [ 7116.665846][ C2] ip_output+0x16b/0x4f0 [ 7116.666061][ C2] ? __pfx_ip_output+0x10/0x10 [ 7116.666302][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7116.666576][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7116.666885][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7116.667158][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7116.667406][ C2] ? __alloc_skb+0xd4/0x280 [ 7116.667636][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7116.667902][ C2] ? tcp_fragment+0x168/0x1040 [ 7116.668145][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7116.668396][ C2] ? ip_local_out+0x114/0x3b0 [ 7116.668632][ C2] __ip_queue_xmit+0x672/0x1910 [ 7116.668877][ C2] ? __skb_clone+0x57a/0x760 [ 7116.669112][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7116.669375][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7116.669653][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7116.669895][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7116.670143][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7116.670441][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7116.670758][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7116.671001][ C2] tcp_send_loss_probe+0x348/0x830 [ 7116.671259][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7116.671525][ C2] tcp_write_timer+0x82/0x1d0 [ 7116.671763][ C2] call_timer_fn+0x173/0x430 [ 7116.671994][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7116.672255][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7116.672514][ C2] __run_timers.part.0+0x52d/0x890 [ 7116.672773][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7116.673043][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7116.673323][ C2] ? lock_acquire+0x1c1/0x220 [ 7116.673560][ C2] ? clockevents_program_event+0xf6/0x300 [ 7116.673847][ C2] ? lock_release+0x1d5/0x250 [ 7116.674083][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7116.674344][ C2] ? ktime_get+0xb3/0x190 [ 7116.674564][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7116.674855][ C2] run_timer_softirq+0x72/0x100 [ 7116.675102][ C2] __do_softirq+0x1b9/0x7ff [ 7116.675334][ C2] irq_exit_rcu+0x98/0xc0 [ 7116.675556][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7116.675840][ C2] [ 7116.675988][ C2] [ 7116.676137][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7116.676436][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7116.676690][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7116.677651][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7116.677956][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7116.678351][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7116.678747][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7116.679142][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7116.679537][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7116.679933][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7116.680223][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7116.680483][ C2] default_idle_call+0x69/0xa0 [ 7116.680725][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7116.680974][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7116.681248][ C2] ? lock_release+0x1d5/0x250 [ 7116.681485][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7116.681759][ C2] do_idle+0xfb/0x160 [ 7116.681960][ C2] cpu_startup_entry+0x55/0x60 [ 7116.682201][ C2] start_secondary+0x21c/0x2b0 [ 7116.682442][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7116.682708][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7116.683016][ C2] [ 7142.478102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7142.478453][ C1] rcu: 1-....: (4776009 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1171234 [ 7142.478997][ C1] rcu: (t=4787591 jiffies g=1882453 q=721 ncpus=4) [ 7142.479320][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7142.479757][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7142.480357][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7142.480675][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7142.481621][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7142.481921][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7142.482309][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7142.482698][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7142.483114][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7142.483512][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7142.483911][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7142.484359][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7142.484691][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7142.485096][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7142.485498][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7142.485897][ C1] PKRU: 55555554 [ 7142.486080][ C1] Call Trace: [ 7142.486251][ C1] [ 7142.486398][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7142.486670][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7142.486923][ C1] ? check_cpu_stall+0x284/0x500 [ 7142.487176][ C1] ? rcu_pending+0x92/0x360 [ 7142.487408][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7142.487676][ C1] ? update_process_times+0xb9/0x110 [ 7142.487946][ C1] ? tick_sched_handle+0x67/0x130 [ 7142.488203][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7142.488490][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7142.488731][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7142.489044][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7142.489319][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7142.489609][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7142.489874][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7142.490181][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7142.490444][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7142.490753][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7142.491047][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7142.491361][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7142.491653][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7142.491949][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7142.492239][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7142.492552][ C1] ? get_stack_info+0x36/0xc0 [ 7142.492794][ C1] ? lock_acquire+0x1c1/0x220 [ 7142.493033][ C1] ? lock_release+0x1d5/0x250 [ 7142.493275][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7142.493524][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7142.493796][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7142.494082][ C1] ? lock_acquire+0x1c1/0x220 [ 7142.494319][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7142.494560][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7142.494820][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7142.495057][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7142.495308][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7142.495569][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7142.495843][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7142.496119][ C1] ip_local_deliver+0x19d/0x480 [ 7142.496367][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7142.496637][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7142.496903][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7142.497251][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7142.497504][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7142.497825][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7142.498087][ C1] ip_rcv+0x564/0x740 [ 7142.498290][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7142.498523][ C1] ? set_track_prepare+0x8a/0xd0 [ 7142.498776][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7142.499051][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7142.499324][ C1] ? skb_clone+0x10b/0x330 [ 7142.499553][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7142.499872][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7142.500176][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7142.500461][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7142.500754][ C1] ? __tcf_classify+0x329/0x7d0 [ 7142.501003][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7142.501235][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7142.501534][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7142.501820][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7142.502146][ C1] ? lock_acquire+0x1c1/0x220 [ 7142.502385][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7142.502680][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7142.502968][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7142.503285][ C1] ? __copy_skb_header+0xaf/0x490 [ 7142.503543][ C1] ? __skb_clone+0x57a/0x760 [ 7142.503776][ C1] netif_receive_skb+0x55/0x280 [ 7142.504025][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7142.504339][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7142.504671][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7142.504971][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7142.505245][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7142.505536][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7142.505848][ C1] ? hlock_class+0x4e/0x130 [ 7142.506082][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7142.506358][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7142.506635][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7142.506900][ C1] ? hlock_class+0x4e/0x130 [ 7142.507130][ C1] ? mark_lock+0x38/0x3e0 [ 7142.507351][ C1] ? stack_access_ok+0xda/0x1f0 [ 7142.507602][ C1] ? __lock_acquire+0xb67/0x1610 [ 7142.507855][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7142.508132][ C1] ? get_stack_info+0x36/0xc0 [ 7142.508373][ C1] ? stack_access_ok+0xda/0x1f0 [ 7142.508619][ C1] ? get_reg+0x119/0x190 [ 7142.508836][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7142.509105][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7142.509414][ C1] __tcf_classify+0x329/0x7d0 [ 7142.509656][ C1] tcf_classify+0x283/0x930 [ 7142.509887][ C1] ? arch_stack_walk+0xa2/0x100 [ 7142.510135][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7142.510391][ C1] ? get_stack_info+0x36/0xc0 [ 7142.510633][ C1] tc_run+0x2e4/0x5d0 [ 7142.510838][ C1] ? __pfx_tc_run+0x10/0x10 [ 7142.511070][ C1] ? lock_acquire+0x1c1/0x220 [ 7142.511306][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7142.511569][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7142.511821][ C1] ? lock_acquire+0x1c1/0x220 [ 7142.512063][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7142.512328][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7142.512635][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7142.512907][ C1] ? neigh_hh_output+0x348/0x590 [ 7142.513160][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7142.513424][ C1] ip_finish_output2+0x786/0x18e0 [ 7142.513681][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7142.513960][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7142.514297][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7142.514573][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7142.514826][ C1] ? __ip_finish_output+0x10f/0x770 [ 7142.515090][ C1] ip_output+0x16b/0x4f0 [ 7142.515310][ C1] ? run_timer_softirq+0x72/0x100 [ 7142.515571][ C1] ? __pfx_ip_output+0x10/0x10 [ 7142.515813][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7142.516101][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7142.516353][ C1] ? ip_local_out+0x114/0x3b0 [ 7142.516593][ C1] __ip_queue_xmit+0x672/0x1910 [ 7142.516840][ C1] ? __create_object+0x5e/0xb0 [ 7142.517086][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7142.517352][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7142.517636][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7142.517909][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7142.518190][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7142.518464][ C1] tcp_delack_timer+0x84/0x240 [ 7142.518705][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7142.518980][ C1] call_timer_fn+0x173/0x430 [ 7142.519214][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7142.519475][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7142.519738][ C1] __run_timers.part.0+0x52d/0x890 [ 7142.519999][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7142.520275][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7142.520559][ C1] ? lock_acquire+0x1c1/0x220 [ 7142.520799][ C1] ? clockevents_program_event+0xf6/0x300 [ 7142.521088][ C1] ? lock_release+0x1d5/0x250 [ 7142.521327][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7142.521590][ C1] ? ktime_get+0xb3/0x190 [ 7142.521813][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7142.522107][ C1] run_timer_softirq+0x72/0x100 [ 7142.522357][ C1] __do_softirq+0x1b9/0x7ff [ 7142.522591][ C1] irq_exit_rcu+0x98/0xc0 [ 7142.522811][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7142.523098][ C1] [ 7142.523247][ C1] [ 7142.523398][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7142.523701][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7142.524026][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7142.525000][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7142.525311][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7142.525709][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7142.526110][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7142.526509][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7142.526907][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7142.527309][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7142.527605][ C1] pipe_read+0xa16/0xdf0 [ 7142.527825][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7142.528103][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7142.528347][ C1] ? iterate_tty_write+0x299/0x540 [ 7142.528610][ C1] ? lock_release+0x1d5/0x250 [ 7142.528849][ C1] vfs_read+0x911/0xc00 [ 7142.529065][ C1] ? lock_acquire+0x1c1/0x220 [ 7142.529303][ C1] ? __might_fault+0xc6/0x180 [ 7142.529542][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7142.529782][ C1] ? __might_fault+0xc6/0x180 [ 7142.530027][ C1] ? lock_release+0x1d5/0x250 [ 7142.530266][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7142.530532][ C1] ? __fget_light+0x54/0x1e0 [ 7142.530768][ C1] ksys_read+0x17a/0x1e0 [ 7142.530988][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7142.531232][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7142.531536][ C1] do_syscall_64+0xc9/0x1e0 [ 7142.531769][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7142.532069][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7142.532295][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7142.533266][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7142.533689][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7142.534087][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7142.534485][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7142.534885][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7142.535286][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7142.535687][ C1] [ 7142.535845][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7142.536116][ C2] NMI backtrace for cpu 2 [ 7142.536121][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7142.536127][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7142.536131][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7142.536139][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7142.536145][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7142.536149][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7142.536153][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7142.536157][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7142.536161][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7142.536165][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7142.536169][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7142.536173][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7142.536179][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7142.536183][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7142.536186][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7142.536189][ C2] PKRU: 55555554 [ 7142.536191][ C2] Call Trace: [ 7142.536194][ C2] [ 7142.536197][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7142.536209][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7142.536217][ C2] ? nmi_handle+0x153/0x420 [ 7142.536227][ C2] ? default_do_nmi+0x41/0x100 [ 7142.536233][ C2] ? exc_nmi+0xf3/0x120 [ 7142.536239][ C2] ? end_repeat_nmi+0xf/0x60 [ 7142.536251][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7142.536259][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7142.536266][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7142.536275][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7142.536283][ C2] [ 7142.536285][ C2] [ 7142.536288][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7142.536295][ C2] ? get_stack_info+0x36/0xc0 [ 7142.536303][ C2] ? lock_acquire+0x1c1/0x220 [ 7142.536311][ C2] ? lock_release+0x1d5/0x250 [ 7142.536320][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7142.536328][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7142.536335][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7142.536343][ C2] ? lock_acquire+0x1c1/0x220 [ 7142.536349][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7142.536357][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7142.536364][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7142.536380][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7142.536386][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7142.536398][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7142.536408][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7142.536416][ C2] ip_local_deliver+0x19d/0x480 [ 7142.536422][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7142.536427][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7142.536433][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7142.536444][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7142.536451][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7142.536459][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7142.536480][ C2] ip_rcv+0x564/0x740 [ 7142.536486][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7142.536492][ C2] ? set_track_prepare+0x8a/0xd0 [ 7142.536500][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7142.536507][ C2] ? start_secondary+0x21c/0x2b0 [ 7142.536514][ C2] ? skb_clone+0x10b/0x330 [ 7142.536519][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7142.536534][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7142.536549][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7142.536556][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7142.536576][ C2] ? __tcf_classify+0x329/0x7d0 [ 7142.536585][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7142.536590][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7142.536598][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7142.536606][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7142.536616][ C2] ? lock_acquire+0x1c1/0x220 [ 7142.536622][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7142.536633][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7142.536641][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7142.536645][ C2] ? __copy_skb_header+0xaf/0x490 [ 7142.536649][ C2] ? __skb_clone+0x57a/0x760 [ 7142.536652][ C2] netif_receive_skb+0x55/0x280 [ 7142.536655][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7142.536662][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7142.536669][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7142.536675][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7142.536679][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7142.536689][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7142.536697][ C2] ? get_stack_info+0x36/0xc0 [ 7142.536701][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7142.536704][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7142.536708][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7142.536710][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7142.536714][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7142.536716][ C2] ? kernel_text_address+0x17/0xe0 [ 7142.536719][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7142.536723][ C2] ? arch_stack_walk+0x8c/0x100 [ 7142.536727][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7142.536730][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7142.536733][ C2] ? lock_acquire+0x1c1/0x220 [ 7142.536735][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7142.536739][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7142.536743][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7142.536746][ C2] ? get_stack_info+0x36/0xc0 [ 7142.536750][ C2] __tcf_classify+0x329/0x7d0 [ 7142.536755][ C2] tcf_classify+0x283/0x930 [ 7142.536759][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7142.536762][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7142.536767][ C2] tc_run+0x2e4/0x5d0 [ 7142.536770][ C2] ? __pfx_tc_run+0x10/0x10 [ 7142.536774][ C2] ? lock_acquire+0x1c1/0x220 [ 7142.536776][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7142.536780][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7142.536784][ C2] ? lock_acquire+0x1c1/0x220 [ 7142.536786][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7142.536789][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7142.536792][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7142.536795][ C2] ? neigh_hh_output+0x348/0x590 [ 7142.536798][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7142.536802][ C2] ip_finish_output2+0x786/0x18e0 [ 7142.536805][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7142.536813][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7142.536815][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7142.536819][ C2] ? __ip_finish_output+0x10f/0x770 [ 7142.536822][ C2] ip_output+0x16b/0x4f0 [ 7142.536826][ C2] ? __pfx_ip_output+0x10/0x10 [ 7142.536828][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7142.536831][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7142.536834][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7142.536837][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7142.536840][ C2] ? __alloc_skb+0xd4/0x280 [ 7142.536842][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7142.536846][ C2] ? tcp_fragment+0x168/0x1040 [ 7142.536849][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7142.536852][ C2] ? ip_local_out+0x114/0x3b0 [ 7142.536856][ C2] __ip_queue_xmit+0x672/0x1910 [ 7142.536859][ C2] ? __skb_clone+0x57a/0x760 [ 7142.536862][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7142.536867][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7142.536870][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7142.536874][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7142.536878][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7142.536882][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7142.536885][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7142.536888][ C2] tcp_send_loss_probe+0x348/0x830 [ 7142.536891][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7142.536894][ C2] tcp_write_timer+0x82/0x1d0 [ 7142.536897][ C2] call_timer_fn+0x173/0x430 [ 7142.536901][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7142.536905][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7142.536909][ C2] __run_timers.part.0+0x52d/0x890 [ 7142.536912][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7142.536916][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7142.536919][ C2] ? lock_acquire+0x1c1/0x220 [ 7142.536922][ C2] ? clockevents_program_event+0xf6/0x300 [ 7142.536926][ C2] ? lock_release+0x1d5/0x250 [ 7142.536928][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7142.536931][ C2] ? ktime_get+0xb3/0x190 [ 7142.536935][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7142.536939][ C2] run_timer_softirq+0x72/0x100 [ 7142.536942][ C2] __do_softirq+0x1b9/0x7ff [ 7142.536946][ C2] irq_exit_rcu+0x98/0xc0 [ 7142.536949][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7142.536952][ C2] [ 7142.536952][ C2] [ 7142.536953][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7142.536957][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7142.536960][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7142.536962][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7142.536963][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7142.536965][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7142.536966][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7142.536968][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7142.536969][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7142.536972][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7142.536975][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7142.536978][ C2] default_idle_call+0x69/0xa0 [ 7142.536981][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7142.536983][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7142.536987][ C2] ? lock_release+0x1d5/0x250 [ 7142.536989][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7142.536993][ C2] do_idle+0xfb/0x160 [ 7142.536995][ C2] cpu_startup_entry+0x55/0x60 [ 7142.536997][ C2] start_secondary+0x21c/0x2b0 [ 7142.537000][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7142.537004][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7142.537009][ C2] [ 7168.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4485s! [perl:4135] [ 7168.569673][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7168.570890][ C1] irq event stamp: 209232 [ 7168.571104][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7168.571618][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7168.572080][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7168.572539][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7168.572987][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7168.573424][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7168.574018][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7168.574334][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7168.575302][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7168.575607][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7168.576007][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7168.576415][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7168.576802][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7168.577191][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7168.577579][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7168.578015][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7168.578338][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7168.578745][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7168.579143][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7168.579543][ C1] PKRU: 55555554 [ 7168.579724][ C1] Call Trace: [ 7168.579903][ C1] [ 7168.580047][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7168.580303][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7168.580539][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7168.580808][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7168.581073][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7168.581354][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7168.581612][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7168.581908][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7168.582163][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7168.582462][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7168.582751][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7168.583057][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7168.583337][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7168.583626][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7168.583906][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7168.584208][ C1] ? get_stack_info+0x36/0xc0 [ 7168.584444][ C1] ? lock_acquire+0x1c1/0x220 [ 7168.584678][ C1] ? lock_release+0x1d5/0x250 [ 7168.584912][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7168.585155][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7168.585444][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7168.585727][ C1] ? lock_acquire+0x1c1/0x220 [ 7168.585966][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7168.586208][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7168.586475][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7168.586702][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7168.586943][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7168.587193][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7168.587462][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7168.587733][ C1] ip_local_deliver+0x19d/0x480 [ 7168.587974][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7168.588239][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7168.588496][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7168.588834][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7168.589078][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7168.589391][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7168.589647][ C1] ip_rcv+0x564/0x740 [ 7168.589848][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7168.590072][ C1] ? set_track_prepare+0x8a/0xd0 [ 7168.590319][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7168.590590][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7168.590857][ C1] ? skb_clone+0x10b/0x330 [ 7168.591076][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7168.591387][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7168.591686][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7168.591958][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7168.592247][ C1] ? __tcf_classify+0x329/0x7d0 [ 7168.592490][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7168.592713][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7168.593006][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7168.593284][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7168.593602][ C1] ? lock_acquire+0x1c1/0x220 [ 7168.593834][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7168.594124][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7168.594402][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7168.594711][ C1] ? __copy_skb_header+0xaf/0x490 [ 7168.594961][ C1] ? __skb_clone+0x57a/0x760 [ 7168.595212][ C1] netif_receive_skb+0x55/0x280 [ 7168.595460][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7168.595773][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7168.596106][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7168.596413][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7168.596683][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7168.596963][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7168.597291][ C1] ? hlock_class+0x4e/0x130 [ 7168.597523][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7168.597801][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7168.598076][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7168.598340][ C1] ? hlock_class+0x4e/0x130 [ 7168.598572][ C1] ? mark_lock+0x38/0x3e0 [ 7168.598791][ C1] ? stack_access_ok+0xda/0x1f0 [ 7168.599040][ C1] ? __lock_acquire+0xb67/0x1610 [ 7168.599294][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7168.599569][ C1] ? get_stack_info+0x36/0xc0 [ 7168.599811][ C1] ? stack_access_ok+0xda/0x1f0 [ 7168.600058][ C1] ? get_reg+0x119/0x190 [ 7168.600273][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7168.600544][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7168.600852][ C1] __tcf_classify+0x329/0x7d0 [ 7168.601095][ C1] tcf_classify+0x283/0x930 [ 7168.601327][ C1] ? arch_stack_walk+0xa2/0x100 [ 7168.601577][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7168.601833][ C1] ? get_stack_info+0x36/0xc0 [ 7168.602073][ C1] tc_run+0x2e4/0x5d0 [ 7168.602280][ C1] ? __pfx_tc_run+0x10/0x10 [ 7168.602510][ C1] ? lock_acquire+0x1c1/0x220 [ 7168.602750][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7168.603011][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7168.603264][ C1] ? lock_acquire+0x1c1/0x220 [ 7168.603504][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7168.603769][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7168.604075][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7168.604348][ C1] ? neigh_hh_output+0x348/0x590 [ 7168.604602][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7168.604866][ C1] ip_finish_output2+0x786/0x18e0 [ 7168.605123][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7168.605418][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7168.605759][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7168.606038][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7168.606292][ C1] ? __ip_finish_output+0x10f/0x770 [ 7168.606558][ C1] ip_output+0x16b/0x4f0 [ 7168.606774][ C1] ? run_timer_softirq+0x72/0x100 [ 7168.607031][ C1] ? __pfx_ip_output+0x10/0x10 [ 7168.607276][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7168.607563][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7168.607814][ C1] ? ip_local_out+0x114/0x3b0 [ 7168.608056][ C1] __ip_queue_xmit+0x672/0x1910 [ 7168.608305][ C1] ? __create_object+0x5e/0xb0 [ 7168.608549][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7168.608816][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7168.609097][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7168.609377][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7168.609658][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7168.609930][ C1] tcp_delack_timer+0x84/0x240 [ 7168.610175][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7168.610446][ C1] call_timer_fn+0x173/0x430 [ 7168.610683][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7168.610945][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7168.611207][ C1] __run_timers.part.0+0x52d/0x890 [ 7168.611468][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7168.611741][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7168.612029][ C1] ? lock_acquire+0x1c1/0x220 [ 7168.612269][ C1] ? clockevents_program_event+0xf6/0x300 [ 7168.612559][ C1] ? lock_release+0x1d5/0x250 [ 7168.612800][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7168.613064][ C1] ? ktime_get+0xb3/0x190 [ 7168.613284][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7168.613584][ C1] run_timer_softirq+0x72/0x100 [ 7168.613834][ C1] __do_softirq+0x1b9/0x7ff [ 7168.614070][ C1] irq_exit_rcu+0x98/0xc0 [ 7168.614291][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7168.614577][ C1] [ 7168.614730][ C1] [ 7168.614880][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7168.615189][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7168.615515][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7168.616487][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7168.616797][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7168.617197][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7168.617598][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7168.618005][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7168.618405][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7168.618807][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7168.619107][ C1] pipe_read+0xa16/0xdf0 [ 7168.619327][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7168.619605][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7168.619849][ C1] ? iterate_tty_write+0x299/0x540 [ 7168.620110][ C1] ? lock_release+0x1d5/0x250 [ 7168.620354][ C1] vfs_read+0x911/0xc00 [ 7168.620570][ C1] ? lock_acquire+0x1c1/0x220 [ 7168.620811][ C1] ? __might_fault+0xc6/0x180 [ 7168.621053][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7168.621294][ C1] ? __might_fault+0xc6/0x180 [ 7168.621532][ C1] ? lock_release+0x1d5/0x250 [ 7168.621774][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7168.622039][ C1] ? __fget_light+0x54/0x1e0 [ 7168.622279][ C1] ksys_read+0x17a/0x1e0 [ 7168.622496][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7168.622742][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7168.623048][ C1] do_syscall_64+0xc9/0x1e0 [ 7168.623281][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7168.623580][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7168.623809][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7168.624785][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7168.625210][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7168.625611][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7168.626012][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7168.626411][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7168.626812][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7168.627217][ C1] [ 7168.627374][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4485s! [swapper/2:0] [ 7168.627779][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7168.629016][ C2] irq event stamp: 44114564 [ 7168.629243][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7168.629772][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7168.630280][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7168.630753][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7168.631216][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7168.631667][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7168.632275][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7168.632593][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7168.633556][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7168.633859][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7168.634255][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7168.634649][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7168.635046][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7168.635447][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7168.635842][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7168.636284][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7168.636613][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7168.637011][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7168.637408][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7168.637804][ C2] PKRU: 55555554 [ 7168.637983][ C2] Call Trace: [ 7168.638153][ C2] [ 7168.638298][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7168.638557][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7168.638798][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7168.639072][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7168.639342][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7168.639628][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7168.639890][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7168.640194][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7168.640454][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7168.640713][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7168.641020][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7168.641312][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7168.641624][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7168.641913][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7168.642199][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7168.642487][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7168.642796][ C2] ? get_stack_info+0x36/0xc0 [ 7168.643032][ C2] ? lock_acquire+0x1c1/0x220 [ 7168.643272][ C2] ? lock_release+0x1d5/0x250 [ 7168.643511][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7168.643759][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7168.644031][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7168.644314][ C2] ? lock_acquire+0x1c1/0x220 [ 7168.644551][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7168.644790][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7168.645048][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7168.645286][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7168.645531][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7168.645786][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7168.646058][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7168.646335][ C2] ip_local_deliver+0x19d/0x480 [ 7168.646580][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7168.646849][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7168.647110][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7168.647455][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7168.647706][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7168.648024][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7168.648285][ C2] ip_rcv+0x564/0x740 [ 7168.648487][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7168.648718][ C2] ? set_track_prepare+0x8a/0xd0 [ 7168.648968][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7168.649247][ C2] ? start_secondary+0x21c/0x2b0 [ 7168.649496][ C2] ? skb_clone+0x10b/0x330 [ 7168.649719][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7168.650036][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7168.650341][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7168.650618][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7168.650913][ C2] ? __tcf_classify+0x329/0x7d0 [ 7168.651160][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7168.651387][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7168.651686][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7168.651967][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7168.652291][ C2] ? lock_acquire+0x1c1/0x220 [ 7168.652528][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7168.652823][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7168.653105][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7168.653419][ C2] ? __copy_skb_header+0xaf/0x490 [ 7168.653674][ C2] ? __skb_clone+0x57a/0x760 [ 7168.653907][ C2] netif_receive_skb+0x55/0x280 [ 7168.654155][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7168.654464][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7168.654794][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7168.655088][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7168.655366][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7168.655652][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7168.655963][ C2] ? get_stack_info+0x36/0xc0 [ 7168.656203][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7168.656466][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7168.656780][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7168.657053][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7168.657328][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7168.657641][ C2] ? kernel_text_address+0x17/0xe0 [ 7168.657898][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7168.658209][ C2] ? arch_stack_walk+0x8c/0x100 [ 7168.658455][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7168.658717][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7168.658999][ C2] ? lock_acquire+0x1c1/0x220 [ 7168.659235][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7168.659517][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7168.659816][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7168.660093][ C2] ? get_stack_info+0x36/0xc0 [ 7168.660331][ C2] __tcf_classify+0x329/0x7d0 [ 7168.660571][ C2] tcf_classify+0x283/0x930 [ 7168.660802][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7168.661056][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7168.661368][ C2] tc_run+0x2e4/0x5d0 [ 7168.661571][ C2] ? __pfx_tc_run+0x10/0x10 [ 7168.661799][ C2] ? lock_acquire+0x1c1/0x220 [ 7168.662036][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7168.662295][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7168.662546][ C2] ? lock_acquire+0x1c1/0x220 [ 7168.662784][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7168.663045][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7168.663347][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7168.663617][ C2] ? neigh_hh_output+0x348/0x590 [ 7168.663867][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7168.664130][ C2] ip_finish_output2+0x786/0x18e0 [ 7168.664384][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7168.664718][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7168.664994][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7168.665256][ C2] ? __ip_finish_output+0x10f/0x770 [ 7168.665520][ C2] ip_output+0x16b/0x4f0 [ 7168.665734][ C2] ? __pfx_ip_output+0x10/0x10 [ 7168.665975][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7168.666249][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7168.666558][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7168.666831][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7168.667080][ C2] ? __alloc_skb+0xd4/0x280 [ 7168.667311][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7168.667577][ C2] ? tcp_fragment+0x168/0x1040 [ 7168.667819][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7168.668069][ C2] ? ip_local_out+0x114/0x3b0 [ 7168.668308][ C2] __ip_queue_xmit+0x672/0x1910 [ 7168.668555][ C2] ? __skb_clone+0x57a/0x760 [ 7168.668787][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7168.669050][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7168.669331][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7168.669573][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7168.669820][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7168.670119][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7168.670436][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7168.670678][ C2] tcp_send_loss_probe+0x348/0x830 [ 7168.670937][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7168.671202][ C2] tcp_write_timer+0x82/0x1d0 [ 7168.671441][ C2] call_timer_fn+0x173/0x430 [ 7168.671676][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7168.671937][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7168.672196][ C2] __run_timers.part.0+0x52d/0x890 [ 7168.672455][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7168.672722][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7168.673005][ C2] ? lock_acquire+0x1c1/0x220 [ 7168.673242][ C2] ? clockevents_program_event+0xf6/0x300 [ 7168.673531][ C2] ? lock_release+0x1d5/0x250 [ 7168.673767][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7168.674031][ C2] ? ktime_get+0xb3/0x190 [ 7168.674249][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7168.674544][ C2] run_timer_softirq+0x72/0x100 [ 7168.674790][ C2] __do_softirq+0x1b9/0x7ff [ 7168.675021][ C2] irq_exit_rcu+0x98/0xc0 [ 7168.675244][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7168.675525][ C2] [ 7168.675674][ C2] [ 7168.675825][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7168.676126][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7168.676380][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7168.677342][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7168.677645][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7168.678042][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7168.678437][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7168.678832][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7168.679227][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7168.679625][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7168.679910][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7168.680167][ C2] default_idle_call+0x69/0xa0 [ 7168.680410][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7168.680660][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7168.680933][ C2] ? lock_release+0x1d5/0x250 [ 7168.681171][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7168.681441][ C2] do_idle+0xfb/0x160 [ 7168.681644][ C2] cpu_startup_entry+0x55/0x60 [ 7168.681883][ C2] start_secondary+0x21c/0x2b0 [ 7168.682126][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7168.682391][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7168.682700][ C2] [ 7196.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4511s! [perl:4135] [ 7196.569675][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7196.570897][ C1] irq event stamp: 209232 [ 7196.571113][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7196.571627][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7196.572089][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7196.572548][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7196.572999][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7196.573436][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7196.574030][ C1] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 7196.574316][ C1] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 7196.575284][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000246 [ 7196.575593][ C1] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7196.575992][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7196.576397][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7196.576787][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7196.577177][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7196.577565][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7196.578003][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7196.578331][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7196.578724][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7196.579113][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7196.579501][ C1] PKRU: 55555554 [ 7196.579678][ C1] Call Trace: [ 7196.579845][ C1] [ 7196.579988][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7196.580244][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7196.580482][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7196.580750][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7196.581016][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7196.581298][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7196.581556][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7196.581855][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7196.582111][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7196.582412][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7196.582698][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7196.583005][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7196.583288][ C1] ? kasan_check_range+0x10f/0x1c0 [ 7196.583542][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7196.583815][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7196.584119][ C1] ? get_stack_info+0x36/0xc0 [ 7196.584356][ C1] ? lock_acquire+0x1c1/0x220 [ 7196.584589][ C1] ? lock_release+0x1d5/0x250 [ 7196.584822][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7196.585085][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7196.585357][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7196.585644][ C1] ? lock_acquire+0x1c1/0x220 [ 7196.585884][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7196.586123][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7196.586389][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7196.586619][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7196.586861][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7196.587112][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7196.587381][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7196.587651][ C1] ip_local_deliver+0x19d/0x480 [ 7196.587891][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7196.588157][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7196.588415][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7196.588752][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7196.588999][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7196.589313][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7196.589568][ C1] ip_rcv+0x564/0x740 [ 7196.589767][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7196.589992][ C1] ? set_track_prepare+0x8a/0xd0 [ 7196.590238][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7196.590507][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7196.590771][ C1] ? skb_clone+0x10b/0x330 [ 7196.590993][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7196.591306][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7196.591626][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7196.591906][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7196.592200][ C1] ? __tcf_classify+0x329/0x7d0 [ 7196.592448][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7196.592679][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7196.592980][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7196.593265][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7196.593589][ C1] ? lock_acquire+0x1c1/0x220 [ 7196.593829][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7196.594126][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7196.594412][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7196.594731][ C1] ? __copy_skb_header+0xaf/0x490 [ 7196.594988][ C1] ? __skb_clone+0x57a/0x760 [ 7196.595228][ C1] netif_receive_skb+0x55/0x280 [ 7196.595476][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7196.595788][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7196.596119][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7196.596421][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7196.596694][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7196.596984][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7196.597296][ C1] ? hlock_class+0x4e/0x130 [ 7196.597529][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7196.597804][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7196.598083][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7196.598347][ C1] ? hlock_class+0x4e/0x130 [ 7196.598577][ C1] ? mark_lock+0x38/0x3e0 [ 7196.598799][ C1] ? stack_access_ok+0xda/0x1f0 [ 7196.599048][ C1] ? __lock_acquire+0xb67/0x1610 [ 7196.599304][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7196.599579][ C1] ? get_stack_info+0x36/0xc0 [ 7196.599820][ C1] ? stack_access_ok+0xda/0x1f0 [ 7196.600067][ C1] ? get_reg+0x119/0x190 [ 7196.600283][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7196.600550][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7196.600861][ C1] __tcf_classify+0x329/0x7d0 [ 7196.601103][ C1] tcf_classify+0x283/0x930 [ 7196.601333][ C1] ? arch_stack_walk+0xa2/0x100 [ 7196.601582][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7196.601839][ C1] ? get_stack_info+0x36/0xc0 [ 7196.602081][ C1] tc_run+0x2e4/0x5d0 [ 7196.602287][ C1] ? __pfx_tc_run+0x10/0x10 [ 7196.602519][ C1] ? lock_acquire+0x1c1/0x220 [ 7196.602758][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7196.603020][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7196.603274][ C1] ? lock_acquire+0x1c1/0x220 [ 7196.603511][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7196.603778][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7196.604083][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7196.604355][ C1] ? neigh_hh_output+0x348/0x590 [ 7196.604607][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7196.604874][ C1] ip_finish_output2+0x786/0x18e0 [ 7196.605132][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7196.605411][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7196.605747][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7196.606023][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7196.606277][ C1] ? __ip_finish_output+0x10f/0x770 [ 7196.606542][ C1] ip_output+0x16b/0x4f0 [ 7196.606761][ C1] ? run_timer_softirq+0x72/0x100 [ 7196.607019][ C1] ? __pfx_ip_output+0x10/0x10 [ 7196.607262][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7196.607548][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7196.607801][ C1] ? ip_local_out+0x114/0x3b0 [ 7196.608042][ C1] __ip_queue_xmit+0x672/0x1910 [ 7196.608291][ C1] ? __create_object+0x5e/0xb0 [ 7196.608534][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7196.608802][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7196.609085][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7196.609358][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7196.609640][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7196.609914][ C1] tcp_delack_timer+0x84/0x240 [ 7196.610159][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7196.610432][ C1] call_timer_fn+0x173/0x430 [ 7196.610668][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7196.610930][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7196.611193][ C1] __run_timers.part.0+0x52d/0x890 [ 7196.611454][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7196.611728][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7196.612013][ C1] ? lock_acquire+0x1c1/0x220 [ 7196.612253][ C1] ? clockevents_program_event+0xf6/0x300 [ 7196.612545][ C1] ? lock_release+0x1d5/0x250 [ 7196.612783][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7196.613049][ C1] ? ktime_get+0xb3/0x190 [ 7196.613271][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7196.613569][ C1] run_timer_softirq+0x72/0x100 [ 7196.613816][ C1] __do_softirq+0x1b9/0x7ff [ 7196.614050][ C1] irq_exit_rcu+0x98/0xc0 [ 7196.614271][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7196.614557][ C1] [ 7196.614707][ C1] [ 7196.614860][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7196.615167][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7196.615495][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7196.616469][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7196.616777][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7196.617178][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7196.617578][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7196.617976][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7196.618377][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7196.618780][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7196.619075][ C1] pipe_read+0xa16/0xdf0 [ 7196.619299][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7196.619577][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7196.619821][ C1] ? iterate_tty_write+0x299/0x540 [ 7196.620083][ C1] ? lock_release+0x1d5/0x250 [ 7196.620326][ C1] vfs_read+0x911/0xc00 [ 7196.620539][ C1] ? lock_acquire+0x1c1/0x220 [ 7196.620779][ C1] ? __might_fault+0xc6/0x180 [ 7196.621020][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7196.621259][ C1] ? __might_fault+0xc6/0x180 [ 7196.621500][ C1] ? lock_release+0x1d5/0x250 [ 7196.621741][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7196.622006][ C1] ? __fget_light+0x54/0x1e0 [ 7196.622245][ C1] ksys_read+0x17a/0x1e0 [ 7196.622463][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7196.622709][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7196.623013][ C1] do_syscall_64+0xc9/0x1e0 [ 7196.623245][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7196.623546][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7196.623772][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7196.624747][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7196.625172][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7196.625571][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7196.625973][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7196.626373][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7196.626773][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7196.627176][ C1] [ 7196.627335][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4511s! [swapper/2:0] [ 7196.627746][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7196.628993][ C2] irq event stamp: 44114564 [ 7196.629220][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7196.629752][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7196.630261][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7196.630734][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7196.631199][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7196.631651][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7196.632261][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7196.632582][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7196.633545][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7196.633850][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7196.634246][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7196.634642][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7196.635043][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7196.635439][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7196.635834][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7196.636276][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7196.636605][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7196.637005][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7196.637401][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7196.637795][ C2] PKRU: 55555554 [ 7196.637976][ C2] Call Trace: [ 7196.638145][ C2] [ 7196.638291][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7196.638549][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7196.638790][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7196.639065][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7196.639338][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7196.639623][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7196.639886][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7196.640190][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7196.640451][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7196.640710][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7196.641018][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7196.641310][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7196.641622][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7196.641911][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7196.642205][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7196.642492][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7196.642802][ C2] ? get_stack_info+0x36/0xc0 [ 7196.643041][ C2] ? lock_acquire+0x1c1/0x220 [ 7196.643277][ C2] ? lock_release+0x1d5/0x250 [ 7196.643517][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7196.643764][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7196.644034][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7196.644319][ C2] ? lock_acquire+0x1c1/0x220 [ 7196.644556][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7196.644794][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7196.645056][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7196.645291][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7196.645538][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7196.645794][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7196.646067][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7196.646341][ C2] ip_local_deliver+0x19d/0x480 [ 7196.646588][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7196.646859][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7196.647122][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7196.647465][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7196.647717][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7196.648037][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7196.648297][ C2] ip_rcv+0x564/0x740 [ 7196.648501][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7196.648731][ C2] ? set_track_prepare+0x8a/0xd0 [ 7196.648983][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7196.649258][ C2] ? start_secondary+0x21c/0x2b0 [ 7196.649508][ C2] ? skb_clone+0x10b/0x330 [ 7196.649733][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7196.650050][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7196.650356][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7196.650635][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7196.650927][ C2] ? __tcf_classify+0x329/0x7d0 [ 7196.651175][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7196.651404][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7196.651700][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7196.651987][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7196.652311][ C2] ? lock_acquire+0x1c1/0x220 [ 7196.652548][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7196.652843][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7196.653127][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7196.653440][ C2] ? __copy_skb_header+0xaf/0x490 [ 7196.653696][ C2] ? __skb_clone+0x57a/0x760 [ 7196.653929][ C2] netif_receive_skb+0x55/0x280 [ 7196.654176][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7196.654486][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7196.654816][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7196.655119][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7196.655390][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7196.655676][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7196.655987][ C2] ? get_stack_info+0x36/0xc0 [ 7196.656228][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7196.656490][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7196.656805][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7196.657078][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7196.657353][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7196.657665][ C2] ? kernel_text_address+0x17/0xe0 [ 7196.657925][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7196.658235][ C2] ? arch_stack_walk+0x8c/0x100 [ 7196.658482][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7196.658744][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7196.659028][ C2] ? lock_acquire+0x1c1/0x220 [ 7196.659265][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7196.659546][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7196.659850][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7196.660124][ C2] ? get_stack_info+0x36/0xc0 [ 7196.660364][ C2] __tcf_classify+0x329/0x7d0 [ 7196.660602][ C2] tcf_classify+0x283/0x930 [ 7196.660834][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7196.661088][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7196.661400][ C2] tc_run+0x2e4/0x5d0 [ 7196.661602][ C2] ? __pfx_tc_run+0x10/0x10 [ 7196.661833][ C2] ? lock_acquire+0x1c1/0x220 [ 7196.662069][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7196.662332][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7196.662582][ C2] ? lock_acquire+0x1c1/0x220 [ 7196.662818][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7196.663080][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7196.663383][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7196.663652][ C2] ? neigh_hh_output+0x348/0x590 [ 7196.663902][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7196.664167][ C2] ip_finish_output2+0x786/0x18e0 [ 7196.664422][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7196.664759][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7196.665037][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7196.665293][ C2] ? __ip_finish_output+0x10f/0x770 [ 7196.665554][ C2] ip_output+0x16b/0x4f0 [ 7196.665769][ C2] ? __pfx_ip_output+0x10/0x10 [ 7196.666012][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7196.666289][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7196.666598][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7196.666875][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7196.667124][ C2] ? __alloc_skb+0xd4/0x280 [ 7196.667351][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7196.667619][ C2] ? tcp_fragment+0x168/0x1040 [ 7196.667861][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7196.668111][ C2] ? ip_local_out+0x114/0x3b0 [ 7196.668351][ C2] __ip_queue_xmit+0x672/0x1910 [ 7196.668599][ C2] ? __skb_clone+0x57a/0x760 [ 7196.668832][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7196.669098][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7196.669377][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7196.669620][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7196.669867][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7196.670165][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7196.670484][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7196.670728][ C2] tcp_send_loss_probe+0x348/0x830 [ 7196.670986][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7196.671256][ C2] tcp_write_timer+0x82/0x1d0 [ 7196.671495][ C2] call_timer_fn+0x173/0x430 [ 7196.671730][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7196.671990][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7196.672250][ C2] __run_timers.part.0+0x52d/0x890 [ 7196.672509][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7196.672776][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7196.673061][ C2] ? lock_acquire+0x1c1/0x220 [ 7196.673297][ C2] ? clockevents_program_event+0xf6/0x300 [ 7196.673586][ C2] ? lock_release+0x1d5/0x250 [ 7196.673824][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7196.674087][ C2] ? ktime_get+0xb3/0x190 [ 7196.674306][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7196.674602][ C2] run_timer_softirq+0x72/0x100 [ 7196.674849][ C2] __do_softirq+0x1b9/0x7ff [ 7196.675082][ C2] irq_exit_rcu+0x98/0xc0 [ 7196.675303][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7196.675585][ C2] [ 7196.675736][ C2] [ 7196.675885][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7196.676188][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7196.676443][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7196.677407][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7196.677713][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7196.678109][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7196.678503][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7196.678899][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7196.679299][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7196.679696][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7196.679983][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7196.680242][ C2] default_idle_call+0x69/0xa0 [ 7196.680483][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7196.680733][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7196.681010][ C2] ? lock_release+0x1d5/0x250 [ 7196.681246][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7196.681519][ C2] do_idle+0xfb/0x160 [ 7196.681723][ C2] cpu_startup_entry+0x55/0x60 [ 7196.681963][ C2] start_secondary+0x21c/0x2b0 [ 7196.682206][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7196.682477][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7196.682784][ C2] [ 7220.536103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7220.536476][ C1] rcu: 1-....: (4853895 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1190143 [ 7220.537017][ C1] rcu: (t=4865649 jiffies g=1882453 q=721 ncpus=4) [ 7220.537345][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7220.537781][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7220.538378][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7220.538697][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7220.539641][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7220.539942][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7220.540331][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7220.540722][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7220.541112][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7220.541500][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7220.541887][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7220.542324][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7220.542652][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7220.543043][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7220.543431][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7220.543820][ C1] PKRU: 55555554 [ 7220.543996][ C1] Call Trace: [ 7220.544163][ C1] [ 7220.544307][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7220.544574][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7220.544820][ C1] ? check_cpu_stall+0x284/0x500 [ 7220.545087][ C1] ? rcu_pending+0x92/0x360 [ 7220.545320][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7220.545590][ C1] ? update_process_times+0xb9/0x110 [ 7220.545859][ C1] ? tick_sched_handle+0x67/0x130 [ 7220.546128][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7220.546408][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7220.546646][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7220.546949][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7220.547216][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7220.547496][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7220.547754][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7220.548054][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7220.548310][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7220.548612][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7220.548901][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7220.549207][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7220.549489][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7220.549778][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7220.550059][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7220.550362][ C1] ? get_stack_info+0x36/0xc0 [ 7220.550597][ C1] ? lock_acquire+0x1c1/0x220 [ 7220.550832][ C1] ? lock_release+0x1d5/0x250 [ 7220.551065][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7220.551308][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7220.551573][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7220.551853][ C1] ? lock_acquire+0x1c1/0x220 [ 7220.552086][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7220.552320][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7220.552573][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7220.552803][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7220.553045][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7220.553296][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7220.553564][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7220.553835][ C1] ip_local_deliver+0x19d/0x480 [ 7220.554075][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7220.554365][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7220.554631][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7220.554982][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7220.555236][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7220.555557][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7220.555821][ C1] ip_rcv+0x564/0x740 [ 7220.556026][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7220.556259][ C1] ? set_track_prepare+0x8a/0xd0 [ 7220.556514][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7220.556791][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7220.557064][ C1] ? skb_clone+0x10b/0x330 [ 7220.557299][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7220.557619][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7220.557927][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7220.558211][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7220.558511][ C1] ? __tcf_classify+0x329/0x7d0 [ 7220.558759][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7220.558992][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7220.559296][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7220.559582][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7220.559908][ C1] ? lock_acquire+0x1c1/0x220 [ 7220.560148][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7220.560447][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7220.560733][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7220.561052][ C1] ? __copy_skb_header+0xaf/0x490 [ 7220.561311][ C1] ? __skb_clone+0x57a/0x760 [ 7220.561547][ C1] netif_receive_skb+0x55/0x280 [ 7220.561796][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7220.562109][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7220.562444][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7220.562744][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7220.563019][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7220.563310][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7220.563624][ C1] ? hlock_class+0x4e/0x130 [ 7220.563858][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7220.564137][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7220.564416][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7220.564681][ C1] ? hlock_class+0x4e/0x130 [ 7220.564917][ C1] ? mark_lock+0x38/0x3e0 [ 7220.565141][ C1] ? stack_access_ok+0xda/0x1f0 [ 7220.565392][ C1] ? __lock_acquire+0xb67/0x1610 [ 7220.565648][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7220.565924][ C1] ? get_stack_info+0x36/0xc0 [ 7220.566167][ C1] ? stack_access_ok+0xda/0x1f0 [ 7220.566415][ C1] ? get_reg+0x119/0x190 [ 7220.566631][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7220.566900][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7220.567211][ C1] __tcf_classify+0x329/0x7d0 [ 7220.567456][ C1] tcf_classify+0x283/0x930 [ 7220.567689][ C1] ? arch_stack_walk+0xa2/0x100 [ 7220.567937][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7220.568196][ C1] ? get_stack_info+0x36/0xc0 [ 7220.568440][ C1] tc_run+0x2e4/0x5d0 [ 7220.568647][ C1] ? __pfx_tc_run+0x10/0x10 [ 7220.568881][ C1] ? lock_acquire+0x1c1/0x220 [ 7220.569122][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7220.569385][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7220.569640][ C1] ? lock_acquire+0x1c1/0x220 [ 7220.569878][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7220.570146][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7220.570454][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7220.570729][ C1] ? neigh_hh_output+0x348/0x590 [ 7220.570985][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7220.571253][ C1] ip_finish_output2+0x786/0x18e0 [ 7220.571511][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7220.571791][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7220.572130][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7220.572407][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7220.572662][ C1] ? __ip_finish_output+0x10f/0x770 [ 7220.572929][ C1] ip_output+0x16b/0x4f0 [ 7220.573149][ C1] ? run_timer_softirq+0x72/0x100 [ 7220.573408][ C1] ? __pfx_ip_output+0x10/0x10 [ 7220.573653][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7220.573940][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7220.574194][ C1] ? ip_local_out+0x114/0x3b0 [ 7220.574436][ C1] __ip_queue_xmit+0x672/0x1910 [ 7220.574687][ C1] ? __create_object+0x5e/0xb0 [ 7220.574934][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7220.575204][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7220.575487][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7220.575761][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7220.576045][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7220.576319][ C1] tcp_delack_timer+0x84/0x240 [ 7220.576565][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7220.576839][ C1] call_timer_fn+0x173/0x430 [ 7220.577077][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7220.577340][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7220.577603][ C1] __run_timers.part.0+0x52d/0x890 [ 7220.577865][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7220.578140][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7220.578426][ C1] ? lock_acquire+0x1c1/0x220 [ 7220.578667][ C1] ? clockevents_program_event+0xf6/0x300 [ 7220.578961][ C1] ? lock_release+0x1d5/0x250 [ 7220.579200][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7220.579468][ C1] ? ktime_get+0xb3/0x190 [ 7220.579690][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7220.579989][ C1] run_timer_softirq+0x72/0x100 [ 7220.580239][ C1] __do_softirq+0x1b9/0x7ff [ 7220.580473][ C1] irq_exit_rcu+0x98/0xc0 [ 7220.580695][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7220.580982][ C1] [ 7220.581132][ C1] [ 7220.581286][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7220.581591][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7220.581919][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7220.582897][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7220.583206][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7220.583610][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7220.584010][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7220.584410][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7220.584813][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7220.585221][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7220.585518][ C1] pipe_read+0xa16/0xdf0 [ 7220.585742][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7220.586022][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7220.586267][ C1] ? iterate_tty_write+0x299/0x540 [ 7220.586530][ C1] ? lock_release+0x1d5/0x250 [ 7220.586774][ C1] vfs_read+0x911/0xc00 [ 7220.586988][ C1] ? lock_acquire+0x1c1/0x220 [ 7220.587230][ C1] ? __might_fault+0xc6/0x180 [ 7220.587471][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7220.587711][ C1] ? __might_fault+0xc6/0x180 [ 7220.587953][ C1] ? lock_release+0x1d5/0x250 [ 7220.588196][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7220.588462][ C1] ? __fget_light+0x54/0x1e0 [ 7220.588700][ C1] ksys_read+0x17a/0x1e0 [ 7220.588919][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7220.589167][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7220.589472][ C1] do_syscall_64+0xc9/0x1e0 [ 7220.589706][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7220.590007][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7220.590234][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7220.591214][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7220.591638][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7220.592038][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7220.592440][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7220.592842][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7220.593243][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7220.593646][ C1] [ 7220.593806][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7220.594079][ C2] NMI backtrace for cpu 2 [ 7220.594085][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7220.594090][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7220.594094][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 7220.594104][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 7220.594110][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 7220.594115][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7220.594118][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7220.594122][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7220.594126][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7220.594130][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7220.594134][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7220.594139][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7220.594144][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7220.594148][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7220.594151][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7220.594154][ C2] PKRU: 55555554 [ 7220.594156][ C2] Call Trace: [ 7220.594159][ C2] [ 7220.594162][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7220.594174][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7220.594182][ C2] ? nmi_handle+0x153/0x420 [ 7220.594192][ C2] ? default_do_nmi+0x41/0x100 [ 7220.594199][ C2] ? exc_nmi+0xf3/0x120 [ 7220.594205][ C2] ? end_repeat_nmi+0xf/0x60 [ 7220.594217][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7220.594226][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 7220.594234][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 7220.594244][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 7220.594252][ C2] [ 7220.594254][ C2] [ 7220.594256][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 7220.594264][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7220.594271][ C2] ? get_stack_info+0x36/0xc0 [ 7220.594279][ C2] ? lock_acquire+0x1c1/0x220 [ 7220.594287][ C2] ? lock_release+0x1d5/0x250 [ 7220.594296][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7220.594304][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7220.594311][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7220.594320][ C2] ? lock_acquire+0x1c1/0x220 [ 7220.594325][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7220.594334][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7220.594340][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7220.594357][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7220.594363][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7220.594375][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7220.594385][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7220.594393][ C2] ip_local_deliver+0x19d/0x480 [ 7220.594399][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7220.594404][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7220.594410][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7220.594421][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7220.594429][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7220.594436][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7220.594450][ C2] ip_rcv+0x564/0x740 [ 7220.594453][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7220.594455][ C2] ? set_track_prepare+0x8a/0xd0 [ 7220.594459][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7220.594462][ C2] ? start_secondary+0x21c/0x2b0 [ 7220.594465][ C2] ? skb_clone+0x10b/0x330 [ 7220.594468][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7220.594474][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7220.594479][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7220.594483][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7220.594491][ C2] ? __tcf_classify+0x329/0x7d0 [ 7220.594494][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7220.594496][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7220.594500][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7220.594503][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7220.594507][ C2] ? lock_acquire+0x1c1/0x220 [ 7220.594509][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7220.594514][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7220.594517][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7220.594521][ C2] ? __copy_skb_header+0xaf/0x490 [ 7220.594525][ C2] ? __skb_clone+0x57a/0x760 [ 7220.594527][ C2] netif_receive_skb+0x55/0x280 [ 7220.594531][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7220.594538][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7220.594544][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7220.594551][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7220.594555][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7220.594565][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7220.594573][ C2] ? get_stack_info+0x36/0xc0 [ 7220.594577][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7220.594580][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7220.594583][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7220.594586][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7220.594589][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7220.594592][ C2] ? kernel_text_address+0x17/0xe0 [ 7220.594595][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7220.594599][ C2] ? arch_stack_walk+0x8c/0x100 [ 7220.594602][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7220.594605][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7220.594609][ C2] ? lock_acquire+0x1c1/0x220 [ 7220.594611][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7220.594615][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7220.594619][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7220.594622][ C2] ? get_stack_info+0x36/0xc0 [ 7220.594626][ C2] __tcf_classify+0x329/0x7d0 [ 7220.594631][ C2] tcf_classify+0x283/0x930 [ 7220.594635][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7220.594638][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7220.594643][ C2] tc_run+0x2e4/0x5d0 [ 7220.594646][ C2] ? __pfx_tc_run+0x10/0x10 [ 7220.594649][ C2] ? lock_acquire+0x1c1/0x220 [ 7220.594652][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7220.594656][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7220.594660][ C2] ? lock_acquire+0x1c1/0x220 [ 7220.594662][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7220.594665][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7220.594668][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7220.594671][ C2] ? neigh_hh_output+0x348/0x590 [ 7220.594674][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7220.594678][ C2] ip_finish_output2+0x786/0x18e0 [ 7220.594681][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7220.594689][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7220.594691][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7220.594695][ C2] ? __ip_finish_output+0x10f/0x770 [ 7220.594698][ C2] ip_output+0x16b/0x4f0 [ 7220.594701][ C2] ? __pfx_ip_output+0x10/0x10 [ 7220.594704][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7220.594707][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7220.594710][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7220.594713][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7220.594715][ C2] ? __alloc_skb+0xd4/0x280 [ 7220.594718][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7220.594721][ C2] ? tcp_fragment+0x168/0x1040 [ 7220.594725][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7220.594728][ C2] ? ip_local_out+0x114/0x3b0 [ 7220.594731][ C2] __ip_queue_xmit+0x672/0x1910 [ 7220.594735][ C2] ? __skb_clone+0x57a/0x760 [ 7220.594738][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7220.594743][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7220.594746][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7220.594749][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7220.594753][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7220.594757][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7220.594760][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7220.594764][ C2] tcp_send_loss_probe+0x348/0x830 [ 7220.594767][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7220.594770][ C2] tcp_write_timer+0x82/0x1d0 [ 7220.594773][ C2] call_timer_fn+0x173/0x430 [ 7220.594777][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7220.594781][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7220.594785][ C2] __run_timers.part.0+0x52d/0x890 [ 7220.594788][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7220.594793][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7220.594796][ C2] ? lock_acquire+0x1c1/0x220 [ 7220.594798][ C2] ? clockevents_program_event+0xf6/0x300 [ 7220.594802][ C2] ? lock_release+0x1d5/0x250 [ 7220.594804][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7220.594808][ C2] ? ktime_get+0xb3/0x190 [ 7220.594811][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7220.594815][ C2] run_timer_softirq+0x72/0x100 [ 7220.594818][ C2] __do_softirq+0x1b9/0x7ff [ 7220.594823][ C2] irq_exit_rcu+0x98/0xc0 [ 7220.594825][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7220.594828][ C2] [ 7220.594829][ C2] [ 7220.594830][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7220.594833][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7220.594836][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7220.594838][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7220.594840][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7220.594842][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7220.594843][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7220.594845][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7220.594846][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7220.594849][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7220.594853][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7220.594856][ C2] default_idle_call+0x69/0xa0 [ 7220.594858][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7220.594861][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7220.594864][ C2] ? lock_release+0x1d5/0x250 [ 7220.594867][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7220.594870][ C2] do_idle+0xfb/0x160 [ 7220.594873][ C2] cpu_startup_entry+0x55/0x60 [ 7220.594875][ C2] start_secondary+0x21c/0x2b0 [ 7220.594878][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7220.594882][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7220.594887][ C2] [ 7244.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4556s! [perl:4135] [ 7244.569684][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7244.570915][ C1] irq event stamp: 209232 [ 7244.571130][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7244.571645][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7244.572113][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7244.572570][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7244.573019][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7244.573457][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7244.574056][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7244.574393][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7244.575367][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7244.575677][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7244.576077][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7244.576476][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7244.576878][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7244.577279][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7244.577679][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7244.578127][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7244.578460][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7244.578862][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7244.579264][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7244.579664][ C1] PKRU: 55555554 [ 7244.579847][ C1] Call Trace: [ 7244.580018][ C1] [ 7244.580166][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7244.580430][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7244.580675][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7244.580951][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7244.581224][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7244.581515][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7244.581781][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7244.582088][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7244.582351][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7244.582661][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7244.582956][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7244.583272][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7244.583562][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7244.583857][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7244.584149][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7244.584462][ C1] ? get_stack_info+0x36/0xc0 [ 7244.584702][ C1] ? lock_acquire+0x1c1/0x220 [ 7244.584946][ C1] ? lock_release+0x1d5/0x250 [ 7244.585188][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7244.585438][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7244.585711][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7244.585997][ C1] ? lock_acquire+0x1c1/0x220 [ 7244.586236][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7244.586479][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7244.586740][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7244.586976][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7244.587224][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7244.587482][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7244.587759][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7244.588036][ C1] ip_local_deliver+0x19d/0x480 [ 7244.588284][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7244.588555][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7244.588819][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7244.589170][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7244.589423][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7244.589745][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7244.590008][ C1] ip_rcv+0x564/0x740 [ 7244.590213][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7244.590443][ C1] ? set_track_prepare+0x8a/0xd0 [ 7244.590697][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7244.590977][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7244.591251][ C1] ? skb_clone+0x10b/0x330 [ 7244.591479][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7244.591799][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7244.592106][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7244.592390][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7244.592685][ C1] ? __tcf_classify+0x329/0x7d0 [ 7244.592935][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7244.593167][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7244.593465][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7244.593753][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7244.594079][ C1] ? lock_acquire+0x1c1/0x220 [ 7244.594319][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7244.594616][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7244.594906][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7244.595224][ C1] ? __copy_skb_header+0xaf/0x490 [ 7244.595483][ C1] ? __skb_clone+0x57a/0x760 [ 7244.595718][ C1] netif_receive_skb+0x55/0x280 [ 7244.595971][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7244.596285][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7244.596618][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7244.596918][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7244.597194][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7244.597481][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7244.597795][ C1] ? hlock_class+0x4e/0x130 [ 7244.598028][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7244.598305][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7244.598581][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7244.598846][ C1] ? hlock_class+0x4e/0x130 [ 7244.599078][ C1] ? mark_lock+0x38/0x3e0 [ 7244.599299][ C1] ? stack_access_ok+0xda/0x1f0 [ 7244.599547][ C1] ? __lock_acquire+0xb67/0x1610 [ 7244.599802][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7244.600081][ C1] ? get_stack_info+0x36/0xc0 [ 7244.600320][ C1] ? stack_access_ok+0xda/0x1f0 [ 7244.600567][ C1] ? get_reg+0x119/0x190 [ 7244.600786][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7244.601059][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7244.601368][ C1] __tcf_classify+0x329/0x7d0 [ 7244.601609][ C1] tcf_classify+0x283/0x930 [ 7244.601842][ C1] ? arch_stack_walk+0xa2/0x100 [ 7244.602092][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7244.602349][ C1] ? get_stack_info+0x36/0xc0 [ 7244.602592][ C1] tc_run+0x2e4/0x5d0 [ 7244.602797][ C1] ? __pfx_tc_run+0x10/0x10 [ 7244.603028][ C1] ? lock_acquire+0x1c1/0x220 [ 7244.603267][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7244.603528][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7244.603781][ C1] ? lock_acquire+0x1c1/0x220 [ 7244.604021][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7244.604285][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7244.604591][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7244.604885][ C1] ? neigh_hh_output+0x348/0x590 [ 7244.605139][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7244.605405][ C1] ip_finish_output2+0x786/0x18e0 [ 7244.605663][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7244.605942][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7244.606283][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7244.606560][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7244.606816][ C1] ? __ip_finish_output+0x10f/0x770 [ 7244.607082][ C1] ip_output+0x16b/0x4f0 [ 7244.607298][ C1] ? run_timer_softirq+0x72/0x100 [ 7244.607557][ C1] ? __pfx_ip_output+0x10/0x10 [ 7244.607803][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7244.608092][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7244.608346][ C1] ? ip_local_out+0x114/0x3b0 [ 7244.608586][ C1] __ip_queue_xmit+0x672/0x1910 [ 7244.608836][ C1] ? __create_object+0x5e/0xb0 [ 7244.609082][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7244.609350][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7244.609632][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7244.609908][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7244.610191][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7244.610464][ C1] tcp_delack_timer+0x84/0x240 [ 7244.610710][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7244.610984][ C1] call_timer_fn+0x173/0x430 [ 7244.611221][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7244.611484][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7244.611747][ C1] __run_timers.part.0+0x52d/0x890 [ 7244.612008][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7244.612285][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7244.612572][ C1] ? lock_acquire+0x1c1/0x220 [ 7244.612813][ C1] ? clockevents_program_event+0xf6/0x300 [ 7244.613104][ C1] ? lock_release+0x1d5/0x250 [ 7244.613345][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7244.613611][ C1] ? ktime_get+0xb3/0x190 [ 7244.613834][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7244.614132][ C1] run_timer_softirq+0x72/0x100 [ 7244.614381][ C1] __do_softirq+0x1b9/0x7ff [ 7244.614616][ C1] irq_exit_rcu+0x98/0xc0 [ 7244.614839][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7244.615127][ C1] [ 7244.615278][ C1] [ 7244.615428][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7244.615736][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7244.616062][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7244.617037][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7244.617348][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7244.617748][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7244.618151][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7244.618553][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7244.618953][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7244.619356][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7244.619656][ C1] pipe_read+0xa16/0xdf0 [ 7244.619876][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7244.620158][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7244.620402][ C1] ? iterate_tty_write+0x299/0x540 [ 7244.620665][ C1] ? lock_release+0x1d5/0x250 [ 7244.620907][ C1] vfs_read+0x911/0xc00 [ 7244.621124][ C1] ? lock_acquire+0x1c1/0x220 [ 7244.621366][ C1] ? __might_fault+0xc6/0x180 [ 7244.621609][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7244.621851][ C1] ? __might_fault+0xc6/0x180 [ 7244.622092][ C1] ? lock_release+0x1d5/0x250 [ 7244.622331][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7244.622598][ C1] ? __fget_light+0x54/0x1e0 [ 7244.622837][ C1] ksys_read+0x17a/0x1e0 [ 7244.623056][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7244.623301][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7244.623609][ C1] do_syscall_64+0xc9/0x1e0 [ 7244.623843][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7244.624143][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7244.624373][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7244.625353][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7244.625777][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7244.626178][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7244.626578][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7244.626978][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7244.627384][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7244.627788][ C1] [ 7248.569296][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4559s! [swapper/2:0] [ 7248.569700][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7248.570916][ C2] irq event stamp: 44114564 [ 7248.571137][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7248.571653][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7248.572148][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7248.572610][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7248.573061][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7248.573501][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7248.574092][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7248.574406][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7248.575373][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7248.575678][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7248.576082][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7248.576465][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7248.576851][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7248.577237][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7248.577641][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7248.578083][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7248.578414][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7248.578814][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7248.579213][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7248.579608][ C2] PKRU: 55555554 [ 7248.579789][ C2] Call Trace: [ 7248.579958][ C2] [ 7248.580103][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7248.580363][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7248.580603][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7248.580877][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7248.581148][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7248.581435][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7248.581697][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7248.582001][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7248.582261][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7248.582521][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7248.582828][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7248.583120][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7248.583432][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7248.583723][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7248.584014][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7248.584304][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7248.584613][ C2] ? get_stack_info+0x36/0xc0 [ 7248.584854][ C2] ? lock_acquire+0x1c1/0x220 [ 7248.585091][ C2] ? lock_release+0x1d5/0x250 [ 7248.585330][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7248.585576][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7248.585849][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7248.586133][ C2] ? lock_acquire+0x1c1/0x220 [ 7248.586368][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7248.586607][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7248.586864][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7248.587097][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7248.587342][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7248.587598][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7248.587870][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7248.588145][ C2] ip_local_deliver+0x19d/0x480 [ 7248.588390][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7248.588659][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7248.588920][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7248.589266][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7248.589518][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7248.589835][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7248.590096][ C2] ip_rcv+0x564/0x740 [ 7248.590297][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7248.590526][ C2] ? set_track_prepare+0x8a/0xd0 [ 7248.590776][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7248.591051][ C2] ? start_secondary+0x21c/0x2b0 [ 7248.591301][ C2] ? skb_clone+0x10b/0x330 [ 7248.591523][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7248.591840][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7248.592143][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7248.592421][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7248.592715][ C2] ? __tcf_classify+0x329/0x7d0 [ 7248.592962][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7248.593189][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7248.593487][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7248.593769][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7248.594092][ C2] ? lock_acquire+0x1c1/0x220 [ 7248.594327][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7248.594622][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7248.594908][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7248.595223][ C2] ? __copy_skb_header+0xaf/0x490 [ 7248.595478][ C2] ? __skb_clone+0x57a/0x760 [ 7248.595712][ C2] netif_receive_skb+0x55/0x280 [ 7248.595959][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7248.596269][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7248.596598][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7248.596894][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7248.597167][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7248.597452][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7248.597762][ C2] ? get_stack_info+0x36/0xc0 [ 7248.598002][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7248.598264][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7248.598578][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7248.598850][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7248.599125][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7248.599438][ C2] ? kernel_text_address+0x17/0xe0 [ 7248.599696][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7248.600005][ C2] ? arch_stack_walk+0x8c/0x100 [ 7248.600252][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7248.600513][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7248.600797][ C2] ? lock_acquire+0x1c1/0x220 [ 7248.601032][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7248.601315][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7248.601615][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7248.601890][ C2] ? get_stack_info+0x36/0xc0 [ 7248.602129][ C2] __tcf_classify+0x329/0x7d0 [ 7248.602366][ C2] tcf_classify+0x283/0x930 [ 7248.602598][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7248.602852][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7248.603164][ C2] tc_run+0x2e4/0x5d0 [ 7248.603366][ C2] ? __pfx_tc_run+0x10/0x10 [ 7248.603596][ C2] ? lock_acquire+0x1c1/0x220 [ 7248.603830][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7248.604090][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7248.604340][ C2] ? lock_acquire+0x1c1/0x220 [ 7248.604578][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7248.604846][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7248.605148][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7248.605416][ C2] ? neigh_hh_output+0x348/0x590 [ 7248.605667][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7248.605928][ C2] ip_finish_output2+0x786/0x18e0 [ 7248.606182][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7248.606517][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7248.606793][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7248.607044][ C2] ? __ip_finish_output+0x10f/0x770 [ 7248.607308][ C2] ip_output+0x16b/0x4f0 [ 7248.607522][ C2] ? __pfx_ip_output+0x10/0x10 [ 7248.607763][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7248.608037][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7248.608348][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7248.608623][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7248.608871][ C2] ? __alloc_skb+0xd4/0x280 [ 7248.609100][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7248.609366][ C2] ? tcp_fragment+0x168/0x1040 [ 7248.609608][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7248.609858][ C2] ? ip_local_out+0x114/0x3b0 [ 7248.610097][ C2] __ip_queue_xmit+0x672/0x1910 [ 7248.610343][ C2] ? __skb_clone+0x57a/0x760 [ 7248.610574][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7248.610840][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7248.611119][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7248.611362][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7248.611608][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7248.611905][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7248.612222][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7248.612465][ C2] tcp_send_loss_probe+0x348/0x830 [ 7248.612723][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7248.612994][ C2] tcp_write_timer+0x82/0x1d0 [ 7248.613233][ C2] call_timer_fn+0x173/0x430 [ 7248.613467][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7248.613727][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7248.613986][ C2] __run_timers.part.0+0x52d/0x890 [ 7248.614244][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7248.614511][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7248.614795][ C2] ? lock_acquire+0x1c1/0x220 [ 7248.615035][ C2] ? clockevents_program_event+0xf6/0x300 [ 7248.615325][ C2] ? lock_release+0x1d5/0x250 [ 7248.615563][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7248.615826][ C2] ? ktime_get+0xb3/0x190 [ 7248.616043][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7248.616339][ C2] run_timer_softirq+0x72/0x100 [ 7248.616585][ C2] __do_softirq+0x1b9/0x7ff [ 7248.616815][ C2] irq_exit_rcu+0x98/0xc0 [ 7248.617035][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7248.617316][ C2] [ 7248.617466][ C2] [ 7248.617615][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7248.617917][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7248.618170][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7248.619129][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7248.619434][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7248.619829][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7248.620224][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7248.620616][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7248.621014][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7248.621411][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7248.621696][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7248.621956][ C2] default_idle_call+0x69/0xa0 [ 7248.622198][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7248.622447][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7248.622723][ C2] ? lock_release+0x1d5/0x250 [ 7248.622959][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7248.623231][ C2] do_idle+0xfb/0x160 [ 7248.623434][ C2] cpu_startup_entry+0x55/0x60 [ 7248.623673][ C2] start_secondary+0x21c/0x2b0 [ 7248.623913][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7248.624181][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7248.624488][ C2] [ 7272.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4582s! [perl:4135] [ 7272.569676][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7272.570905][ C1] irq event stamp: 209232 [ 7272.571118][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7272.571631][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7272.572098][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7272.572554][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7272.573003][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7272.573441][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7272.574040][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7272.574356][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7272.575336][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7272.575644][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7272.576050][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7272.576437][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7272.576829][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7272.577220][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7272.577609][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7272.578045][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7272.578369][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7272.578761][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7272.579152][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7272.579541][ C1] PKRU: 55555554 [ 7272.579719][ C1] Call Trace: [ 7272.579886][ C1] [ 7272.580030][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7272.580287][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7272.580525][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7272.580793][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7272.581059][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7272.581342][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7272.581601][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7272.581899][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7272.582154][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7272.582455][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7272.582742][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7272.583050][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7272.583334][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7272.583620][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7272.583903][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7272.584207][ C1] ? get_stack_info+0x36/0xc0 [ 7272.584440][ C1] ? lock_acquire+0x1c1/0x220 [ 7272.584675][ C1] ? lock_release+0x1d5/0x250 [ 7272.584933][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7272.585183][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7272.585455][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7272.585741][ C1] ? lock_acquire+0x1c1/0x220 [ 7272.585989][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7272.586224][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7272.586478][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7272.586708][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7272.586948][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7272.587221][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7272.587498][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7272.587775][ C1] ip_local_deliver+0x19d/0x480 [ 7272.588024][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7272.588297][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7272.588560][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7272.588910][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7272.589164][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7272.589485][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7272.589754][ C1] ip_rcv+0x564/0x740 [ 7272.589958][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7272.590190][ C1] ? set_track_prepare+0x8a/0xd0 [ 7272.590444][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7272.590725][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7272.590999][ C1] ? skb_clone+0x10b/0x330 [ 7272.591227][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7272.591548][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7272.591853][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7272.592137][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7272.592432][ C1] ? __tcf_classify+0x329/0x7d0 [ 7272.592682][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7272.592914][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7272.593213][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7272.593502][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7272.593830][ C1] ? lock_acquire+0x1c1/0x220 [ 7272.594070][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7272.594367][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7272.594655][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7272.594976][ C1] ? __copy_skb_header+0xaf/0x490 [ 7272.595237][ C1] ? __skb_clone+0x57a/0x760 [ 7272.595471][ C1] netif_receive_skb+0x55/0x280 [ 7272.595721][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7272.596035][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7272.596369][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7272.596673][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7272.596948][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7272.597237][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7272.597554][ C1] ? hlock_class+0x4e/0x130 [ 7272.597794][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7272.598070][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7272.598348][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7272.598615][ C1] ? hlock_class+0x4e/0x130 [ 7272.598846][ C1] ? mark_lock+0x38/0x3e0 [ 7272.599068][ C1] ? stack_access_ok+0xda/0x1f0 [ 7272.599318][ C1] ? __lock_acquire+0xb67/0x1610 [ 7272.599573][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7272.599853][ C1] ? get_stack_info+0x36/0xc0 [ 7272.600094][ C1] ? stack_access_ok+0xda/0x1f0 [ 7272.600341][ C1] ? get_reg+0x119/0x190 [ 7272.600562][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7272.600831][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7272.601143][ C1] __tcf_classify+0x329/0x7d0 [ 7272.601386][ C1] tcf_classify+0x283/0x930 [ 7272.601618][ C1] ? arch_stack_walk+0xa2/0x100 [ 7272.601868][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7272.602126][ C1] ? get_stack_info+0x36/0xc0 [ 7272.602369][ C1] tc_run+0x2e4/0x5d0 [ 7272.602574][ C1] ? __pfx_tc_run+0x10/0x10 [ 7272.602808][ C1] ? lock_acquire+0x1c1/0x220 [ 7272.603047][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7272.603310][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7272.603566][ C1] ? lock_acquire+0x1c1/0x220 [ 7272.603807][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7272.604072][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7272.604380][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7272.604653][ C1] ? neigh_hh_output+0x348/0x590 [ 7272.604910][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7272.605177][ C1] ip_finish_output2+0x786/0x18e0 [ 7272.605434][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7272.605714][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7272.606054][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7272.606332][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7272.606588][ C1] ? __ip_finish_output+0x10f/0x770 [ 7272.606854][ C1] ip_output+0x16b/0x4f0 [ 7272.607071][ C1] ? run_timer_softirq+0x72/0x100 [ 7272.607331][ C1] ? __pfx_ip_output+0x10/0x10 [ 7272.607574][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7272.607864][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7272.608118][ C1] ? ip_local_out+0x114/0x3b0 [ 7272.608359][ C1] __ip_queue_xmit+0x672/0x1910 [ 7272.608608][ C1] ? __create_object+0x5e/0xb0 [ 7272.608854][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7272.609122][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7272.609409][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7272.609684][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7272.609966][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7272.610240][ C1] tcp_delack_timer+0x84/0x240 [ 7272.610484][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7272.610760][ C1] call_timer_fn+0x173/0x430 [ 7272.610996][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7272.611259][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7272.611522][ C1] __run_timers.part.0+0x52d/0x890 [ 7272.611785][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7272.612062][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7272.612347][ C1] ? lock_acquire+0x1c1/0x220 [ 7272.612588][ C1] ? clockevents_program_event+0xf6/0x300 [ 7272.612878][ C1] ? lock_release+0x1d5/0x250 [ 7272.613120][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7272.613386][ C1] ? ktime_get+0xb3/0x190 [ 7272.613609][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7272.613906][ C1] run_timer_softirq+0x72/0x100 [ 7272.614157][ C1] __do_softirq+0x1b9/0x7ff [ 7272.614392][ C1] irq_exit_rcu+0x98/0xc0 [ 7272.614612][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7272.614907][ C1] [ 7272.615056][ C1] [ 7272.615208][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7272.615514][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7272.615839][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7272.616816][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7272.617126][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7272.617527][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7272.617931][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7272.618333][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7272.618735][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7272.619139][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7272.619438][ C1] pipe_read+0xa16/0xdf0 [ 7272.619659][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7272.619939][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7272.620185][ C1] ? iterate_tty_write+0x299/0x540 [ 7272.620448][ C1] ? lock_release+0x1d5/0x250 [ 7272.620689][ C1] vfs_read+0x911/0xc00 [ 7272.620906][ C1] ? lock_acquire+0x1c1/0x220 [ 7272.621145][ C1] ? __might_fault+0xc6/0x180 [ 7272.621387][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7272.621629][ C1] ? __might_fault+0xc6/0x180 [ 7272.621871][ C1] ? lock_release+0x1d5/0x250 [ 7272.622111][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7272.622379][ C1] ? __fget_light+0x54/0x1e0 [ 7272.622616][ C1] ksys_read+0x17a/0x1e0 [ 7272.622836][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7272.623081][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7272.623388][ C1] do_syscall_64+0xc9/0x1e0 [ 7272.623623][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7272.623923][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7272.624152][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7272.625132][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7272.625557][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7272.625958][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7272.626358][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7272.626761][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7272.627165][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7272.627570][ C1] [ 7276.569294][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4585s! [swapper/2:0] [ 7276.569693][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7276.570898][ C2] irq event stamp: 44114564 [ 7276.571118][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7276.571636][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7276.572129][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7276.572587][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7276.573039][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7276.573479][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7276.574067][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7276.574379][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7276.575349][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7276.575654][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7276.576054][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7276.576439][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7276.576823][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7276.577207][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7276.577592][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7276.578023][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7276.578345][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7276.578731][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7276.579137][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7276.579532][ C2] PKRU: 55555554 [ 7276.579711][ C2] Call Trace: [ 7276.579880][ C2] [ 7276.580025][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7276.580286][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7276.580526][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7276.580803][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7276.581073][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7276.581358][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7276.581621][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7276.581923][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7276.582182][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7276.582441][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7276.582748][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7276.583042][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7276.583354][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7276.583640][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7276.583934][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7276.584219][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7276.584528][ C2] ? get_stack_info+0x36/0xc0 [ 7276.584769][ C2] ? lock_acquire+0x1c1/0x220 [ 7276.585008][ C2] ? lock_release+0x1d5/0x250 [ 7276.585243][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7276.585490][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7276.585761][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7276.586044][ C2] ? lock_acquire+0x1c1/0x220 [ 7276.586283][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7276.586520][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7276.586777][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7276.587009][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7276.587255][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7276.587510][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7276.587781][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7276.588062][ C2] ip_local_deliver+0x19d/0x480 [ 7276.588308][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7276.588580][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7276.588842][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7276.589185][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7276.589436][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7276.589754][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7276.590014][ C2] ip_rcv+0x564/0x740 [ 7276.590216][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7276.590446][ C2] ? set_track_prepare+0x8a/0xd0 [ 7276.590698][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7276.590972][ C2] ? start_secondary+0x21c/0x2b0 [ 7276.591222][ C2] ? skb_clone+0x10b/0x330 [ 7276.591448][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7276.591764][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7276.592066][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7276.592348][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7276.592639][ C2] ? __tcf_classify+0x329/0x7d0 [ 7276.592886][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7276.593116][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7276.593412][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7276.593697][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7276.594021][ C2] ? lock_acquire+0x1c1/0x220 [ 7276.594259][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7276.594552][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7276.594841][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7276.595155][ C2] ? __copy_skb_header+0xaf/0x490 [ 7276.595411][ C2] ? __skb_clone+0x57a/0x760 [ 7276.595642][ C2] netif_receive_skb+0x55/0x280 [ 7276.595888][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7276.596200][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7276.596529][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7276.596827][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7276.597099][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7276.597384][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7276.597694][ C2] ? get_stack_info+0x36/0xc0 [ 7276.597935][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7276.598196][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7276.598509][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7276.598782][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7276.599063][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7276.599376][ C2] ? kernel_text_address+0x17/0xe0 [ 7276.599634][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7276.599944][ C2] ? arch_stack_walk+0x8c/0x100 [ 7276.600189][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7276.600454][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7276.600739][ C2] ? lock_acquire+0x1c1/0x220 [ 7276.600979][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7276.601258][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7276.601560][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7276.601834][ C2] ? get_stack_info+0x36/0xc0 [ 7276.602073][ C2] __tcf_classify+0x329/0x7d0 [ 7276.602315][ C2] tcf_classify+0x283/0x930 [ 7276.602544][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7276.602799][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7276.603111][ C2] tc_run+0x2e4/0x5d0 [ 7276.603313][ C2] ? __pfx_tc_run+0x10/0x10 [ 7276.603543][ C2] ? lock_acquire+0x1c1/0x220 [ 7276.603781][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7276.604040][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7276.604293][ C2] ? lock_acquire+0x1c1/0x220 [ 7276.604529][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7276.604796][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7276.605094][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7276.605367][ C2] ? neigh_hh_output+0x348/0x590 [ 7276.605618][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7276.605882][ C2] ip_finish_output2+0x786/0x18e0 [ 7276.606136][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7276.606471][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7276.606744][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7276.606995][ C2] ? __ip_finish_output+0x10f/0x770 [ 7276.607257][ C2] ip_output+0x16b/0x4f0 [ 7276.607475][ C2] ? __pfx_ip_output+0x10/0x10 [ 7276.607715][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7276.607992][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7276.608303][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7276.608576][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7276.608826][ C2] ? __alloc_skb+0xd4/0x280 [ 7276.609055][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7276.609323][ C2] ? tcp_fragment+0x168/0x1040 [ 7276.609564][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7276.609815][ C2] ? ip_local_out+0x114/0x3b0 [ 7276.610052][ C2] __ip_queue_xmit+0x672/0x1910 [ 7276.610299][ C2] ? __skb_clone+0x57a/0x760 [ 7276.610533][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7276.610798][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7276.611076][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7276.611320][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7276.611567][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7276.611866][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7276.612184][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7276.612425][ C2] tcp_send_loss_probe+0x348/0x830 [ 7276.612684][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7276.612951][ C2] tcp_write_timer+0x82/0x1d0 [ 7276.613188][ C2] call_timer_fn+0x173/0x430 [ 7276.613423][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7276.613683][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7276.613942][ C2] __run_timers.part.0+0x52d/0x890 [ 7276.614200][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7276.614469][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7276.614757][ C2] ? lock_acquire+0x1c1/0x220 [ 7276.614994][ C2] ? clockevents_program_event+0xf6/0x300 [ 7276.615282][ C2] ? lock_release+0x1d5/0x250 [ 7276.615520][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7276.615782][ C2] ? ktime_get+0xb3/0x190 [ 7276.616001][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7276.616297][ C2] run_timer_softirq+0x72/0x100 [ 7276.616543][ C2] __do_softirq+0x1b9/0x7ff [ 7276.616775][ C2] irq_exit_rcu+0x98/0xc0 [ 7276.616993][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7276.617276][ C2] [ 7276.617426][ C2] [ 7276.617574][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7276.617877][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7276.618131][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7276.619093][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7276.619399][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7276.619794][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7276.620189][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7276.620586][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7276.620982][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7276.621379][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7276.621667][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7276.621927][ C2] default_idle_call+0x69/0xa0 [ 7276.622169][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7276.622418][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7276.622694][ C2] ? lock_release+0x1d5/0x250 [ 7276.622931][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7276.623203][ C2] do_idle+0xfb/0x160 [ 7276.623405][ C2] cpu_startup_entry+0x55/0x60 [ 7276.623647][ C2] start_secondary+0x21c/0x2b0 [ 7276.623890][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7276.624157][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7276.624466][ C2] [ 7298.594102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7298.594451][ C1] rcu: 1-....: (4931782 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1209037 [ 7298.595026][ C1] rcu: (t=4943707 jiffies g=1882453 q=721 ncpus=4) [ 7298.595358][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7298.595816][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7298.596414][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7298.596729][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7298.597702][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7298.598010][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7298.598412][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7298.598812][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7298.599212][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7298.599613][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7298.600015][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7298.600465][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7298.600797][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7298.601199][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7298.601601][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7298.602004][ C1] PKRU: 55555554 [ 7298.602187][ C1] Call Trace: [ 7298.602356][ C1] [ 7298.602507][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7298.602781][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7298.603035][ C1] ? check_cpu_stall+0x284/0x500 [ 7298.603288][ C1] ? rcu_pending+0x92/0x360 [ 7298.603517][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7298.603789][ C1] ? update_process_times+0xb9/0x110 [ 7298.604059][ C1] ? tick_sched_handle+0x67/0x130 [ 7298.604318][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7298.604606][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7298.604851][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7298.605165][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7298.605438][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7298.605728][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7298.605994][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7298.606300][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7298.606564][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7298.606872][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7298.607171][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7298.607486][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7298.607775][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7298.608067][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7298.608354][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7298.608667][ C1] ? get_stack_info+0x36/0xc0 [ 7298.608909][ C1] ? lock_acquire+0x1c1/0x220 [ 7298.609151][ C1] ? lock_release+0x1d5/0x250 [ 7298.609391][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7298.609640][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7298.609915][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7298.610201][ C1] ? lock_acquire+0x1c1/0x220 [ 7298.610442][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7298.610682][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7298.610944][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7298.611178][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7298.611427][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7298.611685][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7298.611959][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7298.612240][ C1] ip_local_deliver+0x19d/0x480 [ 7298.612489][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7298.612763][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7298.613027][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7298.613374][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7298.613628][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7298.613948][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7298.614210][ C1] ip_rcv+0x564/0x740 [ 7298.614414][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7298.614649][ C1] ? set_track_prepare+0x8a/0xd0 [ 7298.614904][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7298.615181][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7298.615455][ C1] ? skb_clone+0x10b/0x330 [ 7298.615683][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7298.616002][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7298.616309][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7298.616590][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7298.616886][ C1] ? __tcf_classify+0x329/0x7d0 [ 7298.617134][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7298.617365][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7298.617666][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7298.617950][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7298.618276][ C1] ? lock_acquire+0x1c1/0x220 [ 7298.618516][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7298.618814][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7298.619099][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7298.619417][ C1] ? __copy_skb_header+0xaf/0x490 [ 7298.619675][ C1] ? __skb_clone+0x57a/0x760 [ 7298.619911][ C1] netif_receive_skb+0x55/0x280 [ 7298.620160][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7298.620472][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7298.620806][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7298.621105][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7298.621380][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7298.621670][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7298.621987][ C1] ? hlock_class+0x4e/0x130 [ 7298.622218][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7298.622496][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7298.622773][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7298.623038][ C1] ? hlock_class+0x4e/0x130 [ 7298.623271][ C1] ? mark_lock+0x38/0x3e0 [ 7298.623490][ C1] ? stack_access_ok+0xda/0x1f0 [ 7298.623739][ C1] ? __lock_acquire+0xb67/0x1610 [ 7298.623994][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7298.624270][ C1] ? get_stack_info+0x36/0xc0 [ 7298.624512][ C1] ? stack_access_ok+0xda/0x1f0 [ 7298.624764][ C1] ? get_reg+0x119/0x190 [ 7298.624981][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7298.625249][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7298.625559][ C1] __tcf_classify+0x329/0x7d0 [ 7298.625803][ C1] tcf_classify+0x283/0x930 [ 7298.626035][ C1] ? arch_stack_walk+0xa2/0x100 [ 7298.626283][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7298.626540][ C1] ? get_stack_info+0x36/0xc0 [ 7298.626781][ C1] tc_run+0x2e4/0x5d0 [ 7298.626986][ C1] ? __pfx_tc_run+0x10/0x10 [ 7298.627221][ C1] ? lock_acquire+0x1c1/0x220 [ 7298.627461][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7298.627722][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7298.627977][ C1] ? lock_acquire+0x1c1/0x220 [ 7298.628215][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7298.628482][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7298.628786][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7298.629061][ C1] ? neigh_hh_output+0x348/0x590 [ 7298.629314][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7298.629580][ C1] ip_finish_output2+0x786/0x18e0 [ 7298.629836][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7298.630113][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7298.630451][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7298.630729][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7298.630982][ C1] ? __ip_finish_output+0x10f/0x770 [ 7298.631250][ C1] ip_output+0x16b/0x4f0 [ 7298.631466][ C1] ? run_timer_softirq+0x72/0x100 [ 7298.631723][ C1] ? __pfx_ip_output+0x10/0x10 [ 7298.631968][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7298.632254][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7298.632507][ C1] ? ip_local_out+0x114/0x3b0 [ 7298.632749][ C1] __ip_queue_xmit+0x672/0x1910 [ 7298.632999][ C1] ? __create_object+0x5e/0xb0 [ 7298.633244][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7298.633512][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7298.633794][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7298.634067][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7298.634352][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7298.634627][ C1] tcp_delack_timer+0x84/0x240 [ 7298.634872][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7298.635144][ C1] call_timer_fn+0x173/0x430 [ 7298.635382][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7298.635645][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7298.635907][ C1] __run_timers.part.0+0x52d/0x890 [ 7298.636168][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7298.636442][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7298.636728][ C1] ? lock_acquire+0x1c1/0x220 [ 7298.636966][ C1] ? clockevents_program_event+0xf6/0x300 [ 7298.637259][ C1] ? lock_release+0x1d5/0x250 [ 7298.637499][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7298.637764][ C1] ? ktime_get+0xb3/0x190 [ 7298.637984][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7298.638281][ C1] run_timer_softirq+0x72/0x100 [ 7298.638531][ C1] __do_softirq+0x1b9/0x7ff [ 7298.638762][ C1] irq_exit_rcu+0x98/0xc0 [ 7298.638985][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7298.639270][ C1] [ 7298.639421][ C1] [ 7298.639572][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7298.639878][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7298.640204][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7298.641178][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7298.641487][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7298.641886][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7298.642286][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7298.642685][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7298.643088][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7298.643491][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7298.643788][ C1] pipe_read+0xa16/0xdf0 [ 7298.644009][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7298.644286][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7298.644530][ C1] ? iterate_tty_write+0x299/0x540 [ 7298.644794][ C1] ? lock_release+0x1d5/0x250 [ 7298.645036][ C1] vfs_read+0x911/0xc00 [ 7298.645249][ C1] ? lock_acquire+0x1c1/0x220 [ 7298.645489][ C1] ? __might_fault+0xc6/0x180 [ 7298.645731][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7298.645969][ C1] ? __might_fault+0xc6/0x180 [ 7298.646210][ C1] ? lock_release+0x1d5/0x250 [ 7298.646451][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7298.646717][ C1] ? __fget_light+0x54/0x1e0 [ 7298.646956][ C1] ksys_read+0x17a/0x1e0 [ 7298.647173][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7298.647419][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7298.647724][ C1] do_syscall_64+0xc9/0x1e0 [ 7298.647956][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7298.648258][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7298.648486][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7298.649463][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7298.649886][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7298.650287][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7298.650689][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7298.651089][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7298.651488][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7298.651891][ C1] [ 7298.652050][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7298.652322][ C2] NMI backtrace for cpu 2 [ 7298.652327][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7298.652333][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7298.652336][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7298.652344][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7298.652350][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7298.652353][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7298.652355][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7298.652356][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7298.652358][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7298.652359][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7298.652361][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7298.652363][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7298.652367][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7298.652368][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7298.652369][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7298.652371][ C2] PKRU: 55555554 [ 7298.652372][ C2] Call Trace: [ 7298.652374][ C2] [ 7298.652375][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7298.652381][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7298.652386][ C2] ? nmi_handle+0x153/0x420 [ 7298.652390][ C2] ? default_do_nmi+0x41/0x100 [ 7298.652392][ C2] ? exc_nmi+0xf3/0x120 [ 7298.652395][ C2] ? end_repeat_nmi+0xf/0x60 [ 7298.652400][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7298.652403][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7298.652406][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7298.652409][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7298.652412][ C2] [ 7298.652413][ C2] [ 7298.652415][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7298.652417][ C2] ? get_stack_info+0x36/0xc0 [ 7298.652422][ C2] ? lock_acquire+0x1c1/0x220 [ 7298.652425][ C2] ? lock_release+0x1d5/0x250 [ 7298.652428][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7298.652432][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7298.652435][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7298.652438][ C2] ? lock_acquire+0x1c1/0x220 [ 7298.652440][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7298.652443][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7298.652446][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7298.652452][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7298.652455][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7298.652459][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7298.652463][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7298.652466][ C2] ip_local_deliver+0x19d/0x480 [ 7298.652469][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7298.652471][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7298.652473][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7298.652478][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7298.652481][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7298.652484][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7298.652493][ C2] ip_rcv+0x564/0x740 [ 7298.652495][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7298.652497][ C2] ? set_track_prepare+0x8a/0xd0 [ 7298.652501][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7298.652504][ C2] ? start_secondary+0x21c/0x2b0 [ 7298.652507][ C2] ? skb_clone+0x10b/0x330 [ 7298.652510][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7298.652515][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7298.652521][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7298.652524][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7298.652532][ C2] ? __tcf_classify+0x329/0x7d0 [ 7298.652536][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7298.652538][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7298.652541][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7298.652544][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7298.652548][ C2] ? lock_acquire+0x1c1/0x220 [ 7298.652551][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7298.652555][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7298.652558][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7298.652562][ C2] ? __copy_skb_header+0xaf/0x490 [ 7298.652566][ C2] ? __skb_clone+0x57a/0x760 [ 7298.652569][ C2] netif_receive_skb+0x55/0x280 [ 7298.652572][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7298.652578][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7298.652585][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7298.652591][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7298.652596][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7298.652606][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7298.652613][ C2] ? get_stack_info+0x36/0xc0 [ 7298.652618][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7298.652620][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7298.652624][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7298.652626][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7298.652630][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7298.652632][ C2] ? kernel_text_address+0x17/0xe0 [ 7298.652635][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7298.652638][ C2] ? arch_stack_walk+0x8c/0x100 [ 7298.652642][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7298.652645][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7298.652649][ C2] ? lock_acquire+0x1c1/0x220 [ 7298.652651][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7298.652655][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7298.652658][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7298.652661][ C2] ? get_stack_info+0x36/0xc0 [ 7298.652665][ C2] __tcf_classify+0x329/0x7d0 [ 7298.652670][ C2] tcf_classify+0x283/0x930 [ 7298.652674][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7298.652678][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7298.652682][ C2] tc_run+0x2e4/0x5d0 [ 7298.652685][ C2] ? __pfx_tc_run+0x10/0x10 [ 7298.652688][ C2] ? lock_acquire+0x1c1/0x220 [ 7298.652690][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7298.652694][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7298.652698][ C2] ? lock_acquire+0x1c1/0x220 [ 7298.652700][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7298.652703][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7298.652706][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7298.652709][ C2] ? neigh_hh_output+0x348/0x590 [ 7298.652713][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7298.652716][ C2] ip_finish_output2+0x786/0x18e0 [ 7298.652720][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7298.652727][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7298.652729][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7298.652734][ C2] ? __ip_finish_output+0x10f/0x770 [ 7298.652737][ C2] ip_output+0x16b/0x4f0 [ 7298.652740][ C2] ? __pfx_ip_output+0x10/0x10 [ 7298.652742][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7298.652745][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7298.652749][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7298.652751][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7298.652754][ C2] ? __alloc_skb+0xd4/0x280 [ 7298.652756][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7298.652760][ C2] ? tcp_fragment+0x168/0x1040 [ 7298.652763][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7298.652766][ C2] ? ip_local_out+0x114/0x3b0 [ 7298.652769][ C2] __ip_queue_xmit+0x672/0x1910 [ 7298.652773][ C2] ? __skb_clone+0x57a/0x760 [ 7298.652775][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7298.652780][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7298.652783][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7298.652787][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7298.652791][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7298.652795][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7298.652798][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7298.652801][ C2] tcp_send_loss_probe+0x348/0x830 [ 7298.652804][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7298.652807][ C2] tcp_write_timer+0x82/0x1d0 [ 7298.652810][ C2] call_timer_fn+0x173/0x430 [ 7298.652814][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7298.652818][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7298.652822][ C2] __run_timers.part.0+0x52d/0x890 [ 7298.652825][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7298.652829][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7298.652832][ C2] ? lock_acquire+0x1c1/0x220 [ 7298.652834][ C2] ? clockevents_program_event+0xf6/0x300 [ 7298.652838][ C2] ? lock_release+0x1d5/0x250 [ 7298.652841][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7298.652844][ C2] ? ktime_get+0xb3/0x190 [ 7298.652848][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7298.652852][ C2] run_timer_softirq+0x72/0x100 [ 7298.652855][ C2] __do_softirq+0x1b9/0x7ff [ 7298.652860][ C2] irq_exit_rcu+0x98/0xc0 [ 7298.652862][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7298.652865][ C2] [ 7298.652866][ C2] [ 7298.652867][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7298.652870][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7298.652873][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7298.652875][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7298.652877][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7298.652879][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7298.652880][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7298.652881][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7298.652883][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7298.652886][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7298.652889][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7298.652892][ C2] default_idle_call+0x69/0xa0 [ 7298.652895][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7298.652897][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7298.652901][ C2] ? lock_release+0x1d5/0x250 [ 7298.652903][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7298.652907][ C2] do_idle+0xfb/0x160 [ 7298.652909][ C2] cpu_startup_entry+0x55/0x60 [ 7298.652912][ C2] start_secondary+0x21c/0x2b0 [ 7298.652915][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7298.652919][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7298.652924][ C2] [ 7324.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4630s! [perl:4135] [ 7324.569689][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7324.570922][ C1] irq event stamp: 209232 [ 7324.571135][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7324.571651][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7324.572118][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7324.572575][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7324.573026][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7324.573465][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7324.574065][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7324.574378][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7324.575369][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7324.575678][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7324.576077][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7324.576467][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7324.576857][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7324.577249][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7324.577639][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7324.578077][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7324.578402][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7324.578795][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7324.579186][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7324.579575][ C1] PKRU: 55555554 [ 7324.579753][ C1] Call Trace: [ 7324.579921][ C1] [ 7324.580066][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7324.580322][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7324.580560][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7324.580830][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7324.581096][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7324.581381][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7324.581640][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7324.581940][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7324.582200][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7324.582503][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7324.582791][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7324.583099][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7324.583383][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7324.583664][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7324.583947][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7324.584250][ C1] ? get_stack_info+0x36/0xc0 [ 7324.584506][ C1] ? lock_acquire+0x1c1/0x220 [ 7324.584748][ C1] ? lock_release+0x1d5/0x250 [ 7324.584989][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7324.585240][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7324.585513][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7324.585804][ C1] ? lock_acquire+0x1c1/0x220 [ 7324.586039][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7324.586276][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7324.586531][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7324.586760][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7324.587001][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7324.587253][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7324.587526][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7324.587797][ C1] ip_local_deliver+0x19d/0x480 [ 7324.588039][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7324.588305][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7324.588562][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7324.588902][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7324.589149][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7324.589462][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7324.589720][ C1] ip_rcv+0x564/0x740 [ 7324.589921][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7324.590145][ C1] ? set_track_prepare+0x8a/0xd0 [ 7324.590410][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7324.590689][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7324.590963][ C1] ? skb_clone+0x10b/0x330 [ 7324.591191][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7324.591513][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7324.591821][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7324.592103][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7324.592400][ C1] ? __tcf_classify+0x329/0x7d0 [ 7324.592651][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7324.592882][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7324.593184][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7324.593472][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7324.593799][ C1] ? lock_acquire+0x1c1/0x220 [ 7324.594036][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7324.594335][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7324.594626][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7324.594944][ C1] ? __copy_skb_header+0xaf/0x490 [ 7324.595202][ C1] ? __skb_clone+0x57a/0x760 [ 7324.595439][ C1] netif_receive_skb+0x55/0x280 [ 7324.595688][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7324.596003][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7324.596337][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7324.596638][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7324.596915][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7324.597204][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7324.597518][ C1] ? hlock_class+0x4e/0x130 [ 7324.597752][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7324.598030][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7324.598307][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7324.598571][ C1] ? hlock_class+0x4e/0x130 [ 7324.598805][ C1] ? mark_lock+0x38/0x3e0 [ 7324.599024][ C1] ? stack_access_ok+0xda/0x1f0 [ 7324.599275][ C1] ? __lock_acquire+0xb67/0x1610 [ 7324.599529][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7324.599807][ C1] ? get_stack_info+0x36/0xc0 [ 7324.600048][ C1] ? stack_access_ok+0xda/0x1f0 [ 7324.600297][ C1] ? get_reg+0x119/0x190 [ 7324.600515][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7324.600786][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7324.601095][ C1] __tcf_classify+0x329/0x7d0 [ 7324.601338][ C1] tcf_classify+0x283/0x930 [ 7324.601573][ C1] ? arch_stack_walk+0xa2/0x100 [ 7324.601823][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7324.602082][ C1] ? get_stack_info+0x36/0xc0 [ 7324.602323][ C1] tc_run+0x2e4/0x5d0 [ 7324.602530][ C1] ? __pfx_tc_run+0x10/0x10 [ 7324.602761][ C1] ? lock_acquire+0x1c1/0x220 [ 7324.603002][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7324.603264][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7324.603518][ C1] ? lock_acquire+0x1c1/0x220 [ 7324.603760][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7324.604025][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7324.604333][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7324.604609][ C1] ? neigh_hh_output+0x348/0x590 [ 7324.604864][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7324.605130][ C1] ip_finish_output2+0x786/0x18e0 [ 7324.605388][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7324.605666][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7324.606006][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7324.606285][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7324.606540][ C1] ? __ip_finish_output+0x10f/0x770 [ 7324.606808][ C1] ip_output+0x16b/0x4f0 [ 7324.607024][ C1] ? run_timer_softirq+0x72/0x100 [ 7324.607283][ C1] ? __pfx_ip_output+0x10/0x10 [ 7324.607528][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7324.607815][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7324.608068][ C1] ? ip_local_out+0x114/0x3b0 [ 7324.608309][ C1] __ip_queue_xmit+0x672/0x1910 [ 7324.608560][ C1] ? __create_object+0x5e/0xb0 [ 7324.608807][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7324.609075][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7324.609357][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7324.609633][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7324.609916][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7324.610189][ C1] tcp_delack_timer+0x84/0x240 [ 7324.610435][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7324.610707][ C1] call_timer_fn+0x173/0x430 [ 7324.610945][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7324.611208][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7324.611471][ C1] __run_timers.part.0+0x52d/0x890 [ 7324.611732][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7324.612009][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7324.612297][ C1] ? lock_acquire+0x1c1/0x220 [ 7324.612537][ C1] ? clockevents_program_event+0xf6/0x300 [ 7324.612828][ C1] ? lock_release+0x1d5/0x250 [ 7324.613069][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7324.613334][ C1] ? ktime_get+0xb3/0x190 [ 7324.613555][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7324.613853][ C1] run_timer_softirq+0x72/0x100 [ 7324.614103][ C1] __do_softirq+0x1b9/0x7ff [ 7324.614337][ C1] irq_exit_rcu+0x98/0xc0 [ 7324.614560][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7324.614848][ C1] [ 7324.615001][ C1] [ 7324.615151][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7324.615457][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7324.615783][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7324.616756][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7324.617066][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7324.617466][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7324.617867][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7324.618270][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7324.618670][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7324.619072][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7324.619371][ C1] pipe_read+0xa16/0xdf0 [ 7324.619591][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7324.619870][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7324.620114][ C1] ? iterate_tty_write+0x299/0x540 [ 7324.620377][ C1] ? lock_release+0x1d5/0x250 [ 7324.620620][ C1] vfs_read+0x911/0xc00 [ 7324.620834][ C1] ? lock_acquire+0x1c1/0x220 [ 7324.621074][ C1] ? __might_fault+0xc6/0x180 [ 7324.621316][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7324.621557][ C1] ? __might_fault+0xc6/0x180 [ 7324.621796][ C1] ? lock_release+0x1d5/0x250 [ 7324.622037][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7324.622302][ C1] ? __fget_light+0x54/0x1e0 [ 7324.622541][ C1] ksys_read+0x17a/0x1e0 [ 7324.622758][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7324.623005][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7324.623311][ C1] do_syscall_64+0xc9/0x1e0 [ 7324.623545][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7324.623844][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7324.624075][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7324.625051][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7324.625474][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7324.625876][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7324.626277][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7324.626675][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7324.627076][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7324.627480][ C1] [ 7324.627637][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4630s! [swapper/2:0] [ 7324.628054][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7324.629300][ C2] irq event stamp: 44114564 [ 7324.629530][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7324.630060][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7324.630568][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7324.631044][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7324.631508][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7324.631961][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7324.632571][ C2] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 7324.632855][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 7324.633820][ C2] RSP: 0018:ffffc9000021fa80 EFLAGS: 00000286 [ 7324.634126][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7324.634530][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7324.634931][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7324.635327][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7324.635722][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7324.636117][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7324.636559][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7324.636891][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7324.637290][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7324.637686][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7324.638081][ C2] PKRU: 55555554 [ 7324.638263][ C2] Call Trace: [ 7324.638433][ C2] [ 7324.638579][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7324.638838][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7324.639080][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7324.639356][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7324.639628][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7324.639912][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7324.640174][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7324.640478][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7324.640736][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7324.640995][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7324.641302][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7324.641594][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7324.641905][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7324.642196][ C2] ? kasan_check_range+0x1a/0x1c0 [ 7324.642450][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 7324.642728][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7324.643037][ C2] ? get_stack_info+0x36/0xc0 [ 7324.643277][ C2] ? lock_acquire+0x1c1/0x220 [ 7324.643516][ C2] ? lock_release+0x1d5/0x250 [ 7324.643754][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7324.643999][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7324.644273][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7324.644558][ C2] ? lock_acquire+0x1c1/0x220 [ 7324.644795][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7324.645034][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7324.645293][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7324.645524][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7324.645770][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7324.646025][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7324.646295][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7324.646572][ C2] ip_local_deliver+0x19d/0x480 [ 7324.646818][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7324.647088][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7324.647349][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7324.647692][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7324.647943][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7324.648260][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7324.648521][ C2] ip_rcv+0x564/0x740 [ 7324.648724][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7324.648954][ C2] ? set_track_prepare+0x8a/0xd0 [ 7324.649205][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7324.649479][ C2] ? start_secondary+0x21c/0x2b0 [ 7324.649729][ C2] ? skb_clone+0x10b/0x330 [ 7324.649956][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7324.650274][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7324.650576][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7324.650856][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7324.651147][ C2] ? __tcf_classify+0x329/0x7d0 [ 7324.651393][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7324.651624][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7324.651923][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7324.652206][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7324.652529][ C2] ? lock_acquire+0x1c1/0x220 [ 7324.652767][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7324.653059][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7324.653343][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7324.653658][ C2] ? __copy_skb_header+0xaf/0x490 [ 7324.653914][ C2] ? __skb_clone+0x57a/0x760 [ 7324.654147][ C2] netif_receive_skb+0x55/0x280 [ 7324.654392][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7324.654705][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7324.655034][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7324.655333][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7324.655605][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7324.655892][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7324.656200][ C2] ? get_stack_info+0x36/0xc0 [ 7324.656441][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7324.656702][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7324.657017][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7324.657292][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7324.657568][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7324.657881][ C2] ? kernel_text_address+0x17/0xe0 [ 7324.658140][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7324.658451][ C2] ? arch_stack_walk+0x8c/0x100 [ 7324.658697][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7324.658960][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7324.659241][ C2] ? lock_acquire+0x1c1/0x220 [ 7324.659479][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7324.659758][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7324.660062][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7324.660335][ C2] ? get_stack_info+0x36/0xc0 [ 7324.660575][ C2] __tcf_classify+0x329/0x7d0 [ 7324.660816][ C2] tcf_classify+0x283/0x930 [ 7324.661046][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7324.661301][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7324.661611][ C2] tc_run+0x2e4/0x5d0 [ 7324.661815][ C2] ? __pfx_tc_run+0x10/0x10 [ 7324.662043][ C2] ? lock_acquire+0x1c1/0x220 [ 7324.662281][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7324.662541][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7324.662791][ C2] ? lock_acquire+0x1c1/0x220 [ 7324.663029][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7324.663291][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7324.663591][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7324.663862][ C2] ? neigh_hh_output+0x348/0x590 [ 7324.664113][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7324.664377][ C2] ip_finish_output2+0x786/0x18e0 [ 7324.664636][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7324.664971][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7324.665244][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7324.665499][ C2] ? __ip_finish_output+0x10f/0x770 [ 7324.665761][ C2] ip_output+0x16b/0x4f0 [ 7324.665979][ C2] ? __pfx_ip_output+0x10/0x10 [ 7324.666222][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7324.666496][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7324.666806][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7324.667079][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7324.667328][ C2] ? __alloc_skb+0xd4/0x280 [ 7324.667558][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7324.667825][ C2] ? tcp_fragment+0x168/0x1040 [ 7324.668067][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7324.668317][ C2] ? ip_local_out+0x114/0x3b0 [ 7324.668553][ C2] __ip_queue_xmit+0x672/0x1910 [ 7324.668800][ C2] ? __skb_clone+0x57a/0x760 [ 7324.669034][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7324.669299][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7324.669575][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7324.669819][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7324.670066][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7324.670365][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7324.670684][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7324.670926][ C2] tcp_send_loss_probe+0x348/0x830 [ 7324.671185][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7324.671454][ C2] tcp_write_timer+0x82/0x1d0 [ 7324.671692][ C2] call_timer_fn+0x173/0x430 [ 7324.671925][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7324.672186][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7324.672445][ C2] __run_timers.part.0+0x52d/0x890 [ 7324.672704][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7324.672972][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7324.673254][ C2] ? lock_acquire+0x1c1/0x220 [ 7324.673492][ C2] ? clockevents_program_event+0xf6/0x300 [ 7324.673778][ C2] ? lock_release+0x1d5/0x250 [ 7324.674016][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7324.674278][ C2] ? ktime_get+0xb3/0x190 [ 7324.674501][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7324.674794][ C2] run_timer_softirq+0x72/0x100 [ 7324.675041][ C2] __do_softirq+0x1b9/0x7ff [ 7324.675272][ C2] irq_exit_rcu+0x98/0xc0 [ 7324.675489][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7324.675774][ C2] [ 7324.675922][ C2] [ 7324.676071][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7324.676374][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7324.676628][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7324.677588][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7324.677894][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7324.678289][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7324.678687][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7324.679083][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7324.679477][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7324.679872][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7324.680161][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7324.680419][ C2] default_idle_call+0x69/0xa0 [ 7324.680661][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7324.680911][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7324.681185][ C2] ? lock_release+0x1d5/0x250 [ 7324.681422][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7324.681693][ C2] do_idle+0xfb/0x160 [ 7324.681895][ C2] cpu_startup_entry+0x55/0x60 [ 7324.682137][ C2] start_secondary+0x21c/0x2b0 [ 7324.682379][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7324.682646][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7324.682955][ C2] [ 7352.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4656s! [perl:4135] [ 7352.569683][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7352.570906][ C1] irq event stamp: 209232 [ 7352.571118][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7352.571632][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7352.572100][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7352.572555][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7352.573005][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7352.573442][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7352.574041][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7352.574357][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7352.575342][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7352.575659][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7352.576047][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7352.576436][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7352.576825][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7352.577216][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7352.577604][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7352.578041][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7352.578365][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7352.578756][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7352.579148][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7352.579535][ C1] PKRU: 55555554 [ 7352.579713][ C1] Call Trace: [ 7352.579883][ C1] [ 7352.580027][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7352.580282][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7352.580521][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7352.580790][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7352.581055][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7352.581340][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7352.581599][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7352.581899][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7352.582155][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7352.582457][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7352.582744][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7352.583051][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7352.583334][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7352.583616][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7352.583899][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7352.584202][ C1] ? get_stack_info+0x36/0xc0 [ 7352.584458][ C1] ? lock_acquire+0x1c1/0x220 [ 7352.584700][ C1] ? lock_release+0x1d5/0x250 [ 7352.584941][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7352.585190][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7352.585464][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7352.585752][ C1] ? lock_acquire+0x1c1/0x220 [ 7352.585985][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7352.586222][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7352.586475][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7352.586703][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7352.586945][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7352.587196][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7352.587467][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7352.587738][ C1] ip_local_deliver+0x19d/0x480 [ 7352.587980][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7352.588246][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7352.588503][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7352.588843][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7352.589090][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7352.589405][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7352.589663][ C1] ip_rcv+0x564/0x740 [ 7352.589864][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7352.590089][ C1] ? set_track_prepare+0x8a/0xd0 [ 7352.590337][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7352.590628][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7352.590903][ C1] ? skb_clone+0x10b/0x330 [ 7352.591129][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7352.591450][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7352.591760][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7352.592041][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7352.592340][ C1] ? __tcf_classify+0x329/0x7d0 [ 7352.592593][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7352.592823][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7352.593125][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7352.593411][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7352.593739][ C1] ? lock_acquire+0x1c1/0x220 [ 7352.593977][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7352.594277][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7352.594566][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7352.594886][ C1] ? __copy_skb_header+0xaf/0x490 [ 7352.595144][ C1] ? __skb_clone+0x57a/0x760 [ 7352.595381][ C1] netif_receive_skb+0x55/0x280 [ 7352.595631][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7352.595946][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7352.596280][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7352.596580][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7352.596858][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7352.597145][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7352.597460][ C1] ? hlock_class+0x4e/0x130 [ 7352.597693][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7352.597972][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7352.598249][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7352.598513][ C1] ? hlock_class+0x4e/0x130 [ 7352.598747][ C1] ? mark_lock+0x38/0x3e0 [ 7352.598966][ C1] ? stack_access_ok+0xda/0x1f0 [ 7352.599217][ C1] ? __lock_acquire+0xb67/0x1610 [ 7352.599472][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7352.599750][ C1] ? get_stack_info+0x36/0xc0 [ 7352.599992][ C1] ? stack_access_ok+0xda/0x1f0 [ 7352.600240][ C1] ? get_reg+0x119/0x190 [ 7352.600457][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7352.600731][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7352.601041][ C1] __tcf_classify+0x329/0x7d0 [ 7352.601284][ C1] tcf_classify+0x283/0x930 [ 7352.601518][ C1] ? arch_stack_walk+0xa2/0x100 [ 7352.601768][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7352.602027][ C1] ? get_stack_info+0x36/0xc0 [ 7352.602268][ C1] tc_run+0x2e4/0x5d0 [ 7352.602476][ C1] ? __pfx_tc_run+0x10/0x10 [ 7352.602706][ C1] ? lock_acquire+0x1c1/0x220 [ 7352.602947][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7352.603208][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7352.603462][ C1] ? lock_acquire+0x1c1/0x220 [ 7352.603703][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7352.603969][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7352.604277][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7352.604557][ C1] ? neigh_hh_output+0x348/0x590 [ 7352.604810][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7352.605076][ C1] ip_finish_output2+0x786/0x18e0 [ 7352.605334][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7352.605612][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7352.605951][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7352.606231][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7352.606485][ C1] ? __ip_finish_output+0x10f/0x770 [ 7352.606752][ C1] ip_output+0x16b/0x4f0 [ 7352.606968][ C1] ? run_timer_softirq+0x72/0x100 [ 7352.607227][ C1] ? __pfx_ip_output+0x10/0x10 [ 7352.607471][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7352.607760][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7352.608013][ C1] ? ip_local_out+0x114/0x3b0 [ 7352.608256][ C1] __ip_queue_xmit+0x672/0x1910 [ 7352.608509][ C1] ? __create_object+0x5e/0xb0 [ 7352.608755][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7352.609023][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7352.609306][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7352.609582][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7352.609865][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7352.610139][ C1] tcp_delack_timer+0x84/0x240 [ 7352.610384][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7352.610657][ C1] call_timer_fn+0x173/0x430 [ 7352.610895][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7352.611158][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7352.611420][ C1] __run_timers.part.0+0x52d/0x890 [ 7352.611682][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7352.611956][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7352.612245][ C1] ? lock_acquire+0x1c1/0x220 [ 7352.612485][ C1] ? clockevents_program_event+0xf6/0x300 [ 7352.612776][ C1] ? lock_release+0x1d5/0x250 [ 7352.613017][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7352.613283][ C1] ? ktime_get+0xb3/0x190 [ 7352.613504][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7352.613804][ C1] run_timer_softirq+0x72/0x100 [ 7352.614055][ C1] __do_softirq+0x1b9/0x7ff [ 7352.614289][ C1] irq_exit_rcu+0x98/0xc0 [ 7352.614514][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7352.614800][ C1] [ 7352.614954][ C1] [ 7352.615105][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7352.615412][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7352.615739][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7352.616715][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7352.617025][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7352.617427][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7352.617826][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7352.618230][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7352.618632][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7352.619033][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7352.619333][ C1] pipe_read+0xa16/0xdf0 [ 7352.619554][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7352.619836][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7352.620081][ C1] ? iterate_tty_write+0x299/0x540 [ 7352.620343][ C1] ? lock_release+0x1d5/0x250 [ 7352.620586][ C1] vfs_read+0x911/0xc00 [ 7352.620800][ C1] ? lock_acquire+0x1c1/0x220 [ 7352.621042][ C1] ? __might_fault+0xc6/0x180 [ 7352.621286][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7352.621527][ C1] ? __might_fault+0xc6/0x180 [ 7352.621766][ C1] ? lock_release+0x1d5/0x250 [ 7352.622008][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7352.622273][ C1] ? __fget_light+0x54/0x1e0 [ 7352.622512][ C1] ksys_read+0x17a/0x1e0 [ 7352.622730][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7352.622977][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7352.623284][ C1] do_syscall_64+0xc9/0x1e0 [ 7352.623517][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7352.623817][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7352.624047][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7352.625027][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7352.625451][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7352.625854][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7352.626253][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7352.626653][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7352.627055][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7352.627460][ C1] [ 7352.627616][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4656s! [swapper/2:0] [ 7352.628025][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7352.629263][ C2] irq event stamp: 44114564 [ 7352.629492][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7352.630021][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7352.630530][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7352.631002][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7352.631471][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7352.631924][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7352.632534][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7352.632857][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7352.633823][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7352.634126][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7352.634529][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7352.634925][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7352.635319][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7352.635715][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7352.636112][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7352.636556][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7352.636885][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7352.637281][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7352.637678][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7352.638074][ C2] PKRU: 55555554 [ 7352.638255][ C2] Call Trace: [ 7352.638421][ C2] [ 7352.638568][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7352.638829][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7352.639070][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7352.639345][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7352.639615][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7352.639904][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7352.640168][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7352.640470][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7352.640730][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7352.640991][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7352.641295][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7352.641592][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7352.641905][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7352.642191][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7352.642486][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7352.642772][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7352.643080][ C2] ? get_stack_info+0x36/0xc0 [ 7352.643319][ C2] ? lock_acquire+0x1c1/0x220 [ 7352.643560][ C2] ? lock_release+0x1d5/0x250 [ 7352.643798][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7352.644044][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7352.644317][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7352.644601][ C2] ? lock_acquire+0x1c1/0x220 [ 7352.644840][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7352.645079][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7352.645338][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7352.645569][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7352.645814][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7352.646069][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7352.646342][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7352.646618][ C2] ip_local_deliver+0x19d/0x480 [ 7352.646864][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7352.647135][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7352.647396][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7352.647743][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7352.647994][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7352.648311][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7352.648571][ C2] ip_rcv+0x564/0x740 [ 7352.648776][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7352.649004][ C2] ? set_track_prepare+0x8a/0xd0 [ 7352.649255][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7352.649529][ C2] ? start_secondary+0x21c/0x2b0 [ 7352.649779][ C2] ? skb_clone+0x10b/0x330 [ 7352.650005][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7352.650322][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7352.650626][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7352.650904][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7352.651196][ C2] ? __tcf_classify+0x329/0x7d0 [ 7352.651442][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7352.651672][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7352.651969][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7352.652252][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7352.652574][ C2] ? lock_acquire+0x1c1/0x220 [ 7352.652812][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7352.653106][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7352.653389][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7352.653704][ C2] ? __copy_skb_header+0xaf/0x490 [ 7352.653959][ C2] ? __skb_clone+0x57a/0x760 [ 7352.654193][ C2] netif_receive_skb+0x55/0x280 [ 7352.654444][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7352.654752][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7352.655083][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7352.655380][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7352.655652][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7352.655939][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7352.656248][ C2] ? get_stack_info+0x36/0xc0 [ 7352.656486][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7352.656748][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7352.657062][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7352.657339][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7352.657613][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7352.657925][ C2] ? kernel_text_address+0x17/0xe0 [ 7352.658183][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7352.658495][ C2] ? arch_stack_walk+0x8c/0x100 [ 7352.658742][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7352.659004][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7352.659287][ C2] ? lock_acquire+0x1c1/0x220 [ 7352.659524][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7352.659802][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7352.660105][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7352.660380][ C2] ? get_stack_info+0x36/0xc0 [ 7352.660618][ C2] __tcf_classify+0x329/0x7d0 [ 7352.660859][ C2] tcf_classify+0x283/0x930 [ 7352.661090][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7352.661346][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7352.661657][ C2] tc_run+0x2e4/0x5d0 [ 7352.661861][ C2] ? __pfx_tc_run+0x10/0x10 [ 7352.662089][ C2] ? lock_acquire+0x1c1/0x220 [ 7352.662328][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7352.662587][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7352.662837][ C2] ? lock_acquire+0x1c1/0x220 [ 7352.663075][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7352.663338][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7352.663640][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7352.663911][ C2] ? neigh_hh_output+0x348/0x590 [ 7352.664162][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7352.664426][ C2] ip_finish_output2+0x786/0x18e0 [ 7352.664681][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7352.665016][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7352.665290][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7352.665541][ C2] ? __ip_finish_output+0x10f/0x770 [ 7352.665806][ C2] ip_output+0x16b/0x4f0 [ 7352.666022][ C2] ? __pfx_ip_output+0x10/0x10 [ 7352.666264][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7352.666538][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7352.666849][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7352.667122][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7352.667372][ C2] ? __alloc_skb+0xd4/0x280 [ 7352.667602][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7352.667868][ C2] ? tcp_fragment+0x168/0x1040 [ 7352.668111][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7352.668362][ C2] ? ip_local_out+0x114/0x3b0 [ 7352.668599][ C2] __ip_queue_xmit+0x672/0x1910 [ 7352.668846][ C2] ? __skb_clone+0x57a/0x760 [ 7352.669080][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7352.669344][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7352.669623][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7352.669865][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7352.670113][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7352.670412][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7352.670730][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7352.670972][ C2] tcp_send_loss_probe+0x348/0x830 [ 7352.671231][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7352.671497][ C2] tcp_write_timer+0x82/0x1d0 [ 7352.671736][ C2] call_timer_fn+0x173/0x430 [ 7352.671968][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7352.672230][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7352.672490][ C2] __run_timers.part.0+0x52d/0x890 [ 7352.672748][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7352.673017][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7352.673300][ C2] ? lock_acquire+0x1c1/0x220 [ 7352.673537][ C2] ? clockevents_program_event+0xf6/0x300 [ 7352.673825][ C2] ? lock_release+0x1d5/0x250 [ 7352.674061][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7352.674323][ C2] ? ktime_get+0xb3/0x190 [ 7352.674553][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7352.674846][ C2] run_timer_softirq+0x72/0x100 [ 7352.675093][ C2] __do_softirq+0x1b9/0x7ff [ 7352.675325][ C2] irq_exit_rcu+0x98/0xc0 [ 7352.675542][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7352.675826][ C2] [ 7352.675974][ C2] [ 7352.676124][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7352.676425][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7352.676680][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7352.677640][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7352.677946][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7352.678341][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7352.678737][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7352.679133][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7352.679530][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7352.679927][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7352.680215][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7352.680473][ C2] default_idle_call+0x69/0xa0 [ 7352.680715][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7352.680966][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7352.681240][ C2] ? lock_release+0x1d5/0x250 [ 7352.681478][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7352.681749][ C2] do_idle+0xfb/0x160 [ 7352.681950][ C2] cpu_startup_entry+0x55/0x60 [ 7352.682191][ C2] start_secondary+0x21c/0x2b0 [ 7352.682433][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7352.682700][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7352.683008][ C2] [ 7376.652103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7376.652449][ C1] rcu: 1-....: (5009668 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1227954 [ 7376.652992][ C1] rcu: (t=5021765 jiffies g=1882453 q=721 ncpus=4) [ 7376.653316][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7376.653752][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7376.654370][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 7376.654652][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 7376.655629][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 7376.655927][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7376.656317][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7376.656705][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7376.657092][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7376.657482][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7376.657871][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7376.658305][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7376.658628][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7376.659018][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7376.659404][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7376.659795][ C1] PKRU: 55555554 [ 7376.659970][ C1] Call Trace: [ 7376.660135][ C1] [ 7376.660279][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7376.660546][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7376.660791][ C1] ? check_cpu_stall+0x284/0x500 [ 7376.661037][ C1] ? rcu_pending+0x92/0x360 [ 7376.661260][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7376.661521][ C1] ? update_process_times+0xb9/0x110 [ 7376.661785][ C1] ? tick_sched_handle+0x67/0x130 [ 7376.662035][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7376.662312][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7376.662548][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7376.662852][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7376.663117][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7376.663397][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7376.663656][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7376.663951][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7376.664206][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7376.664532][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7376.664827][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7376.665141][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7376.665429][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 7376.665714][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7376.665987][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7376.666291][ C1] ? get_stack_info+0x36/0xc0 [ 7376.666525][ C1] ? lock_acquire+0x1c1/0x220 [ 7376.666757][ C1] ? lock_release+0x1d5/0x250 [ 7376.666992][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7376.667235][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7376.667499][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7376.667778][ C1] ? lock_acquire+0x1c1/0x220 [ 7376.668007][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7376.668242][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7376.668495][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7376.668724][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7376.668965][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7376.669216][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7376.669483][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7376.669752][ C1] ip_local_deliver+0x19d/0x480 [ 7376.669993][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7376.670258][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7376.670516][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7376.670857][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7376.671104][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7376.671417][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7376.671674][ C1] ip_rcv+0x564/0x740 [ 7376.671872][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7376.672099][ C1] ? set_track_prepare+0x8a/0xd0 [ 7376.672346][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7376.672615][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7376.672881][ C1] ? skb_clone+0x10b/0x330 [ 7376.673104][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7376.673415][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7376.673712][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7376.673990][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7376.674296][ C1] ? __tcf_classify+0x329/0x7d0 [ 7376.674545][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7376.674777][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7376.675077][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7376.675365][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7376.675695][ C1] ? lock_acquire+0x1c1/0x220 [ 7376.675929][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7376.676216][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7376.676515][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7376.676833][ C1] ? __copy_skb_header+0xaf/0x490 [ 7376.677091][ C1] ? __skb_clone+0x57a/0x760 [ 7376.677324][ C1] netif_receive_skb+0x55/0x280 [ 7376.677574][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7376.677888][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7376.678220][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7376.678521][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7376.678796][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7376.679084][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7376.679397][ C1] ? hlock_class+0x4e/0x130 [ 7376.679632][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7376.679908][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7376.680185][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7376.680450][ C1] ? hlock_class+0x4e/0x130 [ 7376.680681][ C1] ? mark_lock+0x38/0x3e0 [ 7376.680903][ C1] ? stack_access_ok+0xda/0x1f0 [ 7376.681152][ C1] ? __lock_acquire+0xb67/0x1610 [ 7376.681406][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7376.681684][ C1] ? get_stack_info+0x36/0xc0 [ 7376.681924][ C1] ? stack_access_ok+0xda/0x1f0 [ 7376.682171][ C1] ? get_reg+0x119/0x190 [ 7376.682390][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7376.682659][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7376.682970][ C1] __tcf_classify+0x329/0x7d0 [ 7376.683213][ C1] tcf_classify+0x283/0x930 [ 7376.683444][ C1] ? arch_stack_walk+0xa2/0x100 [ 7376.683694][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7376.683950][ C1] ? get_stack_info+0x36/0xc0 [ 7376.684193][ C1] tc_run+0x2e4/0x5d0 [ 7376.684402][ C1] ? __pfx_tc_run+0x10/0x10 [ 7376.684635][ C1] ? lock_acquire+0x1c1/0x220 [ 7376.684871][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7376.685135][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7376.685388][ C1] ? lock_acquire+0x1c1/0x220 [ 7376.685629][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7376.685893][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7376.686199][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7376.686472][ C1] ? neigh_hh_output+0x348/0x590 [ 7376.686726][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7376.686993][ C1] ip_finish_output2+0x786/0x18e0 [ 7376.687250][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7376.687531][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7376.687869][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7376.688146][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7376.688399][ C1] ? __ip_finish_output+0x10f/0x770 [ 7376.688664][ C1] ip_output+0x16b/0x4f0 [ 7376.688882][ C1] ? run_timer_softirq+0x72/0x100 [ 7376.689140][ C1] ? __pfx_ip_output+0x10/0x10 [ 7376.689382][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7376.689670][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7376.689923][ C1] ? ip_local_out+0x114/0x3b0 [ 7376.690163][ C1] __ip_queue_xmit+0x672/0x1910 [ 7376.690411][ C1] ? __create_object+0x5e/0xb0 [ 7376.690657][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7376.690925][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7376.691209][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7376.691483][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7376.691764][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7376.692039][ C1] tcp_delack_timer+0x84/0x240 [ 7376.692283][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7376.692558][ C1] call_timer_fn+0x173/0x430 [ 7376.692793][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7376.693056][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7376.693320][ C1] __run_timers.part.0+0x52d/0x890 [ 7376.693581][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7376.693858][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7376.694143][ C1] ? lock_acquire+0x1c1/0x220 [ 7376.694386][ C1] ? clockevents_program_event+0xf6/0x300 [ 7376.694676][ C1] ? lock_release+0x1d5/0x250 [ 7376.694916][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7376.695181][ C1] ? ktime_get+0xb3/0x190 [ 7376.695405][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7376.695701][ C1] run_timer_softirq+0x72/0x100 [ 7376.695951][ C1] __do_softirq+0x1b9/0x7ff [ 7376.696186][ C1] irq_exit_rcu+0x98/0xc0 [ 7376.696405][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7376.696694][ C1] [ 7376.696844][ C1] [ 7376.696995][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7376.697299][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7376.697624][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7376.698600][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7376.698908][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7376.699310][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7376.699711][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7376.700111][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7376.700510][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7376.700913][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7376.701210][ C1] pipe_read+0xa16/0xdf0 [ 7376.701431][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7376.701711][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7376.701955][ C1] ? iterate_tty_write+0x299/0x540 [ 7376.702218][ C1] ? lock_release+0x1d5/0x250 [ 7376.702459][ C1] vfs_read+0x911/0xc00 [ 7376.702675][ C1] ? lock_acquire+0x1c1/0x220 [ 7376.702914][ C1] ? __might_fault+0xc6/0x180 [ 7376.703155][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7376.703396][ C1] ? __might_fault+0xc6/0x180 [ 7376.703637][ C1] ? lock_release+0x1d5/0x250 [ 7376.703877][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7376.704144][ C1] ? __fget_light+0x54/0x1e0 [ 7376.704384][ C1] ksys_read+0x17a/0x1e0 [ 7376.704604][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7376.704848][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7376.705154][ C1] do_syscall_64+0xc9/0x1e0 [ 7376.705388][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7376.705689][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7376.705917][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7376.706888][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7376.707313][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7376.707714][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7376.708113][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7376.708519][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7376.708920][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7376.709323][ C1] [ 7376.709482][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7376.709755][ C2] NMI backtrace for cpu 2 [ 7376.709760][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7376.709765][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7376.709769][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7376.709777][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7376.709783][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7376.709787][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7376.709791][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7376.709795][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7376.709799][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7376.709802][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7376.709806][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7376.709811][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7376.709816][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7376.709820][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7376.709823][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7376.709826][ C2] PKRU: 55555554 [ 7376.709829][ C2] Call Trace: [ 7376.709831][ C2] [ 7376.709834][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7376.709845][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7376.709853][ C2] ? nmi_handle+0x153/0x420 [ 7376.709864][ C2] ? default_do_nmi+0x41/0x100 [ 7376.709870][ C2] ? exc_nmi+0xf3/0x120 [ 7376.709875][ C2] ? end_repeat_nmi+0xf/0x60 [ 7376.709887][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7376.709895][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7376.709903][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7376.709912][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7376.709920][ C2] [ 7376.709921][ C2] [ 7376.709924][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7376.709931][ C2] ? get_stack_info+0x36/0xc0 [ 7376.709939][ C2] ? lock_acquire+0x1c1/0x220 [ 7376.709947][ C2] ? lock_release+0x1d5/0x250 [ 7376.709956][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7376.709965][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7376.709971][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7376.709980][ C2] ? lock_acquire+0x1c1/0x220 [ 7376.709985][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7376.709994][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7376.710000][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7376.710016][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7376.710023][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7376.710034][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7376.710044][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7376.710052][ C2] ip_local_deliver+0x19d/0x480 [ 7376.710058][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7376.710063][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7376.710069][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7376.710080][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7376.710088][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7376.710095][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7376.710116][ C2] ip_rcv+0x564/0x740 [ 7376.710122][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7376.710128][ C2] ? set_track_prepare+0x8a/0xd0 [ 7376.710136][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7376.710144][ C2] ? start_secondary+0x21c/0x2b0 [ 7376.710149][ C2] ? skb_clone+0x10b/0x330 [ 7376.710152][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7376.710157][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7376.710162][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7376.710166][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7376.710173][ C2] ? __tcf_classify+0x329/0x7d0 [ 7376.710177][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7376.710179][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7376.710182][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7376.710185][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7376.710190][ C2] ? lock_acquire+0x1c1/0x220 [ 7376.710192][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7376.710196][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7376.710199][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7376.710203][ C2] ? __copy_skb_header+0xaf/0x490 [ 7376.710208][ C2] ? __skb_clone+0x57a/0x760 [ 7376.710210][ C2] netif_receive_skb+0x55/0x280 [ 7376.710213][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7376.710221][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7376.710227][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7376.710233][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7376.710238][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7376.710248][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7376.710255][ C2] ? get_stack_info+0x36/0xc0 [ 7376.710259][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7376.710262][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7376.710265][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7376.710268][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7376.710271][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7376.710273][ C2] ? kernel_text_address+0x17/0xe0 [ 7376.710276][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7376.710280][ C2] ? arch_stack_walk+0x8c/0x100 [ 7376.710283][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7376.710286][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7376.710289][ C2] ? lock_acquire+0x1c1/0x220 [ 7376.710291][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7376.710295][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7376.710300][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7376.710302][ C2] ? get_stack_info+0x36/0xc0 [ 7376.710306][ C2] __tcf_classify+0x329/0x7d0 [ 7376.710311][ C2] tcf_classify+0x283/0x930 [ 7376.710316][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7376.710319][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7376.710323][ C2] tc_run+0x2e4/0x5d0 [ 7376.710326][ C2] ? __pfx_tc_run+0x10/0x10 [ 7376.710329][ C2] ? lock_acquire+0x1c1/0x220 [ 7376.710331][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7376.710335][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7376.710339][ C2] ? lock_acquire+0x1c1/0x220 [ 7376.710342][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7376.710345][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7376.710348][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7376.710350][ C2] ? neigh_hh_output+0x348/0x590 [ 7376.710354][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7376.710357][ C2] ip_finish_output2+0x786/0x18e0 [ 7376.710361][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7376.710368][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7376.710371][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7376.710374][ C2] ? __ip_finish_output+0x10f/0x770 [ 7376.710378][ C2] ip_output+0x16b/0x4f0 [ 7376.710381][ C2] ? __pfx_ip_output+0x10/0x10 [ 7376.710383][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7376.710387][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7376.710390][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7376.710392][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7376.710395][ C2] ? __alloc_skb+0xd4/0x280 [ 7376.710397][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7376.710401][ C2] ? tcp_fragment+0x168/0x1040 [ 7376.710404][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7376.710407][ C2] ? ip_local_out+0x114/0x3b0 [ 7376.710411][ C2] __ip_queue_xmit+0x672/0x1910 [ 7376.710414][ C2] ? __skb_clone+0x57a/0x760 [ 7376.710417][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7376.710422][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7376.710425][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7376.710428][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7376.710432][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7376.710436][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7376.710439][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7376.710442][ C2] tcp_send_loss_probe+0x348/0x830 [ 7376.710445][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7376.710447][ C2] tcp_write_timer+0x82/0x1d0 [ 7376.710451][ C2] call_timer_fn+0x173/0x430 [ 7376.710454][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7376.710459][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7376.710463][ C2] __run_timers.part.0+0x52d/0x890 [ 7376.710465][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7376.710469][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7376.710472][ C2] ? lock_acquire+0x1c1/0x220 [ 7376.710474][ C2] ? clockevents_program_event+0xf6/0x300 [ 7376.710478][ C2] ? lock_release+0x1d5/0x250 [ 7376.710481][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7376.710484][ C2] ? ktime_get+0xb3/0x190 [ 7376.710487][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7376.710491][ C2] run_timer_softirq+0x72/0x100 [ 7376.710495][ C2] __do_softirq+0x1b9/0x7ff [ 7376.710499][ C2] irq_exit_rcu+0x98/0xc0 [ 7376.710501][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7376.710504][ C2] [ 7376.710505][ C2] [ 7376.710506][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7376.710509][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7376.710512][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7376.710515][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7376.710517][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7376.710518][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7376.710519][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7376.710521][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7376.710522][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7376.710525][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7376.710528][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7376.710531][ C2] default_idle_call+0x69/0xa0 [ 7376.710534][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7376.710537][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7376.710540][ C2] ? lock_release+0x1d5/0x250 [ 7376.710542][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7376.710546][ C2] do_idle+0xfb/0x160 [ 7376.710549][ C2] cpu_startup_entry+0x55/0x60 [ 7376.710551][ C2] start_secondary+0x21c/0x2b0 [ 7376.710554][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7376.710558][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7376.710563][ C2] [ 7404.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4705s! [perl:4135] [ 7404.569677][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7404.570897][ C1] irq event stamp: 209232 [ 7404.571109][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7404.571625][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7404.572090][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7404.572544][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7404.572995][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7404.573432][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7404.574029][ C1] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 7404.574332][ C1] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 7404.575319][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000202 [ 7404.575618][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 7404.576008][ C1] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7404.576396][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 7404.576784][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7404.577176][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7404.577566][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7404.578002][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7404.578326][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7404.578716][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7404.579123][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7404.579523][ C1] PKRU: 55555554 [ 7404.579705][ C1] Call Trace: [ 7404.579873][ C1] [ 7404.580023][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7404.580284][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7404.580527][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7404.580805][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7404.581077][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7404.581367][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7404.581633][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7404.581937][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7404.582197][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 7404.582459][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7404.582766][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7404.583063][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7404.583378][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7404.583666][ C1] ? kasan_check_range+0x84/0x1c0 [ 7404.583923][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7404.584215][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7404.584527][ C1] ? get_stack_info+0x36/0xc0 [ 7404.584766][ C1] ? lock_acquire+0x1c1/0x220 [ 7404.585007][ C1] ? lock_release+0x1d5/0x250 [ 7404.585248][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7404.585497][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7404.585768][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7404.586053][ C1] ? lock_acquire+0x1c1/0x220 [ 7404.586292][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7404.586532][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7404.586792][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7404.587027][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7404.587274][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7404.587534][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7404.587810][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7404.588086][ C1] ip_local_deliver+0x19d/0x480 [ 7404.588334][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7404.588605][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7404.588869][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7404.589219][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7404.589472][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7404.589793][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7404.590056][ C1] ip_rcv+0x564/0x740 [ 7404.590260][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7404.590489][ C1] ? set_track_prepare+0x8a/0xd0 [ 7404.590743][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7404.591023][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7404.591295][ C1] ? skb_clone+0x10b/0x330 [ 7404.591523][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7404.591841][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7404.592147][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7404.592430][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7404.592725][ C1] ? __tcf_classify+0x329/0x7d0 [ 7404.592974][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7404.593206][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7404.593503][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7404.593790][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7404.594121][ C1] ? lock_acquire+0x1c1/0x220 [ 7404.594360][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7404.594656][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7404.594942][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7404.595258][ C1] ? __copy_skb_header+0xaf/0x490 [ 7404.595516][ C1] ? __skb_clone+0x57a/0x760 [ 7404.595750][ C1] netif_receive_skb+0x55/0x280 [ 7404.595999][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7404.596312][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7404.596644][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7404.596943][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7404.597217][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7404.597504][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7404.597818][ C1] ? hlock_class+0x4e/0x130 [ 7404.598052][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7404.598327][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7404.598603][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7404.598867][ C1] ? hlock_class+0x4e/0x130 [ 7404.599098][ C1] ? mark_lock+0x38/0x3e0 [ 7404.599318][ C1] ? stack_access_ok+0xda/0x1f0 [ 7404.599566][ C1] ? __lock_acquire+0xb67/0x1610 [ 7404.599820][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7404.600098][ C1] ? get_stack_info+0x36/0xc0 [ 7404.600336][ C1] ? stack_access_ok+0xda/0x1f0 [ 7404.600584][ C1] ? get_reg+0x119/0x190 [ 7404.600802][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7404.601070][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7404.601379][ C1] __tcf_classify+0x329/0x7d0 [ 7404.601619][ C1] tcf_classify+0x283/0x930 [ 7404.601852][ C1] ? arch_stack_walk+0xa2/0x100 [ 7404.602101][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7404.602358][ C1] ? get_stack_info+0x36/0xc0 [ 7404.602599][ C1] tc_run+0x2e4/0x5d0 [ 7404.602804][ C1] ? __pfx_tc_run+0x10/0x10 [ 7404.603035][ C1] ? lock_acquire+0x1c1/0x220 [ 7404.603274][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7404.603535][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7404.603787][ C1] ? lock_acquire+0x1c1/0x220 [ 7404.604029][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7404.604300][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7404.604606][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7404.604878][ C1] ? neigh_hh_output+0x348/0x590 [ 7404.605131][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7404.605395][ C1] ip_finish_output2+0x786/0x18e0 [ 7404.605651][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7404.605928][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7404.606268][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7404.606544][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7404.606797][ C1] ? __ip_finish_output+0x10f/0x770 [ 7404.607064][ C1] ip_output+0x16b/0x4f0 [ 7404.607280][ C1] ? run_timer_softirq+0x72/0x100 [ 7404.607537][ C1] ? __pfx_ip_output+0x10/0x10 [ 7404.607782][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7404.608070][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7404.608321][ C1] ? ip_local_out+0x114/0x3b0 [ 7404.608560][ C1] __ip_queue_xmit+0x672/0x1910 [ 7404.608809][ C1] ? __create_object+0x5e/0xb0 [ 7404.609054][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7404.609320][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7404.609602][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7404.609876][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7404.610157][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7404.610427][ C1] tcp_delack_timer+0x84/0x240 [ 7404.610672][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7404.610944][ C1] call_timer_fn+0x173/0x430 [ 7404.611180][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7404.611441][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7404.611702][ C1] __run_timers.part.0+0x52d/0x890 [ 7404.611962][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7404.612238][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7404.612523][ C1] ? lock_acquire+0x1c1/0x220 [ 7404.612766][ C1] ? clockevents_program_event+0xf6/0x300 [ 7404.613055][ C1] ? lock_release+0x1d5/0x250 [ 7404.613295][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7404.613560][ C1] ? ktime_get+0xb3/0x190 [ 7404.613782][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7404.614077][ C1] run_timer_softirq+0x72/0x100 [ 7404.614332][ C1] __do_softirq+0x1b9/0x7ff [ 7404.614565][ C1] irq_exit_rcu+0x98/0xc0 [ 7404.614785][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7404.615071][ C1] [ 7404.615221][ C1] [ 7404.615371][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7404.615676][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7404.616000][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7404.616968][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7404.617277][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7404.617676][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7404.618080][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7404.618480][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7404.618877][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7404.619278][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7404.619576][ C1] pipe_read+0xa16/0xdf0 [ 7404.619795][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7404.620075][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7404.620318][ C1] ? iterate_tty_write+0x299/0x540 [ 7404.620580][ C1] ? lock_release+0x1d5/0x250 [ 7404.620820][ C1] vfs_read+0x911/0xc00 [ 7404.621035][ C1] ? lock_acquire+0x1c1/0x220 [ 7404.621272][ C1] ? __might_fault+0xc6/0x180 [ 7404.621513][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7404.621754][ C1] ? __might_fault+0xc6/0x180 [ 7404.621993][ C1] ? lock_release+0x1d5/0x250 [ 7404.622231][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7404.622499][ C1] ? __fget_light+0x54/0x1e0 [ 7404.622736][ C1] ksys_read+0x17a/0x1e0 [ 7404.622953][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7404.623197][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7404.623502][ C1] do_syscall_64+0xc9/0x1e0 [ 7404.623735][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7404.624032][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7404.624264][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7404.625235][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7404.625656][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7404.626056][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7404.626455][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7404.626856][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7404.627258][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7404.627659][ C1] [ 7404.627815][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4705s! [swapper/2:0] [ 7404.628222][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7404.629463][ C2] irq event stamp: 44114564 [ 7404.629693][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7404.630222][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7404.630730][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7404.631205][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7404.631669][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7404.632121][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7404.632729][ C2] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 7404.633016][ C2] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 7404.633978][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000246 [ 7404.634288][ C2] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7404.634683][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7404.635080][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7404.635480][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7404.635875][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7404.636269][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7404.636713][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7404.637044][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7404.637442][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7404.637837][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7404.638232][ C2] PKRU: 55555554 [ 7404.638414][ C2] Call Trace: [ 7404.638583][ C2] [ 7404.638728][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7404.638987][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7404.639229][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7404.639503][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7404.639775][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7404.640061][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7404.640323][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7404.640627][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7404.640886][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7404.641145][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7404.641453][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7404.641747][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7404.642058][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7404.642347][ C2] ? kasan_check_range+0x10f/0x1c0 [ 7404.642605][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 7404.642884][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7404.643192][ C2] ? get_stack_info+0x36/0xc0 [ 7404.643432][ C2] ? lock_acquire+0x1c1/0x220 [ 7404.643674][ C2] ? lock_release+0x1d5/0x250 [ 7404.643913][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7404.644162][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7404.644434][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7404.644716][ C2] ? lock_acquire+0x1c1/0x220 [ 7404.644953][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7404.645192][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7404.645450][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7404.645682][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7404.645927][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7404.646183][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7404.646454][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7404.646731][ C2] ip_local_deliver+0x19d/0x480 [ 7404.646977][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7404.647246][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7404.647507][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7404.647849][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7404.648100][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7404.648418][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7404.648678][ C2] ip_rcv+0x564/0x740 [ 7404.648881][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7404.649110][ C2] ? set_track_prepare+0x8a/0xd0 [ 7404.649361][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7404.649635][ C2] ? start_secondary+0x21c/0x2b0 [ 7404.649885][ C2] ? skb_clone+0x10b/0x330 [ 7404.650112][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7404.650430][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7404.650733][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7404.651012][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7404.651305][ C2] ? __tcf_classify+0x329/0x7d0 [ 7404.651550][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7404.651781][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7404.652080][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7404.652361][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7404.652684][ C2] ? lock_acquire+0x1c1/0x220 [ 7404.652922][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7404.653216][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7404.653500][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7404.653815][ C2] ? __copy_skb_header+0xaf/0x490 [ 7404.654070][ C2] ? __skb_clone+0x57a/0x760 [ 7404.654307][ C2] netif_receive_skb+0x55/0x280 [ 7404.654555][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7404.654865][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7404.655195][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7404.655495][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7404.655766][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7404.656054][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7404.656364][ C2] ? get_stack_info+0x36/0xc0 [ 7404.656604][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7404.656865][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7404.657181][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7404.657456][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7404.657731][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7404.658045][ C2] ? kernel_text_address+0x17/0xe0 [ 7404.658304][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7404.658615][ C2] ? arch_stack_walk+0x8c/0x100 [ 7404.658861][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7404.659124][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7404.659406][ C2] ? lock_acquire+0x1c1/0x220 [ 7404.659645][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7404.659923][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7404.660227][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7404.660500][ C2] ? get_stack_info+0x36/0xc0 [ 7404.660740][ C2] __tcf_classify+0x329/0x7d0 [ 7404.660981][ C2] tcf_classify+0x283/0x930 [ 7404.661212][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7404.661466][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7404.661776][ C2] tc_run+0x2e4/0x5d0 [ 7404.661981][ C2] ? __pfx_tc_run+0x10/0x10 [ 7404.662210][ C2] ? lock_acquire+0x1c1/0x220 [ 7404.662447][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7404.662706][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7404.662957][ C2] ? lock_acquire+0x1c1/0x220 [ 7404.663198][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7404.663461][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7404.663762][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7404.664034][ C2] ? neigh_hh_output+0x348/0x590 [ 7404.664290][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7404.664553][ C2] ip_finish_output2+0x786/0x18e0 [ 7404.664808][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7404.665143][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7404.665416][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7404.665668][ C2] ? __ip_finish_output+0x10f/0x770 [ 7404.665931][ C2] ip_output+0x16b/0x4f0 [ 7404.666149][ C2] ? __pfx_ip_output+0x10/0x10 [ 7404.666392][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7404.666665][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7404.666976][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7404.667249][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7404.667499][ C2] ? __alloc_skb+0xd4/0x280 [ 7404.667729][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7404.667996][ C2] ? tcp_fragment+0x168/0x1040 [ 7404.668239][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7404.668489][ C2] ? ip_local_out+0x114/0x3b0 [ 7404.668726][ C2] __ip_queue_xmit+0x672/0x1910 [ 7404.668973][ C2] ? __skb_clone+0x57a/0x760 [ 7404.669208][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7404.669472][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7404.669750][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7404.669993][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7404.670241][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7404.670542][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7404.670860][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7404.671103][ C2] tcp_send_loss_probe+0x348/0x830 [ 7404.671363][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7404.671629][ C2] tcp_write_timer+0x82/0x1d0 [ 7404.671868][ C2] call_timer_fn+0x173/0x430 [ 7404.672102][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7404.672361][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7404.672622][ C2] __run_timers.part.0+0x52d/0x890 [ 7404.672880][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7404.673150][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7404.673432][ C2] ? lock_acquire+0x1c1/0x220 [ 7404.673671][ C2] ? clockevents_program_event+0xf6/0x300 [ 7404.673957][ C2] ? lock_release+0x1d5/0x250 [ 7404.674200][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7404.674461][ C2] ? ktime_get+0xb3/0x190 [ 7404.674682][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7404.674975][ C2] run_timer_softirq+0x72/0x100 [ 7404.675224][ C2] __do_softirq+0x1b9/0x7ff [ 7404.675456][ C2] irq_exit_rcu+0x98/0xc0 [ 7404.675673][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7404.675958][ C2] [ 7404.676107][ C2] [ 7404.676257][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7404.676558][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7404.676812][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7404.677772][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7404.678078][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7404.678474][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7404.678873][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7404.679270][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7404.679664][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7404.680060][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7404.680350][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7404.680608][ C2] default_idle_call+0x69/0xa0 [ 7404.680851][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7404.681101][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7404.681376][ C2] ? lock_release+0x1d5/0x250 [ 7404.681614][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7404.681885][ C2] do_idle+0xfb/0x160 [ 7404.682087][ C2] cpu_startup_entry+0x55/0x60 [ 7404.682328][ C2] start_secondary+0x21c/0x2b0 [ 7404.682571][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7404.682837][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7404.683145][ C2] [ 7432.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4731s! [perl:4135] [ 7432.569676][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7432.570899][ C1] irq event stamp: 209232 [ 7432.571111][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7432.571628][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7432.572094][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7432.572551][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7432.573002][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7432.573440][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7432.574058][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7432.574383][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7432.575361][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7432.575662][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7432.576051][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7432.576441][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7432.576831][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7432.577219][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7432.577609][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7432.578046][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7432.578372][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7432.578764][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7432.579153][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7432.579541][ C1] PKRU: 55555554 [ 7432.579719][ C1] Call Trace: [ 7432.579886][ C1] [ 7432.580029][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7432.580284][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7432.580521][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7432.580790][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7432.581059][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7432.581339][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7432.581597][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7432.581896][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7432.582152][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7432.582454][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7432.582742][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7432.583048][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7432.583333][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7432.583621][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7432.583904][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7432.584231][ C1] ? get_stack_info+0x36/0xc0 [ 7432.584473][ C1] ? lock_acquire+0x1c1/0x220 [ 7432.584712][ C1] ? lock_release+0x1d5/0x250 [ 7432.584954][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7432.585214][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7432.585478][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7432.585758][ C1] ? lock_acquire+0x1c1/0x220 [ 7432.585990][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7432.586225][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7432.586478][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7432.586708][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7432.586951][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7432.587202][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7432.587472][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7432.587741][ C1] ip_local_deliver+0x19d/0x480 [ 7432.587983][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7432.588249][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7432.588508][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7432.588847][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7432.589094][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7432.589408][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7432.589665][ C1] ip_rcv+0x564/0x740 [ 7432.589864][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7432.590091][ C1] ? set_track_prepare+0x8a/0xd0 [ 7432.590339][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7432.590608][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7432.590877][ C1] ? skb_clone+0x10b/0x330 [ 7432.591100][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7432.591412][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7432.591710][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7432.591986][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7432.592299][ C1] ? __tcf_classify+0x329/0x7d0 [ 7432.592549][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7432.592781][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7432.593082][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7432.593369][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7432.593695][ C1] ? lock_acquire+0x1c1/0x220 [ 7432.593936][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7432.594235][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7432.594524][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7432.594843][ C1] ? __copy_skb_header+0xaf/0x490 [ 7432.595101][ C1] ? __skb_clone+0x57a/0x760 [ 7432.595335][ C1] netif_receive_skb+0x55/0x280 [ 7432.595583][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7432.595897][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7432.596230][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7432.596532][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7432.596807][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7432.597096][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7432.597408][ C1] ? hlock_class+0x4e/0x130 [ 7432.597644][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7432.597920][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7432.598200][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7432.598465][ C1] ? hlock_class+0x4e/0x130 [ 7432.598695][ C1] ? mark_lock+0x38/0x3e0 [ 7432.598917][ C1] ? stack_access_ok+0xda/0x1f0 [ 7432.599168][ C1] ? __lock_acquire+0xb67/0x1610 [ 7432.599423][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7432.599701][ C1] ? get_stack_info+0x36/0xc0 [ 7432.599942][ C1] ? stack_access_ok+0xda/0x1f0 [ 7432.600190][ C1] ? get_reg+0x119/0x190 [ 7432.600407][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7432.600676][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7432.600988][ C1] __tcf_classify+0x329/0x7d0 [ 7432.601232][ C1] tcf_classify+0x283/0x930 [ 7432.601463][ C1] ? arch_stack_walk+0xa2/0x100 [ 7432.601713][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7432.601971][ C1] ? get_stack_info+0x36/0xc0 [ 7432.602213][ C1] tc_run+0x2e4/0x5d0 [ 7432.602421][ C1] ? __pfx_tc_run+0x10/0x10 [ 7432.602654][ C1] ? lock_acquire+0x1c1/0x220 [ 7432.602893][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7432.603156][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7432.603410][ C1] ? lock_acquire+0x1c1/0x220 [ 7432.603650][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7432.603914][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7432.604225][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7432.604498][ C1] ? neigh_hh_output+0x348/0x590 [ 7432.604752][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7432.605018][ C1] ip_finish_output2+0x786/0x18e0 [ 7432.605276][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7432.605557][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7432.605896][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7432.606173][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7432.606427][ C1] ? __ip_finish_output+0x10f/0x770 [ 7432.606691][ C1] ip_output+0x16b/0x4f0 [ 7432.606910][ C1] ? run_timer_softirq+0x72/0x100 [ 7432.607168][ C1] ? __pfx_ip_output+0x10/0x10 [ 7432.607410][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7432.607698][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7432.607952][ C1] ? ip_local_out+0x114/0x3b0 [ 7432.608193][ C1] __ip_queue_xmit+0x672/0x1910 [ 7432.608441][ C1] ? __create_object+0x5e/0xb0 [ 7432.608685][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7432.608952][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7432.609239][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7432.609512][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7432.609794][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7432.610070][ C1] tcp_delack_timer+0x84/0x240 [ 7432.610315][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7432.610590][ C1] call_timer_fn+0x173/0x430 [ 7432.610825][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7432.611090][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7432.611353][ C1] __run_timers.part.0+0x52d/0x890 [ 7432.611615][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7432.611891][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7432.612175][ C1] ? lock_acquire+0x1c1/0x220 [ 7432.612416][ C1] ? clockevents_program_event+0xf6/0x300 [ 7432.612708][ C1] ? lock_release+0x1d5/0x250 [ 7432.612948][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7432.613213][ C1] ? ktime_get+0xb3/0x190 [ 7432.613438][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7432.613735][ C1] run_timer_softirq+0x72/0x100 [ 7432.613986][ C1] __do_softirq+0x1b9/0x7ff [ 7432.614222][ C1] irq_exit_rcu+0x98/0xc0 [ 7432.614442][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7432.614731][ C1] [ 7432.614880][ C1] [ 7432.615033][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7432.615337][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7432.615662][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7432.616641][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7432.616949][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7432.617352][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7432.617754][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7432.618154][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7432.618554][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7432.618959][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7432.619256][ C1] pipe_read+0xa16/0xdf0 [ 7432.619478][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7432.619757][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7432.620003][ C1] ? iterate_tty_write+0x299/0x540 [ 7432.620265][ C1] ? lock_release+0x1d5/0x250 [ 7432.620506][ C1] vfs_read+0x911/0xc00 [ 7432.620722][ C1] ? lock_acquire+0x1c1/0x220 [ 7432.620962][ C1] ? __might_fault+0xc6/0x180 [ 7432.621202][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7432.621443][ C1] ? __might_fault+0xc6/0x180 [ 7432.621684][ C1] ? lock_release+0x1d5/0x250 [ 7432.621925][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7432.622192][ C1] ? __fget_light+0x54/0x1e0 [ 7432.622427][ C1] ksys_read+0x17a/0x1e0 [ 7432.622649][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7432.622895][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7432.623199][ C1] do_syscall_64+0xc9/0x1e0 [ 7432.623433][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7432.623735][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7432.623963][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7432.624939][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7432.625367][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7432.625767][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7432.626166][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7432.626568][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7432.626968][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7432.627372][ C1] [ 7432.627530][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4731s! [swapper/2:0] [ 7432.627936][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7432.629177][ C2] irq event stamp: 44114564 [ 7432.629405][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7432.629933][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7432.630440][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7432.630915][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7432.631379][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7432.631831][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7432.632440][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7432.632762][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7432.633723][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7432.634034][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7432.634428][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7432.634823][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7432.635221][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7432.635615][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7432.636010][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7432.636453][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7432.636780][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7432.637180][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7432.637574][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7432.637969][ C2] PKRU: 55555554 [ 7432.638150][ C2] Call Trace: [ 7432.638319][ C2] [ 7432.638463][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7432.638724][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7432.638966][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7432.639239][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7432.639511][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7432.639798][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7432.640060][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7432.640364][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7432.640623][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7432.640884][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7432.641192][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7432.641483][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7432.641795][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7432.642083][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7432.642375][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7432.642662][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7432.642971][ C2] ? get_stack_info+0x36/0xc0 [ 7432.643208][ C2] ? lock_acquire+0x1c1/0x220 [ 7432.643445][ C2] ? lock_release+0x1d5/0x250 [ 7432.643684][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7432.643930][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7432.644202][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7432.644485][ C2] ? lock_acquire+0x1c1/0x220 [ 7432.644719][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7432.644958][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7432.645214][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7432.645447][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7432.645692][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7432.645948][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7432.646218][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7432.646493][ C2] ip_local_deliver+0x19d/0x480 [ 7432.646738][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7432.647006][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7432.647269][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7432.647613][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7432.647863][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7432.648180][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7432.648440][ C2] ip_rcv+0x564/0x740 [ 7432.648642][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7432.648870][ C2] ? set_track_prepare+0x8a/0xd0 [ 7432.649120][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7432.649394][ C2] ? start_secondary+0x21c/0x2b0 [ 7432.649644][ C2] ? skb_clone+0x10b/0x330 [ 7432.649866][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7432.650182][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7432.650486][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7432.650762][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7432.651055][ C2] ? __tcf_classify+0x329/0x7d0 [ 7432.651303][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7432.651529][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7432.651828][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7432.652110][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7432.652434][ C2] ? lock_acquire+0x1c1/0x220 [ 7432.652669][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7432.652964][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7432.653245][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7432.653559][ C2] ? __copy_skb_header+0xaf/0x490 [ 7432.653814][ C2] ? __skb_clone+0x57a/0x760 [ 7432.654050][ C2] netif_receive_skb+0x55/0x280 [ 7432.654296][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7432.654605][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7432.654934][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7432.655229][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7432.655503][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7432.655786][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7432.656095][ C2] ? get_stack_info+0x36/0xc0 [ 7432.656335][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7432.656596][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7432.656910][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7432.657183][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7432.657456][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7432.657769][ C2] ? kernel_text_address+0x17/0xe0 [ 7432.658026][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7432.658336][ C2] ? arch_stack_walk+0x8c/0x100 [ 7432.658582][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7432.658844][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7432.659127][ C2] ? lock_acquire+0x1c1/0x220 [ 7432.659361][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7432.659643][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7432.659943][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7432.660218][ C2] ? get_stack_info+0x36/0xc0 [ 7432.660458][ C2] __tcf_classify+0x329/0x7d0 [ 7432.660696][ C2] tcf_classify+0x283/0x930 [ 7432.660927][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7432.661181][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7432.661492][ C2] tc_run+0x2e4/0x5d0 [ 7432.661694][ C2] ? __pfx_tc_run+0x10/0x10 [ 7432.661923][ C2] ? lock_acquire+0x1c1/0x220 [ 7432.662158][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7432.662417][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7432.662666][ C2] ? lock_acquire+0x1c1/0x220 [ 7432.662904][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7432.663164][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7432.663465][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7432.663734][ C2] ? neigh_hh_output+0x348/0x590 [ 7432.663988][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7432.664250][ C2] ip_finish_output2+0x786/0x18e0 [ 7432.664504][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7432.664839][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7432.665113][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7432.665364][ C2] ? __ip_finish_output+0x10f/0x770 [ 7432.665625][ C2] ip_output+0x16b/0x4f0 [ 7432.665839][ C2] ? __pfx_ip_output+0x10/0x10 [ 7432.666080][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7432.666354][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7432.666663][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7432.666939][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7432.667187][ C2] ? __alloc_skb+0xd4/0x280 [ 7432.667415][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7432.667683][ C2] ? tcp_fragment+0x168/0x1040 [ 7432.667925][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7432.668174][ C2] ? ip_local_out+0x114/0x3b0 [ 7432.668412][ C2] __ip_queue_xmit+0x672/0x1910 [ 7432.668658][ C2] ? __skb_clone+0x57a/0x760 [ 7432.668888][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7432.669154][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7432.669433][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7432.669675][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7432.669921][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7432.670218][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7432.670535][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7432.670777][ C2] tcp_send_loss_probe+0x348/0x830 [ 7432.671037][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7432.671302][ C2] tcp_write_timer+0x82/0x1d0 [ 7432.671540][ C2] call_timer_fn+0x173/0x430 [ 7432.671775][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7432.672036][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7432.672295][ C2] __run_timers.part.0+0x52d/0x890 [ 7432.672552][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7432.672818][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7432.673102][ C2] ? lock_acquire+0x1c1/0x220 [ 7432.673337][ C2] ? clockevents_program_event+0xf6/0x300 [ 7432.673625][ C2] ? lock_release+0x1d5/0x250 [ 7432.673862][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7432.674134][ C2] ? ktime_get+0xb3/0x190 [ 7432.674352][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7432.674647][ C2] run_timer_softirq+0x72/0x100 [ 7432.674893][ C2] __do_softirq+0x1b9/0x7ff [ 7432.675122][ C2] irq_exit_rcu+0x98/0xc0 [ 7432.675341][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7432.675622][ C2] [ 7432.675772][ C2] [ 7432.675921][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7432.676223][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7432.676477][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7432.677436][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7432.677741][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7432.678137][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7432.678531][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7432.678924][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7432.679321][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7432.679718][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7432.680003][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7432.680261][ C2] default_idle_call+0x69/0xa0 [ 7432.680504][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7432.680752][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7432.681026][ C2] ? lock_release+0x1d5/0x250 [ 7432.681262][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7432.681533][ C2] do_idle+0xfb/0x160 [ 7432.681736][ C2] cpu_startup_entry+0x55/0x60 [ 7432.681975][ C2] start_secondary+0x21c/0x2b0 [ 7432.682215][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7432.682482][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7432.682789][ C2] [ 7454.710102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7454.710460][ C1] rcu: 1-....: (5087555 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1246849 [ 7454.711006][ C1] rcu: (t=5099823 jiffies g=1882453 q=721 ncpus=4) [ 7454.711330][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7454.711768][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7454.712368][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7454.712689][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7454.713660][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7454.713972][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7454.714372][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7454.714772][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7454.715179][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7454.715580][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7454.715979][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7454.716428][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7454.716761][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7454.717167][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7454.717570][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7454.717972][ C1] PKRU: 55555554 [ 7454.718155][ C1] Call Trace: [ 7454.718327][ C1] [ 7454.718480][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7454.718754][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7454.719007][ C1] ? check_cpu_stall+0x284/0x500 [ 7454.719260][ C1] ? rcu_pending+0x92/0x360 [ 7454.719493][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7454.719764][ C1] ? update_process_times+0xb9/0x110 [ 7454.720033][ C1] ? tick_sched_handle+0x67/0x130 [ 7454.720291][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7454.720579][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7454.720821][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7454.721134][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7454.721410][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7454.721698][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7454.721964][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7454.722273][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7454.722537][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7454.722848][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7454.723145][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7454.723460][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7454.723753][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7454.724053][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7454.724344][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7454.724657][ C1] ? get_stack_info+0x36/0xc0 [ 7454.724899][ C1] ? lock_acquire+0x1c1/0x220 [ 7454.725138][ C1] ? lock_release+0x1d5/0x250 [ 7454.725380][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7454.725629][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7454.725901][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7454.726189][ C1] ? lock_acquire+0x1c1/0x220 [ 7454.726428][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7454.726669][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7454.726929][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7454.727167][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7454.727415][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7454.727674][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7454.727950][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7454.728227][ C1] ip_local_deliver+0x19d/0x480 [ 7454.728476][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7454.728749][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7454.729015][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7454.729363][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7454.729618][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7454.729939][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7454.730203][ C1] ip_rcv+0x564/0x740 [ 7454.730408][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7454.730640][ C1] ? set_track_prepare+0x8a/0xd0 [ 7454.730896][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7454.731173][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7454.731447][ C1] ? skb_clone+0x10b/0x330 [ 7454.731677][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7454.731998][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7454.732305][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7454.732590][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7454.732885][ C1] ? __tcf_classify+0x329/0x7d0 [ 7454.733136][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7454.733368][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7454.733668][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7454.733958][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7454.734285][ C1] ? lock_acquire+0x1c1/0x220 [ 7454.734527][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7454.734823][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7454.735112][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7454.735431][ C1] ? __copy_skb_header+0xaf/0x490 [ 7454.735691][ C1] ? __skb_clone+0x57a/0x760 [ 7454.735926][ C1] netif_receive_skb+0x55/0x280 [ 7454.736176][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7454.736491][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7454.736826][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7454.737128][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7454.737402][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7454.737692][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7454.738004][ C1] ? hlock_class+0x4e/0x130 [ 7454.738239][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7454.738515][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7454.738794][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7454.739059][ C1] ? hlock_class+0x4e/0x130 [ 7454.739288][ C1] ? mark_lock+0x38/0x3e0 [ 7454.739511][ C1] ? stack_access_ok+0xda/0x1f0 [ 7454.739760][ C1] ? __lock_acquire+0xb67/0x1610 [ 7454.740014][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7454.740291][ C1] ? get_stack_info+0x36/0xc0 [ 7454.740532][ C1] ? stack_access_ok+0xda/0x1f0 [ 7454.740779][ C1] ? get_reg+0x119/0x190 [ 7454.740997][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7454.741265][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7454.741575][ C1] __tcf_classify+0x329/0x7d0 [ 7454.741818][ C1] tcf_classify+0x283/0x930 [ 7454.742049][ C1] ? arch_stack_walk+0xa2/0x100 [ 7454.742299][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7454.742556][ C1] ? get_stack_info+0x36/0xc0 [ 7454.742799][ C1] tc_run+0x2e4/0x5d0 [ 7454.743004][ C1] ? __pfx_tc_run+0x10/0x10 [ 7454.743237][ C1] ? lock_acquire+0x1c1/0x220 [ 7454.743477][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7454.743739][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7454.743995][ C1] ? lock_acquire+0x1c1/0x220 [ 7454.744235][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7454.744499][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7454.744807][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7454.745079][ C1] ? neigh_hh_output+0x348/0x590 [ 7454.745332][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7454.745597][ C1] ip_finish_output2+0x786/0x18e0 [ 7454.745853][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7454.746134][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7454.746473][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7454.746749][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7454.747002][ C1] ? __ip_finish_output+0x10f/0x770 [ 7454.747267][ C1] ip_output+0x16b/0x4f0 [ 7454.747485][ C1] ? run_timer_softirq+0x72/0x100 [ 7454.747743][ C1] ? __pfx_ip_output+0x10/0x10 [ 7454.747986][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7454.748277][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7454.748530][ C1] ? ip_local_out+0x114/0x3b0 [ 7454.748771][ C1] __ip_queue_xmit+0x672/0x1910 [ 7454.749020][ C1] ? __create_object+0x5e/0xb0 [ 7454.749266][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7454.749533][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7454.749817][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7454.750090][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7454.750372][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7454.750647][ C1] tcp_delack_timer+0x84/0x240 [ 7454.750891][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7454.751165][ C1] call_timer_fn+0x173/0x430 [ 7454.751399][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7454.751663][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7454.751925][ C1] __run_timers.part.0+0x52d/0x890 [ 7454.752187][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7454.752462][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7454.752746][ C1] ? lock_acquire+0x1c1/0x220 [ 7454.752986][ C1] ? clockevents_program_event+0xf6/0x300 [ 7454.753276][ C1] ? lock_release+0x1d5/0x250 [ 7454.753515][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7454.753779][ C1] ? ktime_get+0xb3/0x190 [ 7454.754006][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7454.754302][ C1] run_timer_softirq+0x72/0x100 [ 7454.754550][ C1] __do_softirq+0x1b9/0x7ff [ 7454.754785][ C1] irq_exit_rcu+0x98/0xc0 [ 7454.755004][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7454.755293][ C1] [ 7454.755443][ C1] [ 7454.755595][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7454.755897][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7454.756223][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7454.757199][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7454.757506][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7454.757909][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7454.758309][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7454.758708][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7454.759108][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7454.759512][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7454.759809][ C1] pipe_read+0xa16/0xdf0 [ 7454.760031][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7454.760309][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7454.760554][ C1] ? iterate_tty_write+0x299/0x540 [ 7454.760816][ C1] ? lock_release+0x1d5/0x250 [ 7454.761057][ C1] vfs_read+0x911/0xc00 [ 7454.761272][ C1] ? lock_acquire+0x1c1/0x220 [ 7454.761512][ C1] ? __might_fault+0xc6/0x180 [ 7454.761751][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7454.761992][ C1] ? __might_fault+0xc6/0x180 [ 7454.762233][ C1] ? lock_release+0x1d5/0x250 [ 7454.762474][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7454.762740][ C1] ? __fget_light+0x54/0x1e0 [ 7454.762976][ C1] ksys_read+0x17a/0x1e0 [ 7454.763196][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7454.763441][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7454.763745][ C1] do_syscall_64+0xc9/0x1e0 [ 7454.763982][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7454.764283][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7454.764511][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7454.765484][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7454.765909][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7454.766309][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7454.766708][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7454.767111][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7454.767511][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7454.767913][ C1] [ 7454.768072][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7454.768349][ C2] NMI backtrace for cpu 2 [ 7454.768354][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7454.768360][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7454.768364][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7454.768373][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7454.768378][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7454.768383][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7454.768387][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7454.768391][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7454.768395][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7454.768399][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7454.768403][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7454.768407][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7454.768413][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7454.768417][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7454.768420][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7454.768423][ C2] PKRU: 55555554 [ 7454.768425][ C2] Call Trace: [ 7454.768428][ C2] [ 7454.768431][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7454.768443][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7454.768451][ C2] ? nmi_handle+0x153/0x420 [ 7454.768461][ C2] ? default_do_nmi+0x41/0x100 [ 7454.768468][ C2] ? exc_nmi+0xf3/0x120 [ 7454.768474][ C2] ? end_repeat_nmi+0xf/0x60 [ 7454.768485][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7454.768493][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7454.768501][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7454.768510][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7454.768518][ C2] [ 7454.768520][ C2] [ 7454.768523][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7454.768529][ C2] ? get_stack_info+0x36/0xc0 [ 7454.768538][ C2] ? lock_acquire+0x1c1/0x220 [ 7454.768546][ C2] ? lock_release+0x1d5/0x250 [ 7454.768555][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7454.768563][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7454.768570][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7454.768578][ C2] ? lock_acquire+0x1c1/0x220 [ 7454.768584][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7454.768593][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7454.768599][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7454.768615][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7454.768622][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7454.768633][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7454.768643][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7454.768652][ C2] ip_local_deliver+0x19d/0x480 [ 7454.768658][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7454.768663][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7454.768669][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7454.768680][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7454.768688][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7454.768695][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7454.768716][ C2] ip_rcv+0x564/0x740 [ 7454.768722][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7454.768729][ C2] ? set_track_prepare+0x8a/0xd0 [ 7454.768737][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7454.768744][ C2] ? start_secondary+0x21c/0x2b0 [ 7454.768751][ C2] ? skb_clone+0x10b/0x330 [ 7454.768757][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7454.768772][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7454.768786][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7454.768793][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7454.768814][ C2] ? __tcf_classify+0x329/0x7d0 [ 7454.768822][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7454.768828][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7454.768836][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7454.768844][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7454.768854][ C2] ? lock_acquire+0x1c1/0x220 [ 7454.768860][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7454.768870][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7454.768879][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7454.768889][ C2] ? __copy_skb_header+0xaf/0x490 [ 7454.768899][ C2] ? __skb_clone+0x57a/0x760 [ 7454.768905][ C2] netif_receive_skb+0x55/0x280 [ 7454.768913][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7454.768931][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7454.768948][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7454.768966][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7454.768978][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7454.769004][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7454.769024][ C2] ? get_stack_info+0x36/0xc0 [ 7454.769036][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7454.769042][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7454.769051][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7454.769057][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7454.769066][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7454.769072][ C2] ? kernel_text_address+0x17/0xe0 [ 7454.769079][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7454.769088][ C2] ? arch_stack_walk+0x8c/0x100 [ 7454.769096][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7454.769103][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7454.769112][ C2] ? lock_acquire+0x1c1/0x220 [ 7454.769117][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7454.769122][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7454.769126][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7454.769129][ C2] ? get_stack_info+0x36/0xc0 [ 7454.769133][ C2] __tcf_classify+0x329/0x7d0 [ 7454.769138][ C2] tcf_classify+0x283/0x930 [ 7454.769142][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7454.769145][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7454.769149][ C2] tc_run+0x2e4/0x5d0 [ 7454.769153][ C2] ? __pfx_tc_run+0x10/0x10 [ 7454.769156][ C2] ? lock_acquire+0x1c1/0x220 [ 7454.769158][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7454.769162][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7454.769166][ C2] ? lock_acquire+0x1c1/0x220 [ 7454.769169][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7454.769172][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7454.769175][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7454.769177][ C2] ? neigh_hh_output+0x348/0x590 [ 7454.769181][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7454.769184][ C2] ip_finish_output2+0x786/0x18e0 [ 7454.769188][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7454.769195][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7454.769197][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7454.769201][ C2] ? __ip_finish_output+0x10f/0x770 [ 7454.769205][ C2] ip_output+0x16b/0x4f0 [ 7454.769208][ C2] ? __pfx_ip_output+0x10/0x10 [ 7454.769211][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7454.769213][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7454.769216][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7454.769219][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7454.769222][ C2] ? __alloc_skb+0xd4/0x280 [ 7454.769224][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7454.769228][ C2] ? tcp_fragment+0x168/0x1040 [ 7454.769231][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7454.769234][ C2] ? ip_local_out+0x114/0x3b0 [ 7454.769237][ C2] __ip_queue_xmit+0x672/0x1910 [ 7454.769241][ C2] ? __skb_clone+0x57a/0x760 [ 7454.769244][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7454.769249][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7454.769252][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7454.769256][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7454.769260][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7454.769264][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7454.769267][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7454.769270][ C2] tcp_send_loss_probe+0x348/0x830 [ 7454.769273][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7454.769275][ C2] tcp_write_timer+0x82/0x1d0 [ 7454.769279][ C2] call_timer_fn+0x173/0x430 [ 7454.769282][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7454.769287][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7454.769291][ C2] __run_timers.part.0+0x52d/0x890 [ 7454.769294][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7454.769298][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7454.769301][ C2] ? lock_acquire+0x1c1/0x220 [ 7454.769303][ C2] ? clockevents_program_event+0xf6/0x300 [ 7454.769307][ C2] ? lock_release+0x1d5/0x250 [ 7454.769310][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7454.769313][ C2] ? ktime_get+0xb3/0x190 [ 7454.769317][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7454.769321][ C2] run_timer_softirq+0x72/0x100 [ 7454.769324][ C2] __do_softirq+0x1b9/0x7ff [ 7454.769329][ C2] irq_exit_rcu+0x98/0xc0 [ 7454.769331][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7454.769334][ C2] [ 7454.769335][ C2] [ 7454.769336][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7454.769339][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7454.769342][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7454.769344][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7454.769346][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7454.769347][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7454.769349][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7454.769350][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7454.769351][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7454.769354][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7454.769357][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7454.769360][ C2] default_idle_call+0x69/0xa0 [ 7454.769363][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7454.769365][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7454.769369][ C2] ? lock_release+0x1d5/0x250 [ 7454.769371][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7454.769375][ C2] do_idle+0xfb/0x160 [ 7454.769378][ C2] cpu_startup_entry+0x55/0x60 [ 7454.769380][ C2] start_secondary+0x21c/0x2b0 [ 7454.769383][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7454.769387][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7454.769392][ C2] [ 7480.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4775s! [perl:4135] [ 7480.569685][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7480.570910][ C1] irq event stamp: 209232 [ 7480.571124][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7480.571642][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7480.572110][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7480.572567][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7480.573019][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7480.573458][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7480.574084][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7480.574410][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7480.575385][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7480.575685][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7480.576075][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7480.576466][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7480.576858][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7480.577248][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7480.577637][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7480.578075][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7480.578401][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7480.578794][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7480.579185][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7480.579574][ C1] PKRU: 55555554 [ 7480.579752][ C1] Call Trace: [ 7480.579919][ C1] [ 7480.580063][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7480.580320][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7480.580559][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7480.580828][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7480.581097][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7480.581379][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7480.581638][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7480.581938][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7480.582195][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7480.582498][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7480.582786][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7480.583092][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7480.583378][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7480.583668][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7480.583973][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7480.584286][ C1] ? get_stack_info+0x36/0xc0 [ 7480.584529][ C1] ? lock_acquire+0x1c1/0x220 [ 7480.584769][ C1] ? lock_release+0x1d5/0x250 [ 7480.585019][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7480.585263][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7480.585529][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7480.585810][ C1] ? lock_acquire+0x1c1/0x220 [ 7480.586043][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7480.586277][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7480.586552][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7480.586789][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7480.587039][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7480.587298][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7480.587579][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7480.587855][ C1] ip_local_deliver+0x19d/0x480 [ 7480.588104][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7480.588379][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7480.588644][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7480.588992][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7480.589247][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7480.589569][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7480.589833][ C1] ip_rcv+0x564/0x740 [ 7480.590038][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7480.590271][ C1] ? set_track_prepare+0x8a/0xd0 [ 7480.590525][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7480.590802][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7480.591076][ C1] ? skb_clone+0x10b/0x330 [ 7480.591305][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7480.591626][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7480.591933][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7480.592216][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7480.592511][ C1] ? __tcf_classify+0x329/0x7d0 [ 7480.592762][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7480.592994][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7480.593296][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7480.593582][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7480.593911][ C1] ? lock_acquire+0x1c1/0x220 [ 7480.594152][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7480.594449][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7480.594735][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7480.595054][ C1] ? __copy_skb_header+0xaf/0x490 [ 7480.595313][ C1] ? __skb_clone+0x57a/0x760 [ 7480.595548][ C1] netif_receive_skb+0x55/0x280 [ 7480.595796][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7480.596110][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7480.596442][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7480.596744][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7480.597019][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7480.597310][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7480.597622][ C1] ? hlock_class+0x4e/0x130 [ 7480.597857][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7480.598133][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7480.598412][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7480.598677][ C1] ? hlock_class+0x4e/0x130 [ 7480.598907][ C1] ? mark_lock+0x38/0x3e0 [ 7480.599131][ C1] ? stack_access_ok+0xda/0x1f0 [ 7480.599381][ C1] ? __lock_acquire+0xb67/0x1610 [ 7480.599636][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7480.599912][ C1] ? get_stack_info+0x36/0xc0 [ 7480.600155][ C1] ? stack_access_ok+0xda/0x1f0 [ 7480.600402][ C1] ? get_reg+0x119/0x190 [ 7480.600620][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7480.600889][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7480.601200][ C1] __tcf_classify+0x329/0x7d0 [ 7480.601443][ C1] tcf_classify+0x283/0x930 [ 7480.601674][ C1] ? arch_stack_walk+0xa2/0x100 [ 7480.601924][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7480.602180][ C1] ? get_stack_info+0x36/0xc0 [ 7480.602423][ C1] tc_run+0x2e4/0x5d0 [ 7480.602629][ C1] ? __pfx_tc_run+0x10/0x10 [ 7480.602861][ C1] ? lock_acquire+0x1c1/0x220 [ 7480.603100][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7480.603364][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7480.603617][ C1] ? lock_acquire+0x1c1/0x220 [ 7480.603862][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7480.604128][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7480.604434][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7480.604706][ C1] ? neigh_hh_output+0x348/0x590 [ 7480.604961][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7480.605228][ C1] ip_finish_output2+0x786/0x18e0 [ 7480.605485][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7480.605766][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7480.606105][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7480.606382][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7480.606635][ C1] ? __ip_finish_output+0x10f/0x770 [ 7480.606900][ C1] ip_output+0x16b/0x4f0 [ 7480.607119][ C1] ? run_timer_softirq+0x72/0x100 [ 7480.607378][ C1] ? __pfx_ip_output+0x10/0x10 [ 7480.607621][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7480.607910][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7480.608163][ C1] ? ip_local_out+0x114/0x3b0 [ 7480.608405][ C1] __ip_queue_xmit+0x672/0x1910 [ 7480.608654][ C1] ? __create_object+0x5e/0xb0 [ 7480.608898][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7480.609169][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7480.609453][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7480.609726][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7480.610009][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7480.610284][ C1] tcp_delack_timer+0x84/0x240 [ 7480.610529][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7480.610802][ C1] call_timer_fn+0x173/0x430 [ 7480.611038][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7480.611301][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7480.611564][ C1] __run_timers.part.0+0x52d/0x890 [ 7480.611826][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7480.612101][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7480.612386][ C1] ? lock_acquire+0x1c1/0x220 [ 7480.612626][ C1] ? clockevents_program_event+0xf6/0x300 [ 7480.612918][ C1] ? lock_release+0x1d5/0x250 [ 7480.613156][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7480.613422][ C1] ? ktime_get+0xb3/0x190 [ 7480.613646][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7480.613947][ C1] run_timer_softirq+0x72/0x100 [ 7480.614195][ C1] __do_softirq+0x1b9/0x7ff [ 7480.614431][ C1] irq_exit_rcu+0x98/0xc0 [ 7480.614651][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7480.614939][ C1] [ 7480.615089][ C1] [ 7480.615242][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7480.615545][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7480.615872][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7480.616847][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7480.617153][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7480.617557][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7480.617957][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7480.618357][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7480.618756][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7480.619161][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7480.619457][ C1] pipe_read+0xa16/0xdf0 [ 7480.619680][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7480.619958][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7480.620204][ C1] ? iterate_tty_write+0x299/0x540 [ 7480.620467][ C1] ? lock_release+0x1d5/0x250 [ 7480.620709][ C1] vfs_read+0x911/0xc00 [ 7480.620924][ C1] ? lock_acquire+0x1c1/0x220 [ 7480.621164][ C1] ? __might_fault+0xc6/0x180 [ 7480.621403][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7480.621644][ C1] ? __might_fault+0xc6/0x180 [ 7480.621885][ C1] ? lock_release+0x1d5/0x250 [ 7480.622126][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7480.622392][ C1] ? __fget_light+0x54/0x1e0 [ 7480.622629][ C1] ksys_read+0x17a/0x1e0 [ 7480.622849][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7480.623095][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7480.623400][ C1] do_syscall_64+0xc9/0x1e0 [ 7480.623635][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7480.623938][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7480.624166][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7480.625140][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7480.625564][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7480.625964][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7480.626364][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7480.626766][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7480.627167][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7480.627569][ C1] [ 7480.627729][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4775s! [swapper/2:0] [ 7480.628138][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7480.629377][ C2] irq event stamp: 44114564 [ 7480.629605][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7480.630133][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7480.630641][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7480.631116][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7480.631580][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7480.632032][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7480.632640][ C2] RIP: 0010:kasan_check_range+0x66/0x1c0 [ 7480.632922][ C2] Code: 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df <4d> 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d [ 7480.633888][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000216 [ 7480.634193][ C2] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7480.634587][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7480.634985][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7480.635380][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7480.635775][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7480.636170][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7480.636614][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7480.636946][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7480.637344][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7480.637739][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7480.638133][ C2] PKRU: 55555554 [ 7480.638314][ C2] Call Trace: [ 7480.638486][ C2] [ 7480.638631][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7480.638889][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7480.639131][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7480.639405][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7480.639676][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7480.639960][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7480.640222][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7480.640526][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7480.640782][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 7480.641039][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7480.641297][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7480.641603][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7480.641896][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7480.642207][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7480.642493][ C2] ? kasan_check_range+0x66/0x1c0 [ 7480.642748][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 7480.643026][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7480.643333][ C2] ? get_stack_info+0x36/0xc0 [ 7480.643572][ C2] ? lock_acquire+0x1c1/0x220 [ 7480.643814][ C2] ? lock_release+0x1d5/0x250 [ 7480.644054][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7480.644299][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7480.644571][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7480.644851][ C2] ? lock_acquire+0x1c1/0x220 [ 7480.645089][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7480.645327][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7480.645585][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7480.645815][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7480.646060][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7480.646315][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7480.646585][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7480.646861][ C2] ip_local_deliver+0x19d/0x480 [ 7480.647106][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7480.647376][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7480.647636][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7480.647978][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7480.648228][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7480.648544][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7480.648804][ C2] ip_rcv+0x564/0x740 [ 7480.649006][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7480.649237][ C2] ? set_track_prepare+0x8a/0xd0 [ 7480.649487][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7480.649759][ C2] ? start_secondary+0x21c/0x2b0 [ 7480.650009][ C2] ? skb_clone+0x10b/0x330 [ 7480.650236][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7480.650552][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7480.650854][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7480.651133][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7480.651422][ C2] ? __tcf_classify+0x329/0x7d0 [ 7480.651669][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7480.651898][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7480.652196][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7480.652477][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7480.652799][ C2] ? lock_acquire+0x1c1/0x220 [ 7480.653036][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7480.653329][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7480.653612][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7480.653930][ C2] ? __copy_skb_header+0xaf/0x490 [ 7480.654186][ C2] ? __skb_clone+0x57a/0x760 [ 7480.654418][ C2] netif_receive_skb+0x55/0x280 [ 7480.654663][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7480.654973][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7480.655302][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7480.655600][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7480.655870][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7480.656156][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7480.656465][ C2] ? get_stack_info+0x36/0xc0 [ 7480.656704][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7480.656965][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7480.657280][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7480.657553][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7480.657829][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7480.658142][ C2] ? kernel_text_address+0x17/0xe0 [ 7480.658400][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7480.658710][ C2] ? arch_stack_walk+0x8c/0x100 [ 7480.658955][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7480.659216][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7480.659497][ C2] ? lock_acquire+0x1c1/0x220 [ 7480.659734][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7480.660012][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7480.660314][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7480.660586][ C2] ? get_stack_info+0x36/0xc0 [ 7480.660824][ C2] __tcf_classify+0x329/0x7d0 [ 7480.661065][ C2] tcf_classify+0x283/0x930 [ 7480.661295][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7480.661548][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7480.661857][ C2] tc_run+0x2e4/0x5d0 [ 7480.662060][ C2] ? __pfx_tc_run+0x10/0x10 [ 7480.662289][ C2] ? lock_acquire+0x1c1/0x220 [ 7480.662526][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7480.662785][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7480.663035][ C2] ? lock_acquire+0x1c1/0x220 [ 7480.663272][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7480.663534][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7480.663837][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7480.664108][ C2] ? neigh_hh_output+0x348/0x590 [ 7480.664359][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7480.664620][ C2] ip_finish_output2+0x786/0x18e0 [ 7480.664874][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7480.665209][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7480.665481][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7480.665732][ C2] ? __ip_finish_output+0x10f/0x770 [ 7480.665994][ C2] ip_output+0x16b/0x4f0 [ 7480.666211][ C2] ? __pfx_ip_output+0x10/0x10 [ 7480.666452][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7480.666726][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7480.667034][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7480.667307][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7480.667555][ C2] ? __alloc_skb+0xd4/0x280 [ 7480.667784][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7480.668050][ C2] ? tcp_fragment+0x168/0x1040 [ 7480.668292][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7480.668541][ C2] ? ip_local_out+0x114/0x3b0 [ 7480.668776][ C2] __ip_queue_xmit+0x672/0x1910 [ 7480.669022][ C2] ? __skb_clone+0x57a/0x760 [ 7480.669255][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7480.669519][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7480.669796][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7480.670038][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7480.670285][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7480.670586][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7480.670903][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7480.671145][ C2] tcp_send_loss_probe+0x348/0x830 [ 7480.671403][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7480.671668][ C2] tcp_write_timer+0x82/0x1d0 [ 7480.671904][ C2] call_timer_fn+0x173/0x430 [ 7480.672137][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7480.672396][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7480.672654][ C2] __run_timers.part.0+0x52d/0x890 [ 7480.672913][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7480.673182][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7480.673463][ C2] ? lock_acquire+0x1c1/0x220 [ 7480.673700][ C2] ? clockevents_program_event+0xf6/0x300 [ 7480.673990][ C2] ? lock_release+0x1d5/0x250 [ 7480.674227][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7480.674488][ C2] ? ktime_get+0xb3/0x190 [ 7480.674708][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7480.675000][ C2] run_timer_softirq+0x72/0x100 [ 7480.675246][ C2] __do_softirq+0x1b9/0x7ff [ 7480.675477][ C2] irq_exit_rcu+0x98/0xc0 [ 7480.675694][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7480.675977][ C2] [ 7480.676125][ C2] [ 7480.676273][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7480.676574][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7480.676827][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7480.677790][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7480.678094][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7480.678488][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7480.678885][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7480.679283][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7480.679677][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7480.680073][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7480.680361][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7480.680619][ C2] default_idle_call+0x69/0xa0 [ 7480.680861][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7480.681110][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7480.681383][ C2] ? lock_release+0x1d5/0x250 [ 7480.681621][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7480.681891][ C2] do_idle+0xfb/0x160 [ 7480.682092][ C2] cpu_startup_entry+0x55/0x60 [ 7480.682333][ C2] start_secondary+0x21c/0x2b0 [ 7480.682575][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7480.682842][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7480.683150][ C2] [ 7508.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4801s! [perl:4135] [ 7508.569677][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7508.570901][ C1] irq event stamp: 209232 [ 7508.571116][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7508.571632][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7508.572096][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7508.572556][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7508.573010][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7508.573447][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7508.574074][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7508.574401][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7508.575372][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7508.575669][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7508.576062][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7508.576451][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7508.576839][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7508.577228][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7508.577621][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7508.578059][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7508.578384][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7508.578775][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7508.579167][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7508.579559][ C1] PKRU: 55555554 [ 7508.579736][ C1] Call Trace: [ 7508.579900][ C1] [ 7508.580047][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7508.580302][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7508.580538][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7508.580810][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7508.581076][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7508.581357][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7508.581617][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7508.581913][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7508.582170][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7508.582471][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7508.582761][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7508.583068][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7508.583350][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7508.583643][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7508.583946][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7508.584258][ C1] ? get_stack_info+0x36/0xc0 [ 7508.584500][ C1] ? lock_acquire+0x1c1/0x220 [ 7508.584742][ C1] ? lock_release+0x1d5/0x250 [ 7508.584989][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7508.585229][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7508.585497][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7508.585775][ C1] ? lock_acquire+0x1c1/0x220 [ 7508.586008][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7508.586243][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7508.586497][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7508.586725][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7508.586966][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7508.587217][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7508.587486][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7508.587760][ C1] ip_local_deliver+0x19d/0x480 [ 7508.588002][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7508.588268][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7508.588525][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7508.588864][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7508.589112][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7508.589426][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7508.589683][ C1] ip_rcv+0x564/0x740 [ 7508.589883][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7508.590109][ C1] ? set_track_prepare+0x8a/0xd0 [ 7508.590357][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7508.590627][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7508.590896][ C1] ? skb_clone+0x10b/0x330 [ 7508.591118][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7508.591429][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7508.591730][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7508.592003][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7508.592293][ C1] ? __tcf_classify+0x329/0x7d0 [ 7508.592560][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7508.592790][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7508.593092][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7508.593378][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7508.593708][ C1] ? lock_acquire+0x1c1/0x220 [ 7508.593951][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7508.594250][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7508.594535][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7508.594855][ C1] ? __copy_skb_header+0xaf/0x490 [ 7508.595114][ C1] ? __skb_clone+0x57a/0x760 [ 7508.595351][ C1] netif_receive_skb+0x55/0x280 [ 7508.595600][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7508.595914][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7508.596249][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7508.596548][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7508.596825][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7508.597115][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7508.597430][ C1] ? hlock_class+0x4e/0x130 [ 7508.597663][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7508.597943][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7508.598221][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7508.598487][ C1] ? hlock_class+0x4e/0x130 [ 7508.598719][ C1] ? mark_lock+0x38/0x3e0 [ 7508.598939][ C1] ? stack_access_ok+0xda/0x1f0 [ 7508.599190][ C1] ? __lock_acquire+0xb67/0x1610 [ 7508.599446][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7508.599723][ C1] ? get_stack_info+0x36/0xc0 [ 7508.599965][ C1] ? stack_access_ok+0xda/0x1f0 [ 7508.600214][ C1] ? get_reg+0x119/0x190 [ 7508.600430][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7508.600701][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7508.601012][ C1] __tcf_classify+0x329/0x7d0 [ 7508.601256][ C1] tcf_classify+0x283/0x930 [ 7508.601491][ C1] ? arch_stack_walk+0xa2/0x100 [ 7508.601741][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7508.601998][ C1] ? get_stack_info+0x36/0xc0 [ 7508.602240][ C1] tc_run+0x2e4/0x5d0 [ 7508.602446][ C1] ? __pfx_tc_run+0x10/0x10 [ 7508.602679][ C1] ? lock_acquire+0x1c1/0x220 [ 7508.602922][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7508.603186][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7508.603440][ C1] ? lock_acquire+0x1c1/0x220 [ 7508.603684][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7508.603951][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7508.604257][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7508.604532][ C1] ? neigh_hh_output+0x348/0x590 [ 7508.604786][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7508.605053][ C1] ip_finish_output2+0x786/0x18e0 [ 7508.605310][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7508.605589][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7508.605928][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7508.606208][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7508.606463][ C1] ? __ip_finish_output+0x10f/0x770 [ 7508.606730][ C1] ip_output+0x16b/0x4f0 [ 7508.606946][ C1] ? run_timer_softirq+0x72/0x100 [ 7508.607204][ C1] ? __pfx_ip_output+0x10/0x10 [ 7508.607450][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7508.607736][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7508.607990][ C1] ? ip_local_out+0x114/0x3b0 [ 7508.608232][ C1] __ip_queue_xmit+0x672/0x1910 [ 7508.608482][ C1] ? __create_object+0x5e/0xb0 [ 7508.608728][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7508.608997][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7508.609280][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7508.609554][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7508.609840][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7508.610114][ C1] tcp_delack_timer+0x84/0x240 [ 7508.610360][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7508.610633][ C1] call_timer_fn+0x173/0x430 [ 7508.610871][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7508.611135][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7508.611398][ C1] __run_timers.part.0+0x52d/0x890 [ 7508.611661][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7508.611934][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7508.612222][ C1] ? lock_acquire+0x1c1/0x220 [ 7508.612463][ C1] ? clockevents_program_event+0xf6/0x300 [ 7508.612758][ C1] ? lock_release+0x1d5/0x250 [ 7508.612999][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7508.613266][ C1] ? ktime_get+0xb3/0x190 [ 7508.613489][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7508.613792][ C1] run_timer_softirq+0x72/0x100 [ 7508.614043][ C1] __do_softirq+0x1b9/0x7ff [ 7508.614276][ C1] irq_exit_rcu+0x98/0xc0 [ 7508.614499][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7508.614787][ C1] [ 7508.614940][ C1] [ 7508.615091][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7508.615398][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7508.615725][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7508.616700][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7508.617011][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7508.617412][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7508.617812][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7508.618213][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7508.618616][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7508.619019][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7508.619319][ C1] pipe_read+0xa16/0xdf0 [ 7508.619540][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7508.619817][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7508.620063][ C1] ? iterate_tty_write+0x299/0x540 [ 7508.620327][ C1] ? lock_release+0x1d5/0x250 [ 7508.620570][ C1] vfs_read+0x911/0xc00 [ 7508.620784][ C1] ? lock_acquire+0x1c1/0x220 [ 7508.621025][ C1] ? __might_fault+0xc6/0x180 [ 7508.621266][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7508.621507][ C1] ? __might_fault+0xc6/0x180 [ 7508.621747][ C1] ? lock_release+0x1d5/0x250 [ 7508.621989][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7508.622255][ C1] ? __fget_light+0x54/0x1e0 [ 7508.622494][ C1] ksys_read+0x17a/0x1e0 [ 7508.622711][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7508.622958][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7508.623265][ C1] do_syscall_64+0xc9/0x1e0 [ 7508.623497][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7508.623803][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7508.624033][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7508.625007][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7508.625430][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7508.625831][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7508.626233][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7508.626634][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7508.627033][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7508.627438][ C1] [ 7508.627596][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4801s! [swapper/2:0] [ 7508.628004][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7508.629244][ C2] irq event stamp: 44114564 [ 7508.629473][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7508.630001][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7508.630509][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7508.630981][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7508.631446][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7508.631897][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7508.632505][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7508.632823][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7508.633788][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7508.634093][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7508.634488][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7508.634882][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7508.635277][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7508.635673][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7508.636067][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7508.636511][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7508.636839][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7508.637236][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7508.637632][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7508.638025][ C2] PKRU: 55555554 [ 7508.638206][ C2] Call Trace: [ 7508.638374][ C2] [ 7508.638520][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7508.638779][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7508.639020][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7508.639293][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7508.639562][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7508.639850][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7508.640112][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7508.640415][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7508.640674][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7508.640933][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7508.641241][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7508.641532][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7508.641845][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7508.642133][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7508.642419][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7508.642705][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7508.643013][ C2] ? get_stack_info+0x36/0xc0 [ 7508.643254][ C2] ? lock_acquire+0x1c1/0x220 [ 7508.643493][ C2] ? lock_release+0x1d5/0x250 [ 7508.643736][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7508.643982][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7508.644252][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7508.644533][ C2] ? lock_acquire+0x1c1/0x220 [ 7508.644770][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7508.645009][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7508.645266][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7508.645499][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7508.645742][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7508.645997][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7508.646272][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7508.646546][ C2] ip_local_deliver+0x19d/0x480 [ 7508.646792][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7508.647061][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7508.647321][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7508.647665][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7508.647917][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7508.648234][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7508.648494][ C2] ip_rcv+0x564/0x740 [ 7508.648697][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7508.648923][ C2] ? set_track_prepare+0x8a/0xd0 [ 7508.649174][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7508.649450][ C2] ? start_secondary+0x21c/0x2b0 [ 7508.649699][ C2] ? skb_clone+0x10b/0x330 [ 7508.649924][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7508.650240][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7508.650543][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7508.650820][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7508.651113][ C2] ? __tcf_classify+0x329/0x7d0 [ 7508.651358][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7508.651587][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7508.651885][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7508.652166][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7508.652488][ C2] ? lock_acquire+0x1c1/0x220 [ 7508.652726][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7508.653021][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7508.653303][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7508.653617][ C2] ? __copy_skb_header+0xaf/0x490 [ 7508.653875][ C2] ? __skb_clone+0x57a/0x760 [ 7508.654108][ C2] netif_receive_skb+0x55/0x280 [ 7508.654355][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7508.654665][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7508.654996][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7508.655291][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7508.655562][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7508.655849][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7508.656158][ C2] ? get_stack_info+0x36/0xc0 [ 7508.656396][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7508.656659][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7508.656972][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7508.657247][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7508.657521][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7508.657833][ C2] ? kernel_text_address+0x17/0xe0 [ 7508.658091][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7508.658401][ C2] ? arch_stack_walk+0x8c/0x100 [ 7508.658647][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7508.658908][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7508.659190][ C2] ? lock_acquire+0x1c1/0x220 [ 7508.659428][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7508.659707][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7508.660008][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7508.660286][ C2] ? get_stack_info+0x36/0xc0 [ 7508.660523][ C2] __tcf_classify+0x329/0x7d0 [ 7508.660763][ C2] tcf_classify+0x283/0x930 [ 7508.660994][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7508.661250][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7508.661559][ C2] tc_run+0x2e4/0x5d0 [ 7508.661763][ C2] ? __pfx_tc_run+0x10/0x10 [ 7508.661990][ C2] ? lock_acquire+0x1c1/0x220 [ 7508.662228][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7508.662486][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7508.662737][ C2] ? lock_acquire+0x1c1/0x220 [ 7508.662974][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7508.663236][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7508.663536][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7508.663815][ C2] ? neigh_hh_output+0x348/0x590 [ 7508.664065][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7508.664327][ C2] ip_finish_output2+0x786/0x18e0 [ 7508.664580][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7508.664914][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7508.665190][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7508.665440][ C2] ? __ip_finish_output+0x10f/0x770 [ 7508.665704][ C2] ip_output+0x16b/0x4f0 [ 7508.665918][ C2] ? __pfx_ip_output+0x10/0x10 [ 7508.666160][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7508.666433][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7508.666743][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7508.667014][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7508.667263][ C2] ? __alloc_skb+0xd4/0x280 [ 7508.667493][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7508.667759][ C2] ? tcp_fragment+0x168/0x1040 [ 7508.668000][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7508.668250][ C2] ? ip_local_out+0x114/0x3b0 [ 7508.668488][ C2] __ip_queue_xmit+0x672/0x1910 [ 7508.668734][ C2] ? __skb_clone+0x57a/0x760 [ 7508.668967][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7508.669230][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7508.669510][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7508.669752][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7508.669997][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7508.670297][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7508.670613][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7508.670857][ C2] tcp_send_loss_probe+0x348/0x830 [ 7508.671116][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7508.671382][ C2] tcp_write_timer+0x82/0x1d0 [ 7508.671619][ C2] call_timer_fn+0x173/0x430 [ 7508.671853][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7508.672113][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7508.672372][ C2] __run_timers.part.0+0x52d/0x890 [ 7508.672630][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7508.672897][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7508.673179][ C2] ? lock_acquire+0x1c1/0x220 [ 7508.673415][ C2] ? clockevents_program_event+0xf6/0x300 [ 7508.673708][ C2] ? lock_release+0x1d5/0x250 [ 7508.673944][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7508.674208][ C2] ? ktime_get+0xb3/0x190 [ 7508.674427][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7508.674722][ C2] run_timer_softirq+0x72/0x100 [ 7508.674966][ C2] __do_softirq+0x1b9/0x7ff [ 7508.675197][ C2] irq_exit_rcu+0x98/0xc0 [ 7508.675415][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7508.675698][ C2] [ 7508.675846][ C2] [ 7508.675998][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7508.676298][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7508.676552][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7508.677516][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7508.677820][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7508.678218][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7508.678612][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7508.679006][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7508.679400][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7508.679800][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7508.680085][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7508.680343][ C2] default_idle_call+0x69/0xa0 [ 7508.680585][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7508.680833][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7508.681107][ C2] ? lock_release+0x1d5/0x250 [ 7508.681345][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7508.681616][ C2] do_idle+0xfb/0x160 [ 7508.681818][ C2] cpu_startup_entry+0x55/0x60 [ 7508.682059][ C2] start_secondary+0x21c/0x2b0 [ 7508.682301][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7508.682567][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7508.682875][ C2] [ 7532.773103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7532.773448][ C1] rcu: 1-....: (5165445 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1265654 [ 7532.774023][ C1] rcu: (t=5177886 jiffies g=1882453 q=721 ncpus=4) [ 7532.774359][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7532.774817][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7532.775413][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7532.775732][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7532.776680][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7532.776981][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7532.777370][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7532.777762][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7532.778152][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7532.778541][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7532.778929][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7532.779368][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7532.779697][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7532.780088][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7532.780477][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7532.780867][ C1] PKRU: 55555554 [ 7532.781044][ C1] Call Trace: [ 7532.781211][ C1] [ 7532.781354][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7532.781622][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7532.781867][ C1] ? check_cpu_stall+0x284/0x500 [ 7532.782113][ C1] ? rcu_pending+0x92/0x360 [ 7532.782339][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7532.782602][ C1] ? update_process_times+0xb9/0x110 [ 7532.782866][ C1] ? tick_sched_handle+0x67/0x130 [ 7532.783116][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7532.783397][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7532.783656][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7532.783967][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7532.784241][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7532.784530][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7532.784804][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7532.785102][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7532.785357][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7532.785659][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7532.785946][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7532.786253][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7532.786535][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7532.786823][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7532.787104][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7532.787408][ C1] ? get_stack_info+0x36/0xc0 [ 7532.787643][ C1] ? lock_acquire+0x1c1/0x220 [ 7532.787878][ C1] ? lock_release+0x1d5/0x250 [ 7532.788111][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7532.788354][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7532.788618][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7532.788899][ C1] ? lock_acquire+0x1c1/0x220 [ 7532.789132][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7532.789364][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7532.789618][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7532.789848][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7532.790090][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7532.790341][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7532.790607][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7532.790878][ C1] ip_local_deliver+0x19d/0x480 [ 7532.791119][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7532.791390][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7532.791647][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7532.791984][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7532.792230][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7532.792542][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7532.792798][ C1] ip_rcv+0x564/0x740 [ 7532.792996][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7532.793222][ C1] ? set_track_prepare+0x8a/0xd0 [ 7532.793487][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7532.793766][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7532.794038][ C1] ? skb_clone+0x10b/0x330 [ 7532.794268][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7532.794587][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7532.794904][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7532.795200][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7532.795495][ C1] ? __tcf_classify+0x329/0x7d0 [ 7532.795743][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7532.795975][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7532.796276][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7532.796560][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7532.796886][ C1] ? lock_acquire+0x1c1/0x220 [ 7532.797125][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7532.797421][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7532.797708][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7532.798025][ C1] ? __copy_skb_header+0xaf/0x490 [ 7532.798283][ C1] ? __skb_clone+0x57a/0x760 [ 7532.798519][ C1] netif_receive_skb+0x55/0x280 [ 7532.798767][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7532.799079][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7532.799411][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7532.799712][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7532.799986][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7532.800276][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7532.800588][ C1] ? hlock_class+0x4e/0x130 [ 7532.800822][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7532.801097][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7532.801376][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7532.801640][ C1] ? hlock_class+0x4e/0x130 [ 7532.801870][ C1] ? mark_lock+0x38/0x3e0 [ 7532.802091][ C1] ? stack_access_ok+0xda/0x1f0 [ 7532.802341][ C1] ? __lock_acquire+0xb67/0x1610 [ 7532.802595][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7532.802872][ C1] ? get_stack_info+0x36/0xc0 [ 7532.803114][ C1] ? stack_access_ok+0xda/0x1f0 [ 7532.803361][ C1] ? get_reg+0x119/0x190 [ 7532.803581][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7532.803849][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7532.804159][ C1] __tcf_classify+0x329/0x7d0 [ 7532.804402][ C1] tcf_classify+0x283/0x930 [ 7532.804632][ C1] ? arch_stack_walk+0xa2/0x100 [ 7532.804881][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7532.805139][ C1] ? get_stack_info+0x36/0xc0 [ 7532.805381][ C1] tc_run+0x2e4/0x5d0 [ 7532.805586][ C1] ? __pfx_tc_run+0x10/0x10 [ 7532.805818][ C1] ? lock_acquire+0x1c1/0x220 [ 7532.806057][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7532.806319][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7532.806572][ C1] ? lock_acquire+0x1c1/0x220 [ 7532.806810][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7532.807076][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7532.807382][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7532.807654][ C1] ? neigh_hh_output+0x348/0x590 [ 7532.807906][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7532.808174][ C1] ip_finish_output2+0x786/0x18e0 [ 7532.808432][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7532.808711][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7532.809049][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7532.809325][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7532.809579][ C1] ? __ip_finish_output+0x10f/0x770 [ 7532.809845][ C1] ip_output+0x16b/0x4f0 [ 7532.810064][ C1] ? run_timer_softirq+0x72/0x100 [ 7532.810322][ C1] ? __pfx_ip_output+0x10/0x10 [ 7532.810565][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7532.810852][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7532.811104][ C1] ? ip_local_out+0x114/0x3b0 [ 7532.811345][ C1] __ip_queue_xmit+0x672/0x1910 [ 7532.811594][ C1] ? __create_object+0x5e/0xb0 [ 7532.811837][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7532.812106][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7532.812389][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7532.812662][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7532.812944][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7532.813219][ C1] tcp_delack_timer+0x84/0x240 [ 7532.813463][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7532.813746][ C1] call_timer_fn+0x173/0x430 [ 7532.813983][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7532.814248][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7532.814510][ C1] __run_timers.part.0+0x52d/0x890 [ 7532.814771][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7532.815044][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7532.815330][ C1] ? lock_acquire+0x1c1/0x220 [ 7532.815570][ C1] ? clockevents_program_event+0xf6/0x300 [ 7532.815863][ C1] ? lock_release+0x1d5/0x250 [ 7532.816102][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7532.816367][ C1] ? ktime_get+0xb3/0x190 [ 7532.816588][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7532.816887][ C1] run_timer_softirq+0x72/0x100 [ 7532.817135][ C1] __do_softirq+0x1b9/0x7ff [ 7532.817368][ C1] irq_exit_rcu+0x98/0xc0 [ 7532.817590][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7532.817876][ C1] [ 7532.818025][ C1] [ 7532.818178][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7532.818482][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7532.818808][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7532.819780][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7532.820086][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7532.820486][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7532.820885][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7532.821283][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7532.821683][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7532.822086][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7532.822381][ C1] pipe_read+0xa16/0xdf0 [ 7532.822604][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7532.822881][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7532.823126][ C1] ? iterate_tty_write+0x299/0x540 [ 7532.823387][ C1] ? lock_release+0x1d5/0x250 [ 7532.823636][ C1] vfs_read+0x911/0xc00 [ 7532.823850][ C1] ? lock_acquire+0x1c1/0x220 [ 7532.824089][ C1] ? __might_fault+0xc6/0x180 [ 7532.824329][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7532.824568][ C1] ? __might_fault+0xc6/0x180 [ 7532.824808][ C1] ? lock_release+0x1d5/0x250 [ 7532.825050][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7532.825315][ C1] ? __fget_light+0x54/0x1e0 [ 7532.825552][ C1] ksys_read+0x17a/0x1e0 [ 7532.825769][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7532.826015][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7532.826320][ C1] do_syscall_64+0xc9/0x1e0 [ 7532.826553][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7532.826853][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7532.827079][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7532.828052][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7532.828473][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7532.828872][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7532.829274][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7532.829673][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7532.830072][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7532.830473][ C1] [ 7532.830633][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7532.830903][ C2] NMI backtrace for cpu 2 [ 7532.830908][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7532.830913][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7532.830917][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7532.830925][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7532.830930][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7532.830935][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7532.830938][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7532.830941][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7532.830942][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7532.830944][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7532.830945][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7532.830947][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7532.830950][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7532.830952][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7532.830953][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7532.830954][ C2] PKRU: 55555554 [ 7532.830955][ C2] Call Trace: [ 7532.830957][ C2] [ 7532.830958][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7532.830964][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7532.830968][ C2] ? nmi_handle+0x153/0x420 [ 7532.830972][ C2] ? default_do_nmi+0x41/0x100 [ 7532.830975][ C2] ? exc_nmi+0xf3/0x120 [ 7532.830977][ C2] ? end_repeat_nmi+0xf/0x60 [ 7532.830982][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7532.830985][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7532.830988][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7532.830991][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7532.830994][ C2] [ 7532.830995][ C2] [ 7532.830996][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7532.830999][ C2] ? get_stack_info+0x36/0xc0 [ 7532.831003][ C2] ? lock_acquire+0x1c1/0x220 [ 7532.831006][ C2] ? lock_release+0x1d5/0x250 [ 7532.831009][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7532.831013][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7532.831015][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7532.831019][ C2] ? lock_acquire+0x1c1/0x220 [ 7532.831021][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7532.831024][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7532.831027][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7532.831033][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7532.831035][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7532.831040][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7532.831044][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7532.831047][ C2] ip_local_deliver+0x19d/0x480 [ 7532.831049][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7532.831051][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7532.831054][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7532.831058][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7532.831062][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7532.831064][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7532.831073][ C2] ip_rcv+0x564/0x740 [ 7532.831075][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7532.831077][ C2] ? set_track_prepare+0x8a/0xd0 [ 7532.831081][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7532.831084][ C2] ? start_secondary+0x21c/0x2b0 [ 7532.831087][ C2] ? skb_clone+0x10b/0x330 [ 7532.831090][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7532.831095][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7532.831101][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7532.831103][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7532.831111][ C2] ? __tcf_classify+0x329/0x7d0 [ 7532.831115][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7532.831117][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7532.831120][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7532.831123][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7532.831127][ C2] ? lock_acquire+0x1c1/0x220 [ 7532.831129][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7532.831133][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7532.831137][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7532.831141][ C2] ? __copy_skb_header+0xaf/0x490 [ 7532.831145][ C2] ? __skb_clone+0x57a/0x760 [ 7532.831147][ C2] netif_receive_skb+0x55/0x280 [ 7532.831150][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7532.831157][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7532.831163][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7532.831170][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7532.831174][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7532.831184][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7532.831191][ C2] ? get_stack_info+0x36/0xc0 [ 7532.831196][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7532.831199][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7532.831202][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7532.831204][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7532.831207][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7532.831210][ C2] ? kernel_text_address+0x17/0xe0 [ 7532.831213][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7532.831216][ C2] ? arch_stack_walk+0x8c/0x100 [ 7532.831219][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7532.831222][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7532.831226][ C2] ? lock_acquire+0x1c1/0x220 [ 7532.831228][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7532.831232][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7532.831236][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7532.831238][ C2] ? get_stack_info+0x36/0xc0 [ 7532.831242][ C2] __tcf_classify+0x329/0x7d0 [ 7532.831247][ C2] tcf_classify+0x283/0x930 [ 7532.831252][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7532.831255][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7532.831259][ C2] tc_run+0x2e4/0x5d0 [ 7532.831262][ C2] ? __pfx_tc_run+0x10/0x10 [ 7532.831265][ C2] ? lock_acquire+0x1c1/0x220 [ 7532.831268][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7532.831272][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7532.831276][ C2] ? lock_acquire+0x1c1/0x220 [ 7532.831278][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7532.831281][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7532.831284][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7532.831286][ C2] ? neigh_hh_output+0x348/0x590 [ 7532.831290][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7532.831294][ C2] ip_finish_output2+0x786/0x18e0 [ 7532.831297][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7532.831304][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7532.831307][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7532.831311][ C2] ? __ip_finish_output+0x10f/0x770 [ 7532.831314][ C2] ip_output+0x16b/0x4f0 [ 7532.831317][ C2] ? __pfx_ip_output+0x10/0x10 [ 7532.831320][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7532.831322][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7532.831326][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7532.831328][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7532.831331][ C2] ? __alloc_skb+0xd4/0x280 [ 7532.831333][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7532.831336][ C2] ? tcp_fragment+0x168/0x1040 [ 7532.831339][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7532.831342][ C2] ? ip_local_out+0x114/0x3b0 [ 7532.831345][ C2] __ip_queue_xmit+0x672/0x1910 [ 7532.831349][ C2] ? __skb_clone+0x57a/0x760 [ 7532.831352][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7532.831357][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7532.831360][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7532.831363][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7532.831367][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7532.831371][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7532.831374][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7532.831377][ C2] tcp_send_loss_probe+0x348/0x830 [ 7532.831380][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7532.831382][ C2] tcp_write_timer+0x82/0x1d0 [ 7532.831386][ C2] call_timer_fn+0x173/0x430 [ 7532.831389][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7532.831394][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7532.831397][ C2] __run_timers.part.0+0x52d/0x890 [ 7532.831400][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7532.831404][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7532.831407][ C2] ? lock_acquire+0x1c1/0x220 [ 7532.831410][ C2] ? clockevents_program_event+0xf6/0x300 [ 7532.831413][ C2] ? lock_release+0x1d5/0x250 [ 7532.831416][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7532.831419][ C2] ? ktime_get+0xb3/0x190 [ 7532.831422][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7532.831426][ C2] run_timer_softirq+0x72/0x100 [ 7532.831430][ C2] __do_softirq+0x1b9/0x7ff [ 7532.831434][ C2] irq_exit_rcu+0x98/0xc0 [ 7532.831436][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7532.831439][ C2] [ 7532.831440][ C2] [ 7532.831441][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7532.831444][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7532.831447][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7532.831450][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7532.831451][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7532.831453][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7532.831454][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7532.831455][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7532.831457][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7532.831460][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7532.831463][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7532.831466][ C2] default_idle_call+0x69/0xa0 [ 7532.831469][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7532.831471][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7532.831474][ C2] ? lock_release+0x1d5/0x250 [ 7532.831477][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7532.831480][ C2] do_idle+0xfb/0x160 [ 7532.831483][ C2] cpu_startup_entry+0x55/0x60 [ 7532.831485][ C2] start_secondary+0x21c/0x2b0 [ 7532.831488][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7532.831492][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7532.831497][ C2] [ 7560.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4850s! [perl:4135] [ 7560.569687][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7560.570916][ C1] irq event stamp: 209232 [ 7560.571132][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7560.571650][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7560.572113][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7560.572573][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7560.573026][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7560.573484][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7560.574098][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7560.574428][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7560.575386][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7560.575685][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7560.576075][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7560.576462][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7560.576854][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7560.577243][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7560.577631][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7560.578090][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7560.578422][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7560.578826][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7560.579226][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7560.579625][ C1] PKRU: 55555554 [ 7560.579807][ C1] Call Trace: [ 7560.579979][ C1] [ 7560.580127][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7560.580389][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7560.580634][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7560.580910][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7560.581184][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7560.581473][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7560.581738][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7560.582045][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7560.582308][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7560.582620][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7560.582915][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7560.583231][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7560.583526][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7560.583820][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7560.584111][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7560.584423][ C1] ? get_stack_info+0x36/0xc0 [ 7560.584664][ C1] ? lock_acquire+0x1c1/0x220 [ 7560.584904][ C1] ? lock_release+0x1d5/0x250 [ 7560.585144][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7560.585394][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7560.585666][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7560.585951][ C1] ? lock_acquire+0x1c1/0x220 [ 7560.586189][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7560.586432][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7560.586692][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7560.586928][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7560.587176][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7560.587435][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7560.587711][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7560.587988][ C1] ip_local_deliver+0x19d/0x480 [ 7560.588237][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7560.588507][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7560.588772][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7560.589122][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7560.589376][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7560.589697][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7560.589961][ C1] ip_rcv+0x564/0x740 [ 7560.590165][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7560.590396][ C1] ? set_track_prepare+0x8a/0xd0 [ 7560.590649][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7560.590927][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7560.591200][ C1] ? skb_clone+0x10b/0x330 [ 7560.591429][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7560.591748][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7560.592054][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7560.592338][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7560.592632][ C1] ? __tcf_classify+0x329/0x7d0 [ 7560.592882][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7560.593113][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7560.593416][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7560.593703][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7560.594030][ C1] ? lock_acquire+0x1c1/0x220 [ 7560.594270][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7560.594566][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7560.594853][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7560.595170][ C1] ? __copy_skb_header+0xaf/0x490 [ 7560.595428][ C1] ? __skb_clone+0x57a/0x760 [ 7560.595662][ C1] netif_receive_skb+0x55/0x280 [ 7560.595911][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7560.596224][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7560.596557][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7560.596858][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7560.597133][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7560.597421][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7560.597734][ C1] ? hlock_class+0x4e/0x130 [ 7560.597968][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7560.598243][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7560.598519][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7560.598785][ C1] ? hlock_class+0x4e/0x130 [ 7560.599016][ C1] ? mark_lock+0x38/0x3e0 [ 7560.599237][ C1] ? stack_access_ok+0xda/0x1f0 [ 7560.599485][ C1] ? __lock_acquire+0xb67/0x1610 [ 7560.599742][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7560.600021][ C1] ? get_stack_info+0x36/0xc0 [ 7560.600261][ C1] ? stack_access_ok+0xda/0x1f0 [ 7560.600510][ C1] ? get_reg+0x119/0x190 [ 7560.600730][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7560.600998][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7560.601310][ C1] __tcf_classify+0x329/0x7d0 [ 7560.601552][ C1] tcf_classify+0x283/0x930 [ 7560.601784][ C1] ? arch_stack_walk+0xa2/0x100 [ 7560.602034][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7560.602292][ C1] ? get_stack_info+0x36/0xc0 [ 7560.602534][ C1] tc_run+0x2e4/0x5d0 [ 7560.602740][ C1] ? __pfx_tc_run+0x10/0x10 [ 7560.602971][ C1] ? lock_acquire+0x1c1/0x220 [ 7560.603211][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7560.603475][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7560.603729][ C1] ? lock_acquire+0x1c1/0x220 [ 7560.603969][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7560.604234][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7560.604540][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7560.604812][ C1] ? neigh_hh_output+0x348/0x590 [ 7560.605065][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7560.605331][ C1] ip_finish_output2+0x786/0x18e0 [ 7560.605587][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7560.605866][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7560.606204][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7560.606480][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7560.606734][ C1] ? __ip_finish_output+0x10f/0x770 [ 7560.606999][ C1] ip_output+0x16b/0x4f0 [ 7560.607216][ C1] ? run_timer_softirq+0x72/0x100 [ 7560.607473][ C1] ? __pfx_ip_output+0x10/0x10 [ 7560.607716][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7560.608005][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7560.608257][ C1] ? ip_local_out+0x114/0x3b0 [ 7560.608495][ C1] __ip_queue_xmit+0x672/0x1910 [ 7560.608745][ C1] ? __create_object+0x5e/0xb0 [ 7560.608990][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7560.609257][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7560.609539][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7560.609812][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7560.610093][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7560.610366][ C1] tcp_delack_timer+0x84/0x240 [ 7560.610610][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7560.610883][ C1] call_timer_fn+0x173/0x430 [ 7560.611119][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7560.611381][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7560.611643][ C1] __run_timers.part.0+0x52d/0x890 [ 7560.611904][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7560.612181][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7560.612466][ C1] ? lock_acquire+0x1c1/0x220 [ 7560.612704][ C1] ? clockevents_program_event+0xf6/0x300 [ 7560.612997][ C1] ? lock_release+0x1d5/0x250 [ 7560.613238][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7560.613505][ C1] ? ktime_get+0xb3/0x190 [ 7560.613728][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7560.614023][ C1] run_timer_softirq+0x72/0x100 [ 7560.614272][ C1] __do_softirq+0x1b9/0x7ff [ 7560.614506][ C1] irq_exit_rcu+0x98/0xc0 [ 7560.614725][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7560.615012][ C1] [ 7560.615161][ C1] [ 7560.615311][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7560.615616][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7560.615940][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7560.616914][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7560.617223][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7560.617622][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7560.618024][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7560.618423][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7560.618822][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7560.619223][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7560.619521][ C1] pipe_read+0xa16/0xdf0 [ 7560.619741][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7560.620022][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7560.620264][ C1] ? iterate_tty_write+0x299/0x540 [ 7560.620526][ C1] ? lock_release+0x1d5/0x250 [ 7560.620765][ C1] vfs_read+0x911/0xc00 [ 7560.620981][ C1] ? lock_acquire+0x1c1/0x220 [ 7560.621218][ C1] ? __might_fault+0xc6/0x180 [ 7560.621461][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7560.621701][ C1] ? __might_fault+0xc6/0x180 [ 7560.621942][ C1] ? lock_release+0x1d5/0x250 [ 7560.622181][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7560.622448][ C1] ? __fget_light+0x54/0x1e0 [ 7560.622684][ C1] ksys_read+0x17a/0x1e0 [ 7560.622902][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7560.623145][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7560.623454][ C1] do_syscall_64+0xc9/0x1e0 [ 7560.623689][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7560.623991][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7560.624220][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7560.625192][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7560.625614][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7560.626014][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7560.626413][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7560.626812][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7560.627214][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7560.627615][ C1] [ 7560.627772][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4850s! [swapper/2:0] [ 7560.628188][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7560.629432][ C2] irq event stamp: 44114564 [ 7560.629657][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7560.630192][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7560.630700][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7560.631176][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7560.631641][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7560.632093][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7560.632701][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7560.633023][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7560.633990][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7560.634296][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7560.634690][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7560.635086][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7560.635483][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7560.635879][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7560.636275][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7560.636718][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7560.637047][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7560.637447][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7560.637843][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7560.638237][ C2] PKRU: 55555554 [ 7560.638417][ C2] Call Trace: [ 7560.638587][ C2] [ 7560.638732][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7560.638991][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7560.639234][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7560.639507][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7560.639782][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7560.640068][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7560.640331][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7560.640635][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7560.640894][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7560.641155][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7560.641466][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7560.641759][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7560.642070][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7560.642359][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7560.642652][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7560.642939][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7560.643249][ C2] ? get_stack_info+0x36/0xc0 [ 7560.643492][ C2] ? lock_acquire+0x1c1/0x220 [ 7560.643728][ C2] ? lock_release+0x1d5/0x250 [ 7560.643968][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7560.644215][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7560.644485][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7560.644770][ C2] ? lock_acquire+0x1c1/0x220 [ 7560.645006][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7560.645245][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7560.645503][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7560.645736][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7560.645981][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7560.646237][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7560.646508][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7560.646784][ C2] ip_local_deliver+0x19d/0x480 [ 7560.647031][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7560.647300][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7560.647563][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7560.647907][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7560.648158][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7560.648476][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7560.648737][ C2] ip_rcv+0x564/0x740 [ 7560.648939][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7560.649169][ C2] ? set_track_prepare+0x8a/0xd0 [ 7560.649421][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7560.649699][ C2] ? start_secondary+0x21c/0x2b0 [ 7560.649950][ C2] ? skb_clone+0x10b/0x330 [ 7560.650175][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7560.650492][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7560.650797][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7560.651077][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7560.651371][ C2] ? __tcf_classify+0x329/0x7d0 [ 7560.651619][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7560.651849][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7560.652147][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7560.652431][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7560.652755][ C2] ? lock_acquire+0x1c1/0x220 [ 7560.652992][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7560.653288][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7560.653576][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7560.653891][ C2] ? __copy_skb_header+0xaf/0x490 [ 7560.654147][ C2] ? __skb_clone+0x57a/0x760 [ 7560.654381][ C2] netif_receive_skb+0x55/0x280 [ 7560.654628][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7560.654942][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7560.655273][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7560.655571][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7560.655843][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7560.656129][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7560.656440][ C2] ? get_stack_info+0x36/0xc0 [ 7560.656681][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7560.656944][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7560.657260][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7560.657532][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7560.657807][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7560.658121][ C2] ? kernel_text_address+0x17/0xe0 [ 7560.658381][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7560.658691][ C2] ? arch_stack_walk+0x8c/0x100 [ 7560.658939][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7560.659202][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7560.659490][ C2] ? lock_acquire+0x1c1/0x220 [ 7560.659727][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7560.660008][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7560.660312][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7560.660587][ C2] ? get_stack_info+0x36/0xc0 [ 7560.660828][ C2] __tcf_classify+0x329/0x7d0 [ 7560.661067][ C2] tcf_classify+0x283/0x930 [ 7560.661298][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7560.661552][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7560.661864][ C2] tc_run+0x2e4/0x5d0 [ 7560.662068][ C2] ? __pfx_tc_run+0x10/0x10 [ 7560.662299][ C2] ? lock_acquire+0x1c1/0x220 [ 7560.662535][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7560.662795][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7560.663047][ C2] ? lock_acquire+0x1c1/0x220 [ 7560.663283][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7560.663550][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7560.663853][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7560.664122][ C2] ? neigh_hh_output+0x348/0x590 [ 7560.664374][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7560.664637][ C2] ip_finish_output2+0x786/0x18e0 [ 7560.664895][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7560.665232][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7560.665507][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7560.665758][ C2] ? __ip_finish_output+0x10f/0x770 [ 7560.666023][ C2] ip_output+0x16b/0x4f0 [ 7560.666238][ C2] ? __pfx_ip_output+0x10/0x10 [ 7560.666481][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7560.666756][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7560.667065][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7560.667343][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7560.667593][ C2] ? __alloc_skb+0xd4/0x280 [ 7560.667824][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7560.668094][ C2] ? tcp_fragment+0x168/0x1040 [ 7560.668336][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7560.668587][ C2] ? ip_local_out+0x114/0x3b0 [ 7560.668826][ C2] __ip_queue_xmit+0x672/0x1910 [ 7560.669073][ C2] ? __skb_clone+0x57a/0x760 [ 7560.669307][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7560.669574][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7560.669852][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7560.670096][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7560.670345][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7560.670642][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7560.670960][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7560.671204][ C2] tcp_send_loss_probe+0x348/0x830 [ 7560.671463][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7560.671730][ C2] tcp_write_timer+0x82/0x1d0 [ 7560.671969][ C2] call_timer_fn+0x173/0x430 [ 7560.672205][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7560.672466][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7560.672726][ C2] __run_timers.part.0+0x52d/0x890 [ 7560.672987][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7560.673255][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7560.673545][ C2] ? lock_acquire+0x1c1/0x220 [ 7560.673782][ C2] ? clockevents_program_event+0xf6/0x300 [ 7560.674071][ C2] ? lock_release+0x1d5/0x250 [ 7560.674311][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7560.674574][ C2] ? ktime_get+0xb3/0x190 [ 7560.674792][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7560.675089][ C2] run_timer_softirq+0x72/0x100 [ 7560.675338][ C2] __do_softirq+0x1b9/0x7ff [ 7560.675567][ C2] irq_exit_rcu+0x98/0xc0 [ 7560.675789][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7560.676070][ C2] [ 7560.676222][ C2] [ 7560.676371][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7560.676673][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7560.676929][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7560.677892][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7560.678199][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7560.678596][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7560.678991][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7560.679388][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7560.679786][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7560.680185][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7560.680475][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7560.680734][ C2] default_idle_call+0x69/0xa0 [ 7560.680976][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7560.681226][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7560.681504][ C2] ? lock_release+0x1d5/0x250 [ 7560.681740][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7560.682014][ C2] do_idle+0xfb/0x160 [ 7560.682218][ C2] cpu_startup_entry+0x55/0x60 [ 7560.682459][ C2] start_secondary+0x21c/0x2b0 [ 7560.682700][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7560.682970][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7560.683277][ C2] [ 7588.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4876s! [perl:4135] [ 7588.569690][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7588.570915][ C1] irq event stamp: 209232 [ 7588.571128][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7588.571645][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7588.572111][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7588.572568][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7588.573019][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7588.573480][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7588.574094][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7588.574419][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7588.575376][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7588.575676][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7588.576065][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7588.576456][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7588.576847][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7588.577235][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7588.577624][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7588.578061][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7588.578386][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7588.578779][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7588.579169][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7588.579557][ C1] PKRU: 55555554 [ 7588.579735][ C1] Call Trace: [ 7588.579902][ C1] [ 7588.580046][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7588.580302][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7588.580541][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7588.580810][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7588.581078][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7588.581359][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7588.581618][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7588.581919][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7588.582175][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7588.582478][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7588.582767][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7588.583072][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7588.583377][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7588.583671][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7588.583961][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7588.584272][ C1] ? get_stack_info+0x36/0xc0 [ 7588.584524][ C1] ? lock_acquire+0x1c1/0x220 [ 7588.584756][ C1] ? lock_release+0x1d5/0x250 [ 7588.584992][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7588.585234][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7588.585499][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7588.585779][ C1] ? lock_acquire+0x1c1/0x220 [ 7588.586011][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7588.586248][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7588.586501][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7588.586731][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7588.586973][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7588.587226][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7588.587496][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7588.587766][ C1] ip_local_deliver+0x19d/0x480 [ 7588.588008][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7588.588274][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7588.588533][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7588.588873][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7588.589121][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7588.589434][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7588.589690][ C1] ip_rcv+0x564/0x740 [ 7588.589909][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7588.590141][ C1] ? set_track_prepare+0x8a/0xd0 [ 7588.590396][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7588.590673][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7588.590947][ C1] ? skb_clone+0x10b/0x330 [ 7588.591177][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7588.591500][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7588.591807][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7588.592091][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7588.592386][ C1] ? __tcf_classify+0x329/0x7d0 [ 7588.592636][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7588.592869][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7588.593169][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7588.593458][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7588.593784][ C1] ? lock_acquire+0x1c1/0x220 [ 7588.594025][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7588.594320][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7588.594609][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7588.594927][ C1] ? __copy_skb_header+0xaf/0x490 [ 7588.595187][ C1] ? __skb_clone+0x57a/0x760 [ 7588.595422][ C1] netif_receive_skb+0x55/0x280 [ 7588.595670][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7588.595985][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7588.596317][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7588.596618][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7588.596892][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7588.597182][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7588.597494][ C1] ? hlock_class+0x4e/0x130 [ 7588.597730][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7588.598005][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7588.598282][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7588.598547][ C1] ? hlock_class+0x4e/0x130 [ 7588.598777][ C1] ? mark_lock+0x38/0x3e0 [ 7588.598999][ C1] ? stack_access_ok+0xda/0x1f0 [ 7588.599248][ C1] ? __lock_acquire+0xb67/0x1610 [ 7588.599502][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7588.599779][ C1] ? get_stack_info+0x36/0xc0 [ 7588.600020][ C1] ? stack_access_ok+0xda/0x1f0 [ 7588.600267][ C1] ? get_reg+0x119/0x190 [ 7588.600485][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7588.600752][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7588.601063][ C1] __tcf_classify+0x329/0x7d0 [ 7588.601306][ C1] tcf_classify+0x283/0x930 [ 7588.601536][ C1] ? arch_stack_walk+0xa2/0x100 [ 7588.601786][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7588.602043][ C1] ? get_stack_info+0x36/0xc0 [ 7588.602284][ C1] tc_run+0x2e4/0x5d0 [ 7588.602489][ C1] ? __pfx_tc_run+0x10/0x10 [ 7588.602721][ C1] ? lock_acquire+0x1c1/0x220 [ 7588.602960][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7588.603223][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7588.603480][ C1] ? lock_acquire+0x1c1/0x220 [ 7588.603719][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7588.603983][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7588.604291][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7588.604563][ C1] ? neigh_hh_output+0x348/0x590 [ 7588.604817][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7588.605082][ C1] ip_finish_output2+0x786/0x18e0 [ 7588.605339][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7588.605620][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7588.605957][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7588.606232][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7588.606485][ C1] ? __ip_finish_output+0x10f/0x770 [ 7588.606750][ C1] ip_output+0x16b/0x4f0 [ 7588.606968][ C1] ? run_timer_softirq+0x72/0x100 [ 7588.607225][ C1] ? __pfx_ip_output+0x10/0x10 [ 7588.607468][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7588.607754][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7588.608007][ C1] ? ip_local_out+0x114/0x3b0 [ 7588.608247][ C1] __ip_queue_xmit+0x672/0x1910 [ 7588.608496][ C1] ? __create_object+0x5e/0xb0 [ 7588.608739][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7588.609006][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7588.609291][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7588.609563][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7588.609843][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7588.610118][ C1] tcp_delack_timer+0x84/0x240 [ 7588.610361][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7588.610635][ C1] call_timer_fn+0x173/0x430 [ 7588.610868][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7588.611131][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7588.611393][ C1] __run_timers.part.0+0x52d/0x890 [ 7588.611655][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7588.611929][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7588.612213][ C1] ? lock_acquire+0x1c1/0x220 [ 7588.612453][ C1] ? clockevents_program_event+0xf6/0x300 [ 7588.612744][ C1] ? lock_release+0x1d5/0x250 [ 7588.612983][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7588.613247][ C1] ? ktime_get+0xb3/0x190 [ 7588.613475][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7588.613772][ C1] run_timer_softirq+0x72/0x100 [ 7588.614019][ C1] __do_softirq+0x1b9/0x7ff [ 7588.614253][ C1] irq_exit_rcu+0x98/0xc0 [ 7588.614473][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7588.614761][ C1] [ 7588.614910][ C1] [ 7588.615062][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7588.615365][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7588.615691][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7588.616663][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7588.616970][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7588.617373][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7588.617773][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7588.618173][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7588.618573][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7588.618976][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7588.619273][ C1] pipe_read+0xa16/0xdf0 [ 7588.619497][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7588.619777][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7588.620021][ C1] ? iterate_tty_write+0x299/0x540 [ 7588.620284][ C1] ? lock_release+0x1d5/0x250 [ 7588.620523][ C1] vfs_read+0x911/0xc00 [ 7588.620739][ C1] ? lock_acquire+0x1c1/0x220 [ 7588.620979][ C1] ? __might_fault+0xc6/0x180 [ 7588.621219][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7588.621459][ C1] ? __might_fault+0xc6/0x180 [ 7588.621700][ C1] ? lock_release+0x1d5/0x250 [ 7588.621940][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7588.622206][ C1] ? __fget_light+0x54/0x1e0 [ 7588.622441][ C1] ksys_read+0x17a/0x1e0 [ 7588.622661][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7588.622906][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7588.623209][ C1] do_syscall_64+0xc9/0x1e0 [ 7588.623447][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7588.623748][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7588.623975][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7588.624944][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7588.625368][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7588.625767][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7588.626165][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7588.626568][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7588.626967][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7588.627369][ C1] [ 7588.627528][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4876s! [swapper/2:0] [ 7588.627939][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7588.629180][ C2] irq event stamp: 44114564 [ 7588.629408][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7588.629938][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7588.630448][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7588.630923][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7588.631392][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7588.631844][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7588.632455][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7588.632778][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7588.633747][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7588.634054][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7588.634449][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7588.634845][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7588.635243][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7588.635642][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7588.636038][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7588.636482][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7588.636811][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7588.637212][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7588.637609][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7588.638005][ C2] PKRU: 55555554 [ 7588.638186][ C2] Call Trace: [ 7588.638356][ C2] [ 7588.638502][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7588.638761][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7588.639004][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7588.639279][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7588.639551][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7588.639837][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7588.640101][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7588.640407][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7588.640666][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7588.640928][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7588.641236][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7588.641528][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7588.641841][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7588.642132][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7588.642424][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7588.642713][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7588.643023][ C2] ? get_stack_info+0x36/0xc0 [ 7588.643263][ C2] ? lock_acquire+0x1c1/0x220 [ 7588.643504][ C2] ? lock_release+0x1d5/0x250 [ 7588.643745][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7588.643992][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7588.644263][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7588.644549][ C2] ? lock_acquire+0x1c1/0x220 [ 7588.644784][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7588.645023][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7588.645281][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7588.645516][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7588.645762][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7588.646019][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7588.646291][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7588.646565][ C2] ip_local_deliver+0x19d/0x480 [ 7588.646811][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7588.647080][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7588.647342][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7588.647688][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7588.647939][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7588.648258][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7588.648519][ C2] ip_rcv+0x564/0x740 [ 7588.648721][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7588.648952][ C2] ? set_track_prepare+0x8a/0xd0 [ 7588.649203][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7588.649479][ C2] ? start_secondary+0x21c/0x2b0 [ 7588.649731][ C2] ? skb_clone+0x10b/0x330 [ 7588.649955][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7588.650272][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7588.650578][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7588.650859][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7588.651154][ C2] ? __tcf_classify+0x329/0x7d0 [ 7588.651401][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7588.651628][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7588.651927][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7588.652212][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7588.652536][ C2] ? lock_acquire+0x1c1/0x220 [ 7588.652772][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7588.653068][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7588.653355][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7588.653670][ C2] ? __copy_skb_header+0xaf/0x490 [ 7588.653927][ C2] ? __skb_clone+0x57a/0x760 [ 7588.654162][ C2] netif_receive_skb+0x55/0x280 [ 7588.654412][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7588.654723][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7588.655053][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7588.655351][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7588.655625][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7588.655912][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7588.656224][ C2] ? get_stack_info+0x36/0xc0 [ 7588.656465][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7588.656728][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7588.657043][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7588.657318][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7588.657592][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7588.657906][ C2] ? kernel_text_address+0x17/0xe0 [ 7588.658166][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7588.658476][ C2] ? arch_stack_walk+0x8c/0x100 [ 7588.658724][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7588.658988][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7588.659273][ C2] ? lock_acquire+0x1c1/0x220 [ 7588.659508][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7588.659792][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7588.660097][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7588.660373][ C2] ? get_stack_info+0x36/0xc0 [ 7588.660613][ C2] __tcf_classify+0x329/0x7d0 [ 7588.660852][ C2] tcf_classify+0x283/0x930 [ 7588.661085][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7588.661341][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7588.661653][ C2] tc_run+0x2e4/0x5d0 [ 7588.661855][ C2] ? __pfx_tc_run+0x10/0x10 [ 7588.662086][ C2] ? lock_acquire+0x1c1/0x220 [ 7588.662322][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7588.662583][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7588.662834][ C2] ? lock_acquire+0x1c1/0x220 [ 7588.663073][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7588.663338][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7588.663641][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7588.663911][ C2] ? neigh_hh_output+0x348/0x590 [ 7588.664162][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7588.664425][ C2] ip_finish_output2+0x786/0x18e0 [ 7588.664681][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7588.665017][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7588.665292][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7588.665544][ C2] ? __ip_finish_output+0x10f/0x770 [ 7588.665808][ C2] ip_output+0x16b/0x4f0 [ 7588.666022][ C2] ? __pfx_ip_output+0x10/0x10 [ 7588.666265][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7588.666539][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7588.666850][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7588.667127][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7588.667377][ C2] ? __alloc_skb+0xd4/0x280 [ 7588.667606][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7588.667873][ C2] ? tcp_fragment+0x168/0x1040 [ 7588.668116][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7588.668366][ C2] ? ip_local_out+0x114/0x3b0 [ 7588.668606][ C2] __ip_queue_xmit+0x672/0x1910 [ 7588.668854][ C2] ? __skb_clone+0x57a/0x760 [ 7588.669085][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7588.669352][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7588.669632][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7588.669875][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7588.670122][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7588.670420][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7588.670738][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7588.670981][ C2] tcp_send_loss_probe+0x348/0x830 [ 7588.671242][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7588.671508][ C2] tcp_write_timer+0x82/0x1d0 [ 7588.671748][ C2] call_timer_fn+0x173/0x430 [ 7588.671984][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7588.672244][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7588.672504][ C2] __run_timers.part.0+0x52d/0x890 [ 7588.672763][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7588.673031][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7588.673319][ C2] ? lock_acquire+0x1c1/0x220 [ 7588.673554][ C2] ? clockevents_program_event+0xf6/0x300 [ 7588.673844][ C2] ? lock_release+0x1d5/0x250 [ 7588.674083][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7588.674346][ C2] ? ktime_get+0xb3/0x190 [ 7588.674565][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7588.674861][ C2] run_timer_softirq+0x72/0x100 [ 7588.675110][ C2] __do_softirq+0x1b9/0x7ff [ 7588.675340][ C2] irq_exit_rcu+0x98/0xc0 [ 7588.675560][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7588.675842][ C2] [ 7588.675992][ C2] [ 7588.676143][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7588.676446][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7588.676701][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7588.677666][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7588.677971][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7588.678369][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7588.678764][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7588.679159][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7588.679558][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7588.679956][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7588.680242][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7588.680500][ C2] default_idle_call+0x69/0xa0 [ 7588.680744][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7588.680993][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7588.681269][ C2] ? lock_release+0x1d5/0x250 [ 7588.681507][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7588.681780][ C2] do_idle+0xfb/0x160 [ 7588.681984][ C2] cpu_startup_entry+0x55/0x60 [ 7588.682225][ C2] start_secondary+0x21c/0x2b0 [ 7588.682466][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7588.682735][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7588.683048][ C2] [ 7610.832102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7610.832453][ C1] rcu: 1-....: (5243333 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1284494 [ 7610.833000][ C1] rcu: (t=5255945 jiffies g=1882453 q=721 ncpus=4) [ 7610.833347][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7610.833793][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7610.834419][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7610.834737][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7610.835680][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7610.835981][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7610.836370][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7610.836758][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7610.837148][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7610.837558][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7610.837957][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7610.838405][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7610.838738][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7610.839139][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7610.839541][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7610.839939][ C1] PKRU: 55555554 [ 7610.840121][ C1] Call Trace: [ 7610.840291][ C1] [ 7610.840439][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7610.840712][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7610.840967][ C1] ? check_cpu_stall+0x284/0x500 [ 7610.841220][ C1] ? rcu_pending+0x92/0x360 [ 7610.841453][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7610.841724][ C1] ? update_process_times+0xb9/0x110 [ 7610.841993][ C1] ? tick_sched_handle+0x67/0x130 [ 7610.842251][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7610.842536][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7610.842778][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7610.843091][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7610.843366][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7610.843658][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7610.843923][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7610.844230][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7610.844493][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7610.844803][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7610.845098][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7610.845414][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7610.845705][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7610.846000][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7610.846292][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7610.846604][ C1] ? get_stack_info+0x36/0xc0 [ 7610.846844][ C1] ? lock_acquire+0x1c1/0x220 [ 7610.847086][ C1] ? lock_release+0x1d5/0x250 [ 7610.847327][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7610.847577][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7610.847849][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7610.848134][ C1] ? lock_acquire+0x1c1/0x220 [ 7610.848373][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7610.848616][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7610.848877][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7610.849114][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7610.849361][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7610.849619][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7610.849896][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7610.850173][ C1] ip_local_deliver+0x19d/0x480 [ 7610.850422][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7610.850694][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7610.850958][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7610.851308][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7610.851563][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7610.851884][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7610.852148][ C1] ip_rcv+0x564/0x740 [ 7610.852353][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7610.852583][ C1] ? set_track_prepare+0x8a/0xd0 [ 7610.852835][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7610.853115][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7610.853390][ C1] ? skb_clone+0x10b/0x330 [ 7610.853618][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7610.853940][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7610.854246][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7610.854529][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7610.854824][ C1] ? __tcf_classify+0x329/0x7d0 [ 7610.855073][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7610.855304][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7610.855603][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7610.855890][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7610.856216][ C1] ? lock_acquire+0x1c1/0x220 [ 7610.856455][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7610.856751][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7610.857038][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7610.857356][ C1] ? __copy_skb_header+0xaf/0x490 [ 7610.857614][ C1] ? __skb_clone+0x57a/0x760 [ 7610.857848][ C1] netif_receive_skb+0x55/0x280 [ 7610.858097][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7610.858411][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7610.858744][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7610.859044][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7610.859319][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7610.859607][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7610.859921][ C1] ? hlock_class+0x4e/0x130 [ 7610.860158][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7610.860434][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7610.860710][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7610.860975][ C1] ? hlock_class+0x4e/0x130 [ 7610.861207][ C1] ? mark_lock+0x38/0x3e0 [ 7610.861428][ C1] ? stack_access_ok+0xda/0x1f0 [ 7610.861676][ C1] ? __lock_acquire+0xb67/0x1610 [ 7610.861931][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7610.862210][ C1] ? get_stack_info+0x36/0xc0 [ 7610.862448][ C1] ? stack_access_ok+0xda/0x1f0 [ 7610.862697][ C1] ? get_reg+0x119/0x190 [ 7610.862915][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7610.863187][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7610.863497][ C1] __tcf_classify+0x329/0x7d0 [ 7610.863736][ C1] tcf_classify+0x283/0x930 [ 7610.863970][ C1] ? arch_stack_walk+0xa2/0x100 [ 7610.864219][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7610.864476][ C1] ? get_stack_info+0x36/0xc0 [ 7610.864718][ C1] tc_run+0x2e4/0x5d0 [ 7610.864924][ C1] ? __pfx_tc_run+0x10/0x10 [ 7610.865155][ C1] ? lock_acquire+0x1c1/0x220 [ 7610.865394][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7610.865655][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7610.865908][ C1] ? lock_acquire+0x1c1/0x220 [ 7610.866148][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7610.866412][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7610.866719][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7610.866992][ C1] ? neigh_hh_output+0x348/0x590 [ 7610.867245][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7610.867511][ C1] ip_finish_output2+0x786/0x18e0 [ 7610.867767][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7610.868045][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7610.868385][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7610.868661][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7610.868915][ C1] ? __ip_finish_output+0x10f/0x770 [ 7610.869181][ C1] ip_output+0x16b/0x4f0 [ 7610.869396][ C1] ? run_timer_softirq+0x72/0x100 [ 7610.869655][ C1] ? __pfx_ip_output+0x10/0x10 [ 7610.869899][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7610.870187][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7610.870438][ C1] ? ip_local_out+0x114/0x3b0 [ 7610.870677][ C1] __ip_queue_xmit+0x672/0x1910 [ 7610.870927][ C1] ? __create_object+0x5e/0xb0 [ 7610.871172][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7610.871439][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7610.871720][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7610.871994][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7610.872276][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7610.872548][ C1] tcp_delack_timer+0x84/0x240 [ 7610.872793][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7610.873065][ C1] call_timer_fn+0x173/0x430 [ 7610.873304][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7610.873566][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7610.873826][ C1] __run_timers.part.0+0x52d/0x890 [ 7610.874087][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7610.874363][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7610.874649][ C1] ? lock_acquire+0x1c1/0x220 [ 7610.874890][ C1] ? clockevents_program_event+0xf6/0x300 [ 7610.875179][ C1] ? lock_release+0x1d5/0x250 [ 7610.875419][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7610.875683][ C1] ? ktime_get+0xb3/0x190 [ 7610.875904][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7610.876201][ C1] run_timer_softirq+0x72/0x100 [ 7610.876451][ C1] __do_softirq+0x1b9/0x7ff [ 7610.876685][ C1] irq_exit_rcu+0x98/0xc0 [ 7610.876904][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7610.877191][ C1] [ 7610.877341][ C1] [ 7610.877491][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7610.877797][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7610.878121][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7610.879095][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7610.879403][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7610.879801][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7610.880203][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7610.880603][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7610.881003][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7610.881404][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7610.881703][ C1] pipe_read+0xa16/0xdf0 [ 7610.881922][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7610.882202][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7610.882445][ C1] ? iterate_tty_write+0x299/0x540 [ 7610.882707][ C1] ? lock_release+0x1d5/0x250 [ 7610.882947][ C1] vfs_read+0x911/0xc00 [ 7610.883163][ C1] ? lock_acquire+0x1c1/0x220 [ 7610.883402][ C1] ? __might_fault+0xc6/0x180 [ 7610.883644][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7610.883885][ C1] ? __might_fault+0xc6/0x180 [ 7610.884125][ C1] ? lock_release+0x1d5/0x250 [ 7610.884363][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7610.884629][ C1] ? __fget_light+0x54/0x1e0 [ 7610.884867][ C1] ksys_read+0x17a/0x1e0 [ 7610.885084][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7610.885329][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7610.885635][ C1] do_syscall_64+0xc9/0x1e0 [ 7610.885868][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7610.886167][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7610.886396][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7610.887369][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7610.887792][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7610.888191][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7610.888591][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7610.888989][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7610.889390][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7610.889792][ C1] [ 7610.889953][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7610.890236][ C2] NMI backtrace for cpu 2 [ 7610.890244][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7610.890250][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7610.890254][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7610.890262][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7610.890268][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7610.890273][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7610.890277][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7610.890281][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7610.890285][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7610.890289][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7610.890293][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7610.890297][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7610.890303][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7610.890306][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7610.890310][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7610.890313][ C2] PKRU: 55555554 [ 7610.890315][ C2] Call Trace: [ 7610.890318][ C2] [ 7610.890321][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7610.890332][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7610.890340][ C2] ? nmi_handle+0x153/0x420 [ 7610.890350][ C2] ? default_do_nmi+0x41/0x100 [ 7610.890357][ C2] ? exc_nmi+0xf3/0x120 [ 7610.890362][ C2] ? end_repeat_nmi+0xf/0x60 [ 7610.890374][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7610.890382][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7610.890390][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7610.890399][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7610.890407][ C2] [ 7610.890408][ C2] [ 7610.890411][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7610.890418][ C2] ? get_stack_info+0x36/0xc0 [ 7610.890427][ C2] ? lock_acquire+0x1c1/0x220 [ 7610.890435][ C2] ? lock_release+0x1d5/0x250 [ 7610.890444][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7610.890453][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7610.890459][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7610.890468][ C2] ? lock_acquire+0x1c1/0x220 [ 7610.890473][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7610.890482][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7610.890488][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7610.890505][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7610.890511][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7610.890523][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7610.890533][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7610.890541][ C2] ip_local_deliver+0x19d/0x480 [ 7610.890547][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7610.890552][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7610.890558][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7610.890569][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7610.890577][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7610.890584][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7610.890605][ C2] ip_rcv+0x564/0x740 [ 7610.890611][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7610.890617][ C2] ? set_track_prepare+0x8a/0xd0 [ 7610.890626][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7610.890633][ C2] ? start_secondary+0x21c/0x2b0 [ 7610.890640][ C2] ? skb_clone+0x10b/0x330 [ 7610.890645][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7610.890660][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7610.890675][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7610.890682][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7610.890702][ C2] ? __tcf_classify+0x329/0x7d0 [ 7610.890711][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7610.890716][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7610.890724][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7610.890732][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7610.890742][ C2] ? lock_acquire+0x1c1/0x220 [ 7610.890746][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7610.890750][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7610.890754][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7610.890758][ C2] ? __copy_skb_header+0xaf/0x490 [ 7610.890762][ C2] ? __skb_clone+0x57a/0x760 [ 7610.890764][ C2] netif_receive_skb+0x55/0x280 [ 7610.890768][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7610.890775][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7610.890781][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7610.890788][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7610.890792][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7610.890802][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7610.890809][ C2] ? get_stack_info+0x36/0xc0 [ 7610.890814][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7610.890817][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7610.890820][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7610.890822][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7610.890826][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7610.890828][ C2] ? kernel_text_address+0x17/0xe0 [ 7610.890831][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7610.890835][ C2] ? arch_stack_walk+0x8c/0x100 [ 7610.890838][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7610.890842][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7610.890845][ C2] ? lock_acquire+0x1c1/0x220 [ 7610.890847][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7610.890851][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7610.890855][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7610.890858][ C2] ? get_stack_info+0x36/0xc0 [ 7610.890862][ C2] __tcf_classify+0x329/0x7d0 [ 7610.890867][ C2] tcf_classify+0x283/0x930 [ 7610.890872][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7610.890875][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7610.890879][ C2] tc_run+0x2e4/0x5d0 [ 7610.890883][ C2] ? __pfx_tc_run+0x10/0x10 [ 7610.890886][ C2] ? lock_acquire+0x1c1/0x220 [ 7610.890888][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7610.890892][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7610.890896][ C2] ? lock_acquire+0x1c1/0x220 [ 7610.890898][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7610.890901][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7610.890904][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7610.890907][ C2] ? neigh_hh_output+0x348/0x590 [ 7610.890910][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7610.890914][ C2] ip_finish_output2+0x786/0x18e0 [ 7610.890917][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7610.890925][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7610.890927][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7610.890931][ C2] ? __ip_finish_output+0x10f/0x770 [ 7610.890935][ C2] ip_output+0x16b/0x4f0 [ 7610.890938][ C2] ? __pfx_ip_output+0x10/0x10 [ 7610.890940][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7610.890943][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7610.890946][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7610.890949][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7610.890951][ C2] ? __alloc_skb+0xd4/0x280 [ 7610.890954][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7610.890957][ C2] ? tcp_fragment+0x168/0x1040 [ 7610.890961][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7610.890964][ C2] ? ip_local_out+0x114/0x3b0 [ 7610.890967][ C2] __ip_queue_xmit+0x672/0x1910 [ 7610.890971][ C2] ? __skb_clone+0x57a/0x760 [ 7610.890974][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7610.890979][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7610.890982][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7610.890985][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7610.890989][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7610.890994][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7610.890996][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7610.891000][ C2] tcp_send_loss_probe+0x348/0x830 [ 7610.891003][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7610.891005][ C2] tcp_write_timer+0x82/0x1d0 [ 7610.891009][ C2] call_timer_fn+0x173/0x430 [ 7610.891013][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7610.891017][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7610.891021][ C2] __run_timers.part.0+0x52d/0x890 [ 7610.891024][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7610.891028][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7610.891031][ C2] ? lock_acquire+0x1c1/0x220 [ 7610.891034][ C2] ? clockevents_program_event+0xf6/0x300 [ 7610.891038][ C2] ? lock_release+0x1d5/0x250 [ 7610.891040][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7610.891044][ C2] ? ktime_get+0xb3/0x190 [ 7610.891047][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7610.891051][ C2] run_timer_softirq+0x72/0x100 [ 7610.891055][ C2] __do_softirq+0x1b9/0x7ff [ 7610.891059][ C2] irq_exit_rcu+0x98/0xc0 [ 7610.891061][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7610.891064][ C2] [ 7610.891065][ C2] [ 7610.891066][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7610.891070][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7610.891072][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7610.891074][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7610.891076][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7610.891078][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7610.891079][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7610.891080][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7610.891081][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7610.891084][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7610.891088][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7610.891091][ C2] default_idle_call+0x69/0xa0 [ 7610.891094][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7610.891096][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7610.891100][ C2] ? lock_release+0x1d5/0x250 [ 7610.891102][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7610.891106][ C2] do_idle+0xfb/0x160 [ 7610.891108][ C2] cpu_startup_entry+0x55/0x60 [ 7610.891111][ C2] start_secondary+0x21c/0x2b0 [ 7610.891113][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7610.891117][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7610.891123][ C2] [ 7636.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4921s! [perl:4135] [ 7636.569688][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7636.570910][ C1] irq event stamp: 209232 [ 7636.571121][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7636.571642][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7636.572107][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7636.572564][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7636.573018][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7636.573486][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7636.574095][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 7636.574422][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 7636.575372][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7636.575671][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7636.576062][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7636.576450][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7636.576839][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7636.577226][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7636.577616][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7636.578052][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7636.578377][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7636.578767][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7636.579155][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7636.579546][ C1] PKRU: 55555554 [ 7636.579722][ C1] Call Trace: [ 7636.579887][ C1] [ 7636.580032][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7636.580289][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7636.580524][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7636.580797][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7636.581062][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7636.581344][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7636.581603][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7636.581899][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7636.582155][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7636.582456][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7636.582745][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7636.583052][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7636.583358][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 7636.583647][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7636.583935][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7636.584247][ C1] ? get_stack_info+0x36/0xc0 [ 7636.584493][ C1] ? lock_acquire+0x1c1/0x220 [ 7636.584726][ C1] ? lock_release+0x1d5/0x250 [ 7636.584958][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7636.585201][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7636.585466][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7636.585746][ C1] ? lock_acquire+0x1c1/0x220 [ 7636.585979][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7636.586213][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7636.586486][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7636.586721][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7636.586969][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7636.587227][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7636.587503][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7636.587787][ C1] ip_local_deliver+0x19d/0x480 [ 7636.588026][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7636.588292][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7636.588549][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7636.588886][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7636.589133][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7636.589446][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7636.589702][ C1] ip_rcv+0x564/0x740 [ 7636.589900][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7636.590125][ C1] ? set_track_prepare+0x8a/0xd0 [ 7636.590372][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7636.590641][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7636.590907][ C1] ? skb_clone+0x10b/0x330 [ 7636.591129][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7636.591440][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7636.591760][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7636.592043][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7636.592339][ C1] ? __tcf_classify+0x329/0x7d0 [ 7636.592586][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7636.592817][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7636.593121][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7636.593405][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7636.593730][ C1] ? lock_acquire+0x1c1/0x220 [ 7636.593970][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7636.594267][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7636.594551][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7636.594867][ C1] ? __copy_skb_header+0xaf/0x490 [ 7636.595125][ C1] ? __skb_clone+0x57a/0x760 [ 7636.595361][ C1] netif_receive_skb+0x55/0x280 [ 7636.595609][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7636.595919][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7636.596253][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7636.596551][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7636.596824][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7636.597115][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7636.597428][ C1] ? hlock_class+0x4e/0x130 [ 7636.597659][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7636.597936][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7636.598213][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7636.598477][ C1] ? hlock_class+0x4e/0x130 [ 7636.598708][ C1] ? mark_lock+0x38/0x3e0 [ 7636.598928][ C1] ? stack_access_ok+0xda/0x1f0 [ 7636.599178][ C1] ? __lock_acquire+0xb67/0x1610 [ 7636.599432][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7636.599708][ C1] ? get_stack_info+0x36/0xc0 [ 7636.599949][ C1] ? stack_access_ok+0xda/0x1f0 [ 7636.600197][ C1] ? get_reg+0x119/0x190 [ 7636.600412][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7636.600679][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7636.600990][ C1] __tcf_classify+0x329/0x7d0 [ 7636.601232][ C1] tcf_classify+0x283/0x930 [ 7636.601463][ C1] ? arch_stack_walk+0xa2/0x100 [ 7636.601711][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7636.601968][ C1] ? get_stack_info+0x36/0xc0 [ 7636.602210][ C1] tc_run+0x2e4/0x5d0 [ 7636.602415][ C1] ? __pfx_tc_run+0x10/0x10 [ 7636.602647][ C1] ? lock_acquire+0x1c1/0x220 [ 7636.602886][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7636.603164][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7636.603419][ C1] ? lock_acquire+0x1c1/0x220 [ 7636.603657][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7636.603924][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7636.604229][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7636.604504][ C1] ? neigh_hh_output+0x348/0x590 [ 7636.604757][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7636.605026][ C1] ip_finish_output2+0x786/0x18e0 [ 7636.605284][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7636.605563][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7636.605900][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7636.606177][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7636.606431][ C1] ? __ip_finish_output+0x10f/0x770 [ 7636.606698][ C1] ip_output+0x16b/0x4f0 [ 7636.606917][ C1] ? run_timer_softirq+0x72/0x100 [ 7636.607175][ C1] ? __pfx_ip_output+0x10/0x10 [ 7636.607420][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7636.607707][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7636.607960][ C1] ? ip_local_out+0x114/0x3b0 [ 7636.608202][ C1] __ip_queue_xmit+0x672/0x1910 [ 7636.608452][ C1] ? __create_object+0x5e/0xb0 [ 7636.608696][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7636.608965][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7636.609247][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7636.609521][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7636.609806][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7636.610079][ C1] tcp_delack_timer+0x84/0x240 [ 7636.610325][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7636.610597][ C1] call_timer_fn+0x173/0x430 [ 7636.610835][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7636.611099][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7636.611362][ C1] __run_timers.part.0+0x52d/0x890 [ 7636.611624][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7636.611899][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7636.612186][ C1] ? lock_acquire+0x1c1/0x220 [ 7636.612425][ C1] ? clockevents_program_event+0xf6/0x300 [ 7636.612722][ C1] ? lock_release+0x1d5/0x250 [ 7636.612962][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7636.613232][ C1] ? ktime_get+0xb3/0x190 [ 7636.613453][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7636.613751][ C1] run_timer_softirq+0x72/0x100 [ 7636.614001][ C1] __do_softirq+0x1b9/0x7ff [ 7636.614234][ C1] irq_exit_rcu+0x98/0xc0 [ 7636.614457][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7636.614742][ C1] [ 7636.614894][ C1] [ 7636.615045][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7636.615350][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7636.615676][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7636.616651][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7636.616960][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7636.617360][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7636.617760][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7636.618160][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7636.618564][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7636.618967][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7636.619265][ C1] pipe_read+0xa16/0xdf0 [ 7636.619488][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7636.619766][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7636.620012][ C1] ? iterate_tty_write+0x299/0x540 [ 7636.620275][ C1] ? lock_release+0x1d5/0x250 [ 7636.620517][ C1] vfs_read+0x911/0xc00 [ 7636.620732][ C1] ? lock_acquire+0x1c1/0x220 [ 7636.620972][ C1] ? __might_fault+0xc6/0x180 [ 7636.621214][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7636.621454][ C1] ? __might_fault+0xc6/0x180 [ 7636.621696][ C1] ? lock_release+0x1d5/0x250 [ 7636.621937][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7636.622204][ C1] ? __fget_light+0x54/0x1e0 [ 7636.622443][ C1] ksys_read+0x17a/0x1e0 [ 7636.622661][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7636.622909][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7636.623219][ C1] do_syscall_64+0xc9/0x1e0 [ 7636.623451][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7636.623753][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7636.623986][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7636.624966][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7636.625389][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7636.625792][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7636.626194][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7636.626596][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7636.626995][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7636.627403][ C1] [ 7636.627561][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4921s! [swapper/2:0] [ 7636.627970][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7636.629208][ C2] irq event stamp: 44114564 [ 7636.629436][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7636.629965][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7636.630472][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7636.630945][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7636.631409][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7636.631860][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7636.632468][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7636.632789][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7636.633755][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7636.634060][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7636.634455][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7636.634850][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7636.635244][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7636.635641][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7636.636036][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7636.636479][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7636.636807][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7636.637204][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7636.637601][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7636.637996][ C2] PKRU: 55555554 [ 7636.638179][ C2] Call Trace: [ 7636.638346][ C2] [ 7636.638494][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7636.638753][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7636.638995][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7636.639270][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7636.639538][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7636.639826][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7636.640089][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7636.640392][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7636.640651][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7636.640911][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7636.641217][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7636.641509][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7636.641820][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7636.642107][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7636.642400][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7636.642687][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7636.642995][ C2] ? get_stack_info+0x36/0xc0 [ 7636.643239][ C2] ? lock_acquire+0x1c1/0x220 [ 7636.643478][ C2] ? lock_release+0x1d5/0x250 [ 7636.643717][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7636.643964][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7636.644233][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7636.644515][ C2] ? lock_acquire+0x1c1/0x220 [ 7636.644753][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7636.644992][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7636.645250][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7636.645483][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7636.645728][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7636.645983][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7636.646256][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7636.646529][ C2] ip_local_deliver+0x19d/0x480 [ 7636.646775][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7636.647043][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7636.647304][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7636.647649][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7636.647899][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7636.648216][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7636.648476][ C2] ip_rcv+0x564/0x740 [ 7636.648679][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7636.648906][ C2] ? set_track_prepare+0x8a/0xd0 [ 7636.649157][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7636.649432][ C2] ? start_secondary+0x21c/0x2b0 [ 7636.649681][ C2] ? skb_clone+0x10b/0x330 [ 7636.649905][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7636.650222][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7636.650526][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7636.650803][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7636.651096][ C2] ? __tcf_classify+0x329/0x7d0 [ 7636.651342][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7636.651569][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7636.651867][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7636.652149][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7636.652471][ C2] ? lock_acquire+0x1c1/0x220 [ 7636.652708][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7636.653003][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7636.653289][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7636.653602][ C2] ? __copy_skb_header+0xaf/0x490 [ 7636.653857][ C2] ? __skb_clone+0x57a/0x760 [ 7636.654090][ C2] netif_receive_skb+0x55/0x280 [ 7636.654336][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7636.654644][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7636.654975][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7636.655270][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7636.655542][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7636.655829][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7636.656141][ C2] ? get_stack_info+0x36/0xc0 [ 7636.656380][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7636.656643][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7636.656957][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7636.657232][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7636.657506][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7636.657818][ C2] ? kernel_text_address+0x17/0xe0 [ 7636.658076][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7636.658387][ C2] ? arch_stack_walk+0x8c/0x100 [ 7636.658634][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7636.658896][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7636.659179][ C2] ? lock_acquire+0x1c1/0x220 [ 7636.659415][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7636.659694][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7636.659994][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7636.660270][ C2] ? get_stack_info+0x36/0xc0 [ 7636.660507][ C2] __tcf_classify+0x329/0x7d0 [ 7636.660748][ C2] tcf_classify+0x283/0x930 [ 7636.660979][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7636.661233][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7636.661544][ C2] tc_run+0x2e4/0x5d0 [ 7636.661747][ C2] ? __pfx_tc_run+0x10/0x10 [ 7636.661975][ C2] ? lock_acquire+0x1c1/0x220 [ 7636.662212][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7636.662470][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7636.662720][ C2] ? lock_acquire+0x1c1/0x220 [ 7636.662958][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7636.663224][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7636.663525][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7636.663794][ C2] ? neigh_hh_output+0x348/0x590 [ 7636.664045][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7636.664306][ C2] ip_finish_output2+0x786/0x18e0 [ 7636.664560][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7636.664893][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7636.665169][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7636.665419][ C2] ? __ip_finish_output+0x10f/0x770 [ 7636.665681][ C2] ip_output+0x16b/0x4f0 [ 7636.665895][ C2] ? __pfx_ip_output+0x10/0x10 [ 7636.666136][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7636.666410][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7636.666719][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7636.666991][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7636.667242][ C2] ? __alloc_skb+0xd4/0x280 [ 7636.667471][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7636.667737][ C2] ? tcp_fragment+0x168/0x1040 [ 7636.667979][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7636.668230][ C2] ? ip_local_out+0x114/0x3b0 [ 7636.668468][ C2] __ip_queue_xmit+0x672/0x1910 [ 7636.668714][ C2] ? __skb_clone+0x57a/0x760 [ 7636.668946][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7636.669209][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7636.669490][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7636.669731][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7636.669976][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7636.670276][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7636.670593][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7636.670834][ C2] tcp_send_loss_probe+0x348/0x830 [ 7636.671093][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7636.671358][ C2] tcp_write_timer+0x82/0x1d0 [ 7636.671597][ C2] call_timer_fn+0x173/0x430 [ 7636.671835][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7636.672095][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7636.672355][ C2] __run_timers.part.0+0x52d/0x890 [ 7636.672613][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7636.672881][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7636.673166][ C2] ? lock_acquire+0x1c1/0x220 [ 7636.673404][ C2] ? clockevents_program_event+0xf6/0x300 [ 7636.673693][ C2] ? lock_release+0x1d5/0x250 [ 7636.673928][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7636.674191][ C2] ? ktime_get+0xb3/0x190 [ 7636.674410][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7636.674705][ C2] run_timer_softirq+0x72/0x100 [ 7636.674950][ C2] __do_softirq+0x1b9/0x7ff [ 7636.675182][ C2] irq_exit_rcu+0x98/0xc0 [ 7636.675399][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7636.675682][ C2] [ 7636.675829][ C2] [ 7636.675981][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7636.676282][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7636.676537][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7636.677499][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7636.677803][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7636.678201][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7636.678596][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7636.678990][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7636.679384][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7636.679783][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7636.680069][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7636.680326][ C2] default_idle_call+0x69/0xa0 [ 7636.680568][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7636.680817][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7636.681092][ C2] ? lock_release+0x1d5/0x250 [ 7636.681330][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7636.681600][ C2] do_idle+0xfb/0x160 [ 7636.681802][ C2] cpu_startup_entry+0x55/0x60 [ 7636.682043][ C2] start_secondary+0x21c/0x2b0 [ 7636.682286][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7636.682552][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7636.682860][ C2] [ 7664.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4947s! [perl:4135] [ 7664.569673][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7664.570894][ C1] irq event stamp: 209232 [ 7664.571109][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7664.571624][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7664.572088][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7664.572546][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7664.573015][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7664.573463][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7664.574075][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7664.574404][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7664.575347][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7664.575646][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7664.576036][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7664.576423][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7664.576811][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7664.577201][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7664.577591][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7664.578028][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7664.578351][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7664.578740][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7664.579131][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7664.579521][ C1] PKRU: 55555554 [ 7664.579699][ C1] Call Trace: [ 7664.579862][ C1] [ 7664.580009][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7664.580264][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7664.580500][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7664.580770][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7664.581035][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7664.581317][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7664.581576][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7664.581872][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7664.582129][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7664.582428][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7664.582717][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7664.583043][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7664.583330][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7664.583628][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7664.583917][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7664.584236][ C1] ? get_stack_info+0x36/0xc0 [ 7664.584472][ C1] ? lock_acquire+0x1c1/0x220 [ 7664.584707][ C1] ? lock_release+0x1d5/0x250 [ 7664.584941][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7664.585182][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7664.585449][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7664.585726][ C1] ? lock_acquire+0x1c1/0x220 [ 7664.585959][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7664.586194][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7664.586447][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7664.586674][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7664.586916][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7664.587166][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7664.587436][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7664.587707][ C1] ip_local_deliver+0x19d/0x480 [ 7664.587948][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7664.588212][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7664.588470][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7664.588807][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7664.589053][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7664.589367][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7664.589623][ C1] ip_rcv+0x564/0x740 [ 7664.589823][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7664.590046][ C1] ? set_track_prepare+0x8a/0xd0 [ 7664.590293][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7664.590563][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7664.590830][ C1] ? skb_clone+0x10b/0x330 [ 7664.591049][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7664.591361][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7664.591660][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7664.591933][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7664.592242][ C1] ? __tcf_classify+0x329/0x7d0 [ 7664.592491][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7664.592720][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7664.593026][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7664.593312][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7664.593639][ C1] ? lock_acquire+0x1c1/0x220 [ 7664.593878][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7664.594177][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7664.594461][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7664.594779][ C1] ? __copy_skb_header+0xaf/0x490 [ 7664.595036][ C1] ? __skb_clone+0x57a/0x760 [ 7664.595273][ C1] netif_receive_skb+0x55/0x280 [ 7664.595523][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7664.595837][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7664.596170][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7664.596467][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7664.596745][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7664.597034][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7664.597350][ C1] ? hlock_class+0x4e/0x130 [ 7664.597582][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7664.597861][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7664.598136][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7664.598400][ C1] ? hlock_class+0x4e/0x130 [ 7664.598633][ C1] ? mark_lock+0x38/0x3e0 [ 7664.598852][ C1] ? stack_access_ok+0xda/0x1f0 [ 7664.599102][ C1] ? __lock_acquire+0xb67/0x1610 [ 7664.599357][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7664.599633][ C1] ? get_stack_info+0x36/0xc0 [ 7664.599874][ C1] ? stack_access_ok+0xda/0x1f0 [ 7664.600123][ C1] ? get_reg+0x119/0x190 [ 7664.600339][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7664.600609][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7664.600918][ C1] __tcf_classify+0x329/0x7d0 [ 7664.601161][ C1] tcf_classify+0x283/0x930 [ 7664.601394][ C1] ? arch_stack_walk+0xa2/0x100 [ 7664.601643][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7664.601901][ C1] ? get_stack_info+0x36/0xc0 [ 7664.602141][ C1] tc_run+0x2e4/0x5d0 [ 7664.602348][ C1] ? __pfx_tc_run+0x10/0x10 [ 7664.602579][ C1] ? lock_acquire+0x1c1/0x220 [ 7664.602819][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7664.603084][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7664.603338][ C1] ? lock_acquire+0x1c1/0x220 [ 7664.603579][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7664.603844][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7664.604151][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7664.604424][ C1] ? neigh_hh_output+0x348/0x590 [ 7664.604677][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7664.604944][ C1] ip_finish_output2+0x786/0x18e0 [ 7664.605201][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7664.605479][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7664.605816][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7664.606096][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7664.606350][ C1] ? __ip_finish_output+0x10f/0x770 [ 7664.606615][ C1] ip_output+0x16b/0x4f0 [ 7664.606831][ C1] ? run_timer_softirq+0x72/0x100 [ 7664.607088][ C1] ? __pfx_ip_output+0x10/0x10 [ 7664.607332][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7664.607618][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7664.607871][ C1] ? ip_local_out+0x114/0x3b0 [ 7664.608112][ C1] __ip_queue_xmit+0x672/0x1910 [ 7664.608361][ C1] ? __create_object+0x5e/0xb0 [ 7664.608608][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7664.608875][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7664.609157][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7664.609431][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7664.609715][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7664.609987][ C1] tcp_delack_timer+0x84/0x240 [ 7664.610233][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7664.610505][ C1] call_timer_fn+0x173/0x430 [ 7664.610742][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7664.611004][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7664.611267][ C1] __run_timers.part.0+0x52d/0x890 [ 7664.611527][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7664.611800][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7664.612088][ C1] ? lock_acquire+0x1c1/0x220 [ 7664.612327][ C1] ? clockevents_program_event+0xf6/0x300 [ 7664.612618][ C1] ? lock_release+0x1d5/0x250 [ 7664.612859][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7664.613128][ C1] ? ktime_get+0xb3/0x190 [ 7664.613348][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7664.613647][ C1] run_timer_softirq+0x72/0x100 [ 7664.613899][ C1] __do_softirq+0x1b9/0x7ff [ 7664.614132][ C1] irq_exit_rcu+0x98/0xc0 [ 7664.614354][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7664.614638][ C1] [ 7664.614791][ C1] [ 7664.614941][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7664.615247][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7664.615573][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7664.616544][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7664.616854][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7664.617253][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7664.617652][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7664.618054][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7664.618454][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7664.618855][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7664.619153][ C1] pipe_read+0xa16/0xdf0 [ 7664.619374][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7664.619651][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7664.619895][ C1] ? iterate_tty_write+0x299/0x540 [ 7664.620157][ C1] ? lock_release+0x1d5/0x250 [ 7664.620399][ C1] vfs_read+0x911/0xc00 [ 7664.620613][ C1] ? lock_acquire+0x1c1/0x220 [ 7664.620853][ C1] ? __might_fault+0xc6/0x180 [ 7664.621093][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7664.621334][ C1] ? __might_fault+0xc6/0x180 [ 7664.621573][ C1] ? lock_release+0x1d5/0x250 [ 7664.621814][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7664.622079][ C1] ? __fget_light+0x54/0x1e0 [ 7664.622317][ C1] ksys_read+0x17a/0x1e0 [ 7664.622533][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7664.622779][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7664.623089][ C1] do_syscall_64+0xc9/0x1e0 [ 7664.623322][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7664.623622][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7664.623851][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7664.624821][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7664.625242][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7664.625644][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7664.626043][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7664.626444][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7664.626843][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7664.627247][ C1] [ 7664.627403][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4947s! [swapper/2:0] [ 7664.627807][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7664.629046][ C2] irq event stamp: 44114564 [ 7664.629274][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7664.629804][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7664.630313][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7664.630786][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7664.631251][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7664.631702][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7664.632312][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7664.632634][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7664.633600][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7664.633905][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7664.634300][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7664.634694][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7664.635093][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7664.635489][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7664.635883][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7664.636326][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7664.636655][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7664.637055][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7664.637452][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7664.637845][ C2] PKRU: 55555554 [ 7664.638026][ C2] Call Trace: [ 7664.638195][ C2] [ 7664.638340][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7664.638599][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7664.638841][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7664.639115][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7664.639386][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7664.639672][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7664.639935][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7664.640239][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7664.640498][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7664.640758][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7664.641064][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7664.641356][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7664.641668][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7664.641957][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7664.642250][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7664.642537][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7664.642847][ C2] ? get_stack_info+0x36/0xc0 [ 7664.643090][ C2] ? lock_acquire+0x1c1/0x220 [ 7664.643327][ C2] ? lock_release+0x1d5/0x250 [ 7664.643566][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7664.643813][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7664.644082][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7664.644367][ C2] ? lock_acquire+0x1c1/0x220 [ 7664.644602][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7664.644844][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7664.645102][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7664.645336][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7664.645581][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7664.645837][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7664.646108][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7664.646383][ C2] ip_local_deliver+0x19d/0x480 [ 7664.646629][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7664.646897][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7664.647160][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7664.647506][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7664.647756][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7664.648074][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7664.648334][ C2] ip_rcv+0x564/0x740 [ 7664.648536][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7664.648767][ C2] ? set_track_prepare+0x8a/0xd0 [ 7664.649018][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7664.649293][ C2] ? start_secondary+0x21c/0x2b0 [ 7664.649543][ C2] ? skb_clone+0x10b/0x330 [ 7664.649766][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7664.650083][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7664.650388][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7664.650666][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7664.650959][ C2] ? __tcf_classify+0x329/0x7d0 [ 7664.651207][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7664.651435][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7664.651733][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7664.652016][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7664.652340][ C2] ? lock_acquire+0x1c1/0x220 [ 7664.652574][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7664.652870][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7664.653158][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7664.653471][ C2] ? __copy_skb_header+0xaf/0x490 [ 7664.653728][ C2] ? __skb_clone+0x57a/0x760 [ 7664.653963][ C2] netif_receive_skb+0x55/0x280 [ 7664.654209][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7664.654520][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7664.654849][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7664.655147][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7664.655421][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7664.655706][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7664.656016][ C2] ? get_stack_info+0x36/0xc0 [ 7664.656257][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7664.656519][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7664.656832][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7664.657105][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7664.657380][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7664.657694][ C2] ? kernel_text_address+0x17/0xe0 [ 7664.657951][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7664.658262][ C2] ? arch_stack_walk+0x8c/0x100 [ 7664.658509][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7664.658771][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7664.659057][ C2] ? lock_acquire+0x1c1/0x220 [ 7664.659293][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7664.659572][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7664.659874][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7664.660150][ C2] ? get_stack_info+0x36/0xc0 [ 7664.660389][ C2] __tcf_classify+0x329/0x7d0 [ 7664.660628][ C2] tcf_classify+0x283/0x930 [ 7664.660861][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7664.661114][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7664.661425][ C2] tc_run+0x2e4/0x5d0 [ 7664.661631][ C2] ? __pfx_tc_run+0x10/0x10 [ 7664.661861][ C2] ? lock_acquire+0x1c1/0x220 [ 7664.662098][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7664.662359][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7664.662610][ C2] ? lock_acquire+0x1c1/0x220 [ 7664.662847][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7664.663114][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7664.663417][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7664.663687][ C2] ? neigh_hh_output+0x348/0x590 [ 7664.663938][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7664.664201][ C2] ip_finish_output2+0x786/0x18e0 [ 7664.664456][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7664.664793][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7664.665068][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7664.665321][ C2] ? __ip_finish_output+0x10f/0x770 [ 7664.665584][ C2] ip_output+0x16b/0x4f0 [ 7664.665797][ C2] ? __pfx_ip_output+0x10/0x10 [ 7664.666039][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7664.666314][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7664.666624][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7664.666899][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7664.667149][ C2] ? __alloc_skb+0xd4/0x280 [ 7664.667377][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7664.667643][ C2] ? tcp_fragment+0x168/0x1040 [ 7664.667885][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7664.668136][ C2] ? ip_local_out+0x114/0x3b0 [ 7664.668375][ C2] __ip_queue_xmit+0x672/0x1910 [ 7664.668622][ C2] ? __skb_clone+0x57a/0x760 [ 7664.668855][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7664.669120][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7664.669399][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7664.669642][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7664.669890][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7664.670187][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7664.670506][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7664.670749][ C2] tcp_send_loss_probe+0x348/0x830 [ 7664.671007][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7664.671273][ C2] tcp_write_timer+0x82/0x1d0 [ 7664.671514][ C2] call_timer_fn+0x173/0x430 [ 7664.671749][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7664.672010][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7664.672269][ C2] __run_timers.part.0+0x52d/0x890 [ 7664.672528][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7664.672795][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7664.673083][ C2] ? lock_acquire+0x1c1/0x220 [ 7664.673319][ C2] ? clockevents_program_event+0xf6/0x300 [ 7664.673609][ C2] ? lock_release+0x1d5/0x250 [ 7664.673846][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7664.674109][ C2] ? ktime_get+0xb3/0x190 [ 7664.674328][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7664.674624][ C2] run_timer_softirq+0x72/0x100 [ 7664.674871][ C2] __do_softirq+0x1b9/0x7ff [ 7664.675100][ C2] irq_exit_rcu+0x98/0xc0 [ 7664.675321][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7664.675603][ C2] [ 7664.675753][ C2] [ 7664.675903][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7664.676206][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7664.676460][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7664.677422][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7664.677727][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7664.678124][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7664.678519][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7664.678914][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7664.679313][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7664.679711][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7664.679997][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7664.680258][ C2] default_idle_call+0x69/0xa0 [ 7664.680500][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7664.680750][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7664.681030][ C2] ? lock_release+0x1d5/0x250 [ 7664.681267][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7664.681539][ C2] do_idle+0xfb/0x160 [ 7664.681742][ C2] cpu_startup_entry+0x55/0x60 [ 7664.681983][ C2] start_secondary+0x21c/0x2b0 [ 7664.682224][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7664.682492][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7664.682800][ C2] [ 7688.890103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7688.890463][ C1] rcu: 1-....: (5321219 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1303341 [ 7688.891005][ C1] rcu: (t=5334003 jiffies g=1882453 q=721 ncpus=4) [ 7688.891330][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7688.891765][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7688.892360][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7688.892678][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7688.893661][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7688.893970][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7688.894368][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7688.894756][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7688.895142][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7688.895529][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7688.895915][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7688.896376][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7688.896708][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7688.897109][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7688.897508][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7688.897893][ C1] PKRU: 55555554 [ 7688.898071][ C1] Call Trace: [ 7688.898237][ C1] [ 7688.898380][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7688.898646][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7688.898890][ C1] ? check_cpu_stall+0x284/0x500 [ 7688.899135][ C1] ? rcu_pending+0x92/0x360 [ 7688.899361][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7688.899623][ C1] ? update_process_times+0xb9/0x110 [ 7688.899883][ C1] ? tick_sched_handle+0x67/0x130 [ 7688.900133][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7688.900412][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7688.900648][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7688.900952][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7688.901219][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7688.901497][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7688.901754][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7688.902052][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7688.902306][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7688.902607][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7688.902916][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7688.903228][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7688.903518][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7688.903813][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7688.904108][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7688.904411][ C1] ? get_stack_info+0x36/0xc0 [ 7688.904646][ C1] ? lock_acquire+0x1c1/0x220 [ 7688.904879][ C1] ? lock_release+0x1d5/0x250 [ 7688.905112][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7688.905354][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7688.905620][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7688.905899][ C1] ? lock_acquire+0x1c1/0x220 [ 7688.906130][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7688.906363][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7688.906615][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7688.906845][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7688.907086][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7688.907337][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7688.907605][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7688.907873][ C1] ip_local_deliver+0x19d/0x480 [ 7688.908113][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7688.908379][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7688.908636][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7688.908973][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7688.909219][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7688.909530][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7688.909785][ C1] ip_rcv+0x564/0x740 [ 7688.909983][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7688.910207][ C1] ? set_track_prepare+0x8a/0xd0 [ 7688.910454][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7688.910722][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7688.910986][ C1] ? skb_clone+0x10b/0x330 [ 7688.911208][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7688.911518][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7688.911814][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7688.912089][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7688.912374][ C1] ? __tcf_classify+0x329/0x7d0 [ 7688.912616][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7688.912845][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7688.913161][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7688.913444][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7688.913767][ C1] ? lock_acquire+0x1c1/0x220 [ 7688.914006][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7688.914309][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7688.914595][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7688.914911][ C1] ? __copy_skb_header+0xaf/0x490 [ 7688.915168][ C1] ? __skb_clone+0x57a/0x760 [ 7688.915403][ C1] netif_receive_skb+0x55/0x280 [ 7688.915650][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7688.915962][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7688.916292][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7688.916593][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7688.916868][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7688.917158][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7688.917469][ C1] ? hlock_class+0x4e/0x130 [ 7688.917702][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7688.917976][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7688.918253][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7688.918517][ C1] ? hlock_class+0x4e/0x130 [ 7688.918747][ C1] ? mark_lock+0x38/0x3e0 [ 7688.918970][ C1] ? stack_access_ok+0xda/0x1f0 [ 7688.919218][ C1] ? __lock_acquire+0xb67/0x1610 [ 7688.919471][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7688.919746][ C1] ? get_stack_info+0x36/0xc0 [ 7688.919986][ C1] ? stack_access_ok+0xda/0x1f0 [ 7688.920233][ C1] ? get_reg+0x119/0x190 [ 7688.920448][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7688.920715][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7688.921024][ C1] __tcf_classify+0x329/0x7d0 [ 7688.921266][ C1] tcf_classify+0x283/0x930 [ 7688.921496][ C1] ? arch_stack_walk+0xa2/0x100 [ 7688.921745][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7688.922001][ C1] ? get_stack_info+0x36/0xc0 [ 7688.922245][ C1] tc_run+0x2e4/0x5d0 [ 7688.922449][ C1] ? __pfx_tc_run+0x10/0x10 [ 7688.922680][ C1] ? lock_acquire+0x1c1/0x220 [ 7688.922921][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7688.923184][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7688.923437][ C1] ? lock_acquire+0x1c1/0x220 [ 7688.923673][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7688.923938][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7688.924241][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7688.924515][ C1] ? neigh_hh_output+0x348/0x590 [ 7688.924768][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7688.925034][ C1] ip_finish_output2+0x786/0x18e0 [ 7688.925291][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7688.925570][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7688.925906][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7688.926181][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7688.926433][ C1] ? __ip_finish_output+0x10f/0x770 [ 7688.926697][ C1] ip_output+0x16b/0x4f0 [ 7688.926918][ C1] ? run_timer_softirq+0x72/0x100 [ 7688.927174][ C1] ? __pfx_ip_output+0x10/0x10 [ 7688.927417][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7688.927704][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7688.927955][ C1] ? ip_local_out+0x114/0x3b0 [ 7688.928199][ C1] __ip_queue_xmit+0x672/0x1910 [ 7688.928446][ C1] ? __create_object+0x5e/0xb0 [ 7688.928688][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7688.928956][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7688.929238][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7688.929510][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7688.929791][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7688.930064][ C1] tcp_delack_timer+0x84/0x240 [ 7688.930308][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7688.930579][ C1] call_timer_fn+0x173/0x430 [ 7688.930814][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7688.931077][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7688.931339][ C1] __run_timers.part.0+0x52d/0x890 [ 7688.931599][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7688.931872][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7688.932156][ C1] ? lock_acquire+0x1c1/0x220 [ 7688.932399][ C1] ? clockevents_program_event+0xf6/0x300 [ 7688.932690][ C1] ? lock_release+0x1d5/0x250 [ 7688.932929][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7688.933195][ C1] ? ktime_get+0xb3/0x190 [ 7688.933420][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7688.933716][ C1] run_timer_softirq+0x72/0x100 [ 7688.933963][ C1] __do_softirq+0x1b9/0x7ff [ 7688.934196][ C1] irq_exit_rcu+0x98/0xc0 [ 7688.934416][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7688.934702][ C1] [ 7688.934851][ C1] [ 7688.935004][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7688.935306][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7688.935631][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7688.936600][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7688.936906][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7688.937306][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7688.937704][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7688.938101][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7688.938502][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7688.938908][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7688.939202][ C1] pipe_read+0xa16/0xdf0 [ 7688.939424][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7688.939701][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7688.939945][ C1] ? iterate_tty_write+0x299/0x540 [ 7688.940206][ C1] ? lock_release+0x1d5/0x250 [ 7688.940447][ C1] vfs_read+0x911/0xc00 [ 7688.940660][ C1] ? lock_acquire+0x1c1/0x220 [ 7688.940899][ C1] ? __might_fault+0xc6/0x180 [ 7688.941138][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7688.941376][ C1] ? __might_fault+0xc6/0x180 [ 7688.941616][ C1] ? lock_release+0x1d5/0x250 [ 7688.941857][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7688.942121][ C1] ? __fget_light+0x54/0x1e0 [ 7688.942356][ C1] ksys_read+0x17a/0x1e0 [ 7688.942574][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7688.942819][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7688.943125][ C1] do_syscall_64+0xc9/0x1e0 [ 7688.943358][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7688.943657][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7688.943883][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7688.944852][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7688.945276][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7688.945676][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7688.946075][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7688.946474][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7688.946871][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7688.947271][ C1] [ 7688.947435][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7688.947711][ C2] NMI backtrace for cpu 2 [ 7688.947717][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7688.947722][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7688.947726][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7688.947735][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7688.947740][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7688.947745][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7688.947749][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7688.947752][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7688.947756][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7688.947760][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7688.947764][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7688.947768][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7688.947773][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7688.947777][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7688.947780][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7688.947784][ C2] PKRU: 55555554 [ 7688.947786][ C2] Call Trace: [ 7688.947789][ C2] [ 7688.947793][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7688.947805][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7688.947813][ C2] ? nmi_handle+0x153/0x420 [ 7688.947822][ C2] ? default_do_nmi+0x41/0x100 [ 7688.947829][ C2] ? exc_nmi+0xf3/0x120 [ 7688.947835][ C2] ? end_repeat_nmi+0xf/0x60 [ 7688.947847][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7688.947855][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7688.947863][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7688.947871][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7688.947879][ C2] [ 7688.947881][ C2] [ 7688.947884][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7688.947891][ C2] ? get_stack_info+0x36/0xc0 [ 7688.947899][ C2] ? lock_acquire+0x1c1/0x220 [ 7688.947907][ C2] ? lock_release+0x1d5/0x250 [ 7688.947916][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7688.947924][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7688.947931][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7688.947940][ C2] ? lock_acquire+0x1c1/0x220 [ 7688.947945][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7688.947954][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7688.947960][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7688.947977][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7688.947983][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7688.947995][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7688.948005][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7688.948014][ C2] ip_local_deliver+0x19d/0x480 [ 7688.948020][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7688.948025][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7688.948031][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7688.948042][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7688.948050][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7688.948057][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7688.948078][ C2] ip_rcv+0x564/0x740 [ 7688.948084][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7688.948091][ C2] ? set_track_prepare+0x8a/0xd0 [ 7688.948099][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7688.948106][ C2] ? start_secondary+0x21c/0x2b0 [ 7688.948113][ C2] ? skb_clone+0x10b/0x330 [ 7688.948119][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7688.948134][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7688.948149][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7688.948156][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7688.948176][ C2] ? __tcf_classify+0x329/0x7d0 [ 7688.948185][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7688.948190][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7688.948198][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7688.948206][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7688.948217][ C2] ? lock_acquire+0x1c1/0x220 [ 7688.948222][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7688.948233][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7688.948242][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7688.948252][ C2] ? __copy_skb_header+0xaf/0x490 [ 7688.948261][ C2] ? __skb_clone+0x57a/0x760 [ 7688.948267][ C2] netif_receive_skb+0x55/0x280 [ 7688.948275][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7688.948293][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7688.948311][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7688.948329][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7688.948341][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7688.948367][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7688.948386][ C2] ? get_stack_info+0x36/0xc0 [ 7688.948399][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7688.948405][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7688.948414][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7688.948420][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7688.948429][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7688.948435][ C2] ? kernel_text_address+0x17/0xe0 [ 7688.948442][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7688.948451][ C2] ? arch_stack_walk+0x8c/0x100 [ 7688.948459][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7688.948467][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7688.948475][ C2] ? lock_acquire+0x1c1/0x220 [ 7688.948481][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7688.948490][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7688.948498][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7688.948505][ C2] ? get_stack_info+0x36/0xc0 [ 7688.948516][ C2] __tcf_classify+0x329/0x7d0 [ 7688.948529][ C2] tcf_classify+0x283/0x930 [ 7688.948540][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7688.948548][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7688.948560][ C2] tc_run+0x2e4/0x5d0 [ 7688.948567][ C2] ? __pfx_tc_run+0x10/0x10 [ 7688.948575][ C2] ? lock_acquire+0x1c1/0x220 [ 7688.948580][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7688.948591][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7688.948601][ C2] ? lock_acquire+0x1c1/0x220 [ 7688.948606][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7688.948614][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7688.948621][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7688.948628][ C2] ? neigh_hh_output+0x348/0x590 [ 7688.948637][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7688.948647][ C2] ip_finish_output2+0x786/0x18e0 [ 7688.948655][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7688.948675][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7688.948681][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7688.948691][ C2] ? __ip_finish_output+0x10f/0x770 [ 7688.948700][ C2] ip_output+0x16b/0x4f0 [ 7688.948708][ C2] ? __pfx_ip_output+0x10/0x10 [ 7688.948714][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7688.948721][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7688.948728][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7688.948735][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7688.948741][ C2] ? __alloc_skb+0xd4/0x280 [ 7688.948747][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7688.948755][ C2] ? tcp_fragment+0x168/0x1040 [ 7688.948762][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7688.948769][ C2] ? ip_local_out+0x114/0x3b0 [ 7688.948778][ C2] __ip_queue_xmit+0x672/0x1910 [ 7688.948787][ C2] ? __skb_clone+0x57a/0x760 [ 7688.948795][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7688.948809][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7688.948817][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7688.948825][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7688.948835][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7688.948845][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7688.948853][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7688.948862][ C2] tcp_send_loss_probe+0x348/0x830 [ 7688.948870][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7688.948877][ C2] tcp_write_timer+0x82/0x1d0 [ 7688.948885][ C2] call_timer_fn+0x173/0x430 [ 7688.948894][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7688.948905][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7688.948916][ C2] __run_timers.part.0+0x52d/0x890 [ 7688.948923][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7688.948934][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7688.948942][ C2] ? lock_acquire+0x1c1/0x220 [ 7688.948948][ C2] ? clockevents_program_event+0xf6/0x300 [ 7688.948956][ C2] ? lock_release+0x1d5/0x250 [ 7688.948963][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7688.948970][ C2] ? ktime_get+0xb3/0x190 [ 7688.948978][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7688.948989][ C2] run_timer_softirq+0x72/0x100 [ 7688.948998][ C2] __do_softirq+0x1b9/0x7ff [ 7688.949009][ C2] irq_exit_rcu+0x98/0xc0 [ 7688.949014][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7688.949021][ C2] [ 7688.949023][ C2] [ 7688.949026][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7688.949033][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7688.949040][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7688.949046][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7688.949050][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7688.949055][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7688.949059][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7688.949062][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7688.949066][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7688.949074][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7688.949082][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7688.949090][ C2] default_idle_call+0x69/0xa0 [ 7688.949097][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7688.949103][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7688.949112][ C2] ? lock_release+0x1d5/0x250 [ 7688.949118][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7688.949128][ C2] do_idle+0xfb/0x160 [ 7688.949134][ C2] cpu_startup_entry+0x55/0x60 [ 7688.949140][ C2] start_secondary+0x21c/0x2b0 [ 7688.949147][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7688.949157][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7688.949173][ C2] [ 7688.949178][ C2] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.469 msecs [ 7716.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 4995s! [perl:4135] [ 7716.569682][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7716.570900][ C1] irq event stamp: 209232 [ 7716.571112][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7716.571628][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7716.572091][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7716.572546][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7716.573022][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7716.573467][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7716.574084][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7716.574398][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7716.575341][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7716.575640][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7716.576027][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7716.576417][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7716.576804][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7716.577191][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7716.577578][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7716.578012][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7716.578338][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7716.578727][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7716.579114][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7716.579502][ C1] PKRU: 55555554 [ 7716.579677][ C1] Call Trace: [ 7716.579843][ C1] [ 7716.579986][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7716.580239][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7716.580475][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7716.580744][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7716.581010][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7716.581288][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7716.581545][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7716.581843][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7716.582097][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7716.582397][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7716.582684][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7716.583014][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7716.583302][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7716.583597][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7716.583884][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7716.584196][ C1] ? get_stack_info+0x36/0xc0 [ 7716.584431][ C1] ? lock_acquire+0x1c1/0x220 [ 7716.584663][ C1] ? lock_release+0x1d5/0x250 [ 7716.584895][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7716.585136][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7716.585399][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7716.585679][ C1] ? lock_acquire+0x1c1/0x220 [ 7716.585910][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7716.586142][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7716.586397][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7716.586626][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7716.586866][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7716.587116][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7716.587384][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7716.587653][ C1] ip_local_deliver+0x19d/0x480 [ 7716.587892][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7716.588157][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7716.588415][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7716.588752][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7716.588997][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7716.589308][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7716.589562][ C1] ip_rcv+0x564/0x740 [ 7716.589759][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7716.589984][ C1] ? set_track_prepare+0x8a/0xd0 [ 7716.590230][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7716.590498][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7716.590762][ C1] ? skb_clone+0x10b/0x330 [ 7716.590987][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7716.591296][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7716.591594][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7716.591866][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7716.592152][ C1] ? __tcf_classify+0x329/0x7d0 [ 7716.592393][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7716.592618][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7716.592935][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7716.593219][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7716.593543][ C1] ? lock_acquire+0x1c1/0x220 [ 7716.593781][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7716.594084][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7716.594362][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7716.594669][ C1] ? __copy_skb_header+0xaf/0x490 [ 7716.594920][ C1] ? __skb_clone+0x57a/0x760 [ 7716.595148][ C1] netif_receive_skb+0x55/0x280 [ 7716.595389][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7716.595692][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7716.596015][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7716.596307][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7716.596572][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7716.596854][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7716.597157][ C1] ? hlock_class+0x4e/0x130 [ 7716.597383][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7716.597650][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7716.597921][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7716.598178][ C1] ? hlock_class+0x4e/0x130 [ 7716.598401][ C1] ? mark_lock+0x38/0x3e0 [ 7716.598616][ C1] ? stack_access_ok+0xda/0x1f0 [ 7716.598859][ C1] ? __lock_acquire+0xb67/0x1610 [ 7716.599105][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7716.599373][ C1] ? get_stack_info+0x36/0xc0 [ 7716.599607][ C1] ? stack_access_ok+0xda/0x1f0 [ 7716.599847][ C1] ? get_reg+0x119/0x190 [ 7716.600056][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7716.600315][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7716.600616][ C1] __tcf_classify+0x329/0x7d0 [ 7716.600852][ C1] tcf_classify+0x283/0x930 [ 7716.601075][ C1] ? arch_stack_walk+0xa2/0x100 [ 7716.601318][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7716.601567][ C1] ? get_stack_info+0x36/0xc0 [ 7716.601801][ C1] tc_run+0x2e4/0x5d0 [ 7716.602000][ C1] ? __pfx_tc_run+0x10/0x10 [ 7716.602227][ C1] ? lock_acquire+0x1c1/0x220 [ 7716.602459][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7716.602716][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7716.602984][ C1] ? lock_acquire+0x1c1/0x220 [ 7716.603220][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7716.603484][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7716.603788][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7716.604066][ C1] ? neigh_hh_output+0x348/0x590 [ 7716.604311][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7716.604570][ C1] ip_finish_output2+0x786/0x18e0 [ 7716.604819][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7716.605089][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7716.605417][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7716.605684][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7716.605930][ C1] ? __ip_finish_output+0x10f/0x770 [ 7716.606186][ C1] ip_output+0x16b/0x4f0 [ 7716.606399][ C1] ? run_timer_softirq+0x72/0x100 [ 7716.606648][ C1] ? __pfx_ip_output+0x10/0x10 [ 7716.606884][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7716.607162][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7716.607407][ C1] ? ip_local_out+0x114/0x3b0 [ 7716.607641][ C1] __ip_queue_xmit+0x672/0x1910 [ 7716.607883][ C1] ? __create_object+0x5e/0xb0 [ 7716.608118][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7716.608377][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7716.608651][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7716.608916][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7716.609190][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7716.609456][ C1] tcp_delack_timer+0x84/0x240 [ 7716.609693][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7716.609957][ C1] call_timer_fn+0x173/0x430 [ 7716.610185][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7716.610440][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7716.610694][ C1] __run_timers.part.0+0x52d/0x890 [ 7716.610947][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7716.611212][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7716.611487][ C1] ? lock_acquire+0x1c1/0x220 [ 7716.611720][ C1] ? clockevents_program_event+0xf6/0x300 [ 7716.612008][ C1] ? lock_release+0x1d5/0x250 [ 7716.612238][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7716.612497][ C1] ? ktime_get+0xb3/0x190 [ 7716.612716][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7716.613028][ C1] run_timer_softirq+0x72/0x100 [ 7716.613275][ C1] __do_softirq+0x1b9/0x7ff [ 7716.613507][ C1] irq_exit_rcu+0x98/0xc0 [ 7716.613726][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7716.614020][ C1] [ 7716.614165][ C1] [ 7716.614313][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7716.614608][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7716.614924][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7716.615866][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7716.616189][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7716.616588][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7716.616985][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7716.617388][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7716.617774][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7716.618164][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7716.618450][ C1] pipe_read+0xa16/0xdf0 [ 7716.618669][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7716.618939][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7716.619177][ C1] ? iterate_tty_write+0x299/0x540 [ 7716.619431][ C1] ? lock_release+0x1d5/0x250 [ 7716.619665][ C1] vfs_read+0x911/0xc00 [ 7716.619872][ C1] ? lock_acquire+0x1c1/0x220 [ 7716.620105][ C1] ? __might_fault+0xc6/0x180 [ 7716.620338][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7716.620570][ C1] ? __might_fault+0xc6/0x180 [ 7716.620804][ C1] ? lock_release+0x1d5/0x250 [ 7716.621037][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7716.621295][ C1] ? __fget_light+0x54/0x1e0 [ 7716.621524][ C1] ksys_read+0x17a/0x1e0 [ 7716.621736][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7716.621974][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7716.622268][ C1] do_syscall_64+0xc9/0x1e0 [ 7716.622495][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7716.622808][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7716.623033][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7716.624010][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7716.624419][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7716.624805][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7716.625193][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7716.625581][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7716.625967][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7716.626356][ C1] [ 7716.626513][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 4995s! [swapper/2:0] [ 7716.626912][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7716.628122][ C2] irq event stamp: 44114564 [ 7716.628343][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7716.628859][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7716.629353][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7716.629812][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7716.630266][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7716.630705][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7716.631295][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12b/0xb90 [ 7716.631609][ C2] Code: 24 80 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc 90 e9 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 [ 7716.632546][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7716.632867][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7716.633263][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7716.633659][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7716.634061][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7716.634445][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7716.634830][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7716.635262][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7716.635583][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7716.635968][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7716.636354][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7716.636739][ C2] PKRU: 55555554 [ 7716.636915][ C2] Call Trace: [ 7716.637077][ C2] [ 7716.637221][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7716.637474][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7716.637708][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7716.637976][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7716.638239][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7716.638519][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7716.638775][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7716.639069][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7716.639323][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7716.639576][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7716.639872][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7716.640160][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7716.640464][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7716.640741][ C2] ? queued_spin_lock_slowpath+0x12b/0xb90 [ 7716.641028][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7716.641307][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7716.641607][ C2] ? get_stack_info+0x36/0xc0 [ 7716.641841][ C2] ? lock_acquire+0x1c1/0x220 [ 7716.642073][ C2] ? lock_release+0x1d5/0x250 [ 7716.642306][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7716.642545][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7716.642832][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7716.643112][ C2] ? lock_acquire+0x1c1/0x220 [ 7716.643350][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7716.643589][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7716.643847][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7716.644084][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7716.644323][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7716.644572][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7716.644838][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7716.645106][ C2] ip_local_deliver+0x19d/0x480 [ 7716.645346][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7716.645608][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7716.645863][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7716.646197][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7716.646440][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7716.646749][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7716.647002][ C2] ip_rcv+0x564/0x740 [ 7716.647201][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7716.647423][ C2] ? set_track_prepare+0x8a/0xd0 [ 7716.647666][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7716.647933][ C2] ? start_secondary+0x21c/0x2b0 [ 7716.648176][ C2] ? skb_clone+0x10b/0x330 [ 7716.648396][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7716.648704][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7716.649001][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7716.649271][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7716.649556][ C2] ? __tcf_classify+0x329/0x7d0 [ 7716.649795][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7716.650018][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7716.650308][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7716.650583][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7716.650897][ C2] ? lock_acquire+0x1c1/0x220 [ 7716.651128][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7716.651414][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7716.651688][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7716.651994][ C2] ? __copy_skb_header+0xaf/0x490 [ 7716.652243][ C2] ? __skb_clone+0x57a/0x760 [ 7716.652470][ C2] netif_receive_skb+0x55/0x280 [ 7716.652712][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7716.653036][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7716.653366][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7716.653663][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7716.653944][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7716.654223][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7716.654524][ C2] ? get_stack_info+0x36/0xc0 [ 7716.654758][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7716.655012][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7716.655320][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7716.655589][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7716.655856][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7716.656162][ C2] ? kernel_text_address+0x17/0xe0 [ 7716.656413][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7716.656717][ C2] ? arch_stack_walk+0x8c/0x100 [ 7716.656958][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7716.657214][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7716.657488][ C2] ? lock_acquire+0x1c1/0x220 [ 7716.657720][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7716.657991][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7716.658287][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7716.658554][ C2] ? get_stack_info+0x36/0xc0 [ 7716.658787][ C2] __tcf_classify+0x329/0x7d0 [ 7716.659021][ C2] tcf_classify+0x283/0x930 [ 7716.659247][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7716.659495][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7716.659797][ C2] tc_run+0x2e4/0x5d0 [ 7716.659996][ C2] ? __pfx_tc_run+0x10/0x10 [ 7716.660218][ C2] ? lock_acquire+0x1c1/0x220 [ 7716.660449][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7716.660702][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7716.660946][ C2] ? lock_acquire+0x1c1/0x220 [ 7716.661178][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7716.661434][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7716.661728][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7716.661990][ C2] ? neigh_hh_output+0x348/0x590 [ 7716.662236][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7716.662492][ C2] ip_finish_output2+0x786/0x18e0 [ 7716.662760][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7716.663094][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7716.663367][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7716.663617][ C2] ? __ip_finish_output+0x10f/0x770 [ 7716.663881][ C2] ip_output+0x16b/0x4f0 [ 7716.664102][ C2] ? __pfx_ip_output+0x10/0x10 [ 7716.664338][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7716.664605][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7716.664906][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7716.665173][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7716.665416][ C2] ? __alloc_skb+0xd4/0x280 [ 7716.665640][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7716.665900][ C2] ? tcp_fragment+0x168/0x1040 [ 7716.666137][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7716.666381][ C2] ? ip_local_out+0x114/0x3b0 [ 7716.666611][ C2] __ip_queue_xmit+0x672/0x1910 [ 7716.666851][ C2] ? __skb_clone+0x57a/0x760 [ 7716.667079][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7716.667337][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7716.667608][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7716.667843][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7716.668084][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7716.668376][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7716.668686][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7716.668923][ C2] tcp_send_loss_probe+0x348/0x830 [ 7716.669175][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7716.669434][ C2] tcp_write_timer+0x82/0x1d0 [ 7716.669667][ C2] call_timer_fn+0x173/0x430 [ 7716.669894][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7716.670149][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7716.670402][ C2] __run_timers.part.0+0x52d/0x890 [ 7716.670654][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7716.670915][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7716.671189][ C2] ? lock_acquire+0x1c1/0x220 [ 7716.671422][ C2] ? clockevents_program_event+0xf6/0x300 [ 7716.671701][ C2] ? lock_release+0x1d5/0x250 [ 7716.671932][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7716.672187][ C2] ? ktime_get+0xb3/0x190 [ 7716.672402][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7716.672687][ C2] run_timer_softirq+0x72/0x100 [ 7716.672954][ C2] __do_softirq+0x1b9/0x7ff [ 7716.673188][ C2] irq_exit_rcu+0x98/0xc0 [ 7716.673404][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7716.673689][ C2] [ 7716.673837][ C2] [ 7716.673996][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7716.674289][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7716.674537][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7716.675472][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7716.675770][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7716.676155][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7716.676541][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7716.676926][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7716.677311][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7716.677696][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7716.677976][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7716.678228][ C2] default_idle_call+0x69/0xa0 [ 7716.678463][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7716.678706][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7716.678973][ C2] ? lock_release+0x1d5/0x250 [ 7716.679205][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7716.679468][ C2] do_idle+0xfb/0x160 [ 7716.679665][ C2] cpu_startup_entry+0x55/0x60 [ 7716.679899][ C2] start_secondary+0x21c/0x2b0 [ 7716.680135][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7716.680395][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7716.680695][ C2] [ 7744.569276][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5021s! [perl:4135] [ 7744.569694][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7744.570913][ C1] irq event stamp: 209232 [ 7744.571129][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7744.571642][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7744.572104][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7744.572560][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7744.573036][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7744.573482][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7744.574092][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7744.574407][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7744.575351][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7744.575649][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7744.576038][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7744.576425][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7744.576812][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7744.577198][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7744.577586][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7744.578020][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7744.578343][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7744.578731][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7744.579116][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7744.579507][ C1] PKRU: 55555554 [ 7744.579683][ C1] Call Trace: [ 7744.579847][ C1] [ 7744.579990][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7744.580245][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7744.580479][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7744.580751][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7744.581015][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7744.581295][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7744.581553][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7744.581848][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7744.582102][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7744.582402][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7744.582712][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7744.583026][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7744.583314][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7744.583609][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7744.583904][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7744.584206][ C1] ? get_stack_info+0x36/0xc0 [ 7744.584440][ C1] ? lock_acquire+0x1c1/0x220 [ 7744.584677][ C1] ? lock_release+0x1d5/0x250 [ 7744.584910][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7744.585150][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7744.585417][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7744.585693][ C1] ? lock_acquire+0x1c1/0x220 [ 7744.585926][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7744.586159][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7744.586413][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7744.586640][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7744.586882][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7744.587134][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7744.587402][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7744.587673][ C1] ip_local_deliver+0x19d/0x480 [ 7744.587914][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7744.588178][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7744.588434][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7744.588769][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7744.589015][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7744.589327][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7744.589583][ C1] ip_rcv+0x564/0x740 [ 7744.589784][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7744.590007][ C1] ? set_track_prepare+0x8a/0xd0 [ 7744.590253][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7744.590522][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7744.590788][ C1] ? skb_clone+0x10b/0x330 [ 7744.591006][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7744.591319][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7744.591615][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7744.591886][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7744.592175][ C1] ? __tcf_classify+0x329/0x7d0 [ 7744.592417][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7744.592662][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7744.592962][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7744.593245][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7744.593570][ C1] ? lock_acquire+0x1c1/0x220 [ 7744.593816][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7744.594104][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7744.594379][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7744.594687][ C1] ? __copy_skb_header+0xaf/0x490 [ 7744.594935][ C1] ? __skb_clone+0x57a/0x760 [ 7744.595164][ C1] netif_receive_skb+0x55/0x280 [ 7744.595405][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7744.595708][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7744.596031][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7744.596319][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7744.596587][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7744.596866][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7744.597170][ C1] ? hlock_class+0x4e/0x130 [ 7744.597396][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7744.597665][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7744.597934][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7744.598190][ C1] ? hlock_class+0x4e/0x130 [ 7744.598415][ C1] ? mark_lock+0x38/0x3e0 [ 7744.598626][ C1] ? stack_access_ok+0xda/0x1f0 [ 7744.598868][ C1] ? __lock_acquire+0xb67/0x1610 [ 7744.599114][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7744.599381][ C1] ? get_stack_info+0x36/0xc0 [ 7744.599615][ C1] ? stack_access_ok+0xda/0x1f0 [ 7744.599854][ C1] ? get_reg+0x119/0x190 [ 7744.600062][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7744.600325][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7744.600623][ C1] __tcf_classify+0x329/0x7d0 [ 7744.600858][ C1] tcf_classify+0x283/0x930 [ 7744.601084][ C1] ? arch_stack_walk+0xa2/0x100 [ 7744.601325][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7744.601574][ C1] ? get_stack_info+0x36/0xc0 [ 7744.601806][ C1] tc_run+0x2e4/0x5d0 [ 7744.602007][ C1] ? __pfx_tc_run+0x10/0x10 [ 7744.602230][ C1] ? lock_acquire+0x1c1/0x220 [ 7744.602462][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7744.602739][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7744.602990][ C1] ? lock_acquire+0x1c1/0x220 [ 7744.603230][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7744.603494][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7744.603798][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7744.604072][ C1] ? neigh_hh_output+0x348/0x590 [ 7744.604318][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7744.604575][ C1] ip_finish_output2+0x786/0x18e0 [ 7744.604824][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7744.605093][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7744.605420][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7744.605690][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7744.605935][ C1] ? __ip_finish_output+0x10f/0x770 [ 7744.606192][ C1] ip_output+0x16b/0x4f0 [ 7744.606401][ C1] ? run_timer_softirq+0x72/0x100 [ 7744.606649][ C1] ? __pfx_ip_output+0x10/0x10 [ 7744.606886][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7744.607161][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7744.607407][ C1] ? ip_local_out+0x114/0x3b0 [ 7744.607641][ C1] __ip_queue_xmit+0x672/0x1910 [ 7744.607882][ C1] ? __create_object+0x5e/0xb0 [ 7744.608120][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7744.608379][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7744.608651][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7744.608917][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7744.609192][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7744.609476][ C1] tcp_delack_timer+0x84/0x240 [ 7744.609719][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7744.609990][ C1] call_timer_fn+0x173/0x430 [ 7744.610226][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7744.610487][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7744.610751][ C1] __run_timers.part.0+0x52d/0x890 [ 7744.611003][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7744.611267][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7744.611545][ C1] ? lock_acquire+0x1c1/0x220 [ 7744.611776][ C1] ? clockevents_program_event+0xf6/0x300 [ 7744.612059][ C1] ? lock_release+0x1d5/0x250 [ 7744.612292][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7744.612549][ C1] ? ktime_get+0xb3/0x190 [ 7744.612786][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7744.613082][ C1] run_timer_softirq+0x72/0x100 [ 7744.613331][ C1] __do_softirq+0x1b9/0x7ff [ 7744.613562][ C1] irq_exit_rcu+0x98/0xc0 [ 7744.613783][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7744.614070][ C1] [ 7744.614219][ C1] [ 7744.614364][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7744.614659][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7744.614975][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7744.615916][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7744.616215][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7744.616604][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7744.616990][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7744.617379][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7744.617765][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7744.618154][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7744.618443][ C1] pipe_read+0xa16/0xdf0 [ 7744.618656][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7744.618924][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7744.619161][ C1] ? iterate_tty_write+0x299/0x540 [ 7744.619413][ C1] ? lock_release+0x1d5/0x250 [ 7744.619648][ C1] vfs_read+0x911/0xc00 [ 7744.619854][ C1] ? lock_acquire+0x1c1/0x220 [ 7744.620087][ C1] ? __might_fault+0xc6/0x180 [ 7744.620321][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7744.620554][ C1] ? __might_fault+0xc6/0x180 [ 7744.620785][ C1] ? lock_release+0x1d5/0x250 [ 7744.621022][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7744.621278][ C1] ? __fget_light+0x54/0x1e0 [ 7744.621509][ C1] ksys_read+0x17a/0x1e0 [ 7744.621718][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7744.621957][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7744.622252][ C1] do_syscall_64+0xc9/0x1e0 [ 7744.622477][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7744.622793][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7744.623020][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7744.623992][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7744.624399][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7744.624788][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7744.625176][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7744.625562][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7744.625947][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7744.626341][ C1] [ 7744.626492][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5021s! [swapper/2:0] [ 7744.626895][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7744.628105][ C2] irq event stamp: 44114564 [ 7744.628325][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7744.628843][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7744.629339][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7744.629801][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7744.630253][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7744.630693][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7744.631288][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7744.631602][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7744.632541][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7744.632869][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7744.633263][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7744.633659][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7744.634059][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7744.634444][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7744.634828][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7744.635261][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7744.635580][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7744.635969][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7744.636355][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7744.636740][ C2] PKRU: 55555554 [ 7744.636915][ C2] Call Trace: [ 7744.637079][ C2] [ 7744.637221][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7744.637473][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7744.637708][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7744.637975][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7744.638241][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7744.638519][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7744.638773][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7744.639070][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7744.639323][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7744.639576][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7744.639875][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7744.640161][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7744.640465][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7744.640746][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7744.641031][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7744.641311][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7744.641613][ C2] ? get_stack_info+0x36/0xc0 [ 7744.641846][ C2] ? lock_acquire+0x1c1/0x220 [ 7744.642081][ C2] ? lock_release+0x1d5/0x250 [ 7744.642315][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7744.642556][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7744.642845][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7744.643130][ C2] ? lock_acquire+0x1c1/0x220 [ 7744.643366][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7744.643604][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7744.643871][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7744.644099][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7744.644339][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7744.644588][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7744.644852][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7744.645117][ C2] ip_local_deliver+0x19d/0x480 [ 7744.645357][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7744.645619][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7744.645875][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7744.646210][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7744.646454][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7744.646763][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7744.647016][ C2] ip_rcv+0x564/0x740 [ 7744.647213][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7744.647437][ C2] ? set_track_prepare+0x8a/0xd0 [ 7744.647681][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7744.647949][ C2] ? start_secondary+0x21c/0x2b0 [ 7744.648192][ C2] ? skb_clone+0x10b/0x330 [ 7744.648410][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7744.648717][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7744.649013][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7744.649285][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7744.649569][ C2] ? __tcf_classify+0x329/0x7d0 [ 7744.649809][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7744.650031][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7744.650319][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7744.650596][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7744.650933][ C2] ? lock_acquire+0x1c1/0x220 [ 7744.651168][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7744.651462][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7744.651745][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7744.652066][ C2] ? __copy_skb_header+0xaf/0x490 [ 7744.652315][ C2] ? __skb_clone+0x57a/0x760 [ 7744.652542][ C2] netif_receive_skb+0x55/0x280 [ 7744.652814][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7744.653123][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7744.653454][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7744.653751][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7744.654028][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7744.654304][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7744.654606][ C2] ? get_stack_info+0x36/0xc0 [ 7744.654840][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7744.655094][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7744.655401][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7744.655667][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7744.655937][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7744.656240][ C2] ? kernel_text_address+0x17/0xe0 [ 7744.656492][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7744.656794][ C2] ? arch_stack_walk+0x8c/0x100 [ 7744.657033][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7744.657288][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7744.657565][ C2] ? lock_acquire+0x1c1/0x220 [ 7744.657794][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7744.658066][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7744.658361][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7744.658627][ C2] ? get_stack_info+0x36/0xc0 [ 7744.658859][ C2] __tcf_classify+0x329/0x7d0 [ 7744.659091][ C2] tcf_classify+0x283/0x930 [ 7744.659316][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7744.659562][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7744.659865][ C2] tc_run+0x2e4/0x5d0 [ 7744.660062][ C2] ? __pfx_tc_run+0x10/0x10 [ 7744.660286][ C2] ? lock_acquire+0x1c1/0x220 [ 7744.660516][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7744.660772][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7744.661015][ C2] ? lock_acquire+0x1c1/0x220 [ 7744.661245][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7744.661500][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7744.661795][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7744.662056][ C2] ? neigh_hh_output+0x348/0x590 [ 7744.662301][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7744.662557][ C2] ip_finish_output2+0x786/0x18e0 [ 7744.662829][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7744.663167][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7744.663441][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7744.663693][ C2] ? __ip_finish_output+0x10f/0x770 [ 7744.663961][ C2] ip_output+0x16b/0x4f0 [ 7744.664170][ C2] ? __pfx_ip_output+0x10/0x10 [ 7744.664405][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7744.664678][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7744.664977][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7744.665247][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7744.665489][ C2] ? __alloc_skb+0xd4/0x280 [ 7744.665710][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7744.665970][ C2] ? tcp_fragment+0x168/0x1040 [ 7744.666205][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7744.666449][ C2] ? ip_local_out+0x114/0x3b0 [ 7744.666680][ C2] __ip_queue_xmit+0x672/0x1910 [ 7744.666921][ C2] ? __skb_clone+0x57a/0x760 [ 7744.667148][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7744.667405][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7744.667675][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7744.667912][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7744.668153][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7744.668441][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7744.668749][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7744.668985][ C2] tcp_send_loss_probe+0x348/0x830 [ 7744.669237][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7744.669496][ C2] tcp_write_timer+0x82/0x1d0 [ 7744.669728][ C2] call_timer_fn+0x173/0x430 [ 7744.669957][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7744.670210][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7744.670463][ C2] __run_timers.part.0+0x52d/0x890 [ 7744.670714][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7744.670974][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7744.671251][ C2] ? lock_acquire+0x1c1/0x220 [ 7744.671481][ C2] ? clockevents_program_event+0xf6/0x300 [ 7744.671761][ C2] ? lock_release+0x1d5/0x250 [ 7744.671994][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7744.672250][ C2] ? ktime_get+0xb3/0x190 [ 7744.672462][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7744.672780][ C2] run_timer_softirq+0x72/0x100 [ 7744.673026][ C2] __do_softirq+0x1b9/0x7ff [ 7744.673256][ C2] irq_exit_rcu+0x98/0xc0 [ 7744.673476][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7744.673758][ C2] [ 7744.673916][ C2] [ 7744.674061][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7744.674355][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7744.674603][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7744.675539][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7744.675837][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7744.676223][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7744.676607][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7744.676992][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7744.677379][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7744.677765][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7744.678045][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7744.678300][ C2] default_idle_call+0x69/0xa0 [ 7744.678534][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7744.678777][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7744.679045][ C2] ? lock_release+0x1d5/0x250 [ 7744.679274][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7744.679539][ C2] do_idle+0xfb/0x160 [ 7744.679736][ C2] cpu_startup_entry+0x55/0x60 [ 7744.679971][ C2] start_secondary+0x21c/0x2b0 [ 7744.680204][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7744.680466][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7744.680765][ C2] [ 7766.949102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7766.949455][ C1] rcu: 1-....: (5399108 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1322471 [ 7766.950000][ C1] rcu: (t=5412062 jiffies g=1882453 q=721 ncpus=4) [ 7766.950326][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7766.950763][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7766.951356][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7766.951673][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7766.952640][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7766.952947][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7766.953344][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7766.953754][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7766.954140][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7766.954527][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7766.954914][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7766.955349][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7766.955674][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7766.956064][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7766.956451][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7766.956839][ C1] PKRU: 55555554 [ 7766.957015][ C1] Call Trace: [ 7766.957181][ C1] [ 7766.957323][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7766.957589][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7766.957834][ C1] ? check_cpu_stall+0x284/0x500 [ 7766.958078][ C1] ? rcu_pending+0x92/0x360 [ 7766.958305][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7766.958567][ C1] ? update_process_times+0xb9/0x110 [ 7766.958827][ C1] ? tick_sched_handle+0x67/0x130 [ 7766.959076][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7766.959359][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7766.959595][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7766.959901][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7766.960168][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7766.960449][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7766.960706][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7766.961004][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7766.961259][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7766.961560][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7766.961848][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7766.962154][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7766.962435][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7766.962746][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7766.963033][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7766.963346][ C1] ? get_stack_info+0x36/0xc0 [ 7766.963587][ C1] ? lock_acquire+0x1c1/0x220 [ 7766.963836][ C1] ? lock_release+0x1d5/0x250 [ 7766.964069][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7766.964311][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7766.964574][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7766.964855][ C1] ? lock_acquire+0x1c1/0x220 [ 7766.965088][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7766.965320][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7766.965573][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7766.965802][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7766.966043][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7766.966295][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7766.966562][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7766.966831][ C1] ip_local_deliver+0x19d/0x480 [ 7766.967071][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7766.967337][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7766.967594][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7766.967931][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7766.968177][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7766.968488][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7766.968744][ C1] ip_rcv+0x564/0x740 [ 7766.968942][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7766.969169][ C1] ? set_track_prepare+0x8a/0xd0 [ 7766.969416][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7766.969684][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7766.969949][ C1] ? skb_clone+0x10b/0x330 [ 7766.970171][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7766.970482][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7766.970780][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7766.971055][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7766.971341][ C1] ? __tcf_classify+0x329/0x7d0 [ 7766.971582][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7766.971808][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7766.972100][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7766.972376][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7766.972716][ C1] ? lock_acquire+0x1c1/0x220 [ 7766.972955][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7766.973251][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7766.973536][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7766.973859][ C1] ? __copy_skb_header+0xaf/0x490 [ 7766.974108][ C1] ? __skb_clone+0x57a/0x760 [ 7766.974338][ C1] netif_receive_skb+0x55/0x280 [ 7766.974578][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7766.974881][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7766.975204][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7766.975496][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7766.975763][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7766.976045][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7766.976349][ C1] ? hlock_class+0x4e/0x130 [ 7766.976575][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7766.976842][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7766.977113][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7766.977370][ C1] ? hlock_class+0x4e/0x130 [ 7766.977594][ C1] ? mark_lock+0x38/0x3e0 [ 7766.977809][ C1] ? stack_access_ok+0xda/0x1f0 [ 7766.978052][ C1] ? __lock_acquire+0xb67/0x1610 [ 7766.978299][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7766.978567][ C1] ? get_stack_info+0x36/0xc0 [ 7766.978802][ C1] ? stack_access_ok+0xda/0x1f0 [ 7766.979043][ C1] ? get_reg+0x119/0x190 [ 7766.979253][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7766.979513][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7766.979815][ C1] __tcf_classify+0x329/0x7d0 [ 7766.980052][ C1] tcf_classify+0x283/0x930 [ 7766.980275][ C1] ? arch_stack_walk+0xa2/0x100 [ 7766.980518][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7766.980768][ C1] ? get_stack_info+0x36/0xc0 [ 7766.981006][ C1] tc_run+0x2e4/0x5d0 [ 7766.981205][ C1] ? __pfx_tc_run+0x10/0x10 [ 7766.981431][ C1] ? lock_acquire+0x1c1/0x220 [ 7766.981663][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7766.981918][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7766.982164][ C1] ? lock_acquire+0x1c1/0x220 [ 7766.982394][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7766.982675][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7766.982980][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7766.983252][ C1] ? neigh_hh_output+0x348/0x590 [ 7766.983503][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7766.983778][ C1] ip_finish_output2+0x786/0x18e0 [ 7766.984027][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7766.984298][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7766.984626][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7766.984893][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7766.985139][ C1] ? __ip_finish_output+0x10f/0x770 [ 7766.985396][ C1] ip_output+0x16b/0x4f0 [ 7766.985609][ C1] ? run_timer_softirq+0x72/0x100 [ 7766.985859][ C1] ? __pfx_ip_output+0x10/0x10 [ 7766.986096][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7766.986375][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7766.986620][ C1] ? ip_local_out+0x114/0x3b0 [ 7766.986855][ C1] __ip_queue_xmit+0x672/0x1910 [ 7766.987097][ C1] ? __create_object+0x5e/0xb0 [ 7766.987334][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7766.987595][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7766.987874][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7766.988138][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7766.988413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7766.988678][ C1] tcp_delack_timer+0x84/0x240 [ 7766.988916][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7766.989181][ C1] call_timer_fn+0x173/0x430 [ 7766.989410][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7766.989665][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7766.989920][ C1] __run_timers.part.0+0x52d/0x890 [ 7766.990172][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7766.990439][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7766.990715][ C1] ? lock_acquire+0x1c1/0x220 [ 7766.990948][ C1] ? clockevents_program_event+0xf6/0x300 [ 7766.991232][ C1] ? lock_release+0x1d5/0x250 [ 7766.991463][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7766.991721][ C1] ? ktime_get+0xb3/0x190 [ 7766.991936][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7766.992225][ C1] run_timer_softirq+0x72/0x100 [ 7766.992466][ C1] __do_softirq+0x1b9/0x7ff [ 7766.992718][ C1] irq_exit_rcu+0x98/0xc0 [ 7766.992939][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7766.993224][ C1] [ 7766.993373][ C1] [ 7766.993525][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7766.993835][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7766.994151][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7766.995094][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7766.995392][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7766.995781][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7766.996171][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7766.996559][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7766.996946][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7766.997338][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7766.997624][ C1] pipe_read+0xa16/0xdf0 [ 7766.997841][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7766.998110][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7766.998348][ C1] ? iterate_tty_write+0x299/0x540 [ 7766.998602][ C1] ? lock_release+0x1d5/0x250 [ 7766.998837][ C1] vfs_read+0x911/0xc00 [ 7766.999047][ C1] ? lock_acquire+0x1c1/0x220 [ 7766.999280][ C1] ? __might_fault+0xc6/0x180 [ 7766.999512][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7766.999745][ C1] ? __might_fault+0xc6/0x180 [ 7766.999978][ C1] ? lock_release+0x1d5/0x250 [ 7767.000212][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7767.000471][ C1] ? __fget_light+0x54/0x1e0 [ 7767.000701][ C1] ksys_read+0x17a/0x1e0 [ 7767.000912][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7767.001151][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7767.001447][ C1] do_syscall_64+0xc9/0x1e0 [ 7767.001672][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7767.001964][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7767.002183][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7767.003162][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7767.003583][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7767.003983][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7767.004371][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7767.004759][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7767.005149][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7767.005538][ C1] [ 7767.005692][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7767.005955][ C2] NMI backtrace for cpu 2 [ 7767.005960][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7767.005966][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7767.005969][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7767.005977][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7767.005983][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7767.005987][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7767.005991][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7767.005995][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7767.005998][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7767.006002][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7767.006006][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7767.006010][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7767.006016][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7767.006019][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7767.006022][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7767.006026][ C2] PKRU: 55555554 [ 7767.006028][ C2] Call Trace: [ 7767.006030][ C2] [ 7767.006033][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7767.006044][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7767.006052][ C2] ? nmi_handle+0x153/0x420 [ 7767.006061][ C2] ? default_do_nmi+0x41/0x100 [ 7767.006067][ C2] ? exc_nmi+0xf3/0x120 [ 7767.006073][ C2] ? end_repeat_nmi+0xf/0x60 [ 7767.006079][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7767.006082][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7767.006085][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7767.006089][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7767.006092][ C2] [ 7767.006092][ C2] [ 7767.006094][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7767.006096][ C2] ? get_stack_info+0x36/0xc0 [ 7767.006100][ C2] ? lock_acquire+0x1c1/0x220 [ 7767.006103][ C2] ? lock_release+0x1d5/0x250 [ 7767.006107][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7767.006110][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7767.006113][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7767.006116][ C2] ? lock_acquire+0x1c1/0x220 [ 7767.006118][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7767.006122][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7767.006124][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7767.006130][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7767.006132][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7767.006137][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7767.006141][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7767.006144][ C2] ip_local_deliver+0x19d/0x480 [ 7767.006147][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7767.006148][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7767.006151][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7767.006156][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7767.006159][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7767.006162][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7767.006170][ C2] ip_rcv+0x564/0x740 [ 7767.006173][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7767.006175][ C2] ? set_track_prepare+0x8a/0xd0 [ 7767.006179][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7767.006182][ C2] ? start_secondary+0x21c/0x2b0 [ 7767.006185][ C2] ? skb_clone+0x10b/0x330 [ 7767.006188][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7767.006193][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7767.006199][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7767.006202][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7767.006210][ C2] ? __tcf_classify+0x329/0x7d0 [ 7767.006213][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7767.006215][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7767.006218][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7767.006221][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7767.006226][ C2] ? lock_acquire+0x1c1/0x220 [ 7767.006228][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7767.006232][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7767.006235][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7767.006239][ C2] ? __copy_skb_header+0xaf/0x490 [ 7767.006243][ C2] ? __skb_clone+0x57a/0x760 [ 7767.006245][ C2] netif_receive_skb+0x55/0x280 [ 7767.006248][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7767.006255][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7767.006261][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7767.006267][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7767.006272][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7767.006281][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7767.006288][ C2] ? get_stack_info+0x36/0xc0 [ 7767.006293][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7767.006296][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7767.006299][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7767.006301][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7767.006304][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7767.006306][ C2] ? kernel_text_address+0x17/0xe0 [ 7767.006309][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7767.006313][ C2] ? arch_stack_walk+0x8c/0x100 [ 7767.006316][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7767.006319][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7767.006322][ C2] ? lock_acquire+0x1c1/0x220 [ 7767.006324][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7767.006328][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7767.006332][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7767.006335][ C2] ? get_stack_info+0x36/0xc0 [ 7767.006339][ C2] __tcf_classify+0x329/0x7d0 [ 7767.006343][ C2] tcf_classify+0x283/0x930 [ 7767.006348][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7767.006351][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7767.006355][ C2] tc_run+0x2e4/0x5d0 [ 7767.006358][ C2] ? __pfx_tc_run+0x10/0x10 [ 7767.006361][ C2] ? lock_acquire+0x1c1/0x220 [ 7767.006363][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7767.006367][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7767.006371][ C2] ? lock_acquire+0x1c1/0x220 [ 7767.006373][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7767.006376][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7767.006379][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7767.006382][ C2] ? neigh_hh_output+0x348/0x590 [ 7767.006386][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7767.006389][ C2] ip_finish_output2+0x786/0x18e0 [ 7767.006393][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7767.006400][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7767.006402][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7767.006406][ C2] ? __ip_finish_output+0x10f/0x770 [ 7767.006409][ C2] ip_output+0x16b/0x4f0 [ 7767.006412][ C2] ? __pfx_ip_output+0x10/0x10 [ 7767.006415][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7767.006417][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7767.006420][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7767.006423][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7767.006426][ C2] ? __alloc_skb+0xd4/0x280 [ 7767.006428][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7767.006431][ C2] ? tcp_fragment+0x168/0x1040 [ 7767.006434][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7767.006437][ C2] ? ip_local_out+0x114/0x3b0 [ 7767.006440][ C2] __ip_queue_xmit+0x672/0x1910 [ 7767.006444][ C2] ? __skb_clone+0x57a/0x760 [ 7767.006446][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7767.006451][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7767.006454][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7767.006458][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7767.006462][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7767.006465][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7767.006468][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7767.006471][ C2] tcp_send_loss_probe+0x348/0x830 [ 7767.006474][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7767.006477][ C2] tcp_write_timer+0x82/0x1d0 [ 7767.006480][ C2] call_timer_fn+0x173/0x430 [ 7767.006483][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7767.006488][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7767.006492][ C2] __run_timers.part.0+0x52d/0x890 [ 7767.006494][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7767.006499][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7767.006501][ C2] ? lock_acquire+0x1c1/0x220 [ 7767.006504][ C2] ? clockevents_program_event+0xf6/0x300 [ 7767.006508][ C2] ? lock_release+0x1d5/0x250 [ 7767.006510][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7767.006514][ C2] ? ktime_get+0xb3/0x190 [ 7767.006517][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7767.006521][ C2] run_timer_softirq+0x72/0x100 [ 7767.006524][ C2] __do_softirq+0x1b9/0x7ff [ 7767.006528][ C2] irq_exit_rcu+0x98/0xc0 [ 7767.006531][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7767.006534][ C2] [ 7767.006534][ C2] [ 7767.006535][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7767.006539][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7767.006541][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7767.006543][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7767.006545][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7767.006547][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7767.006548][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7767.006549][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7767.006551][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7767.006554][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7767.006557][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7767.006559][ C2] default_idle_call+0x69/0xa0 [ 7767.006562][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7767.006565][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7767.006568][ C2] ? lock_release+0x1d5/0x250 [ 7767.006570][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7767.006574][ C2] do_idle+0xfb/0x160 [ 7767.006576][ C2] cpu_startup_entry+0x55/0x60 [ 7767.006579][ C2] start_secondary+0x21c/0x2b0 [ 7767.006581][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7767.006585][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7767.006591][ C2] [ 7792.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5066s! [perl:4135] [ 7792.569676][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7792.570898][ C1] irq event stamp: 209232 [ 7792.571113][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7792.571627][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7792.572092][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7792.572573][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7792.573033][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7792.573483][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7792.574093][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7792.574409][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7792.575355][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7792.575654][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7792.576044][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7792.576434][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7792.576821][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7792.577211][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7792.577600][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7792.578035][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7792.578359][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7792.578748][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7792.579139][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7792.579528][ C1] PKRU: 55555554 [ 7792.579705][ C1] Call Trace: [ 7792.579870][ C1] [ 7792.580015][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7792.580271][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7792.580509][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7792.580778][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7792.581043][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7792.581326][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7792.581584][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7792.581882][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7792.582138][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7792.582461][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7792.582757][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7792.583072][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7792.583362][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7792.583667][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7792.583948][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7792.584252][ C1] ? get_stack_info+0x36/0xc0 [ 7792.584487][ C1] ? lock_acquire+0x1c1/0x220 [ 7792.584721][ C1] ? lock_release+0x1d5/0x250 [ 7792.584955][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7792.585198][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7792.585464][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7792.585741][ C1] ? lock_acquire+0x1c1/0x220 [ 7792.585974][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7792.586210][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7792.586465][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7792.586693][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7792.586934][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7792.587188][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7792.587457][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7792.587729][ C1] ip_local_deliver+0x19d/0x480 [ 7792.587972][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7792.588237][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7792.588495][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7792.588834][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7792.589082][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7792.589394][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7792.589650][ C1] ip_rcv+0x564/0x740 [ 7792.589851][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7792.590075][ C1] ? set_track_prepare+0x8a/0xd0 [ 7792.590322][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7792.590592][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7792.590859][ C1] ? skb_clone+0x10b/0x330 [ 7792.591078][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7792.591390][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7792.591690][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7792.591963][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7792.592252][ C1] ? __tcf_classify+0x329/0x7d0 [ 7792.592518][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7792.592747][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7792.593049][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7792.593335][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7792.593672][ C1] ? lock_acquire+0x1c1/0x220 [ 7792.593902][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7792.594192][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7792.594469][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7792.594779][ C1] ? __copy_skb_header+0xaf/0x490 [ 7792.595030][ C1] ? __skb_clone+0x57a/0x760 [ 7792.595260][ C1] netif_receive_skb+0x55/0x280 [ 7792.595502][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7792.595810][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7792.596154][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7792.596454][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7792.596730][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7792.597017][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7792.597331][ C1] ? hlock_class+0x4e/0x130 [ 7792.597564][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7792.597842][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7792.598119][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7792.598387][ C1] ? hlock_class+0x4e/0x130 [ 7792.598612][ C1] ? mark_lock+0x38/0x3e0 [ 7792.598826][ C1] ? stack_access_ok+0xda/0x1f0 [ 7792.599071][ C1] ? __lock_acquire+0xb67/0x1610 [ 7792.599319][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7792.599590][ C1] ? get_stack_info+0x36/0xc0 [ 7792.599824][ C1] ? stack_access_ok+0xda/0x1f0 [ 7792.600065][ C1] ? get_reg+0x119/0x190 [ 7792.600276][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7792.600539][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7792.600839][ C1] __tcf_classify+0x329/0x7d0 [ 7792.601075][ C1] tcf_classify+0x283/0x930 [ 7792.601302][ C1] ? arch_stack_walk+0xa2/0x100 [ 7792.601545][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7792.601794][ C1] ? get_stack_info+0x36/0xc0 [ 7792.602028][ C1] tc_run+0x2e4/0x5d0 [ 7792.602230][ C1] ? __pfx_tc_run+0x10/0x10 [ 7792.602476][ C1] ? lock_acquire+0x1c1/0x220 [ 7792.602715][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7792.602975][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7792.603228][ C1] ? lock_acquire+0x1c1/0x220 [ 7792.603468][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7792.603740][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7792.604037][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7792.604303][ C1] ? neigh_hh_output+0x348/0x590 [ 7792.604549][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7792.604807][ C1] ip_finish_output2+0x786/0x18e0 [ 7792.605058][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7792.605328][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7792.605658][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7792.605929][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7792.606176][ C1] ? __ip_finish_output+0x10f/0x770 [ 7792.606434][ C1] ip_output+0x16b/0x4f0 [ 7792.606644][ C1] ? run_timer_softirq+0x72/0x100 [ 7792.606894][ C1] ? __pfx_ip_output+0x10/0x10 [ 7792.607132][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7792.607412][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7792.607658][ C1] ? ip_local_out+0x114/0x3b0 [ 7792.607891][ C1] __ip_queue_xmit+0x672/0x1910 [ 7792.608134][ C1] ? __create_object+0x5e/0xb0 [ 7792.608373][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7792.608633][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7792.608907][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7792.609175][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7792.609449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7792.609734][ C1] tcp_delack_timer+0x84/0x240 [ 7792.609977][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7792.610249][ C1] call_timer_fn+0x173/0x430 [ 7792.610487][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7792.610750][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7792.611011][ C1] __run_timers.part.0+0x52d/0x890 [ 7792.611272][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7792.611545][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7792.611832][ C1] ? lock_acquire+0x1c1/0x220 [ 7792.612071][ C1] ? clockevents_program_event+0xf6/0x300 [ 7792.612363][ C1] ? lock_release+0x1d5/0x250 [ 7792.612603][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7792.612868][ C1] ? ktime_get+0xb3/0x190 [ 7792.613089][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7792.613386][ C1] run_timer_softirq+0x72/0x100 [ 7792.613645][ C1] __do_softirq+0x1b9/0x7ff [ 7792.613872][ C1] irq_exit_rcu+0x98/0xc0 [ 7792.614086][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7792.614365][ C1] [ 7792.614513][ C1] [ 7792.614658][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7792.614956][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7792.615293][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7792.616262][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7792.616570][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7792.616973][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7792.617359][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7792.617749][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7792.618138][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7792.618527][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7792.618816][ C1] pipe_read+0xa16/0xdf0 [ 7792.619030][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7792.619300][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7792.619536][ C1] ? iterate_tty_write+0x299/0x540 [ 7792.619791][ C1] ? lock_release+0x1d5/0x250 [ 7792.620027][ C1] vfs_read+0x911/0xc00 [ 7792.620235][ C1] ? lock_acquire+0x1c1/0x220 [ 7792.620469][ C1] ? __might_fault+0xc6/0x180 [ 7792.620703][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7792.620937][ C1] ? __might_fault+0xc6/0x180 [ 7792.621170][ C1] ? lock_release+0x1d5/0x250 [ 7792.621404][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7792.621661][ C1] ? __fget_light+0x54/0x1e0 [ 7792.621894][ C1] ksys_read+0x17a/0x1e0 [ 7792.622105][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7792.622344][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7792.622667][ C1] do_syscall_64+0xc9/0x1e0 [ 7792.622901][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7792.623200][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7792.623429][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7792.624388][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7792.624798][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7792.625188][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7792.625576][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7792.625963][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7792.626353][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7792.626745][ C1] [ 7792.626896][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5066s! [swapper/2:0] [ 7792.627295][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7792.628502][ C2] irq event stamp: 44114564 [ 7792.628724][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7792.629240][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7792.629733][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7792.630193][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7792.630647][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7792.631086][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7792.631677][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7792.631991][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7792.632963][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7792.633266][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7792.633670][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7792.634052][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7792.634436][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7792.634821][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7792.635208][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7792.635638][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7792.635958][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7792.636343][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7792.636728][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7792.637113][ C2] PKRU: 55555554 [ 7792.637289][ C2] Call Trace: [ 7792.637450][ C2] [ 7792.637595][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7792.637846][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7792.638081][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7792.638349][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7792.638612][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7792.638892][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7792.639148][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7792.639442][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7792.639694][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7792.639948][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7792.640246][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7792.640531][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7792.640835][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7792.641114][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7792.641399][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7792.641678][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7792.641979][ C2] ? get_stack_info+0x36/0xc0 [ 7792.642211][ C2] ? lock_acquire+0x1c1/0x220 [ 7792.642466][ C2] ? lock_release+0x1d5/0x250 [ 7792.642704][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7792.642949][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7792.643220][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7792.643501][ C2] ? lock_acquire+0x1c1/0x220 [ 7792.643746][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7792.643977][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7792.644229][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7792.644454][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7792.644693][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7792.644941][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7792.645207][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7792.645474][ C2] ip_local_deliver+0x19d/0x480 [ 7792.645714][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7792.645975][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7792.646229][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7792.646564][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7792.646808][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7792.647118][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7792.647373][ C2] ip_rcv+0x564/0x740 [ 7792.647574][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7792.647794][ C2] ? set_track_prepare+0x8a/0xd0 [ 7792.648038][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7792.648305][ C2] ? start_secondary+0x21c/0x2b0 [ 7792.648548][ C2] ? skb_clone+0x10b/0x330 [ 7792.648766][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7792.649074][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7792.649370][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7792.649640][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7792.649925][ C2] ? __tcf_classify+0x329/0x7d0 [ 7792.650164][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7792.650387][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7792.650677][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7792.650949][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7792.651263][ C2] ? lock_acquire+0x1c1/0x220 [ 7792.651494][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7792.651781][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7792.652055][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7792.652366][ C2] ? __copy_skb_header+0xaf/0x490 [ 7792.652635][ C2] ? __skb_clone+0x57a/0x760 [ 7792.652868][ C2] netif_receive_skb+0x55/0x280 [ 7792.653115][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7792.653422][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7792.653759][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7792.654047][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7792.654311][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7792.654590][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7792.654891][ C2] ? get_stack_info+0x36/0xc0 [ 7792.655122][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7792.655379][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7792.655684][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7792.655952][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7792.656218][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7792.656523][ C2] ? kernel_text_address+0x17/0xe0 [ 7792.656774][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7792.657075][ C2] ? arch_stack_walk+0x8c/0x100 [ 7792.657316][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7792.657572][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7792.657844][ C2] ? lock_acquire+0x1c1/0x220 [ 7792.658076][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7792.658348][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7792.658641][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7792.658909][ C2] ? get_stack_info+0x36/0xc0 [ 7792.659141][ C2] __tcf_classify+0x329/0x7d0 [ 7792.659374][ C2] tcf_classify+0x283/0x930 [ 7792.659599][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7792.659846][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7792.660149][ C2] tc_run+0x2e4/0x5d0 [ 7792.660347][ C2] ? __pfx_tc_run+0x10/0x10 [ 7792.660568][ C2] ? lock_acquire+0x1c1/0x220 [ 7792.660799][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7792.661050][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7792.661294][ C2] ? lock_acquire+0x1c1/0x220 [ 7792.661525][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7792.661779][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7792.662072][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7792.662335][ C2] ? neigh_hh_output+0x348/0x590 [ 7792.662602][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7792.662864][ C2] ip_finish_output2+0x786/0x18e0 [ 7792.663118][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7792.663451][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7792.663733][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7792.663976][ C2] ? __ip_finish_output+0x10f/0x770 [ 7792.664233][ C2] ip_output+0x16b/0x4f0 [ 7792.664441][ C2] ? __pfx_ip_output+0x10/0x10 [ 7792.664677][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7792.664942][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7792.665244][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7792.665510][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7792.665752][ C2] ? __alloc_skb+0xd4/0x280 [ 7792.665976][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7792.666235][ C2] ? tcp_fragment+0x168/0x1040 [ 7792.666470][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7792.666714][ C2] ? ip_local_out+0x114/0x3b0 [ 7792.666946][ C2] __ip_queue_xmit+0x672/0x1910 [ 7792.667185][ C2] ? __skb_clone+0x57a/0x760 [ 7792.667413][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7792.667669][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7792.667942][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7792.668177][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7792.668416][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7792.668707][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7792.669015][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7792.669252][ C2] tcp_send_loss_probe+0x348/0x830 [ 7792.669503][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7792.669761][ C2] tcp_write_timer+0x82/0x1d0 [ 7792.669992][ C2] call_timer_fn+0x173/0x430 [ 7792.670220][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7792.670477][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7792.670730][ C2] __run_timers.part.0+0x52d/0x890 [ 7792.670981][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7792.671241][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7792.671515][ C2] ? lock_acquire+0x1c1/0x220 [ 7792.671746][ C2] ? clockevents_program_event+0xf6/0x300 [ 7792.672025][ C2] ? lock_release+0x1d5/0x250 [ 7792.672256][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7792.672535][ C2] ? ktime_get+0xb3/0x190 [ 7792.672755][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7792.673049][ C2] run_timer_softirq+0x72/0x100 [ 7792.673294][ C2] __do_softirq+0x1b9/0x7ff [ 7792.673526][ C2] irq_exit_rcu+0x98/0xc0 [ 7792.673743][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7792.674026][ C2] [ 7792.674174][ C2] [ 7792.674324][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7792.674624][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7792.674879][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7792.675845][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7792.676140][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7792.676527][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7792.676912][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7792.677297][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7792.677681][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7792.678068][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7792.678348][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7792.678599][ C2] default_idle_call+0x69/0xa0 [ 7792.678837][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7792.679081][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7792.679348][ C2] ? lock_release+0x1d5/0x250 [ 7792.679579][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7792.679842][ C2] do_idle+0xfb/0x160 [ 7792.680038][ C2] cpu_startup_entry+0x55/0x60 [ 7792.680273][ C2] start_secondary+0x21c/0x2b0 [ 7792.680509][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7792.680768][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7792.681069][ C2] [ 7820.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5092s! [perl:4135] [ 7820.569689][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7820.570912][ C1] irq event stamp: 209232 [ 7820.571126][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7820.571642][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7820.572106][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7820.572590][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7820.573051][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7820.573509][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7820.574104][ C1] RIP: 0010:kasan_check_range+0x161/0x1c0 [ 7820.574387][ C1] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [ 7820.575332][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000282 [ 7820.575632][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 7820.576019][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7820.576408][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 7820.576797][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7820.577185][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7820.577573][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7820.578007][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7820.578332][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7820.578724][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7820.579112][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7820.579500][ C1] PKRU: 55555554 [ 7820.579677][ C1] Call Trace: [ 7820.579844][ C1] [ 7820.579987][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7820.580242][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7820.580480][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7820.580749][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7820.581017][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7820.581297][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7820.581556][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7820.581855][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7820.582108][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 7820.582384][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7820.582693][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7820.582990][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7820.583306][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7820.583603][ C1] ? kasan_check_range+0x161/0x1c0 [ 7820.583857][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7820.584130][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7820.584434][ C1] ? get_stack_info+0x36/0xc0 [ 7820.584670][ C1] ? lock_acquire+0x1c1/0x220 [ 7820.584906][ C1] ? lock_release+0x1d5/0x250 [ 7820.585140][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7820.585380][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7820.585648][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7820.585927][ C1] ? lock_acquire+0x1c1/0x220 [ 7820.586161][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7820.586396][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7820.586651][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7820.586878][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7820.587121][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7820.587372][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7820.587642][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7820.587920][ C1] ip_local_deliver+0x19d/0x480 [ 7820.588162][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7820.588427][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7820.588686][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7820.589025][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7820.589272][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7820.589584][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7820.589842][ C1] ip_rcv+0x564/0x740 [ 7820.590042][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7820.590268][ C1] ? set_track_prepare+0x8a/0xd0 [ 7820.590516][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7820.590785][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7820.591054][ C1] ? skb_clone+0x10b/0x330 [ 7820.591276][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7820.591587][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7820.591886][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7820.592162][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7820.592478][ C1] ? __tcf_classify+0x329/0x7d0 [ 7820.592727][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7820.592958][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7820.593259][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7820.593552][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7820.593869][ C1] ? lock_acquire+0x1c1/0x220 [ 7820.594103][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7820.594394][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7820.594691][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7820.595008][ C1] ? __copy_skb_header+0xaf/0x490 [ 7820.595267][ C1] ? __skb_clone+0x57a/0x760 [ 7820.595504][ C1] netif_receive_skb+0x55/0x280 [ 7820.595754][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7820.596067][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7820.596403][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7820.596701][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7820.596978][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7820.597269][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7820.597583][ C1] ? hlock_class+0x4e/0x130 [ 7820.597816][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7820.598095][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7820.598371][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7820.598637][ C1] ? hlock_class+0x4e/0x130 [ 7820.598870][ C1] ? mark_lock+0x38/0x3e0 [ 7820.599090][ C1] ? stack_access_ok+0xda/0x1f0 [ 7820.599341][ C1] ? __lock_acquire+0xb67/0x1610 [ 7820.599596][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7820.599873][ C1] ? get_stack_info+0x36/0xc0 [ 7820.600115][ C1] ? stack_access_ok+0xda/0x1f0 [ 7820.600364][ C1] ? get_reg+0x119/0x190 [ 7820.600581][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7820.600851][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7820.601161][ C1] __tcf_classify+0x329/0x7d0 [ 7820.601405][ C1] tcf_classify+0x283/0x930 [ 7820.601639][ C1] ? arch_stack_walk+0xa2/0x100 [ 7820.601888][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7820.602146][ C1] ? get_stack_info+0x36/0xc0 [ 7820.602393][ C1] tc_run+0x2e4/0x5d0 [ 7820.602600][ C1] ? __pfx_tc_run+0x10/0x10 [ 7820.602832][ C1] ? lock_acquire+0x1c1/0x220 [ 7820.603073][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7820.603336][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7820.603591][ C1] ? lock_acquire+0x1c1/0x220 [ 7820.603830][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7820.604097][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7820.604402][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7820.604676][ C1] ? neigh_hh_output+0x348/0x590 [ 7820.604931][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7820.605198][ C1] ip_finish_output2+0x786/0x18e0 [ 7820.605455][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7820.605735][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7820.606073][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7820.606352][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7820.606609][ C1] ? __ip_finish_output+0x10f/0x770 [ 7820.606876][ C1] ip_output+0x16b/0x4f0 [ 7820.607093][ C1] ? run_timer_softirq+0x72/0x100 [ 7820.607352][ C1] ? __pfx_ip_output+0x10/0x10 [ 7820.607597][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7820.607883][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7820.608137][ C1] ? ip_local_out+0x114/0x3b0 [ 7820.608379][ C1] __ip_queue_xmit+0x672/0x1910 [ 7820.608630][ C1] ? __create_object+0x5e/0xb0 [ 7820.608875][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7820.609144][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7820.609427][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7820.609701][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7820.609987][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7820.610261][ C1] tcp_delack_timer+0x84/0x240 [ 7820.610510][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7820.610784][ C1] call_timer_fn+0x173/0x430 [ 7820.611021][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7820.611285][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7820.611548][ C1] __run_timers.part.0+0x52d/0x890 [ 7820.611809][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7820.612084][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7820.612375][ C1] ? lock_acquire+0x1c1/0x220 [ 7820.612613][ C1] ? clockevents_program_event+0xf6/0x300 [ 7820.612907][ C1] ? lock_release+0x1d5/0x250 [ 7820.613147][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7820.613414][ C1] ? ktime_get+0xb3/0x190 [ 7820.613635][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7820.613934][ C1] run_timer_softirq+0x72/0x100 [ 7820.614185][ C1] __do_softirq+0x1b9/0x7ff [ 7820.614416][ C1] irq_exit_rcu+0x98/0xc0 [ 7820.614639][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7820.614925][ C1] [ 7820.615080][ C1] [ 7820.615231][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7820.615539][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7820.615865][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7820.616842][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7820.617154][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7820.617556][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7820.617956][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7820.618359][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7820.618761][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7820.619165][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7820.619463][ C1] pipe_read+0xa16/0xdf0 [ 7820.619685][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7820.619964][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7820.620210][ C1] ? iterate_tty_write+0x299/0x540 [ 7820.620472][ C1] ? lock_release+0x1d5/0x250 [ 7820.620715][ C1] vfs_read+0x911/0xc00 [ 7820.620930][ C1] ? lock_acquire+0x1c1/0x220 [ 7820.621170][ C1] ? __might_fault+0xc6/0x180 [ 7820.621413][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7820.621652][ C1] ? __might_fault+0xc6/0x180 [ 7820.621893][ C1] ? lock_release+0x1d5/0x250 [ 7820.622135][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7820.622405][ C1] ? __fget_light+0x54/0x1e0 [ 7820.622643][ C1] ksys_read+0x17a/0x1e0 [ 7820.622860][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7820.623107][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7820.623413][ C1] do_syscall_64+0xc9/0x1e0 [ 7820.623646][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7820.623949][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7820.624179][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7820.625155][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7820.625577][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7820.625978][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7820.626381][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7820.626781][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7820.627182][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7820.627587][ C1] [ 7820.627745][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5092s! [swapper/2:0] [ 7820.628160][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7820.629397][ C2] irq event stamp: 44114564 [ 7820.629622][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7820.630155][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7820.630662][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7820.631134][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7820.631595][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7820.632048][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7820.632658][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7820.632979][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7820.633940][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7820.634245][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7820.634638][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7820.635035][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7820.635432][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7820.635826][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7820.636220][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7820.636662][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7820.636992][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7820.637390][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7820.637784][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7820.638178][ C2] PKRU: 55555554 [ 7820.638358][ C2] Call Trace: [ 7820.638527][ C2] [ 7820.638672][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7820.638931][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7820.639173][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7820.639447][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7820.639719][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7820.640002][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7820.640265][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7820.640568][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7820.640826][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7820.641085][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7820.641391][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7820.641683][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7820.641994][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7820.642284][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7820.642576][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7820.642862][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7820.643170][ C2] ? get_stack_info+0x36/0xc0 [ 7820.643409][ C2] ? lock_acquire+0x1c1/0x220 [ 7820.643646][ C2] ? lock_release+0x1d5/0x250 [ 7820.643882][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7820.644134][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7820.644402][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7820.644688][ C2] ? lock_acquire+0x1c1/0x220 [ 7820.644925][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7820.645162][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7820.645420][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7820.645654][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7820.645900][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7820.646156][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7820.646427][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7820.646700][ C2] ip_local_deliver+0x19d/0x480 [ 7820.646945][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7820.647216][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7820.647478][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7820.647820][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7820.648071][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7820.648388][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7820.648649][ C2] ip_rcv+0x564/0x740 [ 7820.648850][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7820.649081][ C2] ? set_track_prepare+0x8a/0xd0 [ 7820.649332][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7820.649606][ C2] ? start_secondary+0x21c/0x2b0 [ 7820.649855][ C2] ? skb_clone+0x10b/0x330 [ 7820.650080][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7820.650396][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7820.650699][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7820.650979][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7820.651271][ C2] ? __tcf_classify+0x329/0x7d0 [ 7820.651517][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7820.651747][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7820.652042][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7820.652332][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7820.652655][ C2] ? lock_acquire+0x1c1/0x220 [ 7820.652894][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7820.653187][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7820.653470][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7820.653783][ C2] ? __copy_skb_header+0xaf/0x490 [ 7820.654039][ C2] ? __skb_clone+0x57a/0x760 [ 7820.654270][ C2] netif_receive_skb+0x55/0x280 [ 7820.654518][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7820.654826][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7820.655155][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7820.655452][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7820.655723][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7820.656007][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7820.656317][ C2] ? get_stack_info+0x36/0xc0 [ 7820.656556][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7820.656817][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7820.657131][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7820.657403][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7820.657679][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7820.657990][ C2] ? kernel_text_address+0x17/0xe0 [ 7820.658250][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7820.658558][ C2] ? arch_stack_walk+0x8c/0x100 [ 7820.658804][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7820.659067][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7820.659351][ C2] ? lock_acquire+0x1c1/0x220 [ 7820.659587][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7820.659866][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7820.660170][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7820.660443][ C2] ? get_stack_info+0x36/0xc0 [ 7820.660682][ C2] __tcf_classify+0x329/0x7d0 [ 7820.660922][ C2] tcf_classify+0x283/0x930 [ 7820.661152][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7820.661410][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7820.661721][ C2] tc_run+0x2e4/0x5d0 [ 7820.661923][ C2] ? __pfx_tc_run+0x10/0x10 [ 7820.662154][ C2] ? lock_acquire+0x1c1/0x220 [ 7820.662395][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7820.662654][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7820.662905][ C2] ? lock_acquire+0x1c1/0x220 [ 7820.663139][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7820.663401][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7820.663701][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7820.663970][ C2] ? neigh_hh_output+0x348/0x590 [ 7820.664221][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7820.664489][ C2] ip_finish_output2+0x786/0x18e0 [ 7820.664742][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7820.665076][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7820.665349][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7820.665601][ C2] ? __ip_finish_output+0x10f/0x770 [ 7820.665863][ C2] ip_output+0x16b/0x4f0 [ 7820.666077][ C2] ? __pfx_ip_output+0x10/0x10 [ 7820.666317][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7820.666593][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7820.666901][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7820.667176][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7820.667425][ C2] ? __alloc_skb+0xd4/0x280 [ 7820.667651][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7820.667919][ C2] ? tcp_fragment+0x168/0x1040 [ 7820.668159][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7820.668408][ C2] ? ip_local_out+0x114/0x3b0 [ 7820.668647][ C2] __ip_queue_xmit+0x672/0x1910 [ 7820.668893][ C2] ? __skb_clone+0x57a/0x760 [ 7820.669127][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7820.669390][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7820.669667][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7820.669910][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7820.670157][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7820.670453][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7820.670771][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7820.671011][ C2] tcp_send_loss_probe+0x348/0x830 [ 7820.671269][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7820.671537][ C2] tcp_write_timer+0x82/0x1d0 [ 7820.671773][ C2] call_timer_fn+0x173/0x430 [ 7820.672008][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7820.672271][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7820.672529][ C2] __run_timers.part.0+0x52d/0x890 [ 7820.672786][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7820.673053][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7820.673338][ C2] ? lock_acquire+0x1c1/0x220 [ 7820.673575][ C2] ? clockevents_program_event+0xf6/0x300 [ 7820.673862][ C2] ? lock_release+0x1d5/0x250 [ 7820.674100][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7820.674361][ C2] ? ktime_get+0xb3/0x190 [ 7820.674578][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7820.674874][ C2] run_timer_softirq+0x72/0x100 [ 7820.675121][ C2] __do_softirq+0x1b9/0x7ff [ 7820.675351][ C2] irq_exit_rcu+0x98/0xc0 [ 7820.675570][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7820.675850][ C2] [ 7820.676000][ C2] [ 7820.676149][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7820.676451][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7820.676705][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7820.677663][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7820.677968][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7820.678365][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7820.678758][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7820.679154][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7820.679549][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7820.679943][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7820.680231][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7820.680489][ C2] default_idle_call+0x69/0xa0 [ 7820.680730][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7820.680978][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7820.681255][ C2] ? lock_release+0x1d5/0x250 [ 7820.681490][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7820.681763][ C2] do_idle+0xfb/0x160 [ 7820.681964][ C2] cpu_startup_entry+0x55/0x60 [ 7820.682205][ C2] start_secondary+0x21c/0x2b0 [ 7820.682447][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7820.682715][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7820.683021][ C2] [ 7845.007102][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7845.007453][ C1] rcu: 1-....: (5476997 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1341455 [ 7845.007998][ C1] rcu: (t=5490120 jiffies g=1882453 q=721 ncpus=4) [ 7845.008325][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7845.008762][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7845.009361][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7845.009679][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7845.010625][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7845.010927][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7845.011314][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7845.011707][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7845.012095][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7845.012513][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7845.012912][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7845.013370][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7845.013695][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7845.014087][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7845.014476][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7845.014866][ C1] PKRU: 55555554 [ 7845.015042][ C1] Call Trace: [ 7845.015209][ C1] [ 7845.015352][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7845.015619][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7845.015865][ C1] ? check_cpu_stall+0x284/0x500 [ 7845.016110][ C1] ? rcu_pending+0x92/0x360 [ 7845.016337][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7845.016601][ C1] ? update_process_times+0xb9/0x110 [ 7845.016862][ C1] ? tick_sched_handle+0x67/0x130 [ 7845.017112][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7845.017392][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7845.017630][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7845.017934][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7845.018201][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7845.018480][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7845.018737][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7845.019036][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7845.019291][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7845.019592][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7845.019881][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7845.020188][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7845.020470][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7845.020759][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7845.021039][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7845.021346][ C1] ? get_stack_info+0x36/0xc0 [ 7845.021582][ C1] ? lock_acquire+0x1c1/0x220 [ 7845.021815][ C1] ? lock_release+0x1d5/0x250 [ 7845.022048][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7845.022317][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7845.022588][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7845.022876][ C1] ? lock_acquire+0x1c1/0x220 [ 7845.023116][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7845.023355][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7845.023619][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7845.023849][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7845.024093][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7845.024345][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7845.024612][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7845.024883][ C1] ip_local_deliver+0x19d/0x480 [ 7845.025124][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7845.025393][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7845.025651][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7845.025990][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7845.026237][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7845.026551][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7845.026808][ C1] ip_rcv+0x564/0x740 [ 7845.027007][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7845.027234][ C1] ? set_track_prepare+0x8a/0xd0 [ 7845.027482][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7845.027752][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7845.028018][ C1] ? skb_clone+0x10b/0x330 [ 7845.028241][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7845.028553][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7845.028853][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7845.029128][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7845.029416][ C1] ? __tcf_classify+0x329/0x7d0 [ 7845.029658][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7845.029884][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7845.030178][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7845.030456][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7845.030774][ C1] ? lock_acquire+0x1c1/0x220 [ 7845.031008][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7845.031298][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7845.031577][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7845.031887][ C1] ? __copy_skb_header+0xaf/0x490 [ 7845.032159][ C1] ? __skb_clone+0x57a/0x760 [ 7845.032396][ C1] netif_receive_skb+0x55/0x280 [ 7845.032644][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7845.032957][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7845.033290][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7845.033594][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7845.033861][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7845.034145][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7845.034471][ C1] ? hlock_class+0x4e/0x130 [ 7845.034704][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7845.034982][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7845.035261][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7845.035526][ C1] ? hlock_class+0x4e/0x130 [ 7845.035758][ C1] ? mark_lock+0x38/0x3e0 [ 7845.035979][ C1] ? stack_access_ok+0xda/0x1f0 [ 7845.036229][ C1] ? __lock_acquire+0xb67/0x1610 [ 7845.036485][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7845.036761][ C1] ? get_stack_info+0x36/0xc0 [ 7845.037004][ C1] ? stack_access_ok+0xda/0x1f0 [ 7845.037252][ C1] ? get_reg+0x119/0x190 [ 7845.037469][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7845.037737][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7845.038049][ C1] __tcf_classify+0x329/0x7d0 [ 7845.038292][ C1] tcf_classify+0x283/0x930 [ 7845.038524][ C1] ? arch_stack_walk+0xa2/0x100 [ 7845.038774][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7845.039031][ C1] ? get_stack_info+0x36/0xc0 [ 7845.039274][ C1] tc_run+0x2e4/0x5d0 [ 7845.039480][ C1] ? __pfx_tc_run+0x10/0x10 [ 7845.039712][ C1] ? lock_acquire+0x1c1/0x220 [ 7845.039953][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7845.040216][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7845.040470][ C1] ? lock_acquire+0x1c1/0x220 [ 7845.040708][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7845.040976][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7845.041281][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7845.041556][ C1] ? neigh_hh_output+0x348/0x590 [ 7845.041810][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7845.042077][ C1] ip_finish_output2+0x786/0x18e0 [ 7845.042338][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7845.042617][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7845.042956][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7845.043232][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7845.043487][ C1] ? __ip_finish_output+0x10f/0x770 [ 7845.043754][ C1] ip_output+0x16b/0x4f0 [ 7845.043973][ C1] ? run_timer_softirq+0x72/0x100 [ 7845.044230][ C1] ? __pfx_ip_output+0x10/0x10 [ 7845.044475][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7845.044762][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7845.045015][ C1] ? ip_local_out+0x114/0x3b0 [ 7845.045257][ C1] __ip_queue_xmit+0x672/0x1910 [ 7845.045506][ C1] ? __create_object+0x5e/0xb0 [ 7845.045749][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7845.046017][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7845.046299][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7845.046572][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7845.046856][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7845.047129][ C1] tcp_delack_timer+0x84/0x240 [ 7845.047373][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7845.047646][ C1] call_timer_fn+0x173/0x430 [ 7845.047882][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7845.048145][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7845.048407][ C1] __run_timers.part.0+0x52d/0x890 [ 7845.048668][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7845.048942][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7845.049227][ C1] ? lock_acquire+0x1c1/0x220 [ 7845.049465][ C1] ? clockevents_program_event+0xf6/0x300 [ 7845.049757][ C1] ? lock_release+0x1d5/0x250 [ 7845.049995][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7845.050261][ C1] ? ktime_get+0xb3/0x190 [ 7845.050482][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7845.050779][ C1] run_timer_softirq+0x72/0x100 [ 7845.051027][ C1] __do_softirq+0x1b9/0x7ff [ 7845.051260][ C1] irq_exit_rcu+0x98/0xc0 [ 7845.051482][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7845.051768][ C1] [ 7845.051918][ C1] [ 7845.052071][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7845.052380][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7845.052707][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7845.053685][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7845.053994][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7845.054397][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7845.054797][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7845.055197][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7845.055599][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7845.056003][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7845.056300][ C1] pipe_read+0xa16/0xdf0 [ 7845.056524][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7845.056801][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7845.057046][ C1] ? iterate_tty_write+0x299/0x540 [ 7845.057309][ C1] ? lock_release+0x1d5/0x250 [ 7845.057553][ C1] vfs_read+0x911/0xc00 [ 7845.057769][ C1] ? lock_acquire+0x1c1/0x220 [ 7845.058010][ C1] ? __might_fault+0xc6/0x180 [ 7845.058251][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7845.058490][ C1] ? __might_fault+0xc6/0x180 [ 7845.058732][ C1] ? lock_release+0x1d5/0x250 [ 7845.058975][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7845.059240][ C1] ? __fget_light+0x54/0x1e0 [ 7845.059479][ C1] ksys_read+0x17a/0x1e0 [ 7845.059697][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7845.059944][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7845.060250][ C1] do_syscall_64+0xc9/0x1e0 [ 7845.060483][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7845.060786][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7845.061013][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7845.061989][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7845.062415][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7845.062815][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7845.063217][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7845.063617][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7845.064018][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7845.064420][ C1] [ 7845.064580][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7845.064852][ C2] NMI backtrace for cpu 2 [ 7845.064857][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7845.064862][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7845.064866][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7845.064874][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7845.064880][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7845.064884][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7845.064888][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7845.064892][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7845.064896][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7845.064900][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7845.064904][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7845.064908][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7845.064914][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7845.064915][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7845.064916][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7845.064918][ C2] PKRU: 55555554 [ 7845.064919][ C2] Call Trace: [ 7845.064920][ C2] [ 7845.064921][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7845.064928][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7845.064932][ C2] ? nmi_handle+0x153/0x420 [ 7845.064936][ C2] ? default_do_nmi+0x41/0x100 [ 7845.064938][ C2] ? exc_nmi+0xf3/0x120 [ 7845.064941][ C2] ? end_repeat_nmi+0xf/0x60 [ 7845.064946][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7845.064949][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7845.064952][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7845.064955][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7845.064958][ C2] [ 7845.064959][ C2] [ 7845.064960][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7845.064963][ C2] ? get_stack_info+0x36/0xc0 [ 7845.064967][ C2] ? lock_acquire+0x1c1/0x220 [ 7845.064970][ C2] ? lock_release+0x1d5/0x250 [ 7845.064974][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7845.064977][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7845.064980][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7845.064983][ C2] ? lock_acquire+0x1c1/0x220 [ 7845.064985][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7845.064989][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7845.064991][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7845.064997][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7845.065000][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7845.065004][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7845.065008][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7845.065012][ C2] ip_local_deliver+0x19d/0x480 [ 7845.065014][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7845.065016][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7845.065018][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7845.065023][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7845.065027][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7845.065029][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7845.065038][ C2] ip_rcv+0x564/0x740 [ 7845.065041][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7845.065043][ C2] ? set_track_prepare+0x8a/0xd0 [ 7845.065047][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7845.065050][ C2] ? start_secondary+0x21c/0x2b0 [ 7845.065053][ C2] ? skb_clone+0x10b/0x330 [ 7845.065055][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7845.065061][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7845.065066][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7845.065070][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7845.065078][ C2] ? __tcf_classify+0x329/0x7d0 [ 7845.065081][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7845.065083][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7845.065087][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7845.065090][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7845.065094][ C2] ? lock_acquire+0x1c1/0x220 [ 7845.065096][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7845.065100][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7845.065104][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7845.065108][ C2] ? __copy_skb_header+0xaf/0x490 [ 7845.065112][ C2] ? __skb_clone+0x57a/0x760 [ 7845.065114][ C2] netif_receive_skb+0x55/0x280 [ 7845.065117][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7845.065124][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7845.065131][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7845.065137][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7845.065142][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7845.065152][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7845.065159][ C2] ? get_stack_info+0x36/0xc0 [ 7845.065164][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7845.065166][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7845.065170][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7845.065172][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7845.065175][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7845.065178][ C2] ? kernel_text_address+0x17/0xe0 [ 7845.065181][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7845.065184][ C2] ? arch_stack_walk+0x8c/0x100 [ 7845.065188][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7845.065191][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7845.065194][ C2] ? lock_acquire+0x1c1/0x220 [ 7845.065197][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7845.065200][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7845.065204][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7845.065207][ C2] ? get_stack_info+0x36/0xc0 [ 7845.065211][ C2] __tcf_classify+0x329/0x7d0 [ 7845.065216][ C2] tcf_classify+0x283/0x930 [ 7845.065220][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7845.065223][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7845.065228][ C2] tc_run+0x2e4/0x5d0 [ 7845.065232][ C2] ? __pfx_tc_run+0x10/0x10 [ 7845.065234][ C2] ? lock_acquire+0x1c1/0x220 [ 7845.065237][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7845.065241][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7845.065245][ C2] ? lock_acquire+0x1c1/0x220 [ 7845.065247][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7845.065250][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7845.065253][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7845.065255][ C2] ? neigh_hh_output+0x348/0x590 [ 7845.065259][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7845.065262][ C2] ip_finish_output2+0x786/0x18e0 [ 7845.065266][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7845.065273][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7845.065276][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7845.065280][ C2] ? __ip_finish_output+0x10f/0x770 [ 7845.065283][ C2] ip_output+0x16b/0x4f0 [ 7845.065286][ C2] ? __pfx_ip_output+0x10/0x10 [ 7845.065288][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7845.065291][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7845.065294][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7845.065297][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7845.065299][ C2] ? __alloc_skb+0xd4/0x280 [ 7845.065302][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7845.065306][ C2] ? tcp_fragment+0x168/0x1040 [ 7845.065309][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7845.065311][ C2] ? ip_local_out+0x114/0x3b0 [ 7845.065315][ C2] __ip_queue_xmit+0x672/0x1910 [ 7845.065319][ C2] ? __skb_clone+0x57a/0x760 [ 7845.065321][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7845.065326][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7845.065329][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7845.065333][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7845.065337][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7845.065341][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7845.065344][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7845.065348][ C2] tcp_send_loss_probe+0x348/0x830 [ 7845.065351][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7845.065353][ C2] tcp_write_timer+0x82/0x1d0 [ 7845.065357][ C2] call_timer_fn+0x173/0x430 [ 7845.065360][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7845.065365][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7845.065368][ C2] __run_timers.part.0+0x52d/0x890 [ 7845.065371][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7845.065375][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7845.065378][ C2] ? lock_acquire+0x1c1/0x220 [ 7845.065380][ C2] ? clockevents_program_event+0xf6/0x300 [ 7845.065384][ C2] ? lock_release+0x1d5/0x250 [ 7845.065387][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7845.065390][ C2] ? ktime_get+0xb3/0x190 [ 7845.065393][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7845.065397][ C2] run_timer_softirq+0x72/0x100 [ 7845.065401][ C2] __do_softirq+0x1b9/0x7ff [ 7845.065405][ C2] irq_exit_rcu+0x98/0xc0 [ 7845.065407][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7845.065410][ C2] [ 7845.065411][ C2] [ 7845.065412][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7845.065415][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7845.065419][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7845.065421][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7845.065422][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7845.065424][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7845.065425][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7845.065427][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7845.065428][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7845.065431][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7845.065434][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7845.065437][ C2] default_idle_call+0x69/0xa0 [ 7845.065440][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7845.065442][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7845.065445][ C2] ? lock_release+0x1d5/0x250 [ 7845.065448][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7845.065451][ C2] do_idle+0xfb/0x160 [ 7845.065454][ C2] cpu_startup_entry+0x55/0x60 [ 7845.065456][ C2] start_secondary+0x21c/0x2b0 [ 7845.065459][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7845.065462][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7845.065468][ C2] [ 7872.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5140s! [perl:4135] [ 7872.569677][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7872.570903][ C1] irq event stamp: 209232 [ 7872.571116][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7872.571639][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7872.572124][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7872.572594][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7872.573058][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7872.573508][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7872.574119][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [ 7872.574410][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [ 7872.575381][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000282 [ 7872.575690][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7872.576090][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7872.576489][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7872.576890][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7872.577290][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7872.577690][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7872.578139][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7872.578471][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7872.578874][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7872.579275][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7872.579674][ C1] PKRU: 55555554 [ 7872.579857][ C1] Call Trace: [ 7872.580028][ C1] [ 7872.580181][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7872.580444][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7872.580688][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7872.580966][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7872.581240][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7872.581528][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7872.581793][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7872.582102][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7872.582363][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 7872.582624][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7872.582934][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7872.583230][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7872.583545][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7872.583834][ C1] ? kasan_check_range+0x1b/0x1c0 [ 7872.584092][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7872.584373][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7872.584686][ C1] ? get_stack_info+0x36/0xc0 [ 7872.584928][ C1] ? lock_acquire+0x1c1/0x220 [ 7872.585169][ C1] ? lock_release+0x1d5/0x250 [ 7872.585408][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7872.585656][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7872.585931][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7872.586217][ C1] ? lock_acquire+0x1c1/0x220 [ 7872.586457][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7872.586697][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7872.586958][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7872.587191][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7872.587442][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7872.587700][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7872.587974][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7872.588254][ C1] ip_local_deliver+0x19d/0x480 [ 7872.588502][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7872.588774][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7872.589039][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7872.589386][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7872.589640][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7872.589961][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7872.590225][ C1] ip_rcv+0x564/0x740 [ 7872.590433][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7872.590665][ C1] ? set_track_prepare+0x8a/0xd0 [ 7872.590919][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7872.591196][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7872.591470][ C1] ? skb_clone+0x10b/0x330 [ 7872.591697][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7872.592020][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7872.592328][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7872.592608][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7872.592906][ C1] ? __tcf_classify+0x329/0x7d0 [ 7872.593155][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7872.593384][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7872.593686][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7872.593971][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7872.594297][ C1] ? lock_acquire+0x1c1/0x220 [ 7872.594537][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7872.594835][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7872.595120][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7872.595437][ C1] ? __copy_skb_header+0xaf/0x490 [ 7872.595695][ C1] ? __skb_clone+0x57a/0x760 [ 7872.595931][ C1] netif_receive_skb+0x55/0x280 [ 7872.596181][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7872.596493][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7872.596826][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7872.597124][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7872.597399][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7872.597688][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7872.598002][ C1] ? hlock_class+0x4e/0x130 [ 7872.598233][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7872.598510][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7872.598786][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7872.599050][ C1] ? hlock_class+0x4e/0x130 [ 7872.599282][ C1] ? mark_lock+0x38/0x3e0 [ 7872.599501][ C1] ? stack_access_ok+0xda/0x1f0 [ 7872.599751][ C1] ? __lock_acquire+0xb67/0x1610 [ 7872.600005][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7872.600282][ C1] ? get_stack_info+0x36/0xc0 [ 7872.600523][ C1] ? stack_access_ok+0xda/0x1f0 [ 7872.600771][ C1] ? get_reg+0x119/0x190 [ 7872.600987][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7872.601255][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7872.601564][ C1] __tcf_classify+0x329/0x7d0 [ 7872.601806][ C1] tcf_classify+0x283/0x930 [ 7872.602043][ C1] ? arch_stack_walk+0xa2/0x100 [ 7872.602291][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7872.602549][ C1] ? get_stack_info+0x36/0xc0 [ 7872.602789][ C1] tc_run+0x2e4/0x5d0 [ 7872.602995][ C1] ? __pfx_tc_run+0x10/0x10 [ 7872.603227][ C1] ? lock_acquire+0x1c1/0x220 [ 7872.603468][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7872.603729][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7872.603984][ C1] ? lock_acquire+0x1c1/0x220 [ 7872.604222][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7872.604488][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7872.604793][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7872.605067][ C1] ? neigh_hh_output+0x348/0x590 [ 7872.605321][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7872.605587][ C1] ip_finish_output2+0x786/0x18e0 [ 7872.605843][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7872.606120][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7872.606459][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7872.606737][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7872.606990][ C1] ? __ip_finish_output+0x10f/0x770 [ 7872.607257][ C1] ip_output+0x16b/0x4f0 [ 7872.607472][ C1] ? run_timer_softirq+0x72/0x100 [ 7872.607730][ C1] ? __pfx_ip_output+0x10/0x10 [ 7872.607975][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7872.608261][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7872.608513][ C1] ? ip_local_out+0x114/0x3b0 [ 7872.608754][ C1] __ip_queue_xmit+0x672/0x1910 [ 7872.609004][ C1] ? __create_object+0x5e/0xb0 [ 7872.609249][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7872.609518][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7872.609799][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7872.610071][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7872.610356][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7872.610627][ C1] tcp_delack_timer+0x84/0x240 [ 7872.610872][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7872.611144][ C1] call_timer_fn+0x173/0x430 [ 7872.611381][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7872.611643][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7872.611905][ C1] __run_timers.part.0+0x52d/0x890 [ 7872.612170][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7872.612444][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7872.612731][ C1] ? lock_acquire+0x1c1/0x220 [ 7872.612969][ C1] ? clockevents_program_event+0xf6/0x300 [ 7872.613260][ C1] ? lock_release+0x1d5/0x250 [ 7872.613501][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7872.613765][ C1] ? ktime_get+0xb3/0x190 [ 7872.613984][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7872.614284][ C1] run_timer_softirq+0x72/0x100 [ 7872.614533][ C1] __do_softirq+0x1b9/0x7ff [ 7872.614764][ C1] irq_exit_rcu+0x98/0xc0 [ 7872.614987][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7872.615272][ C1] [ 7872.615424][ C1] [ 7872.615574][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7872.615880][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7872.616206][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7872.617177][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7872.617486][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7872.617885][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7872.618285][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7872.618685][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7872.619086][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7872.619487][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7872.619785][ C1] pipe_read+0xa16/0xdf0 [ 7872.620005][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7872.620283][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7872.620528][ C1] ? iterate_tty_write+0x299/0x540 [ 7872.620790][ C1] ? lock_release+0x1d5/0x250 [ 7872.621031][ C1] vfs_read+0x911/0xc00 [ 7872.621246][ C1] ? lock_acquire+0x1c1/0x220 [ 7872.621486][ C1] ? __might_fault+0xc6/0x180 [ 7872.621728][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7872.621968][ C1] ? __might_fault+0xc6/0x180 [ 7872.622210][ C1] ? lock_release+0x1d5/0x250 [ 7872.622450][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7872.622716][ C1] ? __fget_light+0x54/0x1e0 [ 7872.622954][ C1] ksys_read+0x17a/0x1e0 [ 7872.623171][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7872.623416][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7872.623722][ C1] do_syscall_64+0xc9/0x1e0 [ 7872.623954][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7872.624256][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7872.624490][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7872.625462][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7872.625882][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7872.626284][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7872.626684][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7872.627083][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7872.627481][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7872.627887][ C1] [ 7872.628043][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5140s! [swapper/2:0] [ 7872.628454][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7872.629696][ C2] irq event stamp: 44114564 [ 7872.629923][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7872.630454][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7872.630960][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7872.631431][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7872.631899][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7872.632354][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7872.632959][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7872.633282][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7872.634247][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7872.634550][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7872.634947][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7872.635342][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7872.635738][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7872.636132][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7872.636530][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7872.636973][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7872.637301][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7872.637698][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7872.638093][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7872.638490][ C2] PKRU: 55555554 [ 7872.638669][ C2] Call Trace: [ 7872.638836][ C2] [ 7872.638984][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7872.639244][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7872.639484][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7872.639760][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7872.640030][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7872.640316][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7872.640579][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7872.640880][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7872.641140][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7872.641402][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7872.641708][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7872.642005][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7872.642318][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7872.642603][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7872.642898][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7872.643185][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7872.643493][ C2] ? get_stack_info+0x36/0xc0 [ 7872.643732][ C2] ? lock_acquire+0x1c1/0x220 [ 7872.643970][ C2] ? lock_release+0x1d5/0x250 [ 7872.644208][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7872.644453][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7872.644725][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7872.645007][ C2] ? lock_acquire+0x1c1/0x220 [ 7872.645244][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7872.645484][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7872.645742][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7872.645972][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7872.646217][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7872.646473][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7872.646744][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7872.647020][ C2] ip_local_deliver+0x19d/0x480 [ 7872.647266][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7872.647535][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7872.647796][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7872.648138][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7872.648389][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7872.648706][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7872.648966][ C2] ip_rcv+0x564/0x740 [ 7872.649169][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7872.649398][ C2] ? set_track_prepare+0x8a/0xd0 [ 7872.649649][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7872.649922][ C2] ? start_secondary+0x21c/0x2b0 [ 7872.650172][ C2] ? skb_clone+0x10b/0x330 [ 7872.650398][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7872.650713][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7872.651019][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7872.651297][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7872.651589][ C2] ? __tcf_classify+0x329/0x7d0 [ 7872.651834][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7872.652068][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7872.652366][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7872.652647][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7872.652969][ C2] ? lock_acquire+0x1c1/0x220 [ 7872.653209][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7872.653502][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7872.653785][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7872.654099][ C2] ? __copy_skb_header+0xaf/0x490 [ 7872.654354][ C2] ? __skb_clone+0x57a/0x760 [ 7872.654588][ C2] netif_receive_skb+0x55/0x280 [ 7872.654833][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7872.655142][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7872.655472][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7872.655769][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7872.656040][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7872.656328][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7872.656637][ C2] ? get_stack_info+0x36/0xc0 [ 7872.656877][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7872.657138][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7872.657452][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7872.657726][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7872.658000][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7872.658313][ C2] ? kernel_text_address+0x17/0xe0 [ 7872.658571][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7872.658882][ C2] ? arch_stack_walk+0x8c/0x100 [ 7872.659129][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7872.659390][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7872.659672][ C2] ? lock_acquire+0x1c1/0x220 [ 7872.659911][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7872.660190][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7872.660493][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7872.660766][ C2] ? get_stack_info+0x36/0xc0 [ 7872.661005][ C2] __tcf_classify+0x329/0x7d0 [ 7872.661246][ C2] tcf_classify+0x283/0x930 [ 7872.661477][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7872.661730][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7872.662043][ C2] tc_run+0x2e4/0x5d0 [ 7872.662249][ C2] ? __pfx_tc_run+0x10/0x10 [ 7872.662477][ C2] ? lock_acquire+0x1c1/0x220 [ 7872.662715][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7872.662974][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7872.663224][ C2] ? lock_acquire+0x1c1/0x220 [ 7872.663462][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7872.663724][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7872.664023][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7872.664294][ C2] ? neigh_hh_output+0x348/0x590 [ 7872.664544][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7872.664806][ C2] ip_finish_output2+0x786/0x18e0 [ 7872.665061][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7872.665395][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7872.665668][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7872.665918][ C2] ? __ip_finish_output+0x10f/0x770 [ 7872.666182][ C2] ip_output+0x16b/0x4f0 [ 7872.666398][ C2] ? __pfx_ip_output+0x10/0x10 [ 7872.666640][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7872.666914][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7872.667224][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7872.667496][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7872.667745][ C2] ? __alloc_skb+0xd4/0x280 [ 7872.667975][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7872.668242][ C2] ? tcp_fragment+0x168/0x1040 [ 7872.668484][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7872.668733][ C2] ? ip_local_out+0x114/0x3b0 [ 7872.668969][ C2] __ip_queue_xmit+0x672/0x1910 [ 7872.669216][ C2] ? __skb_clone+0x57a/0x760 [ 7872.669451][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7872.669714][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7872.669992][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7872.670234][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7872.670482][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7872.670780][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7872.671101][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7872.671344][ C2] tcp_send_loss_probe+0x348/0x830 [ 7872.671602][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7872.671867][ C2] tcp_write_timer+0x82/0x1d0 [ 7872.672111][ C2] call_timer_fn+0x173/0x430 [ 7872.672344][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7872.672604][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7872.672864][ C2] __run_timers.part.0+0x52d/0x890 [ 7872.673123][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7872.673392][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7872.673674][ C2] ? lock_acquire+0x1c1/0x220 [ 7872.673910][ C2] ? clockevents_program_event+0xf6/0x300 [ 7872.674198][ C2] ? lock_release+0x1d5/0x250 [ 7872.674435][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7872.674696][ C2] ? ktime_get+0xb3/0x190 [ 7872.674916][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7872.675209][ C2] run_timer_softirq+0x72/0x100 [ 7872.675454][ C2] __do_softirq+0x1b9/0x7ff [ 7872.675686][ C2] irq_exit_rcu+0x98/0xc0 [ 7872.675903][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7872.676187][ C2] [ 7872.676335][ C2] [ 7872.676485][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7872.676786][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7872.677040][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7872.678000][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7872.678306][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7872.678700][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7872.679099][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7872.679493][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7872.679888][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7872.680285][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7872.680573][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7872.680831][ C2] default_idle_call+0x69/0xa0 [ 7872.681074][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7872.681323][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7872.681597][ C2] ? lock_release+0x1d5/0x250 [ 7872.681835][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7872.682110][ C2] do_idle+0xfb/0x160 [ 7872.682311][ C2] cpu_startup_entry+0x55/0x60 [ 7872.682552][ C2] start_secondary+0x21c/0x2b0 [ 7872.682793][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7872.683059][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7872.683368][ C2] [ 7900.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5166s! [perl:4135] [ 7900.569675][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7900.570898][ C1] irq event stamp: 209232 [ 7900.571112][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7900.571627][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7900.572116][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7900.572585][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7900.573047][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7900.573495][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7900.574091][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7900.574407][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7900.575355][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7900.575654][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7900.576063][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7900.576464][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7900.576863][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7900.577271][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7900.577661][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7900.578097][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7900.578422][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7900.578812][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7900.579200][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7900.579591][ C1] PKRU: 55555554 [ 7900.579767][ C1] Call Trace: [ 7900.579933][ C1] [ 7900.580077][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7900.580333][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7900.580568][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7900.580840][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7900.581106][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7900.581385][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7900.581644][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7900.581962][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7900.582224][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7900.582534][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7900.582830][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7900.583154][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7900.583434][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7900.583722][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7900.584003][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7900.584307][ C1] ? get_stack_info+0x36/0xc0 [ 7900.584542][ C1] ? lock_acquire+0x1c1/0x220 [ 7900.584777][ C1] ? lock_release+0x1d5/0x250 [ 7900.585008][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7900.585251][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7900.585517][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7900.585795][ C1] ? lock_acquire+0x1c1/0x220 [ 7900.586029][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7900.586262][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7900.586516][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7900.586744][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7900.586984][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7900.587236][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7900.587504][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7900.587776][ C1] ip_local_deliver+0x19d/0x480 [ 7900.588015][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7900.588282][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7900.588538][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7900.588879][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7900.589129][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7900.589440][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7900.589695][ C1] ip_rcv+0x564/0x740 [ 7900.589893][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7900.590119][ C1] ? set_track_prepare+0x8a/0xd0 [ 7900.590366][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7900.590635][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7900.590900][ C1] ? skb_clone+0x10b/0x330 [ 7900.591121][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7900.591434][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7900.591733][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7900.592030][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7900.592325][ C1] ? __tcf_classify+0x329/0x7d0 [ 7900.592573][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7900.592804][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7900.593104][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7900.593391][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7900.593706][ C1] ? lock_acquire+0x1c1/0x220 [ 7900.593940][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7900.594248][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7900.594531][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7900.594848][ C1] ? __copy_skb_header+0xaf/0x490 [ 7900.595106][ C1] ? __skb_clone+0x57a/0x760 [ 7900.595342][ C1] netif_receive_skb+0x55/0x280 [ 7900.595590][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7900.595900][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7900.596234][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7900.596533][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7900.596806][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7900.597096][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7900.597409][ C1] ? hlock_class+0x4e/0x130 [ 7900.597640][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7900.597916][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7900.598193][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7900.598457][ C1] ? hlock_class+0x4e/0x130 [ 7900.598689][ C1] ? mark_lock+0x38/0x3e0 [ 7900.598909][ C1] ? stack_access_ok+0xda/0x1f0 [ 7900.599158][ C1] ? __lock_acquire+0xb67/0x1610 [ 7900.599412][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7900.599689][ C1] ? get_stack_info+0x36/0xc0 [ 7900.599930][ C1] ? stack_access_ok+0xda/0x1f0 [ 7900.600177][ C1] ? get_reg+0x119/0x190 [ 7900.600392][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7900.600660][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7900.600969][ C1] __tcf_classify+0x329/0x7d0 [ 7900.601213][ C1] tcf_classify+0x283/0x930 [ 7900.601444][ C1] ? arch_stack_walk+0xa2/0x100 [ 7900.601691][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7900.601955][ C1] ? get_stack_info+0x36/0xc0 [ 7900.602197][ C1] tc_run+0x2e4/0x5d0 [ 7900.602402][ C1] ? __pfx_tc_run+0x10/0x10 [ 7900.602635][ C1] ? lock_acquire+0x1c1/0x220 [ 7900.602875][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7900.603136][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7900.603389][ C1] ? lock_acquire+0x1c1/0x220 [ 7900.603627][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7900.603892][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7900.604196][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7900.604470][ C1] ? neigh_hh_output+0x348/0x590 [ 7900.604722][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7900.604988][ C1] ip_finish_output2+0x786/0x18e0 [ 7900.605244][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7900.605521][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7900.605859][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7900.606136][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7900.606388][ C1] ? __ip_finish_output+0x10f/0x770 [ 7900.606655][ C1] ip_output+0x16b/0x4f0 [ 7900.606871][ C1] ? run_timer_softirq+0x72/0x100 [ 7900.607129][ C1] ? __pfx_ip_output+0x10/0x10 [ 7900.607374][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7900.607659][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7900.607910][ C1] ? ip_local_out+0x114/0x3b0 [ 7900.608152][ C1] __ip_queue_xmit+0x672/0x1910 [ 7900.608401][ C1] ? __create_object+0x5e/0xb0 [ 7900.608645][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7900.608913][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7900.609194][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7900.609467][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7900.609749][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7900.610021][ C1] tcp_delack_timer+0x84/0x240 [ 7900.610267][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7900.610538][ C1] call_timer_fn+0x173/0x430 [ 7900.610775][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7900.611037][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7900.611298][ C1] __run_timers.part.0+0x52d/0x890 [ 7900.611559][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7900.611832][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7900.612122][ C1] ? lock_acquire+0x1c1/0x220 [ 7900.612360][ C1] ? clockevents_program_event+0xf6/0x300 [ 7900.612652][ C1] ? lock_release+0x1d5/0x250 [ 7900.612891][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7900.613156][ C1] ? ktime_get+0xb3/0x190 [ 7900.613376][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7900.613674][ C1] run_timer_softirq+0x72/0x100 [ 7900.613922][ C1] __do_softirq+0x1b9/0x7ff [ 7900.614154][ C1] irq_exit_rcu+0x98/0xc0 [ 7900.614376][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7900.614660][ C1] [ 7900.614811][ C1] [ 7900.614963][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7900.615268][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7900.615594][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7900.616565][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7900.616871][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7900.617271][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7900.617670][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7900.618068][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7900.618468][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7900.618869][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7900.619165][ C1] pipe_read+0xa16/0xdf0 [ 7900.619388][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7900.619665][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7900.619910][ C1] ? iterate_tty_write+0x299/0x540 [ 7900.620171][ C1] ? lock_release+0x1d5/0x250 [ 7900.620413][ C1] vfs_read+0x911/0xc00 [ 7900.620627][ C1] ? lock_acquire+0x1c1/0x220 [ 7900.620866][ C1] ? __might_fault+0xc6/0x180 [ 7900.621107][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7900.621345][ C1] ? __might_fault+0xc6/0x180 [ 7900.621586][ C1] ? lock_release+0x1d5/0x250 [ 7900.621827][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7900.622095][ C1] ? __fget_light+0x54/0x1e0 [ 7900.622333][ C1] ksys_read+0x17a/0x1e0 [ 7900.622550][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7900.622796][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7900.623101][ C1] do_syscall_64+0xc9/0x1e0 [ 7900.623332][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7900.623633][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7900.623859][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7900.624832][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7900.625252][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7900.625651][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7900.626053][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7900.626455][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7900.626854][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7900.627254][ C1] [ 7900.627414][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5166s! [swapper/2:0] [ 7900.627819][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7900.629059][ C2] irq event stamp: 44114564 [ 7900.629287][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7900.629815][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7900.630321][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7900.630793][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7900.631259][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7900.631709][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7900.632318][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 7900.632598][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 7900.633554][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 7900.633859][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7900.634253][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7900.634647][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7900.635042][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7900.635437][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7900.635830][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7900.636272][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7900.636600][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7900.636996][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7900.637391][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7900.637783][ C2] PKRU: 55555554 [ 7900.637963][ C2] Call Trace: [ 7900.638133][ C2] [ 7900.638277][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7900.638536][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7900.638777][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7900.639050][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7900.639318][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7900.639606][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7900.639868][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7900.640171][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7900.640430][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7900.640689][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7900.640995][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7900.641285][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7900.641598][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7900.641889][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 7900.642167][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 7900.642445][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7900.642753][ C2] ? get_stack_info+0x36/0xc0 [ 7900.642992][ C2] ? lock_acquire+0x1c1/0x220 [ 7900.643231][ C2] ? lock_release+0x1d5/0x250 [ 7900.643469][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7900.643715][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7900.643986][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7900.644267][ C2] ? lock_acquire+0x1c1/0x220 [ 7900.644504][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7900.644742][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7900.645000][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7900.645230][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7900.645476][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7900.645731][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7900.646002][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7900.646277][ C2] ip_local_deliver+0x19d/0x480 [ 7900.646523][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7900.646792][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7900.647054][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7900.647398][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7900.647649][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7900.647965][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7900.648224][ C2] ip_rcv+0x564/0x740 [ 7900.648427][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7900.648656][ C2] ? set_track_prepare+0x8a/0xd0 [ 7900.648906][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7900.649179][ C2] ? start_secondary+0x21c/0x2b0 [ 7900.649429][ C2] ? skb_clone+0x10b/0x330 [ 7900.649654][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7900.649971][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7900.650274][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7900.650552][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7900.650844][ C2] ? __tcf_classify+0x329/0x7d0 [ 7900.651089][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7900.651320][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7900.651617][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7900.651903][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7900.652225][ C2] ? lock_acquire+0x1c1/0x220 [ 7900.652462][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7900.652756][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7900.653038][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7900.653352][ C2] ? __copy_skb_header+0xaf/0x490 [ 7900.653607][ C2] ? __skb_clone+0x57a/0x760 [ 7900.653842][ C2] netif_receive_skb+0x55/0x280 [ 7900.654087][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7900.654395][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7900.654725][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7900.655021][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7900.655292][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7900.655579][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7900.655888][ C2] ? get_stack_info+0x36/0xc0 [ 7900.656127][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7900.656386][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7900.656700][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7900.656976][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7900.657249][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7900.657562][ C2] ? kernel_text_address+0x17/0xe0 [ 7900.657819][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7900.658128][ C2] ? arch_stack_walk+0x8c/0x100 [ 7900.658374][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7900.658637][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7900.658918][ C2] ? lock_acquire+0x1c1/0x220 [ 7900.659155][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7900.659432][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7900.659734][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7900.660008][ C2] ? get_stack_info+0x36/0xc0 [ 7900.660247][ C2] __tcf_classify+0x329/0x7d0 [ 7900.660487][ C2] tcf_classify+0x283/0x930 [ 7900.660717][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7900.660971][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7900.661280][ C2] tc_run+0x2e4/0x5d0 [ 7900.661484][ C2] ? __pfx_tc_run+0x10/0x10 [ 7900.661712][ C2] ? lock_acquire+0x1c1/0x220 [ 7900.661952][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7900.662210][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7900.662461][ C2] ? lock_acquire+0x1c1/0x220 [ 7900.662697][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7900.662959][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7900.663260][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7900.663529][ C2] ? neigh_hh_output+0x348/0x590 [ 7900.663780][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7900.664042][ C2] ip_finish_output2+0x786/0x18e0 [ 7900.664296][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7900.664630][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7900.664903][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7900.665153][ C2] ? __ip_finish_output+0x10f/0x770 [ 7900.665417][ C2] ip_output+0x16b/0x4f0 [ 7900.665632][ C2] ? __pfx_ip_output+0x10/0x10 [ 7900.665873][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7900.666146][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7900.666456][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7900.666728][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7900.666977][ C2] ? __alloc_skb+0xd4/0x280 [ 7900.667207][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7900.667472][ C2] ? tcp_fragment+0x168/0x1040 [ 7900.667714][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7900.667963][ C2] ? ip_local_out+0x114/0x3b0 [ 7900.668200][ C2] __ip_queue_xmit+0x672/0x1910 [ 7900.668447][ C2] ? __skb_clone+0x57a/0x760 [ 7900.668681][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7900.668944][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7900.669223][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7900.669463][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7900.669711][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7900.670009][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7900.670327][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7900.670569][ C2] tcp_send_loss_probe+0x348/0x830 [ 7900.670827][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7900.671092][ C2] tcp_write_timer+0x82/0x1d0 [ 7900.671332][ C2] call_timer_fn+0x173/0x430 [ 7900.671563][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7900.671824][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7900.672086][ C2] __run_timers.part.0+0x52d/0x890 [ 7900.672345][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7900.672613][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7900.672895][ C2] ? lock_acquire+0x1c1/0x220 [ 7900.673133][ C2] ? clockevents_program_event+0xf6/0x300 [ 7900.673419][ C2] ? lock_release+0x1d5/0x250 [ 7900.673657][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7900.673917][ C2] ? ktime_get+0xb3/0x190 [ 7900.674138][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7900.674430][ C2] run_timer_softirq+0x72/0x100 [ 7900.674677][ C2] __do_softirq+0x1b9/0x7ff [ 7900.674909][ C2] irq_exit_rcu+0x98/0xc0 [ 7900.675126][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7900.675410][ C2] [ 7900.675557][ C2] [ 7900.675707][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7900.676007][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7900.676262][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7900.677221][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7900.677526][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7900.677921][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7900.678317][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7900.678711][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7900.679105][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7900.679501][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7900.679788][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7900.680047][ C2] default_idle_call+0x69/0xa0 [ 7900.680290][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7900.680539][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7900.680813][ C2] ? lock_release+0x1d5/0x250 [ 7900.681050][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7900.681320][ C2] do_idle+0xfb/0x160 [ 7900.681521][ C2] cpu_startup_entry+0x55/0x60 [ 7900.681762][ C2] start_secondary+0x21c/0x2b0 [ 7900.682009][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7900.682275][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7900.682583][ C2] [ 7923.065103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 7923.065472][ C1] rcu: 1-....: (5554884 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1360330 [ 7923.066033][ C1] rcu: (t=5568178 jiffies g=1882453 q=721 ncpus=4) [ 7923.066366][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7923.066812][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7923.067427][ C1] RIP: 0010:kasan_check_range+0x16/0x1c0 [ 7923.067720][ C1] Code: 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 <48> 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe [ 7923.068688][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [ 7923.068996][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7923.069394][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7923.069790][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7923.070192][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7923.070590][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7923.070987][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7923.071434][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7923.071765][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7923.072170][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7923.072569][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7923.072967][ C1] PKRU: 55555554 [ 7923.073150][ C1] Call Trace: [ 7923.073322][ C1] [ 7923.073469][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 7923.073741][ C1] ? print_cpu_stall+0x263/0x6a0 [ 7923.073994][ C1] ? check_cpu_stall+0x284/0x500 [ 7923.074246][ C1] ? rcu_pending+0x92/0x360 [ 7923.074477][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 7923.074746][ C1] ? update_process_times+0xb9/0x110 [ 7923.075016][ C1] ? tick_sched_handle+0x67/0x130 [ 7923.075272][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 7923.075558][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7923.075799][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 7923.076114][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7923.076387][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7923.076676][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7923.076940][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7923.077247][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7923.077510][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7923.077821][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7923.078115][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7923.078431][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7923.078722][ C1] ? kasan_check_range+0x16/0x1c0 [ 7923.078977][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 7923.079258][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7923.079570][ C1] ? get_stack_info+0x36/0xc0 [ 7923.079811][ C1] ? lock_acquire+0x1c1/0x220 [ 7923.080051][ C1] ? lock_release+0x1d5/0x250 [ 7923.080290][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7923.080541][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7923.080812][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7923.081099][ C1] ? lock_acquire+0x1c1/0x220 [ 7923.081338][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7923.081577][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7923.081840][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7923.082075][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7923.082324][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7923.082582][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7923.082857][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7923.083134][ C1] ip_local_deliver+0x19d/0x480 [ 7923.083381][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7923.083653][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7923.083917][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7923.084262][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7923.084518][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7923.084838][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7923.085100][ C1] ip_rcv+0x564/0x740 [ 7923.085304][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7923.085535][ C1] ? set_track_prepare+0x8a/0xd0 [ 7923.085789][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7923.086065][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7923.086337][ C1] ? skb_clone+0x10b/0x330 [ 7923.086566][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7923.086885][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7923.087192][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7923.087474][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7923.087770][ C1] ? __tcf_classify+0x329/0x7d0 [ 7923.088018][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7923.088250][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7923.088551][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7923.088835][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7923.089161][ C1] ? lock_acquire+0x1c1/0x220 [ 7923.089401][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7923.089697][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7923.089983][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7923.090301][ C1] ? __copy_skb_header+0xaf/0x490 [ 7923.090558][ C1] ? __skb_clone+0x57a/0x760 [ 7923.090794][ C1] netif_receive_skb+0x55/0x280 [ 7923.091042][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7923.091355][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7923.091686][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7923.091990][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7923.092264][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7923.092554][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7923.092866][ C1] ? hlock_class+0x4e/0x130 [ 7923.093099][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7923.093375][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7923.093654][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7923.093918][ C1] ? hlock_class+0x4e/0x130 [ 7923.094148][ C1] ? mark_lock+0x38/0x3e0 [ 7923.094370][ C1] ? stack_access_ok+0xda/0x1f0 [ 7923.094619][ C1] ? __lock_acquire+0xb67/0x1610 [ 7923.094873][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7923.095148][ C1] ? get_stack_info+0x36/0xc0 [ 7923.095388][ C1] ? stack_access_ok+0xda/0x1f0 [ 7923.095635][ C1] ? get_reg+0x119/0x190 [ 7923.095852][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7923.096119][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7923.096428][ C1] __tcf_classify+0x329/0x7d0 [ 7923.096671][ C1] tcf_classify+0x283/0x930 [ 7923.096901][ C1] ? arch_stack_walk+0xa2/0x100 [ 7923.097150][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7923.097406][ C1] ? get_stack_info+0x36/0xc0 [ 7923.097648][ C1] tc_run+0x2e4/0x5d0 [ 7923.097853][ C1] ? __pfx_tc_run+0x10/0x10 [ 7923.098085][ C1] ? lock_acquire+0x1c1/0x220 [ 7923.098323][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7923.098584][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7923.098836][ C1] ? lock_acquire+0x1c1/0x220 [ 7923.099073][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7923.099339][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7923.099645][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7923.099916][ C1] ? neigh_hh_output+0x348/0x590 [ 7923.100167][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7923.100434][ C1] ip_finish_output2+0x786/0x18e0 [ 7923.100691][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7923.100971][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7923.101308][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7923.101584][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7923.101839][ C1] ? __ip_finish_output+0x10f/0x770 [ 7923.102104][ C1] ip_output+0x16b/0x4f0 [ 7923.102323][ C1] ? run_timer_softirq+0x72/0x100 [ 7923.102579][ C1] ? __pfx_ip_output+0x10/0x10 [ 7923.102823][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7923.103108][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7923.103359][ C1] ? ip_local_out+0x114/0x3b0 [ 7923.103601][ C1] __ip_queue_xmit+0x672/0x1910 [ 7923.103849][ C1] ? __create_object+0x5e/0xb0 [ 7923.104092][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7923.104360][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7923.104642][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7923.104915][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7923.105196][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7923.105469][ C1] tcp_delack_timer+0x84/0x240 [ 7923.105713][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7923.105985][ C1] call_timer_fn+0x173/0x430 [ 7923.106220][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7923.106483][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7923.106745][ C1] __run_timers.part.0+0x52d/0x890 [ 7923.107006][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7923.107279][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7923.107562][ C1] ? lock_acquire+0x1c1/0x220 [ 7923.107802][ C1] ? clockevents_program_event+0xf6/0x300 [ 7923.108093][ C1] ? lock_release+0x1d5/0x250 [ 7923.108330][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7923.108596][ C1] ? ktime_get+0xb3/0x190 [ 7923.108817][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7923.109115][ C1] run_timer_softirq+0x72/0x100 [ 7923.109363][ C1] __do_softirq+0x1b9/0x7ff [ 7923.109596][ C1] irq_exit_rcu+0x98/0xc0 [ 7923.109820][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7923.110107][ C1] [ 7923.110256][ C1] [ 7923.110409][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7923.110712][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7923.111037][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7923.112009][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7923.112317][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7923.112718][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7923.113117][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7923.113516][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7923.113914][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7923.114315][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7923.114614][ C1] pipe_read+0xa16/0xdf0 [ 7923.114838][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7923.115115][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7923.115360][ C1] ? iterate_tty_write+0x299/0x540 [ 7923.115624][ C1] ? lock_release+0x1d5/0x250 [ 7923.115866][ C1] vfs_read+0x911/0xc00 [ 7923.116079][ C1] ? lock_acquire+0x1c1/0x220 [ 7923.116319][ C1] ? __might_fault+0xc6/0x180 [ 7923.116558][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7923.116797][ C1] ? __might_fault+0xc6/0x180 [ 7923.117037][ C1] ? lock_release+0x1d5/0x250 [ 7923.117278][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7923.117542][ C1] ? __fget_light+0x54/0x1e0 [ 7923.117779][ C1] ksys_read+0x17a/0x1e0 [ 7923.117996][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7923.118241][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7923.118544][ C1] do_syscall_64+0xc9/0x1e0 [ 7923.118777][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7923.119078][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7923.119304][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7923.120275][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7923.120700][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7923.121098][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7923.121497][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7923.121900][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7923.122299][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7923.122700][ C1] [ 7923.122859][ C1] Sending NMI from CPU 1 to CPUs 2: [ 7923.123132][ C2] NMI backtrace for cpu 2 [ 7923.123146][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7923.123152][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7923.123156][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7923.123164][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7923.123170][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7923.123175][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7923.123178][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7923.123182][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7923.123186][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7923.123190][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7923.123194][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7923.123198][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7923.123204][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7923.123208][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7923.123211][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7923.123214][ C2] PKRU: 55555554 [ 7923.123216][ C2] Call Trace: [ 7923.123219][ C2] [ 7923.123222][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 7923.123233][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 7923.123241][ C2] ? nmi_handle+0x153/0x420 [ 7923.123251][ C2] ? default_do_nmi+0x41/0x100 [ 7923.123258][ C2] ? exc_nmi+0xf3/0x120 [ 7923.123264][ C2] ? end_repeat_nmi+0xf/0x60 [ 7923.123276][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7923.123284][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7923.123291][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7923.123300][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7923.123308][ C2] [ 7923.123310][ C2] [ 7923.123313][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7923.123320][ C2] ? get_stack_info+0x36/0xc0 [ 7923.123328][ C2] ? lock_acquire+0x1c1/0x220 [ 7923.123336][ C2] ? lock_release+0x1d5/0x250 [ 7923.123345][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7923.123354][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7923.123361][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7923.123369][ C2] ? lock_acquire+0x1c1/0x220 [ 7923.123374][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7923.123383][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7923.123390][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7923.123406][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7923.123412][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7923.123424][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7923.123434][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7923.123442][ C2] ip_local_deliver+0x19d/0x480 [ 7923.123448][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7923.123453][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7923.123459][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7923.123470][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7923.123478][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7923.123485][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7923.123507][ C2] ip_rcv+0x564/0x740 [ 7923.123513][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7923.123519][ C2] ? set_track_prepare+0x8a/0xd0 [ 7923.123528][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7923.123535][ C2] ? start_secondary+0x21c/0x2b0 [ 7923.123542][ C2] ? skb_clone+0x10b/0x330 [ 7923.123547][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7923.123562][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7923.123577][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7923.123584][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7923.123604][ C2] ? __tcf_classify+0x329/0x7d0 [ 7923.123613][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7923.123618][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7923.123627][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7923.123634][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7923.123645][ C2] ? lock_acquire+0x1c1/0x220 [ 7923.123651][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7923.123661][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7923.123670][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7923.123680][ C2] ? __copy_skb_header+0xaf/0x490 [ 7923.123690][ C2] ? __skb_clone+0x57a/0x760 [ 7923.123696][ C2] netif_receive_skb+0x55/0x280 [ 7923.123704][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7923.123720][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7923.123727][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7923.123733][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7923.123738][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7923.123748][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7923.123755][ C2] ? get_stack_info+0x36/0xc0 [ 7923.123760][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7923.123763][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7923.123766][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7923.123769][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7923.123772][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7923.123775][ C2] ? kernel_text_address+0x17/0xe0 [ 7923.123778][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7923.123782][ C2] ? arch_stack_walk+0x8c/0x100 [ 7923.123785][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7923.123789][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7923.123792][ C2] ? lock_acquire+0x1c1/0x220 [ 7923.123794][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7923.123798][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7923.123802][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7923.123805][ C2] ? get_stack_info+0x36/0xc0 [ 7923.123809][ C2] __tcf_classify+0x329/0x7d0 [ 7923.123814][ C2] tcf_classify+0x283/0x930 [ 7923.123818][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7923.123822][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7923.123826][ C2] tc_run+0x2e4/0x5d0 [ 7923.123829][ C2] ? __pfx_tc_run+0x10/0x10 [ 7923.123832][ C2] ? lock_acquire+0x1c1/0x220 [ 7923.123834][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7923.123838][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7923.123842][ C2] ? lock_acquire+0x1c1/0x220 [ 7923.123845][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7923.123848][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7923.123851][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7923.123854][ C2] ? neigh_hh_output+0x348/0x590 [ 7923.123858][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7923.123861][ C2] ip_finish_output2+0x786/0x18e0 [ 7923.123864][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7923.123872][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7923.123874][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7923.123878][ C2] ? __ip_finish_output+0x10f/0x770 [ 7923.123882][ C2] ip_output+0x16b/0x4f0 [ 7923.123885][ C2] ? __pfx_ip_output+0x10/0x10 [ 7923.123887][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7923.123890][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7923.123893][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7923.123896][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7923.123898][ C2] ? __alloc_skb+0xd4/0x280 [ 7923.123901][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7923.123904][ C2] ? tcp_fragment+0x168/0x1040 [ 7923.123907][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7923.123910][ C2] ? ip_local_out+0x114/0x3b0 [ 7923.123913][ C2] __ip_queue_xmit+0x672/0x1910 [ 7923.123917][ C2] ? __skb_clone+0x57a/0x760 [ 7923.123920][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7923.123925][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7923.123928][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7923.123932][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7923.123936][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7923.123940][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7923.123943][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7923.123946][ C2] tcp_send_loss_probe+0x348/0x830 [ 7923.123949][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7923.123952][ C2] tcp_write_timer+0x82/0x1d0 [ 7923.123955][ C2] call_timer_fn+0x173/0x430 [ 7923.123959][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7923.123964][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7923.123968][ C2] __run_timers.part.0+0x52d/0x890 [ 7923.123971][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7923.123975][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7923.123978][ C2] ? lock_acquire+0x1c1/0x220 [ 7923.123980][ C2] ? clockevents_program_event+0xf6/0x300 [ 7923.123985][ C2] ? lock_release+0x1d5/0x250 [ 7923.123987][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7923.123990][ C2] ? ktime_get+0xb3/0x190 [ 7923.123994][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7923.123998][ C2] run_timer_softirq+0x72/0x100 [ 7923.124001][ C2] __do_softirq+0x1b9/0x7ff [ 7923.124005][ C2] irq_exit_rcu+0x98/0xc0 [ 7923.124008][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7923.124011][ C2] [ 7923.124012][ C2] [ 7923.124013][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7923.124016][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7923.124019][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7923.124021][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7923.124023][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7923.124025][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7923.124026][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7923.124027][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7923.124029][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7923.124032][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7923.124035][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7923.124038][ C2] default_idle_call+0x69/0xa0 [ 7923.124041][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7923.124044][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7923.124047][ C2] ? lock_release+0x1d5/0x250 [ 7923.124050][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7923.124054][ C2] do_idle+0xfb/0x160 [ 7923.124056][ C2] cpu_startup_entry+0x55/0x60 [ 7923.124059][ C2] start_secondary+0x21c/0x2b0 [ 7923.124061][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7923.124065][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7923.124071][ C2] [ 7948.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5211s! [perl:4135] [ 7948.569679][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7948.570897][ C1] irq event stamp: 209232 [ 7948.571110][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7948.571622][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7948.572114][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7948.572581][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7948.573048][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7948.573480][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7948.574078][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7948.574398][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7948.575345][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7948.575645][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7948.576032][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7948.576420][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7948.576808][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7948.577199][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7948.577587][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7948.578023][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7948.578347][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7948.578738][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7948.579128][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7948.579516][ C1] PKRU: 55555554 [ 7948.579694][ C1] Call Trace: [ 7948.579860][ C1] [ 7948.580024][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7948.580286][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7948.580531][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7948.580808][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7948.581079][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7948.581370][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7948.581635][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7948.581944][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7948.582208][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7948.582517][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7948.582814][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7948.583129][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7948.583419][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7948.583713][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7948.584003][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7948.584314][ C1] ? get_stack_info+0x36/0xc0 [ 7948.584554][ C1] ? lock_acquire+0x1c1/0x220 [ 7948.584795][ C1] ? lock_release+0x1d5/0x250 [ 7948.585035][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7948.585284][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7948.585556][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7948.585840][ C1] ? lock_acquire+0x1c1/0x220 [ 7948.586079][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7948.586321][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7948.586581][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7948.586817][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7948.587062][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7948.587320][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7948.587597][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7948.587873][ C1] ip_local_deliver+0x19d/0x480 [ 7948.588121][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7948.588391][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7948.588655][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7948.589002][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7948.589254][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7948.589575][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7948.589838][ C1] ip_rcv+0x564/0x740 [ 7948.590044][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7948.590274][ C1] ? set_track_prepare+0x8a/0xd0 [ 7948.590528][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7948.590806][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7948.591079][ C1] ? skb_clone+0x10b/0x330 [ 7948.591305][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7948.591624][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7948.591943][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7948.592226][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7948.592522][ C1] ? __tcf_classify+0x329/0x7d0 [ 7948.592773][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7948.593004][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7948.593305][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7948.593593][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7948.593920][ C1] ? lock_acquire+0x1c1/0x220 [ 7948.594158][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7948.594458][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7948.594745][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7948.595062][ C1] ? __copy_skb_header+0xaf/0x490 [ 7948.595321][ C1] ? __skb_clone+0x57a/0x760 [ 7948.595558][ C1] netif_receive_skb+0x55/0x280 [ 7948.595808][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7948.596123][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7948.596457][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7948.596757][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7948.597033][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7948.597323][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7948.597637][ C1] ? hlock_class+0x4e/0x130 [ 7948.597872][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7948.598149][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7948.598425][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7948.598689][ C1] ? hlock_class+0x4e/0x130 [ 7948.598922][ C1] ? mark_lock+0x38/0x3e0 [ 7948.599143][ C1] ? stack_access_ok+0xda/0x1f0 [ 7948.599394][ C1] ? __lock_acquire+0xb67/0x1610 [ 7948.599649][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7948.599927][ C1] ? get_stack_info+0x36/0xc0 [ 7948.600167][ C1] ? stack_access_ok+0xda/0x1f0 [ 7948.600416][ C1] ? get_reg+0x119/0x190 [ 7948.600634][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7948.600904][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7948.601214][ C1] __tcf_classify+0x329/0x7d0 [ 7948.601456][ C1] tcf_classify+0x283/0x930 [ 7948.601695][ C1] ? arch_stack_walk+0xa2/0x100 [ 7948.601946][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7948.602204][ C1] ? get_stack_info+0x36/0xc0 [ 7948.602444][ C1] tc_run+0x2e4/0x5d0 [ 7948.602652][ C1] ? __pfx_tc_run+0x10/0x10 [ 7948.602882][ C1] ? lock_acquire+0x1c1/0x220 [ 7948.603122][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7948.603385][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7948.603640][ C1] ? lock_acquire+0x1c1/0x220 [ 7948.603880][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7948.604147][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7948.604455][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7948.604728][ C1] ? neigh_hh_output+0x348/0x590 [ 7948.604982][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7948.605249][ C1] ip_finish_output2+0x786/0x18e0 [ 7948.605507][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7948.605785][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7948.606127][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7948.606406][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7948.606665][ C1] ? __ip_finish_output+0x10f/0x770 [ 7948.606931][ C1] ip_output+0x16b/0x4f0 [ 7948.607147][ C1] ? run_timer_softirq+0x72/0x100 [ 7948.607405][ C1] ? __pfx_ip_output+0x10/0x10 [ 7948.607650][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7948.607938][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7948.608191][ C1] ? ip_local_out+0x114/0x3b0 [ 7948.608432][ C1] __ip_queue_xmit+0x672/0x1910 [ 7948.608681][ C1] ? __create_object+0x5e/0xb0 [ 7948.608928][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7948.609196][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7948.609478][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7948.609755][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7948.610037][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7948.610310][ C1] tcp_delack_timer+0x84/0x240 [ 7948.610556][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7948.610827][ C1] call_timer_fn+0x173/0x430 [ 7948.611065][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7948.611328][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7948.611591][ C1] __run_timers.part.0+0x52d/0x890 [ 7948.611857][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7948.612133][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7948.612419][ C1] ? lock_acquire+0x1c1/0x220 [ 7948.612662][ C1] ? clockevents_program_event+0xf6/0x300 [ 7948.612952][ C1] ? lock_release+0x1d5/0x250 [ 7948.613194][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7948.613459][ C1] ? ktime_get+0xb3/0x190 [ 7948.613685][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7948.613983][ C1] run_timer_softirq+0x72/0x100 [ 7948.614233][ C1] __do_softirq+0x1b9/0x7ff [ 7948.614467][ C1] irq_exit_rcu+0x98/0xc0 [ 7948.614688][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7948.614974][ C1] [ 7948.615126][ C1] [ 7948.615276][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7948.615583][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7948.615908][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7948.616884][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7948.617196][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7948.617596][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7948.617996][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7948.618401][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7948.618801][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7948.619204][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7948.619503][ C1] pipe_read+0xa16/0xdf0 [ 7948.619723][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7948.620003][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7948.620247][ C1] ? iterate_tty_write+0x299/0x540 [ 7948.620508][ C1] ? lock_release+0x1d5/0x250 [ 7948.620751][ C1] vfs_read+0x911/0xc00 [ 7948.620966][ C1] ? lock_acquire+0x1c1/0x220 [ 7948.621206][ C1] ? __might_fault+0xc6/0x180 [ 7948.621449][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7948.621694][ C1] ? __might_fault+0xc6/0x180 [ 7948.621933][ C1] ? lock_release+0x1d5/0x250 [ 7948.622174][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7948.622440][ C1] ? __fget_light+0x54/0x1e0 [ 7948.622680][ C1] ksys_read+0x17a/0x1e0 [ 7948.622897][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7948.623143][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7948.623449][ C1] do_syscall_64+0xc9/0x1e0 [ 7948.623684][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7948.623984][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7948.624214][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7948.625191][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7948.625614][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7948.626015][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7948.626416][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7948.626815][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7948.627217][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7948.627623][ C1] [ 7948.627779][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5211s! [swapper/2:0] [ 7948.628191][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7948.629431][ C2] irq event stamp: 44114564 [ 7948.629660][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7948.630191][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7948.630700][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7948.631177][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7948.631645][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7948.632101][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7948.632710][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7948.633032][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7948.633996][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 7948.634304][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7948.634700][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7948.635096][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7948.635491][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7948.635892][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7948.636289][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7948.636733][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7948.637063][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7948.637460][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7948.637860][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7948.638256][ C2] PKRU: 55555554 [ 7948.638438][ C2] Call Trace: [ 7948.638608][ C2] [ 7948.638756][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7948.639016][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7948.639258][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7948.639533][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7948.639804][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7948.640092][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7948.640355][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7948.640660][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7948.640920][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7948.641181][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7948.641486][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7948.641783][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7948.642097][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7948.642384][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7948.642677][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7948.642965][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7948.643275][ C2] ? get_stack_info+0x36/0xc0 [ 7948.643513][ C2] ? lock_acquire+0x1c1/0x220 [ 7948.643753][ C2] ? lock_release+0x1d5/0x250 [ 7948.643992][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7948.644240][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7948.644511][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7948.644793][ C2] ? lock_acquire+0x1c1/0x220 [ 7948.645031][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7948.645272][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7948.645531][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7948.645764][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7948.646008][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7948.646265][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7948.646540][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7948.646816][ C2] ip_local_deliver+0x19d/0x480 [ 7948.647064][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7948.647334][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7948.647595][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7948.647941][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7948.648192][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7948.648510][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7948.648771][ C2] ip_rcv+0x564/0x740 [ 7948.648975][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7948.649203][ C2] ? set_track_prepare+0x8a/0xd0 [ 7948.649455][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7948.649732][ C2] ? start_secondary+0x21c/0x2b0 [ 7948.649982][ C2] ? skb_clone+0x10b/0x330 [ 7948.650209][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7948.650526][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7948.650830][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7948.651109][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7948.651403][ C2] ? __tcf_classify+0x329/0x7d0 [ 7948.651651][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7948.651883][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7948.652181][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7948.652464][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7948.652787][ C2] ? lock_acquire+0x1c1/0x220 [ 7948.653026][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7948.653322][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7948.653605][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7948.653920][ C2] ? __copy_skb_header+0xaf/0x490 [ 7948.654176][ C2] ? __skb_clone+0x57a/0x760 [ 7948.654410][ C2] netif_receive_skb+0x55/0x280 [ 7948.654656][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7948.654966][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7948.655298][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7948.655594][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7948.655867][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7948.656156][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7948.656465][ C2] ? get_stack_info+0x36/0xc0 [ 7948.656704][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7948.656968][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7948.657282][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7948.657558][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7948.657833][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7948.658146][ C2] ? kernel_text_address+0x17/0xe0 [ 7948.658404][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7948.658716][ C2] ? arch_stack_walk+0x8c/0x100 [ 7948.658964][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7948.659227][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7948.659509][ C2] ? lock_acquire+0x1c1/0x220 [ 7948.659748][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7948.660028][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7948.660330][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7948.660607][ C2] ? get_stack_info+0x36/0xc0 [ 7948.660846][ C2] __tcf_classify+0x329/0x7d0 [ 7948.661088][ C2] tcf_classify+0x283/0x930 [ 7948.661320][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7948.661574][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7948.661889][ C2] tc_run+0x2e4/0x5d0 [ 7948.662093][ C2] ? __pfx_tc_run+0x10/0x10 [ 7948.662321][ C2] ? lock_acquire+0x1c1/0x220 [ 7948.662560][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7948.662819][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7948.663071][ C2] ? lock_acquire+0x1c1/0x220 [ 7948.663308][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7948.663570][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7948.663872][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7948.664143][ C2] ? neigh_hh_output+0x348/0x590 [ 7948.664394][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7948.664660][ C2] ip_finish_output2+0x786/0x18e0 [ 7948.664915][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7948.665250][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7948.665526][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7948.665777][ C2] ? __ip_finish_output+0x10f/0x770 [ 7948.666041][ C2] ip_output+0x16b/0x4f0 [ 7948.666257][ C2] ? __pfx_ip_output+0x10/0x10 [ 7948.666500][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7948.666773][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7948.667084][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7948.667358][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7948.667608][ C2] ? __alloc_skb+0xd4/0x280 [ 7948.667839][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7948.668106][ C2] ? tcp_fragment+0x168/0x1040 [ 7948.668348][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7948.668598][ C2] ? ip_local_out+0x114/0x3b0 [ 7948.668837][ C2] __ip_queue_xmit+0x672/0x1910 [ 7948.669083][ C2] ? __skb_clone+0x57a/0x760 [ 7948.669317][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7948.669581][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7948.669862][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7948.670104][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7948.670351][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7948.670651][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7948.670969][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7948.671212][ C2] tcp_send_loss_probe+0x348/0x830 [ 7948.671472][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7948.671741][ C2] tcp_write_timer+0x82/0x1d0 [ 7948.671979][ C2] call_timer_fn+0x173/0x430 [ 7948.672215][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7948.672476][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7948.672736][ C2] __run_timers.part.0+0x52d/0x890 [ 7948.672998][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7948.673266][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7948.673548][ C2] ? lock_acquire+0x1c1/0x220 [ 7948.673786][ C2] ? clockevents_program_event+0xf6/0x300 [ 7948.674075][ C2] ? lock_release+0x1d5/0x250 [ 7948.674311][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7948.674574][ C2] ? ktime_get+0xb3/0x190 [ 7948.674795][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7948.675089][ C2] run_timer_softirq+0x72/0x100 [ 7948.675335][ C2] __do_softirq+0x1b9/0x7ff [ 7948.675571][ C2] irq_exit_rcu+0x98/0xc0 [ 7948.675789][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7948.676074][ C2] [ 7948.676222][ C2] [ 7948.676373][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7948.676674][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7948.676929][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7948.677896][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7948.678201][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7948.678599][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7948.678995][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7948.679390][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7948.679785][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7948.680184][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7948.680471][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7948.680729][ C2] default_idle_call+0x69/0xa0 [ 7948.680972][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7948.681222][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7948.681496][ C2] ? lock_release+0x1d5/0x250 [ 7948.681739][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7948.682010][ C2] do_idle+0xfb/0x160 [ 7948.682212][ C2] cpu_startup_entry+0x55/0x60 [ 7948.682454][ C2] start_secondary+0x21c/0x2b0 [ 7948.682697][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7948.682963][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7948.683272][ C2] [ 7976.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5237s! [perl:4135] [ 7976.569680][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7976.570902][ C1] irq event stamp: 209232 [ 7976.571114][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7976.571650][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 7976.572129][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 7976.572597][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 7976.573059][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 7976.573494][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7976.574094][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 7976.574411][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 7976.575357][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 7976.575657][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7976.576044][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 7976.576432][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 7976.576823][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 7976.577212][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 7976.577601][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 7976.578036][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7976.578359][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 7976.578751][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7976.579140][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7976.579529][ C1] PKRU: 55555554 [ 7976.579707][ C1] Call Trace: [ 7976.579873][ C1] [ 7976.580017][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7976.580271][ C1] ? __run_hrtimer+0x1c0/0x710 [ 7976.580511][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7976.580780][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 7976.581046][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7976.581327][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7976.581606][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7976.581913][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 7976.582176][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7976.582486][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7976.582790][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7976.583096][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7976.583379][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 7976.583666][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7976.583949][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7976.584253][ C1] ? get_stack_info+0x36/0xc0 [ 7976.584488][ C1] ? lock_acquire+0x1c1/0x220 [ 7976.584721][ C1] ? lock_release+0x1d5/0x250 [ 7976.584956][ C1] do_raw_spin_lock+0x1ec/0x270 [ 7976.585199][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7976.585465][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7976.585743][ C1] ? lock_acquire+0x1c1/0x220 [ 7976.585975][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7976.586210][ C1] _raw_spin_lock_nested+0x65/0x80 [ 7976.586463][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 7976.586692][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7976.586934][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 7976.587185][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 7976.587454][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 7976.587724][ C1] ip_local_deliver+0x19d/0x480 [ 7976.587966][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 7976.588231][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7976.588489][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7976.588830][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7976.589078][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7976.589392][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7976.589648][ C1] ip_rcv+0x564/0x740 [ 7976.589847][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7976.590073][ C1] ? set_track_prepare+0x8a/0xd0 [ 7976.590320][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 7976.590592][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 7976.590858][ C1] ? skb_clone+0x10b/0x330 [ 7976.591080][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7976.591391][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7976.591714][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7976.591997][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7976.592292][ C1] ? __tcf_classify+0x329/0x7d0 [ 7976.592542][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 7976.592785][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 7976.593075][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7976.593356][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7976.593675][ C1] ? lock_acquire+0x1c1/0x220 [ 7976.593929][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 7976.594225][ C1] netif_receive_skb_internal+0xb0/0x300 [ 7976.594513][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7976.594831][ C1] ? __copy_skb_header+0xaf/0x490 [ 7976.595090][ C1] ? __skb_clone+0x57a/0x760 [ 7976.595325][ C1] netif_receive_skb+0x55/0x280 [ 7976.595576][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7976.595890][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7976.596224][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7976.596525][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 7976.596801][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 7976.597090][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7976.597405][ C1] ? hlock_class+0x4e/0x130 [ 7976.597640][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7976.597917][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7976.598193][ C1] ? __pfx_validate_chain+0x10/0x10 [ 7976.598460][ C1] ? hlock_class+0x4e/0x130 [ 7976.598692][ C1] ? mark_lock+0x38/0x3e0 [ 7976.598914][ C1] ? stack_access_ok+0xda/0x1f0 [ 7976.599164][ C1] ? __lock_acquire+0xb67/0x1610 [ 7976.599418][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 7976.599699][ C1] ? get_stack_info+0x36/0xc0 [ 7976.599939][ C1] ? stack_access_ok+0xda/0x1f0 [ 7976.600187][ C1] ? get_reg+0x119/0x190 [ 7976.600406][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 7976.600675][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7976.600986][ C1] __tcf_classify+0x329/0x7d0 [ 7976.601228][ C1] tcf_classify+0x283/0x930 [ 7976.601462][ C1] ? arch_stack_walk+0xa2/0x100 [ 7976.601728][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 7976.601987][ C1] ? get_stack_info+0x36/0xc0 [ 7976.602230][ C1] tc_run+0x2e4/0x5d0 [ 7976.602435][ C1] ? __pfx_tc_run+0x10/0x10 [ 7976.602668][ C1] ? lock_acquire+0x1c1/0x220 [ 7976.602907][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 7976.603169][ C1] __dev_queue_xmit+0x686/0x17e0 [ 7976.603423][ C1] ? lock_acquire+0x1c1/0x220 [ 7976.603663][ C1] ? ip_finish_output2+0x786/0x18e0 [ 7976.603929][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7976.604237][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7976.604510][ C1] ? neigh_hh_output+0x348/0x590 [ 7976.604764][ C1] ? ip_finish_output2+0x262/0x18e0 [ 7976.605029][ C1] ip_finish_output2+0x786/0x18e0 [ 7976.605286][ C1] ? stack_depot_save_flags+0x45/0x550 [ 7976.605565][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7976.605905][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 7976.606183][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7976.606438][ C1] ? __ip_finish_output+0x10f/0x770 [ 7976.606705][ C1] ip_output+0x16b/0x4f0 [ 7976.606923][ C1] ? run_timer_softirq+0x72/0x100 [ 7976.607182][ C1] ? __pfx_ip_output+0x10/0x10 [ 7976.607426][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7976.607715][ C1] ? rcu_read_lock_held+0xe/0x50 [ 7976.607968][ C1] ? ip_local_out+0x114/0x3b0 [ 7976.608208][ C1] __ip_queue_xmit+0x672/0x1910 [ 7976.608459][ C1] ? __create_object+0x5e/0xb0 [ 7976.608706][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 7976.608974][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7976.609258][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 7976.609533][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 7976.609816][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7976.610090][ C1] tcp_delack_timer+0x84/0x240 [ 7976.610339][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7976.610613][ C1] call_timer_fn+0x173/0x430 [ 7976.610850][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 7976.611113][ C1] ? next_expiry_recalc+0xcd/0x220 [ 7976.611375][ C1] __run_timers.part.0+0x52d/0x890 [ 7976.611640][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 7976.611917][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 7976.612204][ C1] ? lock_acquire+0x1c1/0x220 [ 7976.612445][ C1] ? clockevents_program_event+0xf6/0x300 [ 7976.612735][ C1] ? lock_release+0x1d5/0x250 [ 7976.612976][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7976.613242][ C1] ? ktime_get+0xb3/0x190 [ 7976.613465][ C1] ? clockevents_program_event+0x1ea/0x300 [ 7976.613762][ C1] run_timer_softirq+0x72/0x100 [ 7976.614011][ C1] __do_softirq+0x1b9/0x7ff [ 7976.614246][ C1] irq_exit_rcu+0x98/0xc0 [ 7976.614466][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 7976.614754][ C1] [ 7976.614905][ C1] [ 7976.615055][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7976.615362][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 7976.615688][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 7976.616661][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 7976.616971][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 7976.617370][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 7976.617774][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 7976.618175][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 7976.618575][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 7976.618977][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 7976.619277][ C1] pipe_read+0xa16/0xdf0 [ 7976.619497][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 7976.619779][ C1] ? __pfx_pipe_read+0x10/0x10 [ 7976.620023][ C1] ? iterate_tty_write+0x299/0x540 [ 7976.620286][ C1] ? lock_release+0x1d5/0x250 [ 7976.620527][ C1] vfs_read+0x911/0xc00 [ 7976.620744][ C1] ? lock_acquire+0x1c1/0x220 [ 7976.620982][ C1] ? __might_fault+0xc6/0x180 [ 7976.621225][ C1] ? __pfx_vfs_read+0x10/0x10 [ 7976.621466][ C1] ? __might_fault+0xc6/0x180 [ 7976.621711][ C1] ? lock_release+0x1d5/0x250 [ 7976.621950][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 7976.622219][ C1] ? __fget_light+0x54/0x1e0 [ 7976.622457][ C1] ksys_read+0x17a/0x1e0 [ 7976.622677][ C1] ? __pfx_ksys_read+0x10/0x10 [ 7976.622921][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7976.623229][ C1] do_syscall_64+0xc9/0x1e0 [ 7976.623463][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 7976.623767][ C1] RIP: 0033:0x7f08a1ea38b2 [ 7976.623996][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 7976.624972][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 7976.625397][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 7976.625798][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 7976.626198][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 7976.626599][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 7976.627002][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 7976.627406][ C1] [ 7976.627564][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5237s! [swapper/2:0] [ 7976.627974][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 7976.629214][ C2] irq event stamp: 44114564 [ 7976.629443][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 7976.629973][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 7976.630480][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 7976.630953][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 7976.631420][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 7976.631877][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 7976.632482][ C2] RIP: 0010:__kasan_check_read+0x8/0x20 [ 7976.632765][ C2] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 7976.633728][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 7976.634033][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 7976.634429][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 7976.634824][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 7976.635219][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 7976.635616][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 7976.636011][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 7976.636452][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 7976.636780][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 7976.637176][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 7976.637573][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 7976.637966][ C2] PKRU: 55555554 [ 7976.638147][ C2] Call Trace: [ 7976.638316][ C2] [ 7976.638462][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 7976.638721][ C2] ? __run_hrtimer+0x1c0/0x710 [ 7976.638962][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 7976.639236][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 7976.639505][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 7976.639793][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7976.640055][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 7976.640358][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 7976.640618][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 7976.640878][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 7976.641183][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 7976.641476][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7976.641794][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 7976.642081][ C2] ? __kasan_check_read+0x8/0x20 [ 7976.642333][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 7976.642611][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 7976.642921][ C2] ? get_stack_info+0x36/0xc0 [ 7976.643160][ C2] ? lock_acquire+0x1c1/0x220 [ 7976.643397][ C2] ? lock_release+0x1d5/0x250 [ 7976.643635][ C2] do_raw_spin_lock+0x1ec/0x270 [ 7976.643882][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 7976.644151][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7976.644434][ C2] ? lock_acquire+0x1c1/0x220 [ 7976.644669][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 7976.644909][ C2] _raw_spin_lock_nested+0x65/0x80 [ 7976.645167][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 7976.645401][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 7976.645646][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 7976.645902][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 7976.646174][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 7976.646448][ C2] ip_local_deliver+0x19d/0x480 [ 7976.646693][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 7976.646962][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 7976.647227][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 7976.647570][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7976.647822][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 7976.648139][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 7976.648400][ C2] ip_rcv+0x564/0x740 [ 7976.648601][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7976.648830][ C2] ? set_track_prepare+0x8a/0xd0 [ 7976.649081][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7976.649355][ C2] ? start_secondary+0x21c/0x2b0 [ 7976.649604][ C2] ? skb_clone+0x10b/0x330 [ 7976.649827][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 7976.650144][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 7976.650449][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 7976.650727][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 7976.651020][ C2] ? __tcf_classify+0x329/0x7d0 [ 7976.651267][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 7976.651495][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 7976.651797][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7976.652080][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 7976.652403][ C2] ? lock_acquire+0x1c1/0x220 [ 7976.652638][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 7976.652933][ C2] netif_receive_skb_internal+0xb0/0x300 [ 7976.653216][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 7976.653530][ C2] ? __copy_skb_header+0xaf/0x490 [ 7976.653784][ C2] ? __skb_clone+0x57a/0x760 [ 7976.654018][ C2] netif_receive_skb+0x55/0x280 [ 7976.654265][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 7976.654575][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 7976.654904][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 7976.655202][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 7976.655474][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 7976.655759][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 7976.656068][ C2] ? get_stack_info+0x36/0xc0 [ 7976.656309][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 7976.656571][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7976.656886][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7976.657158][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 7976.657431][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 7976.657744][ C2] ? kernel_text_address+0x17/0xe0 [ 7976.658001][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7976.658311][ C2] ? arch_stack_walk+0x8c/0x100 [ 7976.658558][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 7976.658821][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 7976.659105][ C2] ? lock_acquire+0x1c1/0x220 [ 7976.659342][ C2] ? stack_depot_save_flags+0x281/0x550 [ 7976.659622][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7976.659924][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 7976.660198][ C2] ? get_stack_info+0x36/0xc0 [ 7976.660437][ C2] __tcf_classify+0x329/0x7d0 [ 7976.660675][ C2] tcf_classify+0x283/0x930 [ 7976.660907][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 7976.661161][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 7976.661471][ C2] tc_run+0x2e4/0x5d0 [ 7976.661678][ C2] ? __pfx_tc_run+0x10/0x10 [ 7976.661908][ C2] ? lock_acquire+0x1c1/0x220 [ 7976.662143][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 7976.662403][ C2] __dev_queue_xmit+0x686/0x17e0 [ 7976.662652][ C2] ? lock_acquire+0x1c1/0x220 [ 7976.662889][ C2] ? ip_finish_output2+0x786/0x18e0 [ 7976.663151][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 7976.663453][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 7976.663724][ C2] ? neigh_hh_output+0x348/0x590 [ 7976.663974][ C2] ? ip_finish_output2+0x262/0x18e0 [ 7976.664237][ C2] ip_finish_output2+0x786/0x18e0 [ 7976.664492][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 7976.664828][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 7976.665101][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7976.665352][ C2] ? __ip_finish_output+0x10f/0x770 [ 7976.665615][ C2] ip_output+0x16b/0x4f0 [ 7976.665828][ C2] ? __pfx_ip_output+0x10/0x10 [ 7976.666070][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 7976.666346][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7976.666655][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 7976.666931][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 7976.667180][ C2] ? __alloc_skb+0xd4/0x280 [ 7976.667408][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 7976.667673][ C2] ? tcp_fragment+0x168/0x1040 [ 7976.667916][ C2] ? rcu_read_lock_held+0xe/0x50 [ 7976.668166][ C2] ? ip_local_out+0x114/0x3b0 [ 7976.668403][ C2] __ip_queue_xmit+0x672/0x1910 [ 7976.668650][ C2] ? __skb_clone+0x57a/0x760 [ 7976.668882][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 7976.669148][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 7976.669426][ C2] ? ipv4_dst_check+0xe3/0x170 [ 7976.669668][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 7976.669915][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 7976.670211][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 7976.670528][ C2] ? tcp_fragment+0xb0e/0x1040 [ 7976.670771][ C2] tcp_send_loss_probe+0x348/0x830 [ 7976.671029][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7976.671294][ C2] tcp_write_timer+0x82/0x1d0 [ 7976.671536][ C2] call_timer_fn+0x173/0x430 [ 7976.671771][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 7976.672030][ C2] ? next_expiry_recalc+0xcd/0x220 [ 7976.672290][ C2] __run_timers.part.0+0x52d/0x890 [ 7976.672548][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 7976.672815][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 7976.673099][ C2] ? lock_acquire+0x1c1/0x220 [ 7976.673335][ C2] ? clockevents_program_event+0xf6/0x300 [ 7976.673624][ C2] ? lock_release+0x1d5/0x250 [ 7976.673862][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 7976.674125][ C2] ? ktime_get+0xb3/0x190 [ 7976.674343][ C2] ? clockevents_program_event+0x1ea/0x300 [ 7976.674638][ C2] run_timer_softirq+0x72/0x100 [ 7976.674884][ C2] __do_softirq+0x1b9/0x7ff [ 7976.675114][ C2] irq_exit_rcu+0x98/0xc0 [ 7976.675334][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 7976.675618][ C2] [ 7976.675768][ C2] [ 7976.675917][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 7976.676219][ C2] RIP: 0010:default_idle+0xf/0x20 [ 7976.676473][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 7976.677435][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 7976.677740][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 7976.678136][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 7976.678530][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 7976.678923][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 7976.679322][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 7976.679719][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 7976.680004][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 7976.680265][ C2] default_idle_call+0x69/0xa0 [ 7976.680506][ C2] cpuidle_idle_call+0x1f6/0x280 [ 7976.680755][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 7976.681030][ C2] ? lock_release+0x1d5/0x250 [ 7976.681269][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 7976.681544][ C2] do_idle+0xfb/0x160 [ 7976.681746][ C2] cpu_startup_entry+0x55/0x60 [ 7976.681986][ C2] start_secondary+0x21c/0x2b0 [ 7976.682227][ C2] ? __pfx_start_secondary+0x10/0x10 [ 7976.682496][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 7976.682803][ C2] [ 8001.123113][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8001.123459][ C1] rcu: 1-....: (5632770 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1379190 [ 8001.124004][ C1] rcu: (t=5646236 jiffies g=1882453 q=721 ncpus=4) [ 8001.124327][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8001.124765][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8001.125360][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8001.125674][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8001.126638][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8001.126944][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8001.127345][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8001.127744][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8001.128141][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8001.128543][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8001.128943][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8001.129389][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8001.129722][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8001.130122][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8001.130522][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8001.130921][ C1] PKRU: 55555554 [ 8001.131104][ C1] Call Trace: [ 8001.131272][ C1] [ 8001.131424][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8001.131696][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8001.131949][ C1] ? check_cpu_stall+0x284/0x500 [ 8001.132203][ C1] ? rcu_pending+0x92/0x360 [ 8001.132433][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8001.132705][ C1] ? update_process_times+0xb9/0x110 [ 8001.132975][ C1] ? tick_sched_handle+0x67/0x130 [ 8001.133232][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8001.133517][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8001.133760][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8001.134072][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8001.134344][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8001.134634][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8001.134897][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8001.135202][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8001.135464][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8001.135770][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8001.136068][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8001.136382][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8001.136669][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8001.136960][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8001.137248][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8001.137560][ C1] ? get_stack_info+0x36/0xc0 [ 8001.137801][ C1] ? lock_acquire+0x1c1/0x220 [ 8001.138043][ C1] ? lock_release+0x1d5/0x250 [ 8001.138283][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8001.138530][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8001.138806][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8001.139091][ C1] ? lock_acquire+0x1c1/0x220 [ 8001.139331][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8001.139572][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8001.139832][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8001.140066][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8001.140314][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8001.140572][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8001.140845][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8001.141125][ C1] ip_local_deliver+0x19d/0x480 [ 8001.141371][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8001.141646][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8001.141910][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8001.142256][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8001.142509][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8001.142830][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8001.143096][ C1] ip_rcv+0x564/0x740 [ 8001.143300][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8001.143531][ C1] ? set_track_prepare+0x8a/0xd0 [ 8001.143785][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8001.144061][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8001.144337][ C1] ? skb_clone+0x10b/0x330 [ 8001.144564][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8001.144882][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8001.145189][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8001.145469][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8001.145766][ C1] ? __tcf_classify+0x329/0x7d0 [ 8001.146015][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8001.146245][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8001.146544][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8001.146828][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8001.147154][ C1] ? lock_acquire+0x1c1/0x220 [ 8001.147395][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8001.147693][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8001.147977][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8001.148294][ C1] ? __copy_skb_header+0xaf/0x490 [ 8001.148552][ C1] ? __skb_clone+0x57a/0x760 [ 8001.148787][ C1] netif_receive_skb+0x55/0x280 [ 8001.149036][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8001.149348][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8001.149681][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8001.149979][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8001.150254][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8001.150544][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8001.150857][ C1] ? hlock_class+0x4e/0x130 [ 8001.151087][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8001.151365][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8001.151645][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8001.151908][ C1] ? hlock_class+0x4e/0x130 [ 8001.152140][ C1] ? mark_lock+0x38/0x3e0 [ 8001.152359][ C1] ? stack_access_ok+0xda/0x1f0 [ 8001.152608][ C1] ? __lock_acquire+0xb67/0x1610 [ 8001.152861][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8001.153136][ C1] ? get_stack_info+0x36/0xc0 [ 8001.153376][ C1] ? stack_access_ok+0xda/0x1f0 [ 8001.153624][ C1] ? get_reg+0x119/0x190 [ 8001.153839][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8001.154107][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8001.154416][ C1] __tcf_classify+0x329/0x7d0 [ 8001.154658][ C1] tcf_classify+0x283/0x930 [ 8001.154891][ C1] ? arch_stack_walk+0xa2/0x100 [ 8001.155139][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8001.155396][ C1] ? get_stack_info+0x36/0xc0 [ 8001.155636][ C1] tc_run+0x2e4/0x5d0 [ 8001.155841][ C1] ? __pfx_tc_run+0x10/0x10 [ 8001.156072][ C1] ? lock_acquire+0x1c1/0x220 [ 8001.156312][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8001.156572][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8001.156826][ C1] ? lock_acquire+0x1c1/0x220 [ 8001.157065][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8001.157330][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8001.157634][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8001.157907][ C1] ? neigh_hh_output+0x348/0x590 [ 8001.158160][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8001.158425][ C1] ip_finish_output2+0x786/0x18e0 [ 8001.158682][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8001.158958][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8001.159294][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8001.159573][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8001.159826][ C1] ? __ip_finish_output+0x10f/0x770 [ 8001.160092][ C1] ip_output+0x16b/0x4f0 [ 8001.160307][ C1] ? run_timer_softirq+0x72/0x100 [ 8001.160563][ C1] ? __pfx_ip_output+0x10/0x10 [ 8001.160806][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8001.161091][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8001.161346][ C1] ? ip_local_out+0x114/0x3b0 [ 8001.161590][ C1] __ip_queue_xmit+0x672/0x1910 [ 8001.161839][ C1] ? __create_object+0x5e/0xb0 [ 8001.162084][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8001.162352][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8001.162632][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8001.162906][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8001.163190][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8001.163462][ C1] tcp_delack_timer+0x84/0x240 [ 8001.163706][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8001.163977][ C1] call_timer_fn+0x173/0x430 [ 8001.164215][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8001.164477][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8001.164738][ C1] __run_timers.part.0+0x52d/0x890 [ 8001.164999][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8001.165272][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8001.165558][ C1] ? lock_acquire+0x1c1/0x220 [ 8001.165796][ C1] ? clockevents_program_event+0xf6/0x300 [ 8001.166087][ C1] ? lock_release+0x1d5/0x250 [ 8001.166327][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8001.166591][ C1] ? ktime_get+0xb3/0x190 [ 8001.166810][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8001.167108][ C1] run_timer_softirq+0x72/0x100 [ 8001.167357][ C1] __do_softirq+0x1b9/0x7ff [ 8001.167588][ C1] irq_exit_rcu+0x98/0xc0 [ 8001.167810][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8001.168094][ C1] [ 8001.168247][ C1] [ 8001.168397][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8001.168702][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8001.169027][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8001.169998][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8001.170306][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8001.170705][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8001.171101][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8001.171503][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8001.171903][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8001.172302][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8001.172599][ C1] pipe_read+0xa16/0xdf0 [ 8001.172818][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8001.173097][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8001.173340][ C1] ? iterate_tty_write+0x299/0x540 [ 8001.173601][ C1] ? lock_release+0x1d5/0x250 [ 8001.173842][ C1] vfs_read+0x911/0xc00 [ 8001.174053][ C1] ? lock_acquire+0x1c1/0x220 [ 8001.174293][ C1] ? __might_fault+0xc6/0x180 [ 8001.174534][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8001.174772][ C1] ? __might_fault+0xc6/0x180 [ 8001.175011][ C1] ? lock_release+0x1d5/0x250 [ 8001.175251][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8001.175515][ C1] ? __fget_light+0x54/0x1e0 [ 8001.175753][ C1] ksys_read+0x17a/0x1e0 [ 8001.175968][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8001.176213][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8001.176518][ C1] do_syscall_64+0xc9/0x1e0 [ 8001.176748][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8001.177050][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8001.177278][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8001.178246][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8001.178666][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8001.179066][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8001.179465][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8001.179863][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8001.180259][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8001.180662][ C1] [ 8001.180819][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8001.181089][ C2] NMI backtrace for cpu 2 [ 8001.181098][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8001.181104][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8001.181108][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8001.181116][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8001.181121][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8001.181126][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8001.181130][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8001.181134][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8001.181137][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8001.181141][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8001.181145][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8001.181150][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8001.181155][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8001.181159][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8001.181162][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8001.181165][ C2] PKRU: 55555554 [ 8001.181167][ C2] Call Trace: [ 8001.181170][ C2] [ 8001.181173][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8001.181184][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8001.181192][ C2] ? nmi_handle+0x153/0x420 [ 8001.181202][ C2] ? default_do_nmi+0x41/0x100 [ 8001.181208][ C2] ? exc_nmi+0xf3/0x120 [ 8001.181214][ C2] ? end_repeat_nmi+0xf/0x60 [ 8001.181225][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8001.181233][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8001.181241][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8001.181250][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8001.181258][ C2] [ 8001.181260][ C2] [ 8001.181263][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8001.181270][ C2] ? get_stack_info+0x36/0xc0 [ 8001.181278][ C2] ? lock_acquire+0x1c1/0x220 [ 8001.181286][ C2] ? lock_release+0x1d5/0x250 [ 8001.181295][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8001.181303][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8001.181310][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8001.181318][ C2] ? lock_acquire+0x1c1/0x220 [ 8001.181324][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8001.181332][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8001.181339][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8001.181355][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8001.181361][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8001.181373][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8001.181382][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8001.181391][ C2] ip_local_deliver+0x19d/0x480 [ 8001.181397][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8001.181402][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8001.181408][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8001.181421][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8001.181424][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8001.181427][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8001.181436][ C2] ip_rcv+0x564/0x740 [ 8001.181438][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8001.181441][ C2] ? set_track_prepare+0x8a/0xd0 [ 8001.181444][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8001.181448][ C2] ? start_secondary+0x21c/0x2b0 [ 8001.181451][ C2] ? skb_clone+0x10b/0x330 [ 8001.181453][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8001.181459][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8001.181464][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8001.181468][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8001.181476][ C2] ? __tcf_classify+0x329/0x7d0 [ 8001.181479][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8001.181482][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8001.181485][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8001.181488][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8001.181492][ C2] ? lock_acquire+0x1c1/0x220 [ 8001.181495][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8001.181499][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8001.181502][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8001.181506][ C2] ? __copy_skb_header+0xaf/0x490 [ 8001.181510][ C2] ? __skb_clone+0x57a/0x760 [ 8001.181512][ C2] netif_receive_skb+0x55/0x280 [ 8001.181516][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8001.181522][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8001.181529][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8001.181535][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8001.181540][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8001.181550][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8001.181557][ C2] ? get_stack_info+0x36/0xc0 [ 8001.181561][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8001.181564][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8001.181567][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8001.181569][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8001.181573][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8001.181575][ C2] ? kernel_text_address+0x17/0xe0 [ 8001.181578][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8001.181582][ C2] ? arch_stack_walk+0x8c/0x100 [ 8001.181585][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8001.181588][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8001.181592][ C2] ? lock_acquire+0x1c1/0x220 [ 8001.181594][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8001.181598][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8001.181602][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8001.181604][ C2] ? get_stack_info+0x36/0xc0 [ 8001.181608][ C2] __tcf_classify+0x329/0x7d0 [ 8001.181613][ C2] tcf_classify+0x283/0x930 [ 8001.181617][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8001.181620][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8001.181625][ C2] tc_run+0x2e4/0x5d0 [ 8001.181628][ C2] ? __pfx_tc_run+0x10/0x10 [ 8001.181631][ C2] ? lock_acquire+0x1c1/0x220 [ 8001.181633][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8001.181637][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8001.181641][ C2] ? lock_acquire+0x1c1/0x220 [ 8001.181643][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8001.181646][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8001.181649][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8001.181652][ C2] ? neigh_hh_output+0x348/0x590 [ 8001.181655][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8001.181659][ C2] ip_finish_output2+0x786/0x18e0 [ 8001.181662][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8001.181670][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8001.181672][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8001.181676][ C2] ? __ip_finish_output+0x10f/0x770 [ 8001.181680][ C2] ip_output+0x16b/0x4f0 [ 8001.181683][ C2] ? __pfx_ip_output+0x10/0x10 [ 8001.181685][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8001.181688][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8001.181691][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8001.181693][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8001.181696][ C2] ? __alloc_skb+0xd4/0x280 [ 8001.181698][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8001.181702][ C2] ? tcp_fragment+0x168/0x1040 [ 8001.181705][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8001.181707][ C2] ? ip_local_out+0x114/0x3b0 [ 8001.181711][ C2] __ip_queue_xmit+0x672/0x1910 [ 8001.181714][ C2] ? __skb_clone+0x57a/0x760 [ 8001.181717][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8001.181722][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8001.181725][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8001.181729][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8001.181733][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8001.181736][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8001.181739][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8001.181743][ C2] tcp_send_loss_probe+0x348/0x830 [ 8001.181746][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8001.181748][ C2] tcp_write_timer+0x82/0x1d0 [ 8001.181752][ C2] call_timer_fn+0x173/0x430 [ 8001.181755][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8001.181760][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8001.181764][ C2] __run_timers.part.0+0x52d/0x890 [ 8001.181766][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8001.181771][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8001.181774][ C2] ? lock_acquire+0x1c1/0x220 [ 8001.181776][ C2] ? clockevents_program_event+0xf6/0x300 [ 8001.181780][ C2] ? lock_release+0x1d5/0x250 [ 8001.181782][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8001.181785][ C2] ? ktime_get+0xb3/0x190 [ 8001.181789][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8001.181793][ C2] run_timer_softirq+0x72/0x100 [ 8001.181797][ C2] __do_softirq+0x1b9/0x7ff [ 8001.181801][ C2] irq_exit_rcu+0x98/0xc0 [ 8001.181803][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8001.181806][ C2] [ 8001.181807][ C2] [ 8001.181808][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8001.181812][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8001.181815][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8001.181817][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8001.181818][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8001.181820][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8001.181821][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8001.181823][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8001.181824][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8001.181827][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8001.181830][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8001.181833][ C2] default_idle_call+0x69/0xa0 [ 8001.181836][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8001.181838][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8001.181841][ C2] ? lock_release+0x1d5/0x250 [ 8001.181844][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8001.181847][ C2] do_idle+0xfb/0x160 [ 8001.181850][ C2] cpu_startup_entry+0x55/0x60 [ 8001.181852][ C2] start_secondary+0x21c/0x2b0 [ 8001.181855][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8001.181859][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8001.181864][ C2] [ 8028.569269][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5286s! [perl:4135] [ 8028.569676][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8028.570894][ C1] irq event stamp: 209232 [ 8028.571105][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8028.571646][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8028.572123][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8028.572597][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8028.573044][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8028.573480][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8028.574078][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8028.574395][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8028.575339][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8028.575637][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8028.576025][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8028.576414][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8028.576803][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8028.577190][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8028.577577][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8028.578012][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8028.578335][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8028.578728][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8028.579116][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8028.579502][ C1] PKRU: 55555554 [ 8028.579679][ C1] Call Trace: [ 8028.579845][ C1] [ 8028.579988][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8028.580242][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8028.580480][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8028.580749][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8028.581017][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8028.581300][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8028.581578][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8028.581884][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8028.582146][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8028.582455][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8028.582753][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8028.583058][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8028.583341][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8028.583627][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8028.583909][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8028.584213][ C1] ? get_stack_info+0x36/0xc0 [ 8028.584447][ C1] ? lock_acquire+0x1c1/0x220 [ 8028.584680][ C1] ? lock_release+0x1d5/0x250 [ 8028.584914][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8028.585157][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8028.585421][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8028.585700][ C1] ? lock_acquire+0x1c1/0x220 [ 8028.585931][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8028.586166][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8028.586419][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8028.586648][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8028.586889][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8028.587139][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8028.587408][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8028.587678][ C1] ip_local_deliver+0x19d/0x480 [ 8028.587920][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8028.588188][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8028.588448][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8028.588788][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8028.589035][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8028.589350][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8028.589606][ C1] ip_rcv+0x564/0x740 [ 8028.589806][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8028.590033][ C1] ? set_track_prepare+0x8a/0xd0 [ 8028.590280][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8028.590550][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8028.590816][ C1] ? skb_clone+0x10b/0x330 [ 8028.591038][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8028.591372][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8028.591677][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8028.591962][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8028.592257][ C1] ? __tcf_classify+0x329/0x7d0 [ 8028.592507][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8028.592739][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8028.593039][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8028.593334][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8028.593652][ C1] ? lock_acquire+0x1c1/0x220 [ 8028.593887][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8028.594176][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8028.594456][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8028.594766][ C1] ? __copy_skb_header+0xaf/0x490 [ 8028.595018][ C1] ? __skb_clone+0x57a/0x760 [ 8028.595246][ C1] netif_receive_skb+0x55/0x280 [ 8028.595489][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8028.595796][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8028.596121][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8028.596414][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8028.596682][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8028.596986][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8028.597300][ C1] ? hlock_class+0x4e/0x130 [ 8028.597535][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8028.597812][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8028.598089][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8028.598356][ C1] ? hlock_class+0x4e/0x130 [ 8028.598586][ C1] ? mark_lock+0x38/0x3e0 [ 8028.598809][ C1] ? stack_access_ok+0xda/0x1f0 [ 8028.599059][ C1] ? __lock_acquire+0xb67/0x1610 [ 8028.599314][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8028.599591][ C1] ? get_stack_info+0x36/0xc0 [ 8028.599832][ C1] ? stack_access_ok+0xda/0x1f0 [ 8028.600079][ C1] ? get_reg+0x119/0x190 [ 8028.600298][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8028.600567][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8028.600878][ C1] __tcf_classify+0x329/0x7d0 [ 8028.601121][ C1] tcf_classify+0x283/0x930 [ 8028.601356][ C1] ? arch_stack_walk+0xa2/0x100 [ 8028.601606][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8028.601864][ C1] ? get_stack_info+0x36/0xc0 [ 8028.602106][ C1] tc_run+0x2e4/0x5d0 [ 8028.602312][ C1] ? __pfx_tc_run+0x10/0x10 [ 8028.602544][ C1] ? lock_acquire+0x1c1/0x220 [ 8028.602782][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8028.603046][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8028.603299][ C1] ? lock_acquire+0x1c1/0x220 [ 8028.603539][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8028.603805][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8028.604112][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8028.604385][ C1] ? neigh_hh_output+0x348/0x590 [ 8028.604640][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8028.604906][ C1] ip_finish_output2+0x786/0x18e0 [ 8028.605163][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8028.605444][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8028.605783][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8028.606060][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8028.606315][ C1] ? __ip_finish_output+0x10f/0x770 [ 8028.606580][ C1] ip_output+0x16b/0x4f0 [ 8028.606798][ C1] ? run_timer_softirq+0x72/0x100 [ 8028.607058][ C1] ? __pfx_ip_output+0x10/0x10 [ 8028.607301][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8028.607592][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8028.607845][ C1] ? ip_local_out+0x114/0x3b0 [ 8028.608087][ C1] __ip_queue_xmit+0x672/0x1910 [ 8028.608335][ C1] ? __create_object+0x5e/0xb0 [ 8028.608580][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8028.608846][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8028.609130][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8028.609403][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8028.609685][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8028.609960][ C1] tcp_delack_timer+0x84/0x240 [ 8028.610203][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8028.610479][ C1] call_timer_fn+0x173/0x430 [ 8028.610713][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8028.610976][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8028.611240][ C1] __run_timers.part.0+0x52d/0x890 [ 8028.611504][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8028.611780][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8028.612065][ C1] ? lock_acquire+0x1c1/0x220 [ 8028.612305][ C1] ? clockevents_program_event+0xf6/0x300 [ 8028.612596][ C1] ? lock_release+0x1d5/0x250 [ 8028.612837][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8028.613101][ C1] ? ktime_get+0xb3/0x190 [ 8028.613325][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8028.613621][ C1] run_timer_softirq+0x72/0x100 [ 8028.613870][ C1] __do_softirq+0x1b9/0x7ff [ 8028.614104][ C1] irq_exit_rcu+0x98/0xc0 [ 8028.614323][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8028.614611][ C1] [ 8028.614761][ C1] [ 8028.614912][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8028.615218][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8028.615543][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8028.616519][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8028.616827][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8028.617228][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8028.617629][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8028.618028][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8028.618427][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8028.618830][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8028.619128][ C1] pipe_read+0xa16/0xdf0 [ 8028.619349][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8028.619629][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8028.619874][ C1] ? iterate_tty_write+0x299/0x540 [ 8028.620135][ C1] ? lock_release+0x1d5/0x250 [ 8028.620376][ C1] vfs_read+0x911/0xc00 [ 8028.620592][ C1] ? lock_acquire+0x1c1/0x220 [ 8028.620831][ C1] ? __might_fault+0xc6/0x180 [ 8028.621072][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8028.621316][ C1] ? __might_fault+0xc6/0x180 [ 8028.621558][ C1] ? lock_release+0x1d5/0x250 [ 8028.621798][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8028.622069][ C1] ? __fget_light+0x54/0x1e0 [ 8028.622304][ C1] ksys_read+0x17a/0x1e0 [ 8028.622524][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8028.622768][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8028.623076][ C1] do_syscall_64+0xc9/0x1e0 [ 8028.623311][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8028.623612][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8028.623840][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8028.624814][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8028.625239][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8028.625640][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8028.626040][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8028.626442][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8028.626842][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8028.627246][ C1] [ 8028.627404][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5286s! [swapper/2:0] [ 8028.627811][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8028.629052][ C2] irq event stamp: 44114564 [ 8028.629278][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8028.629813][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8028.630323][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8028.630796][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8028.631262][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8028.631718][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8028.632324][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8028.632649][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8028.633611][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8028.633917][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8028.634311][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8028.634709][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8028.635107][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8028.635502][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8028.635897][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8028.636341][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8028.636673][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8028.637072][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8028.637470][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8028.637866][ C2] PKRU: 55555554 [ 8028.638046][ C2] Call Trace: [ 8028.638216][ C2] [ 8028.638362][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8028.638622][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8028.638865][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8028.639140][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8028.639413][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8028.639698][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8028.639960][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8028.640265][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8028.640523][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8028.640783][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8028.641090][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8028.641388][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8028.641701][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8028.641987][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8028.642282][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8028.642567][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8028.642877][ C2] ? get_stack_info+0x36/0xc0 [ 8028.643117][ C2] ? lock_acquire+0x1c1/0x220 [ 8028.643356][ C2] ? lock_release+0x1d5/0x250 [ 8028.643592][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8028.643840][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8028.644111][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8028.644397][ C2] ? lock_acquire+0x1c1/0x220 [ 8028.644635][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8028.644871][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8028.645131][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8028.645364][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8028.645610][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8028.645866][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8028.646137][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8028.646414][ C2] ip_local_deliver+0x19d/0x480 [ 8028.646658][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8028.646931][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8028.647194][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8028.647537][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8028.647787][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8028.648104][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8028.648364][ C2] ip_rcv+0x564/0x740 [ 8028.648566][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8028.648797][ C2] ? set_track_prepare+0x8a/0xd0 [ 8028.649048][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8028.649323][ C2] ? start_secondary+0x21c/0x2b0 [ 8028.649572][ C2] ? skb_clone+0x10b/0x330 [ 8028.649798][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8028.650115][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8028.650417][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8028.650699][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8028.650990][ C2] ? __tcf_classify+0x329/0x7d0 [ 8028.651237][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8028.651470][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8028.651766][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8028.652051][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8028.652376][ C2] ? lock_acquire+0x1c1/0x220 [ 8028.652614][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8028.652907][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8028.653191][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8028.653506][ C2] ? __copy_skb_header+0xaf/0x490 [ 8028.653762][ C2] ? __skb_clone+0x57a/0x760 [ 8028.653994][ C2] netif_receive_skb+0x55/0x280 [ 8028.654241][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8028.654552][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8028.654881][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8028.655179][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8028.655451][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8028.655735][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8028.656047][ C2] ? get_stack_info+0x36/0xc0 [ 8028.656288][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8028.656549][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8028.656864][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8028.657138][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8028.657416][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8028.657729][ C2] ? kernel_text_address+0x17/0xe0 [ 8028.657988][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8028.658299][ C2] ? arch_stack_walk+0x8c/0x100 [ 8028.658544][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8028.658809][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8028.659093][ C2] ? lock_acquire+0x1c1/0x220 [ 8028.659331][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8028.659611][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8028.659915][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8028.660188][ C2] ? get_stack_info+0x36/0xc0 [ 8028.660429][ C2] __tcf_classify+0x329/0x7d0 [ 8028.660669][ C2] tcf_classify+0x283/0x930 [ 8028.660899][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8028.661153][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8028.661469][ C2] tc_run+0x2e4/0x5d0 [ 8028.661671][ C2] ? __pfx_tc_run+0x10/0x10 [ 8028.661903][ C2] ? lock_acquire+0x1c1/0x220 [ 8028.662142][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8028.662402][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8028.662654][ C2] ? lock_acquire+0x1c1/0x220 [ 8028.662890][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8028.663154][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8028.663454][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8028.663726][ C2] ? neigh_hh_output+0x348/0x590 [ 8028.663977][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8028.664241][ C2] ip_finish_output2+0x786/0x18e0 [ 8028.664496][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8028.664831][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8028.665105][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8028.665356][ C2] ? __ip_finish_output+0x10f/0x770 [ 8028.665620][ C2] ip_output+0x16b/0x4f0 [ 8028.665836][ C2] ? __pfx_ip_output+0x10/0x10 [ 8028.666079][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8028.666355][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8028.666665][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8028.666940][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8028.667190][ C2] ? __alloc_skb+0xd4/0x280 [ 8028.667419][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8028.667688][ C2] ? tcp_fragment+0x168/0x1040 [ 8028.667930][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8028.668180][ C2] ? ip_local_out+0x114/0x3b0 [ 8028.668421][ C2] __ip_queue_xmit+0x672/0x1910 [ 8028.668668][ C2] ? __skb_clone+0x57a/0x760 [ 8028.668903][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8028.669169][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8028.669447][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8028.669690][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8028.669938][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8028.670238][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8028.670556][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8028.670797][ C2] tcp_send_loss_probe+0x348/0x830 [ 8028.671057][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8028.671330][ C2] tcp_write_timer+0x82/0x1d0 [ 8028.671566][ C2] call_timer_fn+0x173/0x430 [ 8028.671803][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8028.672063][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8028.672323][ C2] __run_timers.part.0+0x52d/0x890 [ 8028.672581][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8028.672850][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8028.673135][ C2] ? lock_acquire+0x1c1/0x220 [ 8028.673373][ C2] ? clockevents_program_event+0xf6/0x300 [ 8028.673659][ C2] ? lock_release+0x1d5/0x250 [ 8028.673897][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8028.674160][ C2] ? ktime_get+0xb3/0x190 [ 8028.674379][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8028.674674][ C2] run_timer_softirq+0x72/0x100 [ 8028.674922][ C2] __do_softirq+0x1b9/0x7ff [ 8028.675154][ C2] irq_exit_rcu+0x98/0xc0 [ 8028.675372][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8028.675657][ C2] [ 8028.675808][ C2] [ 8028.675956][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8028.676258][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8028.676513][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8028.677477][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8028.677782][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8028.678177][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8028.678571][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8028.678970][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8028.679366][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8028.679763][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8028.680051][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8028.680310][ C2] default_idle_call+0x69/0xa0 [ 8028.680552][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8028.680803][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8028.681080][ C2] ? lock_release+0x1d5/0x250 [ 8028.681321][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8028.681594][ C2] do_idle+0xfb/0x160 [ 8028.681795][ C2] cpu_startup_entry+0x55/0x60 [ 8028.682037][ C2] start_secondary+0x21c/0x2b0 [ 8028.682279][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8028.682547][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8028.682854][ C2] [ 8056.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5312s! [perl:4135] [ 8056.569688][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8056.570914][ C1] irq event stamp: 209232 [ 8056.571129][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8056.571679][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8056.572154][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8056.572630][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8056.573077][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8056.573516][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8056.574111][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8056.574429][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8056.575376][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8056.575674][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8056.576064][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8056.576454][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8056.576842][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8056.577232][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8056.577622][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8056.578057][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8056.578382][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8056.578771][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8056.579160][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8056.579551][ C1] PKRU: 55555554 [ 8056.579728][ C1] Call Trace: [ 8056.579892][ C1] [ 8056.580038][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8056.580296][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8056.580532][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8056.580803][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8056.581068][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8056.581374][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8056.581639][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8056.581949][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8056.582213][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8056.582528][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8056.582817][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8056.583123][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8056.583404][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8056.583693][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8056.583975][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8056.584279][ C1] ? get_stack_info+0x36/0xc0 [ 8056.584515][ C1] ? lock_acquire+0x1c1/0x220 [ 8056.584749][ C1] ? lock_release+0x1d5/0x250 [ 8056.584984][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8056.585226][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8056.585493][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8056.585769][ C1] ? lock_acquire+0x1c1/0x220 [ 8056.586002][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8056.586239][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8056.586492][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8056.586719][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8056.586960][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8056.587212][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8056.587483][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8056.587754][ C1] ip_local_deliver+0x19d/0x480 [ 8056.587996][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8056.588261][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8056.588518][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8056.588856][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8056.589102][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8056.589416][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8056.589672][ C1] ip_rcv+0x564/0x740 [ 8056.589872][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8056.590097][ C1] ? set_track_prepare+0x8a/0xd0 [ 8056.590346][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8056.590615][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8056.590883][ C1] ? skb_clone+0x10b/0x330 [ 8056.591103][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8056.591441][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8056.591749][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8056.592030][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8056.592329][ C1] ? __tcf_classify+0x329/0x7d0 [ 8056.592584][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8056.592806][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8056.593100][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8056.593377][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8056.593696][ C1] ? lock_acquire+0x1c1/0x220 [ 8056.593932][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8056.594223][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8056.594501][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8056.594809][ C1] ? __copy_skb_header+0xaf/0x490 [ 8056.595060][ C1] ? __skb_clone+0x57a/0x760 [ 8056.595292][ C1] netif_receive_skb+0x55/0x280 [ 8056.595535][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8056.595840][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8056.596164][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8056.596455][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8056.596724][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8056.597006][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8056.597312][ C1] ? hlock_class+0x4e/0x130 [ 8056.597538][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8056.597810][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8056.598078][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8056.598338][ C1] ? hlock_class+0x4e/0x130 [ 8056.598564][ C1] ? mark_lock+0x38/0x3e0 [ 8056.598777][ C1] ? stack_access_ok+0xda/0x1f0 [ 8056.599019][ C1] ? __lock_acquire+0xb67/0x1610 [ 8056.599268][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8056.599538][ C1] ? get_stack_info+0x36/0xc0 [ 8056.599773][ C1] ? stack_access_ok+0xda/0x1f0 [ 8056.600014][ C1] ? get_reg+0x119/0x190 [ 8056.600225][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8056.600488][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8056.600788][ C1] __tcf_classify+0x329/0x7d0 [ 8056.601025][ C1] tcf_classify+0x283/0x930 [ 8056.601255][ C1] ? arch_stack_walk+0xa2/0x100 [ 8056.601498][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8056.601748][ C1] ? get_stack_info+0x36/0xc0 [ 8056.601981][ C1] tc_run+0x2e4/0x5d0 [ 8056.602183][ C1] ? __pfx_tc_run+0x10/0x10 [ 8056.602409][ C1] ? lock_acquire+0x1c1/0x220 [ 8056.602642][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8056.602896][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8056.603144][ C1] ? lock_acquire+0x1c1/0x220 [ 8056.603378][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8056.603636][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8056.603933][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8056.604200][ C1] ? neigh_hh_output+0x348/0x590 [ 8056.604447][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8056.604705][ C1] ip_finish_output2+0x786/0x18e0 [ 8056.604954][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8056.605225][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8056.605553][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8056.605824][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8056.606070][ C1] ? __ip_finish_output+0x10f/0x770 [ 8056.606330][ C1] ip_output+0x16b/0x4f0 [ 8056.606540][ C1] ? run_timer_softirq+0x72/0x100 [ 8056.606789][ C1] ? __pfx_ip_output+0x10/0x10 [ 8056.607027][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8056.607316][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8056.607560][ C1] ? ip_local_out+0x114/0x3b0 [ 8056.607795][ C1] __ip_queue_xmit+0x672/0x1910 [ 8056.608039][ C1] ? __create_object+0x5e/0xb0 [ 8056.608281][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8056.608541][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8056.608815][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8056.609079][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8056.609356][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8056.609621][ C1] tcp_delack_timer+0x84/0x240 [ 8056.609858][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8056.610123][ C1] call_timer_fn+0x173/0x430 [ 8056.610358][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8056.610612][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8056.610866][ C1] __run_timers.part.0+0x52d/0x890 [ 8056.611120][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8056.611412][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8056.611699][ C1] ? lock_acquire+0x1c1/0x220 [ 8056.611937][ C1] ? clockevents_program_event+0xf6/0x300 [ 8056.612229][ C1] ? lock_release+0x1d5/0x250 [ 8056.612477][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8056.612733][ C1] ? ktime_get+0xb3/0x190 [ 8056.612947][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8056.613239][ C1] run_timer_softirq+0x72/0x100 [ 8056.613482][ C1] __do_softirq+0x1b9/0x7ff [ 8056.613706][ C1] irq_exit_rcu+0x98/0xc0 [ 8056.613923][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8056.614202][ C1] [ 8056.614351][ C1] [ 8056.614497][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8056.614797][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8056.615114][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8056.616058][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8056.616361][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8056.616749][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8056.617139][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8056.617530][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8056.617918][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8056.618310][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8056.618600][ C1] pipe_read+0xa16/0xdf0 [ 8056.618814][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8056.619084][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8056.619323][ C1] ? iterate_tty_write+0x299/0x540 [ 8056.619577][ C1] ? lock_release+0x1d5/0x250 [ 8056.619812][ C1] vfs_read+0x911/0xc00 [ 8056.620019][ C1] ? lock_acquire+0x1c1/0x220 [ 8056.620255][ C1] ? __might_fault+0xc6/0x180 [ 8056.620491][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8056.620723][ C1] ? __might_fault+0xc6/0x180 [ 8056.620956][ C1] ? lock_release+0x1d5/0x250 [ 8056.621195][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8056.621454][ C1] ? __fget_light+0x54/0x1e0 [ 8056.621686][ C1] ksys_read+0x17a/0x1e0 [ 8056.621897][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8056.622136][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8056.622434][ C1] do_syscall_64+0xc9/0x1e0 [ 8056.622658][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8056.622951][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8056.623175][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8056.624122][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8056.624531][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8056.624921][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8056.625312][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8056.625702][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8056.626089][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8056.626484][ C1] [ 8056.626636][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5312s! [swapper/2:0] [ 8056.627038][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8056.628251][ C2] irq event stamp: 44114564 [ 8056.628470][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8056.628991][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8056.629488][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8056.629947][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8056.630400][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8056.630842][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8056.631463][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8056.631784][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8056.632749][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8056.633045][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8056.633431][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8056.633820][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8056.634208][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8056.634594][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8056.634978][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8056.635410][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8056.635732][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8056.636120][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8056.636506][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8056.636890][ C2] PKRU: 55555554 [ 8056.637066][ C2] Call Trace: [ 8056.637232][ C2] [ 8056.637374][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8056.637629][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8056.637864][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8056.638132][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8056.638398][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8056.638676][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8056.638931][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8056.639228][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8056.639480][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8056.639734][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8056.640032][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8056.640321][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8056.640624][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8056.640904][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8056.641195][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8056.641474][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8056.641775][ C2] ? get_stack_info+0x36/0xc0 [ 8056.642008][ C2] ? lock_acquire+0x1c1/0x220 [ 8056.642241][ C2] ? lock_release+0x1d5/0x250 [ 8056.642471][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8056.642712][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8056.642978][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8056.643256][ C2] ? lock_acquire+0x1c1/0x220 [ 8056.643487][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8056.643719][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8056.643971][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8056.644198][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8056.644438][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8056.644687][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8056.644952][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8056.645222][ C2] ip_local_deliver+0x19d/0x480 [ 8056.645460][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8056.645725][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8056.645980][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8056.646316][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8056.646563][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8056.646872][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8056.647126][ C2] ip_rcv+0x564/0x740 [ 8056.647323][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8056.647548][ C2] ? set_track_prepare+0x8a/0xd0 [ 8056.647793][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8056.648061][ C2] ? start_secondary+0x21c/0x2b0 [ 8056.648305][ C2] ? skb_clone+0x10b/0x330 [ 8056.648525][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8056.648834][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8056.649128][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8056.649404][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8056.649687][ C2] ? __tcf_classify+0x329/0x7d0 [ 8056.649928][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8056.650151][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8056.650441][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8056.650719][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8056.651034][ C2] ? lock_acquire+0x1c1/0x220 [ 8056.651288][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8056.651581][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8056.651866][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8056.652180][ C2] ? __copy_skb_header+0xaf/0x490 [ 8056.652445][ C2] ? __skb_clone+0x57a/0x760 [ 8056.652671][ C2] netif_receive_skb+0x55/0x280 [ 8056.652910][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8056.653214][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8056.653535][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8056.653824][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8056.654088][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8056.654367][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8056.654670][ C2] ? get_stack_info+0x36/0xc0 [ 8056.654904][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8056.655159][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8056.655465][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8056.655731][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8056.656000][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8056.656306][ C2] ? kernel_text_address+0x17/0xe0 [ 8056.656558][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8056.656859][ C2] ? arch_stack_walk+0x8c/0x100 [ 8056.657098][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8056.657357][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8056.657633][ C2] ? lock_acquire+0x1c1/0x220 [ 8056.657864][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8056.658136][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8056.658432][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8056.658698][ C2] ? get_stack_info+0x36/0xc0 [ 8056.658932][ C2] __tcf_classify+0x329/0x7d0 [ 8056.659166][ C2] tcf_classify+0x283/0x930 [ 8056.659391][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8056.659641][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8056.659944][ C2] tc_run+0x2e4/0x5d0 [ 8056.660141][ C2] ? __pfx_tc_run+0x10/0x10 [ 8056.660367][ C2] ? lock_acquire+0x1c1/0x220 [ 8056.660598][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8056.660850][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8056.661094][ C2] ? lock_acquire+0x1c1/0x220 [ 8056.661329][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8056.661585][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8056.661877][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8056.662144][ C2] ? neigh_hh_output+0x348/0x590 [ 8056.662388][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8056.662647][ C2] ip_finish_output2+0x786/0x18e0 [ 8056.662895][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8056.663221][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8056.663487][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8056.663731][ C2] ? __ip_finish_output+0x10f/0x770 [ 8056.663985][ C2] ip_output+0x16b/0x4f0 [ 8056.664197][ C2] ? __pfx_ip_output+0x10/0x10 [ 8056.664430][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8056.664699][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8056.665000][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8056.665268][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8056.665511][ C2] ? __alloc_skb+0xd4/0x280 [ 8056.665732][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8056.665993][ C2] ? tcp_fragment+0x168/0x1040 [ 8056.666228][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8056.666477][ C2] ? ip_local_out+0x114/0x3b0 [ 8056.666710][ C2] __ip_queue_xmit+0x672/0x1910 [ 8056.666949][ C2] ? __skb_clone+0x57a/0x760 [ 8056.667182][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8056.667440][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8056.667710][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8056.667947][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8056.668189][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8056.668480][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8056.668789][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8056.669023][ C2] tcp_send_loss_probe+0x348/0x830 [ 8056.669276][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8056.669540][ C2] tcp_write_timer+0x82/0x1d0 [ 8056.669770][ C2] call_timer_fn+0x173/0x430 [ 8056.669999][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8056.670254][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8056.670506][ C2] __run_timers.part.0+0x52d/0x890 [ 8056.670756][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8056.671017][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8056.671318][ C2] ? lock_acquire+0x1c1/0x220 [ 8056.671554][ C2] ? clockevents_program_event+0xf6/0x300 [ 8056.671841][ C2] ? lock_release+0x1d5/0x250 [ 8056.672079][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8056.672346][ C2] ? ktime_get+0xb3/0x190 [ 8056.672572][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8056.672857][ C2] run_timer_softirq+0x72/0x100 [ 8056.673098][ C2] __do_softirq+0x1b9/0x7ff [ 8056.673325][ C2] irq_exit_rcu+0x98/0xc0 [ 8056.673538][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8056.673814][ C2] [ 8056.673959][ C2] [ 8056.674104][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8056.674400][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8056.674647][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8056.675583][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8056.675881][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8056.676266][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8056.676650][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8056.677038][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8056.677425][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8056.677811][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8056.678091][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8056.678343][ C2] default_idle_call+0x69/0xa0 [ 8056.678578][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8056.678820][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8056.679089][ C2] ? lock_release+0x1d5/0x250 [ 8056.679321][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8056.679586][ C2] do_idle+0xfb/0x160 [ 8056.679783][ C2] cpu_startup_entry+0x55/0x60 [ 8056.680018][ C2] start_secondary+0x21c/0x2b0 [ 8056.680257][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8056.680518][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8056.680818][ C2] [ 8079.182103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8079.182453][ C1] rcu: 1-....: (5710659 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1397346 [ 8079.182999][ C1] rcu: (t=5724295 jiffies g=1882453 q=721 ncpus=4) [ 8079.183324][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8079.183759][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8079.184360][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8079.184677][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8079.185622][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8079.185922][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8079.186311][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8079.186699][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8079.187088][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8079.187477][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8079.187866][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8079.188303][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8079.188625][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8079.189016][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8079.189405][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8079.189793][ C1] PKRU: 55555554 [ 8079.189970][ C1] Call Trace: [ 8079.190136][ C1] [ 8079.190279][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8079.190544][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8079.190788][ C1] ? check_cpu_stall+0x284/0x500 [ 8079.191033][ C1] ? rcu_pending+0x92/0x360 [ 8079.191262][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8079.191525][ C1] ? update_process_times+0xb9/0x110 [ 8079.191787][ C1] ? tick_sched_handle+0x67/0x130 [ 8079.192036][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8079.192315][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8079.192550][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8079.192855][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8079.193120][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8079.193403][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8079.193660][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8079.193958][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8079.194213][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8079.194514][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8079.194800][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8079.195106][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8079.195389][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8079.195675][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8079.195961][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8079.196265][ C1] ? get_stack_info+0x36/0xc0 [ 8079.196498][ C1] ? lock_acquire+0x1c1/0x220 [ 8079.196731][ C1] ? lock_release+0x1d5/0x250 [ 8079.196965][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8079.197207][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8079.197472][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8079.197750][ C1] ? lock_acquire+0x1c1/0x220 [ 8079.197981][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8079.198216][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8079.198469][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8079.198699][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8079.198939][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8079.199190][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8079.199459][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8079.199728][ C1] ip_local_deliver+0x19d/0x480 [ 8079.199969][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8079.200235][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8079.200491][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8079.200831][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8079.201080][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8079.201418][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8079.201680][ C1] ip_rcv+0x564/0x740 [ 8079.201884][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8079.202113][ C1] ? set_track_prepare+0x8a/0xd0 [ 8079.202376][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8079.202646][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8079.202910][ C1] ? skb_clone+0x10b/0x330 [ 8079.203131][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8079.203441][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8079.203737][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8079.204012][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8079.204299][ C1] ? __tcf_classify+0x329/0x7d0 [ 8079.204541][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8079.204766][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8079.205055][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8079.205334][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8079.205650][ C1] ? lock_acquire+0x1c1/0x220 [ 8079.205882][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8079.206170][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8079.206449][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8079.206756][ C1] ? __copy_skb_header+0xaf/0x490 [ 8079.207006][ C1] ? __skb_clone+0x57a/0x760 [ 8079.207234][ C1] netif_receive_skb+0x55/0x280 [ 8079.207475][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8079.207780][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8079.208103][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8079.208394][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8079.208661][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8079.208940][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8079.209245][ C1] ? hlock_class+0x4e/0x130 [ 8079.209472][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8079.209741][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8079.210007][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8079.210266][ C1] ? hlock_class+0x4e/0x130 [ 8079.210491][ C1] ? mark_lock+0x38/0x3e0 [ 8079.210706][ C1] ? stack_access_ok+0xda/0x1f0 [ 8079.210946][ C1] ? __lock_acquire+0xb67/0x1610 [ 8079.211216][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8079.211495][ C1] ? get_stack_info+0x36/0xc0 [ 8079.211734][ C1] ? stack_access_ok+0xda/0x1f0 [ 8079.211979][ C1] ? get_reg+0x119/0x190 [ 8079.212197][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8079.212472][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8079.212773][ C1] __tcf_classify+0x329/0x7d0 [ 8079.213007][ C1] tcf_classify+0x283/0x930 [ 8079.213233][ C1] ? arch_stack_walk+0xa2/0x100 [ 8079.213475][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8079.213728][ C1] ? get_stack_info+0x36/0xc0 [ 8079.213964][ C1] tc_run+0x2e4/0x5d0 [ 8079.214163][ C1] ? __pfx_tc_run+0x10/0x10 [ 8079.214388][ C1] ? lock_acquire+0x1c1/0x220 [ 8079.214620][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8079.214873][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8079.215119][ C1] ? lock_acquire+0x1c1/0x220 [ 8079.215361][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8079.215617][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8079.215914][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8079.216179][ C1] ? neigh_hh_output+0x348/0x590 [ 8079.216425][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8079.216683][ C1] ip_finish_output2+0x786/0x18e0 [ 8079.216931][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8079.217207][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8079.217537][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8079.217804][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8079.218051][ C1] ? __ip_finish_output+0x10f/0x770 [ 8079.218310][ C1] ip_output+0x16b/0x4f0 [ 8079.218520][ C1] ? run_timer_softirq+0x72/0x100 [ 8079.218769][ C1] ? __pfx_ip_output+0x10/0x10 [ 8079.219006][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8079.219286][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8079.219531][ C1] ? ip_local_out+0x114/0x3b0 [ 8079.219762][ C1] __ip_queue_xmit+0x672/0x1910 [ 8079.220005][ C1] ? __create_object+0x5e/0xb0 [ 8079.220243][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8079.220503][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8079.220778][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8079.221043][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8079.221345][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8079.221618][ C1] tcp_delack_timer+0x84/0x240 [ 8079.221861][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8079.222135][ C1] call_timer_fn+0x173/0x430 [ 8079.222378][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8079.222631][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8079.222885][ C1] __run_timers.part.0+0x52d/0x890 [ 8079.223139][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8079.223408][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8079.223685][ C1] ? lock_acquire+0x1c1/0x220 [ 8079.223918][ C1] ? clockevents_program_event+0xf6/0x300 [ 8079.224197][ C1] ? lock_release+0x1d5/0x250 [ 8079.224434][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8079.224690][ C1] ? ktime_get+0xb3/0x190 [ 8079.224907][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8079.225195][ C1] run_timer_softirq+0x72/0x100 [ 8079.225437][ C1] __do_softirq+0x1b9/0x7ff [ 8079.225664][ C1] irq_exit_rcu+0x98/0xc0 [ 8079.225877][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8079.226156][ C1] [ 8079.226303][ C1] [ 8079.226450][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8079.226747][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8079.227062][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8079.228005][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8079.228306][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8079.228694][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8079.229084][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8079.229472][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8079.229859][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8079.230250][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8079.230539][ C1] pipe_read+0xa16/0xdf0 [ 8079.230753][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8079.231025][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8079.231287][ C1] ? iterate_tty_write+0x299/0x540 [ 8079.231547][ C1] ? lock_release+0x1d5/0x250 [ 8079.231786][ C1] vfs_read+0x911/0xc00 [ 8079.232002][ C1] ? lock_acquire+0x1c1/0x220 [ 8079.232243][ C1] ? __might_fault+0xc6/0x180 [ 8079.232483][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8079.232731][ C1] ? __might_fault+0xc6/0x180 [ 8079.232964][ C1] ? lock_release+0x1d5/0x250 [ 8079.233197][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8079.233457][ C1] ? __fget_light+0x54/0x1e0 [ 8079.233686][ C1] ksys_read+0x17a/0x1e0 [ 8079.233899][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8079.234136][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8079.234434][ C1] do_syscall_64+0xc9/0x1e0 [ 8079.234660][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8079.234952][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8079.235173][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8079.236120][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8079.236532][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8079.236920][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8079.237307][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8079.237697][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8079.238086][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8079.238479][ C1] [ 8079.238632][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8079.238897][ C2] NMI backtrace for cpu 2 [ 8079.238902][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8079.238907][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8079.238911][ C2] RIP: 0010:kasan_check_range+0x10f/0x1c0 [ 8079.238920][ C2] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [ 8079.238925][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000246 [ 8079.238929][ C2] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8079.238933][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8079.238937][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8079.238940][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8079.238944][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8079.238948][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8079.238952][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8079.238957][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8079.238961][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8079.238964][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8079.238967][ C2] PKRU: 55555554 [ 8079.238969][ C2] Call Trace: [ 8079.238972][ C2] [ 8079.238974][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8079.238986][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8079.238993][ C2] ? nmi_handle+0x153/0x420 [ 8079.239003][ C2] ? default_do_nmi+0x41/0x100 [ 8079.239009][ C2] ? exc_nmi+0xf3/0x120 [ 8079.239013][ C2] ? end_repeat_nmi+0xf/0x60 [ 8079.239017][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8079.239021][ C2] ? kasan_check_range+0x10f/0x1c0 [ 8079.239024][ C2] ? kasan_check_range+0x10f/0x1c0 [ 8079.239027][ C2] ? kasan_check_range+0x10f/0x1c0 [ 8079.239030][ C2] [ 8079.239031][ C2] [ 8079.239032][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 8079.239035][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8079.239037][ C2] ? get_stack_info+0x36/0xc0 [ 8079.239041][ C2] ? lock_acquire+0x1c1/0x220 [ 8079.239044][ C2] ? lock_release+0x1d5/0x250 [ 8079.239048][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8079.239051][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8079.239054][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8079.239057][ C2] ? lock_acquire+0x1c1/0x220 [ 8079.239059][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8079.239063][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8079.239065][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8079.239071][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8079.239073][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8079.239077][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8079.239082][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8079.239085][ C2] ip_local_deliver+0x19d/0x480 [ 8079.239087][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8079.239089][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8079.239091][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8079.239096][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8079.239100][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8079.239103][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8079.239111][ C2] ip_rcv+0x564/0x740 [ 8079.239114][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8079.239116][ C2] ? set_track_prepare+0x8a/0xd0 [ 8079.239120][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8079.239122][ C2] ? start_secondary+0x21c/0x2b0 [ 8079.239125][ C2] ? skb_clone+0x10b/0x330 [ 8079.239128][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8079.239133][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8079.239138][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8079.239141][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8079.239149][ C2] ? __tcf_classify+0x329/0x7d0 [ 8079.239152][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8079.239154][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8079.239158][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8079.239161][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8079.239165][ C2] ? lock_acquire+0x1c1/0x220 [ 8079.239167][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8079.239171][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8079.239174][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8079.239178][ C2] ? __copy_skb_header+0xaf/0x490 [ 8079.239182][ C2] ? __skb_clone+0x57a/0x760 [ 8079.239184][ C2] netif_receive_skb+0x55/0x280 [ 8079.239187][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8079.239194][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8079.239200][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8079.239207][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8079.239211][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8079.239220][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8079.239227][ C2] ? get_stack_info+0x36/0xc0 [ 8079.239232][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8079.239234][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8079.239238][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8079.239240][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8079.239243][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8079.239245][ C2] ? kernel_text_address+0x17/0xe0 [ 8079.239248][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8079.239252][ C2] ? arch_stack_walk+0x8c/0x100 [ 8079.239255][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8079.239258][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8079.239261][ C2] ? lock_acquire+0x1c1/0x220 [ 8079.239263][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8079.239267][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8079.239270][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8079.239273][ C2] ? get_stack_info+0x36/0xc0 [ 8079.239277][ C2] __tcf_classify+0x329/0x7d0 [ 8079.239282][ C2] tcf_classify+0x283/0x930 [ 8079.239286][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8079.239289][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8079.239293][ C2] tc_run+0x2e4/0x5d0 [ 8079.239297][ C2] ? __pfx_tc_run+0x10/0x10 [ 8079.239299][ C2] ? lock_acquire+0x1c1/0x220 [ 8079.239301][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8079.239305][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8079.239309][ C2] ? lock_acquire+0x1c1/0x220 [ 8079.239311][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8079.239314][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8079.239317][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8079.239319][ C2] ? neigh_hh_output+0x348/0x590 [ 8079.239323][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8079.239326][ C2] ip_finish_output2+0x786/0x18e0 [ 8079.239330][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8079.239337][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8079.239339][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8079.239343][ C2] ? __ip_finish_output+0x10f/0x770 [ 8079.239346][ C2] ip_output+0x16b/0x4f0 [ 8079.239349][ C2] ? __pfx_ip_output+0x10/0x10 [ 8079.239352][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8079.239355][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8079.239358][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8079.239360][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8079.239363][ C2] ? __alloc_skb+0xd4/0x280 [ 8079.239365][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8079.239368][ C2] ? tcp_fragment+0x168/0x1040 [ 8079.239371][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8079.239374][ C2] ? ip_local_out+0x114/0x3b0 [ 8079.239378][ C2] __ip_queue_xmit+0x672/0x1910 [ 8079.239381][ C2] ? __skb_clone+0x57a/0x760 [ 8079.239384][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8079.239389][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8079.239392][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8079.239395][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8079.239399][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8079.239403][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8079.239406][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8079.239409][ C2] tcp_send_loss_probe+0x348/0x830 [ 8079.239412][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8079.239415][ C2] tcp_write_timer+0x82/0x1d0 [ 8079.239418][ C2] call_timer_fn+0x173/0x430 [ 8079.239422][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8079.239427][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8079.239431][ C2] __run_timers.part.0+0x52d/0x890 [ 8079.239433][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8079.239437][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8079.239440][ C2] ? lock_acquire+0x1c1/0x220 [ 8079.239442][ C2] ? clockevents_program_event+0xf6/0x300 [ 8079.239446][ C2] ? lock_release+0x1d5/0x250 [ 8079.239449][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8079.239452][ C2] ? ktime_get+0xb3/0x190 [ 8079.239455][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8079.239459][ C2] run_timer_softirq+0x72/0x100 [ 8079.239463][ C2] __do_softirq+0x1b9/0x7ff [ 8079.239467][ C2] irq_exit_rcu+0x98/0xc0 [ 8079.239469][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8079.239472][ C2] [ 8079.239473][ C2] [ 8079.239474][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8079.239477][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8079.239480][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8079.239482][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8079.239484][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8079.239485][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8079.239487][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8079.239488][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8079.239489][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8079.239492][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8079.239495][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8079.239498][ C2] default_idle_call+0x69/0xa0 [ 8079.239501][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8079.239503][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8079.239506][ C2] ? lock_release+0x1d5/0x250 [ 8079.239509][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8079.239512][ C2] do_idle+0xfb/0x160 [ 8079.239514][ C2] cpu_startup_entry+0x55/0x60 [ 8079.239517][ C2] start_secondary+0x21c/0x2b0 [ 8079.239519][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8079.239523][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8079.239528][ C2] [ 8104.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5356s! [swapper/2:0] [ 8104.569672][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8104.570884][ C2] irq event stamp: 44114564 [ 8104.571111][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8104.571631][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8104.572124][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8104.572585][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8104.573039][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8104.573480][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8104.574070][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8104.574384][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8104.575321][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8104.575616][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8104.576002][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8104.576388][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8104.576771][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8104.577155][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8104.577542][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8104.577974][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8104.578296][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8104.578683][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8104.579068][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8104.579455][ C2] PKRU: 55555554 [ 8104.579630][ C2] Call Trace: [ 8104.579792][ C2] [ 8104.579937][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8104.580190][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8104.580425][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8104.580693][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8104.580956][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8104.581263][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8104.581526][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8104.581828][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8104.582089][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8104.582356][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8104.582654][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8104.582941][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8104.583245][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8104.583525][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8104.583810][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8104.584090][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8104.584395][ C2] ? get_stack_info+0x36/0xc0 [ 8104.584628][ C2] ? lock_acquire+0x1c1/0x220 [ 8104.584862][ C2] ? lock_release+0x1d5/0x250 [ 8104.585094][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8104.585336][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8104.585599][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8104.585873][ C2] ? lock_acquire+0x1c1/0x220 [ 8104.586104][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8104.586338][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8104.586590][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8104.586815][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8104.587052][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8104.587303][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8104.587569][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8104.587837][ C2] ip_local_deliver+0x19d/0x480 [ 8104.588076][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8104.588340][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8104.588594][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8104.588930][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8104.589175][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8104.589485][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8104.589739][ C2] ip_rcv+0x564/0x740 [ 8104.589937][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8104.590158][ C2] ? set_track_prepare+0x8a/0xd0 [ 8104.590404][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8104.590672][ C2] ? start_secondary+0x21c/0x2b0 [ 8104.590914][ C2] ? skb_clone+0x10b/0x330 [ 8104.591138][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8104.591447][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8104.591743][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8104.592013][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8104.592300][ C2] ? __tcf_classify+0x329/0x7d0 [ 8104.592539][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8104.592761][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8104.593052][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8104.593328][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8104.593641][ C2] ? lock_acquire+0x1c1/0x220 [ 8104.593873][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8104.594161][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8104.594437][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8104.594743][ C2] ? __copy_skb_header+0xaf/0x490 [ 8104.594992][ C2] ? __skb_clone+0x57a/0x760 [ 8104.595221][ C2] netif_receive_skb+0x55/0x280 [ 8104.595461][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8104.595762][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8104.596085][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8104.596375][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8104.596638][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8104.596919][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8104.597222][ C2] ? get_stack_info+0x36/0xc0 [ 8104.597453][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8104.597708][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8104.598013][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8104.598283][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8104.598549][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8104.598854][ C2] ? kernel_text_address+0x17/0xe0 [ 8104.599105][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8104.599408][ C2] ? arch_stack_walk+0x8c/0x100 [ 8104.599648][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8104.599904][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8104.600178][ C2] ? lock_acquire+0x1c1/0x220 [ 8104.600410][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8104.600682][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8104.600981][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8104.601272][ C2] ? get_stack_info+0x36/0xc0 [ 8104.601510][ C2] __tcf_classify+0x329/0x7d0 [ 8104.601752][ C2] tcf_classify+0x283/0x930 [ 8104.601983][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8104.602247][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8104.602547][ C2] tc_run+0x2e4/0x5d0 [ 8104.602747][ C2] ? __pfx_tc_run+0x10/0x10 [ 8104.602968][ C2] ? lock_acquire+0x1c1/0x220 [ 8104.603200][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8104.603451][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8104.603695][ C2] ? lock_acquire+0x1c1/0x220 [ 8104.603926][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8104.604183][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8104.604478][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8104.604740][ C2] ? neigh_hh_output+0x348/0x590 [ 8104.604983][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8104.605240][ C2] ip_finish_output2+0x786/0x18e0 [ 8104.605488][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8104.605812][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8104.606079][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8104.606324][ C2] ? __ip_finish_output+0x10f/0x770 [ 8104.606581][ C2] ip_output+0x16b/0x4f0 [ 8104.606791][ C2] ? __pfx_ip_output+0x10/0x10 [ 8104.607026][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8104.607294][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8104.607596][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8104.607862][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8104.608104][ C2] ? __alloc_skb+0xd4/0x280 [ 8104.608328][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8104.608587][ C2] ? tcp_fragment+0x168/0x1040 [ 8104.608824][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8104.609068][ C2] ? ip_local_out+0x114/0x3b0 [ 8104.609299][ C2] __ip_queue_xmit+0x672/0x1910 [ 8104.609539][ C2] ? __skb_clone+0x57a/0x760 [ 8104.609767][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8104.610024][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8104.610297][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8104.610530][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8104.610772][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8104.611085][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8104.611403][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8104.611646][ C2] tcp_send_loss_probe+0x348/0x830 [ 8104.611905][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8104.612181][ C2] tcp_write_timer+0x82/0x1d0 [ 8104.612413][ C2] call_timer_fn+0x173/0x430 [ 8104.612641][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8104.612894][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8104.613147][ C2] __run_timers.part.0+0x52d/0x890 [ 8104.613399][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8104.613659][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8104.613933][ C2] ? lock_acquire+0x1c1/0x220 [ 8104.614164][ C2] ? clockevents_program_event+0xf6/0x300 [ 8104.614445][ C2] ? lock_release+0x1d5/0x250 [ 8104.614675][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8104.614928][ C2] ? ktime_get+0xb3/0x190 [ 8104.615144][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8104.615432][ C2] run_timer_softirq+0x72/0x100 [ 8104.615672][ C2] __do_softirq+0x1b9/0x7ff [ 8104.615897][ C2] irq_exit_rcu+0x98/0xc0 [ 8104.616108][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8104.616386][ C2] [ 8104.616530][ C2] [ 8104.616676][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8104.616968][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8104.617216][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8104.618152][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8104.618448][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8104.618834][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8104.619221][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8104.619605][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8104.619989][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8104.620377][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8104.620659][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8104.620910][ C2] default_idle_call+0x69/0xa0 [ 8104.621171][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8104.621420][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8104.621694][ C2] ? lock_release+0x1d5/0x250 [ 8104.621932][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8104.622212][ C2] do_idle+0xfb/0x160 [ 8104.622409][ C2] cpu_startup_entry+0x55/0x60 [ 8104.622643][ C2] start_secondary+0x21c/0x2b0 [ 8104.622879][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8104.623138][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8104.623440][ C2] [ 8104.623591][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5356s! [perl:4135] [ 8104.623991][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8104.625213][ C1] irq event stamp: 209232 [ 8104.625424][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8104.625939][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8104.626404][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8104.626858][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8104.627310][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8104.627746][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8104.628344][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8104.628618][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8104.629562][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 8104.629860][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8104.630252][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8104.630640][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8104.631031][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8104.631418][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8104.631810][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8104.632247][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8104.632570][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8104.632960][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8104.633349][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8104.633738][ C1] PKRU: 55555554 [ 8104.633915][ C1] Call Trace: [ 8104.634079][ C1] [ 8104.634225][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8104.634480][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8104.634715][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8104.634986][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8104.635253][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8104.635534][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8104.635792][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8104.636088][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8104.636345][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8104.636646][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8104.636936][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8104.637243][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8104.637523][ C1] ? __pfx___kasan_check_read+0x10/0x10 [ 8104.637799][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8104.638073][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8104.638378][ C1] ? get_stack_info+0x36/0xc0 [ 8104.638614][ C1] ? lock_acquire+0x1c1/0x220 [ 8104.638846][ C1] ? lock_release+0x1d5/0x250 [ 8104.639081][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8104.639324][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8104.639588][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8104.639868][ C1] ? lock_acquire+0x1c1/0x220 [ 8104.640099][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8104.640334][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8104.640587][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8104.640816][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8104.641080][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8104.641339][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8104.641613][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8104.641888][ C1] ip_local_deliver+0x19d/0x480 [ 8104.642137][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8104.642413][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8104.642670][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8104.643011][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8104.643261][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8104.643573][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8104.643829][ C1] ip_rcv+0x564/0x740 [ 8104.644027][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8104.644255][ C1] ? set_track_prepare+0x8a/0xd0 [ 8104.644501][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8104.644771][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8104.645034][ C1] ? skb_clone+0x10b/0x330 [ 8104.645257][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8104.645567][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8104.645866][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8104.646141][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8104.646427][ C1] ? __tcf_classify+0x329/0x7d0 [ 8104.646669][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8104.646895][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8104.647188][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8104.647467][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8104.647784][ C1] ? lock_acquire+0x1c1/0x220 [ 8104.648017][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8104.648306][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8104.648586][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8104.648895][ C1] ? __copy_skb_header+0xaf/0x490 [ 8104.649146][ C1] ? __skb_clone+0x57a/0x760 [ 8104.649376][ C1] netif_receive_skb+0x55/0x280 [ 8104.649617][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8104.649921][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8104.650245][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8104.650537][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8104.650804][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8104.651088][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8104.651393][ C1] ? hlock_class+0x4e/0x130 [ 8104.651621][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8104.651889][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8104.652159][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8104.652417][ C1] ? hlock_class+0x4e/0x130 [ 8104.652640][ C1] ? mark_lock+0x38/0x3e0 [ 8104.652856][ C1] ? stack_access_ok+0xda/0x1f0 [ 8104.653098][ C1] ? __lock_acquire+0xb67/0x1610 [ 8104.653346][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8104.653615][ C1] ? get_stack_info+0x36/0xc0 [ 8104.653848][ C1] ? stack_access_ok+0xda/0x1f0 [ 8104.654088][ C1] ? get_reg+0x119/0x190 [ 8104.654301][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8104.654561][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8104.654863][ C1] __tcf_classify+0x329/0x7d0 [ 8104.655099][ C1] tcf_classify+0x283/0x930 [ 8104.655324][ C1] ? arch_stack_walk+0xa2/0x100 [ 8104.655567][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8104.655816][ C1] ? get_stack_info+0x36/0xc0 [ 8104.656051][ C1] tc_run+0x2e4/0x5d0 [ 8104.656252][ C1] ? __pfx_tc_run+0x10/0x10 [ 8104.656477][ C1] ? lock_acquire+0x1c1/0x220 [ 8104.656708][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8104.656963][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8104.657210][ C1] ? lock_acquire+0x1c1/0x220 [ 8104.657443][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8104.657699][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8104.657996][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8104.658261][ C1] ? neigh_hh_output+0x348/0x590 [ 8104.658508][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8104.658765][ C1] ip_finish_output2+0x786/0x18e0 [ 8104.659014][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8104.659288][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8104.659615][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8104.659887][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8104.660133][ C1] ? __ip_finish_output+0x10f/0x770 [ 8104.660391][ C1] ip_output+0x16b/0x4f0 [ 8104.660603][ C1] ? run_timer_softirq+0x72/0x100 [ 8104.660853][ C1] ? __pfx_ip_output+0x10/0x10 [ 8104.661111][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8104.661402][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8104.661654][ C1] ? ip_local_out+0x114/0x3b0 [ 8104.661894][ C1] __ip_queue_xmit+0x672/0x1910 [ 8104.662142][ C1] ? __create_object+0x5e/0xb0 [ 8104.662391][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8104.662648][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8104.662924][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8104.663190][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8104.663464][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8104.663730][ C1] tcp_delack_timer+0x84/0x240 [ 8104.663967][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8104.664234][ C1] call_timer_fn+0x173/0x430 [ 8104.664462][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8104.664718][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8104.664973][ C1] __run_timers.part.0+0x52d/0x890 [ 8104.665228][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8104.665495][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8104.665770][ C1] ? lock_acquire+0x1c1/0x220 [ 8104.666003][ C1] ? clockevents_program_event+0xf6/0x300 [ 8104.666287][ C1] ? lock_release+0x1d5/0x250 [ 8104.666519][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8104.666776][ C1] ? ktime_get+0xb3/0x190 [ 8104.666993][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8104.667283][ C1] run_timer_softirq+0x72/0x100 [ 8104.667523][ C1] __do_softirq+0x1b9/0x7ff [ 8104.667751][ C1] irq_exit_rcu+0x98/0xc0 [ 8104.667964][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8104.668245][ C1] [ 8104.668391][ C1] [ 8104.668538][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8104.668832][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8104.669148][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8104.670097][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8104.670397][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8104.670786][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8104.671200][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8104.671598][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8104.671995][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8104.672404][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8104.672690][ C1] pipe_read+0xa16/0xdf0 [ 8104.672905][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8104.673176][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8104.673414][ C1] ? iterate_tty_write+0x299/0x540 [ 8104.673669][ C1] ? lock_release+0x1d5/0x250 [ 8104.673903][ C1] vfs_read+0x911/0xc00 [ 8104.674112][ C1] ? lock_acquire+0x1c1/0x220 [ 8104.674346][ C1] ? __might_fault+0xc6/0x180 [ 8104.674578][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8104.674814][ C1] ? __might_fault+0xc6/0x180 [ 8104.675047][ C1] ? lock_release+0x1d5/0x250 [ 8104.675283][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8104.675541][ C1] ? __fget_light+0x54/0x1e0 [ 8104.675769][ C1] ksys_read+0x17a/0x1e0 [ 8104.675983][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8104.676222][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8104.676518][ C1] do_syscall_64+0xc9/0x1e0 [ 8104.676746][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8104.677041][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8104.677262][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8104.678207][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8104.678620][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8104.679007][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8104.679395][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8104.679785][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8104.680173][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8104.680564][ C1] [ 8132.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5383s! [swapper/2:0] [ 8132.569687][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8132.570921][ C2] irq event stamp: 44114564 [ 8132.571150][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8132.571689][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8132.572206][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8132.572664][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8132.573121][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8132.573565][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8132.574155][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8132.574471][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8132.575413][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8132.575710][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8132.576098][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8132.576486][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8132.576872][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8132.577258][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8132.577645][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8132.578078][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8132.578405][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8132.578792][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8132.579180][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8132.579568][ C2] PKRU: 55555554 [ 8132.579743][ C2] Call Trace: [ 8132.579907][ C2] [ 8132.580050][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8132.580306][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8132.580541][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8132.580812][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8132.581079][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8132.581360][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8132.581618][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8132.581912][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8132.582166][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8132.582422][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8132.582722][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8132.583010][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8132.583316][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8132.583596][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8132.583884][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8132.584162][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8132.584466][ C2] ? get_stack_info+0x36/0xc0 [ 8132.584700][ C2] ? lock_acquire+0x1c1/0x220 [ 8132.584934][ C2] ? lock_release+0x1d5/0x250 [ 8132.585166][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8132.585407][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8132.585674][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8132.585950][ C2] ? lock_acquire+0x1c1/0x220 [ 8132.586182][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8132.586416][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8132.586668][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8132.586895][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8132.587134][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8132.587386][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8132.587650][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8132.587922][ C2] ip_local_deliver+0x19d/0x480 [ 8132.588162][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8132.588427][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8132.588683][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8132.589019][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8132.589265][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8132.589574][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8132.589828][ C2] ip_rcv+0x564/0x740 [ 8132.590027][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8132.590252][ C2] ? set_track_prepare+0x8a/0xd0 [ 8132.590498][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8132.590765][ C2] ? start_secondary+0x21c/0x2b0 [ 8132.591033][ C2] ? skb_clone+0x10b/0x330 [ 8132.591261][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8132.591580][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8132.591884][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8132.592174][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8132.592459][ C2] ? __tcf_classify+0x329/0x7d0 [ 8132.592701][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8132.592926][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8132.593220][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8132.593496][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8132.593810][ C2] ? lock_acquire+0x1c1/0x220 [ 8132.594043][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8132.594330][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8132.594608][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8132.594916][ C2] ? __copy_skb_header+0xaf/0x490 [ 8132.595167][ C2] ? __skb_clone+0x57a/0x760 [ 8132.595395][ C2] netif_receive_skb+0x55/0x280 [ 8132.595635][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8132.595939][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8132.596261][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8132.596553][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8132.596818][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8132.597098][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8132.597400][ C2] ? get_stack_info+0x36/0xc0 [ 8132.597636][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8132.597891][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8132.598197][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8132.598466][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8132.598736][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8132.599042][ C2] ? kernel_text_address+0x17/0xe0 [ 8132.599296][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8132.599599][ C2] ? arch_stack_walk+0x8c/0x100 [ 8132.599839][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8132.600097][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8132.600373][ C2] ? lock_acquire+0x1c1/0x220 [ 8132.600605][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8132.600881][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8132.601179][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8132.601446][ C2] ? get_stack_info+0x36/0xc0 [ 8132.601679][ C2] __tcf_classify+0x329/0x7d0 [ 8132.601913][ C2] tcf_classify+0x283/0x930 [ 8132.602140][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8132.602390][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8132.602694][ C2] tc_run+0x2e4/0x5d0 [ 8132.602894][ C2] ? __pfx_tc_run+0x10/0x10 [ 8132.603117][ C2] ? lock_acquire+0x1c1/0x220 [ 8132.603351][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8132.603604][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8132.603850][ C2] ? lock_acquire+0x1c1/0x220 [ 8132.604082][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8132.604340][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8132.604633][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8132.604898][ C2] ? neigh_hh_output+0x348/0x590 [ 8132.605143][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8132.605401][ C2] ip_finish_output2+0x786/0x18e0 [ 8132.605649][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8132.605977][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8132.606245][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8132.606491][ C2] ? __ip_finish_output+0x10f/0x770 [ 8132.606746][ C2] ip_output+0x16b/0x4f0 [ 8132.606959][ C2] ? __pfx_ip_output+0x10/0x10 [ 8132.607196][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8132.607466][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8132.607770][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8132.608037][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8132.608281][ C2] ? __alloc_skb+0xd4/0x280 [ 8132.608506][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8132.608768][ C2] ? tcp_fragment+0x168/0x1040 [ 8132.609004][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8132.609250][ C2] ? ip_local_out+0x114/0x3b0 [ 8132.609482][ C2] __ip_queue_xmit+0x672/0x1910 [ 8132.609723][ C2] ? __skb_clone+0x57a/0x760 [ 8132.609952][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8132.610211][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8132.610483][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8132.610722][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8132.610986][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8132.611288][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8132.611606][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8132.611849][ C2] tcp_send_loss_probe+0x348/0x830 [ 8132.612119][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8132.612380][ C2] tcp_write_timer+0x82/0x1d0 [ 8132.612613][ C2] call_timer_fn+0x173/0x430 [ 8132.612841][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8132.613094][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8132.613348][ C2] __run_timers.part.0+0x52d/0x890 [ 8132.613602][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8132.613865][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8132.614140][ C2] ? lock_acquire+0x1c1/0x220 [ 8132.614373][ C2] ? clockevents_program_event+0xf6/0x300 [ 8132.614652][ C2] ? lock_release+0x1d5/0x250 [ 8132.614884][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8132.615140][ C2] ? ktime_get+0xb3/0x190 [ 8132.615357][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8132.615643][ C2] run_timer_softirq+0x72/0x100 [ 8132.615884][ C2] __do_softirq+0x1b9/0x7ff [ 8132.616110][ C2] irq_exit_rcu+0x98/0xc0 [ 8132.616323][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8132.616601][ C2] [ 8132.616746][ C2] [ 8132.616891][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8132.617187][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8132.617435][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8132.618373][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8132.618671][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8132.619056][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8132.619445][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8132.619831][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8132.620218][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8132.620603][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8132.620889][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8132.621143][ C2] default_idle_call+0x69/0xa0 [ 8132.621380][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8132.621624][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8132.621893][ C2] ? lock_release+0x1d5/0x250 [ 8132.622125][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8132.622391][ C2] do_idle+0xfb/0x160 [ 8132.622588][ C2] cpu_startup_entry+0x55/0x60 [ 8132.622823][ C2] start_secondary+0x21c/0x2b0 [ 8132.623060][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8132.623322][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8132.623623][ C2] [ 8132.623774][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5383s! [perl:4135] [ 8132.624175][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8132.625396][ C1] irq event stamp: 209232 [ 8132.625608][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8132.626119][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8132.626589][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8132.627045][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8132.627494][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8132.627930][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8132.628528][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8132.628845][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8132.629792][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8132.630091][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8132.630481][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8132.630889][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8132.631291][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8132.631691][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8132.632100][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8132.632535][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8132.632858][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8132.633253][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8132.633642][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8132.634030][ C1] PKRU: 55555554 [ 8132.634208][ C1] Call Trace: [ 8132.634376][ C1] [ 8132.634519][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8132.634772][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8132.635009][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8132.635279][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8132.635545][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8132.635826][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8132.636084][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8132.636384][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8132.636640][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8132.636941][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8132.637228][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8132.637535][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8132.637818][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8132.638104][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8132.638389][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8132.638693][ C1] ? get_stack_info+0x36/0xc0 [ 8132.638927][ C1] ? lock_acquire+0x1c1/0x220 [ 8132.639160][ C1] ? lock_release+0x1d5/0x250 [ 8132.639396][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8132.639639][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8132.639904][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8132.640184][ C1] ? lock_acquire+0x1c1/0x220 [ 8132.640417][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8132.640652][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8132.640909][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8132.641139][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8132.641381][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8132.641632][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8132.641899][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8132.642168][ C1] ip_local_deliver+0x19d/0x480 [ 8132.642410][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8132.642673][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8132.642931][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8132.643270][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8132.643517][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8132.643833][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8132.644091][ C1] ip_rcv+0x564/0x740 [ 8132.644291][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8132.644516][ C1] ? set_track_prepare+0x8a/0xd0 [ 8132.644762][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8132.645033][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8132.645300][ C1] ? skb_clone+0x10b/0x330 [ 8132.645522][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8132.645834][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8132.646131][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8132.646408][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8132.646693][ C1] ? __tcf_classify+0x329/0x7d0 [ 8132.646936][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8132.647161][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8132.647453][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8132.647733][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8132.648050][ C1] ? lock_acquire+0x1c1/0x220 [ 8132.648289][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8132.648576][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8132.648857][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8132.649166][ C1] ? __copy_skb_header+0xaf/0x490 [ 8132.649418][ C1] ? __skb_clone+0x57a/0x760 [ 8132.649645][ C1] netif_receive_skb+0x55/0x280 [ 8132.649887][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8132.650193][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8132.650516][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8132.650808][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8132.651100][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8132.651389][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8132.651703][ C1] ? hlock_class+0x4e/0x130 [ 8132.651937][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8132.652220][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8132.652490][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8132.652748][ C1] ? hlock_class+0x4e/0x130 [ 8132.652973][ C1] ? mark_lock+0x38/0x3e0 [ 8132.653190][ C1] ? stack_access_ok+0xda/0x1f0 [ 8132.653435][ C1] ? __lock_acquire+0xb67/0x1610 [ 8132.653683][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8132.653953][ C1] ? get_stack_info+0x36/0xc0 [ 8132.654188][ C1] ? stack_access_ok+0xda/0x1f0 [ 8132.654427][ C1] ? get_reg+0x119/0x190 [ 8132.654641][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8132.654902][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8132.655204][ C1] __tcf_classify+0x329/0x7d0 [ 8132.655440][ C1] tcf_classify+0x283/0x930 [ 8132.655666][ C1] ? arch_stack_walk+0xa2/0x100 [ 8132.655908][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8132.656158][ C1] ? get_stack_info+0x36/0xc0 [ 8132.656395][ C1] tc_run+0x2e4/0x5d0 [ 8132.656593][ C1] ? __pfx_tc_run+0x10/0x10 [ 8132.656819][ C1] ? lock_acquire+0x1c1/0x220 [ 8132.657049][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8132.657305][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8132.657551][ C1] ? lock_acquire+0x1c1/0x220 [ 8132.657784][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8132.658041][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8132.658339][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8132.658604][ C1] ? neigh_hh_output+0x348/0x590 [ 8132.658850][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8132.659107][ C1] ip_finish_output2+0x786/0x18e0 [ 8132.659358][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8132.659630][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8132.659959][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8132.660228][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8132.660474][ C1] ? __ip_finish_output+0x10f/0x770 [ 8132.660732][ C1] ip_output+0x16b/0x4f0 [ 8132.660946][ C1] ? run_timer_softirq+0x72/0x100 [ 8132.661197][ C1] ? __pfx_ip_output+0x10/0x10 [ 8132.661433][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8132.661714][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8132.661959][ C1] ? ip_local_out+0x114/0x3b0 [ 8132.662193][ C1] __ip_queue_xmit+0x672/0x1910 [ 8132.662435][ C1] ? __create_object+0x5e/0xb0 [ 8132.662673][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8132.662931][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8132.663208][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8132.663474][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8132.663746][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8132.664013][ C1] tcp_delack_timer+0x84/0x240 [ 8132.664250][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8132.664516][ C1] call_timer_fn+0x173/0x430 [ 8132.664745][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8132.664999][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8132.665255][ C1] __run_timers.part.0+0x52d/0x890 [ 8132.665510][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8132.665777][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8132.666053][ C1] ? lock_acquire+0x1c1/0x220 [ 8132.666287][ C1] ? clockevents_program_event+0xf6/0x300 [ 8132.666567][ C1] ? lock_release+0x1d5/0x250 [ 8132.666802][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8132.667058][ C1] ? ktime_get+0xb3/0x190 [ 8132.667276][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8132.667563][ C1] run_timer_softirq+0x72/0x100 [ 8132.667805][ C1] __do_softirq+0x1b9/0x7ff [ 8132.668032][ C1] irq_exit_rcu+0x98/0xc0 [ 8132.668247][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8132.668526][ C1] [ 8132.668672][ C1] [ 8132.668819][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8132.669115][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8132.669430][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8132.670382][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8132.670682][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8132.671095][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8132.671498][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8132.671897][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8132.672300][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8132.672690][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8132.672978][ C1] pipe_read+0xa16/0xdf0 [ 8132.673195][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8132.673466][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8132.673703][ C1] ? iterate_tty_write+0x299/0x540 [ 8132.673957][ C1] ? lock_release+0x1d5/0x250 [ 8132.674190][ C1] vfs_read+0x911/0xc00 [ 8132.674401][ C1] ? lock_acquire+0x1c1/0x220 [ 8132.674632][ C1] ? __might_fault+0xc6/0x180 [ 8132.674866][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8132.675099][ C1] ? __might_fault+0xc6/0x180 [ 8132.675335][ C1] ? lock_release+0x1d5/0x250 [ 8132.675568][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8132.675826][ C1] ? __fget_light+0x54/0x1e0 [ 8132.676055][ C1] ksys_read+0x17a/0x1e0 [ 8132.676269][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8132.676506][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8132.676803][ C1] do_syscall_64+0xc9/0x1e0 [ 8132.677029][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8132.677321][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8132.677542][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8132.678487][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8132.678897][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8132.679287][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8132.679673][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8132.680061][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8132.680452][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8132.680861][ C1] [ 8157.240103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8157.240448][ C1] rcu: 1-....: (5788441 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1413583 [ 8157.240997][ C1] rcu: (t=5802353 jiffies g=1882453 q=721 ncpus=4) [ 8157.241321][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8157.241755][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8157.242351][ C1] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 8157.242664][ C1] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 ca 35 0c fe 89 d8 [ 8157.243608][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000246 [ 8157.243905][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8157.244296][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8157.244682][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8157.245068][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8157.245455][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8157.245845][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8157.246280][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8157.246602][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8157.246990][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8157.247378][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8157.247767][ C1] PKRU: 55555554 [ 8157.247942][ C1] Call Trace: [ 8157.248106][ C1] [ 8157.248251][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8157.248516][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8157.248760][ C1] ? check_cpu_stall+0x284/0x500 [ 8157.249005][ C1] ? rcu_pending+0x92/0x360 [ 8157.249228][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8157.249489][ C1] ? update_process_times+0xb9/0x110 [ 8157.249751][ C1] ? tick_sched_handle+0x67/0x130 [ 8157.250000][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8157.250276][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8157.250511][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8157.250835][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8157.251106][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8157.251393][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8157.251658][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8157.251971][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8157.252227][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8157.252527][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8157.252814][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8157.253119][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8157.253399][ C1] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 8157.253681][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8157.253959][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8157.254263][ C1] ? get_stack_info+0x36/0xc0 [ 8157.254497][ C1] ? lock_acquire+0x1c1/0x220 [ 8157.254730][ C1] ? lock_release+0x1d5/0x250 [ 8157.254960][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8157.255203][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8157.255469][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8157.255746][ C1] ? lock_acquire+0x1c1/0x220 [ 8157.255979][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8157.256212][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8157.256464][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8157.256691][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8157.256931][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8157.257181][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8157.257466][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8157.257745][ C1] ip_local_deliver+0x19d/0x480 [ 8157.257991][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8157.258263][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8157.258536][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8157.258871][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8157.259115][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8157.259426][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8157.259680][ C1] ip_rcv+0x564/0x740 [ 8157.259877][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8157.260101][ C1] ? set_track_prepare+0x8a/0xd0 [ 8157.260348][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8157.260615][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8157.260901][ C1] ? skb_clone+0x10b/0x330 [ 8157.261128][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8157.261444][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8157.261750][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8157.262037][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8157.262323][ C1] ? __tcf_classify+0x329/0x7d0 [ 8157.262564][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8157.262787][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8157.263079][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8157.263356][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8157.263672][ C1] ? lock_acquire+0x1c1/0x220 [ 8157.263904][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8157.264193][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8157.264470][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8157.264777][ C1] ? __copy_skb_header+0xaf/0x490 [ 8157.265028][ C1] ? __skb_clone+0x57a/0x760 [ 8157.265258][ C1] netif_receive_skb+0x55/0x280 [ 8157.265498][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8157.265799][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8157.266122][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8157.266414][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8157.266677][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8157.266960][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8157.267263][ C1] ? hlock_class+0x4e/0x130 [ 8157.267488][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8157.267755][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8157.268024][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8157.268280][ C1] ? hlock_class+0x4e/0x130 [ 8157.268505][ C1] ? mark_lock+0x38/0x3e0 [ 8157.268717][ C1] ? stack_access_ok+0xda/0x1f0 [ 8157.268959][ C1] ? __lock_acquire+0xb67/0x1610 [ 8157.269209][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8157.269476][ C1] ? get_stack_info+0x36/0xc0 [ 8157.269709][ C1] ? stack_access_ok+0xda/0x1f0 [ 8157.269949][ C1] ? get_reg+0x119/0x190 [ 8157.270158][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8157.270418][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8157.270718][ C1] __tcf_classify+0x329/0x7d0 [ 8157.270978][ C1] tcf_classify+0x283/0x930 [ 8157.271209][ C1] ? arch_stack_walk+0xa2/0x100 [ 8157.271455][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8157.271711][ C1] ? get_stack_info+0x36/0xc0 [ 8157.271963][ C1] tc_run+0x2e4/0x5d0 [ 8157.272161][ C1] ? __pfx_tc_run+0x10/0x10 [ 8157.272388][ C1] ? lock_acquire+0x1c1/0x220 [ 8157.272620][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8157.272873][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8157.273119][ C1] ? lock_acquire+0x1c1/0x220 [ 8157.273350][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8157.273607][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8157.273901][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8157.274167][ C1] ? neigh_hh_output+0x348/0x590 [ 8157.274412][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8157.274669][ C1] ip_finish_output2+0x786/0x18e0 [ 8157.274918][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8157.275187][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8157.275515][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8157.275782][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8157.276027][ C1] ? __ip_finish_output+0x10f/0x770 [ 8157.276286][ C1] ip_output+0x16b/0x4f0 [ 8157.276496][ C1] ? run_timer_softirq+0x72/0x100 [ 8157.276746][ C1] ? __pfx_ip_output+0x10/0x10 [ 8157.276982][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8157.277260][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8157.277503][ C1] ? ip_local_out+0x114/0x3b0 [ 8157.277737][ C1] __ip_queue_xmit+0x672/0x1910 [ 8157.277977][ C1] ? __create_object+0x5e/0xb0 [ 8157.278214][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8157.278474][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8157.278746][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8157.279010][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8157.279286][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8157.279549][ C1] tcp_delack_timer+0x84/0x240 [ 8157.279786][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8157.280049][ C1] call_timer_fn+0x173/0x430 [ 8157.280280][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8157.280534][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8157.280790][ C1] __run_timers.part.0+0x52d/0x890 [ 8157.281042][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8157.281306][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8157.281582][ C1] ? lock_acquire+0x1c1/0x220 [ 8157.281813][ C1] ? clockevents_program_event+0xf6/0x300 [ 8157.282096][ C1] ? lock_release+0x1d5/0x250 [ 8157.282329][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8157.282585][ C1] ? ktime_get+0xb3/0x190 [ 8157.282798][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8157.283085][ C1] run_timer_softirq+0x72/0x100 [ 8157.283327][ C1] __do_softirq+0x1b9/0x7ff [ 8157.283551][ C1] irq_exit_rcu+0x98/0xc0 [ 8157.283766][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8157.284042][ C1] [ 8157.284188][ C1] [ 8157.284336][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8157.284630][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8157.284945][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8157.285888][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8157.286186][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8157.286574][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8157.286959][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8157.287346][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8157.287736][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8157.288125][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8157.288412][ C1] pipe_read+0xa16/0xdf0 [ 8157.288627][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8157.288895][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8157.289132][ C1] ? iterate_tty_write+0x299/0x540 [ 8157.289386][ C1] ? lock_release+0x1d5/0x250 [ 8157.289620][ C1] vfs_read+0x911/0xc00 [ 8157.289826][ C1] ? lock_acquire+0x1c1/0x220 [ 8157.290059][ C1] ? __might_fault+0xc6/0x180 [ 8157.290293][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8157.290523][ C1] ? __might_fault+0xc6/0x180 [ 8157.290759][ C1] ? lock_release+0x1d5/0x250 [ 8157.291016][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8157.291280][ C1] ? __fget_light+0x54/0x1e0 [ 8157.291516][ C1] ksys_read+0x17a/0x1e0 [ 8157.291732][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8157.291985][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8157.292281][ C1] do_syscall_64+0xc9/0x1e0 [ 8157.292505][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8157.292796][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8157.293016][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8157.293958][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8157.294367][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8157.294752][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8157.295141][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8157.295529][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8157.295915][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8157.296305][ C1] [ 8157.296460][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8157.296720][ C2] NMI backtrace for cpu 2 [ 8157.296725][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8157.296730][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8157.296734][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8157.296742][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8157.296747][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8157.296752][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8157.296755][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8157.296759][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8157.296763][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8157.296766][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8157.296770][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8157.296775][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8157.296780][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8157.296783][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8157.296786][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8157.296790][ C2] PKRU: 55555554 [ 8157.296792][ C2] Call Trace: [ 8157.296794][ C2] [ 8157.296796][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8157.296808][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8157.296816][ C2] ? nmi_handle+0x153/0x420 [ 8157.296825][ C2] ? default_do_nmi+0x41/0x100 [ 8157.296831][ C2] ? exc_nmi+0xf3/0x120 [ 8157.296837][ C2] ? end_repeat_nmi+0xf/0x60 [ 8157.296848][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8157.296856][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8157.296864][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8157.296872][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8157.296880][ C2] [ 8157.296882][ C2] [ 8157.296885][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8157.296891][ C2] ? get_stack_info+0x36/0xc0 [ 8157.296896][ C2] ? lock_acquire+0x1c1/0x220 [ 8157.296900][ C2] ? lock_release+0x1d5/0x250 [ 8157.296903][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8157.296907][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8157.296909][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8157.296912][ C2] ? lock_acquire+0x1c1/0x220 [ 8157.296914][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8157.296918][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8157.296920][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8157.296926][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8157.296928][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8157.296932][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8157.296936][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8157.296939][ C2] ip_local_deliver+0x19d/0x480 [ 8157.296942][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8157.296944][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8157.296946][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8157.296950][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8157.296954][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8157.296957][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8157.296965][ C2] ip_rcv+0x564/0x740 [ 8157.296967][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8157.296970][ C2] ? set_track_prepare+0x8a/0xd0 [ 8157.296973][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8157.296976][ C2] ? start_secondary+0x21c/0x2b0 [ 8157.296979][ C2] ? skb_clone+0x10b/0x330 [ 8157.296981][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8157.296987][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8157.296992][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8157.296995][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8157.297002][ C2] ? __tcf_classify+0x329/0x7d0 [ 8157.297006][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8157.297008][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8157.297011][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8157.297014][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8157.297018][ C2] ? lock_acquire+0x1c1/0x220 [ 8157.297020][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8157.297024][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8157.297028][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8157.297032][ C2] ? __copy_skb_header+0xaf/0x490 [ 8157.297036][ C2] ? __skb_clone+0x57a/0x760 [ 8157.297038][ C2] netif_receive_skb+0x55/0x280 [ 8157.297041][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8157.297047][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8157.297054][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8157.297060][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8157.297064][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8157.297074][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8157.297081][ C2] ? get_stack_info+0x36/0xc0 [ 8157.297086][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8157.297088][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8157.297091][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8157.297094][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8157.297097][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8157.297099][ C2] ? kernel_text_address+0x17/0xe0 [ 8157.297102][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8157.297106][ C2] ? arch_stack_walk+0x8c/0x100 [ 8157.297109][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8157.297112][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8157.297115][ C2] ? lock_acquire+0x1c1/0x220 [ 8157.297117][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8157.297121][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8157.297125][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8157.297128][ C2] ? get_stack_info+0x36/0xc0 [ 8157.297132][ C2] __tcf_classify+0x329/0x7d0 [ 8157.297137][ C2] tcf_classify+0x283/0x930 [ 8157.297141][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8157.297144][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8157.297149][ C2] tc_run+0x2e4/0x5d0 [ 8157.297152][ C2] ? __pfx_tc_run+0x10/0x10 [ 8157.297155][ C2] ? lock_acquire+0x1c1/0x220 [ 8157.297157][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8157.297161][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8157.297164][ C2] ? lock_acquire+0x1c1/0x220 [ 8157.297167][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8157.297170][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8157.297172][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8157.297175][ C2] ? neigh_hh_output+0x348/0x590 [ 8157.297178][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8157.297182][ C2] ip_finish_output2+0x786/0x18e0 [ 8157.297185][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8157.297193][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8157.297195][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8157.297199][ C2] ? __ip_finish_output+0x10f/0x770 [ 8157.297202][ C2] ip_output+0x16b/0x4f0 [ 8157.297205][ C2] ? __pfx_ip_output+0x10/0x10 [ 8157.297208][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8157.297211][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8157.297214][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8157.297216][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8157.297218][ C2] ? __alloc_skb+0xd4/0x280 [ 8157.297221][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8157.297224][ C2] ? tcp_fragment+0x168/0x1040 [ 8157.297227][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8157.297230][ C2] ? ip_local_out+0x114/0x3b0 [ 8157.297233][ C2] __ip_queue_xmit+0x672/0x1910 [ 8157.297237][ C2] ? __skb_clone+0x57a/0x760 [ 8157.297239][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8157.297244][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8157.297247][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8157.297250][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8157.297254][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8157.297258][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8157.297261][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8157.297264][ C2] tcp_send_loss_probe+0x348/0x830 [ 8157.297267][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8157.297270][ C2] tcp_write_timer+0x82/0x1d0 [ 8157.297273][ C2] call_timer_fn+0x173/0x430 [ 8157.297276][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8157.297281][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8157.297285][ C2] __run_timers.part.0+0x52d/0x890 [ 8157.297288][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8157.297292][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8157.297295][ C2] ? lock_acquire+0x1c1/0x220 [ 8157.297297][ C2] ? clockevents_program_event+0xf6/0x300 [ 8157.297301][ C2] ? lock_release+0x1d5/0x250 [ 8157.297303][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8157.297306][ C2] ? ktime_get+0xb3/0x190 [ 8157.297310][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8157.297314][ C2] run_timer_softirq+0x72/0x100 [ 8157.297317][ C2] __do_softirq+0x1b9/0x7ff [ 8157.297321][ C2] irq_exit_rcu+0x98/0xc0 [ 8157.297323][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8157.297326][ C2] [ 8157.297327][ C2] [ 8157.297328][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8157.297331][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8157.297334][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8157.297336][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8157.297338][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8157.297339][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8157.297341][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8157.297342][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8157.297343][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8157.297346][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8157.297349][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8157.297352][ C2] default_idle_call+0x69/0xa0 [ 8157.297355][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8157.297357][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8157.297360][ C2] ? lock_release+0x1d5/0x250 [ 8157.297363][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8157.297366][ C2] do_idle+0xfb/0x160 [ 8157.297369][ C2] cpu_startup_entry+0x55/0x60 [ 8157.297371][ C2] start_secondary+0x21c/0x2b0 [ 8157.297374][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8157.297378][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8157.297383][ C2] [ 8184.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5431s! [swapper/2:0] [ 8184.569691][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8184.570935][ C2] irq event stamp: 44114564 [ 8184.571163][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8184.571699][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8184.572208][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8184.572667][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8184.573121][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8184.573564][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8184.574161][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8184.574475][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8184.575415][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8184.575712][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8184.576097][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8184.576484][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8184.576870][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8184.577257][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8184.577641][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8184.578074][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8184.578397][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8184.578787][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8184.579173][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8184.579558][ C2] PKRU: 55555554 [ 8184.579734][ C2] Call Trace: [ 8184.579899][ C2] [ 8184.580042][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8184.580295][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8184.580532][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8184.580802][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8184.581068][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8184.581348][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8184.581604][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8184.581901][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8184.582154][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8184.582409][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8184.582710][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8184.582997][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8184.583301][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8184.583582][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8184.583868][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8184.584148][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8184.584451][ C2] ? get_stack_info+0x36/0xc0 [ 8184.584685][ C2] ? lock_acquire+0x1c1/0x220 [ 8184.584920][ C2] ? lock_release+0x1d5/0x250 [ 8184.585152][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8184.585392][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8184.585655][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8184.585933][ C2] ? lock_acquire+0x1c1/0x220 [ 8184.586164][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8184.586398][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8184.586649][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8184.586878][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8184.587117][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8184.587371][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8184.587638][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8184.587905][ C2] ip_local_deliver+0x19d/0x480 [ 8184.588146][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8184.588411][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8184.588668][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8184.589005][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8184.589252][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8184.589563][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8184.589818][ C2] ip_rcv+0x564/0x740 [ 8184.590015][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8184.590241][ C2] ? set_track_prepare+0x8a/0xd0 [ 8184.590487][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8184.590778][ C2] ? start_secondary+0x21c/0x2b0 [ 8184.591029][ C2] ? skb_clone+0x10b/0x330 [ 8184.591257][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8184.591574][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8184.591888][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8184.592162][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8184.592449][ C2] ? __tcf_classify+0x329/0x7d0 [ 8184.592691][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8184.592914][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8184.593205][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8184.593483][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8184.593800][ C2] ? lock_acquire+0x1c1/0x220 [ 8184.594031][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8184.594320][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8184.594597][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8184.594904][ C2] ? __copy_skb_header+0xaf/0x490 [ 8184.595154][ C2] ? __skb_clone+0x57a/0x760 [ 8184.595382][ C2] netif_receive_skb+0x55/0x280 [ 8184.595623][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8184.595926][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8184.596250][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8184.596540][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8184.596807][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8184.597086][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8184.597390][ C2] ? get_stack_info+0x36/0xc0 [ 8184.597626][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8184.597882][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8184.598192][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8184.598459][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8184.598728][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8184.599034][ C2] ? kernel_text_address+0x17/0xe0 [ 8184.599289][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8184.599592][ C2] ? arch_stack_walk+0x8c/0x100 [ 8184.599834][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8184.600090][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8184.600370][ C2] ? lock_acquire+0x1c1/0x220 [ 8184.600602][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8184.600902][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8184.601207][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8184.601482][ C2] ? get_stack_info+0x36/0xc0 [ 8184.601724][ C2] __tcf_classify+0x329/0x7d0 [ 8184.601964][ C2] tcf_classify+0x283/0x930 [ 8184.602196][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8184.602451][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8184.602765][ C2] tc_run+0x2e4/0x5d0 [ 8184.602965][ C2] ? __pfx_tc_run+0x10/0x10 [ 8184.603193][ C2] ? lock_acquire+0x1c1/0x220 [ 8184.603426][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8184.603680][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8184.603925][ C2] ? lock_acquire+0x1c1/0x220 [ 8184.604156][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8184.604414][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8184.604708][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8184.604972][ C2] ? neigh_hh_output+0x348/0x590 [ 8184.605218][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8184.605476][ C2] ip_finish_output2+0x786/0x18e0 [ 8184.605727][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8184.606055][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8184.606324][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8184.606569][ C2] ? __ip_finish_output+0x10f/0x770 [ 8184.606827][ C2] ip_output+0x16b/0x4f0 [ 8184.607037][ C2] ? __pfx_ip_output+0x10/0x10 [ 8184.607274][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8184.607544][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8184.607846][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8184.608117][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8184.608363][ C2] ? __alloc_skb+0xd4/0x280 [ 8184.608585][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8184.608848][ C2] ? tcp_fragment+0x168/0x1040 [ 8184.609084][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8184.609330][ C2] ? ip_local_out+0x114/0x3b0 [ 8184.609564][ C2] __ip_queue_xmit+0x672/0x1910 [ 8184.609806][ C2] ? __skb_clone+0x57a/0x760 [ 8184.610034][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8184.610296][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8184.610567][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8184.610831][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8184.611081][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8184.611382][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8184.611701][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8184.611951][ C2] tcp_send_loss_probe+0x348/0x830 [ 8184.612204][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8184.612466][ C2] tcp_write_timer+0x82/0x1d0 [ 8184.612698][ C2] call_timer_fn+0x173/0x430 [ 8184.612929][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8184.613184][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8184.613438][ C2] __run_timers.part.0+0x52d/0x890 [ 8184.613690][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8184.613950][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8184.614230][ C2] ? lock_acquire+0x1c1/0x220 [ 8184.614461][ C2] ? clockevents_program_event+0xf6/0x300 [ 8184.614742][ C2] ? lock_release+0x1d5/0x250 [ 8184.614975][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8184.615233][ C2] ? ktime_get+0xb3/0x190 [ 8184.615446][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8184.615736][ C2] run_timer_softirq+0x72/0x100 [ 8184.615978][ C2] __do_softirq+0x1b9/0x7ff [ 8184.616203][ C2] irq_exit_rcu+0x98/0xc0 [ 8184.616419][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8184.616695][ C2] [ 8184.616842][ C2] [ 8184.616987][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8184.617285][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8184.617535][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8184.618478][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8184.618778][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8184.619163][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8184.619551][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8184.619939][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8184.620329][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8184.620739][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8184.621027][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8184.621288][ C2] default_idle_call+0x69/0xa0 [ 8184.621530][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8184.621783][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8184.622064][ C2] ? lock_release+0x1d5/0x250 [ 8184.622295][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8184.622563][ C2] do_idle+0xfb/0x160 [ 8184.622760][ C2] cpu_startup_entry+0x55/0x60 [ 8184.622996][ C2] start_secondary+0x21c/0x2b0 [ 8184.623232][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8184.623500][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8184.623801][ C2] [ 8184.623955][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5431s! [perl:4135] [ 8184.624360][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8184.625586][ C1] irq event stamp: 209232 [ 8184.625800][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8184.626319][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8184.626785][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8184.627243][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8184.627697][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8184.628135][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8184.628733][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8184.629052][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8184.630002][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8184.630305][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8184.630717][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8184.631119][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8184.631520][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8184.631929][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8184.632318][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8184.632756][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8184.633083][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8184.633477][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8184.633867][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8184.634259][ C1] PKRU: 55555554 [ 8184.634436][ C1] Call Trace: [ 8184.634602][ C1] [ 8184.634747][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8184.635003][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8184.635242][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8184.635514][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8184.635782][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8184.636062][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8184.636322][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8184.636626][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8184.636882][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8184.637186][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8184.637476][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8184.637782][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8184.638065][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8184.638355][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8184.638638][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8184.638942][ C1] ? get_stack_info+0x36/0xc0 [ 8184.639180][ C1] ? lock_acquire+0x1c1/0x220 [ 8184.639414][ C1] ? lock_release+0x1d5/0x250 [ 8184.639649][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8184.639893][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8184.640158][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8184.640440][ C1] ? lock_acquire+0x1c1/0x220 [ 8184.640696][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8184.640935][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8184.641197][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8184.641435][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8184.641684][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8184.641951][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8184.642219][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8184.642490][ C1] ip_local_deliver+0x19d/0x480 [ 8184.642750][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8184.643024][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8184.643293][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8184.643641][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8184.643895][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8184.644218][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8184.644474][ C1] ip_rcv+0x564/0x740 [ 8184.644673][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8184.644900][ C1] ? set_track_prepare+0x8a/0xd0 [ 8184.645147][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8184.645417][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8184.645682][ C1] ? skb_clone+0x10b/0x330 [ 8184.645905][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8184.646219][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8184.646518][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8184.646793][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8184.647079][ C1] ? __tcf_classify+0x329/0x7d0 [ 8184.647322][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8184.647549][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8184.647842][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8184.648119][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8184.648438][ C1] ? lock_acquire+0x1c1/0x220 [ 8184.648671][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8184.648961][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8184.649243][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8184.649552][ C1] ? __copy_skb_header+0xaf/0x490 [ 8184.649804][ C1] ? __skb_clone+0x57a/0x760 [ 8184.650034][ C1] netif_receive_skb+0x55/0x280 [ 8184.650278][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8184.650583][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8184.650936][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8184.651239][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8184.651513][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8184.651805][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8184.652122][ C1] ? hlock_class+0x4e/0x130 [ 8184.652351][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8184.652623][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8184.652895][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8184.653153][ C1] ? hlock_class+0x4e/0x130 [ 8184.653380][ C1] ? mark_lock+0x38/0x3e0 [ 8184.653595][ C1] ? stack_access_ok+0xda/0x1f0 [ 8184.653838][ C1] ? __lock_acquire+0xb67/0x1610 [ 8184.654086][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8184.654357][ C1] ? get_stack_info+0x36/0xc0 [ 8184.654593][ C1] ? stack_access_ok+0xda/0x1f0 [ 8184.654834][ C1] ? get_reg+0x119/0x190 [ 8184.655045][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8184.655309][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8184.655612][ C1] __tcf_classify+0x329/0x7d0 [ 8184.655850][ C1] tcf_classify+0x283/0x930 [ 8184.656075][ C1] ? arch_stack_walk+0xa2/0x100 [ 8184.656318][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8184.656570][ C1] ? get_stack_info+0x36/0xc0 [ 8184.656807][ C1] tc_run+0x2e4/0x5d0 [ 8184.657006][ C1] ? __pfx_tc_run+0x10/0x10 [ 8184.657235][ C1] ? lock_acquire+0x1c1/0x220 [ 8184.657469][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8184.657724][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8184.657972][ C1] ? lock_acquire+0x1c1/0x220 [ 8184.658204][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8184.658464][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8184.658762][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8184.659028][ C1] ? neigh_hh_output+0x348/0x590 [ 8184.659277][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8184.659537][ C1] ip_finish_output2+0x786/0x18e0 [ 8184.659787][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8184.660059][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8184.660399][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8184.660690][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8184.660943][ C1] ? __ip_finish_output+0x10f/0x770 [ 8184.661213][ C1] ip_output+0x16b/0x4f0 [ 8184.661432][ C1] ? run_timer_softirq+0x72/0x100 [ 8184.661690][ C1] ? __pfx_ip_output+0x10/0x10 [ 8184.661942][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8184.662223][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8184.662469][ C1] ? ip_local_out+0x114/0x3b0 [ 8184.662705][ C1] __ip_queue_xmit+0x672/0x1910 [ 8184.662948][ C1] ? __create_object+0x5e/0xb0 [ 8184.663189][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8184.663452][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8184.663726][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8184.663991][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8184.664269][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8184.664535][ C1] tcp_delack_timer+0x84/0x240 [ 8184.664774][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8184.665040][ C1] call_timer_fn+0x173/0x430 [ 8184.665272][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8184.665528][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8184.665784][ C1] __run_timers.part.0+0x52d/0x890 [ 8184.666038][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8184.666307][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8184.666584][ C1] ? lock_acquire+0x1c1/0x220 [ 8184.666817][ C1] ? clockevents_program_event+0xf6/0x300 [ 8184.667102][ C1] ? lock_release+0x1d5/0x250 [ 8184.667335][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8184.667595][ C1] ? ktime_get+0xb3/0x190 [ 8184.667810][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8184.668101][ C1] run_timer_softirq+0x72/0x100 [ 8184.668345][ C1] __do_softirq+0x1b9/0x7ff [ 8184.668572][ C1] irq_exit_rcu+0x98/0xc0 [ 8184.668789][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8184.669069][ C1] [ 8184.669215][ C1] [ 8184.669366][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8184.669663][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8184.669981][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8184.670960][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8184.671270][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8184.671672][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8184.672077][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8184.672467][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8184.672857][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8184.673253][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8184.673541][ C1] pipe_read+0xa16/0xdf0 [ 8184.673760][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8184.674030][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8184.674270][ C1] ? iterate_tty_write+0x299/0x540 [ 8184.674526][ C1] ? lock_release+0x1d5/0x250 [ 8184.674761][ C1] vfs_read+0x911/0xc00 [ 8184.674970][ C1] ? lock_acquire+0x1c1/0x220 [ 8184.675205][ C1] ? __might_fault+0xc6/0x180 [ 8184.675440][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8184.675673][ C1] ? __might_fault+0xc6/0x180 [ 8184.675908][ C1] ? lock_release+0x1d5/0x250 [ 8184.676143][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8184.676403][ C1] ? __fget_light+0x54/0x1e0 [ 8184.676635][ C1] ksys_read+0x17a/0x1e0 [ 8184.676847][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8184.677087][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8184.677386][ C1] do_syscall_64+0xc9/0x1e0 [ 8184.677612][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8184.677907][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8184.678128][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8184.679084][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8184.679497][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8184.679886][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8184.680278][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8184.680688][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8184.681088][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8184.681492][ C1] [ 8212.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5457s! [swapper/2:0] [ 8212.569681][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8212.570897][ C2] irq event stamp: 44114564 [ 8212.571121][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8212.571639][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8212.572134][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8212.572596][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8212.573051][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8212.573493][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8212.574086][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8212.574402][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8212.575343][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8212.575640][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8212.576027][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8212.576415][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8212.576801][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8212.577189][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8212.577577][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8212.578010][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8212.578332][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8212.578718][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8212.579107][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8212.579494][ C2] PKRU: 55555554 [ 8212.579670][ C2] Call Trace: [ 8212.579832][ C2] [ 8212.579978][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8212.580232][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8212.580468][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8212.580739][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8212.581003][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8212.581285][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8212.581541][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8212.581836][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8212.582090][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8212.582346][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8212.582647][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8212.582933][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8212.583239][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8212.583518][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8212.583805][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8212.584085][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8212.584387][ C2] ? get_stack_info+0x36/0xc0 [ 8212.584620][ C2] ? lock_acquire+0x1c1/0x220 [ 8212.584853][ C2] ? lock_release+0x1d5/0x250 [ 8212.585085][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8212.585327][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8212.585593][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8212.585868][ C2] ? lock_acquire+0x1c1/0x220 [ 8212.586100][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8212.586335][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8212.586586][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8212.586813][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8212.587052][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8212.587304][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8212.587572][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8212.587841][ C2] ip_local_deliver+0x19d/0x480 [ 8212.588080][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8212.588345][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8212.588601][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8212.588938][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8212.589185][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8212.589497][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8212.589752][ C2] ip_rcv+0x564/0x740 [ 8212.589951][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8212.590174][ C2] ? set_track_prepare+0x8a/0xd0 [ 8212.590421][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8212.590715][ C2] ? start_secondary+0x21c/0x2b0 [ 8212.590965][ C2] ? skb_clone+0x10b/0x330 [ 8212.591193][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8212.591510][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8212.591825][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8212.592097][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8212.592385][ C2] ? __tcf_classify+0x329/0x7d0 [ 8212.592625][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8212.592850][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8212.593141][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8212.593417][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8212.593734][ C2] ? lock_acquire+0x1c1/0x220 [ 8212.593967][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8212.594257][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8212.594535][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8212.594841][ C2] ? __copy_skb_header+0xaf/0x490 [ 8212.595092][ C2] ? __skb_clone+0x57a/0x760 [ 8212.595323][ C2] netif_receive_skb+0x55/0x280 [ 8212.595563][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8212.595866][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8212.596191][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8212.596482][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8212.596747][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8212.597030][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8212.597335][ C2] ? get_stack_info+0x36/0xc0 [ 8212.597568][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8212.597827][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8212.598134][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8212.598405][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8212.598673][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8212.598979][ C2] ? kernel_text_address+0x17/0xe0 [ 8212.599233][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8212.599537][ C2] ? arch_stack_walk+0x8c/0x100 [ 8212.599780][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8212.600036][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8212.600313][ C2] ? lock_acquire+0x1c1/0x220 [ 8212.600568][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8212.600848][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8212.601153][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8212.601429][ C2] ? get_stack_info+0x36/0xc0 [ 8212.601669][ C2] __tcf_classify+0x329/0x7d0 [ 8212.601915][ C2] tcf_classify+0x283/0x930 [ 8212.602141][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8212.602392][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8212.602696][ C2] tc_run+0x2e4/0x5d0 [ 8212.602897][ C2] ? __pfx_tc_run+0x10/0x10 [ 8212.603120][ C2] ? lock_acquire+0x1c1/0x220 [ 8212.603353][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8212.603607][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8212.603853][ C2] ? lock_acquire+0x1c1/0x220 [ 8212.604086][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8212.604344][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8212.604640][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8212.604904][ C2] ? neigh_hh_output+0x348/0x590 [ 8212.605150][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8212.605410][ C2] ip_finish_output2+0x786/0x18e0 [ 8212.605660][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8212.605988][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8212.606257][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8212.606502][ C2] ? __ip_finish_output+0x10f/0x770 [ 8212.606761][ C2] ip_output+0x16b/0x4f0 [ 8212.606972][ C2] ? __pfx_ip_output+0x10/0x10 [ 8212.607210][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8212.607477][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8212.607780][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8212.608048][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8212.608293][ C2] ? __alloc_skb+0xd4/0x280 [ 8212.608518][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8212.608780][ C2] ? tcp_fragment+0x168/0x1040 [ 8212.609019][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8212.609265][ C2] ? ip_local_out+0x114/0x3b0 [ 8212.609501][ C2] __ip_queue_xmit+0x672/0x1910 [ 8212.609741][ C2] ? __skb_clone+0x57a/0x760 [ 8212.609971][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8212.610231][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8212.610509][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8212.610768][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8212.611017][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8212.611319][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8212.611638][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8212.611889][ C2] tcp_send_loss_probe+0x348/0x830 [ 8212.612143][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8212.612405][ C2] tcp_write_timer+0x82/0x1d0 [ 8212.612640][ C2] call_timer_fn+0x173/0x430 [ 8212.612869][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8212.613124][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8212.613381][ C2] __run_timers.part.0+0x52d/0x890 [ 8212.613634][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8212.613896][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8212.614173][ C2] ? lock_acquire+0x1c1/0x220 [ 8212.614410][ C2] ? clockevents_program_event+0xf6/0x300 [ 8212.614692][ C2] ? lock_release+0x1d5/0x250 [ 8212.614924][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8212.615184][ C2] ? ktime_get+0xb3/0x190 [ 8212.615401][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8212.615689][ C2] run_timer_softirq+0x72/0x100 [ 8212.615929][ C2] __do_softirq+0x1b9/0x7ff [ 8212.616156][ C2] irq_exit_rcu+0x98/0xc0 [ 8212.616370][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8212.616654][ C2] [ 8212.616800][ C2] [ 8212.616947][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8212.617243][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8212.617493][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8212.618439][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8212.618738][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8212.619127][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8212.619517][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8212.619904][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8212.620292][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8212.620707][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8212.620997][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8212.621258][ C2] default_idle_call+0x69/0xa0 [ 8212.621503][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8212.621766][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8212.622033][ C2] ? lock_release+0x1d5/0x250 [ 8212.622267][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8212.622532][ C2] do_idle+0xfb/0x160 [ 8212.622729][ C2] cpu_startup_entry+0x55/0x60 [ 8212.622966][ C2] start_secondary+0x21c/0x2b0 [ 8212.623203][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8212.623464][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8212.623766][ C2] [ 8212.623919][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5457s! [perl:4135] [ 8212.624321][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8212.625550][ C1] irq event stamp: 209232 [ 8212.625765][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8212.626281][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8212.626747][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8212.627207][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8212.627658][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8212.628095][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8212.628696][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8212.629014][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8212.629965][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8212.630266][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8212.630680][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8212.631078][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8212.631479][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8212.631888][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8212.632279][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8212.632716][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8212.633042][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8212.633434][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8212.633827][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8212.634219][ C1] PKRU: 55555554 [ 8212.634397][ C1] Call Trace: [ 8212.634562][ C1] [ 8212.634708][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8212.634964][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8212.635203][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8212.635473][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8212.635739][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8212.636023][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8212.636284][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8212.636583][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8212.636839][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8212.637141][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8212.637431][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8212.637738][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8212.638020][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8212.638310][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8212.638593][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8212.638897][ C1] ? get_stack_info+0x36/0xc0 [ 8212.639132][ C1] ? lock_acquire+0x1c1/0x220 [ 8212.639369][ C1] ? lock_release+0x1d5/0x250 [ 8212.639604][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8212.639846][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8212.640112][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8212.640391][ C1] ? lock_acquire+0x1c1/0x220 [ 8212.640648][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8212.640890][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8212.641153][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8212.641388][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8212.641635][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8212.641900][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8212.642170][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8212.642442][ C1] ip_local_deliver+0x19d/0x480 [ 8212.642683][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8212.642949][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8212.643206][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8212.643545][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8212.643791][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8212.644104][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8212.644361][ C1] ip_rcv+0x564/0x740 [ 8212.644563][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8212.644786][ C1] ? set_track_prepare+0x8a/0xd0 [ 8212.645033][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8212.645305][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8212.645572][ C1] ? skb_clone+0x10b/0x330 [ 8212.645792][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8212.646104][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8212.646405][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8212.646678][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8212.646968][ C1] ? __tcf_classify+0x329/0x7d0 [ 8212.647213][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8212.647436][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8212.647730][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8212.648009][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8212.648329][ C1] ? lock_acquire+0x1c1/0x220 [ 8212.648561][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8212.648852][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8212.649130][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8212.649441][ C1] ? __copy_skb_header+0xaf/0x490 [ 8212.649694][ C1] ? __skb_clone+0x57a/0x760 [ 8212.649924][ C1] netif_receive_skb+0x55/0x280 [ 8212.650168][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8212.650474][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8212.650825][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8212.651127][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8212.651404][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8212.651692][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8212.652008][ C1] ? hlock_class+0x4e/0x130 [ 8212.652235][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8212.652505][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8212.652774][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8212.653031][ C1] ? hlock_class+0x4e/0x130 [ 8212.653259][ C1] ? mark_lock+0x38/0x3e0 [ 8212.653472][ C1] ? stack_access_ok+0xda/0x1f0 [ 8212.653714][ C1] ? __lock_acquire+0xb67/0x1610 [ 8212.653962][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8212.654239][ C1] ? get_stack_info+0x36/0xc0 [ 8212.654473][ C1] ? stack_access_ok+0xda/0x1f0 [ 8212.654714][ C1] ? get_reg+0x119/0x190 [ 8212.654926][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8212.655190][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8212.655492][ C1] __tcf_classify+0x329/0x7d0 [ 8212.655727][ C1] tcf_classify+0x283/0x930 [ 8212.655955][ C1] ? arch_stack_walk+0xa2/0x100 [ 8212.656199][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8212.656450][ C1] ? get_stack_info+0x36/0xc0 [ 8212.656685][ C1] tc_run+0x2e4/0x5d0 [ 8212.656886][ C1] ? __pfx_tc_run+0x10/0x10 [ 8212.657110][ C1] ? lock_acquire+0x1c1/0x220 [ 8212.657345][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8212.657600][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8212.657847][ C1] ? lock_acquire+0x1c1/0x220 [ 8212.658081][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8212.658341][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8212.658639][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8212.658904][ C1] ? neigh_hh_output+0x348/0x590 [ 8212.659151][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8212.659412][ C1] ip_finish_output2+0x786/0x18e0 [ 8212.659662][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8212.659932][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8212.660263][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8212.660557][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8212.660809][ C1] ? __ip_finish_output+0x10f/0x770 [ 8212.661075][ C1] ip_output+0x16b/0x4f0 [ 8212.661292][ C1] ? run_timer_softirq+0x72/0x100 [ 8212.661549][ C1] ? __pfx_ip_output+0x10/0x10 [ 8212.661805][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8212.662085][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8212.662331][ C1] ? ip_local_out+0x114/0x3b0 [ 8212.662566][ C1] __ip_queue_xmit+0x672/0x1910 [ 8212.662809][ C1] ? __create_object+0x5e/0xb0 [ 8212.663048][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8212.663309][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8212.663583][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8212.663851][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8212.664125][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8212.664391][ C1] tcp_delack_timer+0x84/0x240 [ 8212.664630][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8212.664895][ C1] call_timer_fn+0x173/0x430 [ 8212.665127][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8212.665383][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8212.665637][ C1] __run_timers.part.0+0x52d/0x890 [ 8212.665891][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8212.666157][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8212.666439][ C1] ? lock_acquire+0x1c1/0x220 [ 8212.666672][ C1] ? clockevents_program_event+0xf6/0x300 [ 8212.666955][ C1] ? lock_release+0x1d5/0x250 [ 8212.667188][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8212.667447][ C1] ? ktime_get+0xb3/0x190 [ 8212.667662][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8212.667953][ C1] run_timer_softirq+0x72/0x100 [ 8212.668197][ C1] __do_softirq+0x1b9/0x7ff [ 8212.668425][ C1] irq_exit_rcu+0x98/0xc0 [ 8212.668640][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8212.668918][ C1] [ 8212.669068][ C1] [ 8212.669215][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8212.669513][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8212.669831][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8212.670805][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8212.671115][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8212.671516][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8212.671920][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8212.672312][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8212.672701][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8212.673091][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8212.673383][ C1] pipe_read+0xa16/0xdf0 [ 8212.673598][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8212.673869][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8212.674110][ C1] ? iterate_tty_write+0x299/0x540 [ 8212.674367][ C1] ? lock_release+0x1d5/0x250 [ 8212.674604][ C1] vfs_read+0x911/0xc00 [ 8212.674811][ C1] ? lock_acquire+0x1c1/0x220 [ 8212.675046][ C1] ? __might_fault+0xc6/0x180 [ 8212.675283][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8212.675518][ C1] ? __might_fault+0xc6/0x180 [ 8212.675750][ C1] ? lock_release+0x1d5/0x250 [ 8212.675985][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8212.676244][ C1] ? __fget_light+0x54/0x1e0 [ 8212.676476][ C1] ksys_read+0x17a/0x1e0 [ 8212.676687][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8212.676927][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8212.677226][ C1] do_syscall_64+0xc9/0x1e0 [ 8212.677453][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8212.677745][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8212.677968][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8212.678917][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8212.679329][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8212.679719][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8212.680109][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8212.680501][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8212.680915][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8212.681321][ C1] [ 8235.298103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8235.298452][ C1] rcu: 1-....: (5866221 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1429862 [ 8235.298999][ C1] rcu: (t=5880411 jiffies g=1882453 q=721 ncpus=4) [ 8235.299327][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8235.299766][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8235.300365][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12b/0xb90 [ 8235.300711][ C1] Code: 24 80 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc 90 e9 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 [ 8235.301691][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8235.301993][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8235.302385][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8235.302776][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8235.303166][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8235.303555][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8235.303945][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8235.304383][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8235.304709][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8235.305101][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8235.305491][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8235.305882][ C1] PKRU: 55555554 [ 8235.306058][ C1] Call Trace: [ 8235.306226][ C1] [ 8235.306369][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8235.306638][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8235.306883][ C1] ? check_cpu_stall+0x284/0x500 [ 8235.307129][ C1] ? rcu_pending+0x92/0x360 [ 8235.307356][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8235.307619][ C1] ? update_process_times+0xb9/0x110 [ 8235.307882][ C1] ? tick_sched_handle+0x67/0x130 [ 8235.308132][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8235.308413][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8235.308651][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8235.308956][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8235.309223][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8235.309503][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8235.309763][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8235.310060][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8235.310316][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8235.310645][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8235.310942][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8235.311259][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8235.311549][ C1] ? queued_spin_lock_slowpath+0x12b/0xb90 [ 8235.311850][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8235.312131][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8235.312436][ C1] ? get_stack_info+0x36/0xc0 [ 8235.312671][ C1] ? lock_acquire+0x1c1/0x220 [ 8235.312906][ C1] ? lock_release+0x1d5/0x250 [ 8235.313138][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8235.313383][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8235.313649][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8235.313928][ C1] ? lock_acquire+0x1c1/0x220 [ 8235.314163][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8235.314397][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8235.314652][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8235.314882][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8235.315123][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8235.315377][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8235.315644][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8235.315916][ C1] ip_local_deliver+0x19d/0x480 [ 8235.316156][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8235.316425][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8235.316683][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8235.317021][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8235.317268][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8235.317581][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8235.317837][ C1] ip_rcv+0x564/0x740 [ 8235.318036][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8235.318263][ C1] ? set_track_prepare+0x8a/0xd0 [ 8235.318511][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8235.318780][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8235.319044][ C1] ? skb_clone+0x10b/0x330 [ 8235.319268][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8235.319580][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8235.319880][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8235.320157][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8235.320466][ C1] ? __tcf_classify+0x329/0x7d0 [ 8235.320713][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8235.320946][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8235.321247][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8235.321532][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8235.321862][ C1] ? lock_acquire+0x1c1/0x220 [ 8235.322094][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8235.322385][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8235.322662][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8235.322971][ C1] ? __copy_skb_header+0xaf/0x490 [ 8235.323224][ C1] ? __skb_clone+0x57a/0x760 [ 8235.323454][ C1] netif_receive_skb+0x55/0x280 [ 8235.323697][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8235.324001][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8235.324326][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8235.324618][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8235.324885][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8235.325168][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8235.325472][ C1] ? hlock_class+0x4e/0x130 [ 8235.325699][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8235.325968][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8235.326240][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8235.326497][ C1] ? hlock_class+0x4e/0x130 [ 8235.326722][ C1] ? mark_lock+0x38/0x3e0 [ 8235.326936][ C1] ? stack_access_ok+0xda/0x1f0 [ 8235.327179][ C1] ? __lock_acquire+0xb67/0x1610 [ 8235.327427][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8235.327696][ C1] ? get_stack_info+0x36/0xc0 [ 8235.327931][ C1] ? stack_access_ok+0xda/0x1f0 [ 8235.328173][ C1] ? get_reg+0x119/0x190 [ 8235.328386][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8235.328646][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8235.328949][ C1] __tcf_classify+0x329/0x7d0 [ 8235.329186][ C1] tcf_classify+0x283/0x930 [ 8235.329412][ C1] ? arch_stack_walk+0xa2/0x100 [ 8235.329653][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8235.329903][ C1] ? get_stack_info+0x36/0xc0 [ 8235.330138][ C1] tc_run+0x2e4/0x5d0 [ 8235.330339][ C1] ? __pfx_tc_run+0x10/0x10 [ 8235.330569][ C1] ? lock_acquire+0x1c1/0x220 [ 8235.330801][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8235.331056][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8235.331304][ C1] ? lock_acquire+0x1c1/0x220 [ 8235.331533][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8235.331793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8235.332090][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8235.332357][ C1] ? neigh_hh_output+0x348/0x590 [ 8235.332603][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8235.332862][ C1] ip_finish_output2+0x786/0x18e0 [ 8235.333111][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8235.333383][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8235.333711][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8235.333978][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8235.334226][ C1] ? __ip_finish_output+0x10f/0x770 [ 8235.334485][ C1] ip_output+0x16b/0x4f0 [ 8235.334697][ C1] ? run_timer_softirq+0x72/0x100 [ 8235.334947][ C1] ? __pfx_ip_output+0x10/0x10 [ 8235.335185][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8235.335464][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8235.335710][ C1] ? ip_local_out+0x114/0x3b0 [ 8235.335945][ C1] __ip_queue_xmit+0x672/0x1910 [ 8235.336208][ C1] ? __create_object+0x5e/0xb0 [ 8235.336452][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8235.336720][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8235.337001][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8235.337283][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8235.337558][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8235.337822][ C1] tcp_delack_timer+0x84/0x240 [ 8235.338061][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8235.338327][ C1] call_timer_fn+0x173/0x430 [ 8235.338558][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8235.338814][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8235.339069][ C1] __run_timers.part.0+0x52d/0x890 [ 8235.339324][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8235.339590][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8235.339868][ C1] ? lock_acquire+0x1c1/0x220 [ 8235.340101][ C1] ? clockevents_program_event+0xf6/0x300 [ 8235.340391][ C1] ? lock_release+0x1d5/0x250 [ 8235.340646][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8235.340911][ C1] ? ktime_get+0xb3/0x190 [ 8235.341131][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8235.341429][ C1] run_timer_softirq+0x72/0x100 [ 8235.341686][ C1] __do_softirq+0x1b9/0x7ff [ 8235.341912][ C1] irq_exit_rcu+0x98/0xc0 [ 8235.342128][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8235.342406][ C1] [ 8235.342553][ C1] [ 8235.342700][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8235.342997][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8235.343317][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8235.344266][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8235.344565][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8235.344954][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8235.345343][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8235.345731][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8235.346121][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8235.346514][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8235.346804][ C1] pipe_read+0xa16/0xdf0 [ 8235.347019][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8235.347291][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8235.347529][ C1] ? iterate_tty_write+0x299/0x540 [ 8235.347784][ C1] ? lock_release+0x1d5/0x250 [ 8235.348019][ C1] vfs_read+0x911/0xc00 [ 8235.348228][ C1] ? lock_acquire+0x1c1/0x220 [ 8235.348461][ C1] ? __might_fault+0xc6/0x180 [ 8235.348697][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8235.348929][ C1] ? __might_fault+0xc6/0x180 [ 8235.349163][ C1] ? lock_release+0x1d5/0x250 [ 8235.349402][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8235.349660][ C1] ? __fget_light+0x54/0x1e0 [ 8235.349892][ C1] ksys_read+0x17a/0x1e0 [ 8235.350103][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8235.350347][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8235.350669][ C1] do_syscall_64+0xc9/0x1e0 [ 8235.350900][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8235.351203][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8235.351430][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8235.352389][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8235.352799][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8235.353187][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8235.353580][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8235.353968][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8235.354357][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8235.354748][ C1] [ 8235.354904][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8235.355170][ C2] NMI backtrace for cpu 2 [ 8235.355175][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8235.355181][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8235.355185][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8235.355195][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8235.355201][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 8235.355205][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8235.355209][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8235.355213][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8235.355217][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8235.355221][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8235.355224][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8235.355229][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8235.355235][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8235.355239][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8235.355242][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8235.355245][ C2] PKRU: 55555554 [ 8235.355248][ C2] Call Trace: [ 8235.355250][ C2] [ 8235.355253][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8235.355265][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8235.355272][ C2] ? nmi_handle+0x153/0x420 [ 8235.355282][ C2] ? default_do_nmi+0x41/0x100 [ 8235.355289][ C2] ? exc_nmi+0xf3/0x120 [ 8235.355295][ C2] ? end_repeat_nmi+0xf/0x60 [ 8235.355306][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8235.355312][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8235.355315][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8235.355319][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8235.355322][ C2] [ 8235.355322][ C2] [ 8235.355323][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 8235.355327][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8235.355329][ C2] ? get_stack_info+0x36/0xc0 [ 8235.355333][ C2] ? lock_acquire+0x1c1/0x220 [ 8235.355337][ C2] ? lock_release+0x1d5/0x250 [ 8235.355340][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8235.355344][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8235.355347][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8235.355350][ C2] ? lock_acquire+0x1c1/0x220 [ 8235.355352][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8235.355356][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8235.355359][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8235.355365][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8235.355367][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8235.355372][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8235.355376][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8235.355380][ C2] ip_local_deliver+0x19d/0x480 [ 8235.355383][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8235.355385][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8235.355387][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8235.355392][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8235.355396][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8235.355399][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8235.355408][ C2] ip_rcv+0x564/0x740 [ 8235.355411][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8235.355414][ C2] ? set_track_prepare+0x8a/0xd0 [ 8235.355418][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8235.355421][ C2] ? start_secondary+0x21c/0x2b0 [ 8235.355424][ C2] ? skb_clone+0x10b/0x330 [ 8235.355427][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8235.355432][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8235.355437][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8235.355441][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8235.355449][ C2] ? __tcf_classify+0x329/0x7d0 [ 8235.355453][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8235.355455][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8235.355458][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8235.355462][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8235.355466][ C2] ? lock_acquire+0x1c1/0x220 [ 8235.355468][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8235.355473][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8235.355476][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8235.355480][ C2] ? __copy_skb_header+0xaf/0x490 [ 8235.355484][ C2] ? __skb_clone+0x57a/0x760 [ 8235.355486][ C2] netif_receive_skb+0x55/0x280 [ 8235.355490][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8235.355496][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8235.355503][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8235.355509][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8235.355514][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8235.355523][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8235.355530][ C2] ? get_stack_info+0x36/0xc0 [ 8235.355535][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8235.355538][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8235.355541][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8235.355544][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8235.355548][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8235.355550][ C2] ? kernel_text_address+0x17/0xe0 [ 8235.355553][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8235.355557][ C2] ? arch_stack_walk+0x8c/0x100 [ 8235.355561][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8235.355564][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8235.355568][ C2] ? lock_acquire+0x1c1/0x220 [ 8235.355570][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8235.355575][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8235.355579][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8235.355581][ C2] ? get_stack_info+0x36/0xc0 [ 8235.355586][ C2] __tcf_classify+0x329/0x7d0 [ 8235.355591][ C2] tcf_classify+0x283/0x930 [ 8235.355595][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8235.355598][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8235.355603][ C2] tc_run+0x2e4/0x5d0 [ 8235.355606][ C2] ? __pfx_tc_run+0x10/0x10 [ 8235.355610][ C2] ? lock_acquire+0x1c1/0x220 [ 8235.355612][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8235.355616][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8235.355620][ C2] ? lock_acquire+0x1c1/0x220 [ 8235.355622][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8235.355625][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8235.355628][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8235.355631][ C2] ? neigh_hh_output+0x348/0x590 [ 8235.355634][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8235.355638][ C2] ip_finish_output2+0x786/0x18e0 [ 8235.355642][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8235.355649][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8235.355652][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8235.355656][ C2] ? __ip_finish_output+0x10f/0x770 [ 8235.355659][ C2] ip_output+0x16b/0x4f0 [ 8235.355662][ C2] ? __pfx_ip_output+0x10/0x10 [ 8235.355664][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8235.355667][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8235.355671][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8235.355673][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8235.355676][ C2] ? __alloc_skb+0xd4/0x280 [ 8235.355678][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8235.355682][ C2] ? tcp_fragment+0x168/0x1040 [ 8235.355685][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8235.355688][ C2] ? ip_local_out+0x114/0x3b0 [ 8235.355692][ C2] __ip_queue_xmit+0x672/0x1910 [ 8235.355695][ C2] ? __skb_clone+0x57a/0x760 [ 8235.355698][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8235.355703][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8235.355706][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8235.355710][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8235.355714][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8235.355718][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8235.355721][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8235.355724][ C2] tcp_send_loss_probe+0x348/0x830 [ 8235.355727][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8235.355730][ C2] tcp_write_timer+0x82/0x1d0 [ 8235.355733][ C2] call_timer_fn+0x173/0x430 [ 8235.355736][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8235.355741][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8235.355744][ C2] __run_timers.part.0+0x52d/0x890 [ 8235.355747][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8235.355751][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8235.355754][ C2] ? lock_acquire+0x1c1/0x220 [ 8235.355756][ C2] ? clockevents_program_event+0xf6/0x300 [ 8235.355760][ C2] ? lock_release+0x1d5/0x250 [ 8235.355763][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8235.355766][ C2] ? ktime_get+0xb3/0x190 [ 8235.355770][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8235.355774][ C2] run_timer_softirq+0x72/0x100 [ 8235.355778][ C2] __do_softirq+0x1b9/0x7ff [ 8235.355782][ C2] irq_exit_rcu+0x98/0xc0 [ 8235.355785][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8235.355788][ C2] [ 8235.355789][ C2] [ 8235.355790][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8235.355793][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8235.355796][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8235.355799][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8235.355800][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8235.355802][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8235.355803][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8235.355804][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8235.355806][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8235.355809][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8235.355813][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8235.355815][ C2] default_idle_call+0x69/0xa0 [ 8235.355818][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8235.355821][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8235.355824][ C2] ? lock_release+0x1d5/0x250 [ 8235.355826][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8235.355830][ C2] do_idle+0xfb/0x160 [ 8235.355833][ C2] cpu_startup_entry+0x55/0x60 [ 8235.355835][ C2] start_secondary+0x21c/0x2b0 [ 8235.355837][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8235.355841][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8235.355847][ C2] [ 8260.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5502s! [swapper/2:0] [ 8260.569674][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8260.570921][ C2] irq event stamp: 44114564 [ 8260.571147][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8260.571684][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8260.572179][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8260.572642][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8260.573094][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8260.573534][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8260.574126][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8260.574440][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8260.575379][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8260.575676][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8260.576060][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8260.576444][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8260.576832][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8260.577218][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8260.577603][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8260.578034][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8260.578355][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8260.578744][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8260.579130][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8260.579514][ C2] PKRU: 55555554 [ 8260.579689][ C2] Call Trace: [ 8260.579854][ C2] [ 8260.579996][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8260.580250][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8260.580489][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8260.580755][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8260.581020][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8260.581300][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8260.581555][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8260.581850][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8260.582102][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8260.582357][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8260.582657][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8260.582942][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8260.583245][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8260.583526][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8260.583811][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8260.584091][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8260.584393][ C2] ? get_stack_info+0x36/0xc0 [ 8260.584626][ C2] ? lock_acquire+0x1c1/0x220 [ 8260.584856][ C2] ? lock_release+0x1d5/0x250 [ 8260.585087][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8260.585329][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8260.585592][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8260.585868][ C2] ? lock_acquire+0x1c1/0x220 [ 8260.586097][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8260.586332][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8260.586584][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8260.586812][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8260.587052][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8260.587305][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8260.587570][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8260.587836][ C2] ip_local_deliver+0x19d/0x480 [ 8260.588076][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8260.588339][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8260.588597][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8260.588933][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8260.589179][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8260.589490][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8260.589742][ C2] ip_rcv+0x564/0x740 [ 8260.589939][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8260.590163][ C2] ? set_track_prepare+0x8a/0xd0 [ 8260.590433][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8260.590708][ C2] ? start_secondary+0x21c/0x2b0 [ 8260.590958][ C2] ? skb_clone+0x10b/0x330 [ 8260.591183][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8260.591514][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8260.591812][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8260.592084][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8260.592371][ C2] ? __tcf_classify+0x329/0x7d0 [ 8260.592613][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8260.592835][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8260.593124][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8260.593401][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8260.593716][ C2] ? lock_acquire+0x1c1/0x220 [ 8260.593945][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8260.594235][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8260.594511][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8260.594817][ C2] ? __copy_skb_header+0xaf/0x490 [ 8260.595067][ C2] ? __skb_clone+0x57a/0x760 [ 8260.595297][ C2] netif_receive_skb+0x55/0x280 [ 8260.595538][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8260.595841][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8260.596163][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8260.596452][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8260.596719][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8260.596997][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8260.597301][ C2] ? get_stack_info+0x36/0xc0 [ 8260.597536][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8260.597791][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8260.598098][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8260.598365][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8260.598633][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8260.598938][ C2] ? kernel_text_address+0x17/0xe0 [ 8260.599190][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8260.599494][ C2] ? arch_stack_walk+0x8c/0x100 [ 8260.599734][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8260.599989][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8260.600268][ C2] ? lock_acquire+0x1c1/0x220 [ 8260.600523][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8260.600803][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8260.601107][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8260.601382][ C2] ? get_stack_info+0x36/0xc0 [ 8260.601630][ C2] __tcf_classify+0x329/0x7d0 [ 8260.601862][ C2] tcf_classify+0x283/0x930 [ 8260.602088][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8260.602337][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8260.602641][ C2] tc_run+0x2e4/0x5d0 [ 8260.602838][ C2] ? __pfx_tc_run+0x10/0x10 [ 8260.603062][ C2] ? lock_acquire+0x1c1/0x220 [ 8260.603293][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8260.603547][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8260.603792][ C2] ? lock_acquire+0x1c1/0x220 [ 8260.604023][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8260.604281][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8260.604575][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8260.604839][ C2] ? neigh_hh_output+0x348/0x590 [ 8260.605083][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8260.605341][ C2] ip_finish_output2+0x786/0x18e0 [ 8260.605589][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8260.605918][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8260.606185][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8260.606432][ C2] ? __ip_finish_output+0x10f/0x770 [ 8260.606689][ C2] ip_output+0x16b/0x4f0 [ 8260.606898][ C2] ? __pfx_ip_output+0x10/0x10 [ 8260.607134][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8260.607402][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8260.607703][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8260.607972][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8260.608217][ C2] ? __alloc_skb+0xd4/0x280 [ 8260.608439][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8260.608698][ C2] ? tcp_fragment+0x168/0x1040 [ 8260.608936][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8260.609180][ C2] ? ip_local_out+0x114/0x3b0 [ 8260.609413][ C2] __ip_queue_xmit+0x672/0x1910 [ 8260.609654][ C2] ? __skb_clone+0x57a/0x760 [ 8260.609881][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8260.610140][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8260.610417][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8260.610653][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8260.610895][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8260.611184][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8260.611494][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8260.611731][ C2] tcp_send_loss_probe+0x348/0x830 [ 8260.611982][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8260.612242][ C2] tcp_write_timer+0x82/0x1d0 [ 8260.612475][ C2] call_timer_fn+0x173/0x430 [ 8260.612704][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8260.612958][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8260.613212][ C2] __run_timers.part.0+0x52d/0x890 [ 8260.613464][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8260.613724][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8260.614002][ C2] ? lock_acquire+0x1c1/0x220 [ 8260.614232][ C2] ? clockevents_program_event+0xf6/0x300 [ 8260.614515][ C2] ? lock_release+0x1d5/0x250 [ 8260.614747][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8260.615003][ C2] ? ktime_get+0xb3/0x190 [ 8260.615216][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8260.615503][ C2] run_timer_softirq+0x72/0x100 [ 8260.615745][ C2] __do_softirq+0x1b9/0x7ff [ 8260.615968][ C2] irq_exit_rcu+0x98/0xc0 [ 8260.616184][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8260.616459][ C2] [ 8260.616605][ C2] [ 8260.616751][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8260.617046][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8260.617296][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8260.618236][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8260.618534][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8260.618920][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8260.619306][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8260.619691][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8260.620079][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8260.620491][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8260.620777][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8260.621035][ C2] default_idle_call+0x69/0xa0 [ 8260.621277][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8260.621535][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8260.621804][ C2] ? lock_release+0x1d5/0x250 [ 8260.622034][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8260.622301][ C2] do_idle+0xfb/0x160 [ 8260.622499][ C2] cpu_startup_entry+0x55/0x60 [ 8260.622734][ C2] start_secondary+0x21c/0x2b0 [ 8260.622968][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8260.623232][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8260.623531][ C2] [ 8260.623686][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5502s! [perl:4135] [ 8260.624087][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8260.625308][ C1] irq event stamp: 209232 [ 8260.625520][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8260.626036][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8260.626503][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8260.626959][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8260.627413][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8260.627851][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8260.628448][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8260.628761][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8260.629710][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8260.630011][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8260.630406][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8260.630798][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8260.631188][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8260.631578][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8260.631967][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8260.632404][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8260.632729][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8260.633121][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8260.633511][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8260.633901][ C1] PKRU: 55555554 [ 8260.634079][ C1] Call Trace: [ 8260.634247][ C1] [ 8260.634390][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8260.634646][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8260.634883][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8260.635154][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8260.635423][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8260.635703][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8260.635962][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8260.636262][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8260.636517][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8260.636820][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8260.637109][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8260.637415][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8260.637698][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8260.637980][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8260.638263][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8260.638568][ C1] ? get_stack_info+0x36/0xc0 [ 8260.638803][ C1] ? lock_acquire+0x1c1/0x220 [ 8260.639036][ C1] ? lock_release+0x1d5/0x250 [ 8260.639272][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8260.639514][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8260.639779][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8260.640058][ C1] ? lock_acquire+0x1c1/0x220 [ 8260.640293][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8260.640552][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8260.640811][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8260.641047][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8260.641296][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8260.641563][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8260.641830][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8260.642100][ C1] ip_local_deliver+0x19d/0x480 [ 8260.642343][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8260.642608][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8260.642866][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8260.643205][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8260.643453][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8260.643765][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8260.644021][ C1] ip_rcv+0x564/0x740 [ 8260.644221][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8260.644447][ C1] ? set_track_prepare+0x8a/0xd0 [ 8260.644694][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8260.644963][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8260.645229][ C1] ? skb_clone+0x10b/0x330 [ 8260.645451][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8260.645762][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8260.646059][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8260.646336][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8260.646622][ C1] ? __tcf_classify+0x329/0x7d0 [ 8260.646865][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8260.647090][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8260.647382][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8260.647663][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8260.647980][ C1] ? lock_acquire+0x1c1/0x220 [ 8260.648215][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8260.648503][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8260.648783][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8260.649093][ C1] ? __copy_skb_header+0xaf/0x490 [ 8260.649346][ C1] ? __skb_clone+0x57a/0x760 [ 8260.649573][ C1] netif_receive_skb+0x55/0x280 [ 8260.649816][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8260.650120][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8260.650468][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8260.650769][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8260.651043][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8260.651332][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8260.651653][ C1] ? hlock_class+0x4e/0x130 [ 8260.651880][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8260.652149][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8260.652420][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8260.652679][ C1] ? hlock_class+0x4e/0x130 [ 8260.652903][ C1] ? mark_lock+0x38/0x3e0 [ 8260.653119][ C1] ? stack_access_ok+0xda/0x1f0 [ 8260.653362][ C1] ? __lock_acquire+0xb67/0x1610 [ 8260.653609][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8260.653880][ C1] ? get_stack_info+0x36/0xc0 [ 8260.654114][ C1] ? stack_access_ok+0xda/0x1f0 [ 8260.654354][ C1] ? get_reg+0x119/0x190 [ 8260.654569][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8260.654831][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8260.655133][ C1] __tcf_classify+0x329/0x7d0 [ 8260.655370][ C1] tcf_classify+0x283/0x930 [ 8260.655597][ C1] ? arch_stack_walk+0xa2/0x100 [ 8260.655839][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8260.656090][ C1] ? get_stack_info+0x36/0xc0 [ 8260.656328][ C1] tc_run+0x2e4/0x5d0 [ 8260.656532][ C1] ? __pfx_tc_run+0x10/0x10 [ 8260.656758][ C1] ? lock_acquire+0x1c1/0x220 [ 8260.656990][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8260.657246][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8260.657495][ C1] ? lock_acquire+0x1c1/0x220 [ 8260.657729][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8260.657986][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8260.658285][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8260.658551][ C1] ? neigh_hh_output+0x348/0x590 [ 8260.658796][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8260.659053][ C1] ip_finish_output2+0x786/0x18e0 [ 8260.659306][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8260.659577][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8260.659907][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8260.660177][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8260.660447][ C1] ? __ip_finish_output+0x10f/0x770 [ 8260.660711][ C1] ip_output+0x16b/0x4f0 [ 8260.660928][ C1] ? run_timer_softirq+0x72/0x100 [ 8260.661186][ C1] ? __pfx_ip_output+0x10/0x10 [ 8260.661429][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8260.661723][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8260.661969][ C1] ? ip_local_out+0x114/0x3b0 [ 8260.662203][ C1] __ip_queue_xmit+0x672/0x1910 [ 8260.662444][ C1] ? __create_object+0x5e/0xb0 [ 8260.662683][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8260.662943][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8260.663221][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8260.663487][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8260.663760][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8260.664026][ C1] tcp_delack_timer+0x84/0x240 [ 8260.664264][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8260.664531][ C1] call_timer_fn+0x173/0x430 [ 8260.664760][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8260.665015][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8260.665270][ C1] __run_timers.part.0+0x52d/0x890 [ 8260.665524][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8260.665792][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8260.666068][ C1] ? lock_acquire+0x1c1/0x220 [ 8260.666303][ C1] ? clockevents_program_event+0xf6/0x300 [ 8260.666585][ C1] ? lock_release+0x1d5/0x250 [ 8260.666819][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8260.667076][ C1] ? ktime_get+0xb3/0x190 [ 8260.667296][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8260.667586][ C1] run_timer_softirq+0x72/0x100 [ 8260.667829][ C1] __do_softirq+0x1b9/0x7ff [ 8260.668057][ C1] irq_exit_rcu+0x98/0xc0 [ 8260.668272][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8260.668551][ C1] [ 8260.668698][ C1] [ 8260.668849][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8260.669145][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8260.669462][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8260.670414][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8260.670715][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8260.671105][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8260.671497][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8260.671887][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8260.672278][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8260.672669][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8260.672958][ C1] pipe_read+0xa16/0xdf0 [ 8260.673174][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8260.673446][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8260.673684][ C1] ? iterate_tty_write+0x299/0x540 [ 8260.673939][ C1] ? lock_release+0x1d5/0x250 [ 8260.674172][ C1] vfs_read+0x911/0xc00 [ 8260.674384][ C1] ? lock_acquire+0x1c1/0x220 [ 8260.674615][ C1] ? __might_fault+0xc6/0x180 [ 8260.674849][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8260.675083][ C1] ? __might_fault+0xc6/0x180 [ 8260.675319][ C1] ? lock_release+0x1d5/0x250 [ 8260.675552][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8260.675810][ C1] ? __fget_light+0x54/0x1e0 [ 8260.676040][ C1] ksys_read+0x17a/0x1e0 [ 8260.676255][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8260.676493][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8260.676789][ C1] do_syscall_64+0xc9/0x1e0 [ 8260.677016][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8260.677309][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8260.677531][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8260.678476][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8260.678889][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8260.679279][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8260.679669][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8260.680059][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8260.680473][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8260.680875][ C1] [ 8288.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5528s! [swapper/2:0] [ 8288.569690][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8288.570938][ C2] irq event stamp: 44114564 [ 8288.571165][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8288.571695][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8288.572189][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8288.572651][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8288.573104][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8288.573544][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8288.574137][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8288.574450][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8288.575386][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8288.575683][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8288.576067][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8288.576452][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8288.576838][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8288.577224][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8288.577607][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8288.578037][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8288.578359][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8288.578749][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8288.579135][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8288.579521][ C2] PKRU: 55555554 [ 8288.579697][ C2] Call Trace: [ 8288.579862][ C2] [ 8288.580004][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8288.580261][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8288.580497][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8288.580763][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8288.581026][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8288.581305][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8288.581564][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8288.581859][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8288.582111][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8288.582364][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8288.582664][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8288.582947][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8288.583253][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8288.583534][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8288.583820][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8288.584101][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8288.584403][ C2] ? get_stack_info+0x36/0xc0 [ 8288.584635][ C2] ? lock_acquire+0x1c1/0x220 [ 8288.584867][ C2] ? lock_release+0x1d5/0x250 [ 8288.585099][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8288.585341][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8288.585602][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8288.585878][ C2] ? lock_acquire+0x1c1/0x220 [ 8288.586107][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8288.586342][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8288.586595][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8288.586822][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8288.587062][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8288.587314][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8288.587581][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8288.587849][ C2] ip_local_deliver+0x19d/0x480 [ 8288.588088][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8288.588351][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8288.588607][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8288.588945][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8288.589191][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8288.589501][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8288.589755][ C2] ip_rcv+0x564/0x740 [ 8288.589953][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8288.590183][ C2] ? set_track_prepare+0x8a/0xd0 [ 8288.590430][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8288.590698][ C2] ? start_secondary+0x21c/0x2b0 [ 8288.590942][ C2] ? skb_clone+0x10b/0x330 [ 8288.591161][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8288.591471][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8288.591767][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8288.592040][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8288.592327][ C2] ? __tcf_classify+0x329/0x7d0 [ 8288.592569][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8288.592791][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8288.593082][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8288.593359][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8288.593675][ C2] ? lock_acquire+0x1c1/0x220 [ 8288.593904][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8288.594193][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8288.594470][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8288.594776][ C2] ? __copy_skb_header+0xaf/0x490 [ 8288.595029][ C2] ? __skb_clone+0x57a/0x760 [ 8288.595259][ C2] netif_receive_skb+0x55/0x280 [ 8288.595499][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8288.595803][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8288.596125][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8288.596415][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8288.596681][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8288.596959][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8288.597264][ C2] ? get_stack_info+0x36/0xc0 [ 8288.597499][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8288.597756][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8288.598063][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8288.598331][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8288.598598][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8288.598904][ C2] ? kernel_text_address+0x17/0xe0 [ 8288.599156][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8288.599461][ C2] ? arch_stack_walk+0x8c/0x100 [ 8288.599702][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8288.599958][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8288.600260][ C2] ? lock_acquire+0x1c1/0x220 [ 8288.600496][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8288.600779][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8288.601083][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8288.601359][ C2] ? get_stack_info+0x36/0xc0 [ 8288.601607][ C2] __tcf_classify+0x329/0x7d0 [ 8288.601838][ C2] tcf_classify+0x283/0x930 [ 8288.602065][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8288.602314][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8288.602617][ C2] tc_run+0x2e4/0x5d0 [ 8288.602816][ C2] ? __pfx_tc_run+0x10/0x10 [ 8288.603041][ C2] ? lock_acquire+0x1c1/0x220 [ 8288.603272][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8288.603525][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8288.603770][ C2] ? lock_acquire+0x1c1/0x220 [ 8288.604001][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8288.604258][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8288.604553][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8288.604816][ C2] ? neigh_hh_output+0x348/0x590 [ 8288.605060][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8288.605317][ C2] ip_finish_output2+0x786/0x18e0 [ 8288.605567][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8288.605895][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8288.606163][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8288.606409][ C2] ? __ip_finish_output+0x10f/0x770 [ 8288.606665][ C2] ip_output+0x16b/0x4f0 [ 8288.606875][ C2] ? __pfx_ip_output+0x10/0x10 [ 8288.607111][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8288.607380][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8288.607682][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8288.607952][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8288.608197][ C2] ? __alloc_skb+0xd4/0x280 [ 8288.608421][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8288.608680][ C2] ? tcp_fragment+0x168/0x1040 [ 8288.608919][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8288.609162][ C2] ? ip_local_out+0x114/0x3b0 [ 8288.609396][ C2] __ip_queue_xmit+0x672/0x1910 [ 8288.609636][ C2] ? __skb_clone+0x57a/0x760 [ 8288.609863][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8288.610122][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8288.610421][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8288.610665][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8288.610913][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8288.611213][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8288.611536][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8288.611773][ C2] tcp_send_loss_probe+0x348/0x830 [ 8288.612025][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8288.612285][ C2] tcp_write_timer+0x82/0x1d0 [ 8288.612519][ C2] call_timer_fn+0x173/0x430 [ 8288.612749][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8288.613005][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8288.613260][ C2] __run_timers.part.0+0x52d/0x890 [ 8288.613512][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8288.613773][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8288.614050][ C2] ? lock_acquire+0x1c1/0x220 [ 8288.614281][ C2] ? clockevents_program_event+0xf6/0x300 [ 8288.614565][ C2] ? lock_release+0x1d5/0x250 [ 8288.614798][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8288.615055][ C2] ? ktime_get+0xb3/0x190 [ 8288.615269][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8288.615557][ C2] run_timer_softirq+0x72/0x100 [ 8288.615799][ C2] __do_softirq+0x1b9/0x7ff [ 8288.616022][ C2] irq_exit_rcu+0x98/0xc0 [ 8288.616238][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8288.616513][ C2] [ 8288.616660][ C2] [ 8288.616806][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8288.617101][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8288.617352][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8288.618289][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8288.618588][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8288.618975][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8288.619362][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8288.619747][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8288.620136][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8288.620555][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8288.620842][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8288.621103][ C2] default_idle_call+0x69/0xa0 [ 8288.621347][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8288.621602][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8288.621871][ C2] ? lock_release+0x1d5/0x250 [ 8288.622101][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8288.622368][ C2] do_idle+0xfb/0x160 [ 8288.622566][ C2] cpu_startup_entry+0x55/0x60 [ 8288.622801][ C2] start_secondary+0x21c/0x2b0 [ 8288.623035][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8288.623298][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8288.623598][ C2] [ 8288.623752][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5528s! [perl:4135] [ 8288.624157][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8288.625387][ C1] irq event stamp: 209232 [ 8288.625601][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8288.626115][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8288.626583][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8288.627041][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8288.627492][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8288.627929][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8288.628529][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8288.628846][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8288.629796][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8288.630097][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8288.630513][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8288.630913][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8288.631314][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8288.631717][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8288.632107][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8288.632544][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8288.632868][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8288.633277][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8288.633684][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8288.634085][ C1] PKRU: 55555554 [ 8288.634270][ C1] Call Trace: [ 8288.634439][ C1] [ 8288.634597][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8288.634852][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8288.635090][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8288.635361][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8288.635627][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8288.635911][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8288.636169][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8288.636469][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8288.636726][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8288.637026][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8288.637315][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8288.637622][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8288.637904][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8288.638192][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8288.638476][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8288.638779][ C1] ? get_stack_info+0x36/0xc0 [ 8288.639012][ C1] ? lock_acquire+0x1c1/0x220 [ 8288.639249][ C1] ? lock_release+0x1d5/0x250 [ 8288.639485][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8288.639728][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8288.639993][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8288.640293][ C1] ? lock_acquire+0x1c1/0x220 [ 8288.640533][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8288.640775][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8288.641036][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8288.641272][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8288.641527][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8288.641781][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8288.642051][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8288.642323][ C1] ip_local_deliver+0x19d/0x480 [ 8288.642566][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8288.642831][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8288.643088][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8288.643428][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8288.643676][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8288.643988][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8288.644247][ C1] ip_rcv+0x564/0x740 [ 8288.644447][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8288.644670][ C1] ? set_track_prepare+0x8a/0xd0 [ 8288.644918][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8288.645190][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8288.645457][ C1] ? skb_clone+0x10b/0x330 [ 8288.645678][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8288.645988][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8288.646290][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8288.646564][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8288.646851][ C1] ? __tcf_classify+0x329/0x7d0 [ 8288.647094][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8288.647319][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8288.647611][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8288.647889][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8288.648207][ C1] ? lock_acquire+0x1c1/0x220 [ 8288.648438][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8288.648730][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8288.649008][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8288.649317][ C1] ? __copy_skb_header+0xaf/0x490 [ 8288.649568][ C1] ? __skb_clone+0x57a/0x760 [ 8288.649798][ C1] netif_receive_skb+0x55/0x280 [ 8288.650040][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8288.650373][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8288.650705][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8288.651004][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8288.651280][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8288.651573][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8288.651877][ C1] ? hlock_class+0x4e/0x130 [ 8288.652106][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8288.652376][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8288.652644][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8288.652900][ C1] ? hlock_class+0x4e/0x130 [ 8288.653127][ C1] ? mark_lock+0x38/0x3e0 [ 8288.653341][ C1] ? stack_access_ok+0xda/0x1f0 [ 8288.653584][ C1] ? __lock_acquire+0xb67/0x1610 [ 8288.653832][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8288.654105][ C1] ? get_stack_info+0x36/0xc0 [ 8288.654339][ C1] ? stack_access_ok+0xda/0x1f0 [ 8288.654581][ C1] ? get_reg+0x119/0x190 [ 8288.654793][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8288.655055][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8288.655357][ C1] __tcf_classify+0x329/0x7d0 [ 8288.655593][ C1] tcf_classify+0x283/0x930 [ 8288.655821][ C1] ? arch_stack_walk+0xa2/0x100 [ 8288.656083][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8288.656343][ C1] ? get_stack_info+0x36/0xc0 [ 8288.656583][ C1] tc_run+0x2e4/0x5d0 [ 8288.656789][ C1] ? __pfx_tc_run+0x10/0x10 [ 8288.657019][ C1] ? lock_acquire+0x1c1/0x220 [ 8288.657270][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8288.657524][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8288.657771][ C1] ? lock_acquire+0x1c1/0x220 [ 8288.658009][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8288.658268][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8288.658566][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8288.658830][ C1] ? neigh_hh_output+0x348/0x590 [ 8288.659077][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8288.659337][ C1] ip_finish_output2+0x786/0x18e0 [ 8288.659586][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8288.659856][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8288.660208][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8288.660485][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8288.660738][ C1] ? __ip_finish_output+0x10f/0x770 [ 8288.661003][ C1] ip_output+0x16b/0x4f0 [ 8288.661219][ C1] ? run_timer_softirq+0x72/0x100 [ 8288.661484][ C1] ? __pfx_ip_output+0x10/0x10 [ 8288.661722][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8288.662001][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8288.662248][ C1] ? ip_local_out+0x114/0x3b0 [ 8288.662482][ C1] __ip_queue_xmit+0x672/0x1910 [ 8288.662724][ C1] ? __create_object+0x5e/0xb0 [ 8288.662962][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8288.663223][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8288.663496][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8288.663765][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8288.664038][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8288.664305][ C1] tcp_delack_timer+0x84/0x240 [ 8288.664543][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8288.664807][ C1] call_timer_fn+0x173/0x430 [ 8288.665038][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8288.665295][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8288.665549][ C1] __run_timers.part.0+0x52d/0x890 [ 8288.665803][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8288.666070][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8288.666350][ C1] ? lock_acquire+0x1c1/0x220 [ 8288.666583][ C1] ? clockevents_program_event+0xf6/0x300 [ 8288.666865][ C1] ? lock_release+0x1d5/0x250 [ 8288.667099][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8288.667357][ C1] ? ktime_get+0xb3/0x190 [ 8288.667572][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8288.667862][ C1] run_timer_softirq+0x72/0x100 [ 8288.668104][ C1] __do_softirq+0x1b9/0x7ff [ 8288.668332][ C1] irq_exit_rcu+0x98/0xc0 [ 8288.668547][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8288.668826][ C1] [ 8288.668974][ C1] [ 8288.669119][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8288.669418][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8288.669734][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8288.670715][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8288.671023][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8288.671432][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8288.671820][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8288.672211][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8288.672598][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8288.672988][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8288.673280][ C1] pipe_read+0xa16/0xdf0 [ 8288.673494][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8288.673766][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8288.674002][ C1] ? iterate_tty_write+0x299/0x540 [ 8288.674258][ C1] ? lock_release+0x1d5/0x250 [ 8288.674493][ C1] vfs_read+0x911/0xc00 [ 8288.674701][ C1] ? lock_acquire+0x1c1/0x220 [ 8288.674934][ C1] ? __might_fault+0xc6/0x180 [ 8288.675169][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8288.675404][ C1] ? __might_fault+0xc6/0x180 [ 8288.675637][ C1] ? lock_release+0x1d5/0x250 [ 8288.675869][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8288.676126][ C1] ? __fget_light+0x54/0x1e0 [ 8288.676360][ C1] ksys_read+0x17a/0x1e0 [ 8288.676571][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8288.676810][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8288.677107][ C1] do_syscall_64+0xc9/0x1e0 [ 8288.677335][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8288.677627][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8288.677850][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8288.678795][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8288.679206][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8288.679594][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8288.679982][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8288.680398][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8288.680796][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8288.681200][ C1] [ 8313.356104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8313.356469][ C1] rcu: 1-....: (5944001 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1446062 [ 8313.357014][ C1] rcu: (t=5958469 jiffies g=1882453 q=721 ncpus=4) [ 8313.357341][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8313.357778][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8313.358375][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8313.358695][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8313.359645][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8313.359943][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8313.360364][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8313.360762][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8313.361160][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8313.361563][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8313.361952][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8313.362391][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8313.362715][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8313.363106][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8313.363497][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8313.363887][ C1] PKRU: 55555554 [ 8313.364064][ C1] Call Trace: [ 8313.364232][ C1] [ 8313.364378][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8313.364644][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8313.364891][ C1] ? check_cpu_stall+0x284/0x500 [ 8313.365137][ C1] ? rcu_pending+0x92/0x360 [ 8313.365362][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8313.365625][ C1] ? update_process_times+0xb9/0x110 [ 8313.365889][ C1] ? tick_sched_handle+0x67/0x130 [ 8313.366140][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8313.366418][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8313.366655][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8313.366960][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8313.367226][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8313.367508][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8313.367767][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8313.368064][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8313.368321][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8313.368621][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8313.368911][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8313.369219][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8313.369499][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8313.369788][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8313.370089][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8313.370401][ C1] ? get_stack_info+0x36/0xc0 [ 8313.370643][ C1] ? lock_acquire+0x1c1/0x220 [ 8313.370884][ C1] ? lock_release+0x1d5/0x250 [ 8313.371125][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8313.371374][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8313.371647][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8313.371931][ C1] ? lock_acquire+0x1c1/0x220 [ 8313.372176][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8313.372411][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8313.372664][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8313.372891][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8313.373132][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8313.373383][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8313.373652][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8313.373923][ C1] ip_local_deliver+0x19d/0x480 [ 8313.374165][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8313.374430][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8313.374687][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8313.375024][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8313.375272][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8313.375584][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8313.375839][ C1] ip_rcv+0x564/0x740 [ 8313.376038][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8313.376264][ C1] ? set_track_prepare+0x8a/0xd0 [ 8313.376510][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8313.376779][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8313.377047][ C1] ? skb_clone+0x10b/0x330 [ 8313.377268][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8313.377579][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8313.377878][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8313.378150][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8313.378440][ C1] ? __tcf_classify+0x329/0x7d0 [ 8313.378683][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8313.378907][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8313.379201][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8313.379477][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8313.379795][ C1] ? lock_acquire+0x1c1/0x220 [ 8313.380027][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8313.380344][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8313.380628][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8313.380945][ C1] ? __copy_skb_header+0xaf/0x490 [ 8313.381202][ C1] ? __skb_clone+0x57a/0x760 [ 8313.381443][ C1] netif_receive_skb+0x55/0x280 [ 8313.381685][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8313.381991][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8313.382316][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8313.382606][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8313.382875][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8313.383155][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8313.383463][ C1] ? hlock_class+0x4e/0x130 [ 8313.383690][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8313.383962][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8313.384231][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8313.384488][ C1] ? hlock_class+0x4e/0x130 [ 8313.384714][ C1] ? mark_lock+0x38/0x3e0 [ 8313.384927][ C1] ? stack_access_ok+0xda/0x1f0 [ 8313.385169][ C1] ? __lock_acquire+0xb67/0x1610 [ 8313.385418][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8313.385686][ C1] ? get_stack_info+0x36/0xc0 [ 8313.385921][ C1] ? stack_access_ok+0xda/0x1f0 [ 8313.386162][ C1] ? get_reg+0x119/0x190 [ 8313.386373][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8313.386635][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8313.386935][ C1] __tcf_classify+0x329/0x7d0 [ 8313.387172][ C1] tcf_classify+0x283/0x930 [ 8313.387399][ C1] ? arch_stack_walk+0xa2/0x100 [ 8313.387641][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8313.387891][ C1] ? get_stack_info+0x36/0xc0 [ 8313.388124][ C1] tc_run+0x2e4/0x5d0 [ 8313.388327][ C1] ? __pfx_tc_run+0x10/0x10 [ 8313.388552][ C1] ? lock_acquire+0x1c1/0x220 [ 8313.388785][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8313.389039][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8313.389287][ C1] ? lock_acquire+0x1c1/0x220 [ 8313.389520][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8313.389778][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8313.390094][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8313.390368][ C1] ? neigh_hh_output+0x348/0x590 [ 8313.390622][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8313.390887][ C1] ip_finish_output2+0x786/0x18e0 [ 8313.391143][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8313.391430][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8313.391757][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8313.392028][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8313.392274][ C1] ? __ip_finish_output+0x10f/0x770 [ 8313.392533][ C1] ip_output+0x16b/0x4f0 [ 8313.392742][ C1] ? run_timer_softirq+0x72/0x100 [ 8313.392992][ C1] ? __pfx_ip_output+0x10/0x10 [ 8313.393230][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8313.393507][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8313.393753][ C1] ? ip_local_out+0x114/0x3b0 [ 8313.393987][ C1] __ip_queue_xmit+0x672/0x1910 [ 8313.394229][ C1] ? __create_object+0x5e/0xb0 [ 8313.394468][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8313.394727][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8313.395000][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8313.395268][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8313.395542][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8313.395806][ C1] tcp_delack_timer+0x84/0x240 [ 8313.396044][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8313.396309][ C1] call_timer_fn+0x173/0x430 [ 8313.396539][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8313.396794][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8313.397048][ C1] __run_timers.part.0+0x52d/0x890 [ 8313.397303][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8313.397567][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8313.397847][ C1] ? lock_acquire+0x1c1/0x220 [ 8313.398078][ C1] ? clockevents_program_event+0xf6/0x300 [ 8313.398363][ C1] ? lock_release+0x1d5/0x250 [ 8313.398599][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8313.398856][ C1] ? ktime_get+0xb3/0x190 [ 8313.399071][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8313.399362][ C1] run_timer_softirq+0x72/0x100 [ 8313.399604][ C1] __do_softirq+0x1b9/0x7ff [ 8313.399831][ C1] irq_exit_rcu+0x98/0xc0 [ 8313.400051][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8313.400353][ C1] [ 8313.400506][ C1] [ 8313.400655][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8313.400961][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8313.401295][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8313.402240][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8313.402540][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8313.402927][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8313.403315][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8313.403706][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8313.404095][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8313.404486][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8313.404776][ C1] pipe_read+0xa16/0xdf0 [ 8313.404990][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8313.405260][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8313.405498][ C1] ? iterate_tty_write+0x299/0x540 [ 8313.405753][ C1] ? lock_release+0x1d5/0x250 [ 8313.405989][ C1] vfs_read+0x911/0xc00 [ 8313.406196][ C1] ? lock_acquire+0x1c1/0x220 [ 8313.406432][ C1] ? __might_fault+0xc6/0x180 [ 8313.406668][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8313.406901][ C1] ? __might_fault+0xc6/0x180 [ 8313.407133][ C1] ? lock_release+0x1d5/0x250 [ 8313.407369][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8313.407629][ C1] ? __fget_light+0x54/0x1e0 [ 8313.407860][ C1] ksys_read+0x17a/0x1e0 [ 8313.408071][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8313.408310][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8313.408608][ C1] do_syscall_64+0xc9/0x1e0 [ 8313.408835][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8313.409126][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8313.409350][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8313.410324][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8313.410742][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8313.411144][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8313.411545][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8313.411936][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8313.412324][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8313.412718][ C1] [ 8313.412870][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8313.413134][ C2] NMI backtrace for cpu 2 [ 8313.413140][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8313.413146][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8313.413150][ C2] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [ 8313.413159][ C2] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 ca 35 0c fe 89 d8 [ 8313.413165][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000246 [ 8313.413169][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8313.413173][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8313.413177][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8313.413181][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8313.413185][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8313.413189][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8313.413194][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8313.413199][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8313.413203][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8313.413206][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8313.413210][ C2] PKRU: 55555554 [ 8313.413212][ C2] Call Trace: [ 8313.413214][ C2] [ 8313.413218][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8313.413229][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8313.413236][ C2] ? nmi_handle+0x153/0x420 [ 8313.413246][ C2] ? default_do_nmi+0x41/0x100 [ 8313.413252][ C2] ? exc_nmi+0xf3/0x120 [ 8313.413258][ C2] ? end_repeat_nmi+0xf/0x60 [ 8313.413269][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8313.413277][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 8313.413285][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 8313.413293][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [ 8313.413301][ C2] [ 8313.413303][ C2] [ 8313.413306][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8313.413312][ C2] ? get_stack_info+0x36/0xc0 [ 8313.413321][ C2] ? lock_acquire+0x1c1/0x220 [ 8313.413329][ C2] ? lock_release+0x1d5/0x250 [ 8313.413338][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8313.413346][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8313.413352][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8313.413361][ C2] ? lock_acquire+0x1c1/0x220 [ 8313.413366][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8313.413375][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8313.413381][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8313.413397][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8313.413403][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8313.413414][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8313.413425][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8313.413433][ C2] ip_local_deliver+0x19d/0x480 [ 8313.413439][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8313.413444][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8313.413450][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8313.413461][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8313.413469][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8313.413476][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8313.413497][ C2] ip_rcv+0x564/0x740 [ 8313.413503][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8313.413509][ C2] ? set_track_prepare+0x8a/0xd0 [ 8313.413517][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8313.413525][ C2] ? start_secondary+0x21c/0x2b0 [ 8313.413529][ C2] ? skb_clone+0x10b/0x330 [ 8313.413532][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8313.413538][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8313.413543][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8313.413547][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8313.413555][ C2] ? __tcf_classify+0x329/0x7d0 [ 8313.413559][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8313.413561][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8313.413564][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8313.413568][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8313.413572][ C2] ? lock_acquire+0x1c1/0x220 [ 8313.413575][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8313.413579][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8313.413582][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8313.413586][ C2] ? __copy_skb_header+0xaf/0x490 [ 8313.413591][ C2] ? __skb_clone+0x57a/0x760 [ 8313.413593][ C2] netif_receive_skb+0x55/0x280 [ 8313.413597][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8313.413603][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8313.413610][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8313.413617][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8313.413621][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8313.413631][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8313.413638][ C2] ? get_stack_info+0x36/0xc0 [ 8313.413642][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8313.413645][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8313.413648][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8313.413651][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8313.413654][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8313.413656][ C2] ? kernel_text_address+0x17/0xe0 [ 8313.413659][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8313.413663][ C2] ? arch_stack_walk+0x8c/0x100 [ 8313.413667][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8313.413670][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8313.413673][ C2] ? lock_acquire+0x1c1/0x220 [ 8313.413675][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8313.413680][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8313.413683][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8313.413686][ C2] ? get_stack_info+0x36/0xc0 [ 8313.413690][ C2] __tcf_classify+0x329/0x7d0 [ 8313.413695][ C2] tcf_classify+0x283/0x930 [ 8313.413699][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8313.413702][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8313.413706][ C2] tc_run+0x2e4/0x5d0 [ 8313.413710][ C2] ? __pfx_tc_run+0x10/0x10 [ 8313.413713][ C2] ? lock_acquire+0x1c1/0x220 [ 8313.413715][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8313.413719][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8313.413722][ C2] ? lock_acquire+0x1c1/0x220 [ 8313.413725][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8313.413728][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8313.413731][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8313.413734][ C2] ? neigh_hh_output+0x348/0x590 [ 8313.413738][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8313.413741][ C2] ip_finish_output2+0x786/0x18e0 [ 8313.413745][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8313.413752][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8313.413755][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8313.413759][ C2] ? __ip_finish_output+0x10f/0x770 [ 8313.413763][ C2] ip_output+0x16b/0x4f0 [ 8313.413766][ C2] ? __pfx_ip_output+0x10/0x10 [ 8313.413768][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8313.413771][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8313.413774][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8313.413777][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8313.413779][ C2] ? __alloc_skb+0xd4/0x280 [ 8313.413782][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8313.413785][ C2] ? tcp_fragment+0x168/0x1040 [ 8313.413788][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8313.413791][ C2] ? ip_local_out+0x114/0x3b0 [ 8313.413795][ C2] __ip_queue_xmit+0x672/0x1910 [ 8313.413799][ C2] ? __skb_clone+0x57a/0x760 [ 8313.413801][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8313.413807][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8313.413810][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8313.413813][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8313.413817][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8313.413821][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8313.413824][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8313.413827][ C2] tcp_send_loss_probe+0x348/0x830 [ 8313.413830][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8313.413833][ C2] tcp_write_timer+0x82/0x1d0 [ 8313.413837][ C2] call_timer_fn+0x173/0x430 [ 8313.413840][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8313.413845][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8313.413849][ C2] __run_timers.part.0+0x52d/0x890 [ 8313.413852][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8313.413856][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8313.413859][ C2] ? lock_acquire+0x1c1/0x220 [ 8313.413862][ C2] ? clockevents_program_event+0xf6/0x300 [ 8313.413866][ C2] ? lock_release+0x1d5/0x250 [ 8313.413868][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8313.413872][ C2] ? ktime_get+0xb3/0x190 [ 8313.413875][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8313.413879][ C2] run_timer_softirq+0x72/0x100 [ 8313.413883][ C2] __do_softirq+0x1b9/0x7ff [ 8313.413887][ C2] irq_exit_rcu+0x98/0xc0 [ 8313.413890][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8313.413893][ C2] [ 8313.413894][ C2] [ 8313.413895][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8313.413898][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8313.413902][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8313.413904][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8313.413906][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8313.413907][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8313.413909][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8313.413910][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8313.413911][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8313.413914][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8313.413917][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8313.413920][ C2] default_idle_call+0x69/0xa0 [ 8313.413923][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8313.413925][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8313.413928][ C2] ? lock_release+0x1d5/0x250 [ 8313.413931][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8313.413934][ C2] do_idle+0xfb/0x160 [ 8313.413937][ C2] cpu_startup_entry+0x55/0x60 [ 8313.413939][ C2] start_secondary+0x21c/0x2b0 [ 8313.413942][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8313.413946][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8313.413952][ C2] [ 8340.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5576s! [perl:4135] [ 8340.569679][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8340.570907][ C1] irq event stamp: 209232 [ 8340.571120][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8340.571636][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8340.572099][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8340.572555][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8340.573005][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8340.573442][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8340.574036][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8340.574354][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8340.575298][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8340.575597][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8340.575986][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8340.576376][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8340.576765][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8340.577152][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8340.577542][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8340.577978][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8340.578303][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8340.578694][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8340.579080][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8340.579472][ C1] PKRU: 55555554 [ 8340.579649][ C1] Call Trace: [ 8340.579814][ C1] [ 8340.579962][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8340.580219][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8340.580455][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8340.580726][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8340.580992][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8340.581272][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8340.581531][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8340.581829][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8340.582084][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8340.582385][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8340.582673][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8340.582980][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8340.583261][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8340.583550][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8340.583829][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8340.584132][ C1] ? get_stack_info+0x36/0xc0 [ 8340.584369][ C1] ? lock_acquire+0x1c1/0x220 [ 8340.584603][ C1] ? lock_release+0x1d5/0x250 [ 8340.584834][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8340.585076][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8340.585342][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8340.585620][ C1] ? lock_acquire+0x1c1/0x220 [ 8340.585853][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8340.586086][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8340.586343][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8340.586572][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8340.586812][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8340.587063][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8340.587333][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8340.587604][ C1] ip_local_deliver+0x19d/0x480 [ 8340.587845][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8340.588111][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8340.588369][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8340.588707][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8340.588954][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8340.589267][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8340.589522][ C1] ip_rcv+0x564/0x740 [ 8340.589720][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8340.589966][ C1] ? set_track_prepare+0x8a/0xd0 [ 8340.590221][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8340.590497][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8340.590769][ C1] ? skb_clone+0x10b/0x330 [ 8340.590997][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8340.591323][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8340.591621][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8340.591895][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8340.592183][ C1] ? __tcf_classify+0x329/0x7d0 [ 8340.592425][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8340.592650][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8340.592947][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8340.593225][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8340.593544][ C1] ? lock_acquire+0x1c1/0x220 [ 8340.593778][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8340.594067][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8340.594347][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8340.594655][ C1] ? __copy_skb_header+0xaf/0x490 [ 8340.594906][ C1] ? __skb_clone+0x57a/0x760 [ 8340.595136][ C1] netif_receive_skb+0x55/0x280 [ 8340.595379][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8340.595681][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8340.596006][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8340.596298][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8340.596563][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8340.596847][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8340.597152][ C1] ? hlock_class+0x4e/0x130 [ 8340.597379][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8340.597648][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8340.597918][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8340.598175][ C1] ? hlock_class+0x4e/0x130 [ 8340.598401][ C1] ? mark_lock+0x38/0x3e0 [ 8340.598615][ C1] ? stack_access_ok+0xda/0x1f0 [ 8340.598858][ C1] ? __lock_acquire+0xb67/0x1610 [ 8340.599105][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8340.599376][ C1] ? get_stack_info+0x36/0xc0 [ 8340.599610][ C1] ? stack_access_ok+0xda/0x1f0 [ 8340.599851][ C1] ? get_reg+0x119/0x190 [ 8340.600099][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8340.600368][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8340.600680][ C1] __tcf_classify+0x329/0x7d0 [ 8340.600922][ C1] tcf_classify+0x283/0x930 [ 8340.601166][ C1] ? arch_stack_walk+0xa2/0x100 [ 8340.601409][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8340.601660][ C1] ? get_stack_info+0x36/0xc0 [ 8340.601896][ C1] tc_run+0x2e4/0x5d0 [ 8340.602096][ C1] ? __pfx_tc_run+0x10/0x10 [ 8340.602325][ C1] ? lock_acquire+0x1c1/0x220 [ 8340.602559][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8340.602815][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8340.603063][ C1] ? lock_acquire+0x1c1/0x220 [ 8340.603296][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8340.603557][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8340.603854][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8340.604121][ C1] ? neigh_hh_output+0x348/0x590 [ 8340.604369][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8340.604631][ C1] ip_finish_output2+0x786/0x18e0 [ 8340.604881][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8340.605153][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8340.605483][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8340.605752][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8340.605999][ C1] ? __ip_finish_output+0x10f/0x770 [ 8340.606261][ C1] ip_output+0x16b/0x4f0 [ 8340.606473][ C1] ? run_timer_softirq+0x72/0x100 [ 8340.606724][ C1] ? __pfx_ip_output+0x10/0x10 [ 8340.606964][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8340.607243][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8340.607489][ C1] ? ip_local_out+0x114/0x3b0 [ 8340.607724][ C1] __ip_queue_xmit+0x672/0x1910 [ 8340.607968][ C1] ? __create_object+0x5e/0xb0 [ 8340.608206][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8340.608468][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8340.608741][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8340.609007][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8340.609286][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8340.609552][ C1] tcp_delack_timer+0x84/0x240 [ 8340.609791][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8340.610080][ C1] call_timer_fn+0x173/0x430 [ 8340.610320][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8340.610582][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8340.610845][ C1] __run_timers.part.0+0x52d/0x890 [ 8340.611106][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8340.611386][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8340.611664][ C1] ? lock_acquire+0x1c1/0x220 [ 8340.611897][ C1] ? clockevents_program_event+0xf6/0x300 [ 8340.612182][ C1] ? lock_release+0x1d5/0x250 [ 8340.612416][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8340.612675][ C1] ? ktime_get+0xb3/0x190 [ 8340.612890][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8340.613182][ C1] run_timer_softirq+0x72/0x100 [ 8340.613425][ C1] __do_softirq+0x1b9/0x7ff [ 8340.613651][ C1] irq_exit_rcu+0x98/0xc0 [ 8340.613868][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8340.614146][ C1] [ 8340.614294][ C1] [ 8340.614442][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8340.614739][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8340.615057][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8340.616007][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8340.616310][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8340.616700][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8340.617089][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8340.617479][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8340.617870][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8340.618264][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8340.618553][ C1] pipe_read+0xa16/0xdf0 [ 8340.618769][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8340.619040][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8340.619279][ C1] ? iterate_tty_write+0x299/0x540 [ 8340.619535][ C1] ? lock_release+0x1d5/0x250 [ 8340.619771][ C1] vfs_read+0x911/0xc00 [ 8340.620001][ C1] ? lock_acquire+0x1c1/0x220 [ 8340.620242][ C1] ? __might_fault+0xc6/0x180 [ 8340.620484][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8340.620723][ C1] ? __might_fault+0xc6/0x180 [ 8340.620964][ C1] ? lock_release+0x1d5/0x250 [ 8340.621214][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8340.621473][ C1] ? __fget_light+0x54/0x1e0 [ 8340.621706][ C1] ksys_read+0x17a/0x1e0 [ 8340.621917][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8340.622157][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8340.622455][ C1] do_syscall_64+0xc9/0x1e0 [ 8340.622681][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8340.622974][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8340.623196][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8340.624146][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8340.624558][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8340.624947][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8340.625341][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8340.625729][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8340.626119][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8340.626511][ C1] [ 8340.626666][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5576s! [swapper/2:0] [ 8340.627062][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8340.628272][ C2] irq event stamp: 44114564 [ 8340.628494][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8340.629009][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8340.629506][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8340.629986][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8340.630455][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8340.630908][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8340.631515][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8340.631827][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8340.632768][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8340.633064][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8340.633451][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8340.633841][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8340.634228][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8340.634612][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8340.634999][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8340.635433][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8340.635754][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8340.636143][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8340.636529][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8340.636916][ C2] PKRU: 55555554 [ 8340.637091][ C2] Call Trace: [ 8340.637256][ C2] [ 8340.637398][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8340.637650][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8340.637885][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8340.638156][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8340.638421][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8340.638699][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8340.638957][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8340.639253][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8340.639505][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8340.639759][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8340.640082][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8340.640379][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8340.640692][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8340.640978][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8340.641281][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8340.641558][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8340.641861][ C2] ? get_stack_info+0x36/0xc0 [ 8340.642093][ C2] ? lock_acquire+0x1c1/0x220 [ 8340.642327][ C2] ? lock_release+0x1d5/0x250 [ 8340.642557][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8340.642797][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8340.643060][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8340.643337][ C2] ? lock_acquire+0x1c1/0x220 [ 8340.643570][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8340.643801][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8340.644054][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8340.644281][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8340.644519][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8340.644768][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8340.645032][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8340.645304][ C2] ip_local_deliver+0x19d/0x480 [ 8340.645543][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8340.645806][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8340.646063][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8340.646399][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8340.646644][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8340.646953][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8340.647207][ C2] ip_rcv+0x564/0x740 [ 8340.647404][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8340.647629][ C2] ? set_track_prepare+0x8a/0xd0 [ 8340.647875][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8340.648142][ C2] ? start_secondary+0x21c/0x2b0 [ 8340.648388][ C2] ? skb_clone+0x10b/0x330 [ 8340.648609][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8340.648917][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8340.649217][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8340.649490][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8340.649772][ C2] ? __tcf_classify+0x329/0x7d0 [ 8340.650036][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8340.650266][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8340.650563][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8340.650847][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8340.651181][ C2] ? lock_acquire+0x1c1/0x220 [ 8340.651413][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8340.651697][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8340.651975][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8340.652285][ C2] ? __copy_skb_header+0xaf/0x490 [ 8340.652533][ C2] ? __skb_clone+0x57a/0x760 [ 8340.652759][ C2] netif_receive_skb+0x55/0x280 [ 8340.652998][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8340.653304][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8340.653624][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8340.653914][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8340.654179][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8340.654459][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8340.654759][ C2] ? get_stack_info+0x36/0xc0 [ 8340.654996][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8340.655252][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8340.655558][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8340.655825][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8340.656095][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8340.656401][ C2] ? kernel_text_address+0x17/0xe0 [ 8340.656654][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8340.656956][ C2] ? arch_stack_walk+0x8c/0x100 [ 8340.657196][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8340.657453][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8340.657729][ C2] ? lock_acquire+0x1c1/0x220 [ 8340.657963][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8340.658234][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8340.658529][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8340.658796][ C2] ? get_stack_info+0x36/0xc0 [ 8340.659030][ C2] __tcf_classify+0x329/0x7d0 [ 8340.659265][ C2] tcf_classify+0x283/0x930 [ 8340.659489][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8340.659736][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8340.660063][ C2] tc_run+0x2e4/0x5d0 [ 8340.660267][ C2] ? __pfx_tc_run+0x10/0x10 [ 8340.660497][ C2] ? lock_acquire+0x1c1/0x220 [ 8340.660735][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8340.660994][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8340.661254][ C2] ? lock_acquire+0x1c1/0x220 [ 8340.661484][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8340.661740][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8340.662032][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8340.662297][ C2] ? neigh_hh_output+0x348/0x590 [ 8340.662542][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8340.662799][ C2] ip_finish_output2+0x786/0x18e0 [ 8340.663047][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8340.663374][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8340.663640][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8340.663884][ C2] ? __ip_finish_output+0x10f/0x770 [ 8340.664139][ C2] ip_output+0x16b/0x4f0 [ 8340.664351][ C2] ? __pfx_ip_output+0x10/0x10 [ 8340.664585][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8340.664853][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8340.665155][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8340.665423][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8340.665667][ C2] ? __alloc_skb+0xd4/0x280 [ 8340.665891][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8340.666152][ C2] ? tcp_fragment+0x168/0x1040 [ 8340.666389][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8340.666631][ C2] ? ip_local_out+0x114/0x3b0 [ 8340.666863][ C2] __ip_queue_xmit+0x672/0x1910 [ 8340.667103][ C2] ? __skb_clone+0x57a/0x760 [ 8340.667332][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8340.667590][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8340.667860][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8340.668098][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8340.668341][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8340.668632][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8340.668943][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8340.669178][ C2] tcp_send_loss_probe+0x348/0x830 [ 8340.669431][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8340.669691][ C2] tcp_write_timer+0x82/0x1d0 [ 8340.669927][ C2] call_timer_fn+0x173/0x430 [ 8340.670178][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8340.670438][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8340.670697][ C2] __run_timers.part.0+0x52d/0x890 [ 8340.670954][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8340.671233][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8340.671508][ C2] ? lock_acquire+0x1c1/0x220 [ 8340.671744][ C2] ? clockevents_program_event+0xf6/0x300 [ 8340.672023][ C2] ? lock_release+0x1d5/0x250 [ 8340.672256][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8340.672512][ C2] ? ktime_get+0xb3/0x190 [ 8340.672726][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8340.673012][ C2] run_timer_softirq+0x72/0x100 [ 8340.673254][ C2] __do_softirq+0x1b9/0x7ff [ 8340.673480][ C2] irq_exit_rcu+0x98/0xc0 [ 8340.673694][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8340.673970][ C2] [ 8340.674115][ C2] [ 8340.674261][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8340.674556][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8340.674803][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8340.675740][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8340.676037][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8340.676422][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8340.676809][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8340.677196][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8340.677582][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8340.677967][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8340.678250][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8340.678501][ C2] default_idle_call+0x69/0xa0 [ 8340.678737][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8340.678980][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8340.679249][ C2] ? lock_release+0x1d5/0x250 [ 8340.679480][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8340.679744][ C2] do_idle+0xfb/0x160 [ 8340.679961][ C2] cpu_startup_entry+0x55/0x60 [ 8340.680204][ C2] start_secondary+0x21c/0x2b0 [ 8340.680446][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8340.680713][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8340.681022][ C2] [ 8368.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5602s! [swapper/2:0] [ 8368.569673][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8368.570890][ C2] irq event stamp: 44114564 [ 8368.571112][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8368.571631][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8368.572126][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8368.572587][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8368.573043][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8368.573485][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8368.574075][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8368.574351][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8368.575292][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 8368.575589][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8368.575973][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8368.576360][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8368.576744][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8368.577133][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8368.577520][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8368.577953][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8368.578275][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8368.578662][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8368.579050][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8368.579437][ C2] PKRU: 55555554 [ 8368.579613][ C2] Call Trace: [ 8368.579782][ C2] [ 8368.579925][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8368.580180][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8368.580416][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8368.580683][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8368.580946][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8368.581228][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8368.581484][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8368.581780][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8368.582033][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8368.582287][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8368.582587][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8368.582871][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8368.583177][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8368.583458][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8368.583730][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 8368.584001][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8368.584305][ C2] ? get_stack_info+0x36/0xc0 [ 8368.584539][ C2] ? lock_acquire+0x1c1/0x220 [ 8368.584775][ C2] ? lock_release+0x1d5/0x250 [ 8368.585007][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8368.585248][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8368.585514][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8368.585789][ C2] ? lock_acquire+0x1c1/0x220 [ 8368.586021][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8368.586254][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8368.586507][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8368.586733][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8368.586973][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8368.587225][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8368.587489][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8368.587760][ C2] ip_local_deliver+0x19d/0x480 [ 8368.587999][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8368.588264][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8368.588519][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8368.588854][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8368.589100][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8368.589410][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8368.589664][ C2] ip_rcv+0x564/0x740 [ 8368.589885][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8368.590116][ C2] ? set_track_prepare+0x8a/0xd0 [ 8368.590368][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8368.590643][ C2] ? start_secondary+0x21c/0x2b0 [ 8368.590894][ C2] ? skb_clone+0x10b/0x330 [ 8368.591128][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8368.591438][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8368.591734][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8368.592008][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8368.592293][ C2] ? __tcf_classify+0x329/0x7d0 [ 8368.592537][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8368.592761][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8368.593052][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8368.593330][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8368.593645][ C2] ? lock_acquire+0x1c1/0x220 [ 8368.593877][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8368.594163][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8368.594441][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8368.594749][ C2] ? __copy_skb_header+0xaf/0x490 [ 8368.594999][ C2] ? __skb_clone+0x57a/0x760 [ 8368.595227][ C2] netif_receive_skb+0x55/0x280 [ 8368.595466][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8368.595771][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8368.596091][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8368.596383][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8368.596647][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8368.596927][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8368.597228][ C2] ? get_stack_info+0x36/0xc0 [ 8368.597463][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8368.597718][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8368.598024][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8368.598294][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8368.598563][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8368.598869][ C2] ? kernel_text_address+0x17/0xe0 [ 8368.599121][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8368.599425][ C2] ? arch_stack_walk+0x8c/0x100 [ 8368.599667][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8368.599947][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8368.600231][ C2] ? lock_acquire+0x1c1/0x220 [ 8368.600470][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8368.600750][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8368.601064][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8368.601330][ C2] ? get_stack_info+0x36/0xc0 [ 8368.601565][ C2] __tcf_classify+0x329/0x7d0 [ 8368.601800][ C2] tcf_classify+0x283/0x930 [ 8368.602027][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8368.602276][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8368.602579][ C2] tc_run+0x2e4/0x5d0 [ 8368.602797][ C2] ? __pfx_tc_run+0x10/0x10 [ 8368.603026][ C2] ? lock_acquire+0x1c1/0x220 [ 8368.603266][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8368.603526][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8368.603779][ C2] ? lock_acquire+0x1c1/0x220 [ 8368.604024][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8368.604280][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8368.604573][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8368.604838][ C2] ? neigh_hh_output+0x348/0x590 [ 8368.605082][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8368.605340][ C2] ip_finish_output2+0x786/0x18e0 [ 8368.605589][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8368.605917][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8368.606184][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8368.606430][ C2] ? __ip_finish_output+0x10f/0x770 [ 8368.606685][ C2] ip_output+0x16b/0x4f0 [ 8368.606898][ C2] ? __pfx_ip_output+0x10/0x10 [ 8368.607133][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8368.607402][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8368.607704][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8368.607970][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8368.608216][ C2] ? __alloc_skb+0xd4/0x280 [ 8368.608440][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8368.608700][ C2] ? tcp_fragment+0x168/0x1040 [ 8368.608937][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8368.609181][ C2] ? ip_local_out+0x114/0x3b0 [ 8368.609412][ C2] __ip_queue_xmit+0x672/0x1910 [ 8368.609653][ C2] ? __skb_clone+0x57a/0x760 [ 8368.609904][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8368.610170][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8368.610448][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8368.610691][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8368.610938][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8368.611243][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8368.611553][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8368.611789][ C2] tcp_send_loss_probe+0x348/0x830 [ 8368.612042][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8368.612303][ C2] tcp_write_timer+0x82/0x1d0 [ 8368.612535][ C2] call_timer_fn+0x173/0x430 [ 8368.612762][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8368.613016][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8368.613270][ C2] __run_timers.part.0+0x52d/0x890 [ 8368.613524][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8368.613787][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8368.614061][ C2] ? lock_acquire+0x1c1/0x220 [ 8368.614295][ C2] ? clockevents_program_event+0xf6/0x300 [ 8368.614575][ C2] ? lock_release+0x1d5/0x250 [ 8368.614807][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8368.615063][ C2] ? ktime_get+0xb3/0x190 [ 8368.615280][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8368.615566][ C2] run_timer_softirq+0x72/0x100 [ 8368.615807][ C2] __do_softirq+0x1b9/0x7ff [ 8368.616033][ C2] irq_exit_rcu+0x98/0xc0 [ 8368.616245][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8368.616523][ C2] [ 8368.616668][ C2] [ 8368.616813][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8368.617109][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8368.617357][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8368.618297][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8368.618596][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8368.618980][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8368.619369][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8368.619756][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8368.620172][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8368.620568][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8368.620858][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8368.621124][ C2] default_idle_call+0x69/0xa0 [ 8368.621362][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8368.621605][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8368.621874][ C2] ? lock_release+0x1d5/0x250 [ 8368.622106][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8368.622371][ C2] do_idle+0xfb/0x160 [ 8368.622568][ C2] cpu_startup_entry+0x55/0x60 [ 8368.622804][ C2] start_secondary+0x21c/0x2b0 [ 8368.623041][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8368.623302][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8368.623604][ C2] [ 8368.623754][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5602s! [perl:4135] [ 8368.624155][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8368.625376][ C1] irq event stamp: 209232 [ 8368.625589][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8368.626102][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8368.626568][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8368.627024][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8368.627476][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8368.627912][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8368.628508][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8368.628819][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8368.629769][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8368.630097][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8368.630497][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8368.630897][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8368.631299][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8368.631684][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8368.632074][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8368.632512][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8368.632837][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8368.633230][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8368.633617][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8368.634006][ C1] PKRU: 55555554 [ 8368.634182][ C1] Call Trace: [ 8368.634349][ C1] [ 8368.634492][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8368.634748][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8368.634986][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8368.635259][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8368.635526][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8368.635806][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8368.636065][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8368.636364][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8368.636618][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8368.636919][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8368.637209][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8368.637516][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8368.637798][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8368.638080][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8368.638362][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8368.638665][ C1] ? get_stack_info+0x36/0xc0 [ 8368.638901][ C1] ? lock_acquire+0x1c1/0x220 [ 8368.639134][ C1] ? lock_release+0x1d5/0x250 [ 8368.639369][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8368.639612][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8368.639898][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8368.640185][ C1] ? lock_acquire+0x1c1/0x220 [ 8368.640424][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8368.640663][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8368.640923][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8368.641165][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8368.641406][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8368.641657][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8368.641923][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8368.642193][ C1] ip_local_deliver+0x19d/0x480 [ 8368.642435][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8368.642700][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8368.642957][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8368.643295][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8368.643541][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8368.643853][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8368.644108][ C1] ip_rcv+0x564/0x740 [ 8368.644308][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8368.644534][ C1] ? set_track_prepare+0x8a/0xd0 [ 8368.644781][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8368.645048][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8368.645318][ C1] ? skb_clone+0x10b/0x330 [ 8368.645541][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8368.645852][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8368.646150][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8368.646424][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8368.646710][ C1] ? __tcf_classify+0x329/0x7d0 [ 8368.646952][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8368.647178][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8368.647471][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8368.647748][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8368.648063][ C1] ? lock_acquire+0x1c1/0x220 [ 8368.648298][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8368.648585][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8368.648864][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8368.649174][ C1] ? __copy_skb_header+0xaf/0x490 [ 8368.649425][ C1] ? __skb_clone+0x57a/0x760 [ 8368.649655][ C1] netif_receive_skb+0x55/0x280 [ 8368.649918][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8368.650231][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8368.650563][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8368.650864][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8368.651144][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8368.651429][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8368.651731][ C1] ? hlock_class+0x4e/0x130 [ 8368.651958][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8368.652228][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8368.652498][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8368.652756][ C1] ? hlock_class+0x4e/0x130 [ 8368.652978][ C1] ? mark_lock+0x38/0x3e0 [ 8368.653194][ C1] ? stack_access_ok+0xda/0x1f0 [ 8368.653436][ C1] ? __lock_acquire+0xb67/0x1610 [ 8368.653683][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8368.653951][ C1] ? get_stack_info+0x36/0xc0 [ 8368.654186][ C1] ? stack_access_ok+0xda/0x1f0 [ 8368.654426][ C1] ? get_reg+0x119/0x190 [ 8368.654637][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8368.654897][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8368.655198][ C1] __tcf_classify+0x329/0x7d0 [ 8368.655434][ C1] tcf_classify+0x283/0x930 [ 8368.655660][ C1] ? arch_stack_walk+0xa2/0x100 [ 8368.655901][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8368.656150][ C1] ? get_stack_info+0x36/0xc0 [ 8368.656386][ C1] tc_run+0x2e4/0x5d0 [ 8368.656585][ C1] ? __pfx_tc_run+0x10/0x10 [ 8368.656811][ C1] ? lock_acquire+0x1c1/0x220 [ 8368.657042][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8368.657298][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8368.657543][ C1] ? lock_acquire+0x1c1/0x220 [ 8368.657775][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8368.658031][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8368.658330][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8368.658593][ C1] ? neigh_hh_output+0x348/0x590 [ 8368.658839][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8368.659097][ C1] ip_finish_output2+0x786/0x18e0 [ 8368.659348][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8368.659620][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8368.659972][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8368.660247][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8368.660500][ C1] ? __ip_finish_output+0x10f/0x770 [ 8368.660765][ C1] ip_output+0x16b/0x4f0 [ 8368.660984][ C1] ? run_timer_softirq+0x72/0x100 [ 8368.661245][ C1] ? __pfx_ip_output+0x10/0x10 [ 8368.661480][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8368.661759][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8368.662003][ C1] ? ip_local_out+0x114/0x3b0 [ 8368.662238][ C1] __ip_queue_xmit+0x672/0x1910 [ 8368.662479][ C1] ? __create_object+0x5e/0xb0 [ 8368.662715][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8368.662974][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8368.663251][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8368.663515][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8368.663788][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8368.664054][ C1] tcp_delack_timer+0x84/0x240 [ 8368.664292][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8368.664557][ C1] call_timer_fn+0x173/0x430 [ 8368.664785][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8368.665040][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8368.665297][ C1] __run_timers.part.0+0x52d/0x890 [ 8368.665550][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8368.665816][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8368.666092][ C1] ? lock_acquire+0x1c1/0x220 [ 8368.666326][ C1] ? clockevents_program_event+0xf6/0x300 [ 8368.666608][ C1] ? lock_release+0x1d5/0x250 [ 8368.666839][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8368.667096][ C1] ? ktime_get+0xb3/0x190 [ 8368.667314][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8368.667602][ C1] run_timer_softirq+0x72/0x100 [ 8368.667842][ C1] __do_softirq+0x1b9/0x7ff [ 8368.668068][ C1] irq_exit_rcu+0x98/0xc0 [ 8368.668283][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8368.668562][ C1] [ 8368.668707][ C1] [ 8368.668855][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8368.669149][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8368.669465][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8368.670447][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8368.670752][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8368.671160][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8368.671550][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8368.671937][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8368.672324][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8368.672716][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8368.673004][ C1] pipe_read+0xa16/0xdf0 [ 8368.673221][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8368.673490][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8368.673728][ C1] ? iterate_tty_write+0x299/0x540 [ 8368.673982][ C1] ? lock_release+0x1d5/0x250 [ 8368.674218][ C1] vfs_read+0x911/0xc00 [ 8368.674427][ C1] ? lock_acquire+0x1c1/0x220 [ 8368.674659][ C1] ? __might_fault+0xc6/0x180 [ 8368.674892][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8368.675127][ C1] ? __might_fault+0xc6/0x180 [ 8368.675362][ C1] ? lock_release+0x1d5/0x250 [ 8368.675596][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8368.675854][ C1] ? __fget_light+0x54/0x1e0 [ 8368.676087][ C1] ksys_read+0x17a/0x1e0 [ 8368.676301][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8368.676540][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8368.676834][ C1] do_syscall_64+0xc9/0x1e0 [ 8368.677062][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8368.677356][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8368.677576][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8368.678522][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8368.678933][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8368.679321][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8368.679712][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8368.680149][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8368.680549][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8368.680952][ C1] [ 8391.414103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8391.414451][ C1] rcu: 1-....: (6021835 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1462291 [ 8391.414996][ C1] rcu: (t=6036527 jiffies g=1882453 q=721 ncpus=4) [ 8391.415321][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8391.415757][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8391.416354][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8391.416672][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8391.417616][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8391.417915][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8391.418305][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8391.418693][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8391.419079][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8391.419470][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8391.419863][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8391.420299][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8391.420622][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8391.421010][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8391.421402][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8391.421790][ C1] PKRU: 55555554 [ 8391.421967][ C1] Call Trace: [ 8391.422131][ C1] [ 8391.422277][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8391.422541][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8391.422786][ C1] ? check_cpu_stall+0x284/0x500 [ 8391.423032][ C1] ? rcu_pending+0x92/0x360 [ 8391.423257][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8391.423520][ C1] ? update_process_times+0xb9/0x110 [ 8391.423782][ C1] ? tick_sched_handle+0x67/0x130 [ 8391.424031][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8391.424308][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8391.424545][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8391.424848][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8391.425113][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8391.425396][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8391.425653][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8391.425950][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8391.426206][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8391.426505][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8391.426793][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8391.427098][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8391.427379][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8391.427668][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8391.427949][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8391.428252][ C1] ? get_stack_info+0x36/0xc0 [ 8391.428486][ C1] ? lock_acquire+0x1c1/0x220 [ 8391.428721][ C1] ? lock_release+0x1d5/0x250 [ 8391.428954][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8391.429196][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8391.429462][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8391.429741][ C1] ? lock_acquire+0x1c1/0x220 [ 8391.429974][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8391.430209][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8391.430461][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8391.430689][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8391.430928][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8391.431178][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8391.431449][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8391.431719][ C1] ip_local_deliver+0x19d/0x480 [ 8391.431959][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8391.432225][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8391.432482][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8391.432821][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8391.433067][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8391.433382][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8391.433638][ C1] ip_rcv+0x564/0x740 [ 8391.433838][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8391.434062][ C1] ? set_track_prepare+0x8a/0xd0 [ 8391.434311][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8391.434581][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8391.434848][ C1] ? skb_clone+0x10b/0x330 [ 8391.435071][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8391.435384][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8391.435685][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8391.435959][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8391.436249][ C1] ? __tcf_classify+0x329/0x7d0 [ 8391.436492][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8391.436716][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8391.437010][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8391.437290][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8391.437609][ C1] ? lock_acquire+0x1c1/0x220 [ 8391.437840][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8391.438131][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8391.438411][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8391.438720][ C1] ? __copy_skb_header+0xaf/0x490 [ 8391.438972][ C1] ? __skb_clone+0x57a/0x760 [ 8391.439203][ C1] netif_receive_skb+0x55/0x280 [ 8391.439447][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8391.439774][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8391.440106][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8391.440407][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8391.440683][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8391.440980][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8391.441285][ C1] ? hlock_class+0x4e/0x130 [ 8391.441513][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8391.441782][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8391.442051][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8391.442309][ C1] ? hlock_class+0x4e/0x130 [ 8391.442536][ C1] ? mark_lock+0x38/0x3e0 [ 8391.442749][ C1] ? stack_access_ok+0xda/0x1f0 [ 8391.442992][ C1] ? __lock_acquire+0xb67/0x1610 [ 8391.443242][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8391.443512][ C1] ? get_stack_info+0x36/0xc0 [ 8391.443744][ C1] ? stack_access_ok+0xda/0x1f0 [ 8391.443986][ C1] ? get_reg+0x119/0x190 [ 8391.444202][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8391.444465][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8391.444766][ C1] __tcf_classify+0x329/0x7d0 [ 8391.445001][ C1] tcf_classify+0x283/0x930 [ 8391.445229][ C1] ? arch_stack_walk+0xa2/0x100 [ 8391.445472][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8391.445722][ C1] ? get_stack_info+0x36/0xc0 [ 8391.445956][ C1] tc_run+0x2e4/0x5d0 [ 8391.446156][ C1] ? __pfx_tc_run+0x10/0x10 [ 8391.446381][ C1] ? lock_acquire+0x1c1/0x220 [ 8391.446614][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8391.446868][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8391.447115][ C1] ? lock_acquire+0x1c1/0x220 [ 8391.447349][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8391.447607][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8391.447905][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8391.448171][ C1] ? neigh_hh_output+0x348/0x590 [ 8391.448419][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8391.448678][ C1] ip_finish_output2+0x786/0x18e0 [ 8391.448928][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8391.449198][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8391.449528][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8391.449823][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8391.450077][ C1] ? __ip_finish_output+0x10f/0x770 [ 8391.450343][ C1] ip_output+0x16b/0x4f0 [ 8391.450558][ C1] ? run_timer_softirq+0x72/0x100 [ 8391.450816][ C1] ? __pfx_ip_output+0x10/0x10 [ 8391.451065][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8391.451346][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8391.451592][ C1] ? ip_local_out+0x114/0x3b0 [ 8391.451826][ C1] __ip_queue_xmit+0x672/0x1910 [ 8391.452068][ C1] ? __create_object+0x5e/0xb0 [ 8391.452307][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8391.452568][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8391.452842][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8391.453111][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8391.453386][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8391.453651][ C1] tcp_delack_timer+0x84/0x240 [ 8391.453889][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8391.454153][ C1] call_timer_fn+0x173/0x430 [ 8391.454385][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8391.454641][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8391.454895][ C1] __run_timers.part.0+0x52d/0x890 [ 8391.455149][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8391.455416][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8391.455695][ C1] ? lock_acquire+0x1c1/0x220 [ 8391.455929][ C1] ? clockevents_program_event+0xf6/0x300 [ 8391.456212][ C1] ? lock_release+0x1d5/0x250 [ 8391.456446][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8391.456704][ C1] ? ktime_get+0xb3/0x190 [ 8391.456919][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8391.457209][ C1] run_timer_softirq+0x72/0x100 [ 8391.457452][ C1] __do_softirq+0x1b9/0x7ff [ 8391.457679][ C1] irq_exit_rcu+0x98/0xc0 [ 8391.457894][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8391.458173][ C1] [ 8391.458321][ C1] [ 8391.458467][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8391.458764][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8391.459080][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8391.460060][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8391.460369][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8391.460769][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8391.461173][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8391.461564][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8391.461953][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8391.462346][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8391.462637][ C1] pipe_read+0xa16/0xdf0 [ 8391.462851][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8391.463123][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8391.463360][ C1] ? iterate_tty_write+0x299/0x540 [ 8391.463615][ C1] ? lock_release+0x1d5/0x250 [ 8391.463851][ C1] vfs_read+0x911/0xc00 [ 8391.464059][ C1] ? lock_acquire+0x1c1/0x220 [ 8391.464294][ C1] ? __might_fault+0xc6/0x180 [ 8391.464529][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8391.464763][ C1] ? __might_fault+0xc6/0x180 [ 8391.464996][ C1] ? lock_release+0x1d5/0x250 [ 8391.465231][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8391.465488][ C1] ? __fget_light+0x54/0x1e0 [ 8391.465719][ C1] ksys_read+0x17a/0x1e0 [ 8391.465930][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8391.466169][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8391.466468][ C1] do_syscall_64+0xc9/0x1e0 [ 8391.466696][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8391.466986][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8391.467210][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8391.468157][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8391.468569][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8391.468959][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8391.469348][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8391.469758][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8391.470159][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8391.470563][ C1] [ 8391.470719][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8391.471001][ C2] NMI backtrace for cpu 2 [ 8391.471006][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8391.471012][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8391.471016][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8391.471024][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8391.471029][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8391.471034][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8391.471037][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8391.471041][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8391.471045][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8391.471049][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8391.471053][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8391.471057][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8391.471062][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8391.471066][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8391.471069][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8391.471072][ C2] PKRU: 55555554 [ 8391.471075][ C2] Call Trace: [ 8391.471077][ C2] [ 8391.471080][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8391.471092][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8391.471099][ C2] ? nmi_handle+0x153/0x420 [ 8391.471108][ C2] ? default_do_nmi+0x41/0x100 [ 8391.471114][ C2] ? exc_nmi+0xf3/0x120 [ 8391.471120][ C2] ? end_repeat_nmi+0xf/0x60 [ 8391.471132][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8391.471139][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8391.471147][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8391.471155][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8391.471163][ C2] [ 8391.471165][ C2] [ 8391.471168][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8391.471174][ C2] ? get_stack_info+0x36/0xc0 [ 8391.471183][ C2] ? lock_acquire+0x1c1/0x220 [ 8391.471191][ C2] ? lock_release+0x1d5/0x250 [ 8391.471200][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8391.471208][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8391.471215][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8391.471223][ C2] ? lock_acquire+0x1c1/0x220 [ 8391.471228][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8391.471236][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8391.471243][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8391.471259][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8391.471265][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8391.471276][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8391.471285][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8391.471293][ C2] ip_local_deliver+0x19d/0x480 [ 8391.471299][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8391.471304][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8391.471310][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8391.471321][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8391.471328][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8391.471335][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8391.471356][ C2] ip_rcv+0x564/0x740 [ 8391.471362][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8391.471368][ C2] ? set_track_prepare+0x8a/0xd0 [ 8391.471376][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8391.471383][ C2] ? start_secondary+0x21c/0x2b0 [ 8391.471390][ C2] ? skb_clone+0x10b/0x330 [ 8391.471395][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8391.471405][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8391.471411][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8391.471414][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8391.471422][ C2] ? __tcf_classify+0x329/0x7d0 [ 8391.471425][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8391.471427][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8391.471431][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8391.471434][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8391.471439][ C2] ? lock_acquire+0x1c1/0x220 [ 8391.471441][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8391.471445][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8391.471449][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8391.471453][ C2] ? __copy_skb_header+0xaf/0x490 [ 8391.471456][ C2] ? __skb_clone+0x57a/0x760 [ 8391.471459][ C2] netif_receive_skb+0x55/0x280 [ 8391.471462][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8391.471469][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8391.471476][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8391.471482][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8391.471486][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8391.471496][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8391.471503][ C2] ? get_stack_info+0x36/0xc0 [ 8391.471507][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8391.471510][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8391.471513][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8391.471516][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8391.471519][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8391.471521][ C2] ? kernel_text_address+0x17/0xe0 [ 8391.471524][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8391.471527][ C2] ? arch_stack_walk+0x8c/0x100 [ 8391.471530][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8391.471533][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8391.471537][ C2] ? lock_acquire+0x1c1/0x220 [ 8391.471539][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8391.471543][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8391.471547][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8391.471549][ C2] ? get_stack_info+0x36/0xc0 [ 8391.471554][ C2] __tcf_classify+0x329/0x7d0 [ 8391.471559][ C2] tcf_classify+0x283/0x930 [ 8391.471563][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8391.471566][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8391.471571][ C2] tc_run+0x2e4/0x5d0 [ 8391.471574][ C2] ? __pfx_tc_run+0x10/0x10 [ 8391.471577][ C2] ? lock_acquire+0x1c1/0x220 [ 8391.471579][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8391.471583][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8391.471587][ C2] ? lock_acquire+0x1c1/0x220 [ 8391.471589][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8391.471592][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8391.471595][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8391.471598][ C2] ? neigh_hh_output+0x348/0x590 [ 8391.471601][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8391.471604][ C2] ip_finish_output2+0x786/0x18e0 [ 8391.471608][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8391.471615][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8391.471617][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8391.471621][ C2] ? __ip_finish_output+0x10f/0x770 [ 8391.471624][ C2] ip_output+0x16b/0x4f0 [ 8391.471627][ C2] ? __pfx_ip_output+0x10/0x10 [ 8391.471630][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8391.471633][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8391.471636][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8391.471638][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8391.471641][ C2] ? __alloc_skb+0xd4/0x280 [ 8391.471643][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8391.471646][ C2] ? tcp_fragment+0x168/0x1040 [ 8391.471650][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8391.471652][ C2] ? ip_local_out+0x114/0x3b0 [ 8391.471656][ C2] __ip_queue_xmit+0x672/0x1910 [ 8391.471659][ C2] ? __skb_clone+0x57a/0x760 [ 8391.471662][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8391.471667][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8391.471670][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8391.471673][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8391.471677][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8391.471681][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8391.471684][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8391.471687][ C2] tcp_send_loss_probe+0x348/0x830 [ 8391.471690][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8391.471693][ C2] tcp_write_timer+0x82/0x1d0 [ 8391.471696][ C2] call_timer_fn+0x173/0x430 [ 8391.471699][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8391.471703][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8391.471707][ C2] __run_timers.part.0+0x52d/0x890 [ 8391.471710][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8391.471714][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8391.471717][ C2] ? lock_acquire+0x1c1/0x220 [ 8391.471720][ C2] ? clockevents_program_event+0xf6/0x300 [ 8391.471723][ C2] ? lock_release+0x1d5/0x250 [ 8391.471726][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8391.471729][ C2] ? ktime_get+0xb3/0x190 [ 8391.471732][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8391.471736][ C2] run_timer_softirq+0x72/0x100 [ 8391.471740][ C2] __do_softirq+0x1b9/0x7ff [ 8391.471744][ C2] irq_exit_rcu+0x98/0xc0 [ 8391.471746][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8391.471749][ C2] [ 8391.471750][ C2] [ 8391.471751][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8391.471754][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8391.471757][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8391.471759][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8391.471761][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8391.471762][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8391.471763][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8391.471765][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8391.471766][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8391.471769][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8391.471772][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8391.471775][ C2] default_idle_call+0x69/0xa0 [ 8391.471777][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8391.471780][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8391.471783][ C2] ? lock_release+0x1d5/0x250 [ 8391.471785][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8391.471789][ C2] do_idle+0xfb/0x160 [ 8391.471792][ C2] cpu_startup_entry+0x55/0x60 [ 8391.471794][ C2] start_secondary+0x21c/0x2b0 [ 8391.471797][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8391.471801][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8391.471806][ C2] [ 8416.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5647s! [perl:4135] [ 8416.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8416.570927][ C1] irq event stamp: 209232 [ 8416.571139][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8416.571656][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8416.572120][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8416.572576][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8416.573025][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8416.573462][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8416.574060][ C1] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 8416.574340][ C1] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 8416.575283][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 8416.575582][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8416.575972][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8416.576362][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffff88800a3a0e1b [ 8416.576750][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8416.577137][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8416.577527][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8416.577962][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8416.578288][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8416.578678][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8416.579065][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8416.579456][ C1] PKRU: 55555554 [ 8416.579652][ C1] Call Trace: [ 8416.579821][ C1] [ 8416.579970][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8416.580234][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8416.580477][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8416.580769][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8416.581033][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8416.581315][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8416.581575][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8416.581871][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8416.582125][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 8416.582382][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8416.582683][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8416.582973][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8416.583282][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8416.583563][ C1] ? kasan_check_range+0x69/0x1c0 [ 8416.583813][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8416.584088][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8416.584391][ C1] ? get_stack_info+0x36/0xc0 [ 8416.584626][ C1] ? lock_acquire+0x1c1/0x220 [ 8416.584861][ C1] ? lock_release+0x1d5/0x250 [ 8416.585096][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8416.585340][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8416.585608][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8416.585885][ C1] ? lock_acquire+0x1c1/0x220 [ 8416.586118][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8416.586355][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8416.586609][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8416.586837][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8416.587078][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8416.587330][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8416.587603][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8416.587873][ C1] ip_local_deliver+0x19d/0x480 [ 8416.588116][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8416.588382][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8416.588638][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8416.588978][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8416.589225][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8416.589537][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8416.589797][ C1] ip_rcv+0x564/0x740 [ 8416.589996][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8416.590221][ C1] ? set_track_prepare+0x8a/0xd0 [ 8416.590467][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8416.590738][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8416.591005][ C1] ? skb_clone+0x10b/0x330 [ 8416.591227][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8416.591538][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8416.591838][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8416.592112][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8416.592401][ C1] ? __tcf_classify+0x329/0x7d0 [ 8416.592645][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8416.592869][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8416.593162][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8416.593443][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8416.593760][ C1] ? lock_acquire+0x1c1/0x220 [ 8416.593991][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8416.594290][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8416.594568][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8416.594876][ C1] ? __copy_skb_header+0xaf/0x490 [ 8416.595128][ C1] ? __skb_clone+0x57a/0x760 [ 8416.595359][ C1] netif_receive_skb+0x55/0x280 [ 8416.595601][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8416.595907][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8416.596233][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8416.596525][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8416.596794][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8416.597075][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8416.597384][ C1] ? hlock_class+0x4e/0x130 [ 8416.597612][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8416.597881][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8416.598151][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8416.598407][ C1] ? hlock_class+0x4e/0x130 [ 8416.598634][ C1] ? mark_lock+0x38/0x3e0 [ 8416.598847][ C1] ? stack_access_ok+0xda/0x1f0 [ 8416.599090][ C1] ? __lock_acquire+0xb67/0x1610 [ 8416.599339][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8416.599629][ C1] ? get_stack_info+0x36/0xc0 [ 8416.599868][ C1] ? stack_access_ok+0xda/0x1f0 [ 8416.600115][ C1] ? get_reg+0x119/0x190 [ 8416.600332][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8416.600601][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8416.600918][ C1] __tcf_classify+0x329/0x7d0 [ 8416.601153][ C1] tcf_classify+0x283/0x930 [ 8416.601381][ C1] ? arch_stack_walk+0xa2/0x100 [ 8416.601624][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8416.601876][ C1] ? get_stack_info+0x36/0xc0 [ 8416.602110][ C1] tc_run+0x2e4/0x5d0 [ 8416.602312][ C1] ? __pfx_tc_run+0x10/0x10 [ 8416.602536][ C1] ? lock_acquire+0x1c1/0x220 [ 8416.602769][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8416.603024][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8416.603272][ C1] ? lock_acquire+0x1c1/0x220 [ 8416.603506][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8416.603764][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8416.604064][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8416.604330][ C1] ? neigh_hh_output+0x348/0x590 [ 8416.604577][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8416.604835][ C1] ip_finish_output2+0x786/0x18e0 [ 8416.605085][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8416.605358][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8416.605688][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8416.605958][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8416.606206][ C1] ? __ip_finish_output+0x10f/0x770 [ 8416.606465][ C1] ip_output+0x16b/0x4f0 [ 8416.606675][ C1] ? run_timer_softirq+0x72/0x100 [ 8416.606925][ C1] ? __pfx_ip_output+0x10/0x10 [ 8416.607163][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8416.607443][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8416.607688][ C1] ? ip_local_out+0x114/0x3b0 [ 8416.607923][ C1] __ip_queue_xmit+0x672/0x1910 [ 8416.608165][ C1] ? __create_object+0x5e/0xb0 [ 8416.608404][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8416.608665][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8416.608938][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8416.609208][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8416.609483][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8416.609773][ C1] tcp_delack_timer+0x84/0x240 [ 8416.610018][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8416.610289][ C1] call_timer_fn+0x173/0x430 [ 8416.610526][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8416.610798][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8416.611051][ C1] __run_timers.part.0+0x52d/0x890 [ 8416.611306][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8416.611573][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8416.611851][ C1] ? lock_acquire+0x1c1/0x220 [ 8416.612084][ C1] ? clockevents_program_event+0xf6/0x300 [ 8416.612368][ C1] ? lock_release+0x1d5/0x250 [ 8416.612602][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8416.612859][ C1] ? ktime_get+0xb3/0x190 [ 8416.613074][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8416.613366][ C1] run_timer_softirq+0x72/0x100 [ 8416.613607][ C1] __do_softirq+0x1b9/0x7ff [ 8416.613835][ C1] irq_exit_rcu+0x98/0xc0 [ 8416.614049][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8416.614329][ C1] [ 8416.614477][ C1] [ 8416.614623][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8416.614920][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8416.615237][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8416.616183][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8416.616484][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8416.616871][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8416.617262][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8416.617651][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8416.618039][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8416.618432][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8416.618721][ C1] pipe_read+0xa16/0xdf0 [ 8416.618935][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8416.619208][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8416.619448][ C1] ? iterate_tty_write+0x299/0x540 [ 8416.619727][ C1] ? lock_release+0x1d5/0x250 [ 8416.619970][ C1] vfs_read+0x911/0xc00 [ 8416.620185][ C1] ? lock_acquire+0x1c1/0x220 [ 8416.620424][ C1] ? __might_fault+0xc6/0x180 [ 8416.620664][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8416.620912][ C1] ? __might_fault+0xc6/0x180 [ 8416.621144][ C1] ? lock_release+0x1d5/0x250 [ 8416.621378][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8416.621635][ C1] ? __fget_light+0x54/0x1e0 [ 8416.621868][ C1] ksys_read+0x17a/0x1e0 [ 8416.622079][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8416.622319][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8416.622616][ C1] do_syscall_64+0xc9/0x1e0 [ 8416.622844][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8416.623135][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8416.623359][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8416.624304][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8416.624714][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8416.625103][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8416.625493][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8416.625881][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8416.626272][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8416.626666][ C1] [ 8416.626818][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5647s! [swapper/2:0] [ 8416.627227][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8416.628442][ C2] irq event stamp: 44114564 [ 8416.628668][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8416.629186][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8416.629705][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8416.630180][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8416.630646][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8416.631100][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8416.631692][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8416.632006][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8416.632946][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8416.633245][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8416.633631][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8416.634015][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8416.634401][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8416.634788][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8416.635174][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8416.635606][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8416.635927][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8416.636314][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8416.636701][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8416.637087][ C2] PKRU: 55555554 [ 8416.637265][ C2] Call Trace: [ 8416.637429][ C2] [ 8416.637573][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8416.637825][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8416.638064][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8416.638332][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8416.638595][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8416.638876][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8416.639132][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8416.639429][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8416.639706][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8416.639966][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8416.640275][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8416.640568][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8416.640888][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8416.641167][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8416.641452][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8416.641733][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8416.642034][ C2] ? get_stack_info+0x36/0xc0 [ 8416.642266][ C2] ? lock_acquire+0x1c1/0x220 [ 8416.642499][ C2] ? lock_release+0x1d5/0x250 [ 8416.642732][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8416.642972][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8416.643237][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8416.643511][ C2] ? lock_acquire+0x1c1/0x220 [ 8416.643743][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8416.643976][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8416.644229][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8416.644456][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8416.644693][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8416.644942][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8416.645210][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8416.645477][ C2] ip_local_deliver+0x19d/0x480 [ 8416.645716][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8416.645977][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8416.646232][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8416.646569][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8416.646814][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8416.647123][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8416.647378][ C2] ip_rcv+0x564/0x740 [ 8416.647575][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8416.647796][ C2] ? set_track_prepare+0x8a/0xd0 [ 8416.648045][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8416.648316][ C2] ? start_secondary+0x21c/0x2b0 [ 8416.648560][ C2] ? skb_clone+0x10b/0x330 [ 8416.648778][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8416.649086][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8416.649385][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8416.649678][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8416.649972][ C2] ? __tcf_classify+0x329/0x7d0 [ 8416.650220][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8416.650449][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8416.650751][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8416.651036][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8416.651355][ C2] ? lock_acquire+0x1c1/0x220 [ 8416.651587][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8416.651874][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8416.652149][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8416.652457][ C2] ? __copy_skb_header+0xaf/0x490 [ 8416.652705][ C2] ? __skb_clone+0x57a/0x760 [ 8416.652933][ C2] netif_receive_skb+0x55/0x280 [ 8416.653175][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8416.653476][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8416.653797][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8416.654084][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8416.654351][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8416.654630][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8416.654932][ C2] ? get_stack_info+0x36/0xc0 [ 8416.655165][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8416.655423][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8416.655729][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8416.655996][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8416.656264][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8416.656569][ C2] ? kernel_text_address+0x17/0xe0 [ 8416.656820][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8416.657124][ C2] ? arch_stack_walk+0x8c/0x100 [ 8416.657364][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8416.657620][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8416.657895][ C2] ? lock_acquire+0x1c1/0x220 [ 8416.658127][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8416.658401][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8416.658695][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8416.658963][ C2] ? get_stack_info+0x36/0xc0 [ 8416.659195][ C2] __tcf_classify+0x329/0x7d0 [ 8416.659431][ C2] tcf_classify+0x283/0x930 [ 8416.659679][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8416.659934][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8416.660246][ C2] tc_run+0x2e4/0x5d0 [ 8416.660451][ C2] ? __pfx_tc_run+0x10/0x10 [ 8416.660679][ C2] ? lock_acquire+0x1c1/0x220 [ 8416.660923][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8416.661176][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8416.661422][ C2] ? lock_acquire+0x1c1/0x220 [ 8416.661654][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8416.661909][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8416.662206][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8416.662469][ C2] ? neigh_hh_output+0x348/0x590 [ 8416.662714][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8416.662969][ C2] ip_finish_output2+0x786/0x18e0 [ 8416.663218][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8416.663544][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8416.663814][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8416.664057][ C2] ? __ip_finish_output+0x10f/0x770 [ 8416.664315][ C2] ip_output+0x16b/0x4f0 [ 8416.664524][ C2] ? __pfx_ip_output+0x10/0x10 [ 8416.664760][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8416.665026][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8416.665329][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8416.665595][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8416.665838][ C2] ? __alloc_skb+0xd4/0x280 [ 8416.666061][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8416.666322][ C2] ? tcp_fragment+0x168/0x1040 [ 8416.666558][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8416.666801][ C2] ? ip_local_out+0x114/0x3b0 [ 8416.667033][ C2] __ip_queue_xmit+0x672/0x1910 [ 8416.667274][ C2] ? __skb_clone+0x57a/0x760 [ 8416.667501][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8416.667758][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8416.668033][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8416.668269][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8416.668509][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8416.668801][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8416.669111][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8416.669348][ C2] tcp_send_loss_probe+0x348/0x830 [ 8416.669620][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8416.669886][ C2] tcp_write_timer+0x82/0x1d0 [ 8416.670124][ C2] call_timer_fn+0x173/0x430 [ 8416.670360][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8416.670621][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8416.670889][ C2] __run_timers.part.0+0x52d/0x890 [ 8416.671141][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8416.671403][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8416.671675][ C2] ? lock_acquire+0x1c1/0x220 [ 8416.671907][ C2] ? clockevents_program_event+0xf6/0x300 [ 8416.672211][ C2] ? lock_release+0x1d5/0x250 [ 8416.672445][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8416.672711][ C2] ? ktime_get+0xb3/0x190 [ 8416.672932][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8416.673244][ C2] run_timer_softirq+0x72/0x100 [ 8416.673483][ C2] __do_softirq+0x1b9/0x7ff [ 8416.673711][ C2] irq_exit_rcu+0x98/0xc0 [ 8416.673923][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8416.674200][ C2] [ 8416.674345][ C2] [ 8416.674492][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8416.674785][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8416.675032][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8416.675974][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8416.676271][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8416.676659][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8416.677045][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8416.677431][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8416.677814][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8416.678204][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8416.678483][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8416.678735][ C2] default_idle_call+0x69/0xa0 [ 8416.678972][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8416.679216][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8416.679484][ C2] ? lock_release+0x1d5/0x250 [ 8416.679740][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8416.680010][ C2] do_idle+0xfb/0x160 [ 8416.680214][ C2] cpu_startup_entry+0x55/0x60 [ 8416.680454][ C2] start_secondary+0x21c/0x2b0 [ 8416.680698][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8416.680970][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8416.681270][ C2] [ 8444.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5673s! [perl:4135] [ 8444.569686][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8444.570906][ C1] irq event stamp: 209232 [ 8444.571121][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8444.571636][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8444.572099][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8444.572560][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8444.573008][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8444.573446][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8444.574041][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8444.574361][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8444.575308][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8444.575607][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8444.575997][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8444.576387][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8444.576775][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8444.577162][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8444.577554][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8444.577990][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8444.578314][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8444.578704][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8444.579093][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8444.579486][ C1] PKRU: 55555554 [ 8444.579663][ C1] Call Trace: [ 8444.579826][ C1] [ 8444.579973][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8444.580229][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8444.580467][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8444.580738][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8444.581002][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8444.581284][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8444.581543][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8444.581838][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8444.582094][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8444.582395][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8444.582685][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8444.582991][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8444.583272][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8444.583562][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8444.583842][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8444.584146][ C1] ? get_stack_info+0x36/0xc0 [ 8444.584382][ C1] ? lock_acquire+0x1c1/0x220 [ 8444.584616][ C1] ? lock_release+0x1d5/0x250 [ 8444.584849][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8444.585089][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8444.585358][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8444.585635][ C1] ? lock_acquire+0x1c1/0x220 [ 8444.585867][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8444.586102][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8444.586356][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8444.586583][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8444.586824][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8444.587074][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8444.587343][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8444.587617][ C1] ip_local_deliver+0x19d/0x480 [ 8444.587860][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8444.588126][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8444.588384][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8444.588722][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8444.588969][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8444.589284][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8444.589562][ C1] ip_rcv+0x564/0x740 [ 8444.589767][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8444.589999][ C1] ? set_track_prepare+0x8a/0xd0 [ 8444.590254][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8444.590530][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8444.590812][ C1] ? skb_clone+0x10b/0x330 [ 8444.591034][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8444.591347][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8444.591646][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8444.591920][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8444.592210][ C1] ? __tcf_classify+0x329/0x7d0 [ 8444.592456][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8444.592681][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8444.592973][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8444.593252][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8444.593570][ C1] ? lock_acquire+0x1c1/0x220 [ 8444.593804][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8444.594095][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8444.594374][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8444.594684][ C1] ? __copy_skb_header+0xaf/0x490 [ 8444.594935][ C1] ? __skb_clone+0x57a/0x760 [ 8444.595166][ C1] netif_receive_skb+0x55/0x280 [ 8444.595410][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8444.595714][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8444.596040][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8444.596331][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8444.596601][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8444.596883][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8444.597190][ C1] ? hlock_class+0x4e/0x130 [ 8444.597416][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8444.597690][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8444.597960][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8444.598219][ C1] ? hlock_class+0x4e/0x130 [ 8444.598446][ C1] ? mark_lock+0x38/0x3e0 [ 8444.598660][ C1] ? stack_access_ok+0xda/0x1f0 [ 8444.598903][ C1] ? __lock_acquire+0xb67/0x1610 [ 8444.599152][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8444.599422][ C1] ? get_stack_info+0x36/0xc0 [ 8444.599709][ C1] ? stack_access_ok+0xda/0x1f0 [ 8444.599958][ C1] ? get_reg+0x119/0x190 [ 8444.600176][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8444.600445][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8444.600764][ C1] __tcf_classify+0x329/0x7d0 [ 8444.601001][ C1] tcf_classify+0x283/0x930 [ 8444.601229][ C1] ? arch_stack_walk+0xa2/0x100 [ 8444.601472][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8444.601723][ C1] ? get_stack_info+0x36/0xc0 [ 8444.601958][ C1] tc_run+0x2e4/0x5d0 [ 8444.602158][ C1] ? __pfx_tc_run+0x10/0x10 [ 8444.602386][ C1] ? lock_acquire+0x1c1/0x220 [ 8444.602619][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8444.602874][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8444.603122][ C1] ? lock_acquire+0x1c1/0x220 [ 8444.603356][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8444.603615][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8444.603912][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8444.604179][ C1] ? neigh_hh_output+0x348/0x590 [ 8444.604430][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8444.604689][ C1] ip_finish_output2+0x786/0x18e0 [ 8444.604939][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8444.605211][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8444.605539][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8444.605810][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8444.606056][ C1] ? __ip_finish_output+0x10f/0x770 [ 8444.606317][ C1] ip_output+0x16b/0x4f0 [ 8444.606528][ C1] ? run_timer_softirq+0x72/0x100 [ 8444.606778][ C1] ? __pfx_ip_output+0x10/0x10 [ 8444.607017][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8444.607297][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8444.607543][ C1] ? ip_local_out+0x114/0x3b0 [ 8444.607782][ C1] __ip_queue_xmit+0x672/0x1910 [ 8444.608025][ C1] ? __create_object+0x5e/0xb0 [ 8444.608265][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8444.608526][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8444.608799][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8444.609064][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8444.609343][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8444.609632][ C1] tcp_delack_timer+0x84/0x240 [ 8444.609877][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8444.610149][ C1] call_timer_fn+0x173/0x430 [ 8444.610386][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8444.610660][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8444.610914][ C1] __run_timers.part.0+0x52d/0x890 [ 8444.611169][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8444.611436][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8444.611715][ C1] ? lock_acquire+0x1c1/0x220 [ 8444.611947][ C1] ? clockevents_program_event+0xf6/0x300 [ 8444.612234][ C1] ? lock_release+0x1d5/0x250 [ 8444.612468][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8444.612732][ C1] ? ktime_get+0xb3/0x190 [ 8444.612946][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8444.613238][ C1] run_timer_softirq+0x72/0x100 [ 8444.613481][ C1] __do_softirq+0x1b9/0x7ff [ 8444.613706][ C1] irq_exit_rcu+0x98/0xc0 [ 8444.613923][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8444.614201][ C1] [ 8444.614350][ C1] [ 8444.614497][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8444.614795][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8444.615112][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8444.616060][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8444.616362][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8444.616751][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8444.617139][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8444.617530][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8444.617921][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8444.618313][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8444.618602][ C1] pipe_read+0xa16/0xdf0 [ 8444.618817][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8444.619086][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8444.619326][ C1] ? iterate_tty_write+0x299/0x540 [ 8444.619605][ C1] ? lock_release+0x1d5/0x250 [ 8444.619847][ C1] vfs_read+0x911/0xc00 [ 8444.620060][ C1] ? lock_acquire+0x1c1/0x220 [ 8444.620301][ C1] ? __might_fault+0xc6/0x180 [ 8444.620544][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8444.620791][ C1] ? __might_fault+0xc6/0x180 [ 8444.621025][ C1] ? lock_release+0x1d5/0x250 [ 8444.621261][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8444.621521][ C1] ? __fget_light+0x54/0x1e0 [ 8444.621753][ C1] ksys_read+0x17a/0x1e0 [ 8444.621965][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8444.622204][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8444.622503][ C1] do_syscall_64+0xc9/0x1e0 [ 8444.622728][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8444.623023][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8444.623246][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8444.624194][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8444.624605][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8444.624996][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8444.625388][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8444.625777][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8444.626165][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8444.626561][ C1] [ 8444.626714][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5673s! [swapper/2:0] [ 8444.627115][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8444.628328][ C2] irq event stamp: 44114564 [ 8444.628550][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8444.629067][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8444.629589][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8444.630064][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8444.630533][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8444.630987][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8444.631579][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8444.631893][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8444.632835][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8444.633132][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8444.633520][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8444.633905][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8444.634290][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8444.634678][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8444.635065][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8444.635498][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8444.635820][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8444.636207][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8444.636596][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8444.636981][ C2] PKRU: 55555554 [ 8444.637158][ C2] Call Trace: [ 8444.637322][ C2] [ 8444.637466][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8444.637718][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8444.637955][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8444.638224][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8444.638488][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8444.638769][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8444.639026][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8444.639324][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8444.639601][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8444.639862][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8444.640170][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8444.640464][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8444.640786][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8444.641064][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8444.641351][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8444.641632][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8444.641933][ C2] ? get_stack_info+0x36/0xc0 [ 8444.642166][ C2] ? lock_acquire+0x1c1/0x220 [ 8444.642401][ C2] ? lock_release+0x1d5/0x250 [ 8444.642634][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8444.642875][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8444.643139][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8444.643415][ C2] ? lock_acquire+0x1c1/0x220 [ 8444.643647][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8444.643880][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8444.644132][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8444.644360][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8444.644598][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8444.644846][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8444.645114][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8444.645383][ C2] ip_local_deliver+0x19d/0x480 [ 8444.645623][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8444.645885][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8444.646141][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8444.646478][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8444.646721][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8444.647031][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8444.647287][ C2] ip_rcv+0x564/0x740 [ 8444.647485][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8444.647707][ C2] ? set_track_prepare+0x8a/0xd0 [ 8444.647952][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8444.648222][ C2] ? start_secondary+0x21c/0x2b0 [ 8444.648466][ C2] ? skb_clone+0x10b/0x330 [ 8444.648686][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8444.648994][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8444.649292][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8444.649587][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8444.649879][ C2] ? __tcf_classify+0x329/0x7d0 [ 8444.650126][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8444.650355][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8444.650665][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8444.650939][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8444.651256][ C2] ? lock_acquire+0x1c1/0x220 [ 8444.651487][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8444.651775][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8444.652050][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8444.652358][ C2] ? __copy_skb_header+0xaf/0x490 [ 8444.652608][ C2] ? __skb_clone+0x57a/0x760 [ 8444.652836][ C2] netif_receive_skb+0x55/0x280 [ 8444.653076][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8444.653379][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8444.653703][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8444.653991][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8444.654257][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8444.654538][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8444.654841][ C2] ? get_stack_info+0x36/0xc0 [ 8444.655072][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8444.655331][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8444.655637][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8444.655905][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8444.656174][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8444.656479][ C2] ? kernel_text_address+0x17/0xe0 [ 8444.656731][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8444.657034][ C2] ? arch_stack_walk+0x8c/0x100 [ 8444.657277][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8444.657533][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8444.657807][ C2] ? lock_acquire+0x1c1/0x220 [ 8444.658039][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8444.658313][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8444.658607][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8444.658876][ C2] ? get_stack_info+0x36/0xc0 [ 8444.659108][ C2] __tcf_classify+0x329/0x7d0 [ 8444.659344][ C2] tcf_classify+0x283/0x930 [ 8444.659593][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8444.659848][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8444.660160][ C2] tc_run+0x2e4/0x5d0 [ 8444.660363][ C2] ? __pfx_tc_run+0x10/0x10 [ 8444.660592][ C2] ? lock_acquire+0x1c1/0x220 [ 8444.660835][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8444.661085][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8444.661331][ C2] ? lock_acquire+0x1c1/0x220 [ 8444.661562][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8444.661817][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8444.662111][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8444.662375][ C2] ? neigh_hh_output+0x348/0x590 [ 8444.662618][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8444.662874][ C2] ip_finish_output2+0x786/0x18e0 [ 8444.663124][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8444.663450][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8444.663719][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8444.663963][ C2] ? __ip_finish_output+0x10f/0x770 [ 8444.664225][ C2] ip_output+0x16b/0x4f0 [ 8444.664434][ C2] ? __pfx_ip_output+0x10/0x10 [ 8444.664670][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8444.664937][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8444.665241][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8444.665529][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8444.665778][ C2] ? __alloc_skb+0xd4/0x280 [ 8444.666008][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8444.666275][ C2] ? tcp_fragment+0x168/0x1040 [ 8444.666528][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8444.666772][ C2] ? ip_local_out+0x114/0x3b0 [ 8444.667005][ C2] __ip_queue_xmit+0x672/0x1910 [ 8444.667246][ C2] ? __skb_clone+0x57a/0x760 [ 8444.667473][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8444.667730][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8444.668003][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8444.668240][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8444.668479][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8444.668771][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8444.669081][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8444.669319][ C2] tcp_send_loss_probe+0x348/0x830 [ 8444.669595][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8444.669860][ C2] tcp_write_timer+0x82/0x1d0 [ 8444.670099][ C2] call_timer_fn+0x173/0x430 [ 8444.670335][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8444.670595][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8444.670859][ C2] __run_timers.part.0+0x52d/0x890 [ 8444.671111][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8444.671373][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8444.671648][ C2] ? lock_acquire+0x1c1/0x220 [ 8444.671880][ C2] ? clockevents_program_event+0xf6/0x300 [ 8444.672161][ C2] ? lock_release+0x1d5/0x250 [ 8444.672391][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8444.672648][ C2] ? ktime_get+0xb3/0x190 [ 8444.672862][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8444.673150][ C2] run_timer_softirq+0x72/0x100 [ 8444.673391][ C2] __do_softirq+0x1b9/0x7ff [ 8444.673616][ C2] irq_exit_rcu+0x98/0xc0 [ 8444.673828][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8444.674105][ C2] [ 8444.674250][ C2] [ 8444.674397][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8444.674691][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8444.674939][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8444.675881][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8444.676177][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8444.676566][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8444.676951][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8444.677338][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8444.677724][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8444.678115][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8444.678395][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8444.678648][ C2] default_idle_call+0x69/0xa0 [ 8444.678884][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8444.679128][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8444.679396][ C2] ? lock_release+0x1d5/0x250 [ 8444.679652][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8444.679922][ C2] do_idle+0xfb/0x160 [ 8444.680127][ C2] cpu_startup_entry+0x55/0x60 [ 8444.680368][ C2] start_secondary+0x21c/0x2b0 [ 8444.680610][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8444.680884][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8444.681187][ C2] [ 8469.472103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8469.472455][ C1] rcu: 1-....: (6099725 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1478557 [ 8469.473001][ C1] rcu: (t=6114585 jiffies g=1882453 q=721 ncpus=4) [ 8469.473327][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8469.473764][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8469.474360][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8469.474674][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8469.475622][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8469.475921][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8469.476313][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8469.476702][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8469.477090][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8469.477480][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8469.477870][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8469.478309][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8469.478633][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8469.479022][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8469.479415][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8469.479805][ C1] PKRU: 55555554 [ 8469.479981][ C1] Call Trace: [ 8469.480146][ C1] [ 8469.480290][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8469.480557][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8469.480804][ C1] ? check_cpu_stall+0x284/0x500 [ 8469.481050][ C1] ? rcu_pending+0x92/0x360 [ 8469.481274][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8469.481536][ C1] ? update_process_times+0xb9/0x110 [ 8469.481800][ C1] ? tick_sched_handle+0x67/0x130 [ 8469.482050][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8469.482328][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8469.482565][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8469.482870][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8469.483136][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8469.483417][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8469.483675][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8469.483970][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8469.484226][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8469.484527][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8469.484816][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8469.485121][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8469.485403][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8469.485685][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8469.485965][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8469.486272][ C1] ? get_stack_info+0x36/0xc0 [ 8469.486508][ C1] ? lock_acquire+0x1c1/0x220 [ 8469.486742][ C1] ? lock_release+0x1d5/0x250 [ 8469.486975][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8469.487218][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8469.487483][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8469.487762][ C1] ? lock_acquire+0x1c1/0x220 [ 8469.487995][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8469.488228][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8469.488483][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8469.488712][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8469.488953][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8469.489205][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8469.489496][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8469.489774][ C1] ip_local_deliver+0x19d/0x480 [ 8469.490021][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8469.490296][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8469.490560][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8469.490908][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8469.491156][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8469.491469][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8469.491724][ C1] ip_rcv+0x564/0x740 [ 8469.491922][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8469.492148][ C1] ? set_track_prepare+0x8a/0xd0 [ 8469.492397][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8469.492665][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8469.492931][ C1] ? skb_clone+0x10b/0x330 [ 8469.493154][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8469.493466][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8469.493765][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8469.494038][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8469.494327][ C1] ? __tcf_classify+0x329/0x7d0 [ 8469.494568][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8469.494795][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8469.495087][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8469.495365][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8469.495682][ C1] ? lock_acquire+0x1c1/0x220 [ 8469.495915][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8469.496205][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8469.496483][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8469.496793][ C1] ? __copy_skb_header+0xaf/0x490 [ 8469.497045][ C1] ? __skb_clone+0x57a/0x760 [ 8469.497276][ C1] netif_receive_skb+0x55/0x280 [ 8469.497521][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8469.497824][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8469.498151][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8469.498444][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8469.498710][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8469.498993][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8469.499298][ C1] ? hlock_class+0x4e/0x130 [ 8469.499547][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8469.499824][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8469.500101][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8469.500365][ C1] ? hlock_class+0x4e/0x130 [ 8469.500606][ C1] ? mark_lock+0x38/0x3e0 [ 8469.500821][ C1] ? stack_access_ok+0xda/0x1f0 [ 8469.501062][ C1] ? __lock_acquire+0xb67/0x1610 [ 8469.501311][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8469.501579][ C1] ? get_stack_info+0x36/0xc0 [ 8469.501814][ C1] ? stack_access_ok+0xda/0x1f0 [ 8469.502055][ C1] ? get_reg+0x119/0x190 [ 8469.502267][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8469.502527][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8469.502829][ C1] __tcf_classify+0x329/0x7d0 [ 8469.503066][ C1] tcf_classify+0x283/0x930 [ 8469.503292][ C1] ? arch_stack_walk+0xa2/0x100 [ 8469.503534][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8469.503784][ C1] ? get_stack_info+0x36/0xc0 [ 8469.504019][ C1] tc_run+0x2e4/0x5d0 [ 8469.504219][ C1] ? __pfx_tc_run+0x10/0x10 [ 8469.504446][ C1] ? lock_acquire+0x1c1/0x220 [ 8469.504679][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8469.504934][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8469.505181][ C1] ? lock_acquire+0x1c1/0x220 [ 8469.505412][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8469.505671][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8469.505968][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8469.506235][ C1] ? neigh_hh_output+0x348/0x590 [ 8469.506481][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8469.506740][ C1] ip_finish_output2+0x786/0x18e0 [ 8469.506989][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8469.507262][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8469.507591][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8469.507858][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8469.508105][ C1] ? __ip_finish_output+0x10f/0x770 [ 8469.508365][ C1] ip_output+0x16b/0x4f0 [ 8469.508576][ C1] ? run_timer_softirq+0x72/0x100 [ 8469.508826][ C1] ? __pfx_ip_output+0x10/0x10 [ 8469.509063][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8469.509347][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8469.509615][ C1] ? ip_local_out+0x114/0x3b0 [ 8469.509856][ C1] __ip_queue_xmit+0x672/0x1910 [ 8469.510105][ C1] ? __create_object+0x5e/0xb0 [ 8469.510349][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8469.510627][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8469.510901][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8469.511166][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8469.511441][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8469.511707][ C1] tcp_delack_timer+0x84/0x240 [ 8469.511945][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8469.512210][ C1] call_timer_fn+0x173/0x430 [ 8469.512441][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8469.512696][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8469.512951][ C1] __run_timers.part.0+0x52d/0x890 [ 8469.513206][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8469.513472][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8469.513749][ C1] ? lock_acquire+0x1c1/0x220 [ 8469.513982][ C1] ? clockevents_program_event+0xf6/0x300 [ 8469.514268][ C1] ? lock_release+0x1d5/0x250 [ 8469.514500][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8469.514761][ C1] ? ktime_get+0xb3/0x190 [ 8469.514976][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8469.515265][ C1] run_timer_softirq+0x72/0x100 [ 8469.515506][ C1] __do_softirq+0x1b9/0x7ff [ 8469.515733][ C1] irq_exit_rcu+0x98/0xc0 [ 8469.515948][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8469.516227][ C1] [ 8469.516374][ C1] [ 8469.516523][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8469.516820][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8469.517138][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8469.518090][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8469.518392][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8469.518784][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8469.519173][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8469.519589][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8469.519991][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8469.520395][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8469.520698][ C1] pipe_read+0xa16/0xdf0 [ 8469.520916][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8469.521187][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8469.521427][ C1] ? iterate_tty_write+0x299/0x540 [ 8469.521682][ C1] ? lock_release+0x1d5/0x250 [ 8469.521919][ C1] vfs_read+0x911/0xc00 [ 8469.522128][ C1] ? lock_acquire+0x1c1/0x220 [ 8469.522364][ C1] ? __might_fault+0xc6/0x180 [ 8469.522598][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8469.522832][ C1] ? __might_fault+0xc6/0x180 [ 8469.523069][ C1] ? lock_release+0x1d5/0x250 [ 8469.523306][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8469.523564][ C1] ? __fget_light+0x54/0x1e0 [ 8469.523800][ C1] ksys_read+0x17a/0x1e0 [ 8469.524012][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8469.524253][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8469.524550][ C1] do_syscall_64+0xc9/0x1e0 [ 8469.524778][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8469.525072][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8469.525294][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8469.526248][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8469.526661][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8469.527050][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8469.527443][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8469.527833][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8469.528222][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8469.528614][ C1] [ 8469.528770][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8469.529036][ C2] NMI backtrace for cpu 2 [ 8469.529042][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8469.529048][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8469.529052][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8469.529060][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8469.529065][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8469.529070][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8469.529074][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8469.529078][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8469.529082][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8469.529086][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8469.529090][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8469.529094][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8469.529100][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8469.529104][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8469.529107][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8469.529110][ C2] PKRU: 55555554 [ 8469.529112][ C2] Call Trace: [ 8469.529115][ C2] [ 8469.529118][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8469.529129][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8469.529137][ C2] ? nmi_handle+0x153/0x420 [ 8469.529147][ C2] ? default_do_nmi+0x41/0x100 [ 8469.529154][ C2] ? exc_nmi+0xf3/0x120 [ 8469.529159][ C2] ? end_repeat_nmi+0xf/0x60 [ 8469.529171][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8469.529179][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8469.529187][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8469.529196][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8469.529203][ C2] [ 8469.529205][ C2] [ 8469.529208][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8469.529215][ C2] ? get_stack_info+0x36/0xc0 [ 8469.529223][ C2] ? lock_acquire+0x1c1/0x220 [ 8469.529231][ C2] ? lock_release+0x1d5/0x250 [ 8469.529239][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8469.529248][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8469.529255][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8469.529263][ C2] ? lock_acquire+0x1c1/0x220 [ 8469.529268][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8469.529277][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8469.529283][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8469.529299][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8469.529305][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8469.529317][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8469.529328][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8469.529331][ C2] ip_local_deliver+0x19d/0x480 [ 8469.529334][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8469.529336][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8469.529339][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8469.529344][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8469.529365][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8469.529368][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8469.529377][ C2] ip_rcv+0x564/0x740 [ 8469.529379][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8469.529382][ C2] ? set_track_prepare+0x8a/0xd0 [ 8469.529386][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8469.529389][ C2] ? start_secondary+0x21c/0x2b0 [ 8469.529393][ C2] ? skb_clone+0x10b/0x330 [ 8469.529396][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8469.529402][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8469.529407][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8469.529410][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8469.529419][ C2] ? __tcf_classify+0x329/0x7d0 [ 8469.529422][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8469.529425][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8469.529428][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8469.529431][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8469.529436][ C2] ? lock_acquire+0x1c1/0x220 [ 8469.529438][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8469.529442][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8469.529446][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8469.529450][ C2] ? __copy_skb_header+0xaf/0x490 [ 8469.529454][ C2] ? __skb_clone+0x57a/0x760 [ 8469.529456][ C2] netif_receive_skb+0x55/0x280 [ 8469.529460][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8469.529466][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8469.529473][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8469.529479][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8469.529484][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8469.529494][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8469.529501][ C2] ? get_stack_info+0x36/0xc0 [ 8469.529506][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8469.529508][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8469.529512][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8469.529514][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8469.529518][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8469.529520][ C2] ? kernel_text_address+0x17/0xe0 [ 8469.529523][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8469.529527][ C2] ? arch_stack_walk+0x8c/0x100 [ 8469.529531][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8469.529534][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8469.529538][ C2] ? lock_acquire+0x1c1/0x220 [ 8469.529540][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8469.529544][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8469.529548][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8469.529551][ C2] ? get_stack_info+0x36/0xc0 [ 8469.529555][ C2] __tcf_classify+0x329/0x7d0 [ 8469.529560][ C2] tcf_classify+0x283/0x930 [ 8469.529565][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8469.529568][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8469.529573][ C2] tc_run+0x2e4/0x5d0 [ 8469.529576][ C2] ? __pfx_tc_run+0x10/0x10 [ 8469.529580][ C2] ? lock_acquire+0x1c1/0x220 [ 8469.529582][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8469.529586][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8469.529590][ C2] ? lock_acquire+0x1c1/0x220 [ 8469.529592][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8469.529596][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8469.529598][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8469.529601][ C2] ? neigh_hh_output+0x348/0x590 [ 8469.529605][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8469.529609][ C2] ip_finish_output2+0x786/0x18e0 [ 8469.529612][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8469.529620][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8469.529622][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8469.529626][ C2] ? __ip_finish_output+0x10f/0x770 [ 8469.529630][ C2] ip_output+0x16b/0x4f0 [ 8469.529633][ C2] ? __pfx_ip_output+0x10/0x10 [ 8469.529636][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8469.529639][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8469.529642][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8469.529644][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8469.529647][ C2] ? __alloc_skb+0xd4/0x280 [ 8469.529649][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8469.529653][ C2] ? tcp_fragment+0x168/0x1040 [ 8469.529656][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8469.529659][ C2] ? ip_local_out+0x114/0x3b0 [ 8469.529662][ C2] __ip_queue_xmit+0x672/0x1910 [ 8469.529666][ C2] ? __skb_clone+0x57a/0x760 [ 8469.529669][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8469.529674][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8469.529677][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8469.529680][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8469.529684][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8469.529688][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8469.529692][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8469.529695][ C2] tcp_send_loss_probe+0x348/0x830 [ 8469.529698][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8469.529700][ C2] tcp_write_timer+0x82/0x1d0 [ 8469.529704][ C2] call_timer_fn+0x173/0x430 [ 8469.529707][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8469.529712][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8469.529716][ C2] __run_timers.part.0+0x52d/0x890 [ 8469.529719][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8469.529723][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8469.529726][ C2] ? lock_acquire+0x1c1/0x220 [ 8469.529728][ C2] ? clockevents_program_event+0xf6/0x300 [ 8469.529733][ C2] ? lock_release+0x1d5/0x250 [ 8469.529735][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8469.529739][ C2] ? ktime_get+0xb3/0x190 [ 8469.529742][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8469.529746][ C2] run_timer_softirq+0x72/0x100 [ 8469.529750][ C2] __do_softirq+0x1b9/0x7ff [ 8469.529755][ C2] irq_exit_rcu+0x98/0xc0 [ 8469.529757][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8469.529760][ C2] [ 8469.529761][ C2] [ 8469.529762][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8469.529765][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8469.529768][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8469.529770][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8469.529772][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8469.529774][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8469.529776][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8469.529777][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8469.529779][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8469.529783][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8469.529786][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8469.529789][ C2] default_idle_call+0x69/0xa0 [ 8469.529792][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8469.529794][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8469.529798][ C2] ? lock_release+0x1d5/0x250 [ 8469.529800][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8469.529804][ C2] do_idle+0xfb/0x160 [ 8469.529807][ C2] cpu_startup_entry+0x55/0x60 [ 8469.529809][ C2] start_secondary+0x21c/0x2b0 [ 8469.529811][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8469.529815][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8469.529821][ C2] [ 8496.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5722s! [swapper/2:0] [ 8496.569676][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8496.570895][ C2] irq event stamp: 44114564 [ 8496.571114][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8496.571634][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8496.572129][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8496.572591][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8496.573046][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8496.573489][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8496.574081][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8496.574353][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8496.575295][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 8496.575590][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8496.575977][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8496.576364][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8496.576747][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8496.577132][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8496.577520][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8496.577952][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8496.578274][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8496.578658][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8496.579042][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8496.579436][ C2] PKRU: 55555554 [ 8496.579610][ C2] Call Trace: [ 8496.579774][ C2] [ 8496.579916][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8496.580171][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8496.580404][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8496.580675][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8496.580938][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8496.581218][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8496.581475][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8496.581770][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8496.582022][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8496.582279][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8496.582596][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8496.582890][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8496.583204][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8496.583490][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8496.583781][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 8496.584053][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8496.584355][ C2] ? get_stack_info+0x36/0xc0 [ 8496.584588][ C2] ? lock_acquire+0x1c1/0x220 [ 8496.584819][ C2] ? lock_release+0x1d5/0x250 [ 8496.585052][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8496.585294][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8496.585556][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8496.585833][ C2] ? lock_acquire+0x1c1/0x220 [ 8496.586063][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8496.586296][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8496.586547][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8496.586776][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8496.587015][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8496.587267][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8496.587532][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8496.587799][ C2] ip_local_deliver+0x19d/0x480 [ 8496.588038][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8496.588302][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8496.588556][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8496.588892][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8496.589137][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8496.589481][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8496.589744][ C2] ip_rcv+0x564/0x740 [ 8496.589945][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8496.590175][ C2] ? set_track_prepare+0x8a/0xd0 [ 8496.590427][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8496.590700][ C2] ? start_secondary+0x21c/0x2b0 [ 8496.590949][ C2] ? skb_clone+0x10b/0x330 [ 8496.591174][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8496.591491][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8496.591792][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8496.592074][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8496.592373][ C2] ? __tcf_classify+0x329/0x7d0 [ 8496.592613][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8496.592836][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8496.593123][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8496.593402][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8496.593717][ C2] ? lock_acquire+0x1c1/0x220 [ 8496.593948][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8496.594234][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8496.594512][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8496.594817][ C2] ? __copy_skb_header+0xaf/0x490 [ 8496.595066][ C2] ? __skb_clone+0x57a/0x760 [ 8496.595292][ C2] netif_receive_skb+0x55/0x280 [ 8496.595531][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8496.595834][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8496.596154][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8496.596444][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8496.596709][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8496.596986][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8496.597289][ C2] ? get_stack_info+0x36/0xc0 [ 8496.597523][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8496.597780][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8496.598084][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8496.598351][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8496.598620][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8496.598924][ C2] ? kernel_text_address+0x17/0xe0 [ 8496.599176][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8496.599510][ C2] ? arch_stack_walk+0x8c/0x100 [ 8496.599754][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8496.600018][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8496.600303][ C2] ? lock_acquire+0x1c1/0x220 [ 8496.600549][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8496.600820][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8496.601115][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8496.601381][ C2] ? get_stack_info+0x36/0xc0 [ 8496.601614][ C2] __tcf_classify+0x329/0x7d0 [ 8496.601848][ C2] tcf_classify+0x283/0x930 [ 8496.602070][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8496.602319][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8496.602621][ C2] tc_run+0x2e4/0x5d0 [ 8496.602818][ C2] ? __pfx_tc_run+0x10/0x10 [ 8496.603042][ C2] ? lock_acquire+0x1c1/0x220 [ 8496.603274][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8496.603526][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8496.603770][ C2] ? lock_acquire+0x1c1/0x220 [ 8496.604000][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8496.604257][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8496.604548][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8496.604812][ C2] ? neigh_hh_output+0x348/0x590 [ 8496.605055][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8496.605313][ C2] ip_finish_output2+0x786/0x18e0 [ 8496.605561][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8496.605887][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8496.606152][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8496.606397][ C2] ? __ip_finish_output+0x10f/0x770 [ 8496.606652][ C2] ip_output+0x16b/0x4f0 [ 8496.606862][ C2] ? __pfx_ip_output+0x10/0x10 [ 8496.607095][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8496.607366][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8496.607666][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8496.607934][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8496.608177][ C2] ? __alloc_skb+0xd4/0x280 [ 8496.608400][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8496.608661][ C2] ? tcp_fragment+0x168/0x1040 [ 8496.608895][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8496.609138][ C2] ? ip_local_out+0x114/0x3b0 [ 8496.609397][ C2] __ip_queue_xmit+0x672/0x1910 [ 8496.609642][ C2] ? __skb_clone+0x57a/0x760 [ 8496.609877][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8496.610142][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8496.610432][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8496.610668][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8496.610909][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8496.611201][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8496.611511][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8496.611745][ C2] tcp_send_loss_probe+0x348/0x830 [ 8496.611998][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8496.612260][ C2] tcp_write_timer+0x82/0x1d0 [ 8496.612489][ C2] call_timer_fn+0x173/0x430 [ 8496.612719][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8496.612972][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8496.613225][ C2] __run_timers.part.0+0x52d/0x890 [ 8496.613476][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8496.613737][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8496.614012][ C2] ? lock_acquire+0x1c1/0x220 [ 8496.614245][ C2] ? clockevents_program_event+0xf6/0x300 [ 8496.614525][ C2] ? lock_release+0x1d5/0x250 [ 8496.614756][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8496.615011][ C2] ? ktime_get+0xb3/0x190 [ 8496.615225][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8496.615513][ C2] run_timer_softirq+0x72/0x100 [ 8496.615752][ C2] __do_softirq+0x1b9/0x7ff [ 8496.615977][ C2] irq_exit_rcu+0x98/0xc0 [ 8496.616190][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8496.616466][ C2] [ 8496.616613][ C2] [ 8496.616757][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8496.617052][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8496.617301][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8496.618239][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8496.618536][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8496.618942][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8496.619340][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8496.619737][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8496.620133][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8496.620538][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8496.620818][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8496.621069][ C2] default_idle_call+0x69/0xa0 [ 8496.621305][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8496.621550][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8496.621820][ C2] ? lock_release+0x1d5/0x250 [ 8496.622050][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8496.622316][ C2] do_idle+0xfb/0x160 [ 8496.622513][ C2] cpu_startup_entry+0x55/0x60 [ 8496.622748][ C2] start_secondary+0x21c/0x2b0 [ 8496.622983][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8496.623246][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8496.623546][ C2] [ 8496.623697][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5722s! [perl:4135] [ 8496.624096][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8496.625315][ C1] irq event stamp: 209232 [ 8496.625529][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8496.626042][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8496.626507][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8496.626963][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8496.627413][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8496.627849][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8496.628445][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8496.628760][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8496.629741][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8496.630049][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8496.630461][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8496.630849][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8496.631238][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8496.631626][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8496.632016][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8496.632453][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8496.632777][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8496.633171][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8496.633559][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8496.633950][ C1] PKRU: 55555554 [ 8496.634126][ C1] Call Trace: [ 8496.634293][ C1] [ 8496.634438][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8496.634692][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8496.634928][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8496.635202][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8496.635467][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8496.635746][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8496.636005][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8496.636303][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8496.636558][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8496.636859][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8496.637148][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8496.637455][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8496.637736][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8496.638024][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8496.638306][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8496.638610][ C1] ? get_stack_info+0x36/0xc0 [ 8496.638845][ C1] ? lock_acquire+0x1c1/0x220 [ 8496.639079][ C1] ? lock_release+0x1d5/0x250 [ 8496.639334][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8496.639582][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8496.639855][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8496.640142][ C1] ? lock_acquire+0x1c1/0x220 [ 8496.640383][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8496.640626][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8496.640880][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8496.641107][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8496.641350][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8496.641601][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8496.641867][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8496.642138][ C1] ip_local_deliver+0x19d/0x480 [ 8496.642380][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8496.642644][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8496.642901][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8496.643238][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8496.643484][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8496.643796][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8496.644051][ C1] ip_rcv+0x564/0x740 [ 8496.644250][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8496.644476][ C1] ? set_track_prepare+0x8a/0xd0 [ 8496.644722][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8496.644991][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8496.645259][ C1] ? skb_clone+0x10b/0x330 [ 8496.645482][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8496.645792][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8496.646090][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8496.646369][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8496.646656][ C1] ? __tcf_classify+0x329/0x7d0 [ 8496.646897][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8496.647122][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8496.647415][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8496.647691][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8496.648007][ C1] ? lock_acquire+0x1c1/0x220 [ 8496.648242][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8496.648530][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8496.648807][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8496.649115][ C1] ? __copy_skb_header+0xaf/0x490 [ 8496.649391][ C1] ? __skb_clone+0x57a/0x760 [ 8496.649626][ C1] netif_receive_skb+0x55/0x280 [ 8496.649873][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8496.650185][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8496.650532][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8496.650823][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8496.651091][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8496.651375][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8496.651679][ C1] ? hlock_class+0x4e/0x130 [ 8496.651903][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8496.652172][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8496.652442][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8496.652698][ C1] ? hlock_class+0x4e/0x130 [ 8496.652923][ C1] ? mark_lock+0x38/0x3e0 [ 8496.653137][ C1] ? stack_access_ok+0xda/0x1f0 [ 8496.653380][ C1] ? __lock_acquire+0xb67/0x1610 [ 8496.653627][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8496.653895][ C1] ? get_stack_info+0x36/0xc0 [ 8496.654129][ C1] ? stack_access_ok+0xda/0x1f0 [ 8496.654369][ C1] ? get_reg+0x119/0x190 [ 8496.654579][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8496.654839][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8496.655140][ C1] __tcf_classify+0x329/0x7d0 [ 8496.655377][ C1] tcf_classify+0x283/0x930 [ 8496.655602][ C1] ? arch_stack_walk+0xa2/0x100 [ 8496.655842][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8496.656092][ C1] ? get_stack_info+0x36/0xc0 [ 8496.656328][ C1] tc_run+0x2e4/0x5d0 [ 8496.656526][ C1] ? __pfx_tc_run+0x10/0x10 [ 8496.656752][ C1] ? lock_acquire+0x1c1/0x220 [ 8496.656988][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8496.657243][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8496.657489][ C1] ? lock_acquire+0x1c1/0x220 [ 8496.657720][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8496.657978][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8496.658273][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8496.658540][ C1] ? neigh_hh_output+0x348/0x590 [ 8496.658784][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8496.659042][ C1] ip_finish_output2+0x786/0x18e0 [ 8496.659317][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8496.659593][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8496.659929][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8496.660208][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8496.660469][ C1] ? __ip_finish_output+0x10f/0x770 [ 8496.660732][ C1] ip_output+0x16b/0x4f0 [ 8496.660943][ C1] ? run_timer_softirq+0x72/0x100 [ 8496.661193][ C1] ? __pfx_ip_output+0x10/0x10 [ 8496.661431][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8496.661711][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8496.661956][ C1] ? ip_local_out+0x114/0x3b0 [ 8496.662190][ C1] __ip_queue_xmit+0x672/0x1910 [ 8496.662432][ C1] ? __create_object+0x5e/0xb0 [ 8496.662669][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8496.662929][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8496.663203][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8496.663467][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8496.663742][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8496.664006][ C1] tcp_delack_timer+0x84/0x240 [ 8496.664245][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8496.664508][ C1] call_timer_fn+0x173/0x430 [ 8496.664739][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8496.664992][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8496.665247][ C1] __run_timers.part.0+0x52d/0x890 [ 8496.665500][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8496.665766][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8496.666043][ C1] ? lock_acquire+0x1c1/0x220 [ 8496.666275][ C1] ? clockevents_program_event+0xf6/0x300 [ 8496.666559][ C1] ? lock_release+0x1d5/0x250 [ 8496.666790][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8496.667048][ C1] ? ktime_get+0xb3/0x190 [ 8496.667264][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8496.667554][ C1] run_timer_softirq+0x72/0x100 [ 8496.667795][ C1] __do_softirq+0x1b9/0x7ff [ 8496.668020][ C1] irq_exit_rcu+0x98/0xc0 [ 8496.668236][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8496.668513][ C1] [ 8496.668659][ C1] [ 8496.668807][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8496.669103][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8496.669444][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8496.670411][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8496.670722][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8496.671110][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8496.671498][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8496.671884][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8496.672276][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8496.672665][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8496.672953][ C1] pipe_read+0xa16/0xdf0 [ 8496.673168][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8496.673437][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8496.673674][ C1] ? iterate_tty_write+0x299/0x540 [ 8496.673928][ C1] ? lock_release+0x1d5/0x250 [ 8496.674163][ C1] vfs_read+0x911/0xc00 [ 8496.674370][ C1] ? lock_acquire+0x1c1/0x220 [ 8496.674603][ C1] ? __might_fault+0xc6/0x180 [ 8496.674836][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8496.675068][ C1] ? __might_fault+0xc6/0x180 [ 8496.675303][ C1] ? lock_release+0x1d5/0x250 [ 8496.675537][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8496.675793][ C1] ? __fget_light+0x54/0x1e0 [ 8496.676025][ C1] ksys_read+0x17a/0x1e0 [ 8496.676236][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8496.676474][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8496.676771][ C1] do_syscall_64+0xc9/0x1e0 [ 8496.676996][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8496.677289][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8496.677510][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8496.678458][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8496.678867][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8496.679277][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8496.679676][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8496.680073][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8496.680481][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8496.680870][ C1] [ 8524.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5748s! [perl:4135] [ 8524.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8524.570915][ C1] irq event stamp: 209232 [ 8524.571129][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8524.571644][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8524.572108][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8524.572565][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8524.573016][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8524.573454][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8524.574050][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8524.574367][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8524.575314][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8524.575614][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8524.576003][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8524.576392][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8524.576779][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8524.577166][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8524.577556][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8524.577991][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8524.578317][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8524.578705][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8524.579094][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8524.579511][ C1] PKRU: 55555554 [ 8524.579692][ C1] Call Trace: [ 8524.579862][ C1] [ 8524.580010][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8524.580273][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8524.580519][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8524.580790][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8524.581055][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8524.581336][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8524.581596][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8524.581892][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8524.582146][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8524.582449][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8524.582738][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8524.583044][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8524.583325][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8524.583613][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8524.583892][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8524.584196][ C1] ? get_stack_info+0x36/0xc0 [ 8524.584432][ C1] ? lock_acquire+0x1c1/0x220 [ 8524.584666][ C1] ? lock_release+0x1d5/0x250 [ 8524.584898][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8524.585140][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8524.585407][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8524.585685][ C1] ? lock_acquire+0x1c1/0x220 [ 8524.585918][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8524.586152][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8524.586406][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8524.586634][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8524.586874][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8524.587125][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8524.587396][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8524.587669][ C1] ip_local_deliver+0x19d/0x480 [ 8524.587910][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8524.588186][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8524.588444][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8524.588783][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8524.589030][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8524.589370][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8524.589633][ C1] ip_rcv+0x564/0x740 [ 8524.589837][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8524.590070][ C1] ? set_track_prepare+0x8a/0xd0 [ 8524.590326][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8524.590603][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8524.590876][ C1] ? skb_clone+0x10b/0x330 [ 8524.591105][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8524.591426][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8524.591736][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8524.592011][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8524.592301][ C1] ? __tcf_classify+0x329/0x7d0 [ 8524.592544][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8524.592769][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8524.593063][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8524.593341][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8524.593659][ C1] ? lock_acquire+0x1c1/0x220 [ 8524.593893][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8524.594184][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8524.594462][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8524.594772][ C1] ? __copy_skb_header+0xaf/0x490 [ 8524.595023][ C1] ? __skb_clone+0x57a/0x760 [ 8524.595256][ C1] netif_receive_skb+0x55/0x280 [ 8524.595498][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8524.595802][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8524.596128][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8524.596421][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8524.596688][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8524.596972][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8524.597279][ C1] ? hlock_class+0x4e/0x130 [ 8524.597506][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8524.597776][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8524.598047][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8524.598305][ C1] ? hlock_class+0x4e/0x130 [ 8524.598531][ C1] ? mark_lock+0x38/0x3e0 [ 8524.598745][ C1] ? stack_access_ok+0xda/0x1f0 [ 8524.598989][ C1] ? __lock_acquire+0xb67/0x1610 [ 8524.599261][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8524.599537][ C1] ? get_stack_info+0x36/0xc0 [ 8524.599777][ C1] ? stack_access_ok+0xda/0x1f0 [ 8524.600025][ C1] ? get_reg+0x119/0x190 [ 8524.600243][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8524.600518][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8524.600821][ C1] __tcf_classify+0x329/0x7d0 [ 8524.601058][ C1] tcf_classify+0x283/0x930 [ 8524.601286][ C1] ? arch_stack_walk+0xa2/0x100 [ 8524.601527][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8524.601778][ C1] ? get_stack_info+0x36/0xc0 [ 8524.602015][ C1] tc_run+0x2e4/0x5d0 [ 8524.602215][ C1] ? __pfx_tc_run+0x10/0x10 [ 8524.602442][ C1] ? lock_acquire+0x1c1/0x220 [ 8524.602677][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8524.602932][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8524.603180][ C1] ? lock_acquire+0x1c1/0x220 [ 8524.603413][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8524.603673][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8524.603970][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8524.604238][ C1] ? neigh_hh_output+0x348/0x590 [ 8524.604485][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8524.604745][ C1] ip_finish_output2+0x786/0x18e0 [ 8524.604995][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8524.605268][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8524.605597][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8524.605866][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8524.606112][ C1] ? __ip_finish_output+0x10f/0x770 [ 8524.606373][ C1] ip_output+0x16b/0x4f0 [ 8524.606585][ C1] ? run_timer_softirq+0x72/0x100 [ 8524.606836][ C1] ? __pfx_ip_output+0x10/0x10 [ 8524.607075][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8524.607355][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8524.607601][ C1] ? ip_local_out+0x114/0x3b0 [ 8524.607836][ C1] __ip_queue_xmit+0x672/0x1910 [ 8524.608079][ C1] ? __create_object+0x5e/0xb0 [ 8524.608318][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8524.608579][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8524.608854][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8524.609139][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8524.609424][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8524.609697][ C1] tcp_delack_timer+0x84/0x240 [ 8524.609942][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8524.610216][ C1] call_timer_fn+0x173/0x430 [ 8524.610460][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8524.610715][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8524.610974][ C1] __run_timers.part.0+0x52d/0x890 [ 8524.611228][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8524.611495][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8524.611775][ C1] ? lock_acquire+0x1c1/0x220 [ 8524.612007][ C1] ? clockevents_program_event+0xf6/0x300 [ 8524.612294][ C1] ? lock_release+0x1d5/0x250 [ 8524.612527][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8524.612786][ C1] ? ktime_get+0xb3/0x190 [ 8524.613000][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8524.613292][ C1] run_timer_softirq+0x72/0x100 [ 8524.613536][ C1] __do_softirq+0x1b9/0x7ff [ 8524.613762][ C1] irq_exit_rcu+0x98/0xc0 [ 8524.613978][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8524.614259][ C1] [ 8524.614406][ C1] [ 8524.614554][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8524.614851][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8524.615172][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8524.616121][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8524.616423][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8524.616812][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8524.617203][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8524.617593][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8524.617985][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8524.618378][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8524.618667][ C1] pipe_read+0xa16/0xdf0 [ 8524.618883][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8524.619178][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8524.619424][ C1] ? iterate_tty_write+0x299/0x540 [ 8524.619687][ C1] ? lock_release+0x1d5/0x250 [ 8524.619930][ C1] vfs_read+0x911/0xc00 [ 8524.620144][ C1] ? lock_acquire+0x1c1/0x220 [ 8524.620395][ C1] ? __might_fault+0xc6/0x180 [ 8524.620630][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8524.620862][ C1] ? __might_fault+0xc6/0x180 [ 8524.621097][ C1] ? lock_release+0x1d5/0x250 [ 8524.621333][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8524.621592][ C1] ? __fget_light+0x54/0x1e0 [ 8524.621823][ C1] ksys_read+0x17a/0x1e0 [ 8524.622035][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8524.622276][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8524.622574][ C1] do_syscall_64+0xc9/0x1e0 [ 8524.622801][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8524.623094][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8524.623317][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8524.624269][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8524.624680][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8524.625069][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8524.625463][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8524.625852][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8524.626242][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8524.626634][ C1] [ 8524.626790][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5748s! [swapper/2:0] [ 8524.627193][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8524.628405][ C2] irq event stamp: 44114564 [ 8524.628628][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8524.629167][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8524.629675][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8524.630149][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8524.630616][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8524.631055][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8524.631649][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8524.631963][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8524.632900][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8524.633198][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8524.633584][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8524.633971][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8524.634357][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8524.634748][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8524.635133][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8524.635566][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8524.635888][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8524.636275][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8524.636663][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8524.637048][ C2] PKRU: 55555554 [ 8524.637225][ C2] Call Trace: [ 8524.637389][ C2] [ 8524.637533][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8524.637786][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8524.638021][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8524.638290][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8524.638553][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8524.638833][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8524.639093][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8524.639414][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8524.639673][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8524.639933][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8524.640242][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8524.640538][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8524.640841][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8524.641121][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8524.641407][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8524.641687][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8524.641987][ C2] ? get_stack_info+0x36/0xc0 [ 8524.642219][ C2] ? lock_acquire+0x1c1/0x220 [ 8524.642452][ C2] ? lock_release+0x1d5/0x250 [ 8524.642686][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8524.642927][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8524.643191][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8524.643467][ C2] ? lock_acquire+0x1c1/0x220 [ 8524.643699][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8524.643931][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8524.644184][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8524.644412][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8524.644650][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8524.644902][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8524.645169][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8524.645437][ C2] ip_local_deliver+0x19d/0x480 [ 8524.645677][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8524.645938][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8524.646192][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8524.646529][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8524.646772][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8524.647082][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8524.647336][ C2] ip_rcv+0x564/0x740 [ 8524.647534][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8524.647755][ C2] ? set_track_prepare+0x8a/0xd0 [ 8524.648000][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8524.648270][ C2] ? start_secondary+0x21c/0x2b0 [ 8524.648513][ C2] ? skb_clone+0x10b/0x330 [ 8524.648732][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8524.649040][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8524.649363][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8524.649639][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8524.649931][ C2] ? __tcf_classify+0x329/0x7d0 [ 8524.650179][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8524.650415][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8524.650705][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8524.650980][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8524.651295][ C2] ? lock_acquire+0x1c1/0x220 [ 8524.651527][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8524.651814][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8524.652089][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8524.652396][ C2] ? __copy_skb_header+0xaf/0x490 [ 8524.652645][ C2] ? __skb_clone+0x57a/0x760 [ 8524.652873][ C2] netif_receive_skb+0x55/0x280 [ 8524.653113][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8524.653415][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8524.653738][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8524.654025][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8524.654293][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8524.654572][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8524.654879][ C2] ? get_stack_info+0x36/0xc0 [ 8524.655112][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8524.655369][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8524.655675][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8524.655943][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8524.656210][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8524.656514][ C2] ? kernel_text_address+0x17/0xe0 [ 8524.656767][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8524.657069][ C2] ? arch_stack_walk+0x8c/0x100 [ 8524.657311][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8524.657566][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8524.657842][ C2] ? lock_acquire+0x1c1/0x220 [ 8524.658072][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8524.658346][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8524.658639][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8524.658908][ C2] ? get_stack_info+0x36/0xc0 [ 8524.659161][ C2] __tcf_classify+0x329/0x7d0 [ 8524.659403][ C2] tcf_classify+0x283/0x930 [ 8524.659635][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8524.659890][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8524.660202][ C2] tc_run+0x2e4/0x5d0 [ 8524.660414][ C2] ? __pfx_tc_run+0x10/0x10 [ 8524.660637][ C2] ? lock_acquire+0x1c1/0x220 [ 8524.660868][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8524.661123][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8524.661368][ C2] ? lock_acquire+0x1c1/0x220 [ 8524.661599][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8524.661854][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8524.662149][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8524.662413][ C2] ? neigh_hh_output+0x348/0x590 [ 8524.662657][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8524.662914][ C2] ip_finish_output2+0x786/0x18e0 [ 8524.663163][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8524.663490][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8524.663759][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8524.664003][ C2] ? __ip_finish_output+0x10f/0x770 [ 8524.664260][ C2] ip_output+0x16b/0x4f0 [ 8524.664469][ C2] ? __pfx_ip_output+0x10/0x10 [ 8524.664705][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8524.664973][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8524.665276][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8524.665542][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8524.665785][ C2] ? __alloc_skb+0xd4/0x280 [ 8524.666010][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8524.666270][ C2] ? tcp_fragment+0x168/0x1040 [ 8524.666506][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8524.666754][ C2] ? ip_local_out+0x114/0x3b0 [ 8524.666987][ C2] __ip_queue_xmit+0x672/0x1910 [ 8524.667227][ C2] ? __skb_clone+0x57a/0x760 [ 8524.667454][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8524.667711][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8524.667984][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8524.668221][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8524.668461][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8524.668753][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8524.669062][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8524.669325][ C2] tcp_send_loss_probe+0x348/0x830 [ 8524.669584][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8524.669849][ C2] tcp_write_timer+0x82/0x1d0 [ 8524.670089][ C2] call_timer_fn+0x173/0x430 [ 8524.670335][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8524.670589][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8524.670844][ C2] __run_timers.part.0+0x52d/0x890 [ 8524.671099][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8524.671361][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8524.671635][ C2] ? lock_acquire+0x1c1/0x220 [ 8524.671867][ C2] ? clockevents_program_event+0xf6/0x300 [ 8524.672149][ C2] ? lock_release+0x1d5/0x250 [ 8524.672379][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8524.672636][ C2] ? ktime_get+0xb3/0x190 [ 8524.672853][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8524.673140][ C2] run_timer_softirq+0x72/0x100 [ 8524.673381][ C2] __do_softirq+0x1b9/0x7ff [ 8524.673607][ C2] irq_exit_rcu+0x98/0xc0 [ 8524.673820][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8524.674095][ C2] [ 8524.674240][ C2] [ 8524.674389][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8524.674682][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8524.674931][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8524.675871][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8524.676168][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8524.676557][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8524.676943][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8524.677329][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8524.677714][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8524.678105][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8524.678385][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8524.678636][ C2] default_idle_call+0x69/0xa0 [ 8524.678874][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8524.679139][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8524.679415][ C2] ? lock_release+0x1d5/0x250 [ 8524.679655][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8524.679928][ C2] do_idle+0xfb/0x160 [ 8524.680132][ C2] cpu_startup_entry+0x55/0x60 [ 8524.680384][ C2] start_secondary+0x21c/0x2b0 [ 8524.680622][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8524.680882][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8524.681186][ C2] [ 8547.530103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8547.530462][ C1] rcu: 1-....: (6177561 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1494736 [ 8547.531009][ C1] rcu: (t=6192643 jiffies g=1882453 q=721 ncpus=4) [ 8547.531335][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8547.531774][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8547.532374][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8547.532694][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8547.533646][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8547.533946][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8547.534339][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8547.534729][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8547.535119][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8547.535511][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8547.535903][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8547.536341][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8547.536666][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8547.537057][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8547.537451][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8547.537841][ C1] PKRU: 55555554 [ 8547.538019][ C1] Call Trace: [ 8547.538184][ C1] [ 8547.538334][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8547.538601][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8547.538848][ C1] ? check_cpu_stall+0x284/0x500 [ 8547.539117][ C1] ? rcu_pending+0x92/0x360 [ 8547.539349][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8547.539620][ C1] ? update_process_times+0xb9/0x110 [ 8547.539892][ C1] ? tick_sched_handle+0x67/0x130 [ 8547.540150][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8547.540439][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8547.540676][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8547.540982][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8547.541249][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8547.541533][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8547.541792][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8547.542091][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8547.542349][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8547.542651][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8547.542941][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8547.543250][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8547.543533][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8547.543823][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8547.544106][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8547.544411][ C1] ? get_stack_info+0x36/0xc0 [ 8547.544647][ C1] ? lock_acquire+0x1c1/0x220 [ 8547.544882][ C1] ? lock_release+0x1d5/0x250 [ 8547.545118][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8547.545362][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8547.545629][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8547.545908][ C1] ? lock_acquire+0x1c1/0x220 [ 8547.546142][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8547.546379][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8547.546634][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8547.546862][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8547.547104][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8547.547357][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8547.547629][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8547.547900][ C1] ip_local_deliver+0x19d/0x480 [ 8547.548142][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8547.548410][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8547.548668][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8547.549011][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8547.549258][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8547.549572][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8547.549829][ C1] ip_rcv+0x564/0x740 [ 8547.550032][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8547.550258][ C1] ? set_track_prepare+0x8a/0xd0 [ 8547.550506][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8547.550777][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8547.551044][ C1] ? skb_clone+0x10b/0x330 [ 8547.551266][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8547.551577][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8547.551878][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8547.552153][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8547.552444][ C1] ? __tcf_classify+0x329/0x7d0 [ 8547.552688][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8547.552912][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8547.553207][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8547.553486][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8547.553805][ C1] ? lock_acquire+0x1c1/0x220 [ 8547.554037][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8547.554329][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8547.554607][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8547.554917][ C1] ? __copy_skb_header+0xaf/0x490 [ 8547.555170][ C1] ? __skb_clone+0x57a/0x760 [ 8547.555402][ C1] netif_receive_skb+0x55/0x280 [ 8547.555645][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8547.555952][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8547.556278][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8547.556570][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8547.556839][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8547.557120][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8547.557427][ C1] ? hlock_class+0x4e/0x130 [ 8547.557655][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8547.557926][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8547.558195][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8547.558454][ C1] ? hlock_class+0x4e/0x130 [ 8547.558681][ C1] ? mark_lock+0x38/0x3e0 [ 8547.558895][ C1] ? stack_access_ok+0xda/0x1f0 [ 8547.559175][ C1] ? __lock_acquire+0xb67/0x1610 [ 8547.559430][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8547.559707][ C1] ? get_stack_info+0x36/0xc0 [ 8547.559949][ C1] ? stack_access_ok+0xda/0x1f0 [ 8547.560208][ C1] ? get_reg+0x119/0x190 [ 8547.560420][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8547.560684][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8547.560986][ C1] __tcf_classify+0x329/0x7d0 [ 8547.561223][ C1] tcf_classify+0x283/0x930 [ 8547.561451][ C1] ? arch_stack_walk+0xa2/0x100 [ 8547.561695][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8547.561946][ C1] ? get_stack_info+0x36/0xc0 [ 8547.562182][ C1] tc_run+0x2e4/0x5d0 [ 8547.562384][ C1] ? __pfx_tc_run+0x10/0x10 [ 8547.562608][ C1] ? lock_acquire+0x1c1/0x220 [ 8547.562843][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8547.563098][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8547.563347][ C1] ? lock_acquire+0x1c1/0x220 [ 8547.563582][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8547.563840][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8547.564138][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8547.564406][ C1] ? neigh_hh_output+0x348/0x590 [ 8547.564653][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8547.564912][ C1] ip_finish_output2+0x786/0x18e0 [ 8547.565162][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8547.565435][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8547.565766][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8547.566039][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8547.566287][ C1] ? __ip_finish_output+0x10f/0x770 [ 8547.566546][ C1] ip_output+0x16b/0x4f0 [ 8547.566757][ C1] ? run_timer_softirq+0x72/0x100 [ 8547.567007][ C1] ? __pfx_ip_output+0x10/0x10 [ 8547.567246][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8547.567526][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8547.567772][ C1] ? ip_local_out+0x114/0x3b0 [ 8547.568008][ C1] __ip_queue_xmit+0x672/0x1910 [ 8547.568251][ C1] ? __create_object+0x5e/0xb0 [ 8547.568490][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8547.568752][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8547.569046][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8547.569324][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8547.569606][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8547.569878][ C1] tcp_delack_timer+0x84/0x240 [ 8547.570123][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8547.570403][ C1] call_timer_fn+0x173/0x430 [ 8547.570635][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8547.570891][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8547.571146][ C1] __run_timers.part.0+0x52d/0x890 [ 8547.571402][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8547.571669][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8547.571950][ C1] ? lock_acquire+0x1c1/0x220 [ 8547.572184][ C1] ? clockevents_program_event+0xf6/0x300 [ 8547.572468][ C1] ? lock_release+0x1d5/0x250 [ 8547.572703][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8547.572961][ C1] ? ktime_get+0xb3/0x190 [ 8547.573176][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8547.573469][ C1] run_timer_softirq+0x72/0x100 [ 8547.573712][ C1] __do_softirq+0x1b9/0x7ff [ 8547.573939][ C1] irq_exit_rcu+0x98/0xc0 [ 8547.574155][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8547.574434][ C1] [ 8547.574583][ C1] [ 8547.574730][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8547.575028][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8547.575347][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8547.576301][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8547.576603][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8547.576992][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8547.577383][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8547.577778][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8547.578168][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8547.578560][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8547.578851][ C1] pipe_read+0xa16/0xdf0 [ 8547.579087][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8547.579366][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8547.579611][ C1] ? iterate_tty_write+0x299/0x540 [ 8547.579873][ C1] ? lock_release+0x1d5/0x250 [ 8547.580116][ C1] vfs_read+0x911/0xc00 [ 8547.580338][ C1] ? lock_acquire+0x1c1/0x220 [ 8547.580573][ C1] ? __might_fault+0xc6/0x180 [ 8547.580809][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8547.581043][ C1] ? __might_fault+0xc6/0x180 [ 8547.581277][ C1] ? lock_release+0x1d5/0x250 [ 8547.581513][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8547.581771][ C1] ? __fget_light+0x54/0x1e0 [ 8547.582005][ C1] ksys_read+0x17a/0x1e0 [ 8547.582217][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8547.582457][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8547.582756][ C1] do_syscall_64+0xc9/0x1e0 [ 8547.582982][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8547.583276][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8547.583499][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8547.584451][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8547.584862][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8547.585256][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8547.585646][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8547.586036][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8547.586427][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8547.586822][ C1] [ 8547.586974][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8547.587242][ C2] NMI backtrace for cpu 2 [ 8547.587248][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8547.587253][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8547.587257][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8547.587266][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8547.587271][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8547.587275][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8547.587279][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8547.587283][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8547.587285][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8547.587287][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8547.587289][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8547.587291][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8547.587294][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8547.587296][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8547.587297][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8547.587298][ C2] PKRU: 55555554 [ 8547.587299][ C2] Call Trace: [ 8547.587300][ C2] [ 8547.587303][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8547.587308][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8547.587313][ C2] ? nmi_handle+0x153/0x420 [ 8547.587317][ C2] ? default_do_nmi+0x41/0x100 [ 8547.587320][ C2] ? exc_nmi+0xf3/0x120 [ 8547.587322][ C2] ? end_repeat_nmi+0xf/0x60 [ 8547.587327][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8547.587330][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8547.587333][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8547.587337][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8547.587340][ C2] [ 8547.587341][ C2] [ 8547.587342][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8547.587344][ C2] ? get_stack_info+0x36/0xc0 [ 8547.587349][ C2] ? lock_acquire+0x1c1/0x220 [ 8547.587352][ C2] ? lock_release+0x1d5/0x250 [ 8547.587355][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8547.587359][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8547.587362][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8547.587365][ C2] ? lock_acquire+0x1c1/0x220 [ 8547.587367][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8547.587371][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8547.587374][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8547.587380][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8547.587383][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8547.587387][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8547.587391][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8547.587394][ C2] ip_local_deliver+0x19d/0x480 [ 8547.587397][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8547.587399][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8547.587401][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8547.587406][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8547.587410][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8547.587413][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8547.587422][ C2] ip_rcv+0x564/0x740 [ 8547.587424][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8547.587427][ C2] ? set_track_prepare+0x8a/0xd0 [ 8547.587431][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8547.587434][ C2] ? start_secondary+0x21c/0x2b0 [ 8547.587437][ C2] ? skb_clone+0x10b/0x330 [ 8547.587440][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8547.587445][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8547.587450][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8547.587453][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8547.587461][ C2] ? __tcf_classify+0x329/0x7d0 [ 8547.587465][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8547.587467][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8547.587471][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8547.587474][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8547.587478][ C2] ? lock_acquire+0x1c1/0x220 [ 8547.587481][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8547.587485][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8547.587488][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8547.587492][ C2] ? __copy_skb_header+0xaf/0x490 [ 8547.587496][ C2] ? __skb_clone+0x57a/0x760 [ 8547.587499][ C2] netif_receive_skb+0x55/0x280 [ 8547.587502][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8547.587508][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8547.587515][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8547.587521][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8547.587525][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8547.587535][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8547.587542][ C2] ? get_stack_info+0x36/0xc0 [ 8547.587547][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8547.587549][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8547.587553][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8547.587555][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8547.587559][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8547.587561][ C2] ? kernel_text_address+0x17/0xe0 [ 8547.587565][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8547.587568][ C2] ? arch_stack_walk+0x8c/0x100 [ 8547.587572][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8547.587575][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8547.587578][ C2] ? lock_acquire+0x1c1/0x220 [ 8547.587580][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8547.587584][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8547.587588][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8547.587590][ C2] ? get_stack_info+0x36/0xc0 [ 8547.587595][ C2] __tcf_classify+0x329/0x7d0 [ 8547.587599][ C2] tcf_classify+0x283/0x930 [ 8547.587604][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8547.587607][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8547.587611][ C2] tc_run+0x2e4/0x5d0 [ 8547.587615][ C2] ? __pfx_tc_run+0x10/0x10 [ 8547.587618][ C2] ? lock_acquire+0x1c1/0x220 [ 8547.587620][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8547.587624][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8547.587628][ C2] ? lock_acquire+0x1c1/0x220 [ 8547.587630][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8547.587633][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8547.587636][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8547.587639][ C2] ? neigh_hh_output+0x348/0x590 [ 8547.587642][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8547.587646][ C2] ip_finish_output2+0x786/0x18e0 [ 8547.587649][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8547.587656][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8547.587659][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8547.587662][ C2] ? __ip_finish_output+0x10f/0x770 [ 8547.587666][ C2] ip_output+0x16b/0x4f0 [ 8547.587669][ C2] ? __pfx_ip_output+0x10/0x10 [ 8547.587671][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8547.587674][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8547.587677][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8547.587680][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8547.587682][ C2] ? __alloc_skb+0xd4/0x280 [ 8547.587685][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8547.587689][ C2] ? tcp_fragment+0x168/0x1040 [ 8547.587692][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8547.587695][ C2] ? ip_local_out+0x114/0x3b0 [ 8547.587698][ C2] __ip_queue_xmit+0x672/0x1910 [ 8547.587702][ C2] ? __skb_clone+0x57a/0x760 [ 8547.587705][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8547.587710][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8547.587713][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8547.587717][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8547.587721][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8547.587725][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8547.587728][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8547.587731][ C2] tcp_send_loss_probe+0x348/0x830 [ 8547.587734][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8547.587736][ C2] tcp_write_timer+0x82/0x1d0 [ 8547.587740][ C2] call_timer_fn+0x173/0x430 [ 8547.587744][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8547.587748][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8547.587752][ C2] __run_timers.part.0+0x52d/0x890 [ 8547.587755][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8547.587759][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8547.587761][ C2] ? lock_acquire+0x1c1/0x220 [ 8547.587764][ C2] ? clockevents_program_event+0xf6/0x300 [ 8547.587768][ C2] ? lock_release+0x1d5/0x250 [ 8547.587770][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8547.587774][ C2] ? ktime_get+0xb3/0x190 [ 8547.587777][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8547.587781][ C2] run_timer_softirq+0x72/0x100 [ 8547.587785][ C2] __do_softirq+0x1b9/0x7ff [ 8547.587789][ C2] irq_exit_rcu+0x98/0xc0 [ 8547.587791][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8547.587794][ C2] [ 8547.587795][ C2] [ 8547.587796][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8547.587800][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8547.587802][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8547.587804][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8547.587806][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8547.587808][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8547.587809][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8547.587810][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8547.587812][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8547.587815][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8547.587818][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8547.587821][ C2] default_idle_call+0x69/0xa0 [ 8547.587824][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8547.587826][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8547.587829][ C2] ? lock_release+0x1d5/0x250 [ 8547.587832][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8547.587836][ C2] do_idle+0xfb/0x160 [ 8547.587838][ C2] cpu_startup_entry+0x55/0x60 [ 8547.587841][ C2] start_secondary+0x21c/0x2b0 [ 8547.587844][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8547.587848][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8547.587853][ C2] [ 8572.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5792s! [swapper/2:0] [ 8572.569673][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8572.570886][ C2] irq event stamp: 44114564 [ 8572.571105][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8572.571627][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8572.572125][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8572.572586][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8572.573041][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8572.573484][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8572.574073][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8572.574387][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8572.575325][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8572.575623][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8572.576007][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8572.576395][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8572.576781][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8572.577166][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8572.577553][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8572.577985][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8572.578309][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8572.578696][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8572.579084][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8572.579471][ C2] PKRU: 55555554 [ 8572.579646][ C2] Call Trace: [ 8572.579811][ C2] [ 8572.579952][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8572.580206][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8572.580443][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8572.580710][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8572.580974][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8572.581253][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8572.581510][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8572.581806][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8572.582058][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8572.582313][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8572.582612][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8572.582899][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8572.583204][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8572.583482][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8572.583769][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8572.584047][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8572.584352][ C2] ? get_stack_info+0x36/0xc0 [ 8572.584586][ C2] ? lock_acquire+0x1c1/0x220 [ 8572.584818][ C2] ? lock_release+0x1d5/0x250 [ 8572.585047][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8572.585289][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8572.585552][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8572.585829][ C2] ? lock_acquire+0x1c1/0x220 [ 8572.586064][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8572.586295][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8572.586547][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8572.586773][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8572.587013][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8572.587265][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8572.587530][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8572.587799][ C2] ip_local_deliver+0x19d/0x480 [ 8572.588037][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8572.588304][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8572.588559][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8572.588898][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8572.589143][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8572.589454][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8572.589706][ C2] ip_rcv+0x564/0x740 [ 8572.589902][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8572.590127][ C2] ? set_track_prepare+0x8a/0xd0 [ 8572.590374][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8572.590649][ C2] ? start_secondary+0x21c/0x2b0 [ 8572.590893][ C2] ? skb_clone+0x10b/0x330 [ 8572.591113][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8572.591423][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8572.591718][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8572.591992][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8572.592279][ C2] ? __tcf_classify+0x329/0x7d0 [ 8572.592520][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8572.592743][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8572.593031][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8572.593312][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8572.593630][ C2] ? lock_acquire+0x1c1/0x220 [ 8572.593862][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8572.594147][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8572.594426][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8572.594733][ C2] ? __copy_skb_header+0xaf/0x490 [ 8572.594982][ C2] ? __skb_clone+0x57a/0x760 [ 8572.595209][ C2] netif_receive_skb+0x55/0x280 [ 8572.595450][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8572.595753][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8572.596074][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8572.596365][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8572.596631][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8572.596908][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8572.597213][ C2] ? get_stack_info+0x36/0xc0 [ 8572.597447][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8572.597702][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8572.598008][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8572.598278][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8572.598549][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8572.598856][ C2] ? kernel_text_address+0x17/0xe0 [ 8572.599134][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8572.599443][ C2] ? arch_stack_walk+0x8c/0x100 [ 8572.599689][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8572.599954][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8572.600246][ C2] ? lock_acquire+0x1c1/0x220 [ 8572.600477][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8572.600749][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8572.601045][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8572.601313][ C2] ? get_stack_info+0x36/0xc0 [ 8572.601547][ C2] __tcf_classify+0x329/0x7d0 [ 8572.601781][ C2] tcf_classify+0x283/0x930 [ 8572.602004][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8572.602254][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8572.602558][ C2] tc_run+0x2e4/0x5d0 [ 8572.602755][ C2] ? __pfx_tc_run+0x10/0x10 [ 8572.602979][ C2] ? lock_acquire+0x1c1/0x220 [ 8572.603212][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8572.603465][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8572.603710][ C2] ? lock_acquire+0x1c1/0x220 [ 8572.603940][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8572.604199][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8572.604491][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8572.604757][ C2] ? neigh_hh_output+0x348/0x590 [ 8572.605001][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8572.605260][ C2] ip_finish_output2+0x786/0x18e0 [ 8572.605509][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8572.605836][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8572.606102][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8572.606348][ C2] ? __ip_finish_output+0x10f/0x770 [ 8572.606605][ C2] ip_output+0x16b/0x4f0 [ 8572.606816][ C2] ? __pfx_ip_output+0x10/0x10 [ 8572.607050][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8572.607323][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8572.607625][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8572.607893][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8572.608137][ C2] ? __alloc_skb+0xd4/0x280 [ 8572.608362][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8572.608623][ C2] ? tcp_fragment+0x168/0x1040 [ 8572.608859][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8572.609128][ C2] ? ip_local_out+0x114/0x3b0 [ 8572.609369][ C2] __ip_queue_xmit+0x672/0x1910 [ 8572.609617][ C2] ? __skb_clone+0x57a/0x760 [ 8572.609852][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8572.610118][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8572.610401][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8572.610637][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8572.610879][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8572.611174][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8572.611488][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8572.611723][ C2] tcp_send_loss_probe+0x348/0x830 [ 8572.611979][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8572.612242][ C2] tcp_write_timer+0x82/0x1d0 [ 8572.612472][ C2] call_timer_fn+0x173/0x430 [ 8572.612702][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8572.612956][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8572.613209][ C2] __run_timers.part.0+0x52d/0x890 [ 8572.613460][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8572.613722][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8572.613999][ C2] ? lock_acquire+0x1c1/0x220 [ 8572.614232][ C2] ? clockevents_program_event+0xf6/0x300 [ 8572.614514][ C2] ? lock_release+0x1d5/0x250 [ 8572.614746][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8572.615002][ C2] ? ktime_get+0xb3/0x190 [ 8572.615221][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8572.615509][ C2] run_timer_softirq+0x72/0x100 [ 8572.615750][ C2] __do_softirq+0x1b9/0x7ff [ 8572.615976][ C2] irq_exit_rcu+0x98/0xc0 [ 8572.616189][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8572.616465][ C2] [ 8572.616612][ C2] [ 8572.616757][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8572.617052][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8572.617302][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8572.618239][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8572.618537][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8572.618944][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8572.619341][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8572.619740][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8572.620145][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8572.620532][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8572.620812][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8572.621065][ C2] default_idle_call+0x69/0xa0 [ 8572.621302][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8572.621545][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8572.621815][ C2] ? lock_release+0x1d5/0x250 [ 8572.622046][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8572.622314][ C2] do_idle+0xfb/0x160 [ 8572.622512][ C2] cpu_startup_entry+0x55/0x60 [ 8572.622748][ C2] start_secondary+0x21c/0x2b0 [ 8572.622984][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8572.623247][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8572.623548][ C2] [ 8572.623700][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5792s! [perl:4135] [ 8572.624104][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8572.625332][ C1] irq event stamp: 209232 [ 8572.625544][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8572.626062][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8572.626529][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8572.626985][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8572.627437][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8572.627876][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8572.628475][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8572.628792][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8572.629781][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8572.630098][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8572.630488][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8572.630880][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8572.631270][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8572.631659][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8572.632047][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8572.632485][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8572.632814][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8572.633207][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8572.633595][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8572.633984][ C1] PKRU: 55555554 [ 8572.634162][ C1] Call Trace: [ 8572.634329][ C1] [ 8572.634472][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8572.634727][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8572.634966][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8572.635237][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8572.635505][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8572.635786][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8572.636043][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8572.636344][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8572.636600][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8572.636902][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8572.637192][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8572.637498][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8572.637781][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8572.638070][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8572.638353][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8572.638658][ C1] ? get_stack_info+0x36/0xc0 [ 8572.638896][ C1] ? lock_acquire+0x1c1/0x220 [ 8572.639152][ C1] ? lock_release+0x1d5/0x250 [ 8572.639393][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8572.639642][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8572.639916][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8572.640214][ C1] ? lock_acquire+0x1c1/0x220 [ 8572.640445][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8572.640680][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8572.640934][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8572.641165][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8572.641410][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8572.641662][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8572.641930][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8572.642201][ C1] ip_local_deliver+0x19d/0x480 [ 8572.642443][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8572.642708][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8572.642967][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8572.643305][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8572.643552][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8572.643865][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8572.644121][ C1] ip_rcv+0x564/0x740 [ 8572.644320][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8572.644548][ C1] ? set_track_prepare+0x8a/0xd0 [ 8572.644795][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8572.645064][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8572.645330][ C1] ? skb_clone+0x10b/0x330 [ 8572.645553][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8572.645864][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8572.646163][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8572.646438][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8572.646724][ C1] ? __tcf_classify+0x329/0x7d0 [ 8572.646968][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8572.647194][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8572.647487][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8572.647764][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8572.648081][ C1] ? lock_acquire+0x1c1/0x220 [ 8572.648316][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8572.648605][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8572.648888][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8572.649226][ C1] ? __copy_skb_header+0xaf/0x490 [ 8572.649482][ C1] ? __skb_clone+0x57a/0x760 [ 8572.649716][ C1] netif_receive_skb+0x55/0x280 [ 8572.649964][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8572.650283][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8572.650605][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8572.650897][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8572.651163][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8572.651446][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8572.651748][ C1] ? hlock_class+0x4e/0x130 [ 8572.651976][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8572.652246][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8572.652516][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8572.652773][ C1] ? hlock_class+0x4e/0x130 [ 8572.652997][ C1] ? mark_lock+0x38/0x3e0 [ 8572.653214][ C1] ? stack_access_ok+0xda/0x1f0 [ 8572.653457][ C1] ? __lock_acquire+0xb67/0x1610 [ 8572.653705][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8572.653974][ C1] ? get_stack_info+0x36/0xc0 [ 8572.654209][ C1] ? stack_access_ok+0xda/0x1f0 [ 8572.654450][ C1] ? get_reg+0x119/0x190 [ 8572.654661][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8572.654921][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8572.655225][ C1] __tcf_classify+0x329/0x7d0 [ 8572.655461][ C1] tcf_classify+0x283/0x930 [ 8572.655685][ C1] ? arch_stack_walk+0xa2/0x100 [ 8572.655927][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8572.656177][ C1] ? get_stack_info+0x36/0xc0 [ 8572.656413][ C1] tc_run+0x2e4/0x5d0 [ 8572.656612][ C1] ? __pfx_tc_run+0x10/0x10 [ 8572.656838][ C1] ? lock_acquire+0x1c1/0x220 [ 8572.657070][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8572.657326][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8572.657571][ C1] ? lock_acquire+0x1c1/0x220 [ 8572.657803][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8572.658060][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8572.658360][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8572.658623][ C1] ? neigh_hh_output+0x348/0x590 [ 8572.658869][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8572.659153][ C1] ip_finish_output2+0x786/0x18e0 [ 8572.659410][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8572.659689][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8572.660026][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8572.660308][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8572.660553][ C1] ? __ip_finish_output+0x10f/0x770 [ 8572.660810][ C1] ip_output+0x16b/0x4f0 [ 8572.661022][ C1] ? run_timer_softirq+0x72/0x100 [ 8572.661274][ C1] ? __pfx_ip_output+0x10/0x10 [ 8572.661510][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8572.661790][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8572.662036][ C1] ? ip_local_out+0x114/0x3b0 [ 8572.662271][ C1] __ip_queue_xmit+0x672/0x1910 [ 8572.662513][ C1] ? __create_object+0x5e/0xb0 [ 8572.662749][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8572.663011][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8572.663289][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8572.663553][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8572.663827][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8572.664093][ C1] tcp_delack_timer+0x84/0x240 [ 8572.664331][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8572.664598][ C1] call_timer_fn+0x173/0x430 [ 8572.664826][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8572.665084][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8572.665341][ C1] __run_timers.part.0+0x52d/0x890 [ 8572.665595][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8572.665861][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8572.666137][ C1] ? lock_acquire+0x1c1/0x220 [ 8572.666372][ C1] ? clockevents_program_event+0xf6/0x300 [ 8572.666655][ C1] ? lock_release+0x1d5/0x250 [ 8572.666887][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8572.667145][ C1] ? ktime_get+0xb3/0x190 [ 8572.667362][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8572.667651][ C1] run_timer_softirq+0x72/0x100 [ 8572.667892][ C1] __do_softirq+0x1b9/0x7ff [ 8572.668120][ C1] irq_exit_rcu+0x98/0xc0 [ 8572.668335][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8572.668614][ C1] [ 8572.668759][ C1] [ 8572.668928][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8572.669231][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8572.669557][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8572.670528][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8572.670825][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8572.671217][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8572.671604][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8572.671992][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8572.672380][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8572.672772][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8572.673059][ C1] pipe_read+0xa16/0xdf0 [ 8572.673277][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8572.673547][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8572.673785][ C1] ? iterate_tty_write+0x299/0x540 [ 8572.674039][ C1] ? lock_release+0x1d5/0x250 [ 8572.674276][ C1] vfs_read+0x911/0xc00 [ 8572.674485][ C1] ? lock_acquire+0x1c1/0x220 [ 8572.674717][ C1] ? __might_fault+0xc6/0x180 [ 8572.674950][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8572.675184][ C1] ? __might_fault+0xc6/0x180 [ 8572.675419][ C1] ? lock_release+0x1d5/0x250 [ 8572.675652][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8572.675910][ C1] ? __fget_light+0x54/0x1e0 [ 8572.676140][ C1] ksys_read+0x17a/0x1e0 [ 8572.676354][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8572.676593][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8572.676888][ C1] do_syscall_64+0xc9/0x1e0 [ 8572.677116][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8572.677410][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8572.677630][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8572.678575][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8572.679010][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8572.679408][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8572.679805][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8572.680215][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8572.680603][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8572.680993][ C1] [ 8600.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5818s! [perl:4135] [ 8600.569679][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8600.570902][ C1] irq event stamp: 209232 [ 8600.571115][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8600.571630][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8600.572098][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8600.572556][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8600.573006][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8600.573446][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8600.574048][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8600.574366][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8600.575315][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8600.575616][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8600.576005][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8600.576395][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8600.576786][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8600.577177][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8600.577566][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8600.578002][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8600.578326][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8600.578720][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8600.579114][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8600.579503][ C1] PKRU: 55555554 [ 8600.579681][ C1] Call Trace: [ 8600.579850][ C1] [ 8600.579993][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8600.580249][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8600.580487][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8600.580756][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8600.581023][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8600.581307][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8600.581564][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8600.581864][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8600.582120][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8600.582424][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8600.582711][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8600.583018][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8600.583303][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8600.583589][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8600.583873][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8600.584179][ C1] ? get_stack_info+0x36/0xc0 [ 8600.584414][ C1] ? lock_acquire+0x1c1/0x220 [ 8600.584647][ C1] ? lock_release+0x1d5/0x250 [ 8600.584882][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8600.585125][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8600.585391][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8600.585670][ C1] ? lock_acquire+0x1c1/0x220 [ 8600.585901][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8600.586137][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8600.586391][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8600.586621][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8600.586862][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8600.587114][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8600.587386][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8600.587657][ C1] ip_local_deliver+0x19d/0x480 [ 8600.587898][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8600.588163][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8600.588424][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8600.588769][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8600.589039][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8600.589362][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8600.589626][ C1] ip_rcv+0x564/0x740 [ 8600.589829][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8600.590071][ C1] ? set_track_prepare+0x8a/0xd0 [ 8600.590319][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8600.590590][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8600.590856][ C1] ? skb_clone+0x10b/0x330 [ 8600.591078][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8600.591392][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8600.591689][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8600.591967][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8600.592256][ C1] ? __tcf_classify+0x329/0x7d0 [ 8600.592499][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8600.592725][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8600.593017][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8600.593298][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8600.593616][ C1] ? lock_acquire+0x1c1/0x220 [ 8600.593851][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8600.594140][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8600.594423][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8600.594733][ C1] ? __copy_skb_header+0xaf/0x490 [ 8600.594985][ C1] ? __skb_clone+0x57a/0x760 [ 8600.595215][ C1] netif_receive_skb+0x55/0x280 [ 8600.595458][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8600.595765][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8600.596089][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8600.596383][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8600.596651][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8600.596933][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8600.597240][ C1] ? hlock_class+0x4e/0x130 [ 8600.597469][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8600.597738][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8600.598007][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8600.598268][ C1] ? hlock_class+0x4e/0x130 [ 8600.598493][ C1] ? mark_lock+0x38/0x3e0 [ 8600.598710][ C1] ? stack_access_ok+0xda/0x1f0 [ 8600.598976][ C1] ? __lock_acquire+0xb67/0x1610 [ 8600.599232][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8600.599511][ C1] ? get_stack_info+0x36/0xc0 [ 8600.599752][ C1] ? stack_access_ok+0xda/0x1f0 [ 8600.599999][ C1] ? get_reg+0x119/0x190 [ 8600.600225][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8600.600486][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8600.600789][ C1] __tcf_classify+0x329/0x7d0 [ 8600.601027][ C1] tcf_classify+0x283/0x930 [ 8600.601253][ C1] ? arch_stack_walk+0xa2/0x100 [ 8600.601497][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8600.601748][ C1] ? get_stack_info+0x36/0xc0 [ 8600.601984][ C1] tc_run+0x2e4/0x5d0 [ 8600.602186][ C1] ? __pfx_tc_run+0x10/0x10 [ 8600.602413][ C1] ? lock_acquire+0x1c1/0x220 [ 8600.602644][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8600.602901][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8600.603148][ C1] ? lock_acquire+0x1c1/0x220 [ 8600.603384][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8600.603642][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8600.603941][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8600.604208][ C1] ? neigh_hh_output+0x348/0x590 [ 8600.604455][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8600.604714][ C1] ip_finish_output2+0x786/0x18e0 [ 8600.604965][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8600.605241][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8600.605571][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8600.605840][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8600.606088][ C1] ? __ip_finish_output+0x10f/0x770 [ 8600.606347][ C1] ip_output+0x16b/0x4f0 [ 8600.606560][ C1] ? run_timer_softirq+0x72/0x100 [ 8600.606812][ C1] ? __pfx_ip_output+0x10/0x10 [ 8600.607048][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8600.607332][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8600.607578][ C1] ? ip_local_out+0x114/0x3b0 [ 8600.607813][ C1] __ip_queue_xmit+0x672/0x1910 [ 8600.608054][ C1] ? __create_object+0x5e/0xb0 [ 8600.608294][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8600.608555][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8600.608855][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8600.609127][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8600.609409][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8600.609684][ C1] tcp_delack_timer+0x84/0x240 [ 8600.609926][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8600.610206][ C1] call_timer_fn+0x173/0x430 [ 8600.610435][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8600.610690][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8600.610946][ C1] __run_timers.part.0+0x52d/0x890 [ 8600.611201][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8600.611469][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8600.611746][ C1] ? lock_acquire+0x1c1/0x220 [ 8600.611980][ C1] ? clockevents_program_event+0xf6/0x300 [ 8600.612264][ C1] ? lock_release+0x1d5/0x250 [ 8600.612496][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8600.612752][ C1] ? ktime_get+0xb3/0x190 [ 8600.612970][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8600.613259][ C1] run_timer_softirq+0x72/0x100 [ 8600.613501][ C1] __do_softirq+0x1b9/0x7ff [ 8600.613729][ C1] irq_exit_rcu+0x98/0xc0 [ 8600.613942][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8600.614223][ C1] [ 8600.614369][ C1] [ 8600.614516][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8600.614812][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8600.615129][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8600.616080][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8600.616380][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8600.616771][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8600.617161][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8600.617551][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8600.617939][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8600.618332][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8600.618621][ C1] pipe_read+0xa16/0xdf0 [ 8600.618859][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8600.619138][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8600.619383][ C1] ? iterate_tty_write+0x299/0x540 [ 8600.619645][ C1] ? lock_release+0x1d5/0x250 [ 8600.619885][ C1] vfs_read+0x911/0xc00 [ 8600.620106][ C1] ? lock_acquire+0x1c1/0x220 [ 8600.620339][ C1] ? __might_fault+0xc6/0x180 [ 8600.620573][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8600.620807][ C1] ? __might_fault+0xc6/0x180 [ 8600.621042][ C1] ? lock_release+0x1d5/0x250 [ 8600.621277][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8600.621536][ C1] ? __fget_light+0x54/0x1e0 [ 8600.621765][ C1] ksys_read+0x17a/0x1e0 [ 8600.621978][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8600.622217][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8600.622513][ C1] do_syscall_64+0xc9/0x1e0 [ 8600.622741][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8600.623034][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8600.623256][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8600.624203][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8600.624616][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8600.625004][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8600.625394][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8600.625784][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8600.626173][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8600.626566][ C1] [ 8600.626720][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5818s! [swapper/2:0] [ 8600.627123][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8600.628334][ C2] irq event stamp: 44114564 [ 8600.628559][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8600.629102][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8600.629609][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8600.630088][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8600.630544][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8600.630985][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8600.631573][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8600.631886][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8600.632864][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8600.633168][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8600.633567][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8600.633951][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8600.634336][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8600.634721][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8600.635110][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8600.635543][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8600.635863][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8600.636251][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8600.636636][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8600.637022][ C2] PKRU: 55555554 [ 8600.637199][ C2] Call Trace: [ 8600.637362][ C2] [ 8600.637505][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8600.637757][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8600.637992][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8600.638262][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8600.638526][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8600.638827][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8600.639090][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8600.639392][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8600.639653][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8600.639913][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8600.640222][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8600.640509][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8600.640813][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8600.641091][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8600.641380][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8600.641660][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8600.641960][ C2] ? get_stack_info+0x36/0xc0 [ 8600.642195][ C2] ? lock_acquire+0x1c1/0x220 [ 8600.642428][ C2] ? lock_release+0x1d5/0x250 [ 8600.642661][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8600.642900][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8600.643165][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8600.643440][ C2] ? lock_acquire+0x1c1/0x220 [ 8600.643671][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8600.643903][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8600.644156][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8600.644382][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8600.644621][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8600.644870][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8600.645135][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8600.645404][ C2] ip_local_deliver+0x19d/0x480 [ 8600.645643][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8600.645909][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8600.646163][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8600.646498][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8600.646743][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8600.647051][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8600.647305][ C2] ip_rcv+0x564/0x740 [ 8600.647503][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8600.647725][ C2] ? set_track_prepare+0x8a/0xd0 [ 8600.647970][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8600.648237][ C2] ? start_secondary+0x21c/0x2b0 [ 8600.648479][ C2] ? skb_clone+0x10b/0x330 [ 8600.648703][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8600.649039][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8600.649343][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8600.649624][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8600.649916][ C2] ? __tcf_classify+0x329/0x7d0 [ 8600.650167][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8600.650392][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8600.650683][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8600.650958][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8600.651272][ C2] ? lock_acquire+0x1c1/0x220 [ 8600.651503][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8600.651789][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8600.652065][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8600.652373][ C2] ? __copy_skb_header+0xaf/0x490 [ 8600.652621][ C2] ? __skb_clone+0x57a/0x760 [ 8600.652849][ C2] netif_receive_skb+0x55/0x280 [ 8600.653088][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8600.653390][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8600.653711][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8600.654001][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8600.654267][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8600.654547][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8600.654848][ C2] ? get_stack_info+0x36/0xc0 [ 8600.655081][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8600.655337][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8600.655643][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8600.655914][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8600.656182][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8600.656488][ C2] ? kernel_text_address+0x17/0xe0 [ 8600.656738][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8600.657042][ C2] ? arch_stack_walk+0x8c/0x100 [ 8600.657283][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8600.657538][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8600.657813][ C2] ? lock_acquire+0x1c1/0x220 [ 8600.658043][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8600.658314][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8600.658609][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8600.658899][ C2] ? get_stack_info+0x36/0xc0 [ 8600.659141][ C2] __tcf_classify+0x329/0x7d0 [ 8600.659384][ C2] tcf_classify+0x283/0x930 [ 8600.659615][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8600.659869][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8600.660184][ C2] tc_run+0x2e4/0x5d0 [ 8600.660384][ C2] ? __pfx_tc_run+0x10/0x10 [ 8600.660606][ C2] ? lock_acquire+0x1c1/0x220 [ 8600.660837][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8600.661089][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8600.661335][ C2] ? lock_acquire+0x1c1/0x220 [ 8600.661567][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8600.661822][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8600.662116][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8600.662380][ C2] ? neigh_hh_output+0x348/0x590 [ 8600.662624][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8600.662879][ C2] ip_finish_output2+0x786/0x18e0 [ 8600.663126][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8600.663453][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8600.663718][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8600.663963][ C2] ? __ip_finish_output+0x10f/0x770 [ 8600.664220][ C2] ip_output+0x16b/0x4f0 [ 8600.664431][ C2] ? __pfx_ip_output+0x10/0x10 [ 8600.664666][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8600.664933][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8600.665236][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8600.665503][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8600.665745][ C2] ? __alloc_skb+0xd4/0x280 [ 8600.665968][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8600.666228][ C2] ? tcp_fragment+0x168/0x1040 [ 8600.666465][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8600.666708][ C2] ? ip_local_out+0x114/0x3b0 [ 8600.666937][ C2] __ip_queue_xmit+0x672/0x1910 [ 8600.667179][ C2] ? __skb_clone+0x57a/0x760 [ 8600.667408][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8600.667665][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8600.667936][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8600.668172][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8600.668415][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8600.668706][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8600.669043][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8600.669285][ C2] tcp_send_loss_probe+0x348/0x830 [ 8600.669546][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8600.669813][ C2] tcp_write_timer+0x82/0x1d0 [ 8600.670061][ C2] call_timer_fn+0x173/0x430 [ 8600.670288][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8600.670542][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8600.670799][ C2] __run_timers.part.0+0x52d/0x890 [ 8600.671050][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8600.671314][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8600.671587][ C2] ? lock_acquire+0x1c1/0x220 [ 8600.671819][ C2] ? clockevents_program_event+0xf6/0x300 [ 8600.672097][ C2] ? lock_release+0x1d5/0x250 [ 8600.672330][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8600.672585][ C2] ? ktime_get+0xb3/0x190 [ 8600.672803][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8600.673088][ C2] run_timer_softirq+0x72/0x100 [ 8600.673330][ C2] __do_softirq+0x1b9/0x7ff [ 8600.673556][ C2] irq_exit_rcu+0x98/0xc0 [ 8600.673767][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8600.674044][ C2] [ 8600.674188][ C2] [ 8600.674334][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8600.674628][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8600.674876][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8600.675810][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8600.676107][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8600.676493][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8600.676881][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8600.677266][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8600.677650][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8600.678037][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8600.678321][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8600.678573][ C2] default_idle_call+0x69/0xa0 [ 8600.678830][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8600.679078][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8600.679355][ C2] ? lock_release+0x1d5/0x250 [ 8600.679592][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8600.679863][ C2] do_idle+0xfb/0x160 [ 8600.680072][ C2] cpu_startup_entry+0x55/0x60 [ 8600.680309][ C2] start_secondary+0x21c/0x2b0 [ 8600.680545][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8600.680805][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8600.681106][ C2] [ 8625.588103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8625.588453][ C1] rcu: 1-....: (6255395 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1510903 [ 8625.589003][ C1] rcu: (t=6270701 jiffies g=1882453 q=721 ncpus=4) [ 8625.589331][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8625.589769][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8625.590367][ C1] RIP: 0010:kasan_check_range+0x84/0x1c0 [ 8625.590650][ C1] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [ 8625.591596][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000202 [ 8625.591897][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 8625.592288][ C1] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8625.592676][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 8625.593067][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8625.593458][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8625.593847][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8625.594287][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8625.594611][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8625.595003][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8625.595394][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8625.595783][ C1] PKRU: 55555554 [ 8625.595961][ C1] Call Trace: [ 8625.596128][ C1] [ 8625.596273][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8625.596538][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8625.596785][ C1] ? check_cpu_stall+0x284/0x500 [ 8625.597031][ C1] ? rcu_pending+0x92/0x360 [ 8625.597259][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8625.597523][ C1] ? update_process_times+0xb9/0x110 [ 8625.597785][ C1] ? tick_sched_handle+0x67/0x130 [ 8625.598036][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8625.598317][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8625.598554][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8625.598863][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8625.599129][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8625.599415][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8625.599673][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8625.599973][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8625.600227][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 8625.600483][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8625.600785][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8625.601072][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8625.601381][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8625.601665][ C1] ? kasan_check_range+0x84/0x1c0 [ 8625.601935][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8625.602218][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8625.602539][ C1] ? get_stack_info+0x36/0xc0 [ 8625.602774][ C1] ? lock_acquire+0x1c1/0x220 [ 8625.603008][ C1] ? lock_release+0x1d5/0x250 [ 8625.603244][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8625.603486][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8625.603751][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8625.604032][ C1] ? lock_acquire+0x1c1/0x220 [ 8625.604266][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8625.604499][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8625.604754][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8625.604984][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8625.605227][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8625.605479][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8625.605747][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8625.606016][ C1] ip_local_deliver+0x19d/0x480 [ 8625.606259][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8625.606524][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8625.606784][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8625.607124][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8625.607372][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8625.607686][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8625.607942][ C1] ip_rcv+0x564/0x740 [ 8625.608141][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8625.608368][ C1] ? set_track_prepare+0x8a/0xd0 [ 8625.608615][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8625.608909][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8625.609183][ C1] ? skb_clone+0x10b/0x330 [ 8625.609412][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8625.609734][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8625.610047][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8625.610324][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8625.610610][ C1] ? __tcf_classify+0x329/0x7d0 [ 8625.610852][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8625.611080][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8625.611374][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8625.611653][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8625.611970][ C1] ? lock_acquire+0x1c1/0x220 [ 8625.612205][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8625.612494][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8625.612774][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8625.613084][ C1] ? __copy_skb_header+0xaf/0x490 [ 8625.613337][ C1] ? __skb_clone+0x57a/0x760 [ 8625.613566][ C1] netif_receive_skb+0x55/0x280 [ 8625.613808][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8625.614113][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8625.614439][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8625.614732][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8625.615000][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8625.615284][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8625.615588][ C1] ? hlock_class+0x4e/0x130 [ 8625.615817][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8625.616086][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8625.616358][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8625.616616][ C1] ? hlock_class+0x4e/0x130 [ 8625.616840][ C1] ? mark_lock+0x38/0x3e0 [ 8625.617057][ C1] ? stack_access_ok+0xda/0x1f0 [ 8625.617301][ C1] ? __lock_acquire+0xb67/0x1610 [ 8625.617548][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8625.617817][ C1] ? get_stack_info+0x36/0xc0 [ 8625.618053][ C1] ? stack_access_ok+0xda/0x1f0 [ 8625.618294][ C1] ? get_reg+0x119/0x190 [ 8625.618506][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8625.618793][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8625.619103][ C1] __tcf_classify+0x329/0x7d0 [ 8625.619346][ C1] tcf_classify+0x283/0x930 [ 8625.619577][ C1] ? arch_stack_walk+0xa2/0x100 [ 8625.619826][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8625.620087][ C1] ? get_stack_info+0x36/0xc0 [ 8625.620323][ C1] tc_run+0x2e4/0x5d0 [ 8625.620523][ C1] ? __pfx_tc_run+0x10/0x10 [ 8625.620749][ C1] ? lock_acquire+0x1c1/0x220 [ 8625.620981][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8625.621238][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8625.621485][ C1] ? lock_acquire+0x1c1/0x220 [ 8625.621720][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8625.621978][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8625.622276][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8625.622542][ C1] ? neigh_hh_output+0x348/0x590 [ 8625.622789][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8625.623049][ C1] ip_finish_output2+0x786/0x18e0 [ 8625.623300][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8625.623573][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8625.623902][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8625.624171][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8625.624419][ C1] ? __ip_finish_output+0x10f/0x770 [ 8625.624677][ C1] ip_output+0x16b/0x4f0 [ 8625.624890][ C1] ? run_timer_softirq+0x72/0x100 [ 8625.625141][ C1] ? __pfx_ip_output+0x10/0x10 [ 8625.625379][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8625.625659][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8625.625905][ C1] ? ip_local_out+0x114/0x3b0 [ 8625.626140][ C1] __ip_queue_xmit+0x672/0x1910 [ 8625.626383][ C1] ? __create_object+0x5e/0xb0 [ 8625.626621][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8625.626882][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8625.627158][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8625.627426][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8625.627701][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8625.627968][ C1] tcp_delack_timer+0x84/0x240 [ 8625.628206][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8625.628474][ C1] call_timer_fn+0x173/0x430 [ 8625.628726][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8625.628988][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8625.629251][ C1] __run_timers.part.0+0x52d/0x890 [ 8625.629513][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8625.629787][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8625.630079][ C1] ? lock_acquire+0x1c1/0x220 [ 8625.630313][ C1] ? clockevents_program_event+0xf6/0x300 [ 8625.630597][ C1] ? lock_release+0x1d5/0x250 [ 8625.630829][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8625.631089][ C1] ? ktime_get+0xb3/0x190 [ 8625.631307][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8625.631598][ C1] run_timer_softirq+0x72/0x100 [ 8625.631839][ C1] __do_softirq+0x1b9/0x7ff [ 8625.632068][ C1] irq_exit_rcu+0x98/0xc0 [ 8625.632284][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8625.632563][ C1] [ 8625.632709][ C1] [ 8625.632857][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8625.633151][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8625.633471][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8625.634421][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8625.634719][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8625.635112][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8625.635503][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8625.635892][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8625.636283][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8625.636676][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8625.636965][ C1] pipe_read+0xa16/0xdf0 [ 8625.637182][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8625.637453][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8625.637692][ C1] ? iterate_tty_write+0x299/0x540 [ 8625.637946][ C1] ? lock_release+0x1d5/0x250 [ 8625.638182][ C1] vfs_read+0x911/0xc00 [ 8625.638391][ C1] ? lock_acquire+0x1c1/0x220 [ 8625.638625][ C1] ? __might_fault+0xc6/0x180 [ 8625.638883][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8625.639125][ C1] ? __might_fault+0xc6/0x180 [ 8625.639367][ C1] ? lock_release+0x1d5/0x250 [ 8625.639609][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8625.639885][ C1] ? __fget_light+0x54/0x1e0 [ 8625.640115][ C1] ksys_read+0x17a/0x1e0 [ 8625.640329][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8625.640568][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8625.640864][ C1] do_syscall_64+0xc9/0x1e0 [ 8625.641093][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8625.641386][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8625.641607][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8625.642556][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8625.642994][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8625.643394][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8625.643794][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8625.644199][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8625.644588][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8625.644980][ C1] [ 8625.645135][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8625.645401][ C2] NMI backtrace for cpu 2 [ 8625.645406][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8625.645412][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8625.645414][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8625.645420][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8625.645422][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 8625.645424][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8625.645425][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8625.645427][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8625.645428][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8625.645430][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8625.645431][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8625.645433][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8625.645436][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8625.645438][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8625.645439][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8625.645440][ C2] PKRU: 55555554 [ 8625.645441][ C2] Call Trace: [ 8625.645443][ C2] [ 8625.645444][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8625.645450][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8625.645454][ C2] ? nmi_handle+0x153/0x420 [ 8625.645458][ C2] ? default_do_nmi+0x41/0x100 [ 8625.645462][ C2] ? exc_nmi+0xf3/0x120 [ 8625.645464][ C2] ? end_repeat_nmi+0xf/0x60 [ 8625.645469][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8625.645472][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8625.645476][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8625.645479][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8625.645482][ C2] [ 8625.645483][ C2] [ 8625.645484][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 8625.645487][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8625.645490][ C2] ? get_stack_info+0x36/0xc0 [ 8625.645494][ C2] ? lock_acquire+0x1c1/0x220 [ 8625.645498][ C2] ? lock_release+0x1d5/0x250 [ 8625.645501][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8625.645504][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8625.645507][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8625.645510][ C2] ? lock_acquire+0x1c1/0x220 [ 8625.645512][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8625.645515][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8625.645518][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8625.645524][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8625.645526][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8625.645530][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8625.645535][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8625.645538][ C2] ip_local_deliver+0x19d/0x480 [ 8625.645541][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8625.645543][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8625.645545][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8625.645550][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8625.645554][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8625.645557][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8625.645565][ C2] ip_rcv+0x564/0x740 [ 8625.645568][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8625.645570][ C2] ? set_track_prepare+0x8a/0xd0 [ 8625.645574][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8625.645577][ C2] ? start_secondary+0x21c/0x2b0 [ 8625.645580][ C2] ? skb_clone+0x10b/0x330 [ 8625.645582][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8625.645588][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8625.645593][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8625.645596][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8625.645604][ C2] ? __tcf_classify+0x329/0x7d0 [ 8625.645607][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8625.645609][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8625.645612][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8625.645616][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8625.645620][ C2] ? lock_acquire+0x1c1/0x220 [ 8625.645622][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8625.645626][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8625.645629][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8625.645633][ C2] ? __copy_skb_header+0xaf/0x490 [ 8625.645637][ C2] ? __skb_clone+0x57a/0x760 [ 8625.645639][ C2] netif_receive_skb+0x55/0x280 [ 8625.645642][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8625.645649][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8625.645655][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8625.645661][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8625.645666][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8625.645675][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8625.645683][ C2] ? get_stack_info+0x36/0xc0 [ 8625.645687][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8625.645690][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8625.645693][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8625.645696][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8625.645699][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8625.645702][ C2] ? kernel_text_address+0x17/0xe0 [ 8625.645705][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8625.645708][ C2] ? arch_stack_walk+0x8c/0x100 [ 8625.645711][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8625.645714][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8625.645718][ C2] ? lock_acquire+0x1c1/0x220 [ 8625.645720][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8625.645723][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8625.645727][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8625.645730][ C2] ? get_stack_info+0x36/0xc0 [ 8625.645734][ C2] __tcf_classify+0x329/0x7d0 [ 8625.645739][ C2] tcf_classify+0x283/0x930 [ 8625.645743][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8625.645746][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8625.645751][ C2] tc_run+0x2e4/0x5d0 [ 8625.645754][ C2] ? __pfx_tc_run+0x10/0x10 [ 8625.645757][ C2] ? lock_acquire+0x1c1/0x220 [ 8625.645760][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8625.645763][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8625.645767][ C2] ? lock_acquire+0x1c1/0x220 [ 8625.645769][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8625.645772][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8625.645775][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8625.645778][ C2] ? neigh_hh_output+0x348/0x590 [ 8625.645781][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8625.645785][ C2] ip_finish_output2+0x786/0x18e0 [ 8625.645788][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8625.645795][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8625.645797][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8625.645801][ C2] ? __ip_finish_output+0x10f/0x770 [ 8625.645805][ C2] ip_output+0x16b/0x4f0 [ 8625.645807][ C2] ? __pfx_ip_output+0x10/0x10 [ 8625.645810][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8625.645813][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8625.645816][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8625.645818][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8625.645820][ C2] ? __alloc_skb+0xd4/0x280 [ 8625.645823][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8625.645826][ C2] ? tcp_fragment+0x168/0x1040 [ 8625.645830][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8625.645833][ C2] ? ip_local_out+0x114/0x3b0 [ 8625.645836][ C2] __ip_queue_xmit+0x672/0x1910 [ 8625.645840][ C2] ? __skb_clone+0x57a/0x760 [ 8625.645843][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8625.645848][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8625.645851][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8625.645854][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8625.645859][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8625.645862][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8625.645865][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8625.645868][ C2] tcp_send_loss_probe+0x348/0x830 [ 8625.645872][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8625.645874][ C2] tcp_write_timer+0x82/0x1d0 [ 8625.645877][ C2] call_timer_fn+0x173/0x430 [ 8625.645881][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8625.645885][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8625.645889][ C2] __run_timers.part.0+0x52d/0x890 [ 8625.645892][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8625.645896][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8625.645899][ C2] ? lock_acquire+0x1c1/0x220 [ 8625.645901][ C2] ? clockevents_program_event+0xf6/0x300 [ 8625.645906][ C2] ? lock_release+0x1d5/0x250 [ 8625.645908][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8625.645911][ C2] ? ktime_get+0xb3/0x190 [ 8625.645915][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8625.645919][ C2] run_timer_softirq+0x72/0x100 [ 8625.645922][ C2] __do_softirq+0x1b9/0x7ff [ 8625.645926][ C2] irq_exit_rcu+0x98/0xc0 [ 8625.645928][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8625.645931][ C2] [ 8625.645932][ C2] [ 8625.645933][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8625.645936][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8625.645939][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8625.645941][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8625.645942][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8625.645944][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8625.645945][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8625.645947][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8625.645948][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8625.645951][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8625.645954][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8625.645957][ C2] default_idle_call+0x69/0xa0 [ 8625.645960][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8625.645963][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8625.645966][ C2] ? lock_release+0x1d5/0x250 [ 8625.645969][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8625.645973][ C2] do_idle+0xfb/0x160 [ 8625.645975][ C2] cpu_startup_entry+0x55/0x60 [ 8625.645977][ C2] start_secondary+0x21c/0x2b0 [ 8625.645980][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8625.645983][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8625.645989][ C2] [ 8652.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5867s! [swapper/2:0] [ 8652.569682][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8652.570890][ C2] irq event stamp: 44114564 [ 8652.571112][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8652.571631][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8652.572123][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8652.572583][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8652.573037][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8652.573477][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8652.574067][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8652.574381][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8652.575319][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8652.575613][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8652.575998][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8652.576382][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8652.576766][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8652.577150][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8652.577538][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8652.577969][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8652.578290][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8652.578699][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8652.579094][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8652.579491][ C2] PKRU: 55555554 [ 8652.579671][ C2] Call Trace: [ 8652.579845][ C2] [ 8652.579989][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8652.580243][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8652.580478][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8652.580746][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8652.581009][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8652.581289][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8652.581545][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8652.581839][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8652.582092][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8652.582346][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8652.582643][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8652.582930][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8652.583236][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8652.583515][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8652.583801][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8652.584080][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8652.584381][ C2] ? get_stack_info+0x36/0xc0 [ 8652.584617][ C2] ? lock_acquire+0x1c1/0x220 [ 8652.584849][ C2] ? lock_release+0x1d5/0x250 [ 8652.585081][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8652.585322][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8652.585586][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8652.585860][ C2] ? lock_acquire+0x1c1/0x220 [ 8652.586091][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8652.586324][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8652.586575][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8652.586799][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8652.587038][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8652.587290][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8652.587557][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8652.587826][ C2] ip_local_deliver+0x19d/0x480 [ 8652.588066][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8652.588330][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8652.588607][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8652.588952][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8652.589204][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8652.589522][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8652.589795][ C2] ip_rcv+0x564/0x740 [ 8652.589995][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8652.590218][ C2] ? set_track_prepare+0x8a/0xd0 [ 8652.590463][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8652.590730][ C2] ? start_secondary+0x21c/0x2b0 [ 8652.590972][ C2] ? skb_clone+0x10b/0x330 [ 8652.591195][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8652.591505][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8652.591801][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8652.592074][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8652.592360][ C2] ? __tcf_classify+0x329/0x7d0 [ 8652.592600][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8652.592824][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8652.593115][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8652.593392][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8652.593706][ C2] ? lock_acquire+0x1c1/0x220 [ 8652.593937][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8652.594225][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8652.594501][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8652.594807][ C2] ? __copy_skb_header+0xaf/0x490 [ 8652.595056][ C2] ? __skb_clone+0x57a/0x760 [ 8652.595286][ C2] netif_receive_skb+0x55/0x280 [ 8652.595525][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8652.595827][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8652.596148][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8652.596439][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8652.596704][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8652.596985][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8652.597287][ C2] ? get_stack_info+0x36/0xc0 [ 8652.597520][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8652.597775][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8652.598081][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8652.598351][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8652.598642][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8652.598955][ C2] ? kernel_text_address+0x17/0xe0 [ 8652.599215][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8652.599525][ C2] ? arch_stack_walk+0x8c/0x100 [ 8652.599783][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8652.600038][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8652.600314][ C2] ? lock_acquire+0x1c1/0x220 [ 8652.600546][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8652.600819][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8652.601114][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8652.601382][ C2] ? get_stack_info+0x36/0xc0 [ 8652.601615][ C2] __tcf_classify+0x329/0x7d0 [ 8652.601850][ C2] tcf_classify+0x283/0x930 [ 8652.602076][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8652.602325][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8652.602627][ C2] tc_run+0x2e4/0x5d0 [ 8652.602826][ C2] ? __pfx_tc_run+0x10/0x10 [ 8652.603048][ C2] ? lock_acquire+0x1c1/0x220 [ 8652.603281][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8652.603533][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8652.603778][ C2] ? lock_acquire+0x1c1/0x220 [ 8652.604009][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8652.604266][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8652.604561][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8652.604824][ C2] ? neigh_hh_output+0x348/0x590 [ 8652.605068][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8652.605326][ C2] ip_finish_output2+0x786/0x18e0 [ 8652.605574][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8652.605899][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8652.606166][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8652.606411][ C2] ? __ip_finish_output+0x10f/0x770 [ 8652.606667][ C2] ip_output+0x16b/0x4f0 [ 8652.606879][ C2] ? __pfx_ip_output+0x10/0x10 [ 8652.607115][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8652.607382][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8652.607683][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8652.607951][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8652.608194][ C2] ? __alloc_skb+0xd4/0x280 [ 8652.608419][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8652.608704][ C2] ? tcp_fragment+0x168/0x1040 [ 8652.608946][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8652.609198][ C2] ? ip_local_out+0x114/0x3b0 [ 8652.609436][ C2] __ip_queue_xmit+0x672/0x1910 [ 8652.609682][ C2] ? __skb_clone+0x57a/0x760 [ 8652.609922][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8652.610180][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8652.610453][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8652.610688][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8652.610930][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8652.611222][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8652.611533][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8652.611771][ C2] tcp_send_loss_probe+0x348/0x830 [ 8652.612022][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8652.612284][ C2] tcp_write_timer+0x82/0x1d0 [ 8652.612517][ C2] call_timer_fn+0x173/0x430 [ 8652.612745][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8652.613000][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8652.613255][ C2] __run_timers.part.0+0x52d/0x890 [ 8652.613506][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8652.613768][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8652.614042][ C2] ? lock_acquire+0x1c1/0x220 [ 8652.614275][ C2] ? clockevents_program_event+0xf6/0x300 [ 8652.614555][ C2] ? lock_release+0x1d5/0x250 [ 8652.614789][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8652.615043][ C2] ? ktime_get+0xb3/0x190 [ 8652.615260][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8652.615546][ C2] run_timer_softirq+0x72/0x100 [ 8652.615787][ C2] __do_softirq+0x1b9/0x7ff [ 8652.616013][ C2] irq_exit_rcu+0x98/0xc0 [ 8652.616226][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8652.616508][ C2] [ 8652.616653][ C2] [ 8652.616799][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8652.617093][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8652.617343][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8652.618283][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8652.618604][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8652.619000][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8652.619400][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8652.619806][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8652.620190][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8652.620578][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8652.620858][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8652.621110][ C2] default_idle_call+0x69/0xa0 [ 8652.621348][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8652.621592][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8652.621860][ C2] ? lock_release+0x1d5/0x250 [ 8652.622092][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8652.622357][ C2] do_idle+0xfb/0x160 [ 8652.622554][ C2] cpu_startup_entry+0x55/0x60 [ 8652.622791][ C2] start_secondary+0x21c/0x2b0 [ 8652.623027][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8652.623289][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8652.623590][ C2] [ 8652.623741][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5867s! [perl:4135] [ 8652.624147][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8652.625373][ C1] irq event stamp: 209232 [ 8652.625585][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8652.626098][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8652.626566][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8652.627022][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8652.627473][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8652.627910][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8652.628510][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8652.628856][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8652.629838][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8652.630138][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8652.630529][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8652.630918][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8652.631310][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8652.631699][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8652.632087][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8652.632524][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8652.632851][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8652.633245][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8652.633634][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8652.634024][ C1] PKRU: 55555554 [ 8652.634201][ C1] Call Trace: [ 8652.634369][ C1] [ 8652.634512][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8652.634768][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8652.635007][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8652.635278][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8652.635544][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8652.635826][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8652.636085][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8652.636386][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8652.636642][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8652.636944][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8652.637234][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8652.637541][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8652.637825][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8652.638112][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8652.638397][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8652.638729][ C1] ? get_stack_info+0x36/0xc0 [ 8652.638968][ C1] ? lock_acquire+0x1c1/0x220 [ 8652.639210][ C1] ? lock_release+0x1d5/0x250 [ 8652.639451][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8652.639702][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8652.639978][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8652.640257][ C1] ? lock_acquire+0x1c1/0x220 [ 8652.640490][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8652.640726][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8652.640979][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8652.641209][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8652.641451][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8652.641702][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8652.641971][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8652.642242][ C1] ip_local_deliver+0x19d/0x480 [ 8652.642483][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8652.642747][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8652.643004][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8652.643346][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8652.643594][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8652.643906][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8652.644163][ C1] ip_rcv+0x564/0x740 [ 8652.644362][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8652.644587][ C1] ? set_track_prepare+0x8a/0xd0 [ 8652.644834][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8652.645105][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8652.645373][ C1] ? skb_clone+0x10b/0x330 [ 8652.645595][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8652.645905][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8652.646205][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8652.646483][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8652.646769][ C1] ? __tcf_classify+0x329/0x7d0 [ 8652.647012][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8652.647241][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8652.647531][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8652.647812][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8652.648131][ C1] ? lock_acquire+0x1c1/0x220 [ 8652.648367][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8652.648678][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8652.648965][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8652.649284][ C1] ? __copy_skb_header+0xaf/0x490 [ 8652.649542][ C1] ? __skb_clone+0x57a/0x760 [ 8652.649786][ C1] netif_receive_skb+0x55/0x280 [ 8652.650028][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8652.650334][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8652.650658][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8652.650950][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8652.651219][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8652.651499][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8652.651804][ C1] ? hlock_class+0x4e/0x130 [ 8652.652033][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8652.652304][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8652.652571][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8652.652830][ C1] ? hlock_class+0x4e/0x130 [ 8652.653056][ C1] ? mark_lock+0x38/0x3e0 [ 8652.653272][ C1] ? stack_access_ok+0xda/0x1f0 [ 8652.653514][ C1] ? __lock_acquire+0xb67/0x1610 [ 8652.653761][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8652.654033][ C1] ? get_stack_info+0x36/0xc0 [ 8652.654268][ C1] ? stack_access_ok+0xda/0x1f0 [ 8652.654508][ C1] ? get_reg+0x119/0x190 [ 8652.654722][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8652.654983][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8652.655287][ C1] __tcf_classify+0x329/0x7d0 [ 8652.655523][ C1] tcf_classify+0x283/0x930 [ 8652.655750][ C1] ? arch_stack_walk+0xa2/0x100 [ 8652.655992][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8652.656243][ C1] ? get_stack_info+0x36/0xc0 [ 8652.656479][ C1] tc_run+0x2e4/0x5d0 [ 8652.656679][ C1] ? __pfx_tc_run+0x10/0x10 [ 8652.656905][ C1] ? lock_acquire+0x1c1/0x220 [ 8652.657138][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8652.657393][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8652.657641][ C1] ? lock_acquire+0x1c1/0x220 [ 8652.657875][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8652.658133][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8652.658432][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8652.658723][ C1] ? neigh_hh_output+0x348/0x590 [ 8652.658974][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8652.659240][ C1] ip_finish_output2+0x786/0x18e0 [ 8652.659497][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8652.659784][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8652.660114][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8652.660385][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8652.660632][ C1] ? __ip_finish_output+0x10f/0x770 [ 8652.660890][ C1] ip_output+0x16b/0x4f0 [ 8652.661102][ C1] ? run_timer_softirq+0x72/0x100 [ 8652.661355][ C1] ? __pfx_ip_output+0x10/0x10 [ 8652.661592][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8652.661874][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8652.662120][ C1] ? ip_local_out+0x114/0x3b0 [ 8652.662354][ C1] __ip_queue_xmit+0x672/0x1910 [ 8652.662598][ C1] ? __create_object+0x5e/0xb0 [ 8652.662836][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8652.663096][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8652.663373][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8652.663640][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8652.663914][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8652.664180][ C1] tcp_delack_timer+0x84/0x240 [ 8652.664418][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8652.664683][ C1] call_timer_fn+0x173/0x430 [ 8652.664913][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8652.665168][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8652.665424][ C1] __run_timers.part.0+0x52d/0x890 [ 8652.665678][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8652.665948][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8652.666226][ C1] ? lock_acquire+0x1c1/0x220 [ 8652.666460][ C1] ? clockevents_program_event+0xf6/0x300 [ 8652.666743][ C1] ? lock_release+0x1d5/0x250 [ 8652.666977][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8652.667237][ C1] ? ktime_get+0xb3/0x190 [ 8652.667457][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8652.667745][ C1] run_timer_softirq+0x72/0x100 [ 8652.667988][ C1] __do_softirq+0x1b9/0x7ff [ 8652.668217][ C1] irq_exit_rcu+0x98/0xc0 [ 8652.668431][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8652.668736][ C1] [ 8652.668887][ C1] [ 8652.669037][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8652.669344][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8652.669669][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8652.670628][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8652.670930][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8652.671320][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8652.671712][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8652.672100][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8652.672491][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8652.672883][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8652.673175][ C1] pipe_read+0xa16/0xdf0 [ 8652.673389][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8652.673663][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8652.673901][ C1] ? iterate_tty_write+0x299/0x540 [ 8652.674157][ C1] ? lock_release+0x1d5/0x250 [ 8652.674392][ C1] vfs_read+0x911/0xc00 [ 8652.674603][ C1] ? lock_acquire+0x1c1/0x220 [ 8652.674833][ C1] ? __might_fault+0xc6/0x180 [ 8652.675069][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8652.675304][ C1] ? __might_fault+0xc6/0x180 [ 8652.675539][ C1] ? lock_release+0x1d5/0x250 [ 8652.675770][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8652.676030][ C1] ? __fget_light+0x54/0x1e0 [ 8652.676262][ C1] ksys_read+0x17a/0x1e0 [ 8652.676475][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8652.676712][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8652.677009][ C1] do_syscall_64+0xc9/0x1e0 [ 8652.677238][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8652.677530][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8652.677752][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8652.678725][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8652.679149][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8652.679548][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8652.679951][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8652.680342][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8652.680733][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8652.681125][ C1] [ 8680.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5893s! [perl:4135] [ 8680.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8680.570925][ C1] irq event stamp: 209232 [ 8680.571139][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8680.571658][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8680.572121][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8680.572582][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8680.573035][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8680.573474][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8680.574074][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8680.574399][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8680.575349][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8680.575649][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8680.576039][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8680.576429][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8680.576819][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8680.577210][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8680.577599][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8680.578035][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8680.578361][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8680.578775][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8680.579178][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8680.579588][ C1] PKRU: 55555554 [ 8680.579765][ C1] Call Trace: [ 8680.579932][ C1] [ 8680.580075][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8680.580333][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8680.580574][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8680.580843][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8680.581108][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8680.581392][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8680.581651][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8680.581950][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8680.582207][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8680.582510][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8680.582797][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8680.583104][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8680.583388][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8680.583679][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8680.583962][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8680.584268][ C1] ? get_stack_info+0x36/0xc0 [ 8680.584502][ C1] ? lock_acquire+0x1c1/0x220 [ 8680.584737][ C1] ? lock_release+0x1d5/0x250 [ 8680.584972][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8680.585216][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8680.585482][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8680.585759][ C1] ? lock_acquire+0x1c1/0x220 [ 8680.585991][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8680.586227][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8680.586481][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8680.586711][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8680.586951][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8680.587203][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8680.587474][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8680.587743][ C1] ip_local_deliver+0x19d/0x480 [ 8680.587984][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8680.588250][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8680.588538][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8680.588886][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8680.589141][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8680.589462][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8680.589733][ C1] ip_rcv+0x564/0x740 [ 8680.589932][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8680.590157][ C1] ? set_track_prepare+0x8a/0xd0 [ 8680.590405][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8680.590677][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8680.590942][ C1] ? skb_clone+0x10b/0x330 [ 8680.591164][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8680.591476][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8680.591774][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8680.592050][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8680.592337][ C1] ? __tcf_classify+0x329/0x7d0 [ 8680.592580][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8680.592805][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8680.593096][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8680.593376][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8680.593694][ C1] ? lock_acquire+0x1c1/0x220 [ 8680.593926][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8680.594215][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8680.594494][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8680.594802][ C1] ? __copy_skb_header+0xaf/0x490 [ 8680.595053][ C1] ? __skb_clone+0x57a/0x760 [ 8680.595283][ C1] netif_receive_skb+0x55/0x280 [ 8680.595526][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8680.595829][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8680.596153][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8680.596446][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8680.596714][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8680.596994][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8680.597300][ C1] ? hlock_class+0x4e/0x130 [ 8680.597527][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8680.597796][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8680.598065][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8680.598323][ C1] ? hlock_class+0x4e/0x130 [ 8680.598574][ C1] ? mark_lock+0x38/0x3e0 [ 8680.598794][ C1] ? stack_access_ok+0xda/0x1f0 [ 8680.599042][ C1] ? __lock_acquire+0xb67/0x1610 [ 8680.599298][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8680.599577][ C1] ? get_stack_info+0x36/0xc0 [ 8680.599820][ C1] ? stack_access_ok+0xda/0x1f0 [ 8680.600061][ C1] ? get_reg+0x119/0x190 [ 8680.600275][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8680.600536][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8680.600838][ C1] __tcf_classify+0x329/0x7d0 [ 8680.601072][ C1] tcf_classify+0x283/0x930 [ 8680.601300][ C1] ? arch_stack_walk+0xa2/0x100 [ 8680.601542][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8680.601792][ C1] ? get_stack_info+0x36/0xc0 [ 8680.602027][ C1] tc_run+0x2e4/0x5d0 [ 8680.602228][ C1] ? __pfx_tc_run+0x10/0x10 [ 8680.602455][ C1] ? lock_acquire+0x1c1/0x220 [ 8680.602687][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8680.602941][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8680.603188][ C1] ? lock_acquire+0x1c1/0x220 [ 8680.603421][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8680.603679][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8680.603977][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8680.604243][ C1] ? neigh_hh_output+0x348/0x590 [ 8680.604490][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8680.604750][ C1] ip_finish_output2+0x786/0x18e0 [ 8680.605000][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8680.605272][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8680.605603][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8680.605872][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8680.606119][ C1] ? __ip_finish_output+0x10f/0x770 [ 8680.606379][ C1] ip_output+0x16b/0x4f0 [ 8680.606589][ C1] ? run_timer_softirq+0x72/0x100 [ 8680.606839][ C1] ? __pfx_ip_output+0x10/0x10 [ 8680.607077][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8680.607359][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8680.607605][ C1] ? ip_local_out+0x114/0x3b0 [ 8680.607837][ C1] __ip_queue_xmit+0x672/0x1910 [ 8680.608080][ C1] ? __create_object+0x5e/0xb0 [ 8680.608320][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8680.608605][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8680.608888][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8680.609164][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8680.609445][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8680.609725][ C1] tcp_delack_timer+0x84/0x240 [ 8680.609963][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8680.610229][ C1] call_timer_fn+0x173/0x430 [ 8680.610459][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8680.610714][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8680.610967][ C1] __run_timers.part.0+0x52d/0x890 [ 8680.611222][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8680.611489][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8680.611766][ C1] ? lock_acquire+0x1c1/0x220 [ 8680.612000][ C1] ? clockevents_program_event+0xf6/0x300 [ 8680.612284][ C1] ? lock_release+0x1d5/0x250 [ 8680.612518][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8680.612775][ C1] ? ktime_get+0xb3/0x190 [ 8680.612991][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8680.613280][ C1] run_timer_softirq+0x72/0x100 [ 8680.613522][ C1] __do_softirq+0x1b9/0x7ff [ 8680.613753][ C1] irq_exit_rcu+0x98/0xc0 [ 8680.613967][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8680.614248][ C1] [ 8680.614394][ C1] [ 8680.614540][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8680.614837][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8680.615155][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8680.616101][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8680.616403][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8680.616791][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8680.617181][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8680.617570][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8680.617959][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8680.618349][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8680.618666][ C1] pipe_read+0xa16/0xdf0 [ 8680.618886][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8680.619166][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8680.619409][ C1] ? iterate_tty_write+0x299/0x540 [ 8680.619681][ C1] ? lock_release+0x1d5/0x250 [ 8680.619915][ C1] vfs_read+0x911/0xc00 [ 8680.620124][ C1] ? lock_acquire+0x1c1/0x220 [ 8680.620356][ C1] ? __might_fault+0xc6/0x180 [ 8680.620591][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8680.620826][ C1] ? __might_fault+0xc6/0x180 [ 8680.621059][ C1] ? lock_release+0x1d5/0x250 [ 8680.621292][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8680.621551][ C1] ? __fget_light+0x54/0x1e0 [ 8680.621782][ C1] ksys_read+0x17a/0x1e0 [ 8680.621993][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8680.622231][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8680.622530][ C1] do_syscall_64+0xc9/0x1e0 [ 8680.622756][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8680.623047][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8680.623271][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8680.624217][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8680.624629][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8680.625019][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8680.625408][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8680.625796][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8680.626189][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8680.626582][ C1] [ 8680.626734][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5893s! [swapper/2:0] [ 8680.627140][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8680.628350][ C2] irq event stamp: 44114564 [ 8680.628599][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8680.629127][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8680.629646][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8680.630106][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8680.630561][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8680.631001][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8680.631593][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8680.631907][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8680.632845][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8680.633141][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8680.633528][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8680.633912][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8680.634298][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8680.634684][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8680.635070][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8680.635503][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8680.635823][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8680.636210][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8680.636597][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8680.636983][ C2] PKRU: 55555554 [ 8680.637159][ C2] Call Trace: [ 8680.637322][ C2] [ 8680.637466][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8680.637719][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8680.637954][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8680.638223][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8680.638508][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8680.638795][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8680.639057][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8680.639362][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8680.639634][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8680.639887][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8680.640187][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8680.640474][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8680.640777][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8680.641056][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8680.641343][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8680.641623][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8680.641923][ C2] ? get_stack_info+0x36/0xc0 [ 8680.642156][ C2] ? lock_acquire+0x1c1/0x220 [ 8680.642390][ C2] ? lock_release+0x1d5/0x250 [ 8680.642623][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8680.642863][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8680.643126][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8680.643401][ C2] ? lock_acquire+0x1c1/0x220 [ 8680.643634][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8680.643866][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8680.644118][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8680.644345][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8680.644583][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8680.644834][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8680.645101][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8680.645371][ C2] ip_local_deliver+0x19d/0x480 [ 8680.645610][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8680.645872][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8680.646127][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8680.646464][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8680.646707][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8680.647017][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8680.647272][ C2] ip_rcv+0x564/0x740 [ 8680.647470][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8680.647693][ C2] ? set_track_prepare+0x8a/0xd0 [ 8680.647939][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8680.648209][ C2] ? start_secondary+0x21c/0x2b0 [ 8680.648476][ C2] ? skb_clone+0x10b/0x330 [ 8680.648700][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8680.649017][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8680.649324][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8680.649602][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8680.649897][ C2] ? __tcf_classify+0x329/0x7d0 [ 8680.650138][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8680.650362][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8680.650653][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8680.650927][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8680.651243][ C2] ? lock_acquire+0x1c1/0x220 [ 8680.651474][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8680.651761][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8680.652039][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8680.652346][ C2] ? __copy_skb_header+0xaf/0x490 [ 8680.652595][ C2] ? __skb_clone+0x57a/0x760 [ 8680.652823][ C2] netif_receive_skb+0x55/0x280 [ 8680.653063][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8680.653364][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8680.653687][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8680.653975][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8680.654241][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8680.654522][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8680.654824][ C2] ? get_stack_info+0x36/0xc0 [ 8680.655055][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8680.655314][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8680.655619][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8680.655889][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8680.656157][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8680.656463][ C2] ? kernel_text_address+0x17/0xe0 [ 8680.656714][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8680.657017][ C2] ? arch_stack_walk+0x8c/0x100 [ 8680.657258][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8680.657514][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8680.657788][ C2] ? lock_acquire+0x1c1/0x220 [ 8680.658020][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8680.658294][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8680.658615][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8680.658889][ C2] ? get_stack_info+0x36/0xc0 [ 8680.659129][ C2] __tcf_classify+0x329/0x7d0 [ 8680.659369][ C2] tcf_classify+0x283/0x930 [ 8680.659602][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8680.659861][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8680.660163][ C2] tc_run+0x2e4/0x5d0 [ 8680.660364][ C2] ? __pfx_tc_run+0x10/0x10 [ 8680.660585][ C2] ? lock_acquire+0x1c1/0x220 [ 8680.660817][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8680.661071][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8680.661318][ C2] ? lock_acquire+0x1c1/0x220 [ 8680.661549][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8680.661805][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8680.662100][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8680.662365][ C2] ? neigh_hh_output+0x348/0x590 [ 8680.662610][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8680.662866][ C2] ip_finish_output2+0x786/0x18e0 [ 8680.663115][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8680.663443][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8680.663710][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8680.663955][ C2] ? __ip_finish_output+0x10f/0x770 [ 8680.664213][ C2] ip_output+0x16b/0x4f0 [ 8680.664423][ C2] ? __pfx_ip_output+0x10/0x10 [ 8680.664659][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8680.664927][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8680.665231][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8680.665497][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8680.665741][ C2] ? __alloc_skb+0xd4/0x280 [ 8680.665965][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8680.666225][ C2] ? tcp_fragment+0x168/0x1040 [ 8680.666462][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8680.666706][ C2] ? ip_local_out+0x114/0x3b0 [ 8680.666937][ C2] __ip_queue_xmit+0x672/0x1910 [ 8680.667177][ C2] ? __skb_clone+0x57a/0x760 [ 8680.667407][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8680.667664][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8680.667937][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8680.668172][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8680.668434][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8680.668733][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8680.669052][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8680.669295][ C2] tcp_send_loss_probe+0x348/0x830 [ 8680.669554][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8680.669825][ C2] tcp_write_timer+0x82/0x1d0 [ 8680.670057][ C2] call_timer_fn+0x173/0x430 [ 8680.670286][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8680.670540][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8680.670793][ C2] __run_timers.part.0+0x52d/0x890 [ 8680.671044][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8680.671306][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8680.671581][ C2] ? lock_acquire+0x1c1/0x220 [ 8680.671812][ C2] ? clockevents_program_event+0xf6/0x300 [ 8680.672092][ C2] ? lock_release+0x1d5/0x250 [ 8680.672325][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8680.672581][ C2] ? ktime_get+0xb3/0x190 [ 8680.672798][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8680.673084][ C2] run_timer_softirq+0x72/0x100 [ 8680.673327][ C2] __do_softirq+0x1b9/0x7ff [ 8680.673554][ C2] irq_exit_rcu+0x98/0xc0 [ 8680.673765][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8680.674043][ C2] [ 8680.674189][ C2] [ 8680.674336][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8680.674629][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8680.674877][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8680.675816][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8680.676114][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8680.676500][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8680.676886][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8680.677272][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8680.677656][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8680.678044][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8680.678326][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8680.678602][ C2] default_idle_call+0x69/0xa0 [ 8680.678844][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8680.679094][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8680.679369][ C2] ? lock_release+0x1d5/0x250 [ 8680.679607][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8680.679881][ C2] do_idle+0xfb/0x160 [ 8680.680078][ C2] cpu_startup_entry+0x55/0x60 [ 8680.680315][ C2] start_secondary+0x21c/0x2b0 [ 8680.680551][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8680.680812][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8680.681112][ C2] [ 8703.646103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8703.646454][ C1] rcu: 1-....: (6333229 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1527114 [ 8703.647000][ C1] rcu: (t=6348759 jiffies g=1882453 q=721 ncpus=4) [ 8703.647325][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8703.647762][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8703.648382][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8703.648712][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8703.649691][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8703.649990][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8703.650380][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8703.650769][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8703.651156][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8703.651549][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8703.651938][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8703.652375][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8703.652698][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8703.653087][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8703.653479][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8703.653867][ C1] PKRU: 55555554 [ 8703.654045][ C1] Call Trace: [ 8703.654211][ C1] [ 8703.654356][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8703.654622][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8703.654867][ C1] ? check_cpu_stall+0x284/0x500 [ 8703.655114][ C1] ? rcu_pending+0x92/0x360 [ 8703.655339][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8703.655603][ C1] ? update_process_times+0xb9/0x110 [ 8703.655865][ C1] ? tick_sched_handle+0x67/0x130 [ 8703.656114][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8703.656391][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8703.656627][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8703.656933][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8703.657199][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8703.657482][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8703.657740][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8703.658038][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8703.658298][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8703.658623][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8703.658918][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8703.659234][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8703.659533][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8703.659820][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8703.660103][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8703.660408][ C1] ? get_stack_info+0x36/0xc0 [ 8703.660643][ C1] ? lock_acquire+0x1c1/0x220 [ 8703.660878][ C1] ? lock_release+0x1d5/0x250 [ 8703.661113][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8703.661357][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8703.661622][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8703.661898][ C1] ? lock_acquire+0x1c1/0x220 [ 8703.662132][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8703.662368][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8703.662624][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8703.662852][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8703.663095][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8703.663348][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8703.663618][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8703.663888][ C1] ip_local_deliver+0x19d/0x480 [ 8703.664129][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8703.664394][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8703.664650][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8703.664989][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8703.665240][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8703.665552][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8703.665808][ C1] ip_rcv+0x564/0x740 [ 8703.666007][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8703.666231][ C1] ? set_track_prepare+0x8a/0xd0 [ 8703.666478][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8703.666748][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8703.667014][ C1] ? skb_clone+0x10b/0x330 [ 8703.667235][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8703.667546][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8703.667844][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8703.668118][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8703.668430][ C1] ? __tcf_classify+0x329/0x7d0 [ 8703.668679][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8703.668909][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8703.669209][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8703.669494][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8703.669822][ C1] ? lock_acquire+0x1c1/0x220 [ 8703.670052][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8703.670343][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8703.670620][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8703.670927][ C1] ? __copy_skb_header+0xaf/0x490 [ 8703.671178][ C1] ? __skb_clone+0x57a/0x760 [ 8703.671408][ C1] netif_receive_skb+0x55/0x280 [ 8703.671651][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8703.671955][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8703.672279][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8703.672570][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8703.672838][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8703.673116][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8703.673425][ C1] ? hlock_class+0x4e/0x130 [ 8703.673652][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8703.673920][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8703.674191][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8703.674447][ C1] ? hlock_class+0x4e/0x130 [ 8703.674672][ C1] ? mark_lock+0x38/0x3e0 [ 8703.674885][ C1] ? stack_access_ok+0xda/0x1f0 [ 8703.675128][ C1] ? __lock_acquire+0xb67/0x1610 [ 8703.675376][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8703.675648][ C1] ? get_stack_info+0x36/0xc0 [ 8703.675881][ C1] ? stack_access_ok+0xda/0x1f0 [ 8703.676122][ C1] ? get_reg+0x119/0x190 [ 8703.676334][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8703.676596][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8703.676897][ C1] __tcf_classify+0x329/0x7d0 [ 8703.677131][ C1] tcf_classify+0x283/0x930 [ 8703.677358][ C1] ? arch_stack_walk+0xa2/0x100 [ 8703.677601][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8703.677851][ C1] ? get_stack_info+0x36/0xc0 [ 8703.678085][ C1] tc_run+0x2e4/0x5d0 [ 8703.678290][ C1] ? __pfx_tc_run+0x10/0x10 [ 8703.678535][ C1] ? lock_acquire+0x1c1/0x220 [ 8703.678774][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8703.679036][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8703.679289][ C1] ? lock_acquire+0x1c1/0x220 [ 8703.679539][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8703.679795][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8703.680093][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8703.680358][ C1] ? neigh_hh_output+0x348/0x590 [ 8703.680604][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8703.680861][ C1] ip_finish_output2+0x786/0x18e0 [ 8703.681109][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8703.681380][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8703.681711][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8703.681980][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8703.682228][ C1] ? __ip_finish_output+0x10f/0x770 [ 8703.682486][ C1] ip_output+0x16b/0x4f0 [ 8703.682695][ C1] ? run_timer_softirq+0x72/0x100 [ 8703.682944][ C1] ? __pfx_ip_output+0x10/0x10 [ 8703.683183][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8703.683463][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8703.683708][ C1] ? ip_local_out+0x114/0x3b0 [ 8703.683940][ C1] __ip_queue_xmit+0x672/0x1910 [ 8703.684183][ C1] ? __create_object+0x5e/0xb0 [ 8703.684420][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8703.684679][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8703.684953][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8703.685221][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8703.685494][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8703.685758][ C1] tcp_delack_timer+0x84/0x240 [ 8703.685997][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8703.686262][ C1] call_timer_fn+0x173/0x430 [ 8703.686493][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8703.686748][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8703.687003][ C1] __run_timers.part.0+0x52d/0x890 [ 8703.687257][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8703.687524][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8703.687803][ C1] ? lock_acquire+0x1c1/0x220 [ 8703.688036][ C1] ? clockevents_program_event+0xf6/0x300 [ 8703.688339][ C1] ? lock_release+0x1d5/0x250 [ 8703.688578][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8703.688843][ C1] ? ktime_get+0xb3/0x190 [ 8703.689065][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8703.689362][ C1] run_timer_softirq+0x72/0x100 [ 8703.689618][ C1] __do_softirq+0x1b9/0x7ff [ 8703.689845][ C1] irq_exit_rcu+0x98/0xc0 [ 8703.690058][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8703.690338][ C1] [ 8703.690486][ C1] [ 8703.690632][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8703.690928][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8703.691246][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8703.692192][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8703.692493][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8703.692882][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8703.693271][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8703.693660][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8703.694047][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8703.694437][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8703.694728][ C1] pipe_read+0xa16/0xdf0 [ 8703.694941][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8703.695213][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8703.695448][ C1] ? iterate_tty_write+0x299/0x540 [ 8703.695704][ C1] ? lock_release+0x1d5/0x250 [ 8703.695938][ C1] vfs_read+0x911/0xc00 [ 8703.696147][ C1] ? lock_acquire+0x1c1/0x220 [ 8703.696380][ C1] ? __might_fault+0xc6/0x180 [ 8703.696615][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8703.696850][ C1] ? __might_fault+0xc6/0x180 [ 8703.697082][ C1] ? lock_release+0x1d5/0x250 [ 8703.697334][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8703.697598][ C1] ? __fget_light+0x54/0x1e0 [ 8703.697836][ C1] ksys_read+0x17a/0x1e0 [ 8703.698053][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8703.698302][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8703.698607][ C1] do_syscall_64+0xc9/0x1e0 [ 8703.698840][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8703.699138][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8703.699367][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8703.700323][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8703.700733][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8703.701122][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8703.701511][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8703.701897][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8703.702289][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8703.702679][ C1] [ 8703.702835][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8703.703107][ C2] NMI backtrace for cpu 2 [ 8703.703115][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8703.703121][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8703.703125][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8703.703133][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8703.703139][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8703.703143][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8703.703147][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8703.703151][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8703.703155][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8703.703158][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8703.703162][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8703.703167][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8703.703172][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8703.703176][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8703.703179][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8703.703182][ C2] PKRU: 55555554 [ 8703.703185][ C2] Call Trace: [ 8703.703187][ C2] [ 8703.703190][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8703.703201][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8703.703209][ C2] ? nmi_handle+0x153/0x420 [ 8703.703219][ C2] ? default_do_nmi+0x41/0x100 [ 8703.703225][ C2] ? exc_nmi+0xf3/0x120 [ 8703.703231][ C2] ? end_repeat_nmi+0xf/0x60 [ 8703.703243][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8703.703250][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8703.703258][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8703.703267][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8703.703274][ C2] [ 8703.703276][ C2] [ 8703.703279][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8703.703285][ C2] ? get_stack_info+0x36/0xc0 [ 8703.703294][ C2] ? lock_acquire+0x1c1/0x220 [ 8703.703302][ C2] ? lock_release+0x1d5/0x250 [ 8703.703310][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8703.703318][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8703.703325][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8703.703333][ C2] ? lock_acquire+0x1c1/0x220 [ 8703.703338][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8703.703347][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8703.703353][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8703.703369][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8703.703375][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8703.703383][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8703.703387][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8703.703390][ C2] ip_local_deliver+0x19d/0x480 [ 8703.703393][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8703.703395][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8703.703397][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8703.703402][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8703.703406][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8703.703409][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8703.703418][ C2] ip_rcv+0x564/0x740 [ 8703.703420][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8703.703423][ C2] ? set_track_prepare+0x8a/0xd0 [ 8703.703427][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8703.703430][ C2] ? start_secondary+0x21c/0x2b0 [ 8703.703433][ C2] ? skb_clone+0x10b/0x330 [ 8703.703435][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8703.703441][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8703.703447][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8703.703450][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8703.703458][ C2] ? __tcf_classify+0x329/0x7d0 [ 8703.703461][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8703.703464][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8703.703467][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8703.703471][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8703.703475][ C2] ? lock_acquire+0x1c1/0x220 [ 8703.703477][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8703.703481][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8703.703485][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8703.703489][ C2] ? __copy_skb_header+0xaf/0x490 [ 8703.703493][ C2] ? __skb_clone+0x57a/0x760 [ 8703.703495][ C2] netif_receive_skb+0x55/0x280 [ 8703.703498][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8703.703504][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8703.703511][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8703.703517][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8703.703521][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8703.703531][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8703.703538][ C2] ? get_stack_info+0x36/0xc0 [ 8703.703542][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8703.703545][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8703.703548][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8703.703551][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8703.703554][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8703.703556][ C2] ? kernel_text_address+0x17/0xe0 [ 8703.703559][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8703.703562][ C2] ? arch_stack_walk+0x8c/0x100 [ 8703.703566][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8703.703569][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8703.703572][ C2] ? lock_acquire+0x1c1/0x220 [ 8703.703575][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8703.703579][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8703.703583][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8703.703585][ C2] ? get_stack_info+0x36/0xc0 [ 8703.703590][ C2] __tcf_classify+0x329/0x7d0 [ 8703.703595][ C2] tcf_classify+0x283/0x930 [ 8703.703599][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8703.703602][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8703.703606][ C2] tc_run+0x2e4/0x5d0 [ 8703.703610][ C2] ? __pfx_tc_run+0x10/0x10 [ 8703.703613][ C2] ? lock_acquire+0x1c1/0x220 [ 8703.703615][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8703.703619][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8703.703623][ C2] ? lock_acquire+0x1c1/0x220 [ 8703.703625][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8703.703628][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8703.703631][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8703.703634][ C2] ? neigh_hh_output+0x348/0x590 [ 8703.703637][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8703.703641][ C2] ip_finish_output2+0x786/0x18e0 [ 8703.703644][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8703.703652][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8703.703654][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8703.703658][ C2] ? __ip_finish_output+0x10f/0x770 [ 8703.703662][ C2] ip_output+0x16b/0x4f0 [ 8703.703665][ C2] ? __pfx_ip_output+0x10/0x10 [ 8703.703667][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8703.703670][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8703.703674][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8703.703676][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8703.703679][ C2] ? __alloc_skb+0xd4/0x280 [ 8703.703681][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8703.703685][ C2] ? tcp_fragment+0x168/0x1040 [ 8703.703688][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8703.703691][ C2] ? ip_local_out+0x114/0x3b0 [ 8703.703694][ C2] __ip_queue_xmit+0x672/0x1910 [ 8703.703697][ C2] ? __skb_clone+0x57a/0x760 [ 8703.703700][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8703.703705][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8703.703708][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8703.703711][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8703.703715][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8703.703719][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8703.703722][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8703.703725][ C2] tcp_send_loss_probe+0x348/0x830 [ 8703.703728][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8703.703731][ C2] tcp_write_timer+0x82/0x1d0 [ 8703.703734][ C2] call_timer_fn+0x173/0x430 [ 8703.703738][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8703.703743][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8703.703747][ C2] __run_timers.part.0+0x52d/0x890 [ 8703.703750][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8703.703754][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8703.703757][ C2] ? lock_acquire+0x1c1/0x220 [ 8703.703759][ C2] ? clockevents_program_event+0xf6/0x300 [ 8703.703763][ C2] ? lock_release+0x1d5/0x250 [ 8703.703766][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8703.703769][ C2] ? ktime_get+0xb3/0x190 [ 8703.703772][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8703.703776][ C2] run_timer_softirq+0x72/0x100 [ 8703.703780][ C2] __do_softirq+0x1b9/0x7ff [ 8703.703784][ C2] irq_exit_rcu+0x98/0xc0 [ 8703.703786][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8703.703789][ C2] [ 8703.703789][ C2] [ 8703.703791][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8703.703794][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8703.703797][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8703.703799][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8703.703800][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8703.703802][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8703.703803][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8703.703805][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8703.703806][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8703.703809][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8703.703812][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8703.703815][ C2] default_idle_call+0x69/0xa0 [ 8703.703818][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8703.703820][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8703.703823][ C2] ? lock_release+0x1d5/0x250 [ 8703.703826][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8703.703829][ C2] do_idle+0xfb/0x160 [ 8703.703832][ C2] cpu_startup_entry+0x55/0x60 [ 8703.703834][ C2] start_secondary+0x21c/0x2b0 [ 8703.703837][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8703.703841][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8703.703846][ C2] [ 8728.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5938s! [swapper/2:0] [ 8728.569683][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8728.570894][ C2] irq event stamp: 44114564 [ 8728.571114][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8728.571638][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8728.572130][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8728.572590][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8728.573044][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8728.573488][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8728.574077][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8728.574390][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8728.575329][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8728.575625][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8728.576010][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8728.576397][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8728.576781][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8728.577166][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8728.577551][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8728.577981][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8728.578308][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8728.578693][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8728.579076][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8728.579464][ C2] PKRU: 55555554 [ 8728.579637][ C2] Call Trace: [ 8728.579801][ C2] [ 8728.579943][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8728.580196][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8728.580430][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8728.580699][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8728.580962][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8728.581240][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8728.581497][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8728.581790][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8728.582042][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8728.582295][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8728.582594][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8728.582879][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8728.583183][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8728.583461][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8728.583746][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8728.584023][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8728.584325][ C2] ? get_stack_info+0x36/0xc0 [ 8728.584558][ C2] ? lock_acquire+0x1c1/0x220 [ 8728.584791][ C2] ? lock_release+0x1d5/0x250 [ 8728.585021][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8728.585261][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8728.585525][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8728.585800][ C2] ? lock_acquire+0x1c1/0x220 [ 8728.586030][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8728.586262][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8728.586513][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8728.586738][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8728.586976][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8728.587227][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8728.587492][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8728.587768][ C2] ip_local_deliver+0x19d/0x480 [ 8728.588008][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8728.588296][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8728.588558][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8728.588903][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8728.589155][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8728.589481][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8728.589737][ C2] ip_rcv+0x564/0x740 [ 8728.589935][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8728.590159][ C2] ? set_track_prepare+0x8a/0xd0 [ 8728.590404][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8728.590671][ C2] ? start_secondary+0x21c/0x2b0 [ 8728.590913][ C2] ? skb_clone+0x10b/0x330 [ 8728.591134][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8728.591445][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8728.591740][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8728.592013][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8728.592298][ C2] ? __tcf_classify+0x329/0x7d0 [ 8728.592539][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8728.592763][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8728.593053][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8728.593329][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8728.593643][ C2] ? lock_acquire+0x1c1/0x220 [ 8728.593875][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8728.594161][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8728.594439][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8728.594747][ C2] ? __copy_skb_header+0xaf/0x490 [ 8728.594997][ C2] ? __skb_clone+0x57a/0x760 [ 8728.595225][ C2] netif_receive_skb+0x55/0x280 [ 8728.595464][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8728.595767][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8728.596087][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8728.596379][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8728.596643][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8728.596923][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8728.597224][ C2] ? get_stack_info+0x36/0xc0 [ 8728.597459][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8728.597713][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8728.598018][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8728.598310][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8728.598586][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8728.598900][ C2] ? kernel_text_address+0x17/0xe0 [ 8728.599158][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8728.599479][ C2] ? arch_stack_walk+0x8c/0x100 [ 8728.599719][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8728.599974][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8728.600250][ C2] ? lock_acquire+0x1c1/0x220 [ 8728.600482][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8728.600754][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8728.601049][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8728.601316][ C2] ? get_stack_info+0x36/0xc0 [ 8728.601551][ C2] __tcf_classify+0x329/0x7d0 [ 8728.601786][ C2] tcf_classify+0x283/0x930 [ 8728.602010][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8728.602260][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8728.602562][ C2] tc_run+0x2e4/0x5d0 [ 8728.602761][ C2] ? __pfx_tc_run+0x10/0x10 [ 8728.602984][ C2] ? lock_acquire+0x1c1/0x220 [ 8728.603216][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8728.603469][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8728.603714][ C2] ? lock_acquire+0x1c1/0x220 [ 8728.603945][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8728.604201][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8728.604494][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8728.604758][ C2] ? neigh_hh_output+0x348/0x590 [ 8728.605003][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8728.605260][ C2] ip_finish_output2+0x786/0x18e0 [ 8728.605509][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8728.605835][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8728.606101][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8728.606346][ C2] ? __ip_finish_output+0x10f/0x770 [ 8728.606601][ C2] ip_output+0x16b/0x4f0 [ 8728.606815][ C2] ? __pfx_ip_output+0x10/0x10 [ 8728.607050][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8728.607318][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8728.607621][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8728.607887][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8728.608131][ C2] ? __alloc_skb+0xd4/0x280 [ 8728.608380][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8728.608648][ C2] ? tcp_fragment+0x168/0x1040 [ 8728.608890][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8728.609140][ C2] ? ip_local_out+0x114/0x3b0 [ 8728.609390][ C2] __ip_queue_xmit+0x672/0x1910 [ 8728.609629][ C2] ? __skb_clone+0x57a/0x760 [ 8728.609858][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8728.610116][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8728.610387][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8728.610625][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8728.610866][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8728.611157][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8728.611469][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8728.611705][ C2] tcp_send_loss_probe+0x348/0x830 [ 8728.611956][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8728.612216][ C2] tcp_write_timer+0x82/0x1d0 [ 8728.612448][ C2] call_timer_fn+0x173/0x430 [ 8728.612676][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8728.612928][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8728.613181][ C2] __run_timers.part.0+0x52d/0x890 [ 8728.613434][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8728.613696][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8728.613971][ C2] ? lock_acquire+0x1c1/0x220 [ 8728.614204][ C2] ? clockevents_program_event+0xf6/0x300 [ 8728.614484][ C2] ? lock_release+0x1d5/0x250 [ 8728.614715][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8728.614970][ C2] ? ktime_get+0xb3/0x190 [ 8728.615185][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8728.615471][ C2] run_timer_softirq+0x72/0x100 [ 8728.615711][ C2] __do_softirq+0x1b9/0x7ff [ 8728.615937][ C2] irq_exit_rcu+0x98/0xc0 [ 8728.616149][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8728.616425][ C2] [ 8728.616570][ C2] [ 8728.616714][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8728.617009][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8728.617258][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8728.618199][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8728.618520][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8728.618915][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8728.619314][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8728.619712][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8728.620096][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8728.620485][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8728.620765][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8728.621017][ C2] default_idle_call+0x69/0xa0 [ 8728.621255][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8728.621498][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8728.621766][ C2] ? lock_release+0x1d5/0x250 [ 8728.621998][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8728.622263][ C2] do_idle+0xfb/0x160 [ 8728.622459][ C2] cpu_startup_entry+0x55/0x60 [ 8728.622695][ C2] start_secondary+0x21c/0x2b0 [ 8728.622931][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8728.623192][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8728.623493][ C2] [ 8728.623644][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5938s! [perl:4135] [ 8728.624042][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8728.625260][ C1] irq event stamp: 209232 [ 8728.625472][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8728.625984][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8728.626450][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8728.626904][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8728.627352][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8728.627787][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8728.628411][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8728.628734][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8728.629706][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8728.630004][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8728.630392][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8728.630780][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8728.631168][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8728.631557][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8728.631944][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8728.632378][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8728.632700][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8728.633092][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8728.633481][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8728.633868][ C1] PKRU: 55555554 [ 8728.634044][ C1] Call Trace: [ 8728.634211][ C1] [ 8728.634353][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8728.634607][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8728.634842][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8728.635111][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8728.635378][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8728.635657][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8728.635914][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8728.636212][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8728.636466][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8728.636766][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8728.637052][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8728.637358][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8728.637640][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8728.637926][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8728.638228][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8728.638538][ C1] ? get_stack_info+0x36/0xc0 [ 8728.638779][ C1] ? lock_acquire+0x1c1/0x220 [ 8728.639016][ C1] ? lock_release+0x1d5/0x250 [ 8728.639257][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8728.639512][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8728.639776][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8728.640053][ C1] ? lock_acquire+0x1c1/0x220 [ 8728.640284][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8728.640517][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8728.640769][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8728.640997][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8728.641238][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8728.641488][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8728.641754][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8728.642021][ C1] ip_local_deliver+0x19d/0x480 [ 8728.642262][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8728.642525][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8728.642782][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8728.643120][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8728.643367][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8728.643678][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8728.643933][ C1] ip_rcv+0x564/0x740 [ 8728.644134][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8728.644360][ C1] ? set_track_prepare+0x8a/0xd0 [ 8728.644605][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8728.644873][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8728.645136][ C1] ? skb_clone+0x10b/0x330 [ 8728.645358][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8728.645669][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8728.645964][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8728.646241][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8728.646525][ C1] ? __tcf_classify+0x329/0x7d0 [ 8728.646766][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8728.646990][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8728.647282][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8728.647560][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8728.647877][ C1] ? lock_acquire+0x1c1/0x220 [ 8728.648130][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8728.648432][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8728.648719][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8728.649036][ C1] ? __copy_skb_header+0xaf/0x490 [ 8728.649294][ C1] ? __skb_clone+0x57a/0x760 [ 8728.649534][ C1] netif_receive_skb+0x55/0x280 [ 8728.649775][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8728.650078][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8728.650401][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8728.650691][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8728.650957][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8728.651238][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8728.651541][ C1] ? hlock_class+0x4e/0x130 [ 8728.651767][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8728.652034][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8728.652303][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8728.652560][ C1] ? hlock_class+0x4e/0x130 [ 8728.652783][ C1] ? mark_lock+0x38/0x3e0 [ 8728.652997][ C1] ? stack_access_ok+0xda/0x1f0 [ 8728.653239][ C1] ? __lock_acquire+0xb67/0x1610 [ 8728.653485][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8728.653753][ C1] ? get_stack_info+0x36/0xc0 [ 8728.653987][ C1] ? stack_access_ok+0xda/0x1f0 [ 8728.654226][ C1] ? get_reg+0x119/0x190 [ 8728.654437][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8728.654697][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8728.654998][ C1] __tcf_classify+0x329/0x7d0 [ 8728.655234][ C1] tcf_classify+0x283/0x930 [ 8728.655457][ C1] ? arch_stack_walk+0xa2/0x100 [ 8728.655698][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8728.655947][ C1] ? get_stack_info+0x36/0xc0 [ 8728.656182][ C1] tc_run+0x2e4/0x5d0 [ 8728.656381][ C1] ? __pfx_tc_run+0x10/0x10 [ 8728.656607][ C1] ? lock_acquire+0x1c1/0x220 [ 8728.656836][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8728.657091][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8728.657337][ C1] ? lock_acquire+0x1c1/0x220 [ 8728.657569][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8728.657825][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8728.658121][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8728.658411][ C1] ? neigh_hh_output+0x348/0x590 [ 8728.658662][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8728.658925][ C1] ip_finish_output2+0x786/0x18e0 [ 8728.659180][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8728.659467][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8728.659793][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8728.660060][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8728.660307][ C1] ? __ip_finish_output+0x10f/0x770 [ 8728.660563][ C1] ip_output+0x16b/0x4f0 [ 8728.660773][ C1] ? run_timer_softirq+0x72/0x100 [ 8728.661022][ C1] ? __pfx_ip_output+0x10/0x10 [ 8728.661257][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8728.661537][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8728.661781][ C1] ? ip_local_out+0x114/0x3b0 [ 8728.662014][ C1] __ip_queue_xmit+0x672/0x1910 [ 8728.662255][ C1] ? __create_object+0x5e/0xb0 [ 8728.662492][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8728.662749][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8728.663024][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8728.663289][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8728.663561][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8728.663826][ C1] tcp_delack_timer+0x84/0x240 [ 8728.664060][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8728.664327][ C1] call_timer_fn+0x173/0x430 [ 8728.664555][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8728.664810][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8728.665064][ C1] __run_timers.part.0+0x52d/0x890 [ 8728.665318][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8728.665585][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8728.665860][ C1] ? lock_acquire+0x1c1/0x220 [ 8728.666092][ C1] ? clockevents_program_event+0xf6/0x300 [ 8728.666374][ C1] ? lock_release+0x1d5/0x250 [ 8728.666606][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8728.666865][ C1] ? ktime_get+0xb3/0x190 [ 8728.667081][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8728.667368][ C1] run_timer_softirq+0x72/0x100 [ 8728.667609][ C1] __do_softirq+0x1b9/0x7ff [ 8728.667835][ C1] irq_exit_rcu+0x98/0xc0 [ 8728.668047][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8728.668351][ C1] [ 8728.668499][ C1] [ 8728.668650][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8728.668951][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8728.669275][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8728.670232][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8728.670530][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8728.670917][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8728.671305][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8728.671691][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8728.672078][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8728.672468][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8728.672755][ C1] pipe_read+0xa16/0xdf0 [ 8728.672969][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8728.673239][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8728.673479][ C1] ? iterate_tty_write+0x299/0x540 [ 8728.673733][ C1] ? lock_release+0x1d5/0x250 [ 8728.673965][ C1] vfs_read+0x911/0xc00 [ 8728.674175][ C1] ? lock_acquire+0x1c1/0x220 [ 8728.674406][ C1] ? __might_fault+0xc6/0x180 [ 8728.674638][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8728.674871][ C1] ? __might_fault+0xc6/0x180 [ 8728.675105][ C1] ? lock_release+0x1d5/0x250 [ 8728.675337][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8728.675595][ C1] ? __fget_light+0x54/0x1e0 [ 8728.675823][ C1] ksys_read+0x17a/0x1e0 [ 8728.676035][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8728.676273][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8728.676567][ C1] do_syscall_64+0xc9/0x1e0 [ 8728.676794][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8728.677086][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8728.677312][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8728.678276][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8728.678698][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8728.679095][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8728.679501][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8728.679888][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8728.680275][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8728.680664][ C1] [ 8756.569280][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 5964s! [perl:4135] [ 8756.569687][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8756.570905][ C1] irq event stamp: 209232 [ 8756.571119][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8756.571635][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8756.572099][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8756.572558][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8756.573007][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8756.573444][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8756.574042][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8756.574356][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8756.575304][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8756.575602][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8756.575994][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8756.576382][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8756.576769][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8756.577158][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8756.577549][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8756.577984][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8756.578311][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8756.578700][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8756.579089][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8756.579479][ C1] PKRU: 55555554 [ 8756.579656][ C1] Call Trace: [ 8756.579819][ C1] [ 8756.579965][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8756.580221][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8756.580458][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8756.580727][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8756.580992][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8756.581275][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8756.581534][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8756.581831][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8756.582087][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8756.582387][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8756.582676][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8756.582982][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8756.583264][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8756.583549][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8756.583829][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8756.584132][ C1] ? get_stack_info+0x36/0xc0 [ 8756.584367][ C1] ? lock_acquire+0x1c1/0x220 [ 8756.584602][ C1] ? lock_release+0x1d5/0x250 [ 8756.584834][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8756.585075][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8756.585344][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8756.585620][ C1] ? lock_acquire+0x1c1/0x220 [ 8756.585853][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8756.586087][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8756.586342][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8756.586568][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8756.586809][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8756.587058][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8756.587337][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8756.587609][ C1] ip_local_deliver+0x19d/0x480 [ 8756.587849][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8756.588137][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8756.588400][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8756.588744][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8756.588996][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8756.589326][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8756.589580][ C1] ip_rcv+0x564/0x740 [ 8756.589779][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8756.590006][ C1] ? set_track_prepare+0x8a/0xd0 [ 8756.590253][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8756.590522][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8756.590788][ C1] ? skb_clone+0x10b/0x330 [ 8756.591008][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8756.591320][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8756.591618][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8756.591890][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8756.592178][ C1] ? __tcf_classify+0x329/0x7d0 [ 8756.592420][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8756.592643][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8756.592935][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8756.593212][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8756.593527][ C1] ? lock_acquire+0x1c1/0x220 [ 8756.593761][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8756.594050][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8756.594328][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8756.594636][ C1] ? __copy_skb_header+0xaf/0x490 [ 8756.594887][ C1] ? __skb_clone+0x57a/0x760 [ 8756.595116][ C1] netif_receive_skb+0x55/0x280 [ 8756.595359][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8756.595662][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8756.595987][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8756.596277][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8756.596544][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8756.596825][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8756.597130][ C1] ? hlock_class+0x4e/0x130 [ 8756.597355][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8756.597626][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8756.597893][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8756.598186][ C1] ? hlock_class+0x4e/0x130 [ 8756.598417][ C1] ? mark_lock+0x38/0x3e0 [ 8756.598636][ C1] ? stack_access_ok+0xda/0x1f0 [ 8756.598884][ C1] ? __lock_acquire+0xb67/0x1610 [ 8756.599138][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8756.599422][ C1] ? get_stack_info+0x36/0xc0 [ 8756.599655][ C1] ? stack_access_ok+0xda/0x1f0 [ 8756.599895][ C1] ? get_reg+0x119/0x190 [ 8756.600105][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8756.600366][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8756.600666][ C1] __tcf_classify+0x329/0x7d0 [ 8756.600902][ C1] tcf_classify+0x283/0x930 [ 8756.601128][ C1] ? arch_stack_walk+0xa2/0x100 [ 8756.601370][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8756.601622][ C1] ? get_stack_info+0x36/0xc0 [ 8756.601855][ C1] tc_run+0x2e4/0x5d0 [ 8756.602055][ C1] ? __pfx_tc_run+0x10/0x10 [ 8756.602282][ C1] ? lock_acquire+0x1c1/0x220 [ 8756.602515][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8756.602769][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8756.603015][ C1] ? lock_acquire+0x1c1/0x220 [ 8756.603249][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8756.603508][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8756.603804][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8756.604070][ C1] ? neigh_hh_output+0x348/0x590 [ 8756.604320][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8756.604578][ C1] ip_finish_output2+0x786/0x18e0 [ 8756.604828][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8756.605097][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8756.605426][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8756.605696][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8756.605941][ C1] ? __ip_finish_output+0x10f/0x770 [ 8756.606201][ C1] ip_output+0x16b/0x4f0 [ 8756.606411][ C1] ? run_timer_softirq+0x72/0x100 [ 8756.606662][ C1] ? __pfx_ip_output+0x10/0x10 [ 8756.606900][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8756.607178][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8756.607424][ C1] ? ip_local_out+0x114/0x3b0 [ 8756.607658][ C1] __ip_queue_xmit+0x672/0x1910 [ 8756.607900][ C1] ? __create_object+0x5e/0xb0 [ 8756.608160][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8756.608427][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8756.608707][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8756.608979][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8756.609274][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8756.609537][ C1] tcp_delack_timer+0x84/0x240 [ 8756.609775][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8756.610039][ C1] call_timer_fn+0x173/0x430 [ 8756.610270][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8756.610525][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8756.610779][ C1] __run_timers.part.0+0x52d/0x890 [ 8756.611033][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8756.611300][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8756.611578][ C1] ? lock_acquire+0x1c1/0x220 [ 8756.611809][ C1] ? clockevents_program_event+0xf6/0x300 [ 8756.612095][ C1] ? lock_release+0x1d5/0x250 [ 8756.612330][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8756.612587][ C1] ? ktime_get+0xb3/0x190 [ 8756.612800][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8756.613091][ C1] run_timer_softirq+0x72/0x100 [ 8756.613334][ C1] __do_softirq+0x1b9/0x7ff [ 8756.613558][ C1] irq_exit_rcu+0x98/0xc0 [ 8756.613774][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8756.614049][ C1] [ 8756.614197][ C1] [ 8756.614344][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8756.614640][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8756.614956][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8756.615902][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8756.616202][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8756.616589][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8756.616980][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8756.617368][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8756.617758][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8756.618168][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8756.618465][ C1] pipe_read+0xa16/0xdf0 [ 8756.618685][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8756.618960][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8756.619205][ C1] ? iterate_tty_write+0x299/0x540 [ 8756.619472][ C1] ? lock_release+0x1d5/0x250 [ 8756.619705][ C1] vfs_read+0x911/0xc00 [ 8756.619911][ C1] ? lock_acquire+0x1c1/0x220 [ 8756.620144][ C1] ? __might_fault+0xc6/0x180 [ 8756.620381][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8756.620612][ C1] ? __might_fault+0xc6/0x180 [ 8756.620846][ C1] ? lock_release+0x1d5/0x250 [ 8756.621080][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8756.621337][ C1] ? __fget_light+0x54/0x1e0 [ 8756.621569][ C1] ksys_read+0x17a/0x1e0 [ 8756.621779][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8756.622017][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8756.622316][ C1] do_syscall_64+0xc9/0x1e0 [ 8756.622540][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8756.622832][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8756.623054][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8756.624000][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8756.624409][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8756.624801][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8756.625190][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8756.625578][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8756.625965][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8756.626358][ C1] [ 8756.626511][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 5964s! [swapper/2:0] [ 8756.626909][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8756.628139][ C2] irq event stamp: 44114564 [ 8756.628366][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8756.628896][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8756.629412][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8756.629872][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8756.630327][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8756.630767][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8756.631360][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8756.631672][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8756.632612][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8756.632907][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8756.633292][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8756.633678][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8756.634061][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8756.634446][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8756.634831][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8756.635263][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8756.635583][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8756.635969][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8756.636354][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8756.636739][ C2] PKRU: 55555554 [ 8756.636913][ C2] Call Trace: [ 8756.637079][ C2] [ 8756.637222][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8756.637474][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8756.637708][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8756.637977][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8756.638266][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8756.638550][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8756.638813][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8756.639115][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8756.639384][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8756.639636][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8756.639935][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8756.640223][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8756.640526][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8756.640805][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8756.641091][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8756.641390][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8756.641699][ C2] ? get_stack_info+0x36/0xc0 [ 8756.641938][ C2] ? lock_acquire+0x1c1/0x220 [ 8756.642177][ C2] ? lock_release+0x1d5/0x250 [ 8756.642414][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8756.642666][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8756.642931][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8756.643207][ C2] ? lock_acquire+0x1c1/0x220 [ 8756.643439][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8756.643670][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8756.643922][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8756.644147][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8756.644387][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8756.644635][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8756.644900][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8756.645169][ C2] ip_local_deliver+0x19d/0x480 [ 8756.645408][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8756.645671][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8756.645927][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8756.646263][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8756.646507][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8756.646816][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8756.647069][ C2] ip_rcv+0x564/0x740 [ 8756.647266][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8756.647489][ C2] ? set_track_prepare+0x8a/0xd0 [ 8756.647734][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8756.648000][ C2] ? start_secondary+0x21c/0x2b0 [ 8756.648270][ C2] ? skb_clone+0x10b/0x330 [ 8756.648496][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8756.648812][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8756.649115][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8756.649403][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8756.649685][ C2] ? __tcf_classify+0x329/0x7d0 [ 8756.649926][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8756.650150][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8756.650440][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8756.650716][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8756.651030][ C2] ? lock_acquire+0x1c1/0x220 [ 8756.651263][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8756.651548][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8756.651825][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8756.652132][ C2] ? __copy_skb_header+0xaf/0x490 [ 8756.652382][ C2] ? __skb_clone+0x57a/0x760 [ 8756.652608][ C2] netif_receive_skb+0x55/0x280 [ 8756.652847][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8756.653149][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8756.653470][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8756.653760][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8756.654025][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8756.654304][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8756.654604][ C2] ? get_stack_info+0x36/0xc0 [ 8756.654837][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8756.655092][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8756.655398][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8756.655665][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8756.655934][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8756.656240][ C2] ? kernel_text_address+0x17/0xe0 [ 8756.656491][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8756.656793][ C2] ? arch_stack_walk+0x8c/0x100 [ 8756.657032][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8756.657290][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8756.657564][ C2] ? lock_acquire+0x1c1/0x220 [ 8756.657797][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8756.658071][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8756.658392][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8756.658664][ C2] ? get_stack_info+0x36/0xc0 [ 8756.658904][ C2] __tcf_classify+0x329/0x7d0 [ 8756.659145][ C2] tcf_classify+0x283/0x930 [ 8756.659383][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8756.659630][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8756.659933][ C2] tc_run+0x2e4/0x5d0 [ 8756.660131][ C2] ? __pfx_tc_run+0x10/0x10 [ 8756.660356][ C2] ? lock_acquire+0x1c1/0x220 [ 8756.660586][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8756.660838][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8756.661083][ C2] ? lock_acquire+0x1c1/0x220 [ 8756.661314][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8756.661569][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8756.661862][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8756.662126][ C2] ? neigh_hh_output+0x348/0x590 [ 8756.662371][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8756.662626][ C2] ip_finish_output2+0x786/0x18e0 [ 8756.662875][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8756.663202][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8756.663468][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8756.663713][ C2] ? __ip_finish_output+0x10f/0x770 [ 8756.663967][ C2] ip_output+0x16b/0x4f0 [ 8756.664179][ C2] ? __pfx_ip_output+0x10/0x10 [ 8756.664414][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8756.664682][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8756.664983][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8756.665251][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8756.665493][ C2] ? __alloc_skb+0xd4/0x280 [ 8756.665716][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8756.665976][ C2] ? tcp_fragment+0x168/0x1040 [ 8756.666212][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8756.666455][ C2] ? ip_local_out+0x114/0x3b0 [ 8756.666685][ C2] __ip_queue_xmit+0x672/0x1910 [ 8756.666925][ C2] ? __skb_clone+0x57a/0x760 [ 8756.667152][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8756.667411][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8756.667680][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8756.667916][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8756.668179][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8756.668477][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8756.668795][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8756.669037][ C2] tcp_send_loss_probe+0x348/0x830 [ 8756.669297][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8756.669572][ C2] tcp_write_timer+0x82/0x1d0 [ 8756.669803][ C2] call_timer_fn+0x173/0x430 [ 8756.670031][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8756.670285][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8756.670537][ C2] __run_timers.part.0+0x52d/0x890 [ 8756.670788][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8756.671051][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8756.671326][ C2] ? lock_acquire+0x1c1/0x220 [ 8756.671558][ C2] ? clockevents_program_event+0xf6/0x300 [ 8756.671836][ C2] ? lock_release+0x1d5/0x250 [ 8756.672067][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8756.672324][ C2] ? ktime_get+0xb3/0x190 [ 8756.672538][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8756.672824][ C2] run_timer_softirq+0x72/0x100 [ 8756.673063][ C2] __do_softirq+0x1b9/0x7ff [ 8756.673290][ C2] irq_exit_rcu+0x98/0xc0 [ 8756.673501][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8756.673777][ C2] [ 8756.673922][ C2] [ 8756.674066][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8756.674361][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8756.674609][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8756.675544][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8756.675842][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8756.676227][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8756.676611][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8756.676999][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8756.677385][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8756.677769][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8756.678054][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8756.678329][ C2] default_idle_call+0x69/0xa0 [ 8756.678570][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8756.678819][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8756.679094][ C2] ? lock_release+0x1d5/0x250 [ 8756.679343][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8756.679609][ C2] do_idle+0xfb/0x160 [ 8756.679805][ C2] cpu_startup_entry+0x55/0x60 [ 8756.680040][ C2] start_secondary+0x21c/0x2b0 [ 8756.680277][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8756.680536][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8756.680836][ C2] [ 8781.704103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8781.704463][ C1] rcu: 1-....: (6411064 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1543262 [ 8781.705008][ C1] rcu: (t=6426817 jiffies g=1882453 q=721 ncpus=4) [ 8781.705332][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8781.705771][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8781.706369][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8781.706688][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8781.707632][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8781.707933][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8781.708351][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8781.708749][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8781.709147][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8781.709546][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8781.709933][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8781.710368][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8781.710694][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8781.711085][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8781.711475][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8781.711863][ C1] PKRU: 55555554 [ 8781.712040][ C1] Call Trace: [ 8781.712207][ C1] [ 8781.712351][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8781.712615][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8781.712860][ C1] ? check_cpu_stall+0x284/0x500 [ 8781.713105][ C1] ? rcu_pending+0x92/0x360 [ 8781.713331][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8781.713592][ C1] ? update_process_times+0xb9/0x110 [ 8781.713854][ C1] ? tick_sched_handle+0x67/0x130 [ 8781.714103][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8781.714379][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8781.714615][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8781.714918][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8781.715181][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8781.715463][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8781.715721][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8781.716019][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8781.716274][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8781.716574][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8781.716860][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8781.717166][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8781.717448][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8781.717733][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8781.718018][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8781.718322][ C1] ? get_stack_info+0x36/0xc0 [ 8781.718555][ C1] ? lock_acquire+0x1c1/0x220 [ 8781.718789][ C1] ? lock_release+0x1d5/0x250 [ 8781.719023][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8781.719266][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8781.719530][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8781.719805][ C1] ? lock_acquire+0x1c1/0x220 [ 8781.720038][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8781.720274][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8781.720527][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8781.720755][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8781.720994][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8781.721245][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8781.721514][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8781.721782][ C1] ip_local_deliver+0x19d/0x480 [ 8781.722023][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8781.722289][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8781.722546][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8781.722886][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8781.723132][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8781.723445][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8781.723702][ C1] ip_rcv+0x564/0x740 [ 8781.723901][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8781.724128][ C1] ? set_track_prepare+0x8a/0xd0 [ 8781.724377][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8781.724648][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8781.724913][ C1] ? skb_clone+0x10b/0x330 [ 8781.725135][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8781.725446][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8781.725745][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8781.726020][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8781.726308][ C1] ? __tcf_classify+0x329/0x7d0 [ 8781.726552][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8781.726776][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8781.727068][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8781.727348][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8781.727665][ C1] ? lock_acquire+0x1c1/0x220 [ 8781.727896][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8781.728212][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8781.728497][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8781.728814][ C1] ? __copy_skb_header+0xaf/0x490 [ 8781.729072][ C1] ? __skb_clone+0x57a/0x760 [ 8781.729316][ C1] netif_receive_skb+0x55/0x280 [ 8781.729557][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8781.729861][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8781.730186][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8781.730478][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8781.730746][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8781.731026][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8781.731331][ C1] ? hlock_class+0x4e/0x130 [ 8781.731559][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8781.731828][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8781.732096][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8781.732353][ C1] ? hlock_class+0x4e/0x130 [ 8781.732580][ C1] ? mark_lock+0x38/0x3e0 [ 8781.732793][ C1] ? stack_access_ok+0xda/0x1f0 [ 8781.733034][ C1] ? __lock_acquire+0xb67/0x1610 [ 8781.733283][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8781.733553][ C1] ? get_stack_info+0x36/0xc0 [ 8781.733785][ C1] ? stack_access_ok+0xda/0x1f0 [ 8781.734026][ C1] ? get_reg+0x119/0x190 [ 8781.734238][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8781.734499][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8781.734801][ C1] __tcf_classify+0x329/0x7d0 [ 8781.735035][ C1] tcf_classify+0x283/0x930 [ 8781.735263][ C1] ? arch_stack_walk+0xa2/0x100 [ 8781.735506][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8781.735755][ C1] ? get_stack_info+0x36/0xc0 [ 8781.735990][ C1] tc_run+0x2e4/0x5d0 [ 8781.736190][ C1] ? __pfx_tc_run+0x10/0x10 [ 8781.736415][ C1] ? lock_acquire+0x1c1/0x220 [ 8781.736648][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8781.736902][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8781.737148][ C1] ? lock_acquire+0x1c1/0x220 [ 8781.737382][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8781.737640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8781.737941][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8781.738230][ C1] ? neigh_hh_output+0x348/0x590 [ 8781.738483][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8781.738747][ C1] ip_finish_output2+0x786/0x18e0 [ 8781.739002][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8781.739289][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8781.739619][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8781.739888][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8781.740135][ C1] ? __ip_finish_output+0x10f/0x770 [ 8781.740394][ C1] ip_output+0x16b/0x4f0 [ 8781.740603][ C1] ? run_timer_softirq+0x72/0x100 [ 8781.740853][ C1] ? __pfx_ip_output+0x10/0x10 [ 8781.741091][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8781.741372][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8781.741620][ C1] ? ip_local_out+0x114/0x3b0 [ 8781.741854][ C1] __ip_queue_xmit+0x672/0x1910 [ 8781.742096][ C1] ? __create_object+0x5e/0xb0 [ 8781.742335][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8781.742595][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8781.742870][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8781.743138][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8781.743413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8781.743677][ C1] tcp_delack_timer+0x84/0x240 [ 8781.743914][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8781.744179][ C1] call_timer_fn+0x173/0x430 [ 8781.744411][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8781.744667][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8781.744921][ C1] __run_timers.part.0+0x52d/0x890 [ 8781.745174][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8781.745442][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8781.745719][ C1] ? lock_acquire+0x1c1/0x220 [ 8781.745953][ C1] ? clockevents_program_event+0xf6/0x300 [ 8781.746236][ C1] ? lock_release+0x1d5/0x250 [ 8781.746470][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8781.746728][ C1] ? ktime_get+0xb3/0x190 [ 8781.746943][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8781.747233][ C1] run_timer_softirq+0x72/0x100 [ 8781.747475][ C1] __do_softirq+0x1b9/0x7ff [ 8781.747703][ C1] irq_exit_rcu+0x98/0xc0 [ 8781.747917][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8781.748222][ C1] [ 8781.748373][ C1] [ 8781.748522][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8781.748827][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8781.749162][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8781.750107][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8781.750408][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8781.750796][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8781.751185][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8781.751575][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8781.751963][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8781.752353][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8781.752644][ C1] pipe_read+0xa16/0xdf0 [ 8781.752858][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8781.753130][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8781.753387][ C1] ? iterate_tty_write+0x299/0x540 [ 8781.753649][ C1] ? lock_release+0x1d5/0x250 [ 8781.753890][ C1] vfs_read+0x911/0xc00 [ 8781.754104][ C1] ? lock_acquire+0x1c1/0x220 [ 8781.754343][ C1] ? __might_fault+0xc6/0x180 [ 8781.754592][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8781.754826][ C1] ? __might_fault+0xc6/0x180 [ 8781.755058][ C1] ? lock_release+0x1d5/0x250 [ 8781.755292][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8781.755550][ C1] ? __fget_light+0x54/0x1e0 [ 8781.755782][ C1] ksys_read+0x17a/0x1e0 [ 8781.755993][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8781.756233][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8781.756530][ C1] do_syscall_64+0xc9/0x1e0 [ 8781.756757][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8781.757048][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8781.757272][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8781.758247][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8781.758668][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8781.759069][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8781.759470][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8781.759858][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8781.760249][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8781.760641][ C1] [ 8781.760799][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8781.761070][ C2] NMI backtrace for cpu 2 [ 8781.761075][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8781.761081][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8781.761084][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8781.761093][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8781.761098][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8781.761103][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8781.761106][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8781.761110][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8781.761114][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8781.761118][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8781.761121][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8781.761125][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8781.761131][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8781.761134][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8781.761137][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8781.761141][ C2] PKRU: 55555554 [ 8781.761143][ C2] Call Trace: [ 8781.761146][ C2] [ 8781.761149][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8781.761160][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8781.761168][ C2] ? nmi_handle+0x153/0x420 [ 8781.761178][ C2] ? default_do_nmi+0x41/0x100 [ 8781.761184][ C2] ? exc_nmi+0xf3/0x120 [ 8781.761190][ C2] ? end_repeat_nmi+0xf/0x60 [ 8781.761201][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8781.761209][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8781.761217][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8781.761225][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8781.761233][ C2] [ 8781.761235][ C2] [ 8781.761238][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8781.761244][ C2] ? get_stack_info+0x36/0xc0 [ 8781.761252][ C2] ? lock_acquire+0x1c1/0x220 [ 8781.761261][ C2] ? lock_release+0x1d5/0x250 [ 8781.761269][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8781.761277][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8781.761284][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8781.761292][ C2] ? lock_acquire+0x1c1/0x220 [ 8781.761298][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8781.761306][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8781.761313][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8781.761329][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8781.761335][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8781.761346][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8781.761356][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8781.761364][ C2] ip_local_deliver+0x19d/0x480 [ 8781.761370][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8781.761375][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8781.761379][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8781.761384][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8781.761388][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8781.761391][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8781.761399][ C2] ip_rcv+0x564/0x740 [ 8781.761402][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8781.761404][ C2] ? set_track_prepare+0x8a/0xd0 [ 8781.761408][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8781.761411][ C2] ? start_secondary+0x21c/0x2b0 [ 8781.761414][ C2] ? skb_clone+0x10b/0x330 [ 8781.761417][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8781.761422][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8781.761427][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8781.761431][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8781.761439][ C2] ? __tcf_classify+0x329/0x7d0 [ 8781.761442][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8781.761444][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8781.761447][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8781.761450][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8781.761454][ C2] ? lock_acquire+0x1c1/0x220 [ 8781.761456][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8781.761461][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8781.761464][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8781.761468][ C2] ? __copy_skb_header+0xaf/0x490 [ 8781.761472][ C2] ? __skb_clone+0x57a/0x760 [ 8781.761474][ C2] netif_receive_skb+0x55/0x280 [ 8781.761477][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8781.761484][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8781.761490][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8781.761497][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8781.761501][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8781.761511][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8781.761518][ C2] ? get_stack_info+0x36/0xc0 [ 8781.761522][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8781.761525][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8781.761529][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8781.761531][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8781.761535][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8781.761537][ C2] ? kernel_text_address+0x17/0xe0 [ 8781.761540][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8781.761544][ C2] ? arch_stack_walk+0x8c/0x100 [ 8781.761548][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8781.761551][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8781.761554][ C2] ? lock_acquire+0x1c1/0x220 [ 8781.761556][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8781.761560][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8781.761564][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8781.761567][ C2] ? get_stack_info+0x36/0xc0 [ 8781.761571][ C2] __tcf_classify+0x329/0x7d0 [ 8781.761576][ C2] tcf_classify+0x283/0x930 [ 8781.761580][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8781.761583][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8781.761587][ C2] tc_run+0x2e4/0x5d0 [ 8781.761591][ C2] ? __pfx_tc_run+0x10/0x10 [ 8781.761594][ C2] ? lock_acquire+0x1c1/0x220 [ 8781.761596][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8781.761600][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8781.761603][ C2] ? lock_acquire+0x1c1/0x220 [ 8781.761605][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8781.761609][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8781.761611][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8781.761614][ C2] ? neigh_hh_output+0x348/0x590 [ 8781.761617][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8781.761621][ C2] ip_finish_output2+0x786/0x18e0 [ 8781.761624][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8781.761631][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8781.761634][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8781.761638][ C2] ? __ip_finish_output+0x10f/0x770 [ 8781.761641][ C2] ip_output+0x16b/0x4f0 [ 8781.761644][ C2] ? __pfx_ip_output+0x10/0x10 [ 8781.761647][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8781.761649][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8781.761652][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8781.761655][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8781.761658][ C2] ? __alloc_skb+0xd4/0x280 [ 8781.761660][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8781.761664][ C2] ? tcp_fragment+0x168/0x1040 [ 8781.761667][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8781.761670][ C2] ? ip_local_out+0x114/0x3b0 [ 8781.761674][ C2] __ip_queue_xmit+0x672/0x1910 [ 8781.761677][ C2] ? __skb_clone+0x57a/0x760 [ 8781.761680][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8781.761685][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8781.761688][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8781.761692][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8781.761696][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8781.761700][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8781.761703][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8781.761706][ C2] tcp_send_loss_probe+0x348/0x830 [ 8781.761709][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8781.761712][ C2] tcp_write_timer+0x82/0x1d0 [ 8781.761715][ C2] call_timer_fn+0x173/0x430 [ 8781.761718][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8781.761723][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8781.761727][ C2] __run_timers.part.0+0x52d/0x890 [ 8781.761729][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8781.761733][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8781.761736][ C2] ? lock_acquire+0x1c1/0x220 [ 8781.761738][ C2] ? clockevents_program_event+0xf6/0x300 [ 8781.761742][ C2] ? lock_release+0x1d5/0x250 [ 8781.761745][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8781.761748][ C2] ? ktime_get+0xb3/0x190 [ 8781.761751][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8781.761755][ C2] run_timer_softirq+0x72/0x100 [ 8781.761759][ C2] __do_softirq+0x1b9/0x7ff [ 8781.761763][ C2] irq_exit_rcu+0x98/0xc0 [ 8781.761765][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8781.761768][ C2] [ 8781.761769][ C2] [ 8781.761770][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8781.761773][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8781.761776][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8781.761778][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8781.761780][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8781.761781][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8781.761783][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8781.761784][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8781.761786][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8781.761789][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8781.761792][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8781.761795][ C2] default_idle_call+0x69/0xa0 [ 8781.761798][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8781.761800][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8781.761803][ C2] ? lock_release+0x1d5/0x250 [ 8781.761806][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8781.761809][ C2] do_idle+0xfb/0x160 [ 8781.761812][ C2] cpu_startup_entry+0x55/0x60 [ 8781.761814][ C2] start_secondary+0x21c/0x2b0 [ 8781.761817][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8781.761821][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8781.761827][ C2] [ 8808.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6012s! [perl:4135] [ 8808.569682][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8808.570904][ C1] irq event stamp: 209232 [ 8808.571119][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8808.571635][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8808.572097][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8808.572555][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8808.573004][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8808.573441][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8808.574033][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 8808.574348][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 8808.575291][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8808.575589][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8808.575979][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8808.576371][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8808.576759][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8808.577145][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8808.577536][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8808.577995][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8808.578327][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8808.578728][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8808.579133][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8808.579523][ C1] PKRU: 55555554 [ 8808.579699][ C1] Call Trace: [ 8808.579864][ C1] [ 8808.580009][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8808.580267][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8808.580503][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8808.580774][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8808.581039][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8808.581321][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8808.581582][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8808.581879][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8808.582135][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8808.582437][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8808.582726][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8808.583032][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8808.583314][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 8808.583597][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8808.583877][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8808.584180][ C1] ? get_stack_info+0x36/0xc0 [ 8808.584416][ C1] ? lock_acquire+0x1c1/0x220 [ 8808.584651][ C1] ? lock_release+0x1d5/0x250 [ 8808.584883][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8808.585126][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8808.585392][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8808.585670][ C1] ? lock_acquire+0x1c1/0x220 [ 8808.585903][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8808.586135][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8808.586391][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8808.586620][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8808.586861][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8808.587111][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8808.587383][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8808.587654][ C1] ip_local_deliver+0x19d/0x480 [ 8808.587918][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8808.588193][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8808.588457][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8808.588802][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8808.589065][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8808.589376][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8808.589632][ C1] ip_rcv+0x564/0x740 [ 8808.589829][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8808.590055][ C1] ? set_track_prepare+0x8a/0xd0 [ 8808.590303][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8808.590572][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8808.590841][ C1] ? skb_clone+0x10b/0x330 [ 8808.591064][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8808.591376][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8808.591674][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8808.591949][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8808.592237][ C1] ? __tcf_classify+0x329/0x7d0 [ 8808.592479][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8808.592705][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8808.592997][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8808.593276][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8808.593594][ C1] ? lock_acquire+0x1c1/0x220 [ 8808.593827][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8808.594117][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8808.594396][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8808.594722][ C1] ? __copy_skb_header+0xaf/0x490 [ 8808.594980][ C1] ? __skb_clone+0x57a/0x760 [ 8808.595216][ C1] netif_receive_skb+0x55/0x280 [ 8808.595464][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8808.595781][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8808.596119][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8808.596412][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8808.596681][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8808.596963][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8808.597267][ C1] ? hlock_class+0x4e/0x130 [ 8808.597494][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8808.597763][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8808.598081][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8808.598345][ C1] ? hlock_class+0x4e/0x130 [ 8808.598577][ C1] ? mark_lock+0x38/0x3e0 [ 8808.598798][ C1] ? stack_access_ok+0xda/0x1f0 [ 8808.599048][ C1] ? __lock_acquire+0xb67/0x1610 [ 8808.599309][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8808.599578][ C1] ? get_stack_info+0x36/0xc0 [ 8808.599813][ C1] ? stack_access_ok+0xda/0x1f0 [ 8808.600055][ C1] ? get_reg+0x119/0x190 [ 8808.600268][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8808.600529][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8808.600832][ C1] __tcf_classify+0x329/0x7d0 [ 8808.601069][ C1] tcf_classify+0x283/0x930 [ 8808.601296][ C1] ? arch_stack_walk+0xa2/0x100 [ 8808.601538][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8808.601788][ C1] ? get_stack_info+0x36/0xc0 [ 8808.602025][ C1] tc_run+0x2e4/0x5d0 [ 8808.602225][ C1] ? __pfx_tc_run+0x10/0x10 [ 8808.602453][ C1] ? lock_acquire+0x1c1/0x220 [ 8808.602690][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8808.602945][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8808.603193][ C1] ? lock_acquire+0x1c1/0x220 [ 8808.603426][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8808.603686][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8808.603981][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8808.604250][ C1] ? neigh_hh_output+0x348/0x590 [ 8808.604496][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8808.604756][ C1] ip_finish_output2+0x786/0x18e0 [ 8808.605007][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8808.605279][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8808.605608][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8808.605877][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8808.606123][ C1] ? __ip_finish_output+0x10f/0x770 [ 8808.606385][ C1] ip_output+0x16b/0x4f0 [ 8808.606596][ C1] ? run_timer_softirq+0x72/0x100 [ 8808.606847][ C1] ? __pfx_ip_output+0x10/0x10 [ 8808.607086][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8808.607366][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8808.607611][ C1] ? ip_local_out+0x114/0x3b0 [ 8808.607867][ C1] __ip_queue_xmit+0x672/0x1910 [ 8808.608116][ C1] ? __create_object+0x5e/0xb0 [ 8808.608361][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8808.608630][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8808.608912][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8808.609194][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8808.609470][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8808.609736][ C1] tcp_delack_timer+0x84/0x240 [ 8808.609974][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8808.610241][ C1] call_timer_fn+0x173/0x430 [ 8808.610473][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8808.610729][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8808.610985][ C1] __run_timers.part.0+0x52d/0x890 [ 8808.611240][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8808.611507][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8808.611786][ C1] ? lock_acquire+0x1c1/0x220 [ 8808.612018][ C1] ? clockevents_program_event+0xf6/0x300 [ 8808.612305][ C1] ? lock_release+0x1d5/0x250 [ 8808.612542][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8808.612801][ C1] ? ktime_get+0xb3/0x190 [ 8808.613016][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8808.613307][ C1] run_timer_softirq+0x72/0x100 [ 8808.613550][ C1] __do_softirq+0x1b9/0x7ff [ 8808.613776][ C1] irq_exit_rcu+0x98/0xc0 [ 8808.613992][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8808.614272][ C1] [ 8808.614419][ C1] [ 8808.614567][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8808.614864][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8808.615183][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8808.616129][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8808.616432][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8808.616821][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8808.617210][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8808.617598][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8808.618013][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8808.618415][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8808.618712][ C1] pipe_read+0xa16/0xdf0 [ 8808.618934][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8808.619220][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8808.619458][ C1] ? iterate_tty_write+0x299/0x540 [ 8808.619713][ C1] ? lock_release+0x1d5/0x250 [ 8808.619950][ C1] vfs_read+0x911/0xc00 [ 8808.620157][ C1] ? lock_acquire+0x1c1/0x220 [ 8808.620392][ C1] ? __might_fault+0xc6/0x180 [ 8808.620627][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8808.620859][ C1] ? __might_fault+0xc6/0x180 [ 8808.621094][ C1] ? lock_release+0x1d5/0x250 [ 8808.621330][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8808.621588][ C1] ? __fget_light+0x54/0x1e0 [ 8808.621823][ C1] ksys_read+0x17a/0x1e0 [ 8808.622034][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8808.622275][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8808.622573][ C1] do_syscall_64+0xc9/0x1e0 [ 8808.622798][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8808.623092][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8808.623315][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8808.624266][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8808.624677][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8808.625065][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8808.625457][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8808.625846][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8808.626236][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8808.626627][ C1] [ 8808.626783][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6012s! [swapper/2:0] [ 8808.627189][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8808.628435][ C2] irq event stamp: 44114564 [ 8808.628661][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8808.629200][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8808.629695][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8808.630156][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8808.630609][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8808.631049][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8808.631642][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8808.631956][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8808.632895][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8808.633193][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8808.633578][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8808.633962][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8808.634350][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8808.634735][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8808.635120][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8808.635552][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8808.635872][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8808.636263][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8808.636648][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8808.637032][ C2] PKRU: 55555554 [ 8808.637209][ C2] Call Trace: [ 8808.637374][ C2] [ 8808.637515][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8808.637767][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8808.638027][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8808.638301][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8808.638576][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8808.638862][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8808.639133][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8808.639430][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8808.639682][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8808.639937][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8808.640238][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8808.640523][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8808.640826][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8808.641108][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8808.641394][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8808.641673][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8808.641974][ C2] ? get_stack_info+0x36/0xc0 [ 8808.642208][ C2] ? lock_acquire+0x1c1/0x220 [ 8808.642438][ C2] ? lock_release+0x1d5/0x250 [ 8808.642671][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8808.642911][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8808.643175][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8808.643455][ C2] ? lock_acquire+0x1c1/0x220 [ 8808.643685][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8808.643916][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8808.644167][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8808.644396][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8808.644636][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8808.644884][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8808.645150][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8808.645416][ C2] ip_local_deliver+0x19d/0x480 [ 8808.645655][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8808.645917][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8808.646173][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8808.646510][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8808.646753][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8808.647063][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8808.647319][ C2] ip_rcv+0x564/0x740 [ 8808.647516][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8808.647740][ C2] ? set_track_prepare+0x8a/0xd0 [ 8808.648007][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8808.648282][ C2] ? start_secondary+0x21c/0x2b0 [ 8808.648532][ C2] ? skb_clone+0x10b/0x330 [ 8808.648757][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8808.649082][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8808.649381][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8808.649652][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8808.649937][ C2] ? __tcf_classify+0x329/0x7d0 [ 8808.650179][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8808.650402][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8808.650693][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8808.650969][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8808.651285][ C2] ? lock_acquire+0x1c1/0x220 [ 8808.651515][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8808.651802][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8808.652078][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8808.652387][ C2] ? __copy_skb_header+0xaf/0x490 [ 8808.652636][ C2] ? __skb_clone+0x57a/0x760 [ 8808.652863][ C2] netif_receive_skb+0x55/0x280 [ 8808.653103][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8808.653405][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8808.653726][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8808.654016][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8808.654282][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8808.654561][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8808.654862][ C2] ? get_stack_info+0x36/0xc0 [ 8808.655096][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8808.655352][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8808.655659][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8808.655926][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8808.656195][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8808.656500][ C2] ? kernel_text_address+0x17/0xe0 [ 8808.656752][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8808.657055][ C2] ? arch_stack_walk+0x8c/0x100 [ 8808.657297][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8808.657552][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8808.657835][ C2] ? lock_acquire+0x1c1/0x220 [ 8808.658087][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8808.658367][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8808.658670][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8808.658944][ C2] ? get_stack_info+0x36/0xc0 [ 8808.659190][ C2] __tcf_classify+0x329/0x7d0 [ 8808.659423][ C2] tcf_classify+0x283/0x930 [ 8808.659648][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8808.659895][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8808.660198][ C2] tc_run+0x2e4/0x5d0 [ 8808.660397][ C2] ? __pfx_tc_run+0x10/0x10 [ 8808.660621][ C2] ? lock_acquire+0x1c1/0x220 [ 8808.660851][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8808.661104][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8808.661349][ C2] ? lock_acquire+0x1c1/0x220 [ 8808.661579][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8808.661834][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8808.662128][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8808.662392][ C2] ? neigh_hh_output+0x348/0x590 [ 8808.662636][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8808.662893][ C2] ip_finish_output2+0x786/0x18e0 [ 8808.663141][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8808.663471][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8808.663738][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8808.663982][ C2] ? __ip_finish_output+0x10f/0x770 [ 8808.664239][ C2] ip_output+0x16b/0x4f0 [ 8808.664447][ C2] ? __pfx_ip_output+0x10/0x10 [ 8808.664683][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8808.664951][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8808.665253][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8808.665523][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8808.665765][ C2] ? __alloc_skb+0xd4/0x280 [ 8808.665986][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8808.666248][ C2] ? tcp_fragment+0x168/0x1040 [ 8808.666483][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8808.666727][ C2] ? ip_local_out+0x114/0x3b0 [ 8808.666962][ C2] __ip_queue_xmit+0x672/0x1910 [ 8808.667204][ C2] ? __skb_clone+0x57a/0x760 [ 8808.667432][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8808.667690][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8808.667986][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8808.668232][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8808.668480][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8808.668777][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8808.669104][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8808.669342][ C2] tcp_send_loss_probe+0x348/0x830 [ 8808.669593][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8808.669853][ C2] tcp_write_timer+0x82/0x1d0 [ 8808.670084][ C2] call_timer_fn+0x173/0x430 [ 8808.670315][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8808.670568][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8808.670820][ C2] __run_timers.part.0+0x52d/0x890 [ 8808.671071][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8808.671330][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8808.671606][ C2] ? lock_acquire+0x1c1/0x220 [ 8808.671836][ C2] ? clockevents_program_event+0xf6/0x300 [ 8808.672117][ C2] ? lock_release+0x1d5/0x250 [ 8808.672350][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8808.672605][ C2] ? ktime_get+0xb3/0x190 [ 8808.672816][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8808.673104][ C2] run_timer_softirq+0x72/0x100 [ 8808.673345][ C2] __do_softirq+0x1b9/0x7ff [ 8808.673568][ C2] irq_exit_rcu+0x98/0xc0 [ 8808.673782][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8808.674057][ C2] [ 8808.674204][ C2] [ 8808.674349][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8808.674643][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8808.674891][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8808.675827][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8808.676125][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8808.676510][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8808.676894][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8808.677280][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8808.677665][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8808.678077][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8808.678364][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8808.678623][ C2] default_idle_call+0x69/0xa0 [ 8808.678864][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8808.679122][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8808.679392][ C2] ? lock_release+0x1d5/0x250 [ 8808.679621][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8808.679887][ C2] do_idle+0xfb/0x160 [ 8808.680085][ C2] cpu_startup_entry+0x55/0x60 [ 8808.680322][ C2] start_secondary+0x21c/0x2b0 [ 8808.680556][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8808.680818][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8808.681117][ C2] [ 8836.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6038s! [swapper/2:0] [ 8836.569675][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8836.570889][ C2] irq event stamp: 44114564 [ 8836.571111][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8836.571628][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8836.572125][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8836.572590][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8836.573044][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8836.573486][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8836.574080][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8836.574397][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8836.575338][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8836.575636][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8836.576021][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8836.576409][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8836.576797][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8836.577185][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8836.577571][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8836.578007][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8836.578329][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8836.578717][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8836.579104][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8836.579490][ C2] PKRU: 55555554 [ 8836.579666][ C2] Call Trace: [ 8836.579832][ C2] [ 8836.579974][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8836.580228][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8836.580465][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8836.580733][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8836.580997][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8836.581278][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8836.581534][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8836.581830][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8836.582083][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8836.582339][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8836.582639][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8836.582924][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8836.583231][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8836.583511][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8836.583796][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8836.584078][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8836.584382][ C2] ? get_stack_info+0x36/0xc0 [ 8836.584614][ C2] ? lock_acquire+0x1c1/0x220 [ 8836.584847][ C2] ? lock_release+0x1d5/0x250 [ 8836.585079][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8836.585322][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8836.585586][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8836.585863][ C2] ? lock_acquire+0x1c1/0x220 [ 8836.586094][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8836.586329][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8836.586580][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8836.586808][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8836.587048][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8836.587301][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8836.587566][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8836.587856][ C2] ip_local_deliver+0x19d/0x480 [ 8836.588101][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8836.588370][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8836.588633][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8836.588988][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8836.589234][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8836.589543][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8836.589796][ C2] ip_rcv+0x564/0x740 [ 8836.589993][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8836.590218][ C2] ? set_track_prepare+0x8a/0xd0 [ 8836.590463][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8836.590731][ C2] ? start_secondary+0x21c/0x2b0 [ 8836.590974][ C2] ? skb_clone+0x10b/0x330 [ 8836.591193][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8836.591502][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8836.591799][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8836.592070][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8836.592359][ C2] ? __tcf_classify+0x329/0x7d0 [ 8836.592600][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8836.592821][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8836.593113][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8836.593390][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8836.593706][ C2] ? lock_acquire+0x1c1/0x220 [ 8836.593936][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8836.594225][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8836.594499][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8836.594806][ C2] ? __copy_skb_header+0xaf/0x490 [ 8836.595055][ C2] ? __skb_clone+0x57a/0x760 [ 8836.595283][ C2] netif_receive_skb+0x55/0x280 [ 8836.595523][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8836.595824][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8836.596145][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8836.596438][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8836.596704][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8836.596982][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8836.597286][ C2] ? get_stack_info+0x36/0xc0 [ 8836.597519][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8836.597799][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8836.598116][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8836.598389][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8836.598663][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8836.598985][ C2] ? kernel_text_address+0x17/0xe0 [ 8836.599237][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8836.599540][ C2] ? arch_stack_walk+0x8c/0x100 [ 8836.599781][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8836.600036][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8836.600315][ C2] ? lock_acquire+0x1c1/0x220 [ 8836.600544][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8836.600819][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8836.601114][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8836.601383][ C2] ? get_stack_info+0x36/0xc0 [ 8836.601617][ C2] __tcf_classify+0x329/0x7d0 [ 8836.601849][ C2] tcf_classify+0x283/0x930 [ 8836.602075][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8836.602324][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8836.602628][ C2] tc_run+0x2e4/0x5d0 [ 8836.602828][ C2] ? __pfx_tc_run+0x10/0x10 [ 8836.603053][ C2] ? lock_acquire+0x1c1/0x220 [ 8836.603283][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8836.603537][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8836.603780][ C2] ? lock_acquire+0x1c1/0x220 [ 8836.604012][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8836.604268][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8836.604562][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8836.604825][ C2] ? neigh_hh_output+0x348/0x590 [ 8836.605070][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8836.605326][ C2] ip_finish_output2+0x786/0x18e0 [ 8836.605575][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8836.605904][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8836.606174][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8836.606424][ C2] ? __ip_finish_output+0x10f/0x770 [ 8836.606681][ C2] ip_output+0x16b/0x4f0 [ 8836.606890][ C2] ? __pfx_ip_output+0x10/0x10 [ 8836.607126][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8836.607394][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8836.607719][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8836.607995][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8836.608247][ C2] ? __alloc_skb+0xd4/0x280 [ 8836.608476][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8836.608741][ C2] ? tcp_fragment+0x168/0x1040 [ 8836.608993][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8836.609238][ C2] ? ip_local_out+0x114/0x3b0 [ 8836.609471][ C2] __ip_queue_xmit+0x672/0x1910 [ 8836.609713][ C2] ? __skb_clone+0x57a/0x760 [ 8836.609939][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8836.610199][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8836.610473][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8836.610711][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8836.610951][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8836.611242][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8836.611552][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8836.611789][ C2] tcp_send_loss_probe+0x348/0x830 [ 8836.612041][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8836.612302][ C2] tcp_write_timer+0x82/0x1d0 [ 8836.612535][ C2] call_timer_fn+0x173/0x430 [ 8836.612764][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8836.613018][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8836.613273][ C2] __run_timers.part.0+0x52d/0x890 [ 8836.613525][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8836.613786][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8836.614063][ C2] ? lock_acquire+0x1c1/0x220 [ 8836.614294][ C2] ? clockevents_program_event+0xf6/0x300 [ 8836.614577][ C2] ? lock_release+0x1d5/0x250 [ 8836.614809][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8836.615065][ C2] ? ktime_get+0xb3/0x190 [ 8836.615279][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8836.615567][ C2] run_timer_softirq+0x72/0x100 [ 8836.615808][ C2] __do_softirq+0x1b9/0x7ff [ 8836.616032][ C2] irq_exit_rcu+0x98/0xc0 [ 8836.616248][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8836.616523][ C2] [ 8836.616669][ C2] [ 8836.616815][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8836.617110][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8836.617360][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8836.618335][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8836.618640][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8836.619044][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8836.619431][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8836.619817][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8836.620207][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8836.620600][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8836.620878][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8836.621131][ C2] default_idle_call+0x69/0xa0 [ 8836.621369][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8836.621612][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8836.621881][ C2] ? lock_release+0x1d5/0x250 [ 8836.622113][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8836.622378][ C2] do_idle+0xfb/0x160 [ 8836.622578][ C2] cpu_startup_entry+0x55/0x60 [ 8836.622813][ C2] start_secondary+0x21c/0x2b0 [ 8836.623048][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8836.623311][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8836.623612][ C2] [ 8836.623767][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6038s! [perl:4135] [ 8836.624168][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8836.625389][ C1] irq event stamp: 209232 [ 8836.625602][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8836.626116][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8836.626582][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8836.627040][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8836.627490][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8836.627953][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8836.628568][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8836.628904][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8836.629850][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8836.630151][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8836.630541][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8836.630930][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8836.631319][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8836.631710][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8836.632099][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8836.632539][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8836.632863][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8836.633254][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8836.633646][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8836.634035][ C1] PKRU: 55555554 [ 8836.634214][ C1] Call Trace: [ 8836.634380][ C1] [ 8836.634525][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8836.634781][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8836.635019][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8836.635289][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8836.635554][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8836.635838][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8836.636097][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8836.636398][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8836.636654][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8836.636953][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8836.637242][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8836.637549][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8836.637855][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8836.638150][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8836.638441][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8836.638753][ C1] ? get_stack_info+0x36/0xc0 [ 8836.639003][ C1] ? lock_acquire+0x1c1/0x220 [ 8836.639239][ C1] ? lock_release+0x1d5/0x250 [ 8836.639475][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8836.639718][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8836.639984][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8836.640262][ C1] ? lock_acquire+0x1c1/0x220 [ 8836.640495][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8836.640730][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8836.640984][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8836.641213][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8836.641454][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8836.641705][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8836.641978][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8836.642250][ C1] ip_local_deliver+0x19d/0x480 [ 8836.642492][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8836.642756][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8836.643014][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8836.643355][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8836.643600][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8836.643912][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8836.644167][ C1] ip_rcv+0x564/0x740 [ 8836.644368][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8836.644592][ C1] ? set_track_prepare+0x8a/0xd0 [ 8836.644838][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8836.645110][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8836.645377][ C1] ? skb_clone+0x10b/0x330 [ 8836.645596][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8836.645907][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8836.646208][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8836.646484][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8836.646771][ C1] ? __tcf_classify+0x329/0x7d0 [ 8836.647014][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8836.647240][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8836.647533][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8836.647836][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8836.648163][ C1] ? lock_acquire+0x1c1/0x220 [ 8836.648400][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8836.648698][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8836.648992][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8836.649302][ C1] ? __copy_skb_header+0xaf/0x490 [ 8836.649553][ C1] ? __skb_clone+0x57a/0x760 [ 8836.649783][ C1] netif_receive_skb+0x55/0x280 [ 8836.650026][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8836.650332][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8836.650657][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8836.650948][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8836.651218][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8836.651498][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8836.651803][ C1] ? hlock_class+0x4e/0x130 [ 8836.652030][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8836.652301][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8836.652570][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8836.652826][ C1] ? hlock_class+0x4e/0x130 [ 8836.653058][ C1] ? mark_lock+0x38/0x3e0 [ 8836.653272][ C1] ? stack_access_ok+0xda/0x1f0 [ 8836.653515][ C1] ? __lock_acquire+0xb67/0x1610 [ 8836.653762][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8836.654032][ C1] ? get_stack_info+0x36/0xc0 [ 8836.654267][ C1] ? stack_access_ok+0xda/0x1f0 [ 8836.654508][ C1] ? get_reg+0x119/0x190 [ 8836.654722][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8836.654987][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8836.655289][ C1] __tcf_classify+0x329/0x7d0 [ 8836.655524][ C1] tcf_classify+0x283/0x930 [ 8836.655751][ C1] ? arch_stack_walk+0xa2/0x100 [ 8836.655993][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8836.656245][ C1] ? get_stack_info+0x36/0xc0 [ 8836.656480][ C1] tc_run+0x2e4/0x5d0 [ 8836.656681][ C1] ? __pfx_tc_run+0x10/0x10 [ 8836.656905][ C1] ? lock_acquire+0x1c1/0x220 [ 8836.657138][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8836.657394][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8836.657641][ C1] ? lock_acquire+0x1c1/0x220 [ 8836.657902][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8836.658167][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8836.658473][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8836.658745][ C1] ? neigh_hh_output+0x348/0x590 [ 8836.659007][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8836.659266][ C1] ip_finish_output2+0x786/0x18e0 [ 8836.659516][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8836.659786][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8836.660116][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8836.660387][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8836.660634][ C1] ? __ip_finish_output+0x10f/0x770 [ 8836.660893][ C1] ip_output+0x16b/0x4f0 [ 8836.661102][ C1] ? run_timer_softirq+0x72/0x100 [ 8836.661354][ C1] ? __pfx_ip_output+0x10/0x10 [ 8836.661591][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8836.661871][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8836.662116][ C1] ? ip_local_out+0x114/0x3b0 [ 8836.662351][ C1] __ip_queue_xmit+0x672/0x1910 [ 8836.662593][ C1] ? __create_object+0x5e/0xb0 [ 8836.662832][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8836.663093][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8836.663367][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8836.663635][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8836.663908][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8836.664173][ C1] tcp_delack_timer+0x84/0x240 [ 8836.664412][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8836.664676][ C1] call_timer_fn+0x173/0x430 [ 8836.664907][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8836.665163][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8836.665419][ C1] __run_timers.part.0+0x52d/0x890 [ 8836.665673][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8836.665940][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8836.666220][ C1] ? lock_acquire+0x1c1/0x220 [ 8836.666454][ C1] ? clockevents_program_event+0xf6/0x300 [ 8836.666736][ C1] ? lock_release+0x1d5/0x250 [ 8836.666969][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8836.667228][ C1] ? ktime_get+0xb3/0x190 [ 8836.667444][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8836.667755][ C1] run_timer_softirq+0x72/0x100 [ 8836.668003][ C1] __do_softirq+0x1b9/0x7ff [ 8836.668238][ C1] irq_exit_rcu+0x98/0xc0 [ 8836.668458][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8836.668744][ C1] [ 8836.668906][ C1] [ 8836.669051][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8836.669350][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8836.669666][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8836.670611][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8836.670912][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8836.671303][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8836.671691][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8836.672082][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8836.672472][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8836.672864][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8836.673154][ C1] pipe_read+0xa16/0xdf0 [ 8836.673369][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8836.673640][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8836.673876][ C1] ? iterate_tty_write+0x299/0x540 [ 8836.674130][ C1] ? lock_release+0x1d5/0x250 [ 8836.674368][ C1] vfs_read+0x911/0xc00 [ 8836.674576][ C1] ? lock_acquire+0x1c1/0x220 [ 8836.674809][ C1] ? __might_fault+0xc6/0x180 [ 8836.675044][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8836.675283][ C1] ? __might_fault+0xc6/0x180 [ 8836.675517][ C1] ? lock_release+0x1d5/0x250 [ 8836.675751][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8836.676007][ C1] ? __fget_light+0x54/0x1e0 [ 8836.676240][ C1] ksys_read+0x17a/0x1e0 [ 8836.676452][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8836.676691][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8836.676989][ C1] do_syscall_64+0xc9/0x1e0 [ 8836.677217][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8836.677508][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8836.677754][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8836.678725][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8836.679153][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8836.679542][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8836.679932][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8836.680320][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8836.680709][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8836.681102][ C1] [ 8859.762109][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8859.762468][ C1] rcu: 1-....: (6488899 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1559448 [ 8859.763016][ C1] rcu: (t=6504875 jiffies g=1882453 q=721 ncpus=4) [ 8859.763344][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8859.763783][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8859.764382][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8859.764701][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8859.765649][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8859.765951][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8859.766343][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8859.766734][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8859.767124][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8859.767518][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8859.767933][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8859.768383][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8859.768718][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8859.769123][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8859.769513][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8859.769901][ C1] PKRU: 55555554 [ 8859.770080][ C1] Call Trace: [ 8859.770248][ C1] [ 8859.770393][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8859.770661][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8859.770908][ C1] ? check_cpu_stall+0x284/0x500 [ 8859.771153][ C1] ? rcu_pending+0x92/0x360 [ 8859.771382][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8859.771645][ C1] ? update_process_times+0xb9/0x110 [ 8859.771912][ C1] ? tick_sched_handle+0x67/0x130 [ 8859.772163][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8859.772445][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8859.772683][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8859.772988][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8859.773256][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8859.773537][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8859.773795][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8859.774095][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8859.774352][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8859.774654][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8859.774943][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8859.775251][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8859.775533][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8859.775822][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8859.776103][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8859.776409][ C1] ? get_stack_info+0x36/0xc0 [ 8859.776645][ C1] ? lock_acquire+0x1c1/0x220 [ 8859.776879][ C1] ? lock_release+0x1d5/0x250 [ 8859.777112][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8859.777356][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8859.777642][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8859.777930][ C1] ? lock_acquire+0x1c1/0x220 [ 8859.778171][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8859.778410][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8859.778671][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8859.778915][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8859.779157][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8859.779409][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8859.779680][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8859.779952][ C1] ip_local_deliver+0x19d/0x480 [ 8859.780194][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8859.780462][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8859.780719][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8859.781058][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8859.781306][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8859.781618][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8859.781877][ C1] ip_rcv+0x564/0x740 [ 8859.782075][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8859.782303][ C1] ? set_track_prepare+0x8a/0xd0 [ 8859.782550][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8859.782820][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8859.783086][ C1] ? skb_clone+0x10b/0x330 [ 8859.783309][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8859.783621][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8859.783919][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8859.784194][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8859.784483][ C1] ? __tcf_classify+0x329/0x7d0 [ 8859.784725][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8859.784949][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8859.785244][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8859.785521][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8859.785838][ C1] ? lock_acquire+0x1c1/0x220 [ 8859.786072][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8859.786363][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8859.786641][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8859.786951][ C1] ? __copy_skb_header+0xaf/0x490 [ 8859.787202][ C1] ? __skb_clone+0x57a/0x760 [ 8859.787433][ C1] netif_receive_skb+0x55/0x280 [ 8859.787699][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8859.788010][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8859.788345][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8859.788644][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8859.788927][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8859.789211][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8859.789517][ C1] ? hlock_class+0x4e/0x130 [ 8859.789743][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8859.790014][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8859.790284][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8859.790541][ C1] ? hlock_class+0x4e/0x130 [ 8859.790768][ C1] ? mark_lock+0x38/0x3e0 [ 8859.790982][ C1] ? stack_access_ok+0xda/0x1f0 [ 8859.791227][ C1] ? __lock_acquire+0xb67/0x1610 [ 8859.791475][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8859.791745][ C1] ? get_stack_info+0x36/0xc0 [ 8859.791979][ C1] ? stack_access_ok+0xda/0x1f0 [ 8859.792222][ C1] ? get_reg+0x119/0x190 [ 8859.792433][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8859.792694][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8859.792996][ C1] __tcf_classify+0x329/0x7d0 [ 8859.793233][ C1] tcf_classify+0x283/0x930 [ 8859.793460][ C1] ? arch_stack_walk+0xa2/0x100 [ 8859.793702][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8859.793953][ C1] ? get_stack_info+0x36/0xc0 [ 8859.794189][ C1] tc_run+0x2e4/0x5d0 [ 8859.794390][ C1] ? __pfx_tc_run+0x10/0x10 [ 8859.794617][ C1] ? lock_acquire+0x1c1/0x220 [ 8859.794851][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8859.795107][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8859.795355][ C1] ? lock_acquire+0x1c1/0x220 [ 8859.795590][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8859.795850][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8859.796145][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8859.796414][ C1] ? neigh_hh_output+0x348/0x590 [ 8859.796660][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8859.796919][ C1] ip_finish_output2+0x786/0x18e0 [ 8859.797169][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8859.797441][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8859.797796][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8859.798073][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8859.798327][ C1] ? __ip_finish_output+0x10f/0x770 [ 8859.798593][ C1] ip_output+0x16b/0x4f0 [ 8859.798821][ C1] ? run_timer_softirq+0x72/0x100 [ 8859.799072][ C1] ? __pfx_ip_output+0x10/0x10 [ 8859.799311][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8859.799589][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8859.799835][ C1] ? ip_local_out+0x114/0x3b0 [ 8859.800070][ C1] __ip_queue_xmit+0x672/0x1910 [ 8859.800315][ C1] ? __create_object+0x5e/0xb0 [ 8859.800553][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8859.800814][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8859.801089][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8859.801355][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8859.801631][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8859.801897][ C1] tcp_delack_timer+0x84/0x240 [ 8859.802137][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8859.802403][ C1] call_timer_fn+0x173/0x430 [ 8859.802634][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8859.802890][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8859.803145][ C1] __run_timers.part.0+0x52d/0x890 [ 8859.803400][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8859.803668][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8859.803948][ C1] ? lock_acquire+0x1c1/0x220 [ 8859.804180][ C1] ? clockevents_program_event+0xf6/0x300 [ 8859.804465][ C1] ? lock_release+0x1d5/0x250 [ 8859.804699][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8859.804957][ C1] ? ktime_get+0xb3/0x190 [ 8859.805173][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8859.805464][ C1] run_timer_softirq+0x72/0x100 [ 8859.805707][ C1] __do_softirq+0x1b9/0x7ff [ 8859.805933][ C1] irq_exit_rcu+0x98/0xc0 [ 8859.806150][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8859.806428][ C1] [ 8859.806575][ C1] [ 8859.806722][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8859.807020][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8859.807338][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8859.808324][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8859.808633][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8859.809037][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8859.809426][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8859.809814][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8859.810207][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8859.810600][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8859.810890][ C1] pipe_read+0xa16/0xdf0 [ 8859.811105][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8859.811376][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8859.811614][ C1] ? iterate_tty_write+0x299/0x540 [ 8859.811870][ C1] ? lock_release+0x1d5/0x250 [ 8859.812106][ C1] vfs_read+0x911/0xc00 [ 8859.812316][ C1] ? lock_acquire+0x1c1/0x220 [ 8859.812550][ C1] ? __might_fault+0xc6/0x180 [ 8859.812785][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8859.813017][ C1] ? __might_fault+0xc6/0x180 [ 8859.813253][ C1] ? lock_release+0x1d5/0x250 [ 8859.813488][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8859.813746][ C1] ? __fget_light+0x54/0x1e0 [ 8859.813979][ C1] ksys_read+0x17a/0x1e0 [ 8859.814191][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8859.814431][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8859.814729][ C1] do_syscall_64+0xc9/0x1e0 [ 8859.814955][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8859.815249][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8859.815471][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8859.816427][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8859.816836][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8859.817227][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8859.817638][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8859.818036][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8859.818435][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8859.818847][ C1] [ 8859.819002][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8859.819272][ C2] NMI backtrace for cpu 2 [ 8859.819277][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8859.819282][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8859.819286][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8859.819295][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8859.819300][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8859.819305][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8859.819308][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8859.819312][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8859.819314][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8859.819316][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8859.819318][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8859.819320][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8859.819323][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8859.819325][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8859.819326][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8859.819328][ C2] PKRU: 55555554 [ 8859.819328][ C2] Call Trace: [ 8859.819330][ C2] [ 8859.819332][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8859.819338][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8859.819342][ C2] ? nmi_handle+0x153/0x420 [ 8859.819346][ C2] ? default_do_nmi+0x41/0x100 [ 8859.819349][ C2] ? exc_nmi+0xf3/0x120 [ 8859.819351][ C2] ? end_repeat_nmi+0xf/0x60 [ 8859.819356][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8859.819359][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8859.819362][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8859.819366][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8859.819369][ C2] [ 8859.819370][ C2] [ 8859.819371][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8859.819374][ C2] ? get_stack_info+0x36/0xc0 [ 8859.819378][ C2] ? lock_acquire+0x1c1/0x220 [ 8859.819381][ C2] ? lock_release+0x1d5/0x250 [ 8859.819384][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8859.819388][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8859.819390][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8859.819393][ C2] ? lock_acquire+0x1c1/0x220 [ 8859.819396][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8859.819399][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8859.819401][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8859.819407][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8859.819410][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8859.819414][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8859.819418][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8859.819422][ C2] ip_local_deliver+0x19d/0x480 [ 8859.819424][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8859.819426][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8859.819428][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8859.819433][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8859.819437][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8859.819440][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8859.819448][ C2] ip_rcv+0x564/0x740 [ 8859.819451][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8859.819454][ C2] ? set_track_prepare+0x8a/0xd0 [ 8859.819457][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8859.819460][ C2] ? start_secondary+0x21c/0x2b0 [ 8859.819464][ C2] ? skb_clone+0x10b/0x330 [ 8859.819467][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8859.819473][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8859.819478][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8859.819481][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8859.819489][ C2] ? __tcf_classify+0x329/0x7d0 [ 8859.819492][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8859.819494][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8859.819497][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8859.819500][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8859.819504][ C2] ? lock_acquire+0x1c1/0x220 [ 8859.819507][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8859.819511][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8859.819514][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8859.819518][ C2] ? __copy_skb_header+0xaf/0x490 [ 8859.819522][ C2] ? __skb_clone+0x57a/0x760 [ 8859.819524][ C2] netif_receive_skb+0x55/0x280 [ 8859.819528][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8859.819534][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8859.819541][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8859.819547][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8859.819552][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8859.819561][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8859.819568][ C2] ? get_stack_info+0x36/0xc0 [ 8859.819572][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8859.819575][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8859.819578][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8859.819580][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8859.819584][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8859.819586][ C2] ? kernel_text_address+0x17/0xe0 [ 8859.819588][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8859.819592][ C2] ? arch_stack_walk+0x8c/0x100 [ 8859.819595][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8859.819598][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8859.819602][ C2] ? lock_acquire+0x1c1/0x220 [ 8859.819604][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8859.819608][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8859.819612][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8859.819614][ C2] ? get_stack_info+0x36/0xc0 [ 8859.819619][ C2] __tcf_classify+0x329/0x7d0 [ 8859.819624][ C2] tcf_classify+0x283/0x930 [ 8859.819628][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8859.819631][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8859.819635][ C2] tc_run+0x2e4/0x5d0 [ 8859.819639][ C2] ? __pfx_tc_run+0x10/0x10 [ 8859.819642][ C2] ? lock_acquire+0x1c1/0x220 [ 8859.819644][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8859.819648][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8859.819652][ C2] ? lock_acquire+0x1c1/0x220 [ 8859.819655][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8859.819658][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8859.819661][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8859.819663][ C2] ? neigh_hh_output+0x348/0x590 [ 8859.819667][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8859.819670][ C2] ip_finish_output2+0x786/0x18e0 [ 8859.819673][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8859.819680][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8859.819683][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8859.819687][ C2] ? __ip_finish_output+0x10f/0x770 [ 8859.819690][ C2] ip_output+0x16b/0x4f0 [ 8859.819693][ C2] ? __pfx_ip_output+0x10/0x10 [ 8859.819696][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8859.819698][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8859.819701][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8859.819705][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8859.819707][ C2] ? __alloc_skb+0xd4/0x280 [ 8859.819710][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8859.819713][ C2] ? tcp_fragment+0x168/0x1040 [ 8859.819716][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8859.819719][ C2] ? ip_local_out+0x114/0x3b0 [ 8859.819722][ C2] __ip_queue_xmit+0x672/0x1910 [ 8859.819726][ C2] ? __skb_clone+0x57a/0x760 [ 8859.819729][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8859.819734][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8859.819737][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8859.819740][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8859.819744][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8859.819748][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8859.819751][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8859.819754][ C2] tcp_send_loss_probe+0x348/0x830 [ 8859.819757][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8859.819760][ C2] tcp_write_timer+0x82/0x1d0 [ 8859.819764][ C2] call_timer_fn+0x173/0x430 [ 8859.819768][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8859.819772][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8859.819776][ C2] __run_timers.part.0+0x52d/0x890 [ 8859.819779][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8859.819783][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8859.819786][ C2] ? lock_acquire+0x1c1/0x220 [ 8859.819789][ C2] ? clockevents_program_event+0xf6/0x300 [ 8859.819793][ C2] ? lock_release+0x1d5/0x250 [ 8859.819795][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8859.819799][ C2] ? ktime_get+0xb3/0x190 [ 8859.819802][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8859.819806][ C2] run_timer_softirq+0x72/0x100 [ 8859.819810][ C2] __do_softirq+0x1b9/0x7ff [ 8859.819814][ C2] irq_exit_rcu+0x98/0xc0 [ 8859.819816][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8859.819819][ C2] [ 8859.819820][ C2] [ 8859.819821][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8859.819825][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8859.819827][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8859.819829][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8859.819831][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8859.819833][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8859.819834][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8859.819835][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8859.819836][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8859.819839][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8859.819842][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8859.819845][ C2] default_idle_call+0x69/0xa0 [ 8859.819848][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8859.819850][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8859.819854][ C2] ? lock_release+0x1d5/0x250 [ 8859.819856][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8859.819860][ C2] do_idle+0xfb/0x160 [ 8859.819862][ C2] cpu_startup_entry+0x55/0x60 [ 8859.819864][ C2] start_secondary+0x21c/0x2b0 [ 8859.819867][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8859.819871][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8859.819876][ C2] [ 8884.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6083s! [swapper/2:0] [ 8884.569684][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8884.570908][ C2] irq event stamp: 44114564 [ 8884.571131][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8884.571651][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8884.572148][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8884.572613][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8884.573067][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8884.573509][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8884.574104][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [ 8884.574379][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [ 8884.575318][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [ 8884.575616][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8884.576001][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8884.576391][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8884.576777][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8884.577164][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8884.577574][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8884.578017][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8884.578350][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8884.578758][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8884.579142][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8884.579531][ C2] PKRU: 55555554 [ 8884.579713][ C2] Call Trace: [ 8884.579879][ C2] [ 8884.580020][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8884.580277][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8884.580512][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8884.580782][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8884.581046][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8884.581325][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8884.581584][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8884.581880][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8884.582132][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8884.582386][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8884.582687][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8884.582975][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8884.583281][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8884.583560][ C2] ? __pfx___kasan_check_read+0x10/0x10 [ 8884.583832][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 8884.584105][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8884.584408][ C2] ? get_stack_info+0x36/0xc0 [ 8884.584640][ C2] ? lock_acquire+0x1c1/0x220 [ 8884.584873][ C2] ? lock_release+0x1d5/0x250 [ 8884.585106][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8884.585349][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8884.585612][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8884.585888][ C2] ? lock_acquire+0x1c1/0x220 [ 8884.586118][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8884.586352][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8884.586603][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8884.586833][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8884.587073][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8884.587327][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8884.587617][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8884.587891][ C2] ip_local_deliver+0x19d/0x480 [ 8884.588139][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8884.588408][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8884.588671][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8884.589022][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8884.589270][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8884.589580][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8884.589835][ C2] ip_rcv+0x564/0x740 [ 8884.590033][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8884.590259][ C2] ? set_track_prepare+0x8a/0xd0 [ 8884.590503][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8884.590773][ C2] ? start_secondary+0x21c/0x2b0 [ 8884.591016][ C2] ? skb_clone+0x10b/0x330 [ 8884.591237][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8884.591547][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8884.591845][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8884.592117][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8884.592406][ C2] ? __tcf_classify+0x329/0x7d0 [ 8884.592648][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8884.592870][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8884.593162][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8884.593439][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8884.593756][ C2] ? lock_acquire+0x1c1/0x220 [ 8884.593985][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8884.594278][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8884.594554][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8884.594862][ C2] ? __copy_skb_header+0xaf/0x490 [ 8884.595112][ C2] ? __skb_clone+0x57a/0x760 [ 8884.595341][ C2] netif_receive_skb+0x55/0x280 [ 8884.595581][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8884.595886][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8884.596209][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8884.596499][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8884.596767][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8884.597045][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8884.597349][ C2] ? get_stack_info+0x36/0xc0 [ 8884.597606][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8884.597868][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8884.598185][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8884.598458][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8884.598744][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8884.599052][ C2] ? kernel_text_address+0x17/0xe0 [ 8884.599305][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8884.599609][ C2] ? arch_stack_walk+0x8c/0x100 [ 8884.599851][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8884.600107][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8884.600385][ C2] ? lock_acquire+0x1c1/0x220 [ 8884.600614][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8884.600891][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8884.601186][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8884.601457][ C2] ? get_stack_info+0x36/0xc0 [ 8884.601691][ C2] __tcf_classify+0x329/0x7d0 [ 8884.601924][ C2] tcf_classify+0x283/0x930 [ 8884.602151][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8884.602401][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8884.602705][ C2] tc_run+0x2e4/0x5d0 [ 8884.602905][ C2] ? __pfx_tc_run+0x10/0x10 [ 8884.603130][ C2] ? lock_acquire+0x1c1/0x220 [ 8884.603360][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8884.603614][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8884.603858][ C2] ? lock_acquire+0x1c1/0x220 [ 8884.604091][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8884.604348][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8884.604643][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8884.604906][ C2] ? neigh_hh_output+0x348/0x590 [ 8884.605151][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8884.605407][ C2] ip_finish_output2+0x786/0x18e0 [ 8884.605656][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8884.605985][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8884.606255][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8884.606501][ C2] ? __ip_finish_output+0x10f/0x770 [ 8884.606757][ C2] ip_output+0x16b/0x4f0 [ 8884.606967][ C2] ? __pfx_ip_output+0x10/0x10 [ 8884.607205][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8884.607472][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8884.607804][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8884.608081][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8884.608332][ C2] ? __alloc_skb+0xd4/0x280 [ 8884.608560][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8884.608835][ C2] ? tcp_fragment+0x168/0x1040 [ 8884.609073][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8884.609318][ C2] ? ip_local_out+0x114/0x3b0 [ 8884.609552][ C2] __ip_queue_xmit+0x672/0x1910 [ 8884.609794][ C2] ? __skb_clone+0x57a/0x760 [ 8884.610021][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8884.610283][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8884.610556][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8884.610794][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8884.611036][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8884.611327][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8884.611639][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8884.611877][ C2] tcp_send_loss_probe+0x348/0x830 [ 8884.612129][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8884.612389][ C2] tcp_write_timer+0x82/0x1d0 [ 8884.612623][ C2] call_timer_fn+0x173/0x430 [ 8884.612853][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8884.613109][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8884.613363][ C2] __run_timers.part.0+0x52d/0x890 [ 8884.613616][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8884.613877][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8884.614155][ C2] ? lock_acquire+0x1c1/0x220 [ 8884.614387][ C2] ? clockevents_program_event+0xf6/0x300 [ 8884.614670][ C2] ? lock_release+0x1d5/0x250 [ 8884.614903][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8884.615159][ C2] ? ktime_get+0xb3/0x190 [ 8884.615373][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8884.615662][ C2] run_timer_softirq+0x72/0x100 [ 8884.615903][ C2] __do_softirq+0x1b9/0x7ff [ 8884.616127][ C2] irq_exit_rcu+0x98/0xc0 [ 8884.616343][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8884.616618][ C2] [ 8884.616765][ C2] [ 8884.616911][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8884.617208][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8884.617457][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8884.618439][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8884.618754][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8884.619140][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8884.619525][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8884.619911][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8884.620302][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8884.620692][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8884.620971][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8884.621226][ C2] default_idle_call+0x69/0xa0 [ 8884.621463][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8884.621707][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8884.621978][ C2] ? lock_release+0x1d5/0x250 [ 8884.622210][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8884.622476][ C2] do_idle+0xfb/0x160 [ 8884.622675][ C2] cpu_startup_entry+0x55/0x60 [ 8884.622910][ C2] start_secondary+0x21c/0x2b0 [ 8884.623145][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8884.623408][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8884.623709][ C2] [ 8884.623864][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6083s! [perl:4135] [ 8884.624270][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8884.625497][ C1] irq event stamp: 209232 [ 8884.625710][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8884.626231][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8884.626696][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8884.627155][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8884.627631][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8884.628080][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8884.628706][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 8884.628982][ C1] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 8884.629932][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 8884.630234][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8884.630626][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8884.631016][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8884.631405][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8884.631796][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8884.632188][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8884.632627][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8884.632951][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8884.633343][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8884.633735][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8884.634126][ C1] PKRU: 55555554 [ 8884.634306][ C1] Call Trace: [ 8884.634471][ C1] [ 8884.634619][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8884.634876][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8884.635113][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8884.635386][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8884.635654][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8884.635937][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8884.636197][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8884.636497][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8884.636753][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8884.637053][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8884.637345][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8884.637679][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8884.637967][ C1] ? __kasan_check_read+0x8/0x20 [ 8884.638222][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 8884.638507][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8884.638829][ C1] ? get_stack_info+0x36/0xc0 [ 8884.639061][ C1] ? lock_acquire+0x1c1/0x220 [ 8884.639299][ C1] ? lock_release+0x1d5/0x250 [ 8884.639534][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8884.639778][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8884.640043][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8884.640322][ C1] ? lock_acquire+0x1c1/0x220 [ 8884.640556][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8884.640792][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8884.641046][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8884.641277][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8884.641518][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8884.641770][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8884.642039][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8884.642310][ C1] ip_local_deliver+0x19d/0x480 [ 8884.642552][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8884.642817][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8884.643073][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8884.643413][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8884.643660][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8884.643972][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8884.644230][ C1] ip_rcv+0x564/0x740 [ 8884.644429][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8884.644653][ C1] ? set_track_prepare+0x8a/0xd0 [ 8884.644899][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8884.645172][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8884.645438][ C1] ? skb_clone+0x10b/0x330 [ 8884.645659][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8884.645969][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8884.646271][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8884.646545][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8884.646832][ C1] ? __tcf_classify+0x329/0x7d0 [ 8884.647076][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8884.647301][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8884.647617][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8884.647903][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8884.648231][ C1] ? lock_acquire+0x1c1/0x220 [ 8884.648470][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8884.648775][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8884.649053][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8884.649364][ C1] ? __copy_skb_header+0xaf/0x490 [ 8884.649615][ C1] ? __skb_clone+0x57a/0x760 [ 8884.649844][ C1] netif_receive_skb+0x55/0x280 [ 8884.650086][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8884.650393][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8884.650718][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8884.651014][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8884.651283][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8884.651563][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8884.651869][ C1] ? hlock_class+0x4e/0x130 [ 8884.652099][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8884.652371][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8884.652643][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8884.652903][ C1] ? hlock_class+0x4e/0x130 [ 8884.653130][ C1] ? mark_lock+0x38/0x3e0 [ 8884.653346][ C1] ? stack_access_ok+0xda/0x1f0 [ 8884.653588][ C1] ? __lock_acquire+0xb67/0x1610 [ 8884.653836][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8884.654107][ C1] ? get_stack_info+0x36/0xc0 [ 8884.654341][ C1] ? stack_access_ok+0xda/0x1f0 [ 8884.654581][ C1] ? get_reg+0x119/0x190 [ 8884.654796][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8884.655059][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8884.655362][ C1] __tcf_classify+0x329/0x7d0 [ 8884.655597][ C1] tcf_classify+0x283/0x930 [ 8884.655824][ C1] ? arch_stack_walk+0xa2/0x100 [ 8884.656066][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8884.656320][ C1] ? get_stack_info+0x36/0xc0 [ 8884.656559][ C1] tc_run+0x2e4/0x5d0 [ 8884.656759][ C1] ? __pfx_tc_run+0x10/0x10 [ 8884.656982][ C1] ? lock_acquire+0x1c1/0x220 [ 8884.657218][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8884.657498][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8884.657752][ C1] ? lock_acquire+0x1c1/0x220 [ 8884.657991][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8884.658259][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8884.658565][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8884.658845][ C1] ? neigh_hh_output+0x348/0x590 [ 8884.659091][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8884.659350][ C1] ip_finish_output2+0x786/0x18e0 [ 8884.659600][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8884.659870][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8884.660202][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8884.660472][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8884.660720][ C1] ? __ip_finish_output+0x10f/0x770 [ 8884.660977][ C1] ip_output+0x16b/0x4f0 [ 8884.661188][ C1] ? run_timer_softirq+0x72/0x100 [ 8884.661439][ C1] ? __pfx_ip_output+0x10/0x10 [ 8884.661677][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8884.661958][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8884.662204][ C1] ? ip_local_out+0x114/0x3b0 [ 8884.662438][ C1] __ip_queue_xmit+0x672/0x1910 [ 8884.662680][ C1] ? __create_object+0x5e/0xb0 [ 8884.662918][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8884.663179][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8884.663454][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8884.663721][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8884.663994][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8884.664260][ C1] tcp_delack_timer+0x84/0x240 [ 8884.664499][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8884.664762][ C1] call_timer_fn+0x173/0x430 [ 8884.664994][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8884.665250][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8884.665505][ C1] __run_timers.part.0+0x52d/0x890 [ 8884.665758][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8884.666025][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8884.666305][ C1] ? lock_acquire+0x1c1/0x220 [ 8884.666539][ C1] ? clockevents_program_event+0xf6/0x300 [ 8884.666821][ C1] ? lock_release+0x1d5/0x250 [ 8884.667055][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8884.667314][ C1] ? ktime_get+0xb3/0x190 [ 8884.667552][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8884.667850][ C1] run_timer_softirq+0x72/0x100 [ 8884.668099][ C1] __do_softirq+0x1b9/0x7ff [ 8884.668334][ C1] irq_exit_rcu+0x98/0xc0 [ 8884.668554][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8884.668840][ C1] [ 8884.668991][ C1] [ 8884.669141][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8884.669449][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8884.669774][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8884.670752][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8884.671053][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8884.671442][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8884.671833][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8884.672223][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8884.672611][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8884.673000][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8884.673292][ C1] pipe_read+0xa16/0xdf0 [ 8884.673506][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8884.673778][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8884.674014][ C1] ? iterate_tty_write+0x299/0x540 [ 8884.674272][ C1] ? lock_release+0x1d5/0x250 [ 8884.674507][ C1] vfs_read+0x911/0xc00 [ 8884.674715][ C1] ? lock_acquire+0x1c1/0x220 [ 8884.674947][ C1] ? __might_fault+0xc6/0x180 [ 8884.675183][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8884.675419][ C1] ? __might_fault+0xc6/0x180 [ 8884.675653][ C1] ? lock_release+0x1d5/0x250 [ 8884.675885][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8884.676144][ C1] ? __fget_light+0x54/0x1e0 [ 8884.676377][ C1] ksys_read+0x17a/0x1e0 [ 8884.676589][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8884.676826][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8884.677124][ C1] do_syscall_64+0xc9/0x1e0 [ 8884.677352][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8884.677668][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8884.677897][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8884.678875][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8884.679287][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8884.679676][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8884.680065][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8884.680453][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8884.680843][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8884.681237][ C1] [ 8912.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6109s! [perl:4135] [ 8912.569686][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8912.570907][ C1] irq event stamp: 209232 [ 8912.571120][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8912.571639][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8912.572102][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8912.572559][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8912.573011][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8912.573448][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8912.574044][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8912.574361][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8912.575307][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8912.575608][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8912.575995][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8912.576388][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8912.576778][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8912.577168][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8912.577582][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8912.578030][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8912.578365][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8912.578772][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8912.579159][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8912.579549][ C1] PKRU: 55555554 [ 8912.579725][ C1] Call Trace: [ 8912.579892][ C1] [ 8912.580035][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8912.580292][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8912.580531][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8912.580802][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8912.581068][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8912.581350][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8912.581608][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8912.581907][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8912.582163][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8912.582465][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8912.582753][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8912.583063][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8912.583345][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8912.583633][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8912.583914][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8912.584219][ C1] ? get_stack_info+0x36/0xc0 [ 8912.584454][ C1] ? lock_acquire+0x1c1/0x220 [ 8912.584688][ C1] ? lock_release+0x1d5/0x250 [ 8912.584921][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8912.585164][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8912.585430][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8912.585711][ C1] ? lock_acquire+0x1c1/0x220 [ 8912.585944][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8912.586177][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8912.586431][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8912.586661][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8912.586902][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8912.587153][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8912.587447][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8912.587725][ C1] ip_local_deliver+0x19d/0x480 [ 8912.587973][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8912.588248][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8912.588512][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8912.588864][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8912.589111][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8912.589424][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8912.589681][ C1] ip_rcv+0x564/0x740 [ 8912.589879][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8912.590105][ C1] ? set_track_prepare+0x8a/0xd0 [ 8912.590353][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8912.590623][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8912.590887][ C1] ? skb_clone+0x10b/0x330 [ 8912.591111][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8912.591423][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8912.591721][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8912.591996][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8912.592285][ C1] ? __tcf_classify+0x329/0x7d0 [ 8912.592527][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8912.592753][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8912.593047][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8912.593324][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8912.593642][ C1] ? lock_acquire+0x1c1/0x220 [ 8912.593875][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8912.594164][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8912.594444][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8912.594753][ C1] ? __copy_skb_header+0xaf/0x490 [ 8912.595005][ C1] ? __skb_clone+0x57a/0x760 [ 8912.595235][ C1] netif_receive_skb+0x55/0x280 [ 8912.595476][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8912.595780][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8912.596103][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8912.596397][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8912.596663][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8912.596947][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8912.597253][ C1] ? hlock_class+0x4e/0x130 [ 8912.597515][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8912.597791][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8912.598071][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8912.598336][ C1] ? hlock_class+0x4e/0x130 [ 8912.598567][ C1] ? mark_lock+0x38/0x3e0 [ 8912.598795][ C1] ? stack_access_ok+0xda/0x1f0 [ 8912.599039][ C1] ? __lock_acquire+0xb67/0x1610 [ 8912.599289][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8912.599559][ C1] ? get_stack_info+0x36/0xc0 [ 8912.599794][ C1] ? stack_access_ok+0xda/0x1f0 [ 8912.600036][ C1] ? get_reg+0x119/0x190 [ 8912.600248][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8912.600509][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8912.600812][ C1] __tcf_classify+0x329/0x7d0 [ 8912.601049][ C1] tcf_classify+0x283/0x930 [ 8912.601274][ C1] ? arch_stack_walk+0xa2/0x100 [ 8912.601519][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8912.601770][ C1] ? get_stack_info+0x36/0xc0 [ 8912.602006][ C1] tc_run+0x2e4/0x5d0 [ 8912.602207][ C1] ? __pfx_tc_run+0x10/0x10 [ 8912.602435][ C1] ? lock_acquire+0x1c1/0x220 [ 8912.602669][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8912.602924][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8912.603172][ C1] ? lock_acquire+0x1c1/0x220 [ 8912.603405][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8912.603664][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8912.603963][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8912.604230][ C1] ? neigh_hh_output+0x348/0x590 [ 8912.604478][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8912.604738][ C1] ip_finish_output2+0x786/0x18e0 [ 8912.604989][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8912.605263][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8912.605593][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8912.605863][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8912.606111][ C1] ? __ip_finish_output+0x10f/0x770 [ 8912.606371][ C1] ip_output+0x16b/0x4f0 [ 8912.606584][ C1] ? run_timer_softirq+0x72/0x100 [ 8912.606835][ C1] ? __pfx_ip_output+0x10/0x10 [ 8912.607074][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8912.607355][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8912.607629][ C1] ? ip_local_out+0x114/0x3b0 [ 8912.607870][ C1] __ip_queue_xmit+0x672/0x1910 [ 8912.608120][ C1] ? __create_object+0x5e/0xb0 [ 8912.608364][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8912.608633][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8912.608918][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8912.609204][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8912.609481][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8912.609747][ C1] tcp_delack_timer+0x84/0x240 [ 8912.609986][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8912.610254][ C1] call_timer_fn+0x173/0x430 [ 8912.610485][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8912.610742][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8912.610997][ C1] __run_timers.part.0+0x52d/0x890 [ 8912.611253][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8912.611520][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8912.611799][ C1] ? lock_acquire+0x1c1/0x220 [ 8912.612033][ C1] ? clockevents_program_event+0xf6/0x300 [ 8912.612319][ C1] ? lock_release+0x1d5/0x250 [ 8912.612553][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8912.612813][ C1] ? ktime_get+0xb3/0x190 [ 8912.613029][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8912.613321][ C1] run_timer_softirq+0x72/0x100 [ 8912.613563][ C1] __do_softirq+0x1b9/0x7ff [ 8912.613791][ C1] irq_exit_rcu+0x98/0xc0 [ 8912.614007][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8912.614288][ C1] [ 8912.614436][ C1] [ 8912.614586][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8912.614883][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8912.615201][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8912.616158][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8912.616461][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8912.616851][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8912.617242][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8912.617658][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8912.618058][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8912.618464][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8912.618766][ C1] pipe_read+0xa16/0xdf0 [ 8912.618984][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8912.619257][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8912.619496][ C1] ? iterate_tty_write+0x299/0x540 [ 8912.619752][ C1] ? lock_release+0x1d5/0x250 [ 8912.619988][ C1] vfs_read+0x911/0xc00 [ 8912.620198][ C1] ? lock_acquire+0x1c1/0x220 [ 8912.620433][ C1] ? __might_fault+0xc6/0x180 [ 8912.620667][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8912.620901][ C1] ? __might_fault+0xc6/0x180 [ 8912.621138][ C1] ? lock_release+0x1d5/0x250 [ 8912.621374][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8912.621633][ C1] ? __fget_light+0x54/0x1e0 [ 8912.621866][ C1] ksys_read+0x17a/0x1e0 [ 8912.622079][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8912.622321][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8912.622619][ C1] do_syscall_64+0xc9/0x1e0 [ 8912.622846][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8912.623140][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8912.623362][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8912.624315][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8912.624727][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8912.625116][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8912.625509][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8912.625899][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8912.626290][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8912.626682][ C1] [ 8912.626838][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6109s! [swapper/2:0] [ 8912.627246][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8912.628501][ C2] irq event stamp: 44114564 [ 8912.628735][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8912.629252][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8912.629748][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8912.630210][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8912.630665][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8912.631106][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8912.631702][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8912.632016][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8912.632957][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8912.633256][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8912.633643][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8912.634028][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8912.634414][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8912.634801][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8912.635188][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8912.635622][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8912.635943][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8912.636331][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8912.636718][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8912.637104][ C2] PKRU: 55555554 [ 8912.637282][ C2] Call Trace: [ 8912.637467][ C2] [ 8912.637617][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8912.637877][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8912.638118][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8912.638394][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8912.638674][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8912.638954][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8912.639212][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8912.639507][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8912.639761][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8912.640015][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8912.640314][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8912.640602][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8912.640907][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8912.641187][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8912.641475][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8912.641755][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8912.642056][ C2] ? get_stack_info+0x36/0xc0 [ 8912.642290][ C2] ? lock_acquire+0x1c1/0x220 [ 8912.642526][ C2] ? lock_release+0x1d5/0x250 [ 8912.642760][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8912.643001][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8912.643266][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8912.643541][ C2] ? lock_acquire+0x1c1/0x220 [ 8912.643773][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8912.644006][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8912.644260][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8912.644486][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8912.644724][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8912.644973][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8912.645240][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8912.645509][ C2] ip_local_deliver+0x19d/0x480 [ 8912.645749][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8912.646011][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8912.646267][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8912.646603][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8912.646847][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8912.647157][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8912.647436][ C2] ip_rcv+0x564/0x740 [ 8912.647640][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8912.647868][ C2] ? set_track_prepare+0x8a/0xd0 [ 8912.648119][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8912.648396][ C2] ? start_secondary+0x21c/0x2b0 [ 8912.648654][ C2] ? skb_clone+0x10b/0x330 [ 8912.648873][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8912.649183][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8912.649480][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8912.649750][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8912.650037][ C2] ? __tcf_classify+0x329/0x7d0 [ 8912.650278][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8912.650501][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8912.650793][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8912.651068][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8912.651383][ C2] ? lock_acquire+0x1c1/0x220 [ 8912.651615][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8912.651903][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8912.652180][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8912.652487][ C2] ? __copy_skb_header+0xaf/0x490 [ 8912.652737][ C2] ? __skb_clone+0x57a/0x760 [ 8912.652965][ C2] netif_receive_skb+0x55/0x280 [ 8912.653207][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8912.653508][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8912.653832][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8912.654121][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8912.654387][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8912.654667][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8912.654970][ C2] ? get_stack_info+0x36/0xc0 [ 8912.655203][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8912.655461][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8912.655768][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8912.656036][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8912.656305][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8912.656610][ C2] ? kernel_text_address+0x17/0xe0 [ 8912.656861][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8912.657165][ C2] ? arch_stack_walk+0x8c/0x100 [ 8912.657429][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8912.657692][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8912.657974][ C2] ? lock_acquire+0x1c1/0x220 [ 8912.658214][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8912.658494][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8912.658801][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8912.659070][ C2] ? get_stack_info+0x36/0xc0 [ 8912.659304][ C2] __tcf_classify+0x329/0x7d0 [ 8912.659538][ C2] tcf_classify+0x283/0x930 [ 8912.659764][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8912.660012][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8912.660316][ C2] tc_run+0x2e4/0x5d0 [ 8912.660516][ C2] ? __pfx_tc_run+0x10/0x10 [ 8912.660739][ C2] ? lock_acquire+0x1c1/0x220 [ 8912.660971][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8912.661224][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8912.661469][ C2] ? lock_acquire+0x1c1/0x220 [ 8912.661701][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8912.661957][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8912.662253][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8912.662515][ C2] ? neigh_hh_output+0x348/0x590 [ 8912.662760][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8912.663016][ C2] ip_finish_output2+0x786/0x18e0 [ 8912.663266][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8912.663591][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8912.663863][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8912.664108][ C2] ? __ip_finish_output+0x10f/0x770 [ 8912.664366][ C2] ip_output+0x16b/0x4f0 [ 8912.664575][ C2] ? __pfx_ip_output+0x10/0x10 [ 8912.664811][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8912.665078][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8912.665381][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8912.665647][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8912.665891][ C2] ? __alloc_skb+0xd4/0x280 [ 8912.666115][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8912.666378][ C2] ? tcp_fragment+0x168/0x1040 [ 8912.666613][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8912.666858][ C2] ? ip_local_out+0x114/0x3b0 [ 8912.667090][ C2] __ip_queue_xmit+0x672/0x1910 [ 8912.667331][ C2] ? __skb_clone+0x57a/0x760 [ 8912.667584][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8912.667848][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8912.668130][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8912.668372][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8912.668628][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8912.668918][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8912.669230][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8912.669467][ C2] tcp_send_loss_probe+0x348/0x830 [ 8912.669719][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8912.669981][ C2] tcp_write_timer+0x82/0x1d0 [ 8912.670215][ C2] call_timer_fn+0x173/0x430 [ 8912.670443][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8912.670697][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8912.670951][ C2] __run_timers.part.0+0x52d/0x890 [ 8912.671204][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8912.671465][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8912.671739][ C2] ? lock_acquire+0x1c1/0x220 [ 8912.671971][ C2] ? clockevents_program_event+0xf6/0x300 [ 8912.672254][ C2] ? lock_release+0x1d5/0x250 [ 8912.672484][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8912.672741][ C2] ? ktime_get+0xb3/0x190 [ 8912.672955][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8912.673243][ C2] run_timer_softirq+0x72/0x100 [ 8912.673481][ C2] __do_softirq+0x1b9/0x7ff [ 8912.673709][ C2] irq_exit_rcu+0x98/0xc0 [ 8912.673922][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8912.674204][ C2] [ 8912.674348][ C2] [ 8912.674496][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8912.674787][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8912.675034][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8912.675978][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8912.676278][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8912.676666][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8912.677053][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8912.677462][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8912.677855][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8912.678256][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8912.678544][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8912.678807][ C2] default_idle_call+0x69/0xa0 [ 8912.679043][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8912.679288][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8912.679555][ C2] ? lock_release+0x1d5/0x250 [ 8912.679787][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8912.680051][ C2] do_idle+0xfb/0x160 [ 8912.680248][ C2] cpu_startup_entry+0x55/0x60 [ 8912.680485][ C2] start_secondary+0x21c/0x2b0 [ 8912.680720][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8912.680980][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8912.681282][ C2] [ 8937.820103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 8937.820452][ C1] rcu: 1-....: (6566733 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1575702 [ 8937.820997][ C1] rcu: (t=6582933 jiffies g=1882453 q=721 ncpus=4) [ 8937.821322][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8937.821761][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8937.822364][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8937.822680][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8937.823625][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8937.823926][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8937.824315][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8937.824704][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8937.825093][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8937.825482][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8937.825870][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8937.826308][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8937.826631][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8937.827027][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8937.827421][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8937.827809][ C1] PKRU: 55555554 [ 8937.827987][ C1] Call Trace: [ 8937.828153][ C1] [ 8937.828297][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 8937.828562][ C1] ? print_cpu_stall+0x263/0x6a0 [ 8937.828808][ C1] ? check_cpu_stall+0x284/0x500 [ 8937.829054][ C1] ? rcu_pending+0x92/0x360 [ 8937.829281][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 8937.829544][ C1] ? update_process_times+0xb9/0x110 [ 8937.829807][ C1] ? tick_sched_handle+0x67/0x130 [ 8937.830058][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 8937.830338][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8937.830578][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 8937.830883][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8937.831152][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8937.831434][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8937.831692][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8937.831990][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8937.832269][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8937.832579][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8937.832874][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8937.833199][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8937.833484][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8937.833771][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8937.834054][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8937.834360][ C1] ? get_stack_info+0x36/0xc0 [ 8937.834595][ C1] ? lock_acquire+0x1c1/0x220 [ 8937.834828][ C1] ? lock_release+0x1d5/0x250 [ 8937.835062][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8937.835305][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8937.835570][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8937.835849][ C1] ? lock_acquire+0x1c1/0x220 [ 8937.836080][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8937.836316][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8937.836569][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8937.836799][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8937.837040][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8937.837314][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8937.837588][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8937.837865][ C1] ip_local_deliver+0x19d/0x480 [ 8937.838113][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8937.838387][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8937.838657][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8937.838995][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8937.839243][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8937.839555][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8937.839811][ C1] ip_rcv+0x564/0x740 [ 8937.840010][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8937.840236][ C1] ? set_track_prepare+0x8a/0xd0 [ 8937.840482][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8937.840753][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8937.841018][ C1] ? skb_clone+0x10b/0x330 [ 8937.841242][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8937.841554][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8937.841850][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8937.842128][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8937.842416][ C1] ? __tcf_classify+0x329/0x7d0 [ 8937.842658][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8937.842884][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8937.843176][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8937.843455][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8937.843773][ C1] ? lock_acquire+0x1c1/0x220 [ 8937.844006][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8937.844295][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8937.844576][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8937.844886][ C1] ? __copy_skb_header+0xaf/0x490 [ 8937.845136][ C1] ? __skb_clone+0x57a/0x760 [ 8937.845365][ C1] netif_receive_skb+0x55/0x280 [ 8937.845608][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8937.845912][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8937.846237][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8937.846530][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8937.846796][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8937.847078][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8937.847407][ C1] ? hlock_class+0x4e/0x130 [ 8937.847640][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8937.847917][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8937.848193][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8937.848470][ C1] ? hlock_class+0x4e/0x130 [ 8937.848694][ C1] ? mark_lock+0x38/0x3e0 [ 8937.848910][ C1] ? stack_access_ok+0xda/0x1f0 [ 8937.849152][ C1] ? __lock_acquire+0xb67/0x1610 [ 8937.849400][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8937.849671][ C1] ? get_stack_info+0x36/0xc0 [ 8937.849905][ C1] ? stack_access_ok+0xda/0x1f0 [ 8937.850145][ C1] ? get_reg+0x119/0x190 [ 8937.850358][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8937.850620][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8937.850922][ C1] __tcf_classify+0x329/0x7d0 [ 8937.851158][ C1] tcf_classify+0x283/0x930 [ 8937.851384][ C1] ? arch_stack_walk+0xa2/0x100 [ 8937.851627][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8937.851877][ C1] ? get_stack_info+0x36/0xc0 [ 8937.852113][ C1] tc_run+0x2e4/0x5d0 [ 8937.852314][ C1] ? __pfx_tc_run+0x10/0x10 [ 8937.852540][ C1] ? lock_acquire+0x1c1/0x220 [ 8937.852771][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8937.853027][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8937.853273][ C1] ? lock_acquire+0x1c1/0x220 [ 8937.853508][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8937.853765][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8937.854064][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8937.854330][ C1] ? neigh_hh_output+0x348/0x590 [ 8937.854577][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8937.854835][ C1] ip_finish_output2+0x786/0x18e0 [ 8937.855085][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8937.855358][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8937.855689][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8937.855958][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8937.856205][ C1] ? __ip_finish_output+0x10f/0x770 [ 8937.856463][ C1] ip_output+0x16b/0x4f0 [ 8937.856675][ C1] ? run_timer_softirq+0x72/0x100 [ 8937.856925][ C1] ? __pfx_ip_output+0x10/0x10 [ 8937.857160][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8937.857467][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8937.857719][ C1] ? ip_local_out+0x114/0x3b0 [ 8937.857959][ C1] __ip_queue_xmit+0x672/0x1910 [ 8937.858207][ C1] ? __create_object+0x5e/0xb0 [ 8937.858463][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8937.858722][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8937.858999][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8937.859265][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8937.859539][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8937.859806][ C1] tcp_delack_timer+0x84/0x240 [ 8937.860042][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8937.860311][ C1] call_timer_fn+0x173/0x430 [ 8937.860539][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8937.860794][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8937.861050][ C1] __run_timers.part.0+0x52d/0x890 [ 8937.861305][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8937.861572][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8937.861849][ C1] ? lock_acquire+0x1c1/0x220 [ 8937.862083][ C1] ? clockevents_program_event+0xf6/0x300 [ 8937.862367][ C1] ? lock_release+0x1d5/0x250 [ 8937.862599][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8937.862857][ C1] ? ktime_get+0xb3/0x190 [ 8937.863074][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8937.863362][ C1] run_timer_softirq+0x72/0x100 [ 8937.863604][ C1] __do_softirq+0x1b9/0x7ff [ 8937.863832][ C1] irq_exit_rcu+0x98/0xc0 [ 8937.864045][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8937.864327][ C1] [ 8937.864472][ C1] [ 8937.864619][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8937.864915][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8937.865232][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8937.866178][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8937.866478][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8937.866868][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8937.867281][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8937.867679][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8937.868076][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8937.868488][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8937.868777][ C1] pipe_read+0xa16/0xdf0 [ 8937.868992][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8937.869262][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8937.869500][ C1] ? iterate_tty_write+0x299/0x540 [ 8937.869755][ C1] ? lock_release+0x1d5/0x250 [ 8937.869988][ C1] vfs_read+0x911/0xc00 [ 8937.870197][ C1] ? lock_acquire+0x1c1/0x220 [ 8937.870429][ C1] ? __might_fault+0xc6/0x180 [ 8937.870663][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8937.870897][ C1] ? __might_fault+0xc6/0x180 [ 8937.871132][ C1] ? lock_release+0x1d5/0x250 [ 8937.871367][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8937.871626][ C1] ? __fget_light+0x54/0x1e0 [ 8937.871855][ C1] ksys_read+0x17a/0x1e0 [ 8937.872069][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8937.872309][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8937.872606][ C1] do_syscall_64+0xc9/0x1e0 [ 8937.872834][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8937.873125][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8937.873347][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8937.874294][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8937.874723][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8937.875124][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8937.875523][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8937.875923][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8937.876323][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8937.876713][ C1] [ 8937.876867][ C1] Sending NMI from CPU 1 to CPUs 2: [ 8937.877132][ C2] NMI backtrace for cpu 2 [ 8937.877137][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8937.877142][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8937.877146][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8937.877154][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8937.877160][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8937.877164][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8937.877167][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8937.877169][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8937.877170][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8937.877172][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8937.877173][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8937.877175][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8937.877178][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8937.877180][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8937.877181][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8937.877182][ C2] PKRU: 55555554 [ 8937.877183][ C2] Call Trace: [ 8937.877185][ C2] [ 8937.877186][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 8937.877192][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 8937.877197][ C2] ? nmi_handle+0x153/0x420 [ 8937.877201][ C2] ? default_do_nmi+0x41/0x100 [ 8937.877204][ C2] ? exc_nmi+0xf3/0x120 [ 8937.877207][ C2] ? end_repeat_nmi+0xf/0x60 [ 8937.877212][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8937.877215][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8937.877218][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8937.877221][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8937.877224][ C2] [ 8937.877229][ C2] [ 8937.877231][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8937.877233][ C2] ? get_stack_info+0x36/0xc0 [ 8937.877237][ C2] ? lock_acquire+0x1c1/0x220 [ 8937.877240][ C2] ? lock_release+0x1d5/0x250 [ 8937.877243][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8937.877247][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8937.877250][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8937.877269][ C2] ? lock_acquire+0x1c1/0x220 [ 8937.877271][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8937.877275][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8937.877278][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8937.877284][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8937.877287][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8937.877292][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8937.877296][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8937.877299][ C2] ip_local_deliver+0x19d/0x480 [ 8937.877302][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8937.877304][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8937.877307][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8937.877312][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8937.877316][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8937.877319][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8937.877328][ C2] ip_rcv+0x564/0x740 [ 8937.877330][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8937.877333][ C2] ? set_track_prepare+0x8a/0xd0 [ 8937.877336][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8937.877340][ C2] ? start_secondary+0x21c/0x2b0 [ 8937.877343][ C2] ? skb_clone+0x10b/0x330 [ 8937.877346][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8937.877352][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8937.877358][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8937.877361][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8937.877369][ C2] ? __tcf_classify+0x329/0x7d0 [ 8937.877373][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8937.877375][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8937.877379][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8937.877382][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8937.877387][ C2] ? lock_acquire+0x1c1/0x220 [ 8937.877389][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8937.877393][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8937.877397][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8937.877401][ C2] ? __copy_skb_header+0xaf/0x490 [ 8937.877406][ C2] ? __skb_clone+0x57a/0x760 [ 8937.877409][ C2] netif_receive_skb+0x55/0x280 [ 8937.877412][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8937.877419][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8937.877426][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8937.877432][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8937.877437][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8937.877446][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8937.877454][ C2] ? get_stack_info+0x36/0xc0 [ 8937.877458][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8937.877461][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8937.877465][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8937.877467][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8937.877471][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8937.877474][ C2] ? kernel_text_address+0x17/0xe0 [ 8937.877477][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8937.877481][ C2] ? arch_stack_walk+0x8c/0x100 [ 8937.877484][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8937.877488][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8937.877491][ C2] ? lock_acquire+0x1c1/0x220 [ 8937.877493][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8937.877498][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8937.877502][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8937.877504][ C2] ? get_stack_info+0x36/0xc0 [ 8937.877509][ C2] __tcf_classify+0x329/0x7d0 [ 8937.877514][ C2] tcf_classify+0x283/0x930 [ 8937.877518][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8937.877521][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8937.877526][ C2] tc_run+0x2e4/0x5d0 [ 8937.877529][ C2] ? __pfx_tc_run+0x10/0x10 [ 8937.877532][ C2] ? lock_acquire+0x1c1/0x220 [ 8937.877535][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8937.877539][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8937.877544][ C2] ? lock_acquire+0x1c1/0x220 [ 8937.877546][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8937.877549][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8937.877552][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8937.877555][ C2] ? neigh_hh_output+0x348/0x590 [ 8937.877559][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8937.877562][ C2] ip_finish_output2+0x786/0x18e0 [ 8937.877566][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8937.877573][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8937.877576][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8937.877579][ C2] ? __ip_finish_output+0x10f/0x770 [ 8937.877584][ C2] ip_output+0x16b/0x4f0 [ 8937.877587][ C2] ? __pfx_ip_output+0x10/0x10 [ 8937.877589][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8937.877592][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8937.877596][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8937.877599][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8937.877602][ C2] ? __alloc_skb+0xd4/0x280 [ 8937.877604][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8937.877608][ C2] ? tcp_fragment+0x168/0x1040 [ 8937.877611][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8937.877613][ C2] ? ip_local_out+0x114/0x3b0 [ 8937.877617][ C2] __ip_queue_xmit+0x672/0x1910 [ 8937.877620][ C2] ? __skb_clone+0x57a/0x760 [ 8937.877623][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8937.877628][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8937.877631][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8937.877635][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8937.877639][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8937.877643][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8937.877647][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8937.877650][ C2] tcp_send_loss_probe+0x348/0x830 [ 8937.877653][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8937.877656][ C2] tcp_write_timer+0x82/0x1d0 [ 8937.877659][ C2] call_timer_fn+0x173/0x430 [ 8937.877663][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8937.877667][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8937.877671][ C2] __run_timers.part.0+0x52d/0x890 [ 8937.877674][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8937.877678][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8937.877681][ C2] ? lock_acquire+0x1c1/0x220 [ 8937.877683][ C2] ? clockevents_program_event+0xf6/0x300 [ 8937.877687][ C2] ? lock_release+0x1d5/0x250 [ 8937.877690][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8937.877693][ C2] ? ktime_get+0xb3/0x190 [ 8937.877696][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8937.877701][ C2] run_timer_softirq+0x72/0x100 [ 8937.877705][ C2] __do_softirq+0x1b9/0x7ff [ 8937.877709][ C2] irq_exit_rcu+0x98/0xc0 [ 8937.877711][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8937.877714][ C2] [ 8937.877715][ C2] [ 8937.877716][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8937.877719][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8937.877722][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8937.877724][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8937.877726][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8937.877728][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8937.877729][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8937.877730][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8937.877732][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8937.877735][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8937.877738][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8937.877741][ C2] default_idle_call+0x69/0xa0 [ 8937.877744][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8937.877746][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8937.877749][ C2] ? lock_release+0x1d5/0x250 [ 8937.877752][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8937.877756][ C2] do_idle+0xfb/0x160 [ 8937.877758][ C2] cpu_startup_entry+0x55/0x60 [ 8937.877761][ C2] start_secondary+0x21c/0x2b0 [ 8937.877763][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8937.877767][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8937.877773][ C2] [ 8964.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6157s! [swapper/2:0] [ 8964.569676][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8964.570886][ C2] irq event stamp: 44114564 [ 8964.571108][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8964.571626][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8964.572120][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8964.572580][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8964.573034][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8964.573476][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8964.574066][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8964.574380][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8964.575317][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8964.575612][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8964.575998][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8964.576383][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8964.576766][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8964.577155][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8964.577543][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8964.577975][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8964.578296][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8964.578682][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8964.579073][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8964.579460][ C2] PKRU: 55555554 [ 8964.579635][ C2] Call Trace: [ 8964.579797][ C2] [ 8964.579942][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8964.580195][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8964.580430][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8964.580698][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8964.580961][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8964.581241][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8964.581498][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8964.581793][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8964.582045][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8964.582300][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8964.582596][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8964.582882][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8964.583187][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8964.583466][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8964.583751][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8964.584032][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8964.584334][ C2] ? get_stack_info+0x36/0xc0 [ 8964.584566][ C2] ? lock_acquire+0x1c1/0x220 [ 8964.584799][ C2] ? lock_release+0x1d5/0x250 [ 8964.585031][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8964.585272][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8964.585535][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8964.585809][ C2] ? lock_acquire+0x1c1/0x220 [ 8964.586039][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8964.586274][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8964.586525][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8964.586750][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8964.586988][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8964.587263][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8964.587536][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8964.587812][ C2] ip_local_deliver+0x19d/0x480 [ 8964.588059][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8964.588341][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8964.588595][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8964.588931][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8964.589176][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8964.589485][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8964.589739][ C2] ip_rcv+0x564/0x740 [ 8964.589937][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8964.590159][ C2] ? set_track_prepare+0x8a/0xd0 [ 8964.590404][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8964.590672][ C2] ? start_secondary+0x21c/0x2b0 [ 8964.590915][ C2] ? skb_clone+0x10b/0x330 [ 8964.591135][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8964.591444][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8964.591740][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8964.592012][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8964.592299][ C2] ? __tcf_classify+0x329/0x7d0 [ 8964.592538][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8964.592762][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8964.593053][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8964.593328][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8964.593641][ C2] ? lock_acquire+0x1c1/0x220 [ 8964.593873][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8964.594159][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8964.594435][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8964.594741][ C2] ? __copy_skb_header+0xaf/0x490 [ 8964.594990][ C2] ? __skb_clone+0x57a/0x760 [ 8964.595220][ C2] netif_receive_skb+0x55/0x280 [ 8964.595459][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8964.595758][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8964.596081][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8964.596371][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8964.596635][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8964.596917][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8964.597242][ C2] ? get_stack_info+0x36/0xc0 [ 8964.597480][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8964.597742][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8964.598056][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8964.598344][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8964.598611][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8964.598916][ C2] ? kernel_text_address+0x17/0xe0 [ 8964.599168][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8964.599470][ C2] ? arch_stack_walk+0x8c/0x100 [ 8964.599710][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8964.599967][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8964.600243][ C2] ? lock_acquire+0x1c1/0x220 [ 8964.600474][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8964.600746][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8964.601040][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8964.601309][ C2] ? get_stack_info+0x36/0xc0 [ 8964.601542][ C2] __tcf_classify+0x329/0x7d0 [ 8964.601776][ C2] tcf_classify+0x283/0x930 [ 8964.602002][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8964.602251][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8964.602553][ C2] tc_run+0x2e4/0x5d0 [ 8964.602752][ C2] ? __pfx_tc_run+0x10/0x10 [ 8964.602972][ C2] ? lock_acquire+0x1c1/0x220 [ 8964.603204][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8964.603457][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8964.603701][ C2] ? lock_acquire+0x1c1/0x220 [ 8964.603932][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8964.604188][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8964.604482][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8964.604745][ C2] ? neigh_hh_output+0x348/0x590 [ 8964.604989][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8964.605247][ C2] ip_finish_output2+0x786/0x18e0 [ 8964.605495][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8964.605821][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8964.606088][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8964.606333][ C2] ? __ip_finish_output+0x10f/0x770 [ 8964.606590][ C2] ip_output+0x16b/0x4f0 [ 8964.606800][ C2] ? __pfx_ip_output+0x10/0x10 [ 8964.607037][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8964.607330][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8964.607640][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8964.607913][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8964.608163][ C2] ? __alloc_skb+0xd4/0x280 [ 8964.608402][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8964.608662][ C2] ? tcp_fragment+0x168/0x1040 [ 8964.608898][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8964.609142][ C2] ? ip_local_out+0x114/0x3b0 [ 8964.609374][ C2] __ip_queue_xmit+0x672/0x1910 [ 8964.609612][ C2] ? __skb_clone+0x57a/0x760 [ 8964.609841][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8964.610098][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8964.610372][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8964.610606][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8964.610848][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8964.611139][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8964.611451][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8964.611687][ C2] tcp_send_loss_probe+0x348/0x830 [ 8964.611939][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8964.612198][ C2] tcp_write_timer+0x82/0x1d0 [ 8964.612431][ C2] call_timer_fn+0x173/0x430 [ 8964.612658][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8964.612911][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8964.613165][ C2] __run_timers.part.0+0x52d/0x890 [ 8964.613418][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8964.613680][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8964.613953][ C2] ? lock_acquire+0x1c1/0x220 [ 8964.614186][ C2] ? clockevents_program_event+0xf6/0x300 [ 8964.614467][ C2] ? lock_release+0x1d5/0x250 [ 8964.614698][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8964.614953][ C2] ? ktime_get+0xb3/0x190 [ 8964.615169][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8964.615457][ C2] run_timer_softirq+0x72/0x100 [ 8964.615697][ C2] __do_softirq+0x1b9/0x7ff [ 8964.615923][ C2] irq_exit_rcu+0x98/0xc0 [ 8964.616135][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8964.616413][ C2] [ 8964.616557][ C2] [ 8964.616703][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8964.616996][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8964.617269][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8964.618227][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8964.618536][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8964.618921][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8964.619309][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8964.619693][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8964.620076][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8964.620464][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8964.620744][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8964.620995][ C2] default_idle_call+0x69/0xa0 [ 8964.621233][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8964.621476][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8964.621743][ C2] ? lock_release+0x1d5/0x250 [ 8964.621977][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8964.622241][ C2] do_idle+0xfb/0x160 [ 8964.622437][ C2] cpu_startup_entry+0x55/0x60 [ 8964.622672][ C2] start_secondary+0x21c/0x2b0 [ 8964.622909][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8964.623170][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8964.623471][ C2] [ 8964.623622][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6157s! [perl:4135] [ 8964.624024][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8964.625246][ C1] irq event stamp: 209232 [ 8964.625458][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8964.625972][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8964.626437][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8964.626891][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8964.627369][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8964.627816][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8964.628436][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8964.628752][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8964.629699][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8964.629998][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8964.630386][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8964.630776][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8964.631164][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8964.631553][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8964.631940][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8964.632377][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8964.632702][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8964.633092][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8964.633481][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8964.633869][ C1] PKRU: 55555554 [ 8964.634045][ C1] Call Trace: [ 8964.634213][ C1] [ 8964.634356][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8964.634611][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8964.634849][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8964.635119][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8964.635387][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8964.635667][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8964.635924][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8964.636224][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8964.636480][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8964.636782][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8964.637070][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8964.637402][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8964.637692][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8964.637988][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8964.638278][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8964.638592][ C1] ? get_stack_info+0x36/0xc0 [ 8964.638828][ C1] ? lock_acquire+0x1c1/0x220 [ 8964.639061][ C1] ? lock_release+0x1d5/0x250 [ 8964.639294][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8964.639537][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8964.639802][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8964.640081][ C1] ? lock_acquire+0x1c1/0x220 [ 8964.640316][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8964.640548][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8964.640800][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8964.641031][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8964.641275][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8964.641526][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8964.641793][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8964.642062][ C1] ip_local_deliver+0x19d/0x480 [ 8964.642303][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8964.642570][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8964.642828][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8964.643165][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8964.643412][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8964.643724][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8964.643979][ C1] ip_rcv+0x564/0x740 [ 8964.644178][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8964.644405][ C1] ? set_track_prepare+0x8a/0xd0 [ 8964.644655][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8964.644923][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8964.645188][ C1] ? skb_clone+0x10b/0x330 [ 8964.645409][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8964.645721][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8964.646019][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8964.646294][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8964.646581][ C1] ? __tcf_classify+0x329/0x7d0 [ 8964.646822][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8964.647047][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8964.647366][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8964.647651][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8964.647975][ C1] ? lock_acquire+0x1c1/0x220 [ 8964.648216][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8964.648517][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8964.648795][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8964.649105][ C1] ? __copy_skb_header+0xaf/0x490 [ 8964.649357][ C1] ? __skb_clone+0x57a/0x760 [ 8964.649585][ C1] netif_receive_skb+0x55/0x280 [ 8964.649826][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8964.650129][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8964.650453][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8964.650746][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8964.651012][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8964.651295][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8964.651598][ C1] ? hlock_class+0x4e/0x130 [ 8964.651824][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8964.652092][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8964.652364][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8964.652619][ C1] ? hlock_class+0x4e/0x130 [ 8964.652843][ C1] ? mark_lock+0x38/0x3e0 [ 8964.653059][ C1] ? stack_access_ok+0xda/0x1f0 [ 8964.653302][ C1] ? __lock_acquire+0xb67/0x1610 [ 8964.653549][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8964.653817][ C1] ? get_stack_info+0x36/0xc0 [ 8964.654052][ C1] ? stack_access_ok+0xda/0x1f0 [ 8964.654294][ C1] ? get_reg+0x119/0x190 [ 8964.654504][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8964.654764][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8964.655065][ C1] __tcf_classify+0x329/0x7d0 [ 8964.655303][ C1] tcf_classify+0x283/0x930 [ 8964.655526][ C1] ? arch_stack_walk+0xa2/0x100 [ 8964.655768][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8964.656018][ C1] ? get_stack_info+0x36/0xc0 [ 8964.656255][ C1] tc_run+0x2e4/0x5d0 [ 8964.656453][ C1] ? __pfx_tc_run+0x10/0x10 [ 8964.656680][ C1] ? lock_acquire+0x1c1/0x220 [ 8964.656912][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8964.657188][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8964.657441][ C1] ? lock_acquire+0x1c1/0x220 [ 8964.657678][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8964.657943][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8964.658249][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8964.658526][ C1] ? neigh_hh_output+0x348/0x590 [ 8964.658770][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8964.659029][ C1] ip_finish_output2+0x786/0x18e0 [ 8964.659279][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8964.659550][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8964.659880][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8964.660148][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8964.660396][ C1] ? __ip_finish_output+0x10f/0x770 [ 8964.660653][ C1] ip_output+0x16b/0x4f0 [ 8964.660867][ C1] ? run_timer_softirq+0x72/0x100 [ 8964.661117][ C1] ? __pfx_ip_output+0x10/0x10 [ 8964.661355][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8964.661633][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8964.661879][ C1] ? ip_local_out+0x114/0x3b0 [ 8964.662113][ C1] __ip_queue_xmit+0x672/0x1910 [ 8964.662356][ C1] ? __create_object+0x5e/0xb0 [ 8964.662592][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8964.662852][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8964.663126][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8964.663392][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8964.663667][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8964.663933][ C1] tcp_delack_timer+0x84/0x240 [ 8964.664170][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8964.664436][ C1] call_timer_fn+0x173/0x430 [ 8964.664665][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8964.664920][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8964.665174][ C1] __run_timers.part.0+0x52d/0x890 [ 8964.665429][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8964.665695][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8964.665970][ C1] ? lock_acquire+0x1c1/0x220 [ 8964.666204][ C1] ? clockevents_program_event+0xf6/0x300 [ 8964.666487][ C1] ? lock_release+0x1d5/0x250 [ 8964.666718][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8964.666977][ C1] ? ktime_get+0xb3/0x190 [ 8964.667216][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8964.667512][ C1] run_timer_softirq+0x72/0x100 [ 8964.667761][ C1] __do_softirq+0x1b9/0x7ff [ 8964.667995][ C1] irq_exit_rcu+0x98/0xc0 [ 8964.668216][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8964.668509][ C1] [ 8964.668653][ C1] [ 8964.668802][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8964.669098][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8964.669415][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8964.670361][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8964.670659][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8964.671048][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8964.671440][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8964.671831][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8964.672219][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8964.672611][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8964.672898][ C1] pipe_read+0xa16/0xdf0 [ 8964.673114][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8964.673384][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8964.673621][ C1] ? iterate_tty_write+0x299/0x540 [ 8964.673876][ C1] ? lock_release+0x1d5/0x250 [ 8964.674111][ C1] vfs_read+0x911/0xc00 [ 8964.674320][ C1] ? lock_acquire+0x1c1/0x220 [ 8964.674553][ C1] ? __might_fault+0xc6/0x180 [ 8964.674787][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8964.675019][ C1] ? __might_fault+0xc6/0x180 [ 8964.675254][ C1] ? lock_release+0x1d5/0x250 [ 8964.675489][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8964.675746][ C1] ? __fget_light+0x54/0x1e0 [ 8964.675977][ C1] ksys_read+0x17a/0x1e0 [ 8964.676189][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8964.676428][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8964.676723][ C1] do_syscall_64+0xc9/0x1e0 [ 8964.676950][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8964.677267][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8964.677492][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8964.678470][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8964.678879][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8964.679268][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8964.679656][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8964.680044][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8964.680435][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8964.680828][ C1] [ 8992.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6183s! [swapper/2:0] [ 8992.569677][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8992.570890][ C2] irq event stamp: 44114564 [ 8992.571112][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8992.571635][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 8992.572129][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 8992.572592][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 8992.573047][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 8992.573490][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8992.574081][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8992.574396][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8992.575334][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 8992.575631][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8992.576017][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 8992.576403][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 8992.576787][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 8992.577181][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 8992.577566][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 8992.577998][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8992.578319][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 8992.578705][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8992.579092][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8992.579479][ C2] PKRU: 55555554 [ 8992.579655][ C2] Call Trace: [ 8992.579819][ C2] [ 8992.579968][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8992.580223][ C2] ? __run_hrtimer+0x1c0/0x710 [ 8992.580458][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8992.580724][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 8992.580990][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8992.581270][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8992.581525][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8992.581821][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 8992.582074][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 8992.582328][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8992.582627][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8992.582913][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8992.583218][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8992.583500][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8992.583785][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8992.584065][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8992.584367][ C2] ? get_stack_info+0x36/0xc0 [ 8992.584601][ C2] ? lock_acquire+0x1c1/0x220 [ 8992.584831][ C2] ? lock_release+0x1d5/0x250 [ 8992.585063][ C2] do_raw_spin_lock+0x1ec/0x270 [ 8992.585304][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8992.585567][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8992.585844][ C2] ? lock_acquire+0x1c1/0x220 [ 8992.586073][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8992.586309][ C2] _raw_spin_lock_nested+0x65/0x80 [ 8992.586559][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 8992.586787][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8992.587048][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 8992.587306][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 8992.587580][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 8992.587854][ C2] ip_local_deliver+0x19d/0x480 [ 8992.588100][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 8992.588379][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8992.588636][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8992.588973][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8992.589219][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8992.589532][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8992.589787][ C2] ip_rcv+0x564/0x740 [ 8992.589985][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8992.590210][ C2] ? set_track_prepare+0x8a/0xd0 [ 8992.590455][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8992.590723][ C2] ? start_secondary+0x21c/0x2b0 [ 8992.590966][ C2] ? skb_clone+0x10b/0x330 [ 8992.591186][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8992.591497][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8992.591793][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8992.592065][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8992.592352][ C2] ? __tcf_classify+0x329/0x7d0 [ 8992.592593][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 8992.592816][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 8992.593105][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8992.593383][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8992.593702][ C2] ? lock_acquire+0x1c1/0x220 [ 8992.593932][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 8992.594220][ C2] netif_receive_skb_internal+0xb0/0x300 [ 8992.594496][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8992.594803][ C2] ? __copy_skb_header+0xaf/0x490 [ 8992.595052][ C2] ? __skb_clone+0x57a/0x760 [ 8992.595280][ C2] netif_receive_skb+0x55/0x280 [ 8992.595520][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8992.595823][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8992.596145][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8992.596437][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 8992.596703][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 8992.596986][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8992.597313][ C2] ? get_stack_info+0x36/0xc0 [ 8992.597553][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 8992.597816][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8992.598131][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8992.598411][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 8992.598679][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 8992.598984][ C2] ? kernel_text_address+0x17/0xe0 [ 8992.599237][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8992.599538][ C2] ? arch_stack_walk+0x8c/0x100 [ 8992.599779][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 8992.600034][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8992.600312][ C2] ? lock_acquire+0x1c1/0x220 [ 8992.600543][ C2] ? stack_depot_save_flags+0x281/0x550 [ 8992.600817][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8992.601113][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 8992.601380][ C2] ? get_stack_info+0x36/0xc0 [ 8992.601615][ C2] __tcf_classify+0x329/0x7d0 [ 8992.601847][ C2] tcf_classify+0x283/0x930 [ 8992.602075][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 8992.602324][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 8992.602626][ C2] tc_run+0x2e4/0x5d0 [ 8992.602824][ C2] ? __pfx_tc_run+0x10/0x10 [ 8992.603048][ C2] ? lock_acquire+0x1c1/0x220 [ 8992.603280][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 8992.603533][ C2] __dev_queue_xmit+0x686/0x17e0 [ 8992.603777][ C2] ? lock_acquire+0x1c1/0x220 [ 8992.604006][ C2] ? ip_finish_output2+0x786/0x18e0 [ 8992.604264][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8992.604558][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8992.604820][ C2] ? neigh_hh_output+0x348/0x590 [ 8992.605063][ C2] ? ip_finish_output2+0x262/0x18e0 [ 8992.605323][ C2] ip_finish_output2+0x786/0x18e0 [ 8992.605570][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8992.605898][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 8992.606164][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8992.606410][ C2] ? __ip_finish_output+0x10f/0x770 [ 8992.606665][ C2] ip_output+0x16b/0x4f0 [ 8992.606877][ C2] ? __pfx_ip_output+0x10/0x10 [ 8992.607138][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 8992.607415][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8992.607725][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 8992.608003][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 8992.608263][ C2] ? __alloc_skb+0xd4/0x280 [ 8992.608484][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 8992.608745][ C2] ? tcp_fragment+0x168/0x1040 [ 8992.608980][ C2] ? rcu_read_lock_held+0xe/0x50 [ 8992.609225][ C2] ? ip_local_out+0x114/0x3b0 [ 8992.609459][ C2] __ip_queue_xmit+0x672/0x1910 [ 8992.609699][ C2] ? __skb_clone+0x57a/0x760 [ 8992.609927][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 8992.610187][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8992.610460][ C2] ? ipv4_dst_check+0xe3/0x170 [ 8992.610697][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 8992.610939][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 8992.611230][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 8992.611539][ C2] ? tcp_fragment+0xb0e/0x1040 [ 8992.611775][ C2] tcp_send_loss_probe+0x348/0x830 [ 8992.612026][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8992.612288][ C2] tcp_write_timer+0x82/0x1d0 [ 8992.612519][ C2] call_timer_fn+0x173/0x430 [ 8992.612749][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 8992.613002][ C2] ? next_expiry_recalc+0xcd/0x220 [ 8992.613255][ C2] __run_timers.part.0+0x52d/0x890 [ 8992.613507][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 8992.613767][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 8992.614044][ C2] ? lock_acquire+0x1c1/0x220 [ 8992.614276][ C2] ? clockevents_program_event+0xf6/0x300 [ 8992.614556][ C2] ? lock_release+0x1d5/0x250 [ 8992.614789][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 8992.615045][ C2] ? ktime_get+0xb3/0x190 [ 8992.615259][ C2] ? clockevents_program_event+0x1ea/0x300 [ 8992.615548][ C2] run_timer_softirq+0x72/0x100 [ 8992.615789][ C2] __do_softirq+0x1b9/0x7ff [ 8992.616013][ C2] irq_exit_rcu+0x98/0xc0 [ 8992.616228][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 8992.616503][ C2] [ 8992.616651][ C2] [ 8992.616796][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8992.617116][ C2] RIP: 0010:default_idle+0xf/0x20 [ 8992.617372][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 8992.618341][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 8992.618640][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 8992.619026][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 8992.619411][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 8992.619798][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 8992.620186][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 8992.620572][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 8992.620853][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 8992.621105][ C2] default_idle_call+0x69/0xa0 [ 8992.621341][ C2] cpuidle_idle_call+0x1f6/0x280 [ 8992.621584][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 8992.621855][ C2] ? lock_release+0x1d5/0x250 [ 8992.622085][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 8992.622355][ C2] do_idle+0xfb/0x160 [ 8992.622552][ C2] cpu_startup_entry+0x55/0x60 [ 8992.622789][ C2] start_secondary+0x21c/0x2b0 [ 8992.623023][ C2] ? __pfx_start_secondary+0x10/0x10 [ 8992.623287][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 8992.623589][ C2] [ 8992.623742][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6183s! [perl:4135] [ 8992.624141][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 8992.625361][ C1] irq event stamp: 209232 [ 8992.625573][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 8992.626086][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 8992.626552][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 8992.627027][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 8992.627488][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 8992.627936][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 8992.628552][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 8992.628867][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 8992.629814][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 8992.630114][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 8992.630504][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 8992.630891][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 8992.631281][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 8992.631672][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 8992.632060][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 8992.632495][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 8992.632819][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 8992.633211][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 8992.633602][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 8992.633991][ C1] PKRU: 55555554 [ 8992.634169][ C1] Call Trace: [ 8992.634335][ C1] [ 8992.634479][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 8992.634735][ C1] ? __run_hrtimer+0x1c0/0x710 [ 8992.634972][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 8992.635243][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 8992.635508][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 8992.635790][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8992.636048][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 8992.636348][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 8992.636604][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 8992.636905][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 8992.637220][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8992.637534][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8992.637825][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 8992.638120][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 8992.638417][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 8992.638720][ C1] ? get_stack_info+0x36/0xc0 [ 8992.638953][ C1] ? lock_acquire+0x1c1/0x220 [ 8992.639189][ C1] ? lock_release+0x1d5/0x250 [ 8992.639424][ C1] do_raw_spin_lock+0x1ec/0x270 [ 8992.639667][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 8992.639932][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8992.640210][ C1] ? lock_acquire+0x1c1/0x220 [ 8992.640443][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 8992.640678][ C1] _raw_spin_lock_nested+0x65/0x80 [ 8992.640931][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 8992.641161][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 8992.641402][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 8992.641654][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 8992.641922][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 8992.642193][ C1] ip_local_deliver+0x19d/0x480 [ 8992.642437][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 8992.642701][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 8992.642961][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 8992.643303][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8992.643549][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 8992.643862][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 8992.644117][ C1] ip_rcv+0x564/0x740 [ 8992.644318][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8992.644542][ C1] ? set_track_prepare+0x8a/0xd0 [ 8992.644789][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 8992.645060][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 8992.645328][ C1] ? skb_clone+0x10b/0x330 [ 8992.645548][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 8992.645858][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 8992.646158][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 8992.646433][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 8992.646720][ C1] ? __tcf_classify+0x329/0x7d0 [ 8992.646963][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 8992.647214][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 8992.647513][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8992.647800][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 8992.648126][ C1] ? lock_acquire+0x1c1/0x220 [ 8992.648374][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 8992.648663][ C1] netif_receive_skb_internal+0xb0/0x300 [ 8992.648942][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 8992.649251][ C1] ? __copy_skb_header+0xaf/0x490 [ 8992.649502][ C1] ? __skb_clone+0x57a/0x760 [ 8992.649730][ C1] netif_receive_skb+0x55/0x280 [ 8992.649973][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 8992.650279][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 8992.650603][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 8992.650895][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 8992.651163][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 8992.651443][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 8992.651749][ C1] ? hlock_class+0x4e/0x130 [ 8992.651976][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8992.652245][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8992.652514][ C1] ? __pfx_validate_chain+0x10/0x10 [ 8992.652771][ C1] ? hlock_class+0x4e/0x130 [ 8992.652998][ C1] ? mark_lock+0x38/0x3e0 [ 8992.653214][ C1] ? stack_access_ok+0xda/0x1f0 [ 8992.653455][ C1] ? __lock_acquire+0xb67/0x1610 [ 8992.653703][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 8992.653973][ C1] ? get_stack_info+0x36/0xc0 [ 8992.654208][ C1] ? stack_access_ok+0xda/0x1f0 [ 8992.654449][ C1] ? get_reg+0x119/0x190 [ 8992.654660][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 8992.654921][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8992.655223][ C1] __tcf_classify+0x329/0x7d0 [ 8992.655457][ C1] tcf_classify+0x283/0x930 [ 8992.655685][ C1] ? arch_stack_walk+0xa2/0x100 [ 8992.655927][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 8992.656178][ C1] ? get_stack_info+0x36/0xc0 [ 8992.656413][ C1] tc_run+0x2e4/0x5d0 [ 8992.656612][ C1] ? __pfx_tc_run+0x10/0x10 [ 8992.656837][ C1] ? lock_acquire+0x1c1/0x220 [ 8992.657092][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 8992.657355][ C1] __dev_queue_xmit+0x686/0x17e0 [ 8992.657608][ C1] ? lock_acquire+0x1c1/0x220 [ 8992.657847][ C1] ? ip_finish_output2+0x786/0x18e0 [ 8992.658112][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8992.658423][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 8992.658688][ C1] ? neigh_hh_output+0x348/0x590 [ 8992.658934][ C1] ? ip_finish_output2+0x262/0x18e0 [ 8992.659193][ C1] ip_finish_output2+0x786/0x18e0 [ 8992.659443][ C1] ? stack_depot_save_flags+0x45/0x550 [ 8992.659713][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 8992.660044][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 8992.660314][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8992.660562][ C1] ? __ip_finish_output+0x10f/0x770 [ 8992.660820][ C1] ip_output+0x16b/0x4f0 [ 8992.661029][ C1] ? run_timer_softirq+0x72/0x100 [ 8992.661280][ C1] ? __pfx_ip_output+0x10/0x10 [ 8992.661518][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 8992.661797][ C1] ? rcu_read_lock_held+0xe/0x50 [ 8992.662042][ C1] ? ip_local_out+0x114/0x3b0 [ 8992.662277][ C1] __ip_queue_xmit+0x672/0x1910 [ 8992.662519][ C1] ? __create_object+0x5e/0xb0 [ 8992.662756][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 8992.663016][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 8992.663291][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 8992.663559][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 8992.663832][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8992.664096][ C1] tcp_delack_timer+0x84/0x240 [ 8992.664335][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8992.664599][ C1] call_timer_fn+0x173/0x430 [ 8992.664830][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 8992.665086][ C1] ? next_expiry_recalc+0xcd/0x220 [ 8992.665342][ C1] __run_timers.part.0+0x52d/0x890 [ 8992.665595][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 8992.665862][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 8992.666140][ C1] ? lock_acquire+0x1c1/0x220 [ 8992.666375][ C1] ? clockevents_program_event+0xf6/0x300 [ 8992.666657][ C1] ? lock_release+0x1d5/0x250 [ 8992.666891][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8992.667174][ C1] ? ktime_get+0xb3/0x190 [ 8992.667395][ C1] ? clockevents_program_event+0x1ea/0x300 [ 8992.667692][ C1] run_timer_softirq+0x72/0x100 [ 8992.667941][ C1] __do_softirq+0x1b9/0x7ff [ 8992.668176][ C1] irq_exit_rcu+0x98/0xc0 [ 8992.668401][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 8992.668681][ C1] [ 8992.668829][ C1] [ 8992.668975][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 8992.669274][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 8992.669590][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 8992.670538][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 8992.670839][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 8992.671229][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 8992.671619][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 8992.672009][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 8992.672398][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 8992.672789][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 8992.673080][ C1] pipe_read+0xa16/0xdf0 [ 8992.673298][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 8992.673570][ C1] ? __pfx_pipe_read+0x10/0x10 [ 8992.673805][ C1] ? iterate_tty_write+0x299/0x540 [ 8992.674061][ C1] ? lock_release+0x1d5/0x250 [ 8992.674298][ C1] vfs_read+0x911/0xc00 [ 8992.674506][ C1] ? lock_acquire+0x1c1/0x220 [ 8992.674738][ C1] ? __might_fault+0xc6/0x180 [ 8992.674973][ C1] ? __pfx_vfs_read+0x10/0x10 [ 8992.675208][ C1] ? __might_fault+0xc6/0x180 [ 8992.675442][ C1] ? lock_release+0x1d5/0x250 [ 8992.675675][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 8992.675932][ C1] ? __fget_light+0x54/0x1e0 [ 8992.676165][ C1] ksys_read+0x17a/0x1e0 [ 8992.676378][ C1] ? __pfx_ksys_read+0x10/0x10 [ 8992.676616][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 8992.676913][ C1] do_syscall_64+0xc9/0x1e0 [ 8992.677166][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 8992.677464][ C1] RIP: 0033:0x7f08a1ea38b2 [ 8992.677700][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 8992.678666][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 8992.679077][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 8992.679466][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 8992.679853][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 8992.680242][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 8992.680631][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 8992.681022][ C1] [ 9015.878103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9015.878466][ C1] rcu: 1-....: (6644513 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1591847 [ 9015.879012][ C1] rcu: (t=6660991 jiffies g=1882453 q=721 ncpus=4) [ 9015.879340][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9015.879776][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9015.880377][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9015.880697][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9015.881641][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9015.881943][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9015.882333][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9015.882721][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9015.883111][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9015.883501][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9015.883888][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9015.884326][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9015.884649][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9015.885042][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9015.885431][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9015.885819][ C1] PKRU: 55555554 [ 9015.885996][ C1] Call Trace: [ 9015.886164][ C1] [ 9015.886308][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9015.886573][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9015.886819][ C1] ? check_cpu_stall+0x284/0x500 [ 9015.887088][ C1] ? rcu_pending+0x92/0x360 [ 9015.887320][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9015.887590][ C1] ? update_process_times+0xb9/0x110 [ 9015.887860][ C1] ? tick_sched_handle+0x67/0x130 [ 9015.888116][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9015.888407][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9015.888642][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9015.888946][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9015.889214][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9015.889495][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9015.889754][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9015.890052][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9015.890309][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9015.890612][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9015.890898][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9015.891206][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9015.891490][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9015.891776][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9015.892059][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9015.892364][ C1] ? get_stack_info+0x36/0xc0 [ 9015.892599][ C1] ? lock_acquire+0x1c1/0x220 [ 9015.892833][ C1] ? lock_release+0x1d5/0x250 [ 9015.893068][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9015.893312][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9015.893577][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9015.893858][ C1] ? lock_acquire+0x1c1/0x220 [ 9015.894089][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9015.894325][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9015.894578][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9015.894808][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9015.895049][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9015.895302][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9015.895570][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9015.895840][ C1] ip_local_deliver+0x19d/0x480 [ 9015.896080][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9015.896344][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9015.896602][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9015.896963][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9015.897218][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9015.897538][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9015.897802][ C1] ip_rcv+0x564/0x740 [ 9015.898006][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9015.898245][ C1] ? set_track_prepare+0x8a/0xd0 [ 9015.898491][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9015.898761][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9015.899026][ C1] ? skb_clone+0x10b/0x330 [ 9015.899249][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9015.899561][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9015.899858][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9015.900134][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9015.900421][ C1] ? __tcf_classify+0x329/0x7d0 [ 9015.900662][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9015.900887][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9015.901179][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9015.901459][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9015.901777][ C1] ? lock_acquire+0x1c1/0x220 [ 9015.902010][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9015.902297][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9015.902577][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9015.902886][ C1] ? __copy_skb_header+0xaf/0x490 [ 9015.903137][ C1] ? __skb_clone+0x57a/0x760 [ 9015.903365][ C1] netif_receive_skb+0x55/0x280 [ 9015.903607][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9015.903910][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9015.904234][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9015.904527][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9015.904793][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9015.905073][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9015.905379][ C1] ? hlock_class+0x4e/0x130 [ 9015.905606][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9015.905875][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9015.906143][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9015.906402][ C1] ? hlock_class+0x4e/0x130 [ 9015.906626][ C1] ? mark_lock+0x38/0x3e0 [ 9015.906842][ C1] ? stack_access_ok+0xda/0x1f0 [ 9015.907109][ C1] ? __lock_acquire+0xb67/0x1610 [ 9015.907363][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9015.907641][ C1] ? get_stack_info+0x36/0xc0 [ 9015.907881][ C1] ? stack_access_ok+0xda/0x1f0 [ 9015.908138][ C1] ? get_reg+0x119/0x190 [ 9015.908350][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9015.908611][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9015.908912][ C1] __tcf_classify+0x329/0x7d0 [ 9015.909148][ C1] tcf_classify+0x283/0x930 [ 9015.909373][ C1] ? arch_stack_walk+0xa2/0x100 [ 9015.909615][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9015.909865][ C1] ? get_stack_info+0x36/0xc0 [ 9015.910100][ C1] tc_run+0x2e4/0x5d0 [ 9015.910301][ C1] ? __pfx_tc_run+0x10/0x10 [ 9015.910528][ C1] ? lock_acquire+0x1c1/0x220 [ 9015.910758][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9015.911014][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9015.911260][ C1] ? lock_acquire+0x1c1/0x220 [ 9015.911493][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9015.911749][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9015.912047][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9015.912313][ C1] ? neigh_hh_output+0x348/0x590 [ 9015.912559][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9015.912816][ C1] ip_finish_output2+0x786/0x18e0 [ 9015.913065][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9015.913339][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9015.913667][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9015.913936][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9015.914181][ C1] ? __ip_finish_output+0x10f/0x770 [ 9015.914439][ C1] ip_output+0x16b/0x4f0 [ 9015.914650][ C1] ? run_timer_softirq+0x72/0x100 [ 9015.914899][ C1] ? __pfx_ip_output+0x10/0x10 [ 9015.915134][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9015.915417][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9015.915663][ C1] ? ip_local_out+0x114/0x3b0 [ 9015.915895][ C1] __ip_queue_xmit+0x672/0x1910 [ 9015.916136][ C1] ? __create_object+0x5e/0xb0 [ 9015.916375][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9015.916634][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9015.916930][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9015.917205][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9015.917486][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9015.917760][ C1] tcp_delack_timer+0x84/0x240 [ 9015.918003][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9015.918281][ C1] call_timer_fn+0x173/0x430 [ 9015.918512][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9015.918768][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9015.919023][ C1] __run_timers.part.0+0x52d/0x890 [ 9015.919278][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9015.919544][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9015.919820][ C1] ? lock_acquire+0x1c1/0x220 [ 9015.920053][ C1] ? clockevents_program_event+0xf6/0x300 [ 9015.920338][ C1] ? lock_release+0x1d5/0x250 [ 9015.920570][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9015.920827][ C1] ? ktime_get+0xb3/0x190 [ 9015.921045][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9015.921334][ C1] run_timer_softirq+0x72/0x100 [ 9015.921575][ C1] __do_softirq+0x1b9/0x7ff [ 9015.921803][ C1] irq_exit_rcu+0x98/0xc0 [ 9015.922016][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9015.922299][ C1] [ 9015.922445][ C1] [ 9015.922593][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9015.922888][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9015.923210][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9015.924163][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9015.924464][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9015.924856][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9015.925247][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9015.925637][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9015.926027][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9015.926421][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9015.926710][ C1] pipe_read+0xa16/0xdf0 [ 9015.926949][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9015.927229][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9015.927474][ C1] ? iterate_tty_write+0x299/0x540 [ 9015.927737][ C1] ? lock_release+0x1d5/0x250 [ 9015.927978][ C1] vfs_read+0x911/0xc00 [ 9015.928194][ C1] ? lock_acquire+0x1c1/0x220 [ 9015.928435][ C1] ? __might_fault+0xc6/0x180 [ 9015.928675][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9015.928915][ C1] ? __might_fault+0xc6/0x180 [ 9015.929156][ C1] ? lock_release+0x1d5/0x250 [ 9015.929406][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9015.929664][ C1] ? __fget_light+0x54/0x1e0 [ 9015.929895][ C1] ksys_read+0x17a/0x1e0 [ 9015.930110][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9015.930350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9015.930646][ C1] do_syscall_64+0xc9/0x1e0 [ 9015.930876][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9015.931170][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9015.931390][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9015.932340][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9015.932752][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9015.933142][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9015.933531][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9015.933923][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9015.934313][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9015.934706][ C1] [ 9015.934860][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9015.935126][ C2] NMI backtrace for cpu 2 [ 9015.935140][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9015.935145][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9015.935149][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9015.935158][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9015.935163][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9015.935168][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9015.935172][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9015.935176][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9015.935179][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9015.935183][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9015.935188][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9015.935192][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9015.935198][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9015.935202][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9015.935205][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9015.935208][ C2] PKRU: 55555554 [ 9015.935211][ C2] Call Trace: [ 9015.935213][ C2] [ 9015.935216][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9015.935228][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9015.935236][ C2] ? nmi_handle+0x153/0x420 [ 9015.935246][ C2] ? default_do_nmi+0x41/0x100 [ 9015.935252][ C2] ? exc_nmi+0xf3/0x120 [ 9015.935258][ C2] ? end_repeat_nmi+0xf/0x60 [ 9015.935270][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9015.935278][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9015.935286][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9015.935294][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9015.935302][ C2] [ 9015.935304][ C2] [ 9015.935307][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9015.935313][ C2] ? get_stack_info+0x36/0xc0 [ 9015.935322][ C2] ? lock_acquire+0x1c1/0x220 [ 9015.935330][ C2] ? lock_release+0x1d5/0x250 [ 9015.935339][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9015.935347][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9015.935354][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9015.935363][ C2] ? lock_acquire+0x1c1/0x220 [ 9015.935368][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9015.935377][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9015.935383][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9015.935399][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9015.935405][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9015.935417][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9015.935427][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9015.935435][ C2] ip_local_deliver+0x19d/0x480 [ 9015.935441][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9015.935447][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9015.935453][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9015.935464][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9015.935471][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9015.935478][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9015.935499][ C2] ip_rcv+0x564/0x740 [ 9015.935505][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9015.935511][ C2] ? set_track_prepare+0x8a/0xd0 [ 9015.935520][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9015.935527][ C2] ? start_secondary+0x21c/0x2b0 [ 9015.935533][ C2] ? skb_clone+0x10b/0x330 [ 9015.935539][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9015.935554][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9015.935568][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9015.935575][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9015.935595][ C2] ? __tcf_classify+0x329/0x7d0 [ 9015.935604][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9015.935609][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9015.935617][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9015.935625][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9015.935635][ C2] ? lock_acquire+0x1c1/0x220 [ 9015.935641][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9015.935651][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9015.935660][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9015.935670][ C2] ? __copy_skb_header+0xaf/0x490 [ 9015.935679][ C2] ? __skb_clone+0x57a/0x760 [ 9015.935685][ C2] netif_receive_skb+0x55/0x280 [ 9015.935693][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9015.935710][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9015.935728][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9015.935745][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9015.935756][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9015.935782][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9015.935801][ C2] ? get_stack_info+0x36/0xc0 [ 9015.935813][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9015.935820][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9015.935828][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9015.935834][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9015.935843][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9015.935849][ C2] ? kernel_text_address+0x17/0xe0 [ 9015.935856][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9015.935865][ C2] ? arch_stack_walk+0x8c/0x100 [ 9015.935873][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9015.935881][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9015.935889][ C2] ? lock_acquire+0x1c1/0x220 [ 9015.935894][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9015.935903][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9015.935912][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9015.935918][ C2] ? get_stack_info+0x36/0xc0 [ 9015.935929][ C2] __tcf_classify+0x329/0x7d0 [ 9015.935942][ C2] tcf_classify+0x283/0x930 [ 9015.935952][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9015.935960][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9015.935971][ C2] tc_run+0x2e4/0x5d0 [ 9015.935978][ C2] ? __pfx_tc_run+0x10/0x10 [ 9015.935986][ C2] ? lock_acquire+0x1c1/0x220 [ 9015.935991][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9015.936001][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9015.936011][ C2] ? lock_acquire+0x1c1/0x220 [ 9015.936017][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9015.936024][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9015.936031][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9015.936038][ C2] ? neigh_hh_output+0x348/0x590 [ 9015.936047][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9015.936057][ C2] ip_finish_output2+0x786/0x18e0 [ 9015.936065][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9015.936084][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9015.936090][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9015.936100][ C2] ? __ip_finish_output+0x10f/0x770 [ 9015.936109][ C2] ip_output+0x16b/0x4f0 [ 9015.936116][ C2] ? __pfx_ip_output+0x10/0x10 [ 9015.936122][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9015.936129][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9015.936137][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9015.936142][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9015.936148][ C2] ? __alloc_skb+0xd4/0x280 [ 9015.936154][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9015.936162][ C2] ? tcp_fragment+0x168/0x1040 [ 9015.936169][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9015.936174][ C2] ? ip_local_out+0x114/0x3b0 [ 9015.936178][ C2] __ip_queue_xmit+0x672/0x1910 [ 9015.936181][ C2] ? __skb_clone+0x57a/0x760 [ 9015.936184][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9015.936189][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9015.936192][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9015.936196][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9015.936200][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9015.936204][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9015.936207][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9015.936211][ C2] tcp_send_loss_probe+0x348/0x830 [ 9015.936214][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9015.936217][ C2] tcp_write_timer+0x82/0x1d0 [ 9015.936220][ C2] call_timer_fn+0x173/0x430 [ 9015.936224][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9015.936229][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9015.936233][ C2] __run_timers.part.0+0x52d/0x890 [ 9015.936235][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9015.936239][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9015.936243][ C2] ? lock_acquire+0x1c1/0x220 [ 9015.936245][ C2] ? clockevents_program_event+0xf6/0x300 [ 9015.936249][ C2] ? lock_release+0x1d5/0x250 [ 9015.936252][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9015.936255][ C2] ? ktime_get+0xb3/0x190 [ 9015.936258][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9015.936262][ C2] run_timer_softirq+0x72/0x100 [ 9015.936266][ C2] __do_softirq+0x1b9/0x7ff [ 9015.936270][ C2] irq_exit_rcu+0x98/0xc0 [ 9015.936272][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9015.936275][ C2] [ 9015.936276][ C2] [ 9015.936277][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9015.936280][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9015.936283][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9015.936286][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9015.936287][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9015.936289][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9015.936291][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9015.936292][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9015.936294][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9015.936298][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9015.936301][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9015.936305][ C2] default_idle_call+0x69/0xa0 [ 9015.936308][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9015.936310][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9015.936313][ C2] ? lock_release+0x1d5/0x250 [ 9015.936316][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9015.936319][ C2] do_idle+0xfb/0x160 [ 9015.936322][ C2] cpu_startup_entry+0x55/0x60 [ 9015.936325][ C2] start_secondary+0x21c/0x2b0 [ 9015.936327][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9015.936331][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9015.936337][ C2] [ 9040.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6228s! [swapper/2:0] [ 9040.569678][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9040.570893][ C2] irq event stamp: 44114564 [ 9040.571113][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9040.571637][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9040.572131][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9040.572595][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9040.573048][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9040.573491][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9040.574081][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9040.574399][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9040.575339][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9040.575636][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9040.576022][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9040.576411][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9040.576815][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9040.577211][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9040.577606][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9040.578057][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9040.578381][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9040.578768][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9040.579152][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9040.579540][ C2] PKRU: 55555554 [ 9040.579714][ C2] Call Trace: [ 9040.579879][ C2] [ 9040.580021][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9040.580277][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9040.580513][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9040.580783][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9040.581046][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9040.581324][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9040.581582][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9040.581878][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9040.582130][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9040.582384][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9040.582684][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9040.582971][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9040.583276][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9040.583555][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9040.583842][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9040.584119][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9040.584422][ C2] ? get_stack_info+0x36/0xc0 [ 9040.584656][ C2] ? lock_acquire+0x1c1/0x220 [ 9040.584890][ C2] ? lock_release+0x1d5/0x250 [ 9040.585121][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9040.585363][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9040.585628][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9040.585904][ C2] ? lock_acquire+0x1c1/0x220 [ 9040.586137][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9040.586370][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9040.586622][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9040.586870][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9040.587116][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9040.587373][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9040.587645][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9040.587922][ C2] ip_local_deliver+0x19d/0x480 [ 9040.588174][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9040.588439][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9040.588694][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9040.589029][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9040.589275][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9040.589584][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9040.589838][ C2] ip_rcv+0x564/0x740 [ 9040.590035][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9040.590261][ C2] ? set_track_prepare+0x8a/0xd0 [ 9040.590507][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9040.590775][ C2] ? start_secondary+0x21c/0x2b0 [ 9040.591017][ C2] ? skb_clone+0x10b/0x330 [ 9040.591240][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9040.591548][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9040.591843][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9040.592118][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9040.592403][ C2] ? __tcf_classify+0x329/0x7d0 [ 9040.592644][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9040.592868][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9040.593158][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9040.593435][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9040.593750][ C2] ? lock_acquire+0x1c1/0x220 [ 9040.593982][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9040.594269][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9040.594547][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9040.594854][ C2] ? __copy_skb_header+0xaf/0x490 [ 9040.595104][ C2] ? __skb_clone+0x57a/0x760 [ 9040.595330][ C2] netif_receive_skb+0x55/0x280 [ 9040.595571][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9040.595875][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9040.596197][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9040.596488][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9040.596753][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9040.597057][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9040.597368][ C2] ? get_stack_info+0x36/0xc0 [ 9040.597609][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9040.597871][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9040.598191][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9040.598458][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9040.598727][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9040.599032][ C2] ? kernel_text_address+0x17/0xe0 [ 9040.599285][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9040.599589][ C2] ? arch_stack_walk+0x8c/0x100 [ 9040.599829][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9040.600086][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9040.600363][ C2] ? lock_acquire+0x1c1/0x220 [ 9040.600595][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9040.600866][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9040.601163][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9040.601430][ C2] ? get_stack_info+0x36/0xc0 [ 9040.601664][ C2] __tcf_classify+0x329/0x7d0 [ 9040.601898][ C2] tcf_classify+0x283/0x930 [ 9040.602122][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9040.602372][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9040.602676][ C2] tc_run+0x2e4/0x5d0 [ 9040.602874][ C2] ? __pfx_tc_run+0x10/0x10 [ 9040.603099][ C2] ? lock_acquire+0x1c1/0x220 [ 9040.603332][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9040.603584][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9040.603830][ C2] ? lock_acquire+0x1c1/0x220 [ 9040.604061][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9040.604318][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9040.604611][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9040.604877][ C2] ? neigh_hh_output+0x348/0x590 [ 9040.605121][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9040.605379][ C2] ip_finish_output2+0x786/0x18e0 [ 9040.605627][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9040.605953][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9040.606222][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9040.606466][ C2] ? __ip_finish_output+0x10f/0x770 [ 9040.606721][ C2] ip_output+0x16b/0x4f0 [ 9040.606957][ C2] ? __pfx_ip_output+0x10/0x10 [ 9040.607198][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9040.607475][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9040.607784][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9040.608070][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9040.608314][ C2] ? __alloc_skb+0xd4/0x280 [ 9040.608536][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9040.608797][ C2] ? tcp_fragment+0x168/0x1040 [ 9040.609032][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9040.609275][ C2] ? ip_local_out+0x114/0x3b0 [ 9040.609507][ C2] __ip_queue_xmit+0x672/0x1910 [ 9040.609747][ C2] ? __skb_clone+0x57a/0x760 [ 9040.609975][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9040.610233][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9040.610504][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9040.610739][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9040.610979][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9040.611272][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9040.611581][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9040.611815][ C2] tcp_send_loss_probe+0x348/0x830 [ 9040.612067][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9040.612328][ C2] tcp_write_timer+0x82/0x1d0 [ 9040.612558][ C2] call_timer_fn+0x173/0x430 [ 9040.612787][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9040.613040][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9040.613294][ C2] __run_timers.part.0+0x52d/0x890 [ 9040.613545][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9040.613807][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9040.614083][ C2] ? lock_acquire+0x1c1/0x220 [ 9040.614316][ C2] ? clockevents_program_event+0xf6/0x300 [ 9040.614595][ C2] ? lock_release+0x1d5/0x250 [ 9040.614827][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9040.615082][ C2] ? ktime_get+0xb3/0x190 [ 9040.615297][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9040.615583][ C2] run_timer_softirq+0x72/0x100 [ 9040.615823][ C2] __do_softirq+0x1b9/0x7ff [ 9040.616049][ C2] irq_exit_rcu+0x98/0xc0 [ 9040.616262][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9040.616538][ C2] [ 9040.616686][ C2] [ 9040.616852][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9040.617154][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9040.617408][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9040.618371][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9040.618668][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9040.619053][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9040.619440][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9040.619828][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9040.620215][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9040.620605][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9040.620886][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9040.621137][ C2] default_idle_call+0x69/0xa0 [ 9040.621374][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9040.621617][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9040.621886][ C2] ? lock_release+0x1d5/0x250 [ 9040.622116][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9040.622382][ C2] do_idle+0xfb/0x160 [ 9040.622580][ C2] cpu_startup_entry+0x55/0x60 [ 9040.622816][ C2] start_secondary+0x21c/0x2b0 [ 9040.623053][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9040.623314][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9040.623614][ C2] [ 9040.623765][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6228s! [perl:4135] [ 9040.624191][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9040.625448][ C1] irq event stamp: 209232 [ 9040.625662][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9040.626177][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9040.626643][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9040.627130][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9040.627590][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9040.628050][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9040.628647][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9040.628966][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9040.629914][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9040.630213][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9040.630605][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9040.630994][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9040.631384][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9040.631771][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9040.632162][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9040.632599][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9040.632924][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9040.633316][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9040.633705][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9040.634097][ C1] PKRU: 55555554 [ 9040.634275][ C1] Call Trace: [ 9040.634439][ C1] [ 9040.634585][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9040.634840][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9040.635077][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9040.635350][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9040.635617][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9040.635898][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9040.636158][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9040.636455][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9040.636712][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9040.637040][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9040.637338][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9040.637654][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9040.637944][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9040.638245][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9040.638526][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9040.638831][ C1] ? get_stack_info+0x36/0xc0 [ 9040.639067][ C1] ? lock_acquire+0x1c1/0x220 [ 9040.639305][ C1] ? lock_release+0x1d5/0x250 [ 9040.639539][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9040.639780][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9040.640049][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9040.640328][ C1] ? lock_acquire+0x1c1/0x220 [ 9040.640562][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9040.640797][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9040.641051][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9040.641280][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9040.641520][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9040.641772][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9040.642040][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9040.642314][ C1] ip_local_deliver+0x19d/0x480 [ 9040.642556][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9040.642821][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9040.643078][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9040.643418][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9040.643665][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9040.643977][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9040.644234][ C1] ip_rcv+0x564/0x740 [ 9040.644434][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9040.644660][ C1] ? set_track_prepare+0x8a/0xd0 [ 9040.644907][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9040.645179][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9040.645447][ C1] ? skb_clone+0x10b/0x330 [ 9040.645668][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9040.645980][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9040.646282][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9040.646555][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9040.646868][ C1] ? __tcf_classify+0x329/0x7d0 [ 9040.647117][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9040.647347][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9040.647648][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9040.647932][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9040.648260][ C1] ? lock_acquire+0x1c1/0x220 [ 9040.648494][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9040.648784][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9040.649061][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9040.649371][ C1] ? __copy_skb_header+0xaf/0x490 [ 9040.649621][ C1] ? __skb_clone+0x57a/0x760 [ 9040.649851][ C1] netif_receive_skb+0x55/0x280 [ 9040.650094][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9040.650400][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9040.650724][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9040.651015][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9040.651285][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9040.651565][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9040.651871][ C1] ? hlock_class+0x4e/0x130 [ 9040.652096][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9040.652369][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9040.652638][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9040.652895][ C1] ? hlock_class+0x4e/0x130 [ 9040.653121][ C1] ? mark_lock+0x38/0x3e0 [ 9040.653336][ C1] ? stack_access_ok+0xda/0x1f0 [ 9040.653580][ C1] ? __lock_acquire+0xb67/0x1610 [ 9040.653828][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9040.654097][ C1] ? get_stack_info+0x36/0xc0 [ 9040.654334][ C1] ? stack_access_ok+0xda/0x1f0 [ 9040.654577][ C1] ? get_reg+0x119/0x190 [ 9040.654787][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9040.655049][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9040.655352][ C1] __tcf_classify+0x329/0x7d0 [ 9040.655588][ C1] tcf_classify+0x283/0x930 [ 9040.655814][ C1] ? arch_stack_walk+0xa2/0x100 [ 9040.656056][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9040.656307][ C1] ? get_stack_info+0x36/0xc0 [ 9040.656542][ C1] tc_run+0x2e4/0x5d0 [ 9040.656743][ C1] ? __pfx_tc_run+0x10/0x10 [ 9040.656995][ C1] ? lock_acquire+0x1c1/0x220 [ 9040.657237][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9040.657499][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9040.657754][ C1] ? lock_acquire+0x1c1/0x220 [ 9040.658002][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9040.658261][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9040.658557][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9040.658824][ C1] ? neigh_hh_output+0x348/0x590 [ 9040.659071][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9040.659331][ C1] ip_finish_output2+0x786/0x18e0 [ 9040.659581][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9040.659851][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9040.660180][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9040.660451][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9040.660698][ C1] ? __ip_finish_output+0x10f/0x770 [ 9040.660957][ C1] ip_output+0x16b/0x4f0 [ 9040.661168][ C1] ? run_timer_softirq+0x72/0x100 [ 9040.661418][ C1] ? __pfx_ip_output+0x10/0x10 [ 9040.661657][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9040.661936][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9040.662182][ C1] ? ip_local_out+0x114/0x3b0 [ 9040.662418][ C1] __ip_queue_xmit+0x672/0x1910 [ 9040.662661][ C1] ? __create_object+0x5e/0xb0 [ 9040.662900][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9040.663160][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9040.663435][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9040.663700][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9040.663977][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9040.664245][ C1] tcp_delack_timer+0x84/0x240 [ 9040.664484][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9040.664747][ C1] call_timer_fn+0x173/0x430 [ 9040.664979][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9040.665236][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9040.665492][ C1] __run_timers.part.0+0x52d/0x890 [ 9040.665745][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9040.666012][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9040.666291][ C1] ? lock_acquire+0x1c1/0x220 [ 9040.666522][ C1] ? clockevents_program_event+0xf6/0x300 [ 9040.666828][ C1] ? lock_release+0x1d5/0x250 [ 9040.667067][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9040.667333][ C1] ? ktime_get+0xb3/0x190 [ 9040.667554][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9040.667852][ C1] run_timer_softirq+0x72/0x100 [ 9040.668110][ C1] __do_softirq+0x1b9/0x7ff [ 9040.668336][ C1] irq_exit_rcu+0x98/0xc0 [ 9040.668552][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9040.668829][ C1] [ 9040.668977][ C1] [ 9040.669124][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9040.669422][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9040.669740][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9040.670688][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9040.670989][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9040.671379][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9040.671770][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9040.672160][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9040.672551][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9040.672942][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9040.673234][ C1] pipe_read+0xa16/0xdf0 [ 9040.673450][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9040.673719][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9040.673957][ C1] ? iterate_tty_write+0x299/0x540 [ 9040.674212][ C1] ? lock_release+0x1d5/0x250 [ 9040.674447][ C1] vfs_read+0x911/0xc00 [ 9040.674656][ C1] ? lock_acquire+0x1c1/0x220 [ 9040.674889][ C1] ? __might_fault+0xc6/0x180 [ 9040.675124][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9040.675357][ C1] ? __might_fault+0xc6/0x180 [ 9040.675591][ C1] ? lock_release+0x1d5/0x250 [ 9040.675825][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9040.676084][ C1] ? __fget_light+0x54/0x1e0 [ 9040.676318][ C1] ksys_read+0x17a/0x1e0 [ 9040.676529][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9040.676775][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9040.677097][ C1] do_syscall_64+0xc9/0x1e0 [ 9040.677330][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9040.677631][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9040.677860][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9040.678818][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9040.679226][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9040.679617][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9040.680007][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9040.680396][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9040.680783][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9040.681177][ C1] [ 9068.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6254s! [swapper/2:0] [ 9068.569677][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9068.570892][ C2] irq event stamp: 44114564 [ 9068.571114][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9068.571630][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9068.572124][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9068.572585][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9068.573039][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9068.573480][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9068.574069][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9068.574384][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9068.575323][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9068.575619][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9068.576005][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9068.576390][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9068.576779][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9068.577167][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9068.577553][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9068.577984][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9068.578306][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9068.578690][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9068.579078][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9068.579467][ C2] PKRU: 55555554 [ 9068.579643][ C2] Call Trace: [ 9068.579804][ C2] [ 9068.579949][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9068.580203][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9068.580439][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9068.580708][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9068.580971][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9068.581252][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9068.581508][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9068.581801][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9068.582055][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9068.582310][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9068.582609][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9068.582895][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9068.583201][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9068.583480][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9068.583766][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9068.584046][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9068.584346][ C2] ? get_stack_info+0x36/0xc0 [ 9068.584580][ C2] ? lock_acquire+0x1c1/0x220 [ 9068.584813][ C2] ? lock_release+0x1d5/0x250 [ 9068.585045][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9068.585286][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9068.585550][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9068.585824][ C2] ? lock_acquire+0x1c1/0x220 [ 9068.586056][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9068.586290][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9068.586541][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9068.586790][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9068.587035][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9068.587293][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9068.587566][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9068.587841][ C2] ip_local_deliver+0x19d/0x480 [ 9068.588092][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9068.588355][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9068.588610][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9068.588946][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9068.589191][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9068.589501][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9068.589755][ C2] ip_rcv+0x564/0x740 [ 9068.589953][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9068.590176][ C2] ? set_track_prepare+0x8a/0xd0 [ 9068.590421][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9068.590688][ C2] ? start_secondary+0x21c/0x2b0 [ 9068.590931][ C2] ? skb_clone+0x10b/0x330 [ 9068.591151][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9068.591460][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9068.591757][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9068.592029][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9068.592317][ C2] ? __tcf_classify+0x329/0x7d0 [ 9068.592556][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9068.592779][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9068.593070][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9068.593345][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9068.593659][ C2] ? lock_acquire+0x1c1/0x220 [ 9068.593891][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9068.594178][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9068.594454][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9068.594762][ C2] ? __copy_skb_header+0xaf/0x490 [ 9068.595011][ C2] ? __skb_clone+0x57a/0x760 [ 9068.595240][ C2] netif_receive_skb+0x55/0x280 [ 9068.595479][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9068.595780][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9068.596103][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9068.596394][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9068.596662][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9068.596965][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9068.597277][ C2] ? get_stack_info+0x36/0xc0 [ 9068.597515][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9068.597778][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9068.598098][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9068.598368][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9068.598636][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9068.598940][ C2] ? kernel_text_address+0x17/0xe0 [ 9068.599194][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9068.599496][ C2] ? arch_stack_walk+0x8c/0x100 [ 9068.599737][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9068.599994][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9068.600270][ C2] ? lock_acquire+0x1c1/0x220 [ 9068.600501][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9068.600773][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9068.601068][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9068.601338][ C2] ? get_stack_info+0x36/0xc0 [ 9068.601570][ C2] __tcf_classify+0x329/0x7d0 [ 9068.601805][ C2] tcf_classify+0x283/0x930 [ 9068.602031][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9068.602280][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9068.602584][ C2] tc_run+0x2e4/0x5d0 [ 9068.602784][ C2] ? __pfx_tc_run+0x10/0x10 [ 9068.603005][ C2] ? lock_acquire+0x1c1/0x220 [ 9068.603238][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9068.603490][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9068.603735][ C2] ? lock_acquire+0x1c1/0x220 [ 9068.603966][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9068.604223][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9068.604517][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9068.604779][ C2] ? neigh_hh_output+0x348/0x590 [ 9068.605023][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9068.605280][ C2] ip_finish_output2+0x786/0x18e0 [ 9068.605528][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9068.605854][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9068.606121][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9068.606367][ C2] ? __ip_finish_output+0x10f/0x770 [ 9068.606624][ C2] ip_output+0x16b/0x4f0 [ 9068.606859][ C2] ? __pfx_ip_output+0x10/0x10 [ 9068.607101][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9068.607375][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9068.607685][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9068.607965][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9068.608208][ C2] ? __alloc_skb+0xd4/0x280 [ 9068.608432][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9068.608690][ C2] ? tcp_fragment+0x168/0x1040 [ 9068.608926][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9068.609171][ C2] ? ip_local_out+0x114/0x3b0 [ 9068.609403][ C2] __ip_queue_xmit+0x672/0x1910 [ 9068.609643][ C2] ? __skb_clone+0x57a/0x760 [ 9068.609871][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9068.610128][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9068.610401][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9068.610636][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9068.610876][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9068.611168][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9068.611477][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9068.611713][ C2] tcp_send_loss_probe+0x348/0x830 [ 9068.611964][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9068.612224][ C2] tcp_write_timer+0x82/0x1d0 [ 9068.612456][ C2] call_timer_fn+0x173/0x430 [ 9068.612685][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9068.612939][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9068.613191][ C2] __run_timers.part.0+0x52d/0x890 [ 9068.613444][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9068.613704][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9068.613978][ C2] ? lock_acquire+0x1c1/0x220 [ 9068.614210][ C2] ? clockevents_program_event+0xf6/0x300 [ 9068.614492][ C2] ? lock_release+0x1d5/0x250 [ 9068.614721][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9068.614977][ C2] ? ktime_get+0xb3/0x190 [ 9068.615194][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9068.615481][ C2] run_timer_softirq+0x72/0x100 [ 9068.615720][ C2] __do_softirq+0x1b9/0x7ff [ 9068.615946][ C2] irq_exit_rcu+0x98/0xc0 [ 9068.616158][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9068.616436][ C2] [ 9068.616580][ C2] [ 9068.616749][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9068.617049][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9068.617305][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9068.618270][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9068.618584][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9068.618971][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9068.619357][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9068.619742][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9068.620127][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9068.620516][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9068.620795][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9068.621046][ C2] default_idle_call+0x69/0xa0 [ 9068.621283][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9068.621527][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9068.621793][ C2] ? lock_release+0x1d5/0x250 [ 9068.622025][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9068.622289][ C2] do_idle+0xfb/0x160 [ 9068.622486][ C2] cpu_startup_entry+0x55/0x60 [ 9068.622721][ C2] start_secondary+0x21c/0x2b0 [ 9068.622957][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9068.623218][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9068.623517][ C2] [ 9068.623670][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6254s! [perl:4135] [ 9068.624070][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9068.625294][ C1] irq event stamp: 209232 [ 9068.625508][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9068.626022][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9068.626488][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9068.626976][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9068.627438][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9068.627897][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9068.628493][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9068.628811][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9068.629762][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9068.630060][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9068.630453][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9068.630842][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9068.631232][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9068.631622][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9068.632013][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9068.632451][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9068.632775][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9068.633166][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9068.633557][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9068.633947][ C1] PKRU: 55555554 [ 9068.634125][ C1] Call Trace: [ 9068.634289][ C1] [ 9068.634436][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9068.634692][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9068.634933][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9068.635204][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9068.635470][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9068.635754][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9068.636013][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9068.636313][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9068.636569][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9068.636897][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9068.637197][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9068.637513][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9068.637803][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9068.638106][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9068.638390][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9068.638693][ C1] ? get_stack_info+0x36/0xc0 [ 9068.638930][ C1] ? lock_acquire+0x1c1/0x220 [ 9068.639166][ C1] ? lock_release+0x1d5/0x250 [ 9068.639403][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9068.639646][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9068.639913][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9068.640190][ C1] ? lock_acquire+0x1c1/0x220 [ 9068.640425][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9068.640660][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9068.640917][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9068.641145][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9068.641388][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9068.641643][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9068.641912][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9068.642184][ C1] ip_local_deliver+0x19d/0x480 [ 9068.642427][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9068.642692][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9068.642950][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9068.643290][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9068.643537][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9068.643850][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9068.644106][ C1] ip_rcv+0x564/0x740 [ 9068.644308][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9068.644532][ C1] ? set_track_prepare+0x8a/0xd0 [ 9068.644778][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9068.645048][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9068.645317][ C1] ? skb_clone+0x10b/0x330 [ 9068.645537][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9068.645849][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9068.646148][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9068.646422][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9068.646733][ C1] ? __tcf_classify+0x329/0x7d0 [ 9068.646982][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9068.647213][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9068.647515][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9068.647800][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9068.648129][ C1] ? lock_acquire+0x1c1/0x220 [ 9068.648363][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9068.648653][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9068.648930][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9068.649240][ C1] ? __copy_skb_header+0xaf/0x490 [ 9068.649490][ C1] ? __skb_clone+0x57a/0x760 [ 9068.649720][ C1] netif_receive_skb+0x55/0x280 [ 9068.649963][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9068.650269][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9068.650594][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9068.650884][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9068.651155][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9068.651437][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9068.651742][ C1] ? hlock_class+0x4e/0x130 [ 9068.651969][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9068.652241][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9068.652510][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9068.652767][ C1] ? hlock_class+0x4e/0x130 [ 9068.652993][ C1] ? mark_lock+0x38/0x3e0 [ 9068.653207][ C1] ? stack_access_ok+0xda/0x1f0 [ 9068.653450][ C1] ? __lock_acquire+0xb67/0x1610 [ 9068.653698][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9068.653967][ C1] ? get_stack_info+0x36/0xc0 [ 9068.654203][ C1] ? stack_access_ok+0xda/0x1f0 [ 9068.654445][ C1] ? get_reg+0x119/0x190 [ 9068.654655][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9068.654922][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9068.655223][ C1] __tcf_classify+0x329/0x7d0 [ 9068.655461][ C1] tcf_classify+0x283/0x930 [ 9068.655688][ C1] ? arch_stack_walk+0xa2/0x100 [ 9068.655930][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9068.656182][ C1] ? get_stack_info+0x36/0xc0 [ 9068.656416][ C1] tc_run+0x2e4/0x5d0 [ 9068.656619][ C1] ? __pfx_tc_run+0x10/0x10 [ 9068.656870][ C1] ? lock_acquire+0x1c1/0x220 [ 9068.657110][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9068.657373][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9068.657627][ C1] ? lock_acquire+0x1c1/0x220 [ 9068.657877][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9068.658135][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9068.658434][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9068.658718][ C1] ? neigh_hh_output+0x348/0x590 [ 9068.658972][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9068.659239][ C1] ip_finish_output2+0x786/0x18e0 [ 9068.659497][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9068.659775][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9068.660117][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9068.660390][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9068.660638][ C1] ? __ip_finish_output+0x10f/0x770 [ 9068.660897][ C1] ip_output+0x16b/0x4f0 [ 9068.661107][ C1] ? run_timer_softirq+0x72/0x100 [ 9068.661359][ C1] ? __pfx_ip_output+0x10/0x10 [ 9068.661597][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9068.661876][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9068.662123][ C1] ? ip_local_out+0x114/0x3b0 [ 9068.662361][ C1] __ip_queue_xmit+0x672/0x1910 [ 9068.662604][ C1] ? __create_object+0x5e/0xb0 [ 9068.662844][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9068.663105][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9068.663381][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9068.663648][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9068.663924][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9068.664191][ C1] tcp_delack_timer+0x84/0x240 [ 9068.664430][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9068.664695][ C1] call_timer_fn+0x173/0x430 [ 9068.664926][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9068.665183][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9068.665439][ C1] __run_timers.part.0+0x52d/0x890 [ 9068.665693][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9068.665959][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9068.666241][ C1] ? lock_acquire+0x1c1/0x220 [ 9068.666474][ C1] ? clockevents_program_event+0xf6/0x300 [ 9068.666780][ C1] ? lock_release+0x1d5/0x250 [ 9068.667020][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9068.667286][ C1] ? ktime_get+0xb3/0x190 [ 9068.667506][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9068.667805][ C1] run_timer_softirq+0x72/0x100 [ 9068.668060][ C1] __do_softirq+0x1b9/0x7ff [ 9068.668287][ C1] irq_exit_rcu+0x98/0xc0 [ 9068.668503][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9068.668781][ C1] [ 9068.668929][ C1] [ 9068.669075][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9068.669375][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9068.669692][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9068.670642][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9068.670944][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9068.671336][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9068.671725][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9068.672116][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9068.672507][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9068.672898][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9068.673189][ C1] pipe_read+0xa16/0xdf0 [ 9068.673405][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9068.673675][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9068.673914][ C1] ? iterate_tty_write+0x299/0x540 [ 9068.674170][ C1] ? lock_release+0x1d5/0x250 [ 9068.674407][ C1] vfs_read+0x911/0xc00 [ 9068.674616][ C1] ? lock_acquire+0x1c1/0x220 [ 9068.674853][ C1] ? __might_fault+0xc6/0x180 [ 9068.675089][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9068.675324][ C1] ? __might_fault+0xc6/0x180 [ 9068.675557][ C1] ? lock_release+0x1d5/0x250 [ 9068.675792][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9068.676050][ C1] ? __fget_light+0x54/0x1e0 [ 9068.676284][ C1] ksys_read+0x17a/0x1e0 [ 9068.676496][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9068.676758][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9068.677064][ C1] do_syscall_64+0xc9/0x1e0 [ 9068.677299][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9068.677600][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9068.677829][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9068.678786][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9068.679195][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9068.679589][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9068.679979][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9068.680370][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9068.680759][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9068.681154][ C1] [ 9093.936103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9093.936454][ C1] rcu: 1-....: (6722291 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1608032 [ 9093.937004][ C1] rcu: (t=6739049 jiffies g=1882453 q=721 ncpus=4) [ 9093.937329][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9093.937766][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9093.938364][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9093.938684][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9093.939634][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9093.939933][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9093.940325][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9093.940712][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9093.941100][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9093.941491][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9093.941881][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9093.942318][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9093.942642][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9093.943032][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9093.943423][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9093.943813][ C1] PKRU: 55555554 [ 9093.943991][ C1] Call Trace: [ 9093.944155][ C1] [ 9093.944301][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9093.944567][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9093.944814][ C1] ? check_cpu_stall+0x284/0x500 [ 9093.945060][ C1] ? rcu_pending+0x92/0x360 [ 9093.945285][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9093.945549][ C1] ? update_process_times+0xb9/0x110 [ 9093.945812][ C1] ? tick_sched_handle+0x67/0x130 [ 9093.946065][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9093.946343][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9093.946584][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9093.946889][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9093.947155][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9093.947437][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9093.947696][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9093.947994][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9093.948251][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9093.948552][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9093.948841][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9093.949148][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9093.949430][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9093.949720][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9093.950001][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9093.950305][ C1] ? get_stack_info+0x36/0xc0 [ 9093.950541][ C1] ? lock_acquire+0x1c1/0x220 [ 9093.950776][ C1] ? lock_release+0x1d5/0x250 [ 9093.951010][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9093.951253][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9093.951520][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9093.951798][ C1] ? lock_acquire+0x1c1/0x220 [ 9093.952031][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9093.952267][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9093.952521][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9093.952751][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9093.952992][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9093.953244][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9093.953512][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9093.953784][ C1] ip_local_deliver+0x19d/0x480 [ 9093.954025][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9093.954292][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9093.954550][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9093.954888][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9093.955135][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9093.955447][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9093.955703][ C1] ip_rcv+0x564/0x740 [ 9093.955903][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9093.956127][ C1] ? set_track_prepare+0x8a/0xd0 [ 9093.956375][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9093.956649][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9093.956917][ C1] ? skb_clone+0x10b/0x330 [ 9093.957138][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9093.957449][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9093.957748][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9093.958022][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9093.958313][ C1] ? __tcf_classify+0x329/0x7d0 [ 9093.958555][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9093.958779][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9093.959072][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9093.959353][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9093.959671][ C1] ? lock_acquire+0x1c1/0x220 [ 9093.959903][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9093.960193][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9093.960470][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9093.960779][ C1] ? __copy_skb_header+0xaf/0x490 [ 9093.961031][ C1] ? __skb_clone+0x57a/0x760 [ 9093.961262][ C1] netif_receive_skb+0x55/0x280 [ 9093.961505][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9093.961809][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9093.962134][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9093.962426][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9093.962695][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9093.962976][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9093.963283][ C1] ? hlock_class+0x4e/0x130 [ 9093.963507][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9093.963780][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9093.964048][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9093.964307][ C1] ? hlock_class+0x4e/0x130 [ 9093.964534][ C1] ? mark_lock+0x38/0x3e0 [ 9093.964747][ C1] ? stack_access_ok+0xda/0x1f0 [ 9093.964989][ C1] ? __lock_acquire+0xb67/0x1610 [ 9093.965238][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9093.965507][ C1] ? get_stack_info+0x36/0xc0 [ 9093.965741][ C1] ? stack_access_ok+0xda/0x1f0 [ 9093.965982][ C1] ? get_reg+0x119/0x190 [ 9093.966193][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9093.966455][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9093.966781][ C1] __tcf_classify+0x329/0x7d0 [ 9093.967024][ C1] tcf_classify+0x283/0x930 [ 9093.967258][ C1] ? arch_stack_walk+0xa2/0x100 [ 9093.967508][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9093.967765][ C1] ? get_stack_info+0x36/0xc0 [ 9093.968009][ C1] tc_run+0x2e4/0x5d0 [ 9093.968211][ C1] ? __pfx_tc_run+0x10/0x10 [ 9093.968437][ C1] ? lock_acquire+0x1c1/0x220 [ 9093.968671][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9093.968926][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9093.969174][ C1] ? lock_acquire+0x1c1/0x220 [ 9093.969407][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9093.969665][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9093.969962][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9093.970229][ C1] ? neigh_hh_output+0x348/0x590 [ 9093.970476][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9093.970735][ C1] ip_finish_output2+0x786/0x18e0 [ 9093.970985][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9093.971257][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9093.971586][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9093.971858][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9093.972104][ C1] ? __ip_finish_output+0x10f/0x770 [ 9093.972364][ C1] ip_output+0x16b/0x4f0 [ 9093.972574][ C1] ? run_timer_softirq+0x72/0x100 [ 9093.972825][ C1] ? __pfx_ip_output+0x10/0x10 [ 9093.973064][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9093.973344][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9093.973589][ C1] ? ip_local_out+0x114/0x3b0 [ 9093.973825][ C1] __ip_queue_xmit+0x672/0x1910 [ 9093.974068][ C1] ? __create_object+0x5e/0xb0 [ 9093.974307][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9093.974568][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9093.974843][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9093.975109][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9093.975386][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9093.975652][ C1] tcp_delack_timer+0x84/0x240 [ 9093.975889][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9093.976154][ C1] call_timer_fn+0x173/0x430 [ 9093.976387][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9093.976665][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9093.976927][ C1] __run_timers.part.0+0x52d/0x890 [ 9093.977189][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9093.977464][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9093.977760][ C1] ? lock_acquire+0x1c1/0x220 [ 9093.977991][ C1] ? clockevents_program_event+0xf6/0x300 [ 9093.978277][ C1] ? lock_release+0x1d5/0x250 [ 9093.978511][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9093.978769][ C1] ? ktime_get+0xb3/0x190 [ 9093.978983][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9093.979274][ C1] run_timer_softirq+0x72/0x100 [ 9093.979518][ C1] __do_softirq+0x1b9/0x7ff [ 9093.979743][ C1] irq_exit_rcu+0x98/0xc0 [ 9093.979961][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9093.980238][ C1] [ 9093.980387][ C1] [ 9093.980533][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9093.980830][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9093.981148][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9093.982097][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9093.982399][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9093.982789][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9093.983177][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9093.983568][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9093.983960][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9093.984359][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9093.984649][ C1] pipe_read+0xa16/0xdf0 [ 9093.984864][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9093.985133][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9093.985373][ C1] ? iterate_tty_write+0x299/0x540 [ 9093.985628][ C1] ? lock_release+0x1d5/0x250 [ 9093.985863][ C1] vfs_read+0x911/0xc00 [ 9093.986071][ C1] ? lock_acquire+0x1c1/0x220 [ 9093.986306][ C1] ? __might_fault+0xc6/0x180 [ 9093.986546][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9093.986801][ C1] ? __might_fault+0xc6/0x180 [ 9093.987040][ C1] ? lock_release+0x1d5/0x250 [ 9093.987281][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9093.987547][ C1] ? __fget_light+0x54/0x1e0 [ 9093.987796][ C1] ksys_read+0x17a/0x1e0 [ 9093.988006][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9093.988246][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9093.988544][ C1] do_syscall_64+0xc9/0x1e0 [ 9093.988769][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9093.989062][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9093.989286][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9093.990236][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9093.990646][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9093.991038][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9093.991430][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9093.991818][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9093.992207][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9093.992600][ C1] [ 9093.992754][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9093.993018][ C2] NMI backtrace for cpu 2 [ 9093.993027][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9093.993033][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9093.993037][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9093.993045][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9093.993050][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9093.993055][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9093.993058][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9093.993061][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9093.993062][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9093.993064][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9093.993066][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9093.993068][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9093.993072][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9093.993074][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9093.993075][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9093.993077][ C2] PKRU: 55555554 [ 9093.993078][ C2] Call Trace: [ 9093.993079][ C2] [ 9093.993081][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9093.993087][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9093.993092][ C2] ? nmi_handle+0x153/0x420 [ 9093.993096][ C2] ? default_do_nmi+0x41/0x100 [ 9093.993099][ C2] ? exc_nmi+0xf3/0x120 [ 9093.993101][ C2] ? end_repeat_nmi+0xf/0x60 [ 9093.993107][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9093.993110][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9093.993113][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9093.993117][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9093.993121][ C2] [ 9093.993121][ C2] [ 9093.993123][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9093.993125][ C2] ? get_stack_info+0x36/0xc0 [ 9093.993129][ C2] ? lock_acquire+0x1c1/0x220 [ 9093.993133][ C2] ? lock_release+0x1d5/0x250 [ 9093.993136][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9093.993139][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9093.993142][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9093.993145][ C2] ? lock_acquire+0x1c1/0x220 [ 9093.993147][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9093.993151][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9093.993154][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9093.993159][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9093.993162][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9093.993166][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9093.993170][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9093.993173][ C2] ip_local_deliver+0x19d/0x480 [ 9093.993176][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9093.993178][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9093.993180][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9093.993185][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9093.993188][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9093.993191][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9093.993200][ C2] ip_rcv+0x564/0x740 [ 9093.993202][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9093.993205][ C2] ? set_track_prepare+0x8a/0xd0 [ 9093.993209][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9093.993212][ C2] ? start_secondary+0x21c/0x2b0 [ 9093.993215][ C2] ? skb_clone+0x10b/0x330 [ 9093.993218][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9093.993224][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9093.993229][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9093.993233][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9093.993240][ C2] ? __tcf_classify+0x329/0x7d0 [ 9093.993244][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9093.993246][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9093.993250][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9093.993253][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9093.993257][ C2] ? lock_acquire+0x1c1/0x220 [ 9093.993260][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9093.993264][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9093.993267][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9093.993271][ C2] ? __copy_skb_header+0xaf/0x490 [ 9093.993275][ C2] ? __skb_clone+0x57a/0x760 [ 9093.993277][ C2] netif_receive_skb+0x55/0x280 [ 9093.993280][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9093.993287][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9093.993294][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9093.993300][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9093.993304][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9093.993314][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9093.993321][ C2] ? get_stack_info+0x36/0xc0 [ 9093.993325][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9093.993328][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9093.993331][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9093.993334][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9093.993337][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9093.993339][ C2] ? kernel_text_address+0x17/0xe0 [ 9093.993342][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9093.993346][ C2] ? arch_stack_walk+0x8c/0x100 [ 9093.993349][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9093.993352][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9093.993356][ C2] ? lock_acquire+0x1c1/0x220 [ 9093.993358][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9093.993362][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9093.993366][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9093.993369][ C2] ? get_stack_info+0x36/0xc0 [ 9093.993373][ C2] __tcf_classify+0x329/0x7d0 [ 9093.993378][ C2] tcf_classify+0x283/0x930 [ 9093.993382][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9093.993385][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9093.993389][ C2] tc_run+0x2e4/0x5d0 [ 9093.993393][ C2] ? __pfx_tc_run+0x10/0x10 [ 9093.993396][ C2] ? lock_acquire+0x1c1/0x220 [ 9093.993398][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9093.993402][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9093.993407][ C2] ? lock_acquire+0x1c1/0x220 [ 9093.993409][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9093.993412][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9093.993416][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9093.993419][ C2] ? neigh_hh_output+0x348/0x590 [ 9093.993422][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9093.993425][ C2] ip_finish_output2+0x786/0x18e0 [ 9093.993429][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9093.993436][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9093.993439][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9093.993443][ C2] ? __ip_finish_output+0x10f/0x770 [ 9093.993446][ C2] ip_output+0x16b/0x4f0 [ 9093.993449][ C2] ? __pfx_ip_output+0x10/0x10 [ 9093.993452][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9093.993454][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9093.993457][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9093.993460][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9093.993462][ C2] ? __alloc_skb+0xd4/0x280 [ 9093.993465][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9093.993468][ C2] ? tcp_fragment+0x168/0x1040 [ 9093.993471][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9093.993474][ C2] ? ip_local_out+0x114/0x3b0 [ 9093.993477][ C2] __ip_queue_xmit+0x672/0x1910 [ 9093.993480][ C2] ? __skb_clone+0x57a/0x760 [ 9093.993483][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9093.993488][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9093.993491][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9093.993494][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9093.993498][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9093.993502][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9093.993505][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9093.993508][ C2] tcp_send_loss_probe+0x348/0x830 [ 9093.993511][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9093.993514][ C2] tcp_write_timer+0x82/0x1d0 [ 9093.993517][ C2] call_timer_fn+0x173/0x430 [ 9093.993520][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9093.993524][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9093.993528][ C2] __run_timers.part.0+0x52d/0x890 [ 9093.993531][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9093.993535][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9093.993538][ C2] ? lock_acquire+0x1c1/0x220 [ 9093.993540][ C2] ? clockevents_program_event+0xf6/0x300 [ 9093.993544][ C2] ? lock_release+0x1d5/0x250 [ 9093.993547][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9093.993550][ C2] ? ktime_get+0xb3/0x190 [ 9093.993553][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9093.993558][ C2] run_timer_softirq+0x72/0x100 [ 9093.993561][ C2] __do_softirq+0x1b9/0x7ff [ 9093.993566][ C2] irq_exit_rcu+0x98/0xc0 [ 9093.993568][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9093.993572][ C2] [ 9093.993573][ C2] [ 9093.993574][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9093.993577][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9093.993580][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9093.993582][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9093.993585][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9093.993586][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9093.993587][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9093.993588][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9093.993590][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9093.993593][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9093.993596][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9093.993598][ C2] default_idle_call+0x69/0xa0 [ 9093.993601][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9093.993603][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9093.993607][ C2] ? lock_release+0x1d5/0x250 [ 9093.993609][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9093.993613][ C2] do_idle+0xfb/0x160 [ 9093.993616][ C2] cpu_startup_entry+0x55/0x60 [ 9093.993618][ C2] start_secondary+0x21c/0x2b0 [ 9093.993621][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9093.993625][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9093.993630][ C2] [ 9120.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6303s! [swapper/2:0] [ 9120.569672][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9120.570885][ C2] irq event stamp: 44114564 [ 9120.571105][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9120.571626][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9120.572121][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9120.572582][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9120.573034][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9120.573475][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9120.574068][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9120.574382][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9120.575320][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9120.575617][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9120.576001][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9120.576386][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9120.576775][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9120.577164][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9120.577548][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9120.577980][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9120.578303][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9120.578692][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9120.579077][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9120.579463][ C2] PKRU: 55555554 [ 9120.579640][ C2] Call Trace: [ 9120.579805][ C2] [ 9120.579947][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9120.580201][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9120.580437][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9120.580704][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9120.580970][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9120.581250][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9120.581505][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9120.581801][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9120.582054][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9120.582308][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9120.582608][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9120.582895][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9120.583198][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9120.583480][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9120.583768][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9120.584048][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9120.584353][ C2] ? get_stack_info+0x36/0xc0 [ 9120.584587][ C2] ? lock_acquire+0x1c1/0x220 [ 9120.584817][ C2] ? lock_release+0x1d5/0x250 [ 9120.585052][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9120.585294][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9120.585558][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9120.585835][ C2] ? lock_acquire+0x1c1/0x220 [ 9120.586065][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9120.586299][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9120.586574][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9120.586808][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9120.587055][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9120.587313][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9120.587586][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9120.587863][ C2] ip_local_deliver+0x19d/0x480 [ 9120.588102][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9120.588365][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9120.588622][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9120.588958][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9120.589204][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9120.589514][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9120.589766][ C2] ip_rcv+0x564/0x740 [ 9120.589963][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9120.590188][ C2] ? set_track_prepare+0x8a/0xd0 [ 9120.590434][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9120.590701][ C2] ? start_secondary+0x21c/0x2b0 [ 9120.590944][ C2] ? skb_clone+0x10b/0x330 [ 9120.591163][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9120.591471][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9120.591768][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9120.592040][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9120.592326][ C2] ? __tcf_classify+0x329/0x7d0 [ 9120.592567][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9120.592789][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9120.593077][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9120.593355][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9120.593669][ C2] ? lock_acquire+0x1c1/0x220 [ 9120.593902][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9120.594190][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9120.594466][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9120.594773][ C2] ? __copy_skb_header+0xaf/0x490 [ 9120.595023][ C2] ? __skb_clone+0x57a/0x760 [ 9120.595252][ C2] netif_receive_skb+0x55/0x280 [ 9120.595492][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9120.595795][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9120.596116][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9120.596408][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9120.596700][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9120.596985][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9120.597297][ C2] ? get_stack_info+0x36/0xc0 [ 9120.597538][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9120.597806][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9120.598111][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9120.598379][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9120.598646][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9120.598950][ C2] ? kernel_text_address+0x17/0xe0 [ 9120.599204][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9120.599506][ C2] ? arch_stack_walk+0x8c/0x100 [ 9120.599748][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9120.600003][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9120.600282][ C2] ? lock_acquire+0x1c1/0x220 [ 9120.600513][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9120.600786][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9120.601082][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9120.601350][ C2] ? get_stack_info+0x36/0xc0 [ 9120.601582][ C2] __tcf_classify+0x329/0x7d0 [ 9120.601815][ C2] tcf_classify+0x283/0x930 [ 9120.602041][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9120.602289][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9120.602592][ C2] tc_run+0x2e4/0x5d0 [ 9120.602789][ C2] ? __pfx_tc_run+0x10/0x10 [ 9120.603013][ C2] ? lock_acquire+0x1c1/0x220 [ 9120.603245][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9120.603498][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9120.603741][ C2] ? lock_acquire+0x1c1/0x220 [ 9120.603972][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9120.604228][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9120.604523][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9120.604785][ C2] ? neigh_hh_output+0x348/0x590 [ 9120.605030][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9120.605289][ C2] ip_finish_output2+0x786/0x18e0 [ 9120.605539][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9120.605867][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9120.606135][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9120.606381][ C2] ? __ip_finish_output+0x10f/0x770 [ 9120.606664][ C2] ip_output+0x16b/0x4f0 [ 9120.606878][ C2] ? __pfx_ip_output+0x10/0x10 [ 9120.607123][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9120.607398][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9120.607717][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9120.607986][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9120.608230][ C2] ? __alloc_skb+0xd4/0x280 [ 9120.608453][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9120.608714][ C2] ? tcp_fragment+0x168/0x1040 [ 9120.608950][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9120.609194][ C2] ? ip_local_out+0x114/0x3b0 [ 9120.609430][ C2] __ip_queue_xmit+0x672/0x1910 [ 9120.609672][ C2] ? __skb_clone+0x57a/0x760 [ 9120.609898][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9120.610157][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9120.610430][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9120.610667][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9120.610909][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9120.611199][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9120.611513][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9120.611751][ C2] tcp_send_loss_probe+0x348/0x830 [ 9120.612003][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9120.612264][ C2] tcp_write_timer+0x82/0x1d0 [ 9120.612497][ C2] call_timer_fn+0x173/0x430 [ 9120.612726][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9120.612979][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9120.613233][ C2] __run_timers.part.0+0x52d/0x890 [ 9120.613486][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9120.613745][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9120.614023][ C2] ? lock_acquire+0x1c1/0x220 [ 9120.614254][ C2] ? clockevents_program_event+0xf6/0x300 [ 9120.614535][ C2] ? lock_release+0x1d5/0x250 [ 9120.614767][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9120.615023][ C2] ? ktime_get+0xb3/0x190 [ 9120.615237][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9120.615526][ C2] run_timer_softirq+0x72/0x100 [ 9120.615766][ C2] __do_softirq+0x1b9/0x7ff [ 9120.615990][ C2] irq_exit_rcu+0x98/0xc0 [ 9120.616205][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9120.616503][ C2] [ 9120.616654][ C2] [ 9120.616803][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9120.617105][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9120.617361][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9120.618311][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9120.618608][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9120.618993][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9120.619379][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9120.619765][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9120.620154][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9120.620541][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9120.620821][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9120.621073][ C2] default_idle_call+0x69/0xa0 [ 9120.621311][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9120.621554][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9120.621824][ C2] ? lock_release+0x1d5/0x250 [ 9120.622056][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9120.622322][ C2] do_idle+0xfb/0x160 [ 9120.622520][ C2] cpu_startup_entry+0x55/0x60 [ 9120.622755][ C2] start_secondary+0x21c/0x2b0 [ 9120.622989][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9120.623254][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9120.623553][ C2] [ 9120.623707][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6303s! [perl:4135] [ 9120.624108][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9120.625330][ C1] irq event stamp: 209232 [ 9120.625544][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9120.626059][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9120.626548][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9120.627017][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9120.627482][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9120.627931][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9120.628527][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9120.628843][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9120.629792][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9120.630091][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9120.630482][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9120.630872][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9120.631262][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9120.631651][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9120.632042][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9120.632480][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9120.632803][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9120.633197][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9120.633585][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9120.633976][ C1] PKRU: 55555554 [ 9120.634152][ C1] Call Trace: [ 9120.634317][ C1] [ 9120.634462][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9120.634717][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9120.634953][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9120.635226][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9120.635492][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9120.635774][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9120.636033][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9120.636331][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9120.636611][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9120.636920][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9120.637219][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9120.637535][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9120.637828][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9120.638117][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9120.638398][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9120.638703][ C1] ? get_stack_info+0x36/0xc0 [ 9120.638938][ C1] ? lock_acquire+0x1c1/0x220 [ 9120.639174][ C1] ? lock_release+0x1d5/0x250 [ 9120.639408][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9120.639651][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9120.639919][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9120.640198][ C1] ? lock_acquire+0x1c1/0x220 [ 9120.640432][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9120.640665][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9120.640920][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9120.641148][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9120.641390][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9120.641642][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9120.641909][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9120.642182][ C1] ip_local_deliver+0x19d/0x480 [ 9120.642423][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9120.642688][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9120.642946][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9120.643284][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9120.643530][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9120.643842][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9120.644096][ C1] ip_rcv+0x564/0x740 [ 9120.644298][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9120.644525][ C1] ? set_track_prepare+0x8a/0xd0 [ 9120.644772][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9120.645041][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9120.645309][ C1] ? skb_clone+0x10b/0x330 [ 9120.645530][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9120.645841][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9120.646141][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9120.646414][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9120.646729][ C1] ? __tcf_classify+0x329/0x7d0 [ 9120.646977][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9120.647208][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9120.647509][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9120.647804][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9120.648120][ C1] ? lock_acquire+0x1c1/0x220 [ 9120.648355][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9120.648645][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9120.648921][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9120.649231][ C1] ? __copy_skb_header+0xaf/0x490 [ 9120.649482][ C1] ? __skb_clone+0x57a/0x760 [ 9120.649711][ C1] netif_receive_skb+0x55/0x280 [ 9120.649953][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9120.650259][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9120.650584][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9120.650874][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9120.651142][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9120.651426][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9120.651731][ C1] ? hlock_class+0x4e/0x130 [ 9120.651956][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9120.652229][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9120.652497][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9120.652754][ C1] ? hlock_class+0x4e/0x130 [ 9120.652981][ C1] ? mark_lock+0x38/0x3e0 [ 9120.653195][ C1] ? stack_access_ok+0xda/0x1f0 [ 9120.653438][ C1] ? __lock_acquire+0xb67/0x1610 [ 9120.653687][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9120.653956][ C1] ? get_stack_info+0x36/0xc0 [ 9120.654191][ C1] ? stack_access_ok+0xda/0x1f0 [ 9120.654433][ C1] ? get_reg+0x119/0x190 [ 9120.654644][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9120.654906][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9120.655209][ C1] __tcf_classify+0x329/0x7d0 [ 9120.655445][ C1] tcf_classify+0x283/0x930 [ 9120.655671][ C1] ? arch_stack_walk+0xa2/0x100 [ 9120.655913][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9120.656164][ C1] ? get_stack_info+0x36/0xc0 [ 9120.656399][ C1] tc_run+0x2e4/0x5d0 [ 9120.656625][ C1] ? __pfx_tc_run+0x10/0x10 [ 9120.656856][ C1] ? lock_acquire+0x1c1/0x220 [ 9120.657096][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9120.657359][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9120.657624][ C1] ? lock_acquire+0x1c1/0x220 [ 9120.657857][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9120.658115][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9120.658412][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9120.658679][ C1] ? neigh_hh_output+0x348/0x590 [ 9120.658926][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9120.659185][ C1] ip_finish_output2+0x786/0x18e0 [ 9120.659435][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9120.659705][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9120.660033][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9120.660305][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9120.660551][ C1] ? __ip_finish_output+0x10f/0x770 [ 9120.660811][ C1] ip_output+0x16b/0x4f0 [ 9120.661021][ C1] ? run_timer_softirq+0x72/0x100 [ 9120.661273][ C1] ? __pfx_ip_output+0x10/0x10 [ 9120.661511][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9120.661789][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9120.662035][ C1] ? ip_local_out+0x114/0x3b0 [ 9120.662271][ C1] __ip_queue_xmit+0x672/0x1910 [ 9120.662514][ C1] ? __create_object+0x5e/0xb0 [ 9120.662753][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9120.663013][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9120.663288][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9120.663553][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9120.663829][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9120.664097][ C1] tcp_delack_timer+0x84/0x240 [ 9120.664336][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9120.664601][ C1] call_timer_fn+0x173/0x430 [ 9120.664832][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9120.665087][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9120.665343][ C1] __run_timers.part.0+0x52d/0x890 [ 9120.665597][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9120.665863][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9120.666142][ C1] ? lock_acquire+0x1c1/0x220 [ 9120.666374][ C1] ? clockevents_program_event+0xf6/0x300 [ 9120.666684][ C1] ? lock_release+0x1d5/0x250 [ 9120.666923][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9120.667189][ C1] ? ktime_get+0xb3/0x190 [ 9120.667409][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9120.667718][ C1] run_timer_softirq+0x72/0x100 [ 9120.667960][ C1] __do_softirq+0x1b9/0x7ff [ 9120.668185][ C1] irq_exit_rcu+0x98/0xc0 [ 9120.668401][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9120.668679][ C1] [ 9120.668827][ C1] [ 9120.668973][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9120.669271][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9120.669587][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9120.670532][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9120.670832][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9120.671222][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9120.671610][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9120.671999][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9120.672391][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9120.672780][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9120.673071][ C1] pipe_read+0xa16/0xdf0 [ 9120.673287][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9120.673556][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9120.673794][ C1] ? iterate_tty_write+0x299/0x540 [ 9120.674048][ C1] ? lock_release+0x1d5/0x250 [ 9120.674285][ C1] vfs_read+0x911/0xc00 [ 9120.674493][ C1] ? lock_acquire+0x1c1/0x220 [ 9120.674727][ C1] ? __might_fault+0xc6/0x180 [ 9120.674962][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9120.675195][ C1] ? __might_fault+0xc6/0x180 [ 9120.675429][ C1] ? lock_release+0x1d5/0x250 [ 9120.675663][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9120.675921][ C1] ? __fget_light+0x54/0x1e0 [ 9120.676153][ C1] ksys_read+0x17a/0x1e0 [ 9120.676366][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9120.676629][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9120.676933][ C1] do_syscall_64+0xc9/0x1e0 [ 9120.677165][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9120.677467][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9120.677706][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9120.678651][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9120.679060][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9120.679452][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9120.679840][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9120.680229][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9120.680617][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9120.681012][ C1] [ 9148.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6329s! [perl:4135] [ 9148.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9148.570915][ C1] irq event stamp: 209232 [ 9148.571129][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9148.571645][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9148.572111][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9148.572570][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9148.573018][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9148.573456][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9148.574055][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9148.574373][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9148.575320][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9148.575619][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9148.576008][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9148.576401][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9148.576789][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9148.577181][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9148.577571][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9148.578007][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9148.578332][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9148.578723][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9148.579113][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9148.579504][ C1] PKRU: 55555554 [ 9148.579681][ C1] Call Trace: [ 9148.579847][ C1] [ 9148.579992][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9148.580248][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9148.580486][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9148.580756][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9148.581021][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9148.581304][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9148.581563][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9148.581863][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9148.582118][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9148.582422][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9148.582710][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9148.583016][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9148.583300][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9148.583587][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9148.583870][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9148.584174][ C1] ? get_stack_info+0x36/0xc0 [ 9148.584408][ C1] ? lock_acquire+0x1c1/0x220 [ 9148.584643][ C1] ? lock_release+0x1d5/0x250 [ 9148.584879][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9148.585124][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9148.585391][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9148.585667][ C1] ? lock_acquire+0x1c1/0x220 [ 9148.585901][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9148.586135][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9148.586412][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9148.586647][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9148.586893][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9148.587152][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9148.587432][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9148.587716][ C1] ip_local_deliver+0x19d/0x480 [ 9148.587960][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9148.588227][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9148.588486][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9148.588828][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9148.589077][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9148.589392][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9148.589650][ C1] ip_rcv+0x564/0x740 [ 9148.589851][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9148.590076][ C1] ? set_track_prepare+0x8a/0xd0 [ 9148.590326][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9148.590599][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9148.590866][ C1] ? skb_clone+0x10b/0x330 [ 9148.591089][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9148.591404][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9148.591706][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9148.591983][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9148.592275][ C1] ? __tcf_classify+0x329/0x7d0 [ 9148.592519][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9148.592745][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9148.593039][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9148.593321][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9148.593641][ C1] ? lock_acquire+0x1c1/0x220 [ 9148.593874][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9148.594167][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9148.594451][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9148.594761][ C1] ? __copy_skb_header+0xaf/0x490 [ 9148.595015][ C1] ? __skb_clone+0x57a/0x760 [ 9148.595249][ C1] netif_receive_skb+0x55/0x280 [ 9148.595493][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9148.595802][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9148.596127][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9148.596447][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9148.596725][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9148.597014][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9148.597330][ C1] ? hlock_class+0x4e/0x130 [ 9148.597576][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9148.597845][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9148.598116][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9148.598374][ C1] ? hlock_class+0x4e/0x130 [ 9148.598601][ C1] ? mark_lock+0x38/0x3e0 [ 9148.598815][ C1] ? stack_access_ok+0xda/0x1f0 [ 9148.599060][ C1] ? __lock_acquire+0xb67/0x1610 [ 9148.599313][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9148.599583][ C1] ? get_stack_info+0x36/0xc0 [ 9148.599818][ C1] ? stack_access_ok+0xda/0x1f0 [ 9148.600061][ C1] ? get_reg+0x119/0x190 [ 9148.600275][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9148.600539][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9148.600841][ C1] __tcf_classify+0x329/0x7d0 [ 9148.601077][ C1] tcf_classify+0x283/0x930 [ 9148.601307][ C1] ? arch_stack_walk+0xa2/0x100 [ 9148.601552][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9148.601805][ C1] ? get_stack_info+0x36/0xc0 [ 9148.602043][ C1] tc_run+0x2e4/0x5d0 [ 9148.602246][ C1] ? __pfx_tc_run+0x10/0x10 [ 9148.602470][ C1] ? lock_acquire+0x1c1/0x220 [ 9148.602706][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9148.602962][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9148.603211][ C1] ? lock_acquire+0x1c1/0x220 [ 9148.603445][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9148.603705][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9148.604005][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9148.604273][ C1] ? neigh_hh_output+0x348/0x590 [ 9148.604522][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9148.604781][ C1] ip_finish_output2+0x786/0x18e0 [ 9148.605032][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9148.605304][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9148.605636][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9148.605908][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9148.606156][ C1] ? __ip_finish_output+0x10f/0x770 [ 9148.606440][ C1] ip_output+0x16b/0x4f0 [ 9148.606657][ C1] ? run_timer_softirq+0x72/0x100 [ 9148.606915][ C1] ? __pfx_ip_output+0x10/0x10 [ 9148.607159][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9148.607449][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9148.607707][ C1] ? ip_local_out+0x114/0x3b0 [ 9148.607941][ C1] __ip_queue_xmit+0x672/0x1910 [ 9148.608184][ C1] ? __create_object+0x5e/0xb0 [ 9148.608424][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9148.608685][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9148.608960][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9148.609230][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9148.609505][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9148.609771][ C1] tcp_delack_timer+0x84/0x240 [ 9148.610011][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9148.610277][ C1] call_timer_fn+0x173/0x430 [ 9148.610509][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9148.610766][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9148.611022][ C1] __run_timers.part.0+0x52d/0x890 [ 9148.611277][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9148.611545][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9148.611824][ C1] ? lock_acquire+0x1c1/0x220 [ 9148.612058][ C1] ? clockevents_program_event+0xf6/0x300 [ 9148.612343][ C1] ? lock_release+0x1d5/0x250 [ 9148.612581][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9148.612841][ C1] ? ktime_get+0xb3/0x190 [ 9148.613058][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9148.613350][ C1] run_timer_softirq+0x72/0x100 [ 9148.613594][ C1] __do_softirq+0x1b9/0x7ff [ 9148.613823][ C1] irq_exit_rcu+0x98/0xc0 [ 9148.614039][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9148.614322][ C1] [ 9148.614470][ C1] [ 9148.614617][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9148.614916][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9148.615237][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9148.616192][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9148.616519][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9148.616920][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9148.617323][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9148.617729][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9148.618120][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9148.618514][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9148.618805][ C1] pipe_read+0xa16/0xdf0 [ 9148.619020][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9148.619293][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9148.619530][ C1] ? iterate_tty_write+0x299/0x540 [ 9148.619787][ C1] ? lock_release+0x1d5/0x250 [ 9148.620024][ C1] vfs_read+0x911/0xc00 [ 9148.620234][ C1] ? lock_acquire+0x1c1/0x220 [ 9148.620468][ C1] ? __might_fault+0xc6/0x180 [ 9148.620705][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9148.620940][ C1] ? __might_fault+0xc6/0x180 [ 9148.621174][ C1] ? lock_release+0x1d5/0x250 [ 9148.621410][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9148.621668][ C1] ? __fget_light+0x54/0x1e0 [ 9148.621901][ C1] ksys_read+0x17a/0x1e0 [ 9148.622113][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9148.622355][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9148.622654][ C1] do_syscall_64+0xc9/0x1e0 [ 9148.622882][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9148.623174][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9148.623400][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9148.624348][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9148.624761][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9148.625153][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9148.625545][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9148.625935][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9148.626330][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9148.626751][ C1] [ 9148.626908][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6329s! [swapper/2:0] [ 9148.627323][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9148.628543][ C2] irq event stamp: 44114564 [ 9148.628766][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9148.629282][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9148.629776][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9148.630241][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9148.630692][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9148.631133][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9148.631727][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9148.632040][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9148.632980][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9148.633279][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9148.633664][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9148.634047][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9148.634434][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9148.634819][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9148.635205][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9148.635636][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9148.635956][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9148.636368][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9148.636765][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9148.637162][ C2] PKRU: 55555554 [ 9148.637344][ C2] Call Trace: [ 9148.637513][ C2] [ 9148.637666][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9148.637919][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9148.638155][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9148.638423][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9148.638686][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9148.638967][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9148.639225][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9148.639520][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9148.639773][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9148.640026][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9148.640327][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9148.640611][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9148.640917][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9148.641200][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9148.641484][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9148.641768][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9148.642069][ C2] ? get_stack_info+0x36/0xc0 [ 9148.642302][ C2] ? lock_acquire+0x1c1/0x220 [ 9148.642533][ C2] ? lock_release+0x1d5/0x250 [ 9148.642766][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9148.643007][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9148.643271][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9148.643547][ C2] ? lock_acquire+0x1c1/0x220 [ 9148.643777][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9148.644010][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9148.644263][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9148.644491][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9148.644730][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9148.644979][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9148.645245][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9148.645512][ C2] ip_local_deliver+0x19d/0x480 [ 9148.645751][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9148.646012][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9148.646268][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9148.646633][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9148.646883][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9148.647202][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9148.647462][ C2] ip_rcv+0x564/0x740 [ 9148.647670][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9148.647893][ C2] ? set_track_prepare+0x8a/0xd0 [ 9148.648139][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9148.648409][ C2] ? start_secondary+0x21c/0x2b0 [ 9148.648651][ C2] ? skb_clone+0x10b/0x330 [ 9148.648868][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9148.649177][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9148.649473][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9148.649744][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9148.650029][ C2] ? __tcf_classify+0x329/0x7d0 [ 9148.650271][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9148.650493][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9148.650783][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9148.651058][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9148.651374][ C2] ? lock_acquire+0x1c1/0x220 [ 9148.651606][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9148.651892][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9148.652166][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9148.652473][ C2] ? __copy_skb_header+0xaf/0x490 [ 9148.652721][ C2] ? __skb_clone+0x57a/0x760 [ 9148.652949][ C2] netif_receive_skb+0x55/0x280 [ 9148.653189][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9148.653492][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9148.653814][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9148.654100][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9148.654368][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9148.654646][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9148.654948][ C2] ? get_stack_info+0x36/0xc0 [ 9148.655183][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9148.655439][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9148.655745][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9148.656011][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9148.656278][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9148.656610][ C2] ? kernel_text_address+0x17/0xe0 [ 9148.656866][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9148.657178][ C2] ? arch_stack_walk+0x8c/0x100 [ 9148.657424][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9148.657692][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9148.657967][ C2] ? lock_acquire+0x1c1/0x220 [ 9148.658197][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9148.658471][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9148.658765][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9148.659034][ C2] ? get_stack_info+0x36/0xc0 [ 9148.659267][ C2] __tcf_classify+0x329/0x7d0 [ 9148.659500][ C2] tcf_classify+0x283/0x930 [ 9148.659726][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9148.659974][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9148.660278][ C2] tc_run+0x2e4/0x5d0 [ 9148.660476][ C2] ? __pfx_tc_run+0x10/0x10 [ 9148.660699][ C2] ? lock_acquire+0x1c1/0x220 [ 9148.660928][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9148.661181][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9148.661426][ C2] ? lock_acquire+0x1c1/0x220 [ 9148.661657][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9148.661912][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9148.662206][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9148.662469][ C2] ? neigh_hh_output+0x348/0x590 [ 9148.662713][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9148.662967][ C2] ip_finish_output2+0x786/0x18e0 [ 9148.663216][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9148.663543][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9148.663811][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9148.664056][ C2] ? __ip_finish_output+0x10f/0x770 [ 9148.664313][ C2] ip_output+0x16b/0x4f0 [ 9148.664521][ C2] ? __pfx_ip_output+0x10/0x10 [ 9148.664756][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9148.665022][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9148.665325][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9148.665597][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9148.665840][ C2] ? __alloc_skb+0xd4/0x280 [ 9148.666062][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9148.666348][ C2] ? tcp_fragment+0x168/0x1040 [ 9148.666589][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9148.666842][ C2] ? ip_local_out+0x114/0x3b0 [ 9148.667081][ C2] __ip_queue_xmit+0x672/0x1910 [ 9148.667330][ C2] ? __skb_clone+0x57a/0x760 [ 9148.667570][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9148.667828][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9148.668100][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9148.668337][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9148.668577][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9148.668867][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9148.669177][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9148.669413][ C2] tcp_send_loss_probe+0x348/0x830 [ 9148.669664][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9148.669921][ C2] tcp_write_timer+0x82/0x1d0 [ 9148.670154][ C2] call_timer_fn+0x173/0x430 [ 9148.670386][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9148.670640][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9148.670892][ C2] __run_timers.part.0+0x52d/0x890 [ 9148.671144][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9148.671404][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9148.671679][ C2] ? lock_acquire+0x1c1/0x220 [ 9148.671909][ C2] ? clockevents_program_event+0xf6/0x300 [ 9148.672191][ C2] ? lock_release+0x1d5/0x250 [ 9148.672422][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9148.672679][ C2] ? ktime_get+0xb3/0x190 [ 9148.672891][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9148.673178][ C2] run_timer_softirq+0x72/0x100 [ 9148.673418][ C2] __do_softirq+0x1b9/0x7ff [ 9148.673642][ C2] irq_exit_rcu+0x98/0xc0 [ 9148.673856][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9148.674131][ C2] [ 9148.674277][ C2] [ 9148.674424][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9148.674718][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9148.674967][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9148.675904][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9148.676202][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9148.676616][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9148.677010][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9148.677405][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9148.677806][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9148.678194][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9148.678472][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9148.678724][ C2] default_idle_call+0x69/0xa0 [ 9148.678959][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9148.679203][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9148.679469][ C2] ? lock_release+0x1d5/0x250 [ 9148.679701][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9148.679964][ C2] do_idle+0xfb/0x160 [ 9148.680163][ C2] cpu_startup_entry+0x55/0x60 [ 9148.680396][ C2] start_secondary+0x21c/0x2b0 [ 9148.680632][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9148.680891][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9148.681192][ C2] [ 9171.994103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9171.994456][ C1] rcu: 1-....: (6800126 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1624235 [ 9171.995003][ C1] rcu: (t=6817107 jiffies g=1882453 q=721 ncpus=4) [ 9171.995327][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9171.995768][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9171.996394][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9171.996720][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9171.997694][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9171.997994][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9171.998382][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9171.998772][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9171.999163][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9171.999554][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9171.999941][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9172.000376][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9172.000700][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9172.001093][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9172.001483][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9172.001871][ C1] PKRU: 55555554 [ 9172.002047][ C1] Call Trace: [ 9172.002214][ C1] [ 9172.002357][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9172.002622][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9172.002869][ C1] ? check_cpu_stall+0x284/0x500 [ 9172.003114][ C1] ? rcu_pending+0x92/0x360 [ 9172.003342][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9172.003607][ C1] ? update_process_times+0xb9/0x110 [ 9172.003870][ C1] ? tick_sched_handle+0x67/0x130 [ 9172.004121][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9172.004402][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9172.004638][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9172.004942][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9172.005210][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9172.005492][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9172.005750][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9172.006050][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9172.006310][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9172.006612][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9172.006899][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9172.007206][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9172.007491][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9172.007779][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9172.008062][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9172.008367][ C1] ? get_stack_info+0x36/0xc0 [ 9172.008603][ C1] ? lock_acquire+0x1c1/0x220 [ 9172.008836][ C1] ? lock_release+0x1d5/0x250 [ 9172.009071][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9172.009315][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9172.009581][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9172.009860][ C1] ? lock_acquire+0x1c1/0x220 [ 9172.010091][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9172.010328][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9172.010581][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9172.010812][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9172.011055][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9172.011308][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9172.011580][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9172.011850][ C1] ip_local_deliver+0x19d/0x480 [ 9172.012092][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9172.012359][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9172.012618][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9172.012957][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9172.013205][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9172.013519][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9172.013776][ C1] ip_rcv+0x564/0x740 [ 9172.013976][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9172.014203][ C1] ? set_track_prepare+0x8a/0xd0 [ 9172.014450][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9172.014720][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9172.014986][ C1] ? skb_clone+0x10b/0x330 [ 9172.015210][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9172.015521][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9172.015819][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9172.016096][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9172.016408][ C1] ? __tcf_classify+0x329/0x7d0 [ 9172.016658][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9172.016891][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9172.017193][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9172.017490][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9172.017806][ C1] ? lock_acquire+0x1c1/0x220 [ 9172.018040][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9172.018329][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9172.018610][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9172.018920][ C1] ? __copy_skb_header+0xaf/0x490 [ 9172.019171][ C1] ? __skb_clone+0x57a/0x760 [ 9172.019399][ C1] netif_receive_skb+0x55/0x280 [ 9172.019642][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9172.019950][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9172.020275][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9172.020569][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9172.020837][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9172.021117][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9172.021423][ C1] ? hlock_class+0x4e/0x130 [ 9172.021652][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9172.021921][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9172.022191][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9172.022450][ C1] ? hlock_class+0x4e/0x130 [ 9172.022675][ C1] ? mark_lock+0x38/0x3e0 [ 9172.022892][ C1] ? stack_access_ok+0xda/0x1f0 [ 9172.023135][ C1] ? __lock_acquire+0xb67/0x1610 [ 9172.023384][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9172.023654][ C1] ? get_stack_info+0x36/0xc0 [ 9172.023890][ C1] ? stack_access_ok+0xda/0x1f0 [ 9172.024130][ C1] ? get_reg+0x119/0x190 [ 9172.024344][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9172.024605][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9172.024911][ C1] __tcf_classify+0x329/0x7d0 [ 9172.025147][ C1] tcf_classify+0x283/0x930 [ 9172.025373][ C1] ? arch_stack_walk+0xa2/0x100 [ 9172.025615][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9172.025866][ C1] ? get_stack_info+0x36/0xc0 [ 9172.026102][ C1] tc_run+0x2e4/0x5d0 [ 9172.026327][ C1] ? __pfx_tc_run+0x10/0x10 [ 9172.026560][ C1] ? lock_acquire+0x1c1/0x220 [ 9172.026797][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9172.027060][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9172.027313][ C1] ? lock_acquire+0x1c1/0x220 [ 9172.027554][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9172.027818][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9172.028132][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9172.028398][ C1] ? neigh_hh_output+0x348/0x590 [ 9172.028645][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9172.028902][ C1] ip_finish_output2+0x786/0x18e0 [ 9172.029152][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9172.029427][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9172.029756][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9172.030026][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9172.030274][ C1] ? __ip_finish_output+0x10f/0x770 [ 9172.030532][ C1] ip_output+0x16b/0x4f0 [ 9172.030744][ C1] ? run_timer_softirq+0x72/0x100 [ 9172.030995][ C1] ? __pfx_ip_output+0x10/0x10 [ 9172.031232][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9172.031514][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9172.031760][ C1] ? ip_local_out+0x114/0x3b0 [ 9172.031994][ C1] __ip_queue_xmit+0x672/0x1910 [ 9172.032236][ C1] ? __create_object+0x5e/0xb0 [ 9172.032476][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9172.032736][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9172.033013][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9172.033282][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9172.033556][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9172.033824][ C1] tcp_delack_timer+0x84/0x240 [ 9172.034060][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9172.034330][ C1] call_timer_fn+0x173/0x430 [ 9172.034559][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9172.034815][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9172.035071][ C1] __run_timers.part.0+0x52d/0x890 [ 9172.035327][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9172.035595][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9172.035873][ C1] ? lock_acquire+0x1c1/0x220 [ 9172.036107][ C1] ? clockevents_program_event+0xf6/0x300 [ 9172.036417][ C1] ? lock_release+0x1d5/0x250 [ 9172.036655][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9172.036919][ C1] ? ktime_get+0xb3/0x190 [ 9172.037143][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9172.037439][ C1] run_timer_softirq+0x72/0x100 [ 9172.037693][ C1] __do_softirq+0x1b9/0x7ff [ 9172.037921][ C1] irq_exit_rcu+0x98/0xc0 [ 9172.038134][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9172.038415][ C1] [ 9172.038561][ C1] [ 9172.038708][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9172.039004][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9172.039321][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9172.040272][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9172.040571][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9172.040961][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9172.041352][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9172.041742][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9172.042130][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9172.042525][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9172.042814][ C1] pipe_read+0xa16/0xdf0 [ 9172.043029][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9172.043302][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9172.043540][ C1] ? iterate_tty_write+0x299/0x540 [ 9172.043796][ C1] ? lock_release+0x1d5/0x250 [ 9172.044030][ C1] vfs_read+0x911/0xc00 [ 9172.044241][ C1] ? lock_acquire+0x1c1/0x220 [ 9172.044474][ C1] ? __might_fault+0xc6/0x180 [ 9172.044707][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9172.044942][ C1] ? __might_fault+0xc6/0x180 [ 9172.045181][ C1] ? lock_release+0x1d5/0x250 [ 9172.045417][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9172.045676][ C1] ? __fget_light+0x54/0x1e0 [ 9172.045906][ C1] ksys_read+0x17a/0x1e0 [ 9172.046119][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9172.046383][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9172.046689][ C1] do_syscall_64+0xc9/0x1e0 [ 9172.046924][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9172.047226][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9172.047463][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9172.048411][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9172.048825][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9172.049215][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9172.049604][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9172.049996][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9172.050386][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9172.050779][ C1] [ 9172.050933][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9172.051200][ C2] NMI backtrace for cpu 2 [ 9172.051205][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9172.051211][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9172.051215][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9172.051223][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9172.051228][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9172.051233][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9172.051236][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9172.051240][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9172.051244][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9172.051248][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9172.051252][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9172.051256][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9172.051262][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9172.051263][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9172.051265][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9172.051266][ C2] PKRU: 55555554 [ 9172.051267][ C2] Call Trace: [ 9172.051269][ C2] [ 9172.051271][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9172.051277][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9172.051281][ C2] ? nmi_handle+0x153/0x420 [ 9172.051286][ C2] ? default_do_nmi+0x41/0x100 [ 9172.051289][ C2] ? exc_nmi+0xf3/0x120 [ 9172.051291][ C2] ? end_repeat_nmi+0xf/0x60 [ 9172.051296][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9172.051299][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9172.051302][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9172.051306][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9172.051309][ C2] [ 9172.051310][ C2] [ 9172.051311][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9172.051314][ C2] ? get_stack_info+0x36/0xc0 [ 9172.051318][ C2] ? lock_acquire+0x1c1/0x220 [ 9172.051321][ C2] ? lock_release+0x1d5/0x250 [ 9172.051324][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9172.051328][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9172.051331][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9172.051334][ C2] ? lock_acquire+0x1c1/0x220 [ 9172.051336][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9172.051339][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9172.051342][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9172.051348][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9172.051350][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9172.051355][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9172.051359][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9172.051362][ C2] ip_local_deliver+0x19d/0x480 [ 9172.051365][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9172.051367][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9172.051369][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9172.051374][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9172.051378][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9172.051381][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9172.051389][ C2] ip_rcv+0x564/0x740 [ 9172.051391][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9172.051394][ C2] ? set_track_prepare+0x8a/0xd0 [ 9172.051398][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9172.051401][ C2] ? start_secondary+0x21c/0x2b0 [ 9172.051404][ C2] ? skb_clone+0x10b/0x330 [ 9172.051407][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9172.051413][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9172.051418][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9172.051421][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9172.051429][ C2] ? __tcf_classify+0x329/0x7d0 [ 9172.051432][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9172.051434][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9172.051438][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9172.051441][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9172.051445][ C2] ? lock_acquire+0x1c1/0x220 [ 9172.051447][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9172.051451][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9172.051454][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9172.051458][ C2] ? __copy_skb_header+0xaf/0x490 [ 9172.051462][ C2] ? __skb_clone+0x57a/0x760 [ 9172.051465][ C2] netif_receive_skb+0x55/0x280 [ 9172.051468][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9172.051475][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9172.051482][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9172.051488][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9172.051492][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9172.051502][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9172.051509][ C2] ? get_stack_info+0x36/0xc0 [ 9172.051514][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9172.051516][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9172.051519][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9172.051522][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9172.051525][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9172.051527][ C2] ? kernel_text_address+0x17/0xe0 [ 9172.051530][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9172.051533][ C2] ? arch_stack_walk+0x8c/0x100 [ 9172.051537][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9172.051540][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9172.051543][ C2] ? lock_acquire+0x1c1/0x220 [ 9172.051545][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9172.051549][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9172.051553][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9172.051556][ C2] ? get_stack_info+0x36/0xc0 [ 9172.051561][ C2] __tcf_classify+0x329/0x7d0 [ 9172.051566][ C2] tcf_classify+0x283/0x930 [ 9172.051570][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9172.051573][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9172.051577][ C2] tc_run+0x2e4/0x5d0 [ 9172.051581][ C2] ? __pfx_tc_run+0x10/0x10 [ 9172.051584][ C2] ? lock_acquire+0x1c1/0x220 [ 9172.051586][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9172.051590][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9172.051594][ C2] ? lock_acquire+0x1c1/0x220 [ 9172.051596][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9172.051599][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9172.051602][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9172.051605][ C2] ? neigh_hh_output+0x348/0x590 [ 9172.051608][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9172.051612][ C2] ip_finish_output2+0x786/0x18e0 [ 9172.051615][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9172.051622][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9172.051624][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9172.051628][ C2] ? __ip_finish_output+0x10f/0x770 [ 9172.051632][ C2] ip_output+0x16b/0x4f0 [ 9172.051634][ C2] ? __pfx_ip_output+0x10/0x10 [ 9172.051637][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9172.051640][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9172.051643][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9172.051646][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9172.051648][ C2] ? __alloc_skb+0xd4/0x280 [ 9172.051651][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9172.051654][ C2] ? tcp_fragment+0x168/0x1040 [ 9172.051657][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9172.051660][ C2] ? ip_local_out+0x114/0x3b0 [ 9172.051664][ C2] __ip_queue_xmit+0x672/0x1910 [ 9172.051667][ C2] ? __skb_clone+0x57a/0x760 [ 9172.051670][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9172.051675][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9172.051678][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9172.051681][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9172.051685][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9172.051689][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9172.051692][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9172.051695][ C2] tcp_send_loss_probe+0x348/0x830 [ 9172.051698][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9172.051700][ C2] tcp_write_timer+0x82/0x1d0 [ 9172.051703][ C2] call_timer_fn+0x173/0x430 [ 9172.051707][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9172.051711][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9172.051715][ C2] __run_timers.part.0+0x52d/0x890 [ 9172.051718][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9172.051722][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9172.051725][ C2] ? lock_acquire+0x1c1/0x220 [ 9172.051727][ C2] ? clockevents_program_event+0xf6/0x300 [ 9172.051731][ C2] ? lock_release+0x1d5/0x250 [ 9172.051733][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9172.051736][ C2] ? ktime_get+0xb3/0x190 [ 9172.051739][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9172.051744][ C2] run_timer_softirq+0x72/0x100 [ 9172.051747][ C2] __do_softirq+0x1b9/0x7ff [ 9172.051751][ C2] irq_exit_rcu+0x98/0xc0 [ 9172.051753][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9172.051756][ C2] [ 9172.051757][ C2] [ 9172.051758][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9172.051761][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9172.051764][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9172.051766][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9172.051768][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9172.051770][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9172.051771][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9172.051772][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9172.051773][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9172.051777][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9172.051780][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9172.051782][ C2] default_idle_call+0x69/0xa0 [ 9172.051785][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9172.051787][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9172.051791][ C2] ? lock_release+0x1d5/0x250 [ 9172.051793][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9172.051797][ C2] do_idle+0xfb/0x160 [ 9172.051799][ C2] cpu_startup_entry+0x55/0x60 [ 9172.051801][ C2] start_secondary+0x21c/0x2b0 [ 9172.051804][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9172.051808][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9172.051813][ C2] [ 9196.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6373s! [swapper/2:0] [ 9196.569675][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9196.570890][ C2] irq event stamp: 44114564 [ 9196.571112][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9196.571633][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9196.572127][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9196.572588][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9196.573042][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9196.573485][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9196.574078][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9196.574393][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9196.575337][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9196.575636][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9196.576022][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9196.576439][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9196.576833][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9196.577230][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9196.577625][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9196.578057][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9196.578382][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9196.578769][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9196.579153][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9196.579540][ C2] PKRU: 55555554 [ 9196.579714][ C2] Call Trace: [ 9196.579880][ C2] [ 9196.580022][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9196.580277][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9196.580512][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9196.580781][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9196.581044][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9196.581324][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9196.581582][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9196.581878][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9196.582131][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9196.582386][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9196.582685][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9196.582972][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9196.583277][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9196.583556][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9196.583844][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9196.584122][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9196.584428][ C2] ? get_stack_info+0x36/0xc0 [ 9196.584662][ C2] ? lock_acquire+0x1c1/0x220 [ 9196.584896][ C2] ? lock_release+0x1d5/0x250 [ 9196.585126][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9196.585369][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9196.585634][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9196.585910][ C2] ? lock_acquire+0x1c1/0x220 [ 9196.586165][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9196.586403][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9196.586661][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9196.586894][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9196.587140][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9196.587404][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9196.587669][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9196.587938][ C2] ip_local_deliver+0x19d/0x480 [ 9196.588177][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9196.588441][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9196.588696][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9196.589029][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9196.589276][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9196.589585][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9196.589838][ C2] ip_rcv+0x564/0x740 [ 9196.590035][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9196.590261][ C2] ? set_track_prepare+0x8a/0xd0 [ 9196.590506][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9196.590772][ C2] ? start_secondary+0x21c/0x2b0 [ 9196.591015][ C2] ? skb_clone+0x10b/0x330 [ 9196.591237][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9196.591546][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9196.591840][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9196.592114][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9196.592397][ C2] ? __tcf_classify+0x329/0x7d0 [ 9196.592639][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9196.592862][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9196.593150][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9196.593428][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9196.593746][ C2] ? lock_acquire+0x1c1/0x220 [ 9196.593977][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9196.594263][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9196.594541][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9196.594848][ C2] ? __copy_skb_header+0xaf/0x490 [ 9196.595096][ C2] ? __skb_clone+0x57a/0x760 [ 9196.595322][ C2] netif_receive_skb+0x55/0x280 [ 9196.595562][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9196.595864][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9196.596207][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9196.596505][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9196.596777][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9196.597064][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9196.597383][ C2] ? get_stack_info+0x36/0xc0 [ 9196.597617][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9196.597872][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9196.598180][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9196.598445][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9196.598717][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9196.599022][ C2] ? kernel_text_address+0x17/0xe0 [ 9196.599276][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9196.599580][ C2] ? arch_stack_walk+0x8c/0x100 [ 9196.599821][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9196.600078][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9196.600355][ C2] ? lock_acquire+0x1c1/0x220 [ 9196.600588][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9196.600860][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9196.601155][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9196.601423][ C2] ? get_stack_info+0x36/0xc0 [ 9196.601657][ C2] __tcf_classify+0x329/0x7d0 [ 9196.601892][ C2] tcf_classify+0x283/0x930 [ 9196.602116][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9196.602365][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9196.602669][ C2] tc_run+0x2e4/0x5d0 [ 9196.602866][ C2] ? __pfx_tc_run+0x10/0x10 [ 9196.603095][ C2] ? lock_acquire+0x1c1/0x220 [ 9196.603328][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9196.603581][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9196.603827][ C2] ? lock_acquire+0x1c1/0x220 [ 9196.604057][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9196.604316][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9196.604608][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9196.604874][ C2] ? neigh_hh_output+0x348/0x590 [ 9196.605119][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9196.605377][ C2] ip_finish_output2+0x786/0x18e0 [ 9196.605626][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9196.605956][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9196.606246][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9196.606497][ C2] ? __ip_finish_output+0x10f/0x770 [ 9196.606760][ C2] ip_output+0x16b/0x4f0 [ 9196.606977][ C2] ? __pfx_ip_output+0x10/0x10 [ 9196.607220][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9196.607503][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9196.607805][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9196.608070][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9196.608315][ C2] ? __alloc_skb+0xd4/0x280 [ 9196.608538][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9196.608799][ C2] ? tcp_fragment+0x168/0x1040 [ 9196.609033][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9196.609278][ C2] ? ip_local_out+0x114/0x3b0 [ 9196.609511][ C2] __ip_queue_xmit+0x672/0x1910 [ 9196.609752][ C2] ? __skb_clone+0x57a/0x760 [ 9196.609980][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9196.610238][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9196.610508][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9196.610745][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9196.610986][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9196.611278][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9196.611588][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9196.611822][ C2] tcp_send_loss_probe+0x348/0x830 [ 9196.612074][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9196.612339][ C2] tcp_write_timer+0x82/0x1d0 [ 9196.612570][ C2] call_timer_fn+0x173/0x430 [ 9196.612798][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9196.613051][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9196.613305][ C2] __run_timers.part.0+0x52d/0x890 [ 9196.613556][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9196.613818][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9196.614094][ C2] ? lock_acquire+0x1c1/0x220 [ 9196.614327][ C2] ? clockevents_program_event+0xf6/0x300 [ 9196.614607][ C2] ? lock_release+0x1d5/0x250 [ 9196.614839][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9196.615094][ C2] ? ktime_get+0xb3/0x190 [ 9196.615309][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9196.615596][ C2] run_timer_softirq+0x72/0x100 [ 9196.615837][ C2] __do_softirq+0x1b9/0x7ff [ 9196.616062][ C2] irq_exit_rcu+0x98/0xc0 [ 9196.616299][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9196.616582][ C2] [ 9196.616732][ C2] [ 9196.616880][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9196.617184][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9196.617445][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9196.618382][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9196.618680][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9196.619064][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9196.619451][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9196.619838][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9196.620224][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9196.620610][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9196.620891][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9196.621144][ C2] default_idle_call+0x69/0xa0 [ 9196.621381][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9196.621622][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9196.621892][ C2] ? lock_release+0x1d5/0x250 [ 9196.622123][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9196.622389][ C2] do_idle+0xfb/0x160 [ 9196.622586][ C2] cpu_startup_entry+0x55/0x60 [ 9196.622822][ C2] start_secondary+0x21c/0x2b0 [ 9196.623058][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9196.623320][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9196.623621][ C2] [ 9196.623771][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6373s! [perl:4135] [ 9196.624175][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9196.625396][ C1] irq event stamp: 209232 [ 9196.625611][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9196.626147][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9196.626623][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9196.627095][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9196.627562][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9196.627997][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9196.628595][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9196.628915][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9196.629864][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9196.630163][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9196.630555][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9196.630948][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9196.631337][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9196.631726][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9196.632118][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9196.632555][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9196.632881][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9196.633290][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9196.633691][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9196.634093][ C1] PKRU: 55555554 [ 9196.634276][ C1] Call Trace: [ 9196.634445][ C1] [ 9196.634602][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9196.634859][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9196.635096][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9196.635369][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9196.635634][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9196.635916][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9196.636199][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9196.636506][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9196.636769][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9196.637078][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9196.637384][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9196.637690][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9196.637971][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9196.638262][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9196.638542][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9196.638848][ C1] ? get_stack_info+0x36/0xc0 [ 9196.639084][ C1] ? lock_acquire+0x1c1/0x220 [ 9196.639320][ C1] ? lock_release+0x1d5/0x250 [ 9196.639554][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9196.639795][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9196.640064][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9196.640343][ C1] ? lock_acquire+0x1c1/0x220 [ 9196.640578][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9196.640812][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9196.641067][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9196.641296][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9196.641539][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9196.641791][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9196.642058][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9196.642332][ C1] ip_local_deliver+0x19d/0x480 [ 9196.642573][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9196.642839][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9196.643096][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9196.643437][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9196.643687][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9196.643999][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9196.644256][ C1] ip_rcv+0x564/0x740 [ 9196.644455][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9196.644681][ C1] ? set_track_prepare+0x8a/0xd0 [ 9196.644928][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9196.645198][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9196.645466][ C1] ? skb_clone+0x10b/0x330 [ 9196.645687][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9196.646000][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9196.646328][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9196.646608][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9196.646904][ C1] ? __tcf_classify+0x329/0x7d0 [ 9196.647153][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9196.647393][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9196.647687][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9196.647964][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9196.648282][ C1] ? lock_acquire+0x1c1/0x220 [ 9196.648517][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9196.648807][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9196.649085][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9196.649396][ C1] ? __copy_skb_header+0xaf/0x490 [ 9196.649647][ C1] ? __skb_clone+0x57a/0x760 [ 9196.649877][ C1] netif_receive_skb+0x55/0x280 [ 9196.650120][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9196.650425][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9196.650750][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9196.651041][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9196.651311][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9196.651594][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9196.651899][ C1] ? hlock_class+0x4e/0x130 [ 9196.652125][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9196.652397][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9196.652667][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9196.652924][ C1] ? hlock_class+0x4e/0x130 [ 9196.653151][ C1] ? mark_lock+0x38/0x3e0 [ 9196.653366][ C1] ? stack_access_ok+0xda/0x1f0 [ 9196.653608][ C1] ? __lock_acquire+0xb67/0x1610 [ 9196.653856][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9196.654124][ C1] ? get_stack_info+0x36/0xc0 [ 9196.654360][ C1] ? stack_access_ok+0xda/0x1f0 [ 9196.654602][ C1] ? get_reg+0x119/0x190 [ 9196.654812][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9196.655074][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9196.655378][ C1] __tcf_classify+0x329/0x7d0 [ 9196.655615][ C1] tcf_classify+0x283/0x930 [ 9196.655843][ C1] ? arch_stack_walk+0xa2/0x100 [ 9196.656088][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9196.656362][ C1] ? get_stack_info+0x36/0xc0 [ 9196.656602][ C1] tc_run+0x2e4/0x5d0 [ 9196.656808][ C1] ? __pfx_tc_run+0x10/0x10 [ 9196.657041][ C1] ? lock_acquire+0x1c1/0x220 [ 9196.657283][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9196.657549][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9196.657797][ C1] ? lock_acquire+0x1c1/0x220 [ 9196.658030][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9196.658290][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9196.658586][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9196.658854][ C1] ? neigh_hh_output+0x348/0x590 [ 9196.659100][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9196.659359][ C1] ip_finish_output2+0x786/0x18e0 [ 9196.659611][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9196.659880][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9196.660211][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9196.660481][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9196.660728][ C1] ? __ip_finish_output+0x10f/0x770 [ 9196.660988][ C1] ip_output+0x16b/0x4f0 [ 9196.661199][ C1] ? run_timer_softirq+0x72/0x100 [ 9196.661449][ C1] ? __pfx_ip_output+0x10/0x10 [ 9196.661688][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9196.661966][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9196.662212][ C1] ? ip_local_out+0x114/0x3b0 [ 9196.662447][ C1] __ip_queue_xmit+0x672/0x1910 [ 9196.662693][ C1] ? __create_object+0x5e/0xb0 [ 9196.662931][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9196.663194][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9196.663468][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9196.663733][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9196.664009][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9196.664275][ C1] tcp_delack_timer+0x84/0x240 [ 9196.664513][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9196.664778][ C1] call_timer_fn+0x173/0x430 [ 9196.665009][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9196.665265][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9196.665519][ C1] __run_timers.part.0+0x52d/0x890 [ 9196.665773][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9196.666039][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9196.666345][ C1] ? lock_acquire+0x1c1/0x220 [ 9196.666581][ C1] ? clockevents_program_event+0xf6/0x300 [ 9196.666874][ C1] ? lock_release+0x1d5/0x250 [ 9196.667114][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9196.667389][ C1] ? ktime_get+0xb3/0x190 [ 9196.667602][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9196.667892][ C1] run_timer_softirq+0x72/0x100 [ 9196.668135][ C1] __do_softirq+0x1b9/0x7ff [ 9196.668361][ C1] irq_exit_rcu+0x98/0xc0 [ 9196.668578][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9196.668855][ C1] [ 9196.669002][ C1] [ 9196.669149][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9196.669448][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9196.669765][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9196.670710][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9196.671011][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9196.671400][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9196.671786][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9196.672175][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9196.672567][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9196.672958][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9196.673251][ C1] pipe_read+0xa16/0xdf0 [ 9196.673465][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9196.673735][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9196.673973][ C1] ? iterate_tty_write+0x299/0x540 [ 9196.674229][ C1] ? lock_release+0x1d5/0x250 [ 9196.674464][ C1] vfs_read+0x911/0xc00 [ 9196.674689][ C1] ? lock_acquire+0x1c1/0x220 [ 9196.674932][ C1] ? __might_fault+0xc6/0x180 [ 9196.675174][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9196.675414][ C1] ? __might_fault+0xc6/0x180 [ 9196.675654][ C1] ? lock_release+0x1d5/0x250 [ 9196.675897][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9196.676207][ C1] ? __fget_light+0x54/0x1e0 [ 9196.676450][ C1] ksys_read+0x17a/0x1e0 [ 9196.676667][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9196.676913][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9196.677221][ C1] do_syscall_64+0xc9/0x1e0 [ 9196.677460][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9196.677756][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9196.677978][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9196.678930][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9196.679342][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9196.679735][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9196.680125][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9196.680517][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9196.680906][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9196.681303][ C1] [ 9224.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6400s! [swapper/2:0] [ 9224.569688][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9224.570899][ C2] irq event stamp: 44114564 [ 9224.571121][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9224.571638][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9224.572132][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9224.572596][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9224.573048][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9224.573490][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9224.574081][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9224.574395][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9224.575332][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9224.575629][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9224.576016][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9224.576401][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9224.576788][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9224.577173][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9224.577560][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9224.577992][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9224.578313][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9224.578700][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9224.579086][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9224.579472][ C2] PKRU: 55555554 [ 9224.579647][ C2] Call Trace: [ 9224.579812][ C2] [ 9224.579953][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9224.580206][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9224.580442][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9224.580708][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9224.580972][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9224.581253][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9224.581508][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9224.581804][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9224.582060][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9224.582314][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9224.582614][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9224.582899][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9224.583203][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9224.583485][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9224.583768][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9224.584050][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9224.584353][ C2] ? get_stack_info+0x36/0xc0 [ 9224.584586][ C2] ? lock_acquire+0x1c1/0x220 [ 9224.584817][ C2] ? lock_release+0x1d5/0x250 [ 9224.585050][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9224.585296][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9224.585559][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9224.585835][ C2] ? lock_acquire+0x1c1/0x220 [ 9224.586088][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9224.586328][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9224.586586][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9224.586819][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9224.587065][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9224.587330][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9224.587594][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9224.587861][ C2] ip_local_deliver+0x19d/0x480 [ 9224.588099][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9224.588362][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9224.588617][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9224.588954][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9224.589200][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9224.589510][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9224.589764][ C2] ip_rcv+0x564/0x740 [ 9224.589961][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9224.590185][ C2] ? set_track_prepare+0x8a/0xd0 [ 9224.590430][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9224.590698][ C2] ? start_secondary+0x21c/0x2b0 [ 9224.590942][ C2] ? skb_clone+0x10b/0x330 [ 9224.591160][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9224.591469][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9224.591766][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9224.592041][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9224.592329][ C2] ? __tcf_classify+0x329/0x7d0 [ 9224.592570][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9224.592791][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9224.593084][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9224.593360][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9224.593676][ C2] ? lock_acquire+0x1c1/0x220 [ 9224.593905][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9224.594194][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9224.594469][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9224.594775][ C2] ? __copy_skb_header+0xaf/0x490 [ 9224.595027][ C2] ? __skb_clone+0x57a/0x760 [ 9224.595256][ C2] netif_receive_skb+0x55/0x280 [ 9224.595497][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9224.595799][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9224.596145][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9224.596440][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9224.596714][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9224.596998][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9224.597317][ C2] ? get_stack_info+0x36/0xc0 [ 9224.597550][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9224.597805][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9224.598110][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9224.598377][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9224.598643][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9224.598947][ C2] ? kernel_text_address+0x17/0xe0 [ 9224.599199][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9224.599501][ C2] ? arch_stack_walk+0x8c/0x100 [ 9224.599740][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9224.599995][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9224.600273][ C2] ? lock_acquire+0x1c1/0x220 [ 9224.600502][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9224.600777][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9224.601071][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9224.601339][ C2] ? get_stack_info+0x36/0xc0 [ 9224.601571][ C2] __tcf_classify+0x329/0x7d0 [ 9224.601803][ C2] tcf_classify+0x283/0x930 [ 9224.602028][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9224.602278][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9224.602580][ C2] tc_run+0x2e4/0x5d0 [ 9224.602777][ C2] ? __pfx_tc_run+0x10/0x10 [ 9224.603002][ C2] ? lock_acquire+0x1c1/0x220 [ 9224.603231][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9224.603485][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9224.603729][ C2] ? lock_acquire+0x1c1/0x220 [ 9224.603961][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9224.604216][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9224.604510][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9224.604771][ C2] ? neigh_hh_output+0x348/0x590 [ 9224.605015][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9224.605271][ C2] ip_finish_output2+0x786/0x18e0 [ 9224.605519][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9224.605846][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9224.606138][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9224.606389][ C2] ? __ip_finish_output+0x10f/0x770 [ 9224.606651][ C2] ip_output+0x16b/0x4f0 [ 9224.606866][ C2] ? __pfx_ip_output+0x10/0x10 [ 9224.607107][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9224.607386][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9224.607688][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9224.607955][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9224.608197][ C2] ? __alloc_skb+0xd4/0x280 [ 9224.608420][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9224.608679][ C2] ? tcp_fragment+0x168/0x1040 [ 9224.608915][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9224.609158][ C2] ? ip_local_out+0x114/0x3b0 [ 9224.609391][ C2] __ip_queue_xmit+0x672/0x1910 [ 9224.609631][ C2] ? __skb_clone+0x57a/0x760 [ 9224.609856][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9224.610115][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9224.610388][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9224.610624][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9224.610864][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9224.611153][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9224.611465][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9224.611700][ C2] tcp_send_loss_probe+0x348/0x830 [ 9224.611950][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9224.612209][ C2] tcp_write_timer+0x82/0x1d0 [ 9224.612442][ C2] call_timer_fn+0x173/0x430 [ 9224.612671][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9224.612924][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9224.613178][ C2] __run_timers.part.0+0x52d/0x890 [ 9224.613430][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9224.613689][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9224.613966][ C2] ? lock_acquire+0x1c1/0x220 [ 9224.614195][ C2] ? clockevents_program_event+0xf6/0x300 [ 9224.614477][ C2] ? lock_release+0x1d5/0x250 [ 9224.614709][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9224.614965][ C2] ? ktime_get+0xb3/0x190 [ 9224.615177][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9224.615465][ C2] run_timer_softirq+0x72/0x100 [ 9224.615705][ C2] __do_softirq+0x1b9/0x7ff [ 9224.615928][ C2] irq_exit_rcu+0x98/0xc0 [ 9224.616167][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9224.616449][ C2] [ 9224.616599][ C2] [ 9224.616748][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9224.617051][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9224.617313][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9224.618247][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9224.618544][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9224.618929][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9224.619313][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9224.619697][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9224.620084][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9224.620472][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9224.620750][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9224.621001][ C2] default_idle_call+0x69/0xa0 [ 9224.621238][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9224.621480][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9224.621748][ C2] ? lock_release+0x1d5/0x250 [ 9224.621979][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9224.622244][ C2] do_idle+0xfb/0x160 [ 9224.622443][ C2] cpu_startup_entry+0x55/0x60 [ 9224.622677][ C2] start_secondary+0x21c/0x2b0 [ 9224.622911][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9224.623173][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9224.623474][ C2] [ 9224.623627][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6400s! [perl:4135] [ 9224.624027][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9224.625251][ C1] irq event stamp: 209232 [ 9224.625465][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9224.625982][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9224.626475][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9224.626943][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9224.627410][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9224.627845][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9224.628443][ C1] RIP: 0010:__kasan_check_read+0x8/0x20 [ 9224.628720][ C1] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [ 9224.629668][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [ 9224.629968][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9224.630358][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9224.630747][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9224.631135][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9224.631527][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9224.631916][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9224.632354][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9224.632681][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9224.633072][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9224.633466][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9224.633855][ C1] PKRU: 55555554 [ 9224.634033][ C1] Call Trace: [ 9224.634198][ C1] [ 9224.634344][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9224.634599][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9224.634836][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9224.635106][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9224.635373][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9224.635655][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9224.635912][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9224.636236][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9224.636499][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9224.636806][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9224.637103][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9224.637424][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9224.637708][ C1] ? __kasan_check_read+0x8/0x20 [ 9224.637953][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9224.638233][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9224.638539][ C1] ? get_stack_info+0x36/0xc0 [ 9224.638772][ C1] ? lock_acquire+0x1c1/0x220 [ 9224.639008][ C1] ? lock_release+0x1d5/0x250 [ 9224.639244][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9224.639486][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9224.639752][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9224.640029][ C1] ? lock_acquire+0x1c1/0x220 [ 9224.640263][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9224.640498][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9224.640752][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9224.640982][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9224.641224][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9224.641475][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9224.641744][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9224.642013][ C1] ip_local_deliver+0x19d/0x480 [ 9224.642256][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9224.642523][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9224.642779][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9224.643119][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9224.643368][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9224.643679][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9224.643935][ C1] ip_rcv+0x564/0x740 [ 9224.644134][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9224.644360][ C1] ? set_track_prepare+0x8a/0xd0 [ 9224.644606][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9224.644878][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9224.645147][ C1] ? skb_clone+0x10b/0x330 [ 9224.645369][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9224.645680][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9224.645982][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9224.646281][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9224.646573][ C1] ? __tcf_classify+0x329/0x7d0 [ 9224.646823][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9224.647055][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9224.647361][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9224.647640][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9224.647956][ C1] ? lock_acquire+0x1c1/0x220 [ 9224.648189][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9224.648477][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9224.648755][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9224.649063][ C1] ? __copy_skb_header+0xaf/0x490 [ 9224.649316][ C1] ? __skb_clone+0x57a/0x760 [ 9224.649543][ C1] netif_receive_skb+0x55/0x280 [ 9224.649785][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9224.650089][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9224.650413][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9224.650704][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9224.650969][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9224.651250][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9224.651555][ C1] ? hlock_class+0x4e/0x130 [ 9224.651782][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9224.652051][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9224.652320][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9224.652577][ C1] ? hlock_class+0x4e/0x130 [ 9224.652803][ C1] ? mark_lock+0x38/0x3e0 [ 9224.653017][ C1] ? stack_access_ok+0xda/0x1f0 [ 9224.653260][ C1] ? __lock_acquire+0xb67/0x1610 [ 9224.653506][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9224.653778][ C1] ? get_stack_info+0x36/0xc0 [ 9224.654009][ C1] ? stack_access_ok+0xda/0x1f0 [ 9224.654250][ C1] ? get_reg+0x119/0x190 [ 9224.654463][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9224.654723][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9224.655025][ C1] __tcf_classify+0x329/0x7d0 [ 9224.655261][ C1] tcf_classify+0x283/0x930 [ 9224.655487][ C1] ? arch_stack_walk+0xa2/0x100 [ 9224.655728][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9224.655981][ C1] ? get_stack_info+0x36/0xc0 [ 9224.656239][ C1] tc_run+0x2e4/0x5d0 [ 9224.656444][ C1] ? __pfx_tc_run+0x10/0x10 [ 9224.656675][ C1] ? lock_acquire+0x1c1/0x220 [ 9224.656913][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9224.657184][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9224.657430][ C1] ? lock_acquire+0x1c1/0x220 [ 9224.657663][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9224.657921][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9224.658220][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9224.658485][ C1] ? neigh_hh_output+0x348/0x590 [ 9224.658732][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9224.658989][ C1] ip_finish_output2+0x786/0x18e0 [ 9224.659240][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9224.659510][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9224.659841][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9224.660110][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9224.660357][ C1] ? __ip_finish_output+0x10f/0x770 [ 9224.660615][ C1] ip_output+0x16b/0x4f0 [ 9224.660825][ C1] ? run_timer_softirq+0x72/0x100 [ 9224.661077][ C1] ? __pfx_ip_output+0x10/0x10 [ 9224.661316][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9224.661596][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9224.661841][ C1] ? ip_local_out+0x114/0x3b0 [ 9224.662073][ C1] __ip_queue_xmit+0x672/0x1910 [ 9224.662316][ C1] ? __create_object+0x5e/0xb0 [ 9224.662554][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9224.662813][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9224.663088][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9224.663356][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9224.663629][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9224.663892][ C1] tcp_delack_timer+0x84/0x240 [ 9224.664131][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9224.664397][ C1] call_timer_fn+0x173/0x430 [ 9224.664626][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9224.664881][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9224.665135][ C1] __run_timers.part.0+0x52d/0x890 [ 9224.665388][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9224.665657][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9224.665934][ C1] ? lock_acquire+0x1c1/0x220 [ 9224.666192][ C1] ? clockevents_program_event+0xf6/0x300 [ 9224.666481][ C1] ? lock_release+0x1d5/0x250 [ 9224.666721][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9224.666984][ C1] ? ktime_get+0xb3/0x190 [ 9224.667217][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9224.667505][ C1] run_timer_softirq+0x72/0x100 [ 9224.667747][ C1] __do_softirq+0x1b9/0x7ff [ 9224.667974][ C1] irq_exit_rcu+0x98/0xc0 [ 9224.668188][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9224.668468][ C1] [ 9224.668613][ C1] [ 9224.668759][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9224.669056][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9224.669373][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9224.670316][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9224.670616][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9224.671002][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9224.671392][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9224.671781][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9224.672170][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9224.672560][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9224.672850][ C1] pipe_read+0xa16/0xdf0 [ 9224.673066][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9224.673342][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9224.673578][ C1] ? iterate_tty_write+0x299/0x540 [ 9224.673833][ C1] ? lock_release+0x1d5/0x250 [ 9224.674067][ C1] vfs_read+0x911/0xc00 [ 9224.674278][ C1] ? lock_acquire+0x1c1/0x220 [ 9224.674508][ C1] ? __might_fault+0xc6/0x180 [ 9224.674743][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9224.674977][ C1] ? __might_fault+0xc6/0x180 [ 9224.675212][ C1] ? lock_release+0x1d5/0x250 [ 9224.675444][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9224.675704][ C1] ? __fget_light+0x54/0x1e0 [ 9224.675934][ C1] ksys_read+0x17a/0x1e0 [ 9224.676197][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9224.676443][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9224.676751][ C1] do_syscall_64+0xc9/0x1e0 [ 9224.676986][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9224.677294][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9224.677519][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9224.678469][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9224.678882][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9224.679273][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9224.679663][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9224.680051][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9224.680445][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9224.680838][ C1] [ 9250.052103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9250.052471][ C1] rcu: 1-....: (6877906 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1640379 [ 9250.053017][ C1] rcu: (t=6895165 jiffies g=1882453 q=721 ncpus=4) [ 9250.053342][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9250.053780][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9250.054382][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9250.054702][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9250.055649][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9250.055973][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9250.056371][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9250.056771][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9250.057180][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9250.057593][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9250.057990][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9250.058443][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9250.058781][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9250.059175][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9250.059564][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9250.059952][ C1] PKRU: 55555554 [ 9250.060130][ C1] Call Trace: [ 9250.060297][ C1] [ 9250.060442][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9250.060707][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9250.060954][ C1] ? check_cpu_stall+0x284/0x500 [ 9250.061200][ C1] ? rcu_pending+0x92/0x360 [ 9250.061427][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9250.061690][ C1] ? update_process_times+0xb9/0x110 [ 9250.061952][ C1] ? tick_sched_handle+0x67/0x130 [ 9250.062202][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9250.062482][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9250.062718][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9250.063021][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9250.063291][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9250.063571][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9250.063829][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9250.064128][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9250.064384][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9250.064686][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9250.064975][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9250.065281][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9250.065565][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9250.065855][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9250.066161][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9250.066473][ C1] ? get_stack_info+0x36/0xc0 [ 9250.066717][ C1] ? lock_acquire+0x1c1/0x220 [ 9250.066957][ C1] ? lock_release+0x1d5/0x250 [ 9250.067205][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9250.067448][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9250.067713][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9250.067992][ C1] ? lock_acquire+0x1c1/0x220 [ 9250.068224][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9250.068460][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9250.068713][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9250.068943][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9250.069184][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9250.069436][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9250.069705][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9250.069973][ C1] ip_local_deliver+0x19d/0x480 [ 9250.070215][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9250.070478][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9250.070737][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9250.071079][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9250.071327][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9250.071639][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9250.071895][ C1] ip_rcv+0x564/0x740 [ 9250.072093][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9250.072320][ C1] ? set_track_prepare+0x8a/0xd0 [ 9250.072568][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9250.072838][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9250.073103][ C1] ? skb_clone+0x10b/0x330 [ 9250.073326][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9250.073638][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9250.073934][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9250.074212][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9250.074499][ C1] ? __tcf_classify+0x329/0x7d0 [ 9250.074742][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9250.074966][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9250.075259][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9250.075537][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9250.075859][ C1] ? lock_acquire+0x1c1/0x220 [ 9250.076116][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9250.076410][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9250.076696][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9250.077013][ C1] ? __copy_skb_header+0xaf/0x490 [ 9250.077276][ C1] ? __skb_clone+0x57a/0x760 [ 9250.077502][ C1] netif_receive_skb+0x55/0x280 [ 9250.077744][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9250.078050][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9250.078373][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9250.078665][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9250.078931][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9250.079231][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9250.079543][ C1] ? hlock_class+0x4e/0x130 [ 9250.079777][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9250.080052][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9250.080330][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9250.080601][ C1] ? hlock_class+0x4e/0x130 [ 9250.080824][ C1] ? mark_lock+0x38/0x3e0 [ 9250.081039][ C1] ? stack_access_ok+0xda/0x1f0 [ 9250.081282][ C1] ? __lock_acquire+0xb67/0x1610 [ 9250.081528][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9250.081797][ C1] ? get_stack_info+0x36/0xc0 [ 9250.082031][ C1] ? stack_access_ok+0xda/0x1f0 [ 9250.082271][ C1] ? get_reg+0x119/0x190 [ 9250.082483][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9250.082743][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9250.083044][ C1] __tcf_classify+0x329/0x7d0 [ 9250.083280][ C1] tcf_classify+0x283/0x930 [ 9250.083505][ C1] ? arch_stack_walk+0xa2/0x100 [ 9250.083748][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9250.083997][ C1] ? get_stack_info+0x36/0xc0 [ 9250.084234][ C1] tc_run+0x2e4/0x5d0 [ 9250.084433][ C1] ? __pfx_tc_run+0x10/0x10 [ 9250.084659][ C1] ? lock_acquire+0x1c1/0x220 [ 9250.084890][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9250.085145][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9250.085392][ C1] ? lock_acquire+0x1c1/0x220 [ 9250.085626][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9250.085902][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9250.086208][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9250.086479][ C1] ? neigh_hh_output+0x348/0x590 [ 9250.086731][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9250.086998][ C1] ip_finish_output2+0x786/0x18e0 [ 9250.087259][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9250.087532][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9250.087859][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9250.088127][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9250.088374][ C1] ? __ip_finish_output+0x10f/0x770 [ 9250.088631][ C1] ip_output+0x16b/0x4f0 [ 9250.088843][ C1] ? run_timer_softirq+0x72/0x100 [ 9250.089092][ C1] ? __pfx_ip_output+0x10/0x10 [ 9250.089327][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9250.089608][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9250.089854][ C1] ? ip_local_out+0x114/0x3b0 [ 9250.090086][ C1] __ip_queue_xmit+0x672/0x1910 [ 9250.090327][ C1] ? __create_object+0x5e/0xb0 [ 9250.090566][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9250.090825][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9250.091100][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9250.091367][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9250.091639][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9250.091906][ C1] tcp_delack_timer+0x84/0x240 [ 9250.092141][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9250.092409][ C1] call_timer_fn+0x173/0x430 [ 9250.092636][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9250.092890][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9250.093145][ C1] __run_timers.part.0+0x52d/0x890 [ 9250.093400][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9250.093666][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9250.093943][ C1] ? lock_acquire+0x1c1/0x220 [ 9250.094176][ C1] ? clockevents_program_event+0xf6/0x300 [ 9250.094460][ C1] ? lock_release+0x1d5/0x250 [ 9250.094693][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9250.094949][ C1] ? ktime_get+0xb3/0x190 [ 9250.095166][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9250.095454][ C1] run_timer_softirq+0x72/0x100 [ 9250.095696][ C1] __do_softirq+0x1b9/0x7ff [ 9250.095946][ C1] irq_exit_rcu+0x98/0xc0 [ 9250.096167][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9250.096455][ C1] [ 9250.096608][ C1] [ 9250.096759][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9250.097073][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9250.097389][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9250.098340][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9250.098639][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9250.099054][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9250.099454][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9250.099851][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9250.100249][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9250.100639][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9250.100927][ C1] pipe_read+0xa16/0xdf0 [ 9250.101143][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9250.101416][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9250.101653][ C1] ? iterate_tty_write+0x299/0x540 [ 9250.101907][ C1] ? lock_release+0x1d5/0x250 [ 9250.102140][ C1] vfs_read+0x911/0xc00 [ 9250.102351][ C1] ? lock_acquire+0x1c1/0x220 [ 9250.102585][ C1] ? __might_fault+0xc6/0x180 [ 9250.102818][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9250.103051][ C1] ? __might_fault+0xc6/0x180 [ 9250.103287][ C1] ? lock_release+0x1d5/0x250 [ 9250.103519][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9250.103778][ C1] ? __fget_light+0x54/0x1e0 [ 9250.104007][ C1] ksys_read+0x17a/0x1e0 [ 9250.104221][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9250.104458][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9250.104753][ C1] do_syscall_64+0xc9/0x1e0 [ 9250.104981][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9250.105275][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9250.105497][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9250.106483][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9250.106905][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9250.107308][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9250.107696][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9250.108085][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9250.108475][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9250.108866][ C1] [ 9250.109021][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9250.109287][ C2] NMI backtrace for cpu 2 [ 9250.109293][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9250.109299][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9250.109303][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9250.109309][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9250.109311][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9250.109314][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9250.109315][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9250.109317][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9250.109319][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9250.109320][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9250.109322][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9250.109324][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9250.109327][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9250.109328][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9250.109330][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9250.109332][ C2] PKRU: 55555554 [ 9250.109333][ C2] Call Trace: [ 9250.109335][ C2] [ 9250.109336][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9250.109343][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9250.109347][ C2] ? nmi_handle+0x153/0x420 [ 9250.109351][ C2] ? default_do_nmi+0x41/0x100 [ 9250.109354][ C2] ? exc_nmi+0xf3/0x120 [ 9250.109357][ C2] ? end_repeat_nmi+0xf/0x60 [ 9250.109362][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9250.109365][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9250.109368][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9250.109372][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9250.109374][ C2] [ 9250.109375][ C2] [ 9250.109377][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9250.109379][ C2] ? get_stack_info+0x36/0xc0 [ 9250.109383][ C2] ? lock_acquire+0x1c1/0x220 [ 9250.109387][ C2] ? lock_release+0x1d5/0x250 [ 9250.109391][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9250.109395][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9250.109397][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9250.109401][ C2] ? lock_acquire+0x1c1/0x220 [ 9250.109403][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9250.109407][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9250.109410][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9250.109416][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9250.109418][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9250.109422][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9250.109427][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9250.109430][ C2] ip_local_deliver+0x19d/0x480 [ 9250.109433][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9250.109435][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9250.109437][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9250.109442][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9250.109446][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9250.109449][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9250.109458][ C2] ip_rcv+0x564/0x740 [ 9250.109461][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9250.109463][ C2] ? set_track_prepare+0x8a/0xd0 [ 9250.109467][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9250.109470][ C2] ? start_secondary+0x21c/0x2b0 [ 9250.109473][ C2] ? skb_clone+0x10b/0x330 [ 9250.109476][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9250.109482][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9250.109487][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9250.109490][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9250.109498][ C2] ? __tcf_classify+0x329/0x7d0 [ 9250.109501][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9250.109503][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9250.109506][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9250.109510][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9250.109514][ C2] ? lock_acquire+0x1c1/0x220 [ 9250.109516][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9250.109520][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9250.109524][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9250.109527][ C2] ? __copy_skb_header+0xaf/0x490 [ 9250.109532][ C2] ? __skb_clone+0x57a/0x760 [ 9250.109534][ C2] netif_receive_skb+0x55/0x280 [ 9250.109538][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9250.109544][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9250.109551][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9250.109557][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9250.109561][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9250.109571][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9250.109578][ C2] ? get_stack_info+0x36/0xc0 [ 9250.109582][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9250.109585][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9250.109589][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9250.109591][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9250.109594][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9250.109596][ C2] ? kernel_text_address+0x17/0xe0 [ 9250.109600][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9250.109603][ C2] ? arch_stack_walk+0x8c/0x100 [ 9250.109607][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9250.109610][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9250.109613][ C2] ? lock_acquire+0x1c1/0x220 [ 9250.109615][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9250.109620][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9250.109624][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9250.109627][ C2] ? get_stack_info+0x36/0xc0 [ 9250.109631][ C2] __tcf_classify+0x329/0x7d0 [ 9250.109636][ C2] tcf_classify+0x283/0x930 [ 9250.109640][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9250.109643][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9250.109647][ C2] tc_run+0x2e4/0x5d0 [ 9250.109651][ C2] ? __pfx_tc_run+0x10/0x10 [ 9250.109654][ C2] ? lock_acquire+0x1c1/0x220 [ 9250.109656][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9250.109660][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9250.109664][ C2] ? lock_acquire+0x1c1/0x220 [ 9250.109666][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9250.109669][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9250.109672][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9250.109675][ C2] ? neigh_hh_output+0x348/0x590 [ 9250.109679][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9250.109682][ C2] ip_finish_output2+0x786/0x18e0 [ 9250.109686][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9250.109693][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9250.109695][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9250.109699][ C2] ? __ip_finish_output+0x10f/0x770 [ 9250.109703][ C2] ip_output+0x16b/0x4f0 [ 9250.109706][ C2] ? __pfx_ip_output+0x10/0x10 [ 9250.109708][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9250.109711][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9250.109714][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9250.109717][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9250.109720][ C2] ? __alloc_skb+0xd4/0x280 [ 9250.109722][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9250.109726][ C2] ? tcp_fragment+0x168/0x1040 [ 9250.109729][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9250.109732][ C2] ? ip_local_out+0x114/0x3b0 [ 9250.109735][ C2] __ip_queue_xmit+0x672/0x1910 [ 9250.109739][ C2] ? __skb_clone+0x57a/0x760 [ 9250.109741][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9250.109746][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9250.109749][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9250.109753][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9250.109757][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9250.109761][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9250.109763][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9250.109767][ C2] tcp_send_loss_probe+0x348/0x830 [ 9250.109770][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9250.109773][ C2] tcp_write_timer+0x82/0x1d0 [ 9250.109776][ C2] call_timer_fn+0x173/0x430 [ 9250.109780][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9250.109784][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9250.109788][ C2] __run_timers.part.0+0x52d/0x890 [ 9250.109790][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9250.109794][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9250.109797][ C2] ? lock_acquire+0x1c1/0x220 [ 9250.109799][ C2] ? clockevents_program_event+0xf6/0x300 [ 9250.109804][ C2] ? lock_release+0x1d5/0x250 [ 9250.109806][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9250.109810][ C2] ? ktime_get+0xb3/0x190 [ 9250.109813][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9250.109817][ C2] run_timer_softirq+0x72/0x100 [ 9250.109821][ C2] __do_softirq+0x1b9/0x7ff [ 9250.109825][ C2] irq_exit_rcu+0x98/0xc0 [ 9250.109827][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9250.109830][ C2] [ 9250.109831][ C2] [ 9250.109832][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9250.109835][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9250.109838][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9250.109840][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9250.109842][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9250.109843][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9250.109845][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9250.109846][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9250.109848][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9250.109851][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9250.109854][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9250.109857][ C2] default_idle_call+0x69/0xa0 [ 9250.109860][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9250.109862][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9250.109866][ C2] ? lock_release+0x1d5/0x250 [ 9250.109868][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9250.109872][ C2] do_idle+0xfb/0x160 [ 9250.109874][ C2] cpu_startup_entry+0x55/0x60 [ 9250.109877][ C2] start_secondary+0x21c/0x2b0 [ 9250.109880][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9250.109884][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9250.109889][ C2] [ 9276.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6448s! [perl:4135] [ 9276.569683][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9276.570909][ C1] irq event stamp: 209232 [ 9276.571121][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9276.571640][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9276.572103][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9276.572559][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9276.573010][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9276.573449][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9276.574044][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9276.574362][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9276.575308][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9276.575609][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9276.576023][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9276.576428][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9276.576827][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9276.577228][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9276.577616][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9276.578051][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9276.578378][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9276.578769][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9276.579157][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9276.579545][ C1] PKRU: 55555554 [ 9276.579723][ C1] Call Trace: [ 9276.579889][ C1] [ 9276.580032][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9276.580288][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9276.580526][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9276.580795][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9276.581062][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9276.581343][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9276.581600][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9276.581899][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9276.582154][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9276.582456][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9276.582745][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9276.583050][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9276.583333][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9276.583622][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9276.583903][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9276.584207][ C1] ? get_stack_info+0x36/0xc0 [ 9276.584444][ C1] ? lock_acquire+0x1c1/0x220 [ 9276.584677][ C1] ? lock_release+0x1d5/0x250 [ 9276.584911][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9276.585155][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9276.585421][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9276.585700][ C1] ? lock_acquire+0x1c1/0x220 [ 9276.585936][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9276.586192][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9276.586451][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9276.586687][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9276.586965][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9276.587223][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9276.587506][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9276.587775][ C1] ip_local_deliver+0x19d/0x480 [ 9276.588022][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9276.588289][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9276.588548][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9276.588889][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9276.589137][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9276.589472][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9276.589736][ C1] ip_rcv+0x564/0x740 [ 9276.589940][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9276.590172][ C1] ? set_track_prepare+0x8a/0xd0 [ 9276.590427][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9276.590703][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9276.590976][ C1] ? skb_clone+0x10b/0x330 [ 9276.591207][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9276.591528][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9276.591834][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9276.592117][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9276.592413][ C1] ? __tcf_classify+0x329/0x7d0 [ 9276.592662][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9276.592895][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9276.593196][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9276.593482][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9276.593808][ C1] ? lock_acquire+0x1c1/0x220 [ 9276.594048][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9276.594346][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9276.594635][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9276.594953][ C1] ? __copy_skb_header+0xaf/0x490 [ 9276.595212][ C1] ? __skb_clone+0x57a/0x760 [ 9276.595447][ C1] netif_receive_skb+0x55/0x280 [ 9276.595695][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9276.596012][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9276.596346][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9276.596647][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9276.596921][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9276.597213][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9276.597523][ C1] ? hlock_class+0x4e/0x130 [ 9276.597758][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9276.598034][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9276.598314][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9276.598579][ C1] ? hlock_class+0x4e/0x130 [ 9276.598809][ C1] ? mark_lock+0x38/0x3e0 [ 9276.599030][ C1] ? stack_access_ok+0xda/0x1f0 [ 9276.599282][ C1] ? __lock_acquire+0xb67/0x1610 [ 9276.599537][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9276.599813][ C1] ? get_stack_info+0x36/0xc0 [ 9276.600055][ C1] ? stack_access_ok+0xda/0x1f0 [ 9276.600303][ C1] ? get_reg+0x119/0x190 [ 9276.600520][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9276.600788][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9276.601098][ C1] __tcf_classify+0x329/0x7d0 [ 9276.601342][ C1] tcf_classify+0x283/0x930 [ 9276.601573][ C1] ? arch_stack_walk+0xa2/0x100 [ 9276.601824][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9276.602080][ C1] ? get_stack_info+0x36/0xc0 [ 9276.602324][ C1] tc_run+0x2e4/0x5d0 [ 9276.602530][ C1] ? __pfx_tc_run+0x10/0x10 [ 9276.602763][ C1] ? lock_acquire+0x1c1/0x220 [ 9276.603002][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9276.603266][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9276.603520][ C1] ? lock_acquire+0x1c1/0x220 [ 9276.603759][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9276.604023][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9276.604331][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9276.604603][ C1] ? neigh_hh_output+0x348/0x590 [ 9276.604857][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9276.605123][ C1] ip_finish_output2+0x786/0x18e0 [ 9276.605381][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9276.605660][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9276.606001][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9276.606278][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9276.606531][ C1] ? __ip_finish_output+0x10f/0x770 [ 9276.606796][ C1] ip_output+0x16b/0x4f0 [ 9276.607022][ C1] ? run_timer_softirq+0x72/0x100 [ 9276.607273][ C1] ? __pfx_ip_output+0x10/0x10 [ 9276.607510][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9276.607790][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9276.608037][ C1] ? ip_local_out+0x114/0x3b0 [ 9276.608273][ C1] __ip_queue_xmit+0x672/0x1910 [ 9276.608514][ C1] ? __create_object+0x5e/0xb0 [ 9276.608751][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9276.609012][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9276.609289][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9276.609555][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9276.609830][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9276.610097][ C1] tcp_delack_timer+0x84/0x240 [ 9276.610335][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9276.610602][ C1] call_timer_fn+0x173/0x430 [ 9276.610831][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9276.611087][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9276.611344][ C1] __run_timers.part.0+0x52d/0x890 [ 9276.611599][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9276.611866][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9276.612143][ C1] ? lock_acquire+0x1c1/0x220 [ 9276.612378][ C1] ? clockevents_program_event+0xf6/0x300 [ 9276.612661][ C1] ? lock_release+0x1d5/0x250 [ 9276.612894][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9276.613153][ C1] ? ktime_get+0xb3/0x190 [ 9276.613371][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9276.613660][ C1] run_timer_softirq+0x72/0x100 [ 9276.613902][ C1] __do_softirq+0x1b9/0x7ff [ 9276.614130][ C1] irq_exit_rcu+0x98/0xc0 [ 9276.614346][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9276.614626][ C1] [ 9276.614772][ C1] [ 9276.614920][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9276.615216][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9276.615534][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9276.616519][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9276.616824][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9276.617230][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9276.617615][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9276.618002][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9276.618391][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9276.618783][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9276.619070][ C1] pipe_read+0xa16/0xdf0 [ 9276.619288][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9276.619558][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9276.619796][ C1] ? iterate_tty_write+0x299/0x540 [ 9276.620053][ C1] ? lock_release+0x1d5/0x250 [ 9276.620289][ C1] vfs_read+0x911/0xc00 [ 9276.620497][ C1] ? lock_acquire+0x1c1/0x220 [ 9276.620730][ C1] ? __might_fault+0xc6/0x180 [ 9276.620963][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9276.621198][ C1] ? __might_fault+0xc6/0x180 [ 9276.621432][ C1] ? lock_release+0x1d5/0x250 [ 9276.621666][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9276.621924][ C1] ? __fget_light+0x54/0x1e0 [ 9276.622155][ C1] ksys_read+0x17a/0x1e0 [ 9276.622369][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9276.622608][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9276.622902][ C1] do_syscall_64+0xc9/0x1e0 [ 9276.623130][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9276.623423][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9276.623643][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9276.624590][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9276.625002][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9276.625390][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9276.625801][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9276.626200][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9276.626599][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9276.627009][ C1] [ 9276.627163][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6448s! [swapper/2:0] [ 9276.627564][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9276.628773][ C2] irq event stamp: 44114564 [ 9276.628995][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9276.629514][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9276.630010][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9276.630471][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9276.630923][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9276.631367][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9276.631957][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9276.632272][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9276.633211][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9276.633509][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9276.633894][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9276.634283][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9276.634667][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9276.635052][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9276.635438][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9276.635894][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9276.636225][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9276.636623][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9276.637028][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9276.637415][ C2] PKRU: 55555554 [ 9276.637592][ C2] Call Trace: [ 9276.637757][ C2] [ 9276.637899][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9276.638152][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9276.638388][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9276.638656][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9276.638921][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9276.639200][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9276.639456][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9276.639753][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9276.640006][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9276.640258][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9276.640558][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9276.640845][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9276.641149][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9276.641431][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9276.641718][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9276.641997][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9276.642299][ C2] ? get_stack_info+0x36/0xc0 [ 9276.642533][ C2] ? lock_acquire+0x1c1/0x220 [ 9276.642765][ C2] ? lock_release+0x1d5/0x250 [ 9276.642996][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9276.643239][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9276.643503][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9276.643781][ C2] ? lock_acquire+0x1c1/0x220 [ 9276.644012][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9276.644244][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9276.644495][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9276.644725][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9276.644967][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9276.645217][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9276.645481][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9276.645770][ C2] ip_local_deliver+0x19d/0x480 [ 9276.646015][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9276.646288][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9276.646551][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9276.646894][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9276.647150][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9276.647459][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9276.647713][ C2] ip_rcv+0x564/0x740 [ 9276.647909][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9276.648133][ C2] ? set_track_prepare+0x8a/0xd0 [ 9276.648379][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9276.648646][ C2] ? start_secondary+0x21c/0x2b0 [ 9276.648888][ C2] ? skb_clone+0x10b/0x330 [ 9276.649108][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9276.649417][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9276.649712][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9276.649985][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9276.650269][ C2] ? __tcf_classify+0x329/0x7d0 [ 9276.650509][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9276.650732][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9276.651021][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9276.651299][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9276.651613][ C2] ? lock_acquire+0x1c1/0x220 [ 9276.651844][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9276.652130][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9276.652408][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9276.652715][ C2] ? __copy_skb_header+0xaf/0x490 [ 9276.652964][ C2] ? __skb_clone+0x57a/0x760 [ 9276.653190][ C2] netif_receive_skb+0x55/0x280 [ 9276.653431][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9276.653733][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9276.654053][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9276.654344][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9276.654608][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9276.654886][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9276.655189][ C2] ? get_stack_info+0x36/0xc0 [ 9276.655423][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9276.655677][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9276.656011][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9276.656285][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9276.656561][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9276.656873][ C2] ? kernel_text_address+0x17/0xe0 [ 9276.657138][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9276.657441][ C2] ? arch_stack_walk+0x8c/0x100 [ 9276.657680][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9276.657937][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9276.658216][ C2] ? lock_acquire+0x1c1/0x220 [ 9276.658448][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9276.658720][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9276.659015][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9276.659282][ C2] ? get_stack_info+0x36/0xc0 [ 9276.659517][ C2] __tcf_classify+0x329/0x7d0 [ 9276.659751][ C2] tcf_classify+0x283/0x930 [ 9276.659975][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9276.660224][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9276.660527][ C2] tc_run+0x2e4/0x5d0 [ 9276.660724][ C2] ? __pfx_tc_run+0x10/0x10 [ 9276.660949][ C2] ? lock_acquire+0x1c1/0x220 [ 9276.661181][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9276.661435][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9276.661680][ C2] ? lock_acquire+0x1c1/0x220 [ 9276.661910][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9276.662168][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9276.662463][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9276.662728][ C2] ? neigh_hh_output+0x348/0x590 [ 9276.662973][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9276.663231][ C2] ip_finish_output2+0x786/0x18e0 [ 9276.663480][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9276.663807][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9276.664073][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9276.664320][ C2] ? __ip_finish_output+0x10f/0x770 [ 9276.664575][ C2] ip_output+0x16b/0x4f0 [ 9276.664785][ C2] ? __pfx_ip_output+0x10/0x10 [ 9276.665024][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9276.665296][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9276.665599][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9276.665892][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9276.666143][ C2] ? __alloc_skb+0xd4/0x280 [ 9276.666370][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9276.666640][ C2] ? tcp_fragment+0x168/0x1040 [ 9276.666882][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9276.667141][ C2] ? ip_local_out+0x114/0x3b0 [ 9276.667374][ C2] __ip_queue_xmit+0x672/0x1910 [ 9276.667614][ C2] ? __skb_clone+0x57a/0x760 [ 9276.667842][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9276.668100][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9276.668372][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9276.668607][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9276.668848][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9276.669141][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9276.669452][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9276.669687][ C2] tcp_send_loss_probe+0x348/0x830 [ 9276.669938][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9276.670200][ C2] tcp_write_timer+0x82/0x1d0 [ 9276.670430][ C2] call_timer_fn+0x173/0x430 [ 9276.670659][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9276.670911][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9276.671164][ C2] __run_timers.part.0+0x52d/0x890 [ 9276.671416][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9276.671676][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9276.671953][ C2] ? lock_acquire+0x1c1/0x220 [ 9276.672185][ C2] ? clockevents_program_event+0xf6/0x300 [ 9276.672466][ C2] ? lock_release+0x1d5/0x250 [ 9276.672697][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9276.672952][ C2] ? ktime_get+0xb3/0x190 [ 9276.673165][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9276.673453][ C2] run_timer_softirq+0x72/0x100 [ 9276.673693][ C2] __do_softirq+0x1b9/0x7ff [ 9276.673917][ C2] irq_exit_rcu+0x98/0xc0 [ 9276.674129][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9276.674404][ C2] [ 9276.674552][ C2] [ 9276.674700][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9276.674995][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9276.675244][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9276.676211][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9276.676518][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9276.676912][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9276.677308][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9276.677694][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9276.678079][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9276.678466][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9276.678746][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9276.678998][ C2] default_idle_call+0x69/0xa0 [ 9276.679235][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9276.679477][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9276.679747][ C2] ? lock_release+0x1d5/0x250 [ 9276.679977][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9276.680245][ C2] do_idle+0xfb/0x160 [ 9276.680442][ C2] cpu_startup_entry+0x55/0x60 [ 9276.680678][ C2] start_secondary+0x21c/0x2b0 [ 9276.680913][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9276.681175][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9276.681474][ C2] [ 9304.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6474s! [swapper/2:0] [ 9304.569673][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9304.570881][ C2] irq event stamp: 44114564 [ 9304.571103][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9304.571619][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9304.572114][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9304.572575][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9304.573028][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9304.573469][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9304.574060][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9304.574374][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9304.575313][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9304.575611][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9304.575996][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9304.576382][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9304.576765][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9304.577152][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9304.577538][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9304.577969][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9304.578290][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9304.578675][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9304.579063][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9304.579449][ C2] PKRU: 55555554 [ 9304.579625][ C2] Call Trace: [ 9304.579788][ C2] [ 9304.579932][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9304.580185][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9304.580420][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9304.580687][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9304.580949][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9304.581231][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9304.581487][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9304.581783][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9304.582036][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9304.582290][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9304.582588][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9304.582873][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9304.583177][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9304.583457][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9304.583741][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9304.584021][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9304.584322][ C2] ? get_stack_info+0x36/0xc0 [ 9304.584553][ C2] ? lock_acquire+0x1c1/0x220 [ 9304.584786][ C2] ? lock_release+0x1d5/0x250 [ 9304.585018][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9304.585259][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9304.585522][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9304.585800][ C2] ? lock_acquire+0x1c1/0x220 [ 9304.586032][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9304.586267][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9304.586517][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9304.586744][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9304.586982][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9304.587235][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9304.587502][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9304.587770][ C2] ip_local_deliver+0x19d/0x480 [ 9304.588010][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9304.588274][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9304.588529][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9304.588867][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9304.589112][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9304.589425][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9304.589679][ C2] ip_rcv+0x564/0x740 [ 9304.589878][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9304.590101][ C2] ? set_track_prepare+0x8a/0xd0 [ 9304.590351][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9304.590621][ C2] ? start_secondary+0x21c/0x2b0 [ 9304.590866][ C2] ? skb_clone+0x10b/0x330 [ 9304.591085][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9304.591396][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9304.591694][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9304.591966][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9304.592254][ C2] ? __tcf_classify+0x329/0x7d0 [ 9304.592496][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9304.592719][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9304.593011][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9304.593288][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9304.593604][ C2] ? lock_acquire+0x1c1/0x220 [ 9304.593840][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9304.594129][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9304.594407][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9304.594715][ C2] ? __copy_skb_header+0xaf/0x490 [ 9304.594965][ C2] ? __skb_clone+0x57a/0x760 [ 9304.595194][ C2] netif_receive_skb+0x55/0x280 [ 9304.595436][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9304.595762][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9304.596094][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9304.596392][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9304.596667][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9304.596962][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9304.597269][ C2] ? get_stack_info+0x36/0xc0 [ 9304.597503][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9304.597760][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9304.598066][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9304.598335][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9304.598604][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9304.598909][ C2] ? kernel_text_address+0x17/0xe0 [ 9304.599161][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9304.599465][ C2] ? arch_stack_walk+0x8c/0x100 [ 9304.599706][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9304.599962][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9304.600240][ C2] ? lock_acquire+0x1c1/0x220 [ 9304.600472][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9304.600746][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9304.601040][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9304.601311][ C2] ? get_stack_info+0x36/0xc0 [ 9304.601543][ C2] __tcf_classify+0x329/0x7d0 [ 9304.601778][ C2] tcf_classify+0x283/0x930 [ 9304.602004][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9304.602254][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9304.602558][ C2] tc_run+0x2e4/0x5d0 [ 9304.602757][ C2] ? __pfx_tc_run+0x10/0x10 [ 9304.602980][ C2] ? lock_acquire+0x1c1/0x220 [ 9304.603214][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9304.603467][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9304.603713][ C2] ? lock_acquire+0x1c1/0x220 [ 9304.603945][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9304.604201][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9304.604498][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9304.604762][ C2] ? neigh_hh_output+0x348/0x590 [ 9304.605007][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9304.605265][ C2] ip_finish_output2+0x786/0x18e0 [ 9304.605514][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9304.605866][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9304.606144][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9304.606397][ C2] ? __ip_finish_output+0x10f/0x770 [ 9304.606661][ C2] ip_output+0x16b/0x4f0 [ 9304.606884][ C2] ? __pfx_ip_output+0x10/0x10 [ 9304.607121][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9304.607389][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9304.607694][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9304.607962][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9304.608207][ C2] ? __alloc_skb+0xd4/0x280 [ 9304.608432][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9304.608694][ C2] ? tcp_fragment+0x168/0x1040 [ 9304.608932][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9304.609177][ C2] ? ip_local_out+0x114/0x3b0 [ 9304.609411][ C2] __ip_queue_xmit+0x672/0x1910 [ 9304.609652][ C2] ? __skb_clone+0x57a/0x760 [ 9304.609879][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9304.610137][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9304.610413][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9304.610649][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9304.610890][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9304.611184][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9304.611495][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9304.611732][ C2] tcp_send_loss_probe+0x348/0x830 [ 9304.611985][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9304.612246][ C2] tcp_write_timer+0x82/0x1d0 [ 9304.612481][ C2] call_timer_fn+0x173/0x430 [ 9304.612712][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9304.612966][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9304.613222][ C2] __run_timers.part.0+0x52d/0x890 [ 9304.613475][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9304.613736][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9304.614011][ C2] ? lock_acquire+0x1c1/0x220 [ 9304.614245][ C2] ? clockevents_program_event+0xf6/0x300 [ 9304.614528][ C2] ? lock_release+0x1d5/0x250 [ 9304.614758][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9304.615020][ C2] ? ktime_get+0xb3/0x190 [ 9304.615236][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9304.615527][ C2] run_timer_softirq+0x72/0x100 [ 9304.615792][ C2] __do_softirq+0x1b9/0x7ff [ 9304.616024][ C2] irq_exit_rcu+0x98/0xc0 [ 9304.616245][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9304.616530][ C2] [ 9304.616678][ C2] [ 9304.616841][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9304.617138][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9304.617389][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9304.618330][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9304.618627][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9304.619018][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9304.619407][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9304.619793][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9304.620181][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9304.620572][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9304.620852][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9304.621105][ C2] default_idle_call+0x69/0xa0 [ 9304.621343][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9304.621588][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9304.621857][ C2] ? lock_release+0x1d5/0x250 [ 9304.622090][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9304.622357][ C2] do_idle+0xfb/0x160 [ 9304.622555][ C2] cpu_startup_entry+0x55/0x60 [ 9304.622792][ C2] start_secondary+0x21c/0x2b0 [ 9304.623029][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9304.623291][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9304.623593][ C2] [ 9304.623747][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6474s! [perl:4135] [ 9304.624151][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9304.625373][ C1] irq event stamp: 209232 [ 9304.625585][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9304.626130][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9304.626608][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9304.627079][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9304.627528][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9304.627964][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9304.628562][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9304.628878][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9304.629823][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9304.630123][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9304.630515][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9304.630903][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9304.631292][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9304.631685][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9304.632073][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9304.632511][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9304.632834][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9304.633225][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9304.633614][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9304.634002][ C1] PKRU: 55555554 [ 9304.634180][ C1] Call Trace: [ 9304.634346][ C1] [ 9304.634490][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9304.634745][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9304.634983][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9304.635253][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9304.635516][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9304.635823][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9304.636090][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9304.636398][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9304.636660][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9304.636976][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9304.637264][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9304.637570][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9304.637852][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9304.638139][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9304.638422][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9304.638726][ C1] ? get_stack_info+0x36/0xc0 [ 9304.638958][ C1] ? lock_acquire+0x1c1/0x220 [ 9304.639194][ C1] ? lock_release+0x1d5/0x250 [ 9304.639427][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9304.639672][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9304.639937][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9304.640214][ C1] ? lock_acquire+0x1c1/0x220 [ 9304.640449][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9304.640683][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9304.640937][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9304.641166][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9304.641407][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9304.641658][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9304.641927][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9304.642197][ C1] ip_local_deliver+0x19d/0x480 [ 9304.642441][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9304.642706][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9304.642963][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9304.643304][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9304.643551][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9304.643863][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9304.644118][ C1] ip_rcv+0x564/0x740 [ 9304.644319][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9304.644542][ C1] ? set_track_prepare+0x8a/0xd0 [ 9304.644790][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9304.645061][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9304.645328][ C1] ? skb_clone+0x10b/0x330 [ 9304.645549][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9304.645886][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9304.646195][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9304.646478][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9304.646774][ C1] ? __tcf_classify+0x329/0x7d0 [ 9304.647028][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9304.647253][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9304.647545][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9304.647825][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9304.648143][ C1] ? lock_acquire+0x1c1/0x220 [ 9304.648377][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9304.648667][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9304.648944][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9304.649255][ C1] ? __copy_skb_header+0xaf/0x490 [ 9304.649506][ C1] ? __skb_clone+0x57a/0x760 [ 9304.649736][ C1] netif_receive_skb+0x55/0x280 [ 9304.649977][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9304.650284][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9304.650608][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9304.650899][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9304.651167][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9304.651449][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9304.651754][ C1] ? hlock_class+0x4e/0x130 [ 9304.651982][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9304.652253][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9304.652521][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9304.652777][ C1] ? hlock_class+0x4e/0x130 [ 9304.653004][ C1] ? mark_lock+0x38/0x3e0 [ 9304.653220][ C1] ? stack_access_ok+0xda/0x1f0 [ 9304.653462][ C1] ? __lock_acquire+0xb67/0x1610 [ 9304.653709][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9304.653980][ C1] ? get_stack_info+0x36/0xc0 [ 9304.654213][ C1] ? stack_access_ok+0xda/0x1f0 [ 9304.654455][ C1] ? get_reg+0x119/0x190 [ 9304.654668][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9304.654930][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9304.655233][ C1] __tcf_classify+0x329/0x7d0 [ 9304.655468][ C1] tcf_classify+0x283/0x930 [ 9304.655720][ C1] ? arch_stack_walk+0xa2/0x100 [ 9304.655969][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9304.656227][ C1] ? get_stack_info+0x36/0xc0 [ 9304.656469][ C1] tc_run+0x2e4/0x5d0 [ 9304.656675][ C1] ? __pfx_tc_run+0x10/0x10 [ 9304.656912][ C1] ? lock_acquire+0x1c1/0x220 [ 9304.657144][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9304.657399][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9304.657645][ C1] ? lock_acquire+0x1c1/0x220 [ 9304.657877][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9304.658135][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9304.658433][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9304.658697][ C1] ? neigh_hh_output+0x348/0x590 [ 9304.658944][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9304.659202][ C1] ip_finish_output2+0x786/0x18e0 [ 9304.659451][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9304.659720][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9304.660051][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9304.660320][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9304.660568][ C1] ? __ip_finish_output+0x10f/0x770 [ 9304.660826][ C1] ip_output+0x16b/0x4f0 [ 9304.661035][ C1] ? run_timer_softirq+0x72/0x100 [ 9304.661287][ C1] ? __pfx_ip_output+0x10/0x10 [ 9304.661525][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9304.661805][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9304.662050][ C1] ? ip_local_out+0x114/0x3b0 [ 9304.662284][ C1] __ip_queue_xmit+0x672/0x1910 [ 9304.662526][ C1] ? __create_object+0x5e/0xb0 [ 9304.662764][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9304.663024][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9304.663299][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9304.663566][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9304.663840][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9304.664105][ C1] tcp_delack_timer+0x84/0x240 [ 9304.664344][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9304.664608][ C1] call_timer_fn+0x173/0x430 [ 9304.664840][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9304.665094][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9304.665349][ C1] __run_timers.part.0+0x52d/0x890 [ 9304.665605][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9304.665896][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9304.666183][ C1] ? lock_acquire+0x1c1/0x220 [ 9304.666423][ C1] ? clockevents_program_event+0xf6/0x300 [ 9304.666715][ C1] ? lock_release+0x1d5/0x250 [ 9304.666962][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9304.667222][ C1] ? ktime_get+0xb3/0x190 [ 9304.667438][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9304.667728][ C1] run_timer_softirq+0x72/0x100 [ 9304.667969][ C1] __do_softirq+0x1b9/0x7ff [ 9304.668198][ C1] irq_exit_rcu+0x98/0xc0 [ 9304.668412][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9304.668694][ C1] [ 9304.668841][ C1] [ 9304.668986][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9304.669285][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9304.669601][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9304.670547][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9304.670847][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9304.671237][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9304.671627][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9304.672016][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9304.672410][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9304.672800][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9304.673089][ C1] pipe_read+0xa16/0xdf0 [ 9304.673304][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9304.673576][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9304.673812][ C1] ? iterate_tty_write+0x299/0x540 [ 9304.674068][ C1] ? lock_release+0x1d5/0x250 [ 9304.674304][ C1] vfs_read+0x911/0xc00 [ 9304.674512][ C1] ? lock_acquire+0x1c1/0x220 [ 9304.674744][ C1] ? __might_fault+0xc6/0x180 [ 9304.674980][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9304.675215][ C1] ? __might_fault+0xc6/0x180 [ 9304.675448][ C1] ? lock_release+0x1d5/0x250 [ 9304.675703][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9304.675967][ C1] ? __fget_light+0x54/0x1e0 [ 9304.676205][ C1] ksys_read+0x17a/0x1e0 [ 9304.676423][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9304.676667][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9304.676983][ C1] do_syscall_64+0xc9/0x1e0 [ 9304.677210][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9304.677501][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9304.677723][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9304.678668][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9304.679078][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9304.679467][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9304.679854][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9304.680244][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9304.680634][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9304.681025][ C1] [ 9328.110103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9328.110453][ C1] rcu: 1-....: (6955739 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1656614 [ 9328.110997][ C1] rcu: (t=6973223 jiffies g=1882453 q=721 ncpus=4) [ 9328.111324][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9328.111763][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9328.112362][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9328.112679][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9328.113625][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9328.113925][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9328.114314][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9328.114703][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9328.115093][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9328.115483][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9328.115876][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9328.116312][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9328.116636][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9328.117028][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9328.117417][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9328.117804][ C1] PKRU: 55555554 [ 9328.117981][ C1] Call Trace: [ 9328.118147][ C1] [ 9328.118292][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9328.118558][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9328.118804][ C1] ? check_cpu_stall+0x284/0x500 [ 9328.119050][ C1] ? rcu_pending+0x92/0x360 [ 9328.119278][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9328.119540][ C1] ? update_process_times+0xb9/0x110 [ 9328.119801][ C1] ? tick_sched_handle+0x67/0x130 [ 9328.120052][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9328.120333][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9328.120568][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9328.120872][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9328.121141][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9328.121422][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9328.121680][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9328.121979][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9328.122236][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9328.122538][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9328.122826][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9328.123131][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9328.123416][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9328.123704][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9328.123986][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9328.124291][ C1] ? get_stack_info+0x36/0xc0 [ 9328.124525][ C1] ? lock_acquire+0x1c1/0x220 [ 9328.124757][ C1] ? lock_release+0x1d5/0x250 [ 9328.124992][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9328.125235][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9328.125504][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9328.125783][ C1] ? lock_acquire+0x1c1/0x220 [ 9328.126015][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9328.126250][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9328.126502][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9328.126732][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9328.126973][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9328.127225][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9328.127493][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9328.127762][ C1] ip_local_deliver+0x19d/0x480 [ 9328.128004][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9328.128273][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9328.128532][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9328.128871][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9328.129118][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9328.129431][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9328.129687][ C1] ip_rcv+0x564/0x740 [ 9328.129886][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9328.130111][ C1] ? set_track_prepare+0x8a/0xd0 [ 9328.130361][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9328.130630][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9328.130896][ C1] ? skb_clone+0x10b/0x330 [ 9328.131119][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9328.131432][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9328.131730][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9328.132006][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9328.132293][ C1] ? __tcf_classify+0x329/0x7d0 [ 9328.132536][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9328.132762][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9328.133056][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9328.133336][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9328.133654][ C1] ? lock_acquire+0x1c1/0x220 [ 9328.133888][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9328.134176][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9328.134458][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9328.134768][ C1] ? __copy_skb_header+0xaf/0x490 [ 9328.135019][ C1] ? __skb_clone+0x57a/0x760 [ 9328.135250][ C1] netif_receive_skb+0x55/0x280 [ 9328.135491][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9328.135825][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9328.136160][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9328.136462][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9328.136746][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9328.137029][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9328.137332][ C1] ? hlock_class+0x4e/0x130 [ 9328.137561][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9328.137830][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9328.138102][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9328.138361][ C1] ? hlock_class+0x4e/0x130 [ 9328.138585][ C1] ? mark_lock+0x38/0x3e0 [ 9328.138803][ C1] ? stack_access_ok+0xda/0x1f0 [ 9328.139047][ C1] ? __lock_acquire+0xb67/0x1610 [ 9328.139297][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9328.139566][ C1] ? get_stack_info+0x36/0xc0 [ 9328.139802][ C1] ? stack_access_ok+0xda/0x1f0 [ 9328.140043][ C1] ? get_reg+0x119/0x190 [ 9328.140255][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9328.140517][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9328.140820][ C1] __tcf_classify+0x329/0x7d0 [ 9328.141057][ C1] tcf_classify+0x283/0x930 [ 9328.141283][ C1] ? arch_stack_walk+0xa2/0x100 [ 9328.141527][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9328.141777][ C1] ? get_stack_info+0x36/0xc0 [ 9328.142013][ C1] tc_run+0x2e4/0x5d0 [ 9328.142214][ C1] ? __pfx_tc_run+0x10/0x10 [ 9328.142442][ C1] ? lock_acquire+0x1c1/0x220 [ 9328.142675][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9328.142932][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9328.143178][ C1] ? lock_acquire+0x1c1/0x220 [ 9328.143414][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9328.143673][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9328.143972][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9328.144238][ C1] ? neigh_hh_output+0x348/0x590 [ 9328.144486][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9328.144746][ C1] ip_finish_output2+0x786/0x18e0 [ 9328.144996][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9328.145271][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9328.145626][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9328.145902][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9328.146157][ C1] ? __ip_finish_output+0x10f/0x770 [ 9328.146421][ C1] ip_output+0x16b/0x4f0 [ 9328.146641][ C1] ? run_timer_softirq+0x72/0x100 [ 9328.146904][ C1] ? __pfx_ip_output+0x10/0x10 [ 9328.147140][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9328.147421][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9328.147668][ C1] ? ip_local_out+0x114/0x3b0 [ 9328.147902][ C1] __ip_queue_xmit+0x672/0x1910 [ 9328.148144][ C1] ? __create_object+0x5e/0xb0 [ 9328.148382][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9328.148643][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9328.148920][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9328.149187][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9328.149463][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9328.149730][ C1] tcp_delack_timer+0x84/0x240 [ 9328.149968][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9328.150236][ C1] call_timer_fn+0x173/0x430 [ 9328.150466][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9328.150722][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9328.150977][ C1] __run_timers.part.0+0x52d/0x890 [ 9328.151233][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9328.151500][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9328.151778][ C1] ? lock_acquire+0x1c1/0x220 [ 9328.152013][ C1] ? clockevents_program_event+0xf6/0x300 [ 9328.152300][ C1] ? lock_release+0x1d5/0x250 [ 9328.152537][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9328.152795][ C1] ? ktime_get+0xb3/0x190 [ 9328.153012][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9328.153303][ C1] run_timer_softirq+0x72/0x100 [ 9328.153545][ C1] __do_softirq+0x1b9/0x7ff [ 9328.153774][ C1] irq_exit_rcu+0x98/0xc0 [ 9328.153989][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9328.154270][ C1] [ 9328.154415][ C1] [ 9328.154564][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9328.154859][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9328.155178][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9328.156164][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9328.156471][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9328.156879][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9328.157268][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9328.157656][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9328.158044][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9328.158439][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9328.158726][ C1] pipe_read+0xa16/0xdf0 [ 9328.158944][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9328.159215][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9328.159454][ C1] ? iterate_tty_write+0x299/0x540 [ 9328.159709][ C1] ? lock_release+0x1d5/0x250 [ 9328.159944][ C1] vfs_read+0x911/0xc00 [ 9328.160152][ C1] ? lock_acquire+0x1c1/0x220 [ 9328.160388][ C1] ? __might_fault+0xc6/0x180 [ 9328.160620][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9328.160855][ C1] ? __might_fault+0xc6/0x180 [ 9328.161090][ C1] ? lock_release+0x1d5/0x250 [ 9328.161326][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9328.161586][ C1] ? __fget_light+0x54/0x1e0 [ 9328.161816][ C1] ksys_read+0x17a/0x1e0 [ 9328.162029][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9328.162269][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9328.162565][ C1] do_syscall_64+0xc9/0x1e0 [ 9328.162793][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9328.163085][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9328.163306][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9328.164252][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9328.164666][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9328.165055][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9328.165445][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9328.165863][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9328.166262][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9328.166665][ C1] [ 9328.166832][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9328.167098][ C2] NMI backtrace for cpu 2 [ 9328.167104][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9328.167109][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9328.167113][ C2] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 9328.167122][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 9328.167127][ C2] RSP: 0018:ffffc9000021fa80 EFLAGS: 00000286 [ 9328.167132][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9328.167136][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9328.167139][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9328.167143][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9328.167145][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9328.167147][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9328.167149][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9328.167152][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9328.167154][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9328.167155][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9328.167157][ C2] PKRU: 55555554 [ 9328.167158][ C2] Call Trace: [ 9328.167160][ C2] [ 9328.167162][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9328.167168][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9328.167173][ C2] ? nmi_handle+0x153/0x420 [ 9328.167178][ C2] ? default_do_nmi+0x41/0x100 [ 9328.167181][ C2] ? exc_nmi+0xf3/0x120 [ 9328.167183][ C2] ? end_repeat_nmi+0xf/0x60 [ 9328.167189][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9328.167192][ C2] ? kasan_check_range+0x1a/0x1c0 [ 9328.167195][ C2] ? kasan_check_range+0x1a/0x1c0 [ 9328.167199][ C2] ? kasan_check_range+0x1a/0x1c0 [ 9328.167202][ C2] [ 9328.167203][ C2] [ 9328.167204][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 9328.167207][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9328.167210][ C2] ? get_stack_info+0x36/0xc0 [ 9328.167213][ C2] ? lock_acquire+0x1c1/0x220 [ 9328.167217][ C2] ? lock_release+0x1d5/0x250 [ 9328.167220][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9328.167224][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9328.167226][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9328.167230][ C2] ? lock_acquire+0x1c1/0x220 [ 9328.167232][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9328.167235][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9328.167238][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9328.167244][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9328.167246][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9328.167251][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9328.167255][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9328.167259][ C2] ip_local_deliver+0x19d/0x480 [ 9328.167261][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9328.167263][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9328.167266][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9328.167271][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9328.167275][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9328.167278][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9328.167286][ C2] ip_rcv+0x564/0x740 [ 9328.167289][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9328.167291][ C2] ? set_track_prepare+0x8a/0xd0 [ 9328.167295][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9328.167298][ C2] ? start_secondary+0x21c/0x2b0 [ 9328.167301][ C2] ? skb_clone+0x10b/0x330 [ 9328.167304][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9328.167310][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9328.167315][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9328.167318][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9328.167327][ C2] ? __tcf_classify+0x329/0x7d0 [ 9328.167330][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9328.167332][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9328.167336][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9328.167339][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9328.167343][ C2] ? lock_acquire+0x1c1/0x220 [ 9328.167346][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9328.167350][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9328.167353][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9328.167357][ C2] ? __copy_skb_header+0xaf/0x490 [ 9328.167361][ C2] ? __skb_clone+0x57a/0x760 [ 9328.167363][ C2] netif_receive_skb+0x55/0x280 [ 9328.167367][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9328.167373][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9328.167379][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9328.167385][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9328.167390][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9328.167399][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9328.167406][ C2] ? get_stack_info+0x36/0xc0 [ 9328.167411][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9328.167414][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9328.167417][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9328.167419][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9328.167422][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9328.167425][ C2] ? kernel_text_address+0x17/0xe0 [ 9328.167428][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9328.167431][ C2] ? arch_stack_walk+0x8c/0x100 [ 9328.167435][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9328.167438][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9328.167442][ C2] ? lock_acquire+0x1c1/0x220 [ 9328.167444][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9328.167447][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9328.167451][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9328.167454][ C2] ? get_stack_info+0x36/0xc0 [ 9328.167458][ C2] __tcf_classify+0x329/0x7d0 [ 9328.167463][ C2] tcf_classify+0x283/0x930 [ 9328.167467][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9328.167470][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9328.167474][ C2] tc_run+0x2e4/0x5d0 [ 9328.167477][ C2] ? __pfx_tc_run+0x10/0x10 [ 9328.167480][ C2] ? lock_acquire+0x1c1/0x220 [ 9328.167483][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9328.167487][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9328.167491][ C2] ? lock_acquire+0x1c1/0x220 [ 9328.167493][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9328.167496][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9328.167500][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9328.167502][ C2] ? neigh_hh_output+0x348/0x590 [ 9328.167506][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9328.167510][ C2] ip_finish_output2+0x786/0x18e0 [ 9328.167513][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9328.167520][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9328.167523][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9328.167526][ C2] ? __ip_finish_output+0x10f/0x770 [ 9328.167530][ C2] ip_output+0x16b/0x4f0 [ 9328.167533][ C2] ? __pfx_ip_output+0x10/0x10 [ 9328.167535][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9328.167538][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9328.167541][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9328.167543][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9328.167546][ C2] ? __alloc_skb+0xd4/0x280 [ 9328.167548][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9328.167552][ C2] ? tcp_fragment+0x168/0x1040 [ 9328.167555][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9328.167557][ C2] ? ip_local_out+0x114/0x3b0 [ 9328.167561][ C2] __ip_queue_xmit+0x672/0x1910 [ 9328.167564][ C2] ? __skb_clone+0x57a/0x760 [ 9328.167567][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9328.167572][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9328.167575][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9328.167578][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9328.167582][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9328.167586][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9328.167589][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9328.167592][ C2] tcp_send_loss_probe+0x348/0x830 [ 9328.167595][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9328.167598][ C2] tcp_write_timer+0x82/0x1d0 [ 9328.167601][ C2] call_timer_fn+0x173/0x430 [ 9328.167605][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9328.167609][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9328.167613][ C2] __run_timers.part.0+0x52d/0x890 [ 9328.167616][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9328.167620][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9328.167622][ C2] ? lock_acquire+0x1c1/0x220 [ 9328.167625][ C2] ? clockevents_program_event+0xf6/0x300 [ 9328.167629][ C2] ? lock_release+0x1d5/0x250 [ 9328.167631][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9328.167634][ C2] ? ktime_get+0xb3/0x190 [ 9328.167637][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9328.167642][ C2] run_timer_softirq+0x72/0x100 [ 9328.167645][ C2] __do_softirq+0x1b9/0x7ff [ 9328.167650][ C2] irq_exit_rcu+0x98/0xc0 [ 9328.167652][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9328.167655][ C2] [ 9328.167656][ C2] [ 9328.167657][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9328.167660][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9328.167664][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9328.167665][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9328.167667][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9328.167669][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9328.167670][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9328.167672][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9328.167673][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9328.167677][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9328.167680][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9328.167683][ C2] default_idle_call+0x69/0xa0 [ 9328.167686][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9328.167688][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9328.167691][ C2] ? lock_release+0x1d5/0x250 [ 9328.167694][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9328.167698][ C2] do_idle+0xfb/0x160 [ 9328.167700][ C2] cpu_startup_entry+0x55/0x60 [ 9328.167703][ C2] start_secondary+0x21c/0x2b0 [ 9328.167705][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9328.167709][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9328.167715][ C2] [ 9352.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6519s! [perl:4135] [ 9352.569677][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9352.570904][ C1] irq event stamp: 209232 [ 9352.571118][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9352.571635][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9352.572099][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9352.572558][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9352.573011][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9352.573448][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9352.574044][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9352.574361][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9352.575310][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9352.575616][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9352.576005][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9352.576397][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9352.576784][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9352.577171][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9352.577562][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9352.577997][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9352.578322][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9352.578712][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9352.579099][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9352.579490][ C1] PKRU: 55555554 [ 9352.579666][ C1] Call Trace: [ 9352.579831][ C1] [ 9352.579975][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9352.580231][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9352.580467][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9352.580739][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9352.581004][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9352.581284][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9352.581544][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9352.581841][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9352.582096][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9352.582399][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9352.582688][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9352.582994][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9352.583276][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9352.583565][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9352.583845][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9352.584149][ C1] ? get_stack_info+0x36/0xc0 [ 9352.584385][ C1] ? lock_acquire+0x1c1/0x220 [ 9352.584620][ C1] ? lock_release+0x1d5/0x250 [ 9352.584851][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9352.585094][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9352.585361][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9352.585643][ C1] ? lock_acquire+0x1c1/0x220 [ 9352.585876][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9352.586109][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9352.586364][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9352.586592][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9352.586833][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9352.587084][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9352.587354][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9352.587626][ C1] ip_local_deliver+0x19d/0x480 [ 9352.587866][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9352.588132][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9352.588391][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9352.588728][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9352.588974][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9352.589287][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9352.589545][ C1] ip_rcv+0x564/0x740 [ 9352.589742][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9352.589969][ C1] ? set_track_prepare+0x8a/0xd0 [ 9352.590217][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9352.590486][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9352.590752][ C1] ? skb_clone+0x10b/0x330 [ 9352.590973][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9352.591285][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9352.591584][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9352.591857][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9352.592149][ C1] ? __tcf_classify+0x329/0x7d0 [ 9352.592391][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9352.592616][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9352.592909][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9352.593187][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9352.593504][ C1] ? lock_acquire+0x1c1/0x220 [ 9352.593737][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9352.594026][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9352.594304][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9352.594614][ C1] ? __copy_skb_header+0xaf/0x490 [ 9352.594864][ C1] ? __skb_clone+0x57a/0x760 [ 9352.595094][ C1] netif_receive_skb+0x55/0x280 [ 9352.595338][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9352.595665][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9352.595999][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9352.596299][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9352.596573][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9352.596866][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9352.597171][ C1] ? hlock_class+0x4e/0x130 [ 9352.597397][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9352.597665][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9352.597935][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9352.598192][ C1] ? hlock_class+0x4e/0x130 [ 9352.598418][ C1] ? mark_lock+0x38/0x3e0 [ 9352.598632][ C1] ? stack_access_ok+0xda/0x1f0 [ 9352.598874][ C1] ? __lock_acquire+0xb67/0x1610 [ 9352.599122][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9352.599392][ C1] ? get_stack_info+0x36/0xc0 [ 9352.599626][ C1] ? stack_access_ok+0xda/0x1f0 [ 9352.599868][ C1] ? get_reg+0x119/0x190 [ 9352.600098][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9352.600367][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9352.600678][ C1] __tcf_classify+0x329/0x7d0 [ 9352.600920][ C1] tcf_classify+0x283/0x930 [ 9352.601152][ C1] ? arch_stack_walk+0xa2/0x100 [ 9352.601406][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9352.601655][ C1] ? get_stack_info+0x36/0xc0 [ 9352.601891][ C1] tc_run+0x2e4/0x5d0 [ 9352.602091][ C1] ? __pfx_tc_run+0x10/0x10 [ 9352.602319][ C1] ? lock_acquire+0x1c1/0x220 [ 9352.602552][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9352.602808][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9352.603055][ C1] ? lock_acquire+0x1c1/0x220 [ 9352.603291][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9352.603550][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9352.603845][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9352.604113][ C1] ? neigh_hh_output+0x348/0x590 [ 9352.604360][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9352.604620][ C1] ip_finish_output2+0x786/0x18e0 [ 9352.604870][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9352.605140][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9352.605492][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9352.605770][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9352.606024][ C1] ? __ip_finish_output+0x10f/0x770 [ 9352.606295][ C1] ip_output+0x16b/0x4f0 [ 9352.606513][ C1] ? run_timer_softirq+0x72/0x100 [ 9352.606778][ C1] ? __pfx_ip_output+0x10/0x10 [ 9352.607017][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9352.607297][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9352.607544][ C1] ? ip_local_out+0x114/0x3b0 [ 9352.607780][ C1] __ip_queue_xmit+0x672/0x1910 [ 9352.608023][ C1] ? __create_object+0x5e/0xb0 [ 9352.608263][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9352.608526][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9352.608800][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9352.609067][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9352.609346][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9352.609613][ C1] tcp_delack_timer+0x84/0x240 [ 9352.609852][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9352.610119][ C1] call_timer_fn+0x173/0x430 [ 9352.610351][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9352.610608][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9352.610864][ C1] __run_timers.part.0+0x52d/0x890 [ 9352.611119][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9352.611387][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9352.611667][ C1] ? lock_acquire+0x1c1/0x220 [ 9352.611899][ C1] ? clockevents_program_event+0xf6/0x300 [ 9352.612186][ C1] ? lock_release+0x1d5/0x250 [ 9352.612420][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9352.612680][ C1] ? ktime_get+0xb3/0x190 [ 9352.612896][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9352.613189][ C1] run_timer_softirq+0x72/0x100 [ 9352.613432][ C1] __do_softirq+0x1b9/0x7ff [ 9352.613659][ C1] irq_exit_rcu+0x98/0xc0 [ 9352.613877][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9352.614155][ C1] [ 9352.614303][ C1] [ 9352.614452][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9352.614753][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9352.615071][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9352.616058][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9352.616368][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9352.616775][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9352.617165][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9352.617555][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9352.617949][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9352.618344][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9352.618635][ C1] pipe_read+0xa16/0xdf0 [ 9352.618851][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9352.619122][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9352.619362][ C1] ? iterate_tty_write+0x299/0x540 [ 9352.619618][ C1] ? lock_release+0x1d5/0x250 [ 9352.619855][ C1] vfs_read+0x911/0xc00 [ 9352.620063][ C1] ? lock_acquire+0x1c1/0x220 [ 9352.620299][ C1] ? __might_fault+0xc6/0x180 [ 9352.620536][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9352.620768][ C1] ? __might_fault+0xc6/0x180 [ 9352.621004][ C1] ? lock_release+0x1d5/0x250 [ 9352.621242][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9352.621501][ C1] ? __fget_light+0x54/0x1e0 [ 9352.621735][ C1] ksys_read+0x17a/0x1e0 [ 9352.621947][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9352.622188][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9352.622490][ C1] do_syscall_64+0xc9/0x1e0 [ 9352.622716][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9352.623011][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9352.623235][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9352.624190][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9352.624603][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9352.624994][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9352.625393][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9352.625808][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9352.626208][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9352.626624][ C1] [ 9352.626778][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6519s! [swapper/2:0] [ 9352.627179][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9352.628392][ C2] irq event stamp: 44114564 [ 9352.628615][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9352.629131][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9352.629627][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9352.630088][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9352.630543][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9352.630983][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9352.631577][ C2] RIP: 0010:kasan_check_range+0x4/0x1c0 [ 9352.631849][ C2] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [ 9352.632788][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000246 [ 9352.633085][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9352.633471][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9352.633856][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9352.634244][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9352.634630][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9352.635015][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9352.635470][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9352.635798][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9352.636200][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9352.636597][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9352.636991][ C2] PKRU: 55555554 [ 9352.637166][ C2] Call Trace: [ 9352.637334][ C2] [ 9352.637476][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9352.637728][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9352.637963][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9352.638232][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9352.638497][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9352.638775][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9352.639030][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9352.639327][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9352.639580][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9352.639833][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9352.640131][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9352.640419][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9352.640721][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9352.641002][ C2] ? kasan_check_range+0x4/0x1c0 [ 9352.641247][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 9352.641517][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9352.641818][ C2] ? get_stack_info+0x36/0xc0 [ 9352.642052][ C2] ? lock_acquire+0x1c1/0x220 [ 9352.642286][ C2] ? lock_release+0x1d5/0x250 [ 9352.642517][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9352.642757][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9352.643021][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9352.643300][ C2] ? lock_acquire+0x1c1/0x220 [ 9352.643531][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9352.643762][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9352.644015][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9352.644243][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9352.644482][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9352.644731][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9352.644995][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9352.645265][ C2] ip_local_deliver+0x19d/0x480 [ 9352.645526][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9352.645798][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9352.646060][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9352.646405][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9352.646665][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9352.646975][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9352.647231][ C2] ip_rcv+0x564/0x740 [ 9352.647428][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9352.647653][ C2] ? set_track_prepare+0x8a/0xd0 [ 9352.647898][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9352.648165][ C2] ? start_secondary+0x21c/0x2b0 [ 9352.648409][ C2] ? skb_clone+0x10b/0x330 [ 9352.648630][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9352.648939][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9352.649235][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9352.649509][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9352.649792][ C2] ? __tcf_classify+0x329/0x7d0 [ 9352.650034][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9352.650259][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9352.650548][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9352.650827][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9352.651143][ C2] ? lock_acquire+0x1c1/0x220 [ 9352.651376][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9352.651661][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9352.651940][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9352.652249][ C2] ? __copy_skb_header+0xaf/0x490 [ 9352.652497][ C2] ? __skb_clone+0x57a/0x760 [ 9352.652722][ C2] netif_receive_skb+0x55/0x280 [ 9352.652963][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9352.653266][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9352.653587][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9352.653877][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9352.654143][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9352.654422][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9352.654725][ C2] ? get_stack_info+0x36/0xc0 [ 9352.654959][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9352.655215][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9352.655545][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9352.655818][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9352.656094][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9352.656408][ C2] ? kernel_text_address+0x17/0xe0 [ 9352.656680][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9352.656981][ C2] ? arch_stack_walk+0x8c/0x100 [ 9352.657222][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9352.657480][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9352.657757][ C2] ? lock_acquire+0x1c1/0x220 [ 9352.657989][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9352.658261][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9352.658556][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9352.658823][ C2] ? get_stack_info+0x36/0xc0 [ 9352.659056][ C2] __tcf_classify+0x329/0x7d0 [ 9352.659292][ C2] tcf_classify+0x283/0x930 [ 9352.659515][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9352.659763][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9352.660065][ C2] tc_run+0x2e4/0x5d0 [ 9352.660263][ C2] ? __pfx_tc_run+0x10/0x10 [ 9352.660487][ C2] ? lock_acquire+0x1c1/0x220 [ 9352.660719][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9352.660972][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9352.661218][ C2] ? lock_acquire+0x1c1/0x220 [ 9352.661448][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9352.661704][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9352.661996][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9352.662263][ C2] ? neigh_hh_output+0x348/0x590 [ 9352.662506][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9352.662764][ C2] ip_finish_output2+0x786/0x18e0 [ 9352.663012][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9352.663339][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9352.663606][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9352.663851][ C2] ? __ip_finish_output+0x10f/0x770 [ 9352.664106][ C2] ip_output+0x16b/0x4f0 [ 9352.664318][ C2] ? __pfx_ip_output+0x10/0x10 [ 9352.664551][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9352.664825][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9352.665126][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9352.665399][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9352.665665][ C2] ? __alloc_skb+0xd4/0x280 [ 9352.665893][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9352.666164][ C2] ? tcp_fragment+0x168/0x1040 [ 9352.666406][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9352.666665][ C2] ? ip_local_out+0x114/0x3b0 [ 9352.666898][ C2] __ip_queue_xmit+0x672/0x1910 [ 9352.667139][ C2] ? __skb_clone+0x57a/0x760 [ 9352.667368][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9352.667625][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9352.667895][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9352.668131][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9352.668374][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9352.668664][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9352.668974][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9352.669209][ C2] tcp_send_loss_probe+0x348/0x830 [ 9352.669462][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9352.669723][ C2] tcp_write_timer+0x82/0x1d0 [ 9352.669954][ C2] call_timer_fn+0x173/0x430 [ 9352.670185][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9352.670440][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9352.670692][ C2] __run_timers.part.0+0x52d/0x890 [ 9352.670943][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9352.671205][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9352.671482][ C2] ? lock_acquire+0x1c1/0x220 [ 9352.671714][ C2] ? clockevents_program_event+0xf6/0x300 [ 9352.671993][ C2] ? lock_release+0x1d5/0x250 [ 9352.672226][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9352.672484][ C2] ? ktime_get+0xb3/0x190 [ 9352.672697][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9352.672984][ C2] run_timer_softirq+0x72/0x100 [ 9352.673226][ C2] __do_softirq+0x1b9/0x7ff [ 9352.673452][ C2] irq_exit_rcu+0x98/0xc0 [ 9352.673665][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9352.673940][ C2] [ 9352.674087][ C2] [ 9352.674232][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9352.674526][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9352.674775][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9352.675742][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9352.676049][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9352.676445][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9352.676844][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9352.677232][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9352.677618][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9352.678005][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9352.678287][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9352.678540][ C2] default_idle_call+0x69/0xa0 [ 9352.678774][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9352.679016][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9352.679287][ C2] ? lock_release+0x1d5/0x250 [ 9352.679518][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9352.679787][ C2] do_idle+0xfb/0x160 [ 9352.679984][ C2] cpu_startup_entry+0x55/0x60 [ 9352.680222][ C2] start_secondary+0x21c/0x2b0 [ 9352.680457][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9352.680717][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9352.681017][ C2] [ 9380.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6545s! [perl:4135] [ 9380.569688][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9380.570913][ C1] irq event stamp: 209232 [ 9380.571125][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9380.571642][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9380.572107][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9380.572562][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9380.573014][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9380.573450][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9380.574045][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9380.574362][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9380.575310][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9380.575610][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9380.575998][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9380.576390][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9380.576777][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9380.577165][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9380.577554][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9380.577990][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9380.578316][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9380.578706][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9380.579093][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9380.579483][ C1] PKRU: 55555554 [ 9380.579659][ C1] Call Trace: [ 9380.579829][ C1] [ 9380.579973][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9380.580230][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9380.580467][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9380.580738][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9380.581005][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9380.581285][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9380.581543][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9380.581841][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9380.582095][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9380.582397][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9380.582686][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9380.582992][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9380.583273][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9380.583562][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9380.583841][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9380.584144][ C1] ? get_stack_info+0x36/0xc0 [ 9380.584381][ C1] ? lock_acquire+0x1c1/0x220 [ 9380.584615][ C1] ? lock_release+0x1d5/0x250 [ 9380.584846][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9380.585088][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9380.585378][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9380.585664][ C1] ? lock_acquire+0x1c1/0x220 [ 9380.585904][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9380.586143][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9380.586407][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9380.586647][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9380.586888][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9380.587140][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9380.587411][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9380.587681][ C1] ip_local_deliver+0x19d/0x480 [ 9380.587921][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9380.588189][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9380.588451][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9380.588789][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9380.589036][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9380.589350][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9380.589607][ C1] ip_rcv+0x564/0x740 [ 9380.589806][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9380.590034][ C1] ? set_track_prepare+0x8a/0xd0 [ 9380.590283][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9380.590553][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9380.590817][ C1] ? skb_clone+0x10b/0x330 [ 9380.591042][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9380.591356][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9380.591655][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9380.591929][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9380.592220][ C1] ? __tcf_classify+0x329/0x7d0 [ 9380.592462][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9380.592688][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9380.592982][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9380.593278][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9380.593604][ C1] ? lock_acquire+0x1c1/0x220 [ 9380.593844][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9380.594143][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9380.594430][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9380.594753][ C1] ? __copy_skb_header+0xaf/0x490 [ 9380.595005][ C1] ? __skb_clone+0x57a/0x760 [ 9380.595237][ C1] netif_receive_skb+0x55/0x280 [ 9380.595503][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9380.595815][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9380.596148][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9380.596449][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9380.596727][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9380.597010][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9380.597316][ C1] ? hlock_class+0x4e/0x130 [ 9380.597543][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9380.597812][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9380.598083][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9380.598340][ C1] ? hlock_class+0x4e/0x130 [ 9380.598565][ C1] ? mark_lock+0x38/0x3e0 [ 9380.598780][ C1] ? stack_access_ok+0xda/0x1f0 [ 9380.599023][ C1] ? __lock_acquire+0xb67/0x1610 [ 9380.599273][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9380.599541][ C1] ? get_stack_info+0x36/0xc0 [ 9380.599776][ C1] ? stack_access_ok+0xda/0x1f0 [ 9380.600017][ C1] ? get_reg+0x119/0x190 [ 9380.600228][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9380.600489][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9380.600792][ C1] __tcf_classify+0x329/0x7d0 [ 9380.601028][ C1] tcf_classify+0x283/0x930 [ 9380.601255][ C1] ? arch_stack_walk+0xa2/0x100 [ 9380.601498][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9380.601748][ C1] ? get_stack_info+0x36/0xc0 [ 9380.601985][ C1] tc_run+0x2e4/0x5d0 [ 9380.602185][ C1] ? __pfx_tc_run+0x10/0x10 [ 9380.602412][ C1] ? lock_acquire+0x1c1/0x220 [ 9380.602645][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9380.602900][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9380.603147][ C1] ? lock_acquire+0x1c1/0x220 [ 9380.603378][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9380.603638][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9380.603935][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9380.604203][ C1] ? neigh_hh_output+0x348/0x590 [ 9380.604449][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9380.604709][ C1] ip_finish_output2+0x786/0x18e0 [ 9380.604959][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9380.605231][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9380.605587][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9380.605863][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9380.606118][ C1] ? __ip_finish_output+0x10f/0x770 [ 9380.606387][ C1] ip_output+0x16b/0x4f0 [ 9380.606613][ C1] ? run_timer_softirq+0x72/0x100 [ 9380.606864][ C1] ? __pfx_ip_output+0x10/0x10 [ 9380.607103][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9380.607383][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9380.607630][ C1] ? ip_local_out+0x114/0x3b0 [ 9380.607865][ C1] __ip_queue_xmit+0x672/0x1910 [ 9380.608108][ C1] ? __create_object+0x5e/0xb0 [ 9380.608348][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9380.608610][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9380.608884][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9380.609150][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9380.609428][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9380.609694][ C1] tcp_delack_timer+0x84/0x240 [ 9380.609933][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9380.610198][ C1] call_timer_fn+0x173/0x430 [ 9380.610429][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9380.610685][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9380.610941][ C1] __run_timers.part.0+0x52d/0x890 [ 9380.611196][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9380.611463][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9380.611741][ C1] ? lock_acquire+0x1c1/0x220 [ 9380.611974][ C1] ? clockevents_program_event+0xf6/0x300 [ 9380.612261][ C1] ? lock_release+0x1d5/0x250 [ 9380.612494][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9380.612753][ C1] ? ktime_get+0xb3/0x190 [ 9380.612967][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9380.613259][ C1] run_timer_softirq+0x72/0x100 [ 9380.613501][ C1] __do_softirq+0x1b9/0x7ff [ 9380.613728][ C1] irq_exit_rcu+0x98/0xc0 [ 9380.613943][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9380.614223][ C1] [ 9380.614369][ C1] [ 9380.614519][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9380.614815][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9380.615133][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9380.616121][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9380.616428][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9380.616828][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9380.617216][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9380.617604][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9380.617993][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9380.618386][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9380.618674][ C1] pipe_read+0xa16/0xdf0 [ 9380.618891][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9380.619161][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9380.619400][ C1] ? iterate_tty_write+0x299/0x540 [ 9380.619656][ C1] ? lock_release+0x1d5/0x250 [ 9380.619892][ C1] vfs_read+0x911/0xc00 [ 9380.620099][ C1] ? lock_acquire+0x1c1/0x220 [ 9380.620335][ C1] ? __might_fault+0xc6/0x180 [ 9380.620568][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9380.620801][ C1] ? __might_fault+0xc6/0x180 [ 9380.621035][ C1] ? lock_release+0x1d5/0x250 [ 9380.621271][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9380.621529][ C1] ? __fget_light+0x54/0x1e0 [ 9380.621760][ C1] ksys_read+0x17a/0x1e0 [ 9380.621972][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9380.622213][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9380.622509][ C1] do_syscall_64+0xc9/0x1e0 [ 9380.622737][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9380.623030][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9380.623252][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9380.624203][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9380.624614][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9380.625002][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9380.625417][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9380.625814][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9380.626214][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9380.626624][ C1] [ 9380.626779][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6545s! [swapper/2:0] [ 9380.627181][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9380.628391][ C2] irq event stamp: 44114564 [ 9380.628613][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9380.629130][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9380.629624][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9380.630085][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9380.630539][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9380.630979][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9380.631572][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9380.631887][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9380.632825][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9380.633126][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9380.633512][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9380.633896][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9380.634281][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9380.634685][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9380.635079][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9380.635527][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9380.635857][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9380.636254][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9380.636657][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9380.637041][ C2] PKRU: 55555554 [ 9380.637219][ C2] Call Trace: [ 9380.637383][ C2] [ 9380.637525][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9380.637777][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9380.638013][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9380.638281][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9380.638543][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9380.638823][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9380.639078][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9380.639374][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9380.639626][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9380.639878][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9380.640178][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9380.640463][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9380.640766][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9380.641048][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9380.641333][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9380.641613][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9380.641913][ C2] ? get_stack_info+0x36/0xc0 [ 9380.642143][ C2] ? lock_acquire+0x1c1/0x220 [ 9380.642377][ C2] ? lock_release+0x1d5/0x250 [ 9380.642610][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9380.642850][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9380.643112][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9380.643386][ C2] ? lock_acquire+0x1c1/0x220 [ 9380.643618][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9380.643850][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9380.644101][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9380.644329][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9380.644567][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9380.644816][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9380.645082][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9380.645375][ C2] ip_local_deliver+0x19d/0x480 [ 9380.645621][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9380.645890][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9380.646150][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9380.646508][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9380.646751][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9380.647060][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9380.647315][ C2] ip_rcv+0x564/0x740 [ 9380.647512][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9380.647732][ C2] ? set_track_prepare+0x8a/0xd0 [ 9380.647978][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9380.648248][ C2] ? start_secondary+0x21c/0x2b0 [ 9380.648491][ C2] ? skb_clone+0x10b/0x330 [ 9380.648708][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9380.649016][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9380.649313][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9380.649584][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9380.649868][ C2] ? __tcf_classify+0x329/0x7d0 [ 9380.650108][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9380.650330][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9380.650620][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9380.650894][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9380.651209][ C2] ? lock_acquire+0x1c1/0x220 [ 9380.651441][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9380.651727][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9380.652001][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9380.652308][ C2] ? __copy_skb_header+0xaf/0x490 [ 9380.652556][ C2] ? __skb_clone+0x57a/0x760 [ 9380.652784][ C2] netif_receive_skb+0x55/0x280 [ 9380.653023][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9380.653324][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9380.653646][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9380.653933][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9380.654200][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9380.654478][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9380.654780][ C2] ? get_stack_info+0x36/0xc0 [ 9380.655013][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9380.655274][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9380.655603][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9380.655876][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9380.656150][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9380.656474][ C2] ? kernel_text_address+0x17/0xe0 [ 9380.656725][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9380.657026][ C2] ? arch_stack_walk+0x8c/0x100 [ 9380.657268][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9380.657523][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9380.657799][ C2] ? lock_acquire+0x1c1/0x220 [ 9380.658029][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9380.658304][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9380.658596][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9380.658864][ C2] ? get_stack_info+0x36/0xc0 [ 9380.659095][ C2] __tcf_classify+0x329/0x7d0 [ 9380.659331][ C2] tcf_classify+0x283/0x930 [ 9380.659556][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9380.659804][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9380.660106][ C2] tc_run+0x2e4/0x5d0 [ 9380.660305][ C2] ? __pfx_tc_run+0x10/0x10 [ 9380.660527][ C2] ? lock_acquire+0x1c1/0x220 [ 9380.660761][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9380.661012][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9380.661258][ C2] ? lock_acquire+0x1c1/0x220 [ 9380.661489][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9380.661743][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9380.662035][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9380.662299][ C2] ? neigh_hh_output+0x348/0x590 [ 9380.662543][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9380.662798][ C2] ip_finish_output2+0x786/0x18e0 [ 9380.663045][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9380.663372][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9380.663640][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9380.663883][ C2] ? __ip_finish_output+0x10f/0x770 [ 9380.664139][ C2] ip_output+0x16b/0x4f0 [ 9380.664348][ C2] ? __pfx_ip_output+0x10/0x10 [ 9380.664583][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9380.664849][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9380.665151][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9380.665441][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9380.665690][ C2] ? __alloc_skb+0xd4/0x280 [ 9380.665921][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9380.666187][ C2] ? tcp_fragment+0x168/0x1040 [ 9380.666430][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9380.666686][ C2] ? ip_local_out+0x114/0x3b0 [ 9380.666917][ C2] __ip_queue_xmit+0x672/0x1910 [ 9380.667156][ C2] ? __skb_clone+0x57a/0x760 [ 9380.667384][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9380.667640][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9380.667913][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9380.668148][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9380.668388][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9380.668678][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9380.668986][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9380.669223][ C2] tcp_send_loss_probe+0x348/0x830 [ 9380.669474][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9380.669732][ C2] tcp_write_timer+0x82/0x1d0 [ 9380.669964][ C2] call_timer_fn+0x173/0x430 [ 9380.670192][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9380.670451][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9380.670704][ C2] __run_timers.part.0+0x52d/0x890 [ 9380.670955][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9380.671215][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9380.671489][ C2] ? lock_acquire+0x1c1/0x220 [ 9380.671720][ C2] ? clockevents_program_event+0xf6/0x300 [ 9380.672001][ C2] ? lock_release+0x1d5/0x250 [ 9380.672231][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9380.672488][ C2] ? ktime_get+0xb3/0x190 [ 9380.672701][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9380.672988][ C2] run_timer_softirq+0x72/0x100 [ 9380.673227][ C2] __do_softirq+0x1b9/0x7ff [ 9380.673453][ C2] irq_exit_rcu+0x98/0xc0 [ 9380.673665][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9380.673940][ C2] [ 9380.674083][ C2] [ 9380.674232][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9380.674527][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9380.674776][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9380.675744][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9380.676047][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9380.676446][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9380.676841][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9380.677225][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9380.677607][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9380.677997][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9380.678277][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9380.678528][ C2] default_idle_call+0x69/0xa0 [ 9380.678764][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9380.679007][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9380.679274][ C2] ? lock_release+0x1d5/0x250 [ 9380.679505][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9380.679768][ C2] do_idle+0xfb/0x160 [ 9380.679965][ C2] cpu_startup_entry+0x55/0x60 [ 9380.680200][ C2] start_secondary+0x21c/0x2b0 [ 9380.680437][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9380.680697][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9380.680996][ C2] [ 9406.168103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9406.168456][ C1] rcu: 1-....: (7033628 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1672823 [ 9406.169003][ C1] rcu: (t=7051281 jiffies g=1882453 q=721 ncpus=4) [ 9406.169326][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9406.169762][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9406.170362][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9406.170680][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9406.171625][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9406.171925][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9406.172314][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9406.172701][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9406.173092][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9406.173481][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9406.173868][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9406.174304][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9406.174627][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9406.175020][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9406.175412][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9406.175799][ C1] PKRU: 55555554 [ 9406.175976][ C1] Call Trace: [ 9406.176141][ C1] [ 9406.176285][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9406.176549][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9406.176795][ C1] ? check_cpu_stall+0x284/0x500 [ 9406.177040][ C1] ? rcu_pending+0x92/0x360 [ 9406.177268][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9406.177530][ C1] ? update_process_times+0xb9/0x110 [ 9406.177791][ C1] ? tick_sched_handle+0x67/0x130 [ 9406.178041][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9406.178320][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9406.178556][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9406.178860][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9406.179127][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9406.179408][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9406.179665][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9406.179963][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9406.180219][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9406.180520][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9406.180807][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9406.181112][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9406.181397][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9406.181683][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9406.181966][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9406.182271][ C1] ? get_stack_info+0x36/0xc0 [ 9406.182506][ C1] ? lock_acquire+0x1c1/0x220 [ 9406.182739][ C1] ? lock_release+0x1d5/0x250 [ 9406.182973][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9406.183217][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9406.183481][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9406.183760][ C1] ? lock_acquire+0x1c1/0x220 [ 9406.183990][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9406.184226][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9406.184479][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9406.184708][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9406.184951][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9406.185225][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9406.185499][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9406.185781][ C1] ip_local_deliver+0x19d/0x480 [ 9406.186029][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9406.186301][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9406.186567][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9406.186921][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9406.187168][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9406.187481][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9406.187736][ C1] ip_rcv+0x564/0x740 [ 9406.187934][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9406.188160][ C1] ? set_track_prepare+0x8a/0xd0 [ 9406.188408][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9406.188678][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9406.188943][ C1] ? skb_clone+0x10b/0x330 [ 9406.189165][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9406.189477][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9406.189773][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9406.190049][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9406.190336][ C1] ? __tcf_classify+0x329/0x7d0 [ 9406.190579][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9406.190805][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9406.191096][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9406.191378][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9406.191695][ C1] ? lock_acquire+0x1c1/0x220 [ 9406.191928][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9406.192217][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9406.192500][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9406.192809][ C1] ? __copy_skb_header+0xaf/0x490 [ 9406.193061][ C1] ? __skb_clone+0x57a/0x760 [ 9406.193289][ C1] netif_receive_skb+0x55/0x280 [ 9406.193531][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9406.193836][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9406.194159][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9406.194453][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9406.194720][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9406.195001][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9406.195329][ C1] ? hlock_class+0x4e/0x130 [ 9406.195562][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9406.195837][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9406.196113][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9406.196389][ C1] ? hlock_class+0x4e/0x130 [ 9406.196613][ C1] ? mark_lock+0x38/0x3e0 [ 9406.196829][ C1] ? stack_access_ok+0xda/0x1f0 [ 9406.197071][ C1] ? __lock_acquire+0xb67/0x1610 [ 9406.197320][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9406.197589][ C1] ? get_stack_info+0x36/0xc0 [ 9406.197824][ C1] ? stack_access_ok+0xda/0x1f0 [ 9406.198065][ C1] ? get_reg+0x119/0x190 [ 9406.198278][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9406.198539][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9406.198841][ C1] __tcf_classify+0x329/0x7d0 [ 9406.199077][ C1] tcf_classify+0x283/0x930 [ 9406.199302][ C1] ? arch_stack_walk+0xa2/0x100 [ 9406.199546][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9406.199795][ C1] ? get_stack_info+0x36/0xc0 [ 9406.200031][ C1] tc_run+0x2e4/0x5d0 [ 9406.200232][ C1] ? __pfx_tc_run+0x10/0x10 [ 9406.200459][ C1] ? lock_acquire+0x1c1/0x220 [ 9406.200689][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9406.200946][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9406.201194][ C1] ? lock_acquire+0x1c1/0x220 [ 9406.201428][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9406.201685][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9406.201984][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9406.202249][ C1] ? neigh_hh_output+0x348/0x590 [ 9406.202495][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9406.202756][ C1] ip_finish_output2+0x786/0x18e0 [ 9406.203008][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9406.203281][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9406.203609][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9406.203878][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9406.204125][ C1] ? __ip_finish_output+0x10f/0x770 [ 9406.204383][ C1] ip_output+0x16b/0x4f0 [ 9406.204597][ C1] ? run_timer_softirq+0x72/0x100 [ 9406.204847][ C1] ? __pfx_ip_output+0x10/0x10 [ 9406.205082][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9406.205391][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9406.205643][ C1] ? ip_local_out+0x114/0x3b0 [ 9406.205883][ C1] __ip_queue_xmit+0x672/0x1910 [ 9406.206131][ C1] ? __create_object+0x5e/0xb0 [ 9406.206377][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9406.206647][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9406.206923][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9406.207188][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9406.207462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9406.207728][ C1] tcp_delack_timer+0x84/0x240 [ 9406.207963][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9406.208232][ C1] call_timer_fn+0x173/0x430 [ 9406.208461][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9406.208716][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9406.208972][ C1] __run_timers.part.0+0x52d/0x890 [ 9406.209227][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9406.209495][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9406.209772][ C1] ? lock_acquire+0x1c1/0x220 [ 9406.210006][ C1] ? clockevents_program_event+0xf6/0x300 [ 9406.210288][ C1] ? lock_release+0x1d5/0x250 [ 9406.210521][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9406.210782][ C1] ? ktime_get+0xb3/0x190 [ 9406.210999][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9406.211288][ C1] run_timer_softirq+0x72/0x100 [ 9406.211530][ C1] __do_softirq+0x1b9/0x7ff [ 9406.211758][ C1] irq_exit_rcu+0x98/0xc0 [ 9406.211972][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9406.212252][ C1] [ 9406.212398][ C1] [ 9406.212545][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9406.212841][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9406.213159][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9406.214108][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9406.214408][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9406.214797][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9406.215211][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9406.215610][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9406.216008][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9406.216421][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9406.216710][ C1] pipe_read+0xa16/0xdf0 [ 9406.216925][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9406.217196][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9406.217434][ C1] ? iterate_tty_write+0x299/0x540 [ 9406.217688][ C1] ? lock_release+0x1d5/0x250 [ 9406.217925][ C1] vfs_read+0x911/0xc00 [ 9406.218135][ C1] ? lock_acquire+0x1c1/0x220 [ 9406.218367][ C1] ? __might_fault+0xc6/0x180 [ 9406.218601][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9406.218835][ C1] ? __might_fault+0xc6/0x180 [ 9406.219069][ C1] ? lock_release+0x1d5/0x250 [ 9406.219303][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9406.219563][ C1] ? __fget_light+0x54/0x1e0 [ 9406.219792][ C1] ksys_read+0x17a/0x1e0 [ 9406.220006][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9406.220244][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9406.220540][ C1] do_syscall_64+0xc9/0x1e0 [ 9406.220770][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9406.221062][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9406.221283][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9406.222229][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9406.222640][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9406.223028][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9406.223417][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9406.223805][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9406.224196][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9406.224587][ C1] [ 9406.224741][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9406.225006][ C2] NMI backtrace for cpu 2 [ 9406.225011][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9406.225017][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9406.225021][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9406.225029][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9406.225035][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9406.225039][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9406.225043][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9406.225047][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9406.225050][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9406.225054][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9406.225058][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9406.225063][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9406.225068][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9406.225070][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9406.225071][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9406.225072][ C2] PKRU: 55555554 [ 9406.225073][ C2] Call Trace: [ 9406.225075][ C2] [ 9406.225077][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9406.225082][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9406.225087][ C2] ? nmi_handle+0x153/0x420 [ 9406.225091][ C2] ? default_do_nmi+0x41/0x100 [ 9406.225094][ C2] ? exc_nmi+0xf3/0x120 [ 9406.225096][ C2] ? end_repeat_nmi+0xf/0x60 [ 9406.225101][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9406.225104][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9406.225107][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9406.225110][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9406.225114][ C2] [ 9406.225114][ C2] [ 9406.225116][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9406.225119][ C2] ? get_stack_info+0x36/0xc0 [ 9406.225123][ C2] ? lock_acquire+0x1c1/0x220 [ 9406.225126][ C2] ? lock_release+0x1d5/0x250 [ 9406.225129][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9406.225133][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9406.225136][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9406.225139][ C2] ? lock_acquire+0x1c1/0x220 [ 9406.225144][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9406.225148][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9406.225150][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9406.225156][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9406.225159][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9406.225163][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9406.225168][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9406.225188][ C2] ip_local_deliver+0x19d/0x480 [ 9406.225190][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9406.225192][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9406.225195][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9406.225200][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9406.225204][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9406.225207][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9406.225216][ C2] ip_rcv+0x564/0x740 [ 9406.225218][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9406.225221][ C2] ? set_track_prepare+0x8a/0xd0 [ 9406.225225][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9406.225228][ C2] ? start_secondary+0x21c/0x2b0 [ 9406.225232][ C2] ? skb_clone+0x10b/0x330 [ 9406.225235][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9406.225240][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9406.225246][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9406.225249][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9406.225257][ C2] ? __tcf_classify+0x329/0x7d0 [ 9406.225261][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9406.225263][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9406.225266][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9406.225270][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9406.225274][ C2] ? lock_acquire+0x1c1/0x220 [ 9406.225276][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9406.225280][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9406.225283][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9406.225287][ C2] ? __copy_skb_header+0xaf/0x490 [ 9406.225292][ C2] ? __skb_clone+0x57a/0x760 [ 9406.225294][ C2] netif_receive_skb+0x55/0x280 [ 9406.225297][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9406.225304][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9406.225311][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9406.225317][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9406.225321][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9406.225331][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9406.225339][ C2] ? get_stack_info+0x36/0xc0 [ 9406.225343][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9406.225346][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9406.225349][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9406.225352][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9406.225355][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9406.225357][ C2] ? kernel_text_address+0x17/0xe0 [ 9406.225360][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9406.225364][ C2] ? arch_stack_walk+0x8c/0x100 [ 9406.225368][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9406.225371][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9406.225374][ C2] ? lock_acquire+0x1c1/0x220 [ 9406.225376][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9406.225380][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9406.225384][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9406.225387][ C2] ? get_stack_info+0x36/0xc0 [ 9406.225391][ C2] __tcf_classify+0x329/0x7d0 [ 9406.225396][ C2] tcf_classify+0x283/0x930 [ 9406.225400][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9406.225404][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9406.225408][ C2] tc_run+0x2e4/0x5d0 [ 9406.225411][ C2] ? __pfx_tc_run+0x10/0x10 [ 9406.225414][ C2] ? lock_acquire+0x1c1/0x220 [ 9406.225417][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9406.225421][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9406.225425][ C2] ? lock_acquire+0x1c1/0x220 [ 9406.225427][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9406.225430][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9406.225433][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9406.225436][ C2] ? neigh_hh_output+0x348/0x590 [ 9406.225439][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9406.225443][ C2] ip_finish_output2+0x786/0x18e0 [ 9406.225446][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9406.225454][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9406.225456][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9406.225460][ C2] ? __ip_finish_output+0x10f/0x770 [ 9406.225463][ C2] ip_output+0x16b/0x4f0 [ 9406.225466][ C2] ? __pfx_ip_output+0x10/0x10 [ 9406.225469][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9406.225472][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9406.225475][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9406.225478][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9406.225480][ C2] ? __alloc_skb+0xd4/0x280 [ 9406.225482][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9406.225486][ C2] ? tcp_fragment+0x168/0x1040 [ 9406.225489][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9406.225492][ C2] ? ip_local_out+0x114/0x3b0 [ 9406.225496][ C2] __ip_queue_xmit+0x672/0x1910 [ 9406.225499][ C2] ? __skb_clone+0x57a/0x760 [ 9406.225502][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9406.225507][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9406.225510][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9406.225514][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9406.225518][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9406.225523][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9406.225526][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9406.225529][ C2] tcp_send_loss_probe+0x348/0x830 [ 9406.225532][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9406.225534][ C2] tcp_write_timer+0x82/0x1d0 [ 9406.225538][ C2] call_timer_fn+0x173/0x430 [ 9406.225542][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9406.225546][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9406.225550][ C2] __run_timers.part.0+0x52d/0x890 [ 9406.225553][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9406.225557][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9406.225560][ C2] ? lock_acquire+0x1c1/0x220 [ 9406.225562][ C2] ? clockevents_program_event+0xf6/0x300 [ 9406.225566][ C2] ? lock_release+0x1d5/0x250 [ 9406.225569][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9406.225572][ C2] ? ktime_get+0xb3/0x190 [ 9406.225575][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9406.225580][ C2] run_timer_softirq+0x72/0x100 [ 9406.225583][ C2] __do_softirq+0x1b9/0x7ff [ 9406.225587][ C2] irq_exit_rcu+0x98/0xc0 [ 9406.225589][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9406.225593][ C2] [ 9406.225593][ C2] [ 9406.225595][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9406.225598][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9406.225601][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9406.225603][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9406.225605][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9406.225606][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9406.225608][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9406.225609][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9406.225611][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9406.225614][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9406.225617][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9406.225620][ C2] default_idle_call+0x69/0xa0 [ 9406.225622][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9406.225625][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9406.225628][ C2] ? lock_release+0x1d5/0x250 [ 9406.225630][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9406.225634][ C2] do_idle+0xfb/0x160 [ 9406.225637][ C2] cpu_startup_entry+0x55/0x60 [ 9406.225639][ C2] start_secondary+0x21c/0x2b0 [ 9406.225641][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9406.225645][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9406.225651][ C2] [ 9432.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6593s! [perl:4135] [ 9432.569680][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9432.570901][ C1] irq event stamp: 209232 [ 9432.571116][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9432.571631][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9432.572094][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9432.572555][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9432.573005][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9432.573442][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9432.574035][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9432.574351][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9432.575301][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9432.575600][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9432.575990][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9432.576380][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9432.576767][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9432.577153][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9432.577544][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9432.577980][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9432.578304][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9432.578693][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9432.579080][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9432.579473][ C1] PKRU: 55555554 [ 9432.579650][ C1] Call Trace: [ 9432.579816][ C1] [ 9432.579960][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9432.580220][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9432.580455][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9432.580727][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9432.580992][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9432.581273][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9432.581533][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9432.581829][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9432.582084][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9432.582387][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9432.582676][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9432.582982][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9432.583263][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9432.583551][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9432.583830][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9432.584134][ C1] ? get_stack_info+0x36/0xc0 [ 9432.584371][ C1] ? lock_acquire+0x1c1/0x220 [ 9432.584606][ C1] ? lock_release+0x1d5/0x250 [ 9432.584838][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9432.585082][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9432.585351][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9432.585645][ C1] ? lock_acquire+0x1c1/0x220 [ 9432.585885][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9432.586125][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9432.586393][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9432.586620][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9432.586861][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9432.587112][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9432.587381][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9432.587653][ C1] ip_local_deliver+0x19d/0x480 [ 9432.587894][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9432.588160][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9432.588418][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9432.588755][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9432.589002][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9432.589316][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9432.589571][ C1] ip_rcv+0x564/0x740 [ 9432.589768][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9432.589995][ C1] ? set_track_prepare+0x8a/0xd0 [ 9432.590243][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9432.590512][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9432.590779][ C1] ? skb_clone+0x10b/0x330 [ 9432.591002][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9432.591314][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9432.591613][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9432.591886][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9432.592175][ C1] ? __tcf_classify+0x329/0x7d0 [ 9432.592417][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9432.592641][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9432.592935][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9432.593213][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9432.593530][ C1] ? lock_acquire+0x1c1/0x220 [ 9432.593763][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9432.594053][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9432.594332][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9432.594640][ C1] ? __copy_skb_header+0xaf/0x490 [ 9432.594892][ C1] ? __skb_clone+0x57a/0x760 [ 9432.595144][ C1] netif_receive_skb+0x55/0x280 [ 9432.595391][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9432.595703][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9432.596038][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9432.596347][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9432.596614][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9432.596897][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9432.597202][ C1] ? hlock_class+0x4e/0x130 [ 9432.597427][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9432.597698][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9432.597968][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9432.598227][ C1] ? hlock_class+0x4e/0x130 [ 9432.598454][ C1] ? mark_lock+0x38/0x3e0 [ 9432.598667][ C1] ? stack_access_ok+0xda/0x1f0 [ 9432.598909][ C1] ? __lock_acquire+0xb67/0x1610 [ 9432.599157][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9432.599427][ C1] ? get_stack_info+0x36/0xc0 [ 9432.599661][ C1] ? stack_access_ok+0xda/0x1f0 [ 9432.599903][ C1] ? get_reg+0x119/0x190 [ 9432.600112][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9432.600373][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9432.600675][ C1] __tcf_classify+0x329/0x7d0 [ 9432.600912][ C1] tcf_classify+0x283/0x930 [ 9432.601138][ C1] ? arch_stack_walk+0xa2/0x100 [ 9432.601382][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9432.601632][ C1] ? get_stack_info+0x36/0xc0 [ 9432.601867][ C1] tc_run+0x2e4/0x5d0 [ 9432.602066][ C1] ? __pfx_tc_run+0x10/0x10 [ 9432.602294][ C1] ? lock_acquire+0x1c1/0x220 [ 9432.602528][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9432.602783][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9432.603030][ C1] ? lock_acquire+0x1c1/0x220 [ 9432.603263][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9432.603522][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9432.603818][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9432.604086][ C1] ? neigh_hh_output+0x348/0x590 [ 9432.604334][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9432.604593][ C1] ip_finish_output2+0x786/0x18e0 [ 9432.604843][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9432.605136][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9432.605473][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9432.605750][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9432.606002][ C1] ? __ip_finish_output+0x10f/0x770 [ 9432.606279][ C1] ip_output+0x16b/0x4f0 [ 9432.606489][ C1] ? run_timer_softirq+0x72/0x100 [ 9432.606740][ C1] ? __pfx_ip_output+0x10/0x10 [ 9432.606978][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9432.607257][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9432.607503][ C1] ? ip_local_out+0x114/0x3b0 [ 9432.607738][ C1] __ip_queue_xmit+0x672/0x1910 [ 9432.607980][ C1] ? __create_object+0x5e/0xb0 [ 9432.608219][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9432.608479][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9432.608752][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9432.609016][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9432.609294][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9432.609559][ C1] tcp_delack_timer+0x84/0x240 [ 9432.609796][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9432.610061][ C1] call_timer_fn+0x173/0x430 [ 9432.610293][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9432.610547][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9432.610802][ C1] __run_timers.part.0+0x52d/0x890 [ 9432.611055][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9432.611322][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9432.611600][ C1] ? lock_acquire+0x1c1/0x220 [ 9432.611831][ C1] ? clockevents_program_event+0xf6/0x300 [ 9432.612115][ C1] ? lock_release+0x1d5/0x250 [ 9432.612349][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9432.612606][ C1] ? ktime_get+0xb3/0x190 [ 9432.612819][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9432.613109][ C1] run_timer_softirq+0x72/0x100 [ 9432.613351][ C1] __do_softirq+0x1b9/0x7ff [ 9432.613576][ C1] irq_exit_rcu+0x98/0xc0 [ 9432.613792][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9432.614069][ C1] [ 9432.614216][ C1] [ 9432.614363][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9432.614660][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9432.614975][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9432.615960][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9432.616279][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9432.616665][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9432.617051][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9432.617440][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9432.617830][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9432.618221][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9432.618510][ C1] pipe_read+0xa16/0xdf0 [ 9432.618725][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9432.618993][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9432.619232][ C1] ? iterate_tty_write+0x299/0x540 [ 9432.619487][ C1] ? lock_release+0x1d5/0x250 [ 9432.619721][ C1] vfs_read+0x911/0xc00 [ 9432.619928][ C1] ? lock_acquire+0x1c1/0x220 [ 9432.620162][ C1] ? __might_fault+0xc6/0x180 [ 9432.620398][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9432.620629][ C1] ? __might_fault+0xc6/0x180 [ 9432.620864][ C1] ? lock_release+0x1d5/0x250 [ 9432.621098][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9432.621357][ C1] ? __fget_light+0x54/0x1e0 [ 9432.621590][ C1] ksys_read+0x17a/0x1e0 [ 9432.621800][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9432.622038][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9432.622336][ C1] do_syscall_64+0xc9/0x1e0 [ 9432.622561][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9432.622854][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9432.623076][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9432.624021][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9432.624430][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9432.624818][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9432.625234][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9432.625632][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9432.626029][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9432.626439][ C1] [ 9432.626593][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6593s! [swapper/2:0] [ 9432.626992][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9432.628204][ C2] irq event stamp: 44114564 [ 9432.628427][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9432.628943][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9432.629437][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9432.629898][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9432.630353][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9432.630793][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9432.631386][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9432.631701][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9432.632643][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9432.632940][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9432.633327][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9432.633712][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9432.634095][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9432.634485][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9432.634870][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9432.635330][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9432.635659][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9432.636055][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9432.636460][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9432.636844][ C2] PKRU: 55555554 [ 9432.637019][ C2] Call Trace: [ 9432.637183][ C2] [ 9432.637327][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9432.637579][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9432.637814][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9432.638081][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9432.638345][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9432.638625][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9432.638882][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9432.639178][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9432.639431][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9432.639685][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9432.639984][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9432.640269][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9432.640573][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9432.640853][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9432.641137][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9432.641418][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9432.641720][ C2] ? get_stack_info+0x36/0xc0 [ 9432.641951][ C2] ? lock_acquire+0x1c1/0x220 [ 9432.642185][ C2] ? lock_release+0x1d5/0x250 [ 9432.642417][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9432.642657][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9432.642919][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9432.643193][ C2] ? lock_acquire+0x1c1/0x220 [ 9432.643425][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9432.643658][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9432.643909][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9432.644136][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9432.644375][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9432.644623][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9432.644890][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9432.645181][ C2] ip_local_deliver+0x19d/0x480 [ 9432.645427][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9432.645695][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9432.645956][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9432.646312][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9432.646557][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9432.646868][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9432.647122][ C2] ip_rcv+0x564/0x740 [ 9432.647319][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9432.647540][ C2] ? set_track_prepare+0x8a/0xd0 [ 9432.647786][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9432.648056][ C2] ? start_secondary+0x21c/0x2b0 [ 9432.648301][ C2] ? skb_clone+0x10b/0x330 [ 9432.648519][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9432.648826][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9432.649124][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9432.649397][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9432.649683][ C2] ? __tcf_classify+0x329/0x7d0 [ 9432.649922][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9432.650144][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9432.650436][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9432.650711][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9432.651025][ C2] ? lock_acquire+0x1c1/0x220 [ 9432.651258][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9432.651546][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9432.651819][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9432.652125][ C2] ? __copy_skb_header+0xaf/0x490 [ 9432.652376][ C2] ? __skb_clone+0x57a/0x760 [ 9432.652604][ C2] netif_receive_skb+0x55/0x280 [ 9432.652845][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9432.653146][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9432.653469][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9432.653757][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9432.654022][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9432.654302][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9432.654604][ C2] ? get_stack_info+0x36/0xc0 [ 9432.654837][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9432.655115][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9432.655430][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9432.655706][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9432.655979][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9432.656302][ C2] ? kernel_text_address+0x17/0xe0 [ 9432.656553][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9432.656854][ C2] ? arch_stack_walk+0x8c/0x100 [ 9432.657095][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9432.657352][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9432.657627][ C2] ? lock_acquire+0x1c1/0x220 [ 9432.657859][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9432.658131][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9432.658424][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9432.658694][ C2] ? get_stack_info+0x36/0xc0 [ 9432.658925][ C2] __tcf_classify+0x329/0x7d0 [ 9432.659159][ C2] tcf_classify+0x283/0x930 [ 9432.659387][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9432.659634][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9432.659937][ C2] tc_run+0x2e4/0x5d0 [ 9432.660135][ C2] ? __pfx_tc_run+0x10/0x10 [ 9432.660359][ C2] ? lock_acquire+0x1c1/0x220 [ 9432.660590][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9432.660841][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9432.661086][ C2] ? lock_acquire+0x1c1/0x220 [ 9432.661318][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9432.661573][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9432.661866][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9432.662128][ C2] ? neigh_hh_output+0x348/0x590 [ 9432.662373][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9432.662629][ C2] ip_finish_output2+0x786/0x18e0 [ 9432.662876][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9432.663203][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9432.663472][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9432.663717][ C2] ? __ip_finish_output+0x10f/0x770 [ 9432.663973][ C2] ip_output+0x16b/0x4f0 [ 9432.664182][ C2] ? __pfx_ip_output+0x10/0x10 [ 9432.664417][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9432.664684][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9432.664985][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9432.665280][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9432.665528][ C2] ? __alloc_skb+0xd4/0x280 [ 9432.665758][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9432.666023][ C2] ? tcp_fragment+0x168/0x1040 [ 9432.666267][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9432.666521][ C2] ? ip_local_out+0x114/0x3b0 [ 9432.666753][ C2] __ip_queue_xmit+0x672/0x1910 [ 9432.666992][ C2] ? __skb_clone+0x57a/0x760 [ 9432.667220][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9432.667476][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9432.667749][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9432.667986][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9432.668227][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9432.668517][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9432.668826][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9432.669062][ C2] tcp_send_loss_probe+0x348/0x830 [ 9432.669315][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9432.669574][ C2] tcp_write_timer+0x82/0x1d0 [ 9432.669806][ C2] call_timer_fn+0x173/0x430 [ 9432.670035][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9432.670289][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9432.670542][ C2] __run_timers.part.0+0x52d/0x890 [ 9432.670793][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9432.671053][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9432.671329][ C2] ? lock_acquire+0x1c1/0x220 [ 9432.671560][ C2] ? clockevents_program_event+0xf6/0x300 [ 9432.671840][ C2] ? lock_release+0x1d5/0x250 [ 9432.672070][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9432.672328][ C2] ? ktime_get+0xb3/0x190 [ 9432.672540][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9432.672827][ C2] run_timer_softirq+0x72/0x100 [ 9432.673066][ C2] __do_softirq+0x1b9/0x7ff [ 9432.673292][ C2] irq_exit_rcu+0x98/0xc0 [ 9432.673505][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9432.673779][ C2] [ 9432.673924][ C2] [ 9432.674071][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9432.674366][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9432.674614][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9432.675585][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9432.675888][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9432.676297][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9432.676681][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9432.677065][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9432.677451][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9432.677840][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9432.678119][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9432.678371][ C2] default_idle_call+0x69/0xa0 [ 9432.678607][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9432.678850][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9432.679117][ C2] ? lock_release+0x1d5/0x250 [ 9432.679350][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9432.679615][ C2] do_idle+0xfb/0x160 [ 9432.679813][ C2] cpu_startup_entry+0x55/0x60 [ 9432.680047][ C2] start_secondary+0x21c/0x2b0 [ 9432.680284][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9432.680544][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9432.680846][ C2] [ 9460.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6619s! [perl:4135] [ 9460.569678][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9460.570898][ C1] irq event stamp: 209232 [ 9460.571110][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9460.571626][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9460.572092][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9460.572548][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9460.572997][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9460.573436][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9460.574035][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9460.574353][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9460.575302][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9460.575602][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9460.575989][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9460.576378][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9460.576768][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9460.577157][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9460.577545][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9460.577981][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9460.578305][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9460.578699][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9460.579087][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9460.579476][ C1] PKRU: 55555554 [ 9460.579653][ C1] Call Trace: [ 9460.579819][ C1] [ 9460.579962][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9460.580217][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9460.580455][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9460.580724][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9460.580992][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9460.581273][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9460.581530][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9460.581829][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9460.582084][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9460.582386][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9460.582674][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9460.582980][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9460.583265][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9460.583553][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9460.583835][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9460.584140][ C1] ? get_stack_info+0x36/0xc0 [ 9460.584377][ C1] ? lock_acquire+0x1c1/0x220 [ 9460.584609][ C1] ? lock_release+0x1d5/0x250 [ 9460.584844][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9460.585109][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9460.585382][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9460.585668][ C1] ? lock_acquire+0x1c1/0x220 [ 9460.585905][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9460.586157][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9460.586411][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9460.586641][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9460.586883][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9460.587134][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9460.587404][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9460.587673][ C1] ip_local_deliver+0x19d/0x480 [ 9460.587914][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9460.588179][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9460.588438][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9460.588776][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9460.589024][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9460.589338][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9460.589594][ C1] ip_rcv+0x564/0x740 [ 9460.589793][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9460.590018][ C1] ? set_track_prepare+0x8a/0xd0 [ 9460.590267][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9460.590537][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9460.590801][ C1] ? skb_clone+0x10b/0x330 [ 9460.591023][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9460.591336][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9460.591632][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9460.591909][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9460.592196][ C1] ? __tcf_classify+0x329/0x7d0 [ 9460.592439][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9460.592664][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9460.592955][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9460.593237][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9460.593554][ C1] ? lock_acquire+0x1c1/0x220 [ 9460.593787][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9460.594074][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9460.594356][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9460.594665][ C1] ? __copy_skb_header+0xaf/0x490 [ 9460.594919][ C1] ? __skb_clone+0x57a/0x760 [ 9460.595170][ C1] netif_receive_skb+0x55/0x280 [ 9460.595419][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9460.595733][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9460.596064][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9460.596370][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9460.596636][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9460.596917][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9460.597223][ C1] ? hlock_class+0x4e/0x130 [ 9460.597451][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9460.597720][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9460.597989][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9460.598248][ C1] ? hlock_class+0x4e/0x130 [ 9460.598472][ C1] ? mark_lock+0x38/0x3e0 [ 9460.598689][ C1] ? stack_access_ok+0xda/0x1f0 [ 9460.598931][ C1] ? __lock_acquire+0xb67/0x1610 [ 9460.599179][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9460.599450][ C1] ? get_stack_info+0x36/0xc0 [ 9460.599684][ C1] ? stack_access_ok+0xda/0x1f0 [ 9460.599923][ C1] ? get_reg+0x119/0x190 [ 9460.600136][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9460.600398][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9460.600700][ C1] __tcf_classify+0x329/0x7d0 [ 9460.600936][ C1] tcf_classify+0x283/0x930 [ 9460.601161][ C1] ? arch_stack_walk+0xa2/0x100 [ 9460.601405][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9460.601655][ C1] ? get_stack_info+0x36/0xc0 [ 9460.601891][ C1] tc_run+0x2e4/0x5d0 [ 9460.602089][ C1] ? __pfx_tc_run+0x10/0x10 [ 9460.602317][ C1] ? lock_acquire+0x1c1/0x220 [ 9460.602548][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9460.602804][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9460.603050][ C1] ? lock_acquire+0x1c1/0x220 [ 9460.603285][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9460.603542][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9460.603840][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9460.604104][ C1] ? neigh_hh_output+0x348/0x590 [ 9460.604352][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9460.604611][ C1] ip_finish_output2+0x786/0x18e0 [ 9460.604860][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9460.605160][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9460.605499][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9460.605776][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9460.606029][ C1] ? __ip_finish_output+0x10f/0x770 [ 9460.606301][ C1] ip_output+0x16b/0x4f0 [ 9460.606512][ C1] ? run_timer_softirq+0x72/0x100 [ 9460.606762][ C1] ? __pfx_ip_output+0x10/0x10 [ 9460.606998][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9460.607281][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9460.607526][ C1] ? ip_local_out+0x114/0x3b0 [ 9460.607759][ C1] __ip_queue_xmit+0x672/0x1910 [ 9460.608001][ C1] ? __create_object+0x5e/0xb0 [ 9460.608241][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9460.608500][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9460.608776][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9460.609042][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9460.609317][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9460.609583][ C1] tcp_delack_timer+0x84/0x240 [ 9460.609819][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9460.610087][ C1] call_timer_fn+0x173/0x430 [ 9460.610317][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9460.610571][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9460.610827][ C1] __run_timers.part.0+0x52d/0x890 [ 9460.611081][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9460.611350][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9460.611626][ C1] ? lock_acquire+0x1c1/0x220 [ 9460.611859][ C1] ? clockevents_program_event+0xf6/0x300 [ 9460.612143][ C1] ? lock_release+0x1d5/0x250 [ 9460.612376][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9460.612633][ C1] ? ktime_get+0xb3/0x190 [ 9460.612851][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9460.613139][ C1] run_timer_softirq+0x72/0x100 [ 9460.613383][ C1] __do_softirq+0x1b9/0x7ff [ 9460.613611][ C1] irq_exit_rcu+0x98/0xc0 [ 9460.613824][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9460.614103][ C1] [ 9460.614254][ C1] [ 9460.614402][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9460.614697][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9460.615035][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9460.616008][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9460.616322][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9460.616712][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9460.617101][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9460.617490][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9460.617877][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9460.618270][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9460.618558][ C1] pipe_read+0xa16/0xdf0 [ 9460.618773][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9460.619045][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9460.619284][ C1] ? iterate_tty_write+0x299/0x540 [ 9460.619540][ C1] ? lock_release+0x1d5/0x250 [ 9460.619777][ C1] vfs_read+0x911/0xc00 [ 9460.619987][ C1] ? lock_acquire+0x1c1/0x220 [ 9460.620220][ C1] ? __might_fault+0xc6/0x180 [ 9460.620453][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9460.620687][ C1] ? __might_fault+0xc6/0x180 [ 9460.620921][ C1] ? lock_release+0x1d5/0x250 [ 9460.621155][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9460.621414][ C1] ? __fget_light+0x54/0x1e0 [ 9460.621643][ C1] ksys_read+0x17a/0x1e0 [ 9460.621857][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9460.622095][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9460.622392][ C1] do_syscall_64+0xc9/0x1e0 [ 9460.622619][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9460.622912][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9460.623133][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9460.624080][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9460.624494][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9460.624882][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9460.625299][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9460.625700][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9460.626110][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9460.626501][ C1] [ 9460.626656][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6619s! [swapper/2:0] [ 9460.627057][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9460.628272][ C2] irq event stamp: 44114564 [ 9460.628491][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9460.629010][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9460.629506][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9460.629967][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9460.630421][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9460.630863][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9460.631458][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9460.631771][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9460.632709][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9460.633008][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9460.633393][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9460.633780][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9460.634168][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9460.634554][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9460.634959][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9460.635406][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9460.635739][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9460.636149][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9460.636535][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9460.636920][ C2] PKRU: 55555554 [ 9460.637096][ C2] Call Trace: [ 9460.637262][ C2] [ 9460.637404][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9460.637656][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9460.637894][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9460.638162][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9460.638427][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9460.638704][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9460.638958][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9460.639254][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9460.639506][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9460.639759][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9460.640058][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9460.640345][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9460.640648][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9460.640928][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9460.641215][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9460.641495][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9460.641797][ C2] ? get_stack_info+0x36/0xc0 [ 9460.642031][ C2] ? lock_acquire+0x1c1/0x220 [ 9460.642264][ C2] ? lock_release+0x1d5/0x250 [ 9460.642495][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9460.642736][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9460.642998][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9460.643277][ C2] ? lock_acquire+0x1c1/0x220 [ 9460.643508][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9460.643738][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9460.643990][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9460.644219][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9460.644458][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9460.644708][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9460.644993][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9460.645269][ C2] ip_local_deliver+0x19d/0x480 [ 9460.645514][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9460.645785][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9460.646047][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9460.646395][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9460.646640][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9460.646950][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9460.647205][ C2] ip_rcv+0x564/0x740 [ 9460.647403][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9460.647628][ C2] ? set_track_prepare+0x8a/0xd0 [ 9460.647873][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9460.648141][ C2] ? start_secondary+0x21c/0x2b0 [ 9460.648386][ C2] ? skb_clone+0x10b/0x330 [ 9460.648606][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9460.648915][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9460.649212][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9460.649487][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9460.649771][ C2] ? __tcf_classify+0x329/0x7d0 [ 9460.650011][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9460.650237][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9460.650528][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9460.650806][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9460.651122][ C2] ? lock_acquire+0x1c1/0x220 [ 9460.651355][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9460.651640][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9460.651918][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9460.652227][ C2] ? __copy_skb_header+0xaf/0x490 [ 9460.652476][ C2] ? __skb_clone+0x57a/0x760 [ 9460.652702][ C2] netif_receive_skb+0x55/0x280 [ 9460.652942][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9460.653245][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9460.653566][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9460.653856][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9460.654121][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9460.654401][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9460.654704][ C2] ? get_stack_info+0x36/0xc0 [ 9460.654961][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9460.655223][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9460.655538][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9460.655811][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9460.656088][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9460.656406][ C2] ? kernel_text_address+0x17/0xe0 [ 9460.656658][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9460.656959][ C2] ? arch_stack_walk+0x8c/0x100 [ 9460.657200][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9460.657456][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9460.657734][ C2] ? lock_acquire+0x1c1/0x220 [ 9460.657967][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9460.658244][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9460.658539][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9460.658806][ C2] ? get_stack_info+0x36/0xc0 [ 9460.659040][ C2] __tcf_classify+0x329/0x7d0 [ 9460.659276][ C2] tcf_classify+0x283/0x930 [ 9460.659500][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9460.659747][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9460.660052][ C2] tc_run+0x2e4/0x5d0 [ 9460.660252][ C2] ? __pfx_tc_run+0x10/0x10 [ 9460.660477][ C2] ? lock_acquire+0x1c1/0x220 [ 9460.660709][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9460.660961][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9460.661207][ C2] ? lock_acquire+0x1c1/0x220 [ 9460.661436][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9460.661693][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9460.661986][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9460.662255][ C2] ? neigh_hh_output+0x348/0x590 [ 9460.662500][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9460.662760][ C2] ip_finish_output2+0x786/0x18e0 [ 9460.663009][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9460.663337][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9460.663604][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9460.663848][ C2] ? __ip_finish_output+0x10f/0x770 [ 9460.664104][ C2] ip_output+0x16b/0x4f0 [ 9460.664315][ C2] ? __pfx_ip_output+0x10/0x10 [ 9460.664549][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9460.664819][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9460.665149][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9460.665426][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9460.665676][ C2] ? __alloc_skb+0xd4/0x280 [ 9460.665903][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9460.666182][ C2] ? tcp_fragment+0x168/0x1040 [ 9460.666416][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9460.666659][ C2] ? ip_local_out+0x114/0x3b0 [ 9460.666893][ C2] __ip_queue_xmit+0x672/0x1910 [ 9460.667134][ C2] ? __skb_clone+0x57a/0x760 [ 9460.667363][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9460.667622][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9460.667893][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9460.668129][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9460.668371][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9460.668662][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9460.668971][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9460.669207][ C2] tcp_send_loss_probe+0x348/0x830 [ 9460.669460][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9460.669722][ C2] tcp_write_timer+0x82/0x1d0 [ 9460.669952][ C2] call_timer_fn+0x173/0x430 [ 9460.670184][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9460.670438][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9460.670690][ C2] __run_timers.part.0+0x52d/0x890 [ 9460.670941][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9460.671202][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9460.671480][ C2] ? lock_acquire+0x1c1/0x220 [ 9460.671712][ C2] ? clockevents_program_event+0xf6/0x300 [ 9460.671993][ C2] ? lock_release+0x1d5/0x250 [ 9460.672225][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9460.672483][ C2] ? ktime_get+0xb3/0x190 [ 9460.672696][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9460.672985][ C2] run_timer_softirq+0x72/0x100 [ 9460.673226][ C2] __do_softirq+0x1b9/0x7ff [ 9460.673451][ C2] irq_exit_rcu+0x98/0xc0 [ 9460.673665][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9460.673939][ C2] [ 9460.674088][ C2] [ 9460.674233][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9460.674528][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9460.674776][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9460.675755][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9460.676060][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9460.676459][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9460.676843][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9460.677231][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9460.677617][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9460.678008][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9460.678289][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9460.678541][ C2] default_idle_call+0x69/0xa0 [ 9460.678775][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9460.679017][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9460.679289][ C2] ? lock_release+0x1d5/0x250 [ 9460.679519][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9460.679785][ C2] do_idle+0xfb/0x160 [ 9460.679982][ C2] cpu_startup_entry+0x55/0x60 [ 9460.680219][ C2] start_secondary+0x21c/0x2b0 [ 9460.680455][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9460.680717][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9460.681016][ C2] [ 9484.226103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9484.226463][ C1] rcu: 1-....: (7111518 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1689001 [ 9484.227010][ C1] rcu: (t=7129339 jiffies g=1882453 q=724 ncpus=4) [ 9484.227335][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9484.227772][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9484.228371][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9484.228691][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9484.229637][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9484.229937][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9484.230326][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9484.230715][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9484.231102][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9484.231494][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9484.231882][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9484.232320][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9484.232644][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9484.233034][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9484.233426][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9484.233814][ C1] PKRU: 55555554 [ 9484.233992][ C1] Call Trace: [ 9484.234156][ C1] [ 9484.234303][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9484.234569][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9484.234820][ C1] ? check_cpu_stall+0x284/0x500 [ 9484.235067][ C1] ? rcu_pending+0x92/0x360 [ 9484.235292][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9484.235556][ C1] ? update_process_times+0xb9/0x110 [ 9484.235819][ C1] ? tick_sched_handle+0x67/0x130 [ 9484.236070][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9484.236347][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9484.236584][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9484.236890][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9484.237154][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9484.237437][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9484.237697][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9484.237995][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9484.238254][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9484.238555][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9484.238843][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9484.239151][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9484.239433][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9484.239721][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9484.240003][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9484.240308][ C1] ? get_stack_info+0x36/0xc0 [ 9484.240543][ C1] ? lock_acquire+0x1c1/0x220 [ 9484.240778][ C1] ? lock_release+0x1d5/0x250 [ 9484.241013][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9484.241256][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9484.241522][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9484.241800][ C1] ? lock_acquire+0x1c1/0x220 [ 9484.242033][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9484.242271][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9484.242525][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9484.242753][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9484.242993][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9484.243245][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9484.243522][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9484.243793][ C1] ip_local_deliver+0x19d/0x480 [ 9484.244039][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9484.244306][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9484.244563][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9484.244926][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9484.245178][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9484.245498][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9484.245761][ C1] ip_rcv+0x564/0x740 [ 9484.245976][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9484.246200][ C1] ? set_track_prepare+0x8a/0xd0 [ 9484.246448][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9484.246718][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9484.246983][ C1] ? skb_clone+0x10b/0x330 [ 9484.247208][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9484.247520][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9484.247818][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9484.248094][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9484.248381][ C1] ? __tcf_classify+0x329/0x7d0 [ 9484.248624][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9484.248849][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9484.249139][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9484.249419][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9484.249735][ C1] ? lock_acquire+0x1c1/0x220 [ 9484.249967][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9484.250256][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9484.250535][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9484.250842][ C1] ? __copy_skb_header+0xaf/0x490 [ 9484.251093][ C1] ? __skb_clone+0x57a/0x760 [ 9484.251323][ C1] netif_receive_skb+0x55/0x280 [ 9484.251566][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9484.251871][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9484.252195][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9484.252486][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9484.252753][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9484.253034][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9484.253339][ C1] ? hlock_class+0x4e/0x130 [ 9484.253566][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9484.253835][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9484.254102][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9484.254360][ C1] ? hlock_class+0x4e/0x130 [ 9484.254586][ C1] ? mark_lock+0x38/0x3e0 [ 9484.254821][ C1] ? stack_access_ok+0xda/0x1f0 [ 9484.255067][ C1] ? __lock_acquire+0xb67/0x1610 [ 9484.255323][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9484.255602][ C1] ? get_stack_info+0x36/0xc0 [ 9484.255840][ C1] ? stack_access_ok+0xda/0x1f0 [ 9484.256096][ C1] ? get_reg+0x119/0x190 [ 9484.256309][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9484.256570][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9484.256872][ C1] __tcf_classify+0x329/0x7d0 [ 9484.257106][ C1] tcf_classify+0x283/0x930 [ 9484.257353][ C1] ? arch_stack_walk+0xa2/0x100 [ 9484.257602][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9484.257860][ C1] ? get_stack_info+0x36/0xc0 [ 9484.258102][ C1] tc_run+0x2e4/0x5d0 [ 9484.258308][ C1] ? __pfx_tc_run+0x10/0x10 [ 9484.258539][ C1] ? lock_acquire+0x1c1/0x220 [ 9484.258781][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9484.259033][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9484.259280][ C1] ? lock_acquire+0x1c1/0x220 [ 9484.259513][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9484.259771][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9484.260069][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9484.260335][ C1] ? neigh_hh_output+0x348/0x590 [ 9484.260581][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9484.260838][ C1] ip_finish_output2+0x786/0x18e0 [ 9484.261088][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9484.261361][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9484.261690][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9484.261960][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9484.262207][ C1] ? __ip_finish_output+0x10f/0x770 [ 9484.262466][ C1] ip_output+0x16b/0x4f0 [ 9484.262675][ C1] ? run_timer_softirq+0x72/0x100 [ 9484.262925][ C1] ? __pfx_ip_output+0x10/0x10 [ 9484.263163][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9484.263445][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9484.263690][ C1] ? ip_local_out+0x114/0x3b0 [ 9484.263923][ C1] __ip_queue_xmit+0x672/0x1910 [ 9484.264165][ C1] ? __create_object+0x5e/0xb0 [ 9484.264404][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9484.264665][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9484.264999][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9484.265276][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9484.265558][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9484.265830][ C1] tcp_delack_timer+0x84/0x240 [ 9484.266085][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9484.266351][ C1] call_timer_fn+0x173/0x430 [ 9484.266583][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9484.266838][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9484.267093][ C1] __run_timers.part.0+0x52d/0x890 [ 9484.267347][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9484.267617][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9484.267897][ C1] ? lock_acquire+0x1c1/0x220 [ 9484.268132][ C1] ? clockevents_program_event+0xf6/0x300 [ 9484.268415][ C1] ? lock_release+0x1d5/0x250 [ 9484.268652][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9484.268911][ C1] ? ktime_get+0xb3/0x190 [ 9484.269129][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9484.269419][ C1] run_timer_softirq+0x72/0x100 [ 9484.269663][ C1] __do_softirq+0x1b9/0x7ff [ 9484.269895][ C1] irq_exit_rcu+0x98/0xc0 [ 9484.270110][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9484.270393][ C1] [ 9484.270541][ C1] [ 9484.270687][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9484.270987][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9484.271307][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9484.272261][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9484.272564][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9484.272953][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9484.273346][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9484.273737][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9484.274130][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9484.274526][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9484.274844][ C1] pipe_read+0xa16/0xdf0 [ 9484.275066][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9484.275349][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9484.275592][ C1] ? iterate_tty_write+0x299/0x540 [ 9484.275856][ C1] ? lock_release+0x1d5/0x250 [ 9484.276107][ C1] vfs_read+0x911/0xc00 [ 9484.276319][ C1] ? lock_acquire+0x1c1/0x220 [ 9484.276552][ C1] ? __might_fault+0xc6/0x180 [ 9484.276788][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9484.277023][ C1] ? __might_fault+0xc6/0x180 [ 9484.277259][ C1] ? lock_release+0x1d5/0x250 [ 9484.277493][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9484.277753][ C1] ? __fget_light+0x54/0x1e0 [ 9484.277985][ C1] ksys_read+0x17a/0x1e0 [ 9484.278198][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9484.278436][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9484.278736][ C1] do_syscall_64+0xc9/0x1e0 [ 9484.278965][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9484.279258][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9484.279484][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9484.280436][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9484.280849][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9484.281241][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9484.281630][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9484.282018][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9484.282411][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9484.282804][ C1] [ 9484.282956][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9484.283225][ C2] NMI backtrace for cpu 2 [ 9484.283231][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9484.283236][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9484.283240][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 9484.283249][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 9484.283254][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [ 9484.283259][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9484.283263][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9484.283267][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9484.283271][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9484.283275][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9484.283279][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9484.283283][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9484.283289][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9484.283292][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9484.283295][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9484.283299][ C2] PKRU: 55555554 [ 9484.283301][ C2] Call Trace: [ 9484.283304][ C2] [ 9484.283307][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9484.283319][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9484.283327][ C2] ? nmi_handle+0x153/0x420 [ 9484.283337][ C2] ? default_do_nmi+0x41/0x100 [ 9484.283343][ C2] ? exc_nmi+0xf3/0x120 [ 9484.283349][ C2] ? end_repeat_nmi+0xf/0x60 [ 9484.283361][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9484.283369][ C2] ? kasan_check_range+0x12/0x1c0 [ 9484.283377][ C2] ? kasan_check_range+0x12/0x1c0 [ 9484.283382][ C2] ? kasan_check_range+0x12/0x1c0 [ 9484.283385][ C2] [ 9484.283386][ C2] [ 9484.283387][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 9484.283391][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9484.283393][ C2] ? get_stack_info+0x36/0xc0 [ 9484.283398][ C2] ? lock_acquire+0x1c1/0x220 [ 9484.283402][ C2] ? lock_release+0x1d5/0x250 [ 9484.283405][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9484.283408][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9484.283411][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9484.283414][ C2] ? lock_acquire+0x1c1/0x220 [ 9484.283417][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9484.283421][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9484.283423][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9484.283430][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9484.283432][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9484.283437][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9484.283442][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9484.283446][ C2] ip_local_deliver+0x19d/0x480 [ 9484.283449][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9484.283451][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9484.283453][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9484.283459][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9484.283463][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9484.283466][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9484.283475][ C2] ip_rcv+0x564/0x740 [ 9484.283478][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9484.283480][ C2] ? set_track_prepare+0x8a/0xd0 [ 9484.283485][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9484.283488][ C2] ? start_secondary+0x21c/0x2b0 [ 9484.283492][ C2] ? skb_clone+0x10b/0x330 [ 9484.283495][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9484.283501][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9484.283506][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9484.283510][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9484.283518][ C2] ? __tcf_classify+0x329/0x7d0 [ 9484.283522][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9484.283525][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9484.283528][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9484.283531][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9484.283536][ C2] ? lock_acquire+0x1c1/0x220 [ 9484.283538][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9484.283542][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9484.283546][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9484.283550][ C2] ? __copy_skb_header+0xaf/0x490 [ 9484.283554][ C2] ? __skb_clone+0x57a/0x760 [ 9484.283556][ C2] netif_receive_skb+0x55/0x280 [ 9484.283560][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9484.283567][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9484.283573][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9484.283580][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9484.283584][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9484.283593][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9484.283601][ C2] ? get_stack_info+0x36/0xc0 [ 9484.283606][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9484.283609][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9484.283612][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9484.283614][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9484.283618][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9484.283620][ C2] ? kernel_text_address+0x17/0xe0 [ 9484.283623][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9484.283627][ C2] ? arch_stack_walk+0x8c/0x100 [ 9484.283631][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9484.283634][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9484.283638][ C2] ? lock_acquire+0x1c1/0x220 [ 9484.283640][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9484.283644][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9484.283648][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9484.283651][ C2] ? get_stack_info+0x36/0xc0 [ 9484.283655][ C2] __tcf_classify+0x329/0x7d0 [ 9484.283660][ C2] tcf_classify+0x283/0x930 [ 9484.283664][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9484.283667][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9484.283672][ C2] tc_run+0x2e4/0x5d0 [ 9484.283675][ C2] ? __pfx_tc_run+0x10/0x10 [ 9484.283678][ C2] ? lock_acquire+0x1c1/0x220 [ 9484.283680][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9484.283684][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9484.283688][ C2] ? lock_acquire+0x1c1/0x220 [ 9484.283691][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9484.283694][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9484.283697][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9484.283700][ C2] ? neigh_hh_output+0x348/0x590 [ 9484.283704][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9484.283707][ C2] ip_finish_output2+0x786/0x18e0 [ 9484.283711][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9484.283718][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9484.283721][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9484.283725][ C2] ? __ip_finish_output+0x10f/0x770 [ 9484.283728][ C2] ip_output+0x16b/0x4f0 [ 9484.283731][ C2] ? __pfx_ip_output+0x10/0x10 [ 9484.283734][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9484.283737][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9484.283740][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9484.283742][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9484.283745][ C2] ? __alloc_skb+0xd4/0x280 [ 9484.283747][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9484.283751][ C2] ? tcp_fragment+0x168/0x1040 [ 9484.283754][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9484.283757][ C2] ? ip_local_out+0x114/0x3b0 [ 9484.283760][ C2] __ip_queue_xmit+0x672/0x1910 [ 9484.283764][ C2] ? __skb_clone+0x57a/0x760 [ 9484.283767][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9484.283772][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9484.283774][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9484.283778][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9484.283782][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9484.283786][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9484.283789][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9484.283792][ C2] tcp_send_loss_probe+0x348/0x830 [ 9484.283795][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9484.283798][ C2] tcp_write_timer+0x82/0x1d0 [ 9484.283801][ C2] call_timer_fn+0x173/0x430 [ 9484.283805][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9484.283809][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9484.283813][ C2] __run_timers.part.0+0x52d/0x890 [ 9484.283816][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9484.283820][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9484.283823][ C2] ? lock_acquire+0x1c1/0x220 [ 9484.283825][ C2] ? clockevents_program_event+0xf6/0x300 [ 9484.283830][ C2] ? lock_release+0x1d5/0x250 [ 9484.283832][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9484.283836][ C2] ? ktime_get+0xb3/0x190 [ 9484.283839][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9484.283844][ C2] run_timer_softirq+0x72/0x100 [ 9484.283847][ C2] __do_softirq+0x1b9/0x7ff [ 9484.283851][ C2] irq_exit_rcu+0x98/0xc0 [ 9484.283853][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9484.283856][ C2] [ 9484.283857][ C2] [ 9484.283858][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9484.283861][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9484.283864][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9484.283866][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9484.283868][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9484.283870][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9484.283872][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9484.283873][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9484.283874][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9484.283877][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9484.283880][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9484.283884][ C2] default_idle_call+0x69/0xa0 [ 9484.283886][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9484.283889][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9484.283892][ C2] ? lock_release+0x1d5/0x250 [ 9484.283895][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9484.283899][ C2] do_idle+0xfb/0x160 [ 9484.283901][ C2] cpu_startup_entry+0x55/0x60 [ 9484.283904][ C2] start_secondary+0x21c/0x2b0 [ 9484.283907][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9484.283910][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9484.283916][ C2] [ 9508.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6664s! [swapper/2:0] [ 9508.569673][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9508.570894][ C2] irq event stamp: 44114564 [ 9508.571117][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9508.571635][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9508.572131][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9508.572595][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9508.573049][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9508.573491][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9508.574085][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9508.574400][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9508.575346][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9508.575643][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9508.576030][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9508.576417][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9508.576801][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9508.577191][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9508.577578][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9508.578010][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9508.578333][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9508.578720][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9508.579109][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9508.579496][ C2] PKRU: 55555554 [ 9508.579672][ C2] Call Trace: [ 9508.579835][ C2] [ 9508.579978][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9508.580233][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9508.580469][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9508.580736][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9508.581000][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9508.581282][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9508.581539][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9508.581836][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9508.582089][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9508.582344][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9508.582645][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9508.582930][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9508.583236][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9508.583517][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9508.583802][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9508.584083][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9508.584385][ C2] ? get_stack_info+0x36/0xc0 [ 9508.584617][ C2] ? lock_acquire+0x1c1/0x220 [ 9508.584874][ C2] ? lock_release+0x1d5/0x250 [ 9508.585112][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9508.585361][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9508.585632][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9508.585923][ C2] ? lock_acquire+0x1c1/0x220 [ 9508.586155][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9508.586390][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9508.586645][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9508.586873][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9508.587111][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9508.587365][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9508.587632][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9508.587899][ C2] ip_local_deliver+0x19d/0x480 [ 9508.588139][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9508.588403][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9508.588657][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9508.588995][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9508.589240][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9508.589550][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9508.589804][ C2] ip_rcv+0x564/0x740 [ 9508.590002][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9508.590225][ C2] ? set_track_prepare+0x8a/0xd0 [ 9508.590471][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9508.590741][ C2] ? start_secondary+0x21c/0x2b0 [ 9508.590985][ C2] ? skb_clone+0x10b/0x330 [ 9508.591205][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9508.591514][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9508.591811][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9508.592082][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9508.592370][ C2] ? __tcf_classify+0x329/0x7d0 [ 9508.592610][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9508.592831][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9508.593123][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9508.593399][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9508.593716][ C2] ? lock_acquire+0x1c1/0x220 [ 9508.593949][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9508.594238][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9508.594514][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9508.594844][ C2] ? __copy_skb_header+0xaf/0x490 [ 9508.595100][ C2] ? __skb_clone+0x57a/0x760 [ 9508.595336][ C2] netif_receive_skb+0x55/0x280 [ 9508.595583][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9508.595893][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9508.596226][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9508.596515][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9508.596782][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9508.597063][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9508.597368][ C2] ? get_stack_info+0x36/0xc0 [ 9508.597601][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9508.597857][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9508.598163][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9508.598432][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9508.598699][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9508.599004][ C2] ? kernel_text_address+0x17/0xe0 [ 9508.599257][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9508.599560][ C2] ? arch_stack_walk+0x8c/0x100 [ 9508.599801][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9508.600057][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9508.600334][ C2] ? lock_acquire+0x1c1/0x220 [ 9508.600565][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9508.600843][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9508.601138][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9508.601408][ C2] ? get_stack_info+0x36/0xc0 [ 9508.601640][ C2] __tcf_classify+0x329/0x7d0 [ 9508.601875][ C2] tcf_classify+0x283/0x930 [ 9508.602102][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9508.602352][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9508.602656][ C2] tc_run+0x2e4/0x5d0 [ 9508.602855][ C2] ? __pfx_tc_run+0x10/0x10 [ 9508.603078][ C2] ? lock_acquire+0x1c1/0x220 [ 9508.603310][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9508.603563][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9508.603808][ C2] ? lock_acquire+0x1c1/0x220 [ 9508.604040][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9508.604297][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9508.604592][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9508.604879][ C2] ? neigh_hh_output+0x348/0x590 [ 9508.605131][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9508.605393][ C2] ip_finish_output2+0x786/0x18e0 [ 9508.605650][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9508.605994][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9508.606263][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9508.606508][ C2] ? __ip_finish_output+0x10f/0x770 [ 9508.606765][ C2] ip_output+0x16b/0x4f0 [ 9508.606975][ C2] ? __pfx_ip_output+0x10/0x10 [ 9508.607212][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9508.607479][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9508.607782][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9508.608048][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9508.608293][ C2] ? __alloc_skb+0xd4/0x280 [ 9508.608518][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9508.608778][ C2] ? tcp_fragment+0x168/0x1040 [ 9508.609015][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9508.609277][ C2] ? ip_local_out+0x114/0x3b0 [ 9508.609516][ C2] __ip_queue_xmit+0x672/0x1910 [ 9508.609762][ C2] ? __skb_clone+0x57a/0x760 [ 9508.609995][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9508.610261][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9508.610552][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9508.610786][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9508.611026][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9508.611320][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9508.611629][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9508.611866][ C2] tcp_send_loss_probe+0x348/0x830 [ 9508.612118][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9508.612378][ C2] tcp_write_timer+0x82/0x1d0 [ 9508.612612][ C2] call_timer_fn+0x173/0x430 [ 9508.612840][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9508.613094][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9508.613349][ C2] __run_timers.part.0+0x52d/0x890 [ 9508.613601][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9508.613862][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9508.614138][ C2] ? lock_acquire+0x1c1/0x220 [ 9508.614371][ C2] ? clockevents_program_event+0xf6/0x300 [ 9508.614652][ C2] ? lock_release+0x1d5/0x250 [ 9508.614906][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9508.615172][ C2] ? ktime_get+0xb3/0x190 [ 9508.615393][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9508.615689][ C2] run_timer_softirq+0x72/0x100 [ 9508.615946][ C2] __do_softirq+0x1b9/0x7ff [ 9508.616172][ C2] irq_exit_rcu+0x98/0xc0 [ 9508.616385][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9508.616661][ C2] [ 9508.616805][ C2] [ 9508.616952][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9508.617245][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9508.617493][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9508.618431][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9508.618726][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9508.619113][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9508.619499][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9508.619884][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9508.620268][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9508.620657][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9508.620936][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9508.621188][ C2] default_idle_call+0x69/0xa0 [ 9508.621425][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9508.621669][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9508.621937][ C2] ? lock_release+0x1d5/0x250 [ 9508.622169][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9508.622433][ C2] do_idle+0xfb/0x160 [ 9508.622631][ C2] cpu_startup_entry+0x55/0x60 [ 9508.622867][ C2] start_secondary+0x21c/0x2b0 [ 9508.623103][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9508.623364][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9508.623664][ C2] [ 9508.623817][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6664s! [perl:4135] [ 9508.624222][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9508.625482][ C1] irq event stamp: 209232 [ 9508.625702][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9508.626234][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9508.626698][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9508.627156][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9508.627608][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9508.628045][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9508.628641][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9508.628957][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9508.629906][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9508.630206][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9508.630596][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9508.630990][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9508.631379][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9508.631767][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9508.632158][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9508.632594][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9508.632919][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9508.633310][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9508.633697][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9508.634088][ C1] PKRU: 55555554 [ 9508.634265][ C1] Call Trace: [ 9508.634431][ C1] [ 9508.634576][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9508.634854][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9508.635095][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9508.635376][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9508.635649][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9508.635947][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9508.636207][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9508.636505][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9508.636760][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9508.637061][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9508.637352][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9508.637658][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9508.637938][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9508.638229][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9508.638508][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9508.638811][ C1] ? get_stack_info+0x36/0xc0 [ 9508.639046][ C1] ? lock_acquire+0x1c1/0x220 [ 9508.639282][ C1] ? lock_release+0x1d5/0x250 [ 9508.639514][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9508.639756][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9508.640022][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9508.640305][ C1] ? lock_acquire+0x1c1/0x220 [ 9508.640541][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9508.640774][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9508.641028][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9508.641258][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9508.641499][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9508.641749][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9508.642016][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9508.642289][ C1] ip_local_deliver+0x19d/0x480 [ 9508.642528][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9508.642795][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9508.643052][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9508.643390][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9508.643637][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9508.643948][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9508.644204][ C1] ip_rcv+0x564/0x740 [ 9508.644402][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9508.644628][ C1] ? set_track_prepare+0x8a/0xd0 [ 9508.644904][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9508.645180][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9508.645453][ C1] ? skb_clone+0x10b/0x330 [ 9508.645681][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9508.646007][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9508.646308][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9508.646581][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9508.646869][ C1] ? __tcf_classify+0x329/0x7d0 [ 9508.647110][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9508.647336][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9508.647629][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9508.647905][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9508.648223][ C1] ? lock_acquire+0x1c1/0x220 [ 9508.648456][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9508.648744][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9508.649021][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9508.649331][ C1] ? __copy_skb_header+0xaf/0x490 [ 9508.649581][ C1] ? __skb_clone+0x57a/0x760 [ 9508.649810][ C1] netif_receive_skb+0x55/0x280 [ 9508.650051][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9508.650354][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9508.650695][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9508.650994][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9508.651269][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9508.651559][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9508.651871][ C1] ? hlock_class+0x4e/0x130 [ 9508.652109][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9508.652378][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9508.652648][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9508.652905][ C1] ? hlock_class+0x4e/0x130 [ 9508.653131][ C1] ? mark_lock+0x38/0x3e0 [ 9508.653345][ C1] ? stack_access_ok+0xda/0x1f0 [ 9508.653587][ C1] ? __lock_acquire+0xb67/0x1610 [ 9508.653835][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9508.654103][ C1] ? get_stack_info+0x36/0xc0 [ 9508.654339][ C1] ? stack_access_ok+0xda/0x1f0 [ 9508.654579][ C1] ? get_reg+0x119/0x190 [ 9508.654811][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9508.655076][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9508.655387][ C1] __tcf_classify+0x329/0x7d0 [ 9508.655629][ C1] tcf_classify+0x283/0x930 [ 9508.655860][ C1] ? arch_stack_walk+0xa2/0x100 [ 9508.656113][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9508.656365][ C1] ? get_stack_info+0x36/0xc0 [ 9508.656599][ C1] tc_run+0x2e4/0x5d0 [ 9508.656798][ C1] ? __pfx_tc_run+0x10/0x10 [ 9508.657024][ C1] ? lock_acquire+0x1c1/0x220 [ 9508.657259][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9508.657513][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9508.657760][ C1] ? lock_acquire+0x1c1/0x220 [ 9508.657990][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9508.658250][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9508.658546][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9508.658813][ C1] ? neigh_hh_output+0x348/0x590 [ 9508.659059][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9508.659319][ C1] ip_finish_output2+0x786/0x18e0 [ 9508.659568][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9508.659838][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9508.660169][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9508.660439][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9508.660685][ C1] ? __ip_finish_output+0x10f/0x770 [ 9508.660944][ C1] ip_output+0x16b/0x4f0 [ 9508.661155][ C1] ? run_timer_softirq+0x72/0x100 [ 9508.661407][ C1] ? __pfx_ip_output+0x10/0x10 [ 9508.661645][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9508.661923][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9508.662170][ C1] ? ip_local_out+0x114/0x3b0 [ 9508.662405][ C1] __ip_queue_xmit+0x672/0x1910 [ 9508.662647][ C1] ? __create_object+0x5e/0xb0 [ 9508.662883][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9508.663143][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9508.663418][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9508.663683][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9508.663959][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9508.664224][ C1] tcp_delack_timer+0x84/0x240 [ 9508.664462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9508.664748][ C1] call_timer_fn+0x173/0x430 [ 9508.664984][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9508.665247][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9508.665508][ C1] __run_timers.part.0+0x52d/0x890 [ 9508.665768][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9508.666047][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9508.666325][ C1] ? lock_acquire+0x1c1/0x220 [ 9508.666556][ C1] ? clockevents_program_event+0xf6/0x300 [ 9508.666840][ C1] ? lock_release+0x1d5/0x250 [ 9508.667071][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9508.667331][ C1] ? ktime_get+0xb3/0x190 [ 9508.667545][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9508.667835][ C1] run_timer_softirq+0x72/0x100 [ 9508.668077][ C1] __do_softirq+0x1b9/0x7ff [ 9508.668305][ C1] irq_exit_rcu+0x98/0xc0 [ 9508.668521][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9508.668799][ C1] [ 9508.668945][ C1] [ 9508.669092][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9508.669390][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9508.669707][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9508.670658][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9508.670959][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9508.671350][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9508.671737][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9508.672125][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9508.672517][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9508.672909][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9508.673199][ C1] pipe_read+0xa16/0xdf0 [ 9508.673415][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9508.673684][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9508.673923][ C1] ? iterate_tty_write+0x299/0x540 [ 9508.674178][ C1] ? lock_release+0x1d5/0x250 [ 9508.674415][ C1] vfs_read+0x911/0xc00 [ 9508.674622][ C1] ? lock_acquire+0x1c1/0x220 [ 9508.674903][ C1] ? __might_fault+0xc6/0x180 [ 9508.675145][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9508.675385][ C1] ? __might_fault+0xc6/0x180 [ 9508.675626][ C1] ? lock_release+0x1d5/0x250 [ 9508.675868][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9508.676139][ C1] ? __fget_light+0x54/0x1e0 [ 9508.676371][ C1] ksys_read+0x17a/0x1e0 [ 9508.676584][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9508.676823][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9508.677121][ C1] do_syscall_64+0xc9/0x1e0 [ 9508.677348][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9508.677642][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9508.677864][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9508.678814][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9508.679226][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9508.679615][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9508.680006][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9508.680397][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9508.680786][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9508.681178][ C1] [ 9536.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6690s! [swapper/2:0] [ 9536.569682][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9536.570893][ C2] irq event stamp: 44114564 [ 9536.571114][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9536.571631][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9536.572125][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9536.572590][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9536.573041][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9536.573483][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9536.574076][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12b/0xb90 [ 9536.574391][ C2] Code: 24 80 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc 90 e9 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 [ 9536.575335][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9536.575631][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9536.576016][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9536.576402][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9536.576789][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9536.577176][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9536.577561][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9536.577992][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9536.578314][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9536.578703][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9536.579089][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9536.579476][ C2] PKRU: 55555554 [ 9536.579652][ C2] Call Trace: [ 9536.579818][ C2] [ 9536.579960][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9536.580214][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9536.580451][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9536.580718][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9536.580981][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9536.581262][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9536.581518][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9536.581814][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9536.582067][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9536.582320][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9536.582620][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9536.582904][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9536.583210][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9536.583492][ C2] ? queued_spin_lock_slowpath+0x12b/0xb90 [ 9536.583776][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9536.584058][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9536.584360][ C2] ? get_stack_info+0x36/0xc0 [ 9536.584597][ C2] ? lock_acquire+0x1c1/0x220 [ 9536.584830][ C2] ? lock_release+0x1d5/0x250 [ 9536.585063][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9536.585305][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9536.585568][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9536.585845][ C2] ? lock_acquire+0x1c1/0x220 [ 9536.586074][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9536.586309][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9536.586560][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9536.586787][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9536.587027][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9536.587279][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9536.587547][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9536.587815][ C2] ip_local_deliver+0x19d/0x480 [ 9536.588056][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9536.588320][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9536.588577][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9536.588916][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9536.589162][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9536.589474][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9536.589729][ C2] ip_rcv+0x564/0x740 [ 9536.589927][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9536.590151][ C2] ? set_track_prepare+0x8a/0xd0 [ 9536.590398][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9536.590667][ C2] ? start_secondary+0x21c/0x2b0 [ 9536.590911][ C2] ? skb_clone+0x10b/0x330 [ 9536.591130][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9536.591441][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9536.591739][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9536.592011][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9536.592300][ C2] ? __tcf_classify+0x329/0x7d0 [ 9536.592542][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9536.592764][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9536.593057][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9536.593335][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9536.593651][ C2] ? lock_acquire+0x1c1/0x220 [ 9536.593881][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9536.594171][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9536.594448][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9536.594781][ C2] ? __copy_skb_header+0xaf/0x490 [ 9536.595037][ C2] ? __skb_clone+0x57a/0x760 [ 9536.595274][ C2] netif_receive_skb+0x55/0x280 [ 9536.595522][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9536.595844][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9536.596168][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9536.596459][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9536.596727][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9536.597007][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9536.597312][ C2] ? get_stack_info+0x36/0xc0 [ 9536.597547][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9536.597804][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9536.598111][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9536.598380][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9536.598649][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9536.598955][ C2] ? kernel_text_address+0x17/0xe0 [ 9536.599208][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9536.599512][ C2] ? arch_stack_walk+0x8c/0x100 [ 9536.599754][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9536.600011][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9536.600291][ C2] ? lock_acquire+0x1c1/0x220 [ 9536.600520][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9536.600797][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9536.601093][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9536.601364][ C2] ? get_stack_info+0x36/0xc0 [ 9536.601598][ C2] __tcf_classify+0x329/0x7d0 [ 9536.601831][ C2] tcf_classify+0x283/0x930 [ 9536.602059][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9536.602310][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9536.602616][ C2] tc_run+0x2e4/0x5d0 [ 9536.602817][ C2] ? __pfx_tc_run+0x10/0x10 [ 9536.603043][ C2] ? lock_acquire+0x1c1/0x220 [ 9536.603274][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9536.603529][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9536.603774][ C2] ? lock_acquire+0x1c1/0x220 [ 9536.604007][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9536.604264][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9536.604564][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9536.604851][ C2] ? neigh_hh_output+0x348/0x590 [ 9536.605103][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9536.605367][ C2] ip_finish_output2+0x786/0x18e0 [ 9536.605624][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9536.605966][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9536.606236][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9536.606482][ C2] ? __ip_finish_output+0x10f/0x770 [ 9536.606739][ C2] ip_output+0x16b/0x4f0 [ 9536.606948][ C2] ? __pfx_ip_output+0x10/0x10 [ 9536.607186][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9536.607453][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9536.607757][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9536.608026][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9536.608271][ C2] ? __alloc_skb+0xd4/0x280 [ 9536.608494][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9536.608755][ C2] ? tcp_fragment+0x168/0x1040 [ 9536.608993][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9536.609239][ C2] ? ip_local_out+0x114/0x3b0 [ 9536.609473][ C2] __ip_queue_xmit+0x672/0x1910 [ 9536.609715][ C2] ? __skb_clone+0x57a/0x760 [ 9536.609942][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9536.610203][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9536.610476][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9536.610715][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9536.610956][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9536.611247][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9536.611558][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9536.611796][ C2] tcp_send_loss_probe+0x348/0x830 [ 9536.612048][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9536.612309][ C2] tcp_write_timer+0x82/0x1d0 [ 9536.612543][ C2] call_timer_fn+0x173/0x430 [ 9536.612774][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9536.613029][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9536.613285][ C2] __run_timers.part.0+0x52d/0x890 [ 9536.613538][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9536.613800][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9536.614078][ C2] ? lock_acquire+0x1c1/0x220 [ 9536.614310][ C2] ? clockevents_program_event+0xf6/0x300 [ 9536.614620][ C2] ? lock_release+0x1d5/0x250 [ 9536.614859][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9536.615124][ C2] ? ktime_get+0xb3/0x190 [ 9536.615343][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9536.615640][ C2] run_timer_softirq+0x72/0x100 [ 9536.615897][ C2] __do_softirq+0x1b9/0x7ff [ 9536.616122][ C2] irq_exit_rcu+0x98/0xc0 [ 9536.616339][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9536.616616][ C2] [ 9536.616762][ C2] [ 9536.616909][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9536.617206][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9536.617456][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9536.618401][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9536.618701][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9536.619089][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9536.619479][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9536.619865][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9536.620257][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9536.620647][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9536.620927][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9536.621181][ C2] default_idle_call+0x69/0xa0 [ 9536.621420][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9536.621665][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9536.621934][ C2] ? lock_release+0x1d5/0x250 [ 9536.622168][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9536.622433][ C2] do_idle+0xfb/0x160 [ 9536.622633][ C2] cpu_startup_entry+0x55/0x60 [ 9536.622869][ C2] start_secondary+0x21c/0x2b0 [ 9536.623106][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9536.623369][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9536.623672][ C2] [ 9536.623826][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6690s! [perl:4135] [ 9536.624228][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9536.625488][ C1] irq event stamp: 209232 [ 9536.625707][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9536.626231][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9536.626698][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9536.627157][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9536.627606][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9536.628042][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9536.628640][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9536.628958][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9536.629904][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9536.630205][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9536.630595][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9536.630984][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9536.631373][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9536.631763][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9536.632153][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9536.632590][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9536.632914][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9536.633304][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9536.633697][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9536.634090][ C1] PKRU: 55555554 [ 9536.634270][ C1] Call Trace: [ 9536.634435][ C1] [ 9536.634601][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9536.634863][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9536.635107][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9536.635385][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9536.635657][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9536.635953][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9536.636212][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9536.636510][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9536.636766][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9536.637066][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9536.637356][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9536.637661][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9536.637944][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9536.638233][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9536.638514][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9536.638817][ C1] ? get_stack_info+0x36/0xc0 [ 9536.639051][ C1] ? lock_acquire+0x1c1/0x220 [ 9536.639286][ C1] ? lock_release+0x1d5/0x250 [ 9536.639521][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9536.639762][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9536.640028][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9536.640306][ C1] ? lock_acquire+0x1c1/0x220 [ 9536.640539][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9536.640774][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9536.641027][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9536.641256][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9536.641498][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9536.641748][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9536.642017][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9536.642288][ C1] ip_local_deliver+0x19d/0x480 [ 9536.642529][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9536.642793][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9536.643049][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9536.643389][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9536.643635][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9536.643947][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9536.644203][ C1] ip_rcv+0x564/0x740 [ 9536.644404][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9536.644649][ C1] ? set_track_prepare+0x8a/0xd0 [ 9536.644901][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9536.645179][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9536.645452][ C1] ? skb_clone+0x10b/0x330 [ 9536.645677][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9536.646000][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9536.646300][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9536.646571][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9536.646860][ C1] ? __tcf_classify+0x329/0x7d0 [ 9536.647101][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9536.647325][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9536.647618][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9536.647896][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9536.648216][ C1] ? lock_acquire+0x1c1/0x220 [ 9536.648448][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9536.648738][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9536.649014][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9536.649324][ C1] ? __copy_skb_header+0xaf/0x490 [ 9536.649579][ C1] ? __skb_clone+0x57a/0x760 [ 9536.649808][ C1] netif_receive_skb+0x55/0x280 [ 9536.650050][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9536.650355][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9536.650678][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9536.650968][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9536.651239][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9536.651519][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9536.651823][ C1] ? hlock_class+0x4e/0x130 [ 9536.652048][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9536.652319][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9536.652587][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9536.652843][ C1] ? hlock_class+0x4e/0x130 [ 9536.653069][ C1] ? mark_lock+0x38/0x3e0 [ 9536.653283][ C1] ? stack_access_ok+0xda/0x1f0 [ 9536.653525][ C1] ? __lock_acquire+0xb67/0x1610 [ 9536.653772][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9536.654040][ C1] ? get_stack_info+0x36/0xc0 [ 9536.654275][ C1] ? stack_access_ok+0xda/0x1f0 [ 9536.654515][ C1] ? get_reg+0x119/0x190 [ 9536.654750][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9536.655018][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9536.655328][ C1] __tcf_classify+0x329/0x7d0 [ 9536.655569][ C1] tcf_classify+0x283/0x930 [ 9536.655812][ C1] ? arch_stack_walk+0xa2/0x100 [ 9536.656054][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9536.656305][ C1] ? get_stack_info+0x36/0xc0 [ 9536.656538][ C1] tc_run+0x2e4/0x5d0 [ 9536.656738][ C1] ? __pfx_tc_run+0x10/0x10 [ 9536.656961][ C1] ? lock_acquire+0x1c1/0x220 [ 9536.657195][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9536.657450][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9536.657697][ C1] ? lock_acquire+0x1c1/0x220 [ 9536.657929][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9536.658187][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9536.658485][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9536.658750][ C1] ? neigh_hh_output+0x348/0x590 [ 9536.658996][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9536.659255][ C1] ip_finish_output2+0x786/0x18e0 [ 9536.659504][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9536.659773][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9536.660103][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9536.660374][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9536.660621][ C1] ? __ip_finish_output+0x10f/0x770 [ 9536.660879][ C1] ip_output+0x16b/0x4f0 [ 9536.661089][ C1] ? run_timer_softirq+0x72/0x100 [ 9536.661339][ C1] ? __pfx_ip_output+0x10/0x10 [ 9536.661576][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9536.661858][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9536.662102][ C1] ? ip_local_out+0x114/0x3b0 [ 9536.662338][ C1] __ip_queue_xmit+0x672/0x1910 [ 9536.662579][ C1] ? __create_object+0x5e/0xb0 [ 9536.662817][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9536.663077][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9536.663351][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9536.663619][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9536.663892][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9536.664156][ C1] tcp_delack_timer+0x84/0x240 [ 9536.664394][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9536.664681][ C1] call_timer_fn+0x173/0x430 [ 9536.664918][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9536.665181][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9536.665442][ C1] __run_timers.part.0+0x52d/0x890 [ 9536.665701][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9536.665978][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9536.666258][ C1] ? lock_acquire+0x1c1/0x220 [ 9536.666490][ C1] ? clockevents_program_event+0xf6/0x300 [ 9536.666771][ C1] ? lock_release+0x1d5/0x250 [ 9536.667005][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9536.667263][ C1] ? ktime_get+0xb3/0x190 [ 9536.667477][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9536.667767][ C1] run_timer_softirq+0x72/0x100 [ 9536.668009][ C1] __do_softirq+0x1b9/0x7ff [ 9536.668237][ C1] irq_exit_rcu+0x98/0xc0 [ 9536.668452][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9536.668729][ C1] [ 9536.668878][ C1] [ 9536.669023][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9536.669321][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9536.669637][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9536.670584][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9536.670884][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9536.671273][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9536.671660][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9536.672051][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9536.672441][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9536.672830][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9536.673120][ C1] pipe_read+0xa16/0xdf0 [ 9536.673334][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9536.673604][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9536.673841][ C1] ? iterate_tty_write+0x299/0x540 [ 9536.674095][ C1] ? lock_release+0x1d5/0x250 [ 9536.674332][ C1] vfs_read+0x911/0xc00 [ 9536.674540][ C1] ? lock_acquire+0x1c1/0x220 [ 9536.674798][ C1] ? __might_fault+0xc6/0x180 [ 9536.675038][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9536.675279][ C1] ? __might_fault+0xc6/0x180 [ 9536.675516][ C1] ? lock_release+0x1d5/0x250 [ 9536.675756][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9536.676024][ C1] ? __fget_light+0x54/0x1e0 [ 9536.676255][ C1] ksys_read+0x17a/0x1e0 [ 9536.676465][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9536.676703][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9536.676999][ C1] do_syscall_64+0xc9/0x1e0 [ 9536.677226][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9536.677517][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9536.677742][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9536.678686][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9536.679095][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9536.679484][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9536.679871][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9536.680260][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9536.680647][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9536.681040][ C1] [ 9562.284104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9562.284460][ C1] rcu: 1-....: (7189297 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1705186 [ 9562.285007][ C1] rcu: (t=7207397 jiffies g=1882453 q=724 ncpus=4) [ 9562.285333][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9562.285770][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9562.286367][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9562.286684][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9562.287632][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9562.287931][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9562.288321][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9562.288710][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9562.289098][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9562.289487][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9562.289877][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9562.290313][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9562.290640][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9562.291030][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9562.291419][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9562.291808][ C1] PKRU: 55555554 [ 9562.291985][ C1] Call Trace: [ 9562.292150][ C1] [ 9562.292295][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9562.292562][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9562.292808][ C1] ? check_cpu_stall+0x284/0x500 [ 9562.293053][ C1] ? rcu_pending+0x92/0x360 [ 9562.293278][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9562.293541][ C1] ? update_process_times+0xb9/0x110 [ 9562.293804][ C1] ? tick_sched_handle+0x67/0x130 [ 9562.294054][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9562.294333][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9562.294592][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9562.294904][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9562.295177][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9562.295463][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9562.295739][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9562.296037][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9562.296293][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9562.296595][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9562.296886][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9562.297193][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9562.297474][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9562.297763][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9562.298042][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9562.298347][ C1] ? get_stack_info+0x36/0xc0 [ 9562.298582][ C1] ? lock_acquire+0x1c1/0x220 [ 9562.298817][ C1] ? lock_release+0x1d5/0x250 [ 9562.299048][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9562.299291][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9562.299558][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9562.299835][ C1] ? lock_acquire+0x1c1/0x220 [ 9562.300068][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9562.300303][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9562.300556][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9562.300784][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9562.301025][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9562.301277][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9562.301544][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9562.301815][ C1] ip_local_deliver+0x19d/0x480 [ 9562.302055][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9562.302324][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9562.302581][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9562.302920][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9562.303167][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9562.303480][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9562.303737][ C1] ip_rcv+0x564/0x740 [ 9562.303935][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9562.304162][ C1] ? set_track_prepare+0x8a/0xd0 [ 9562.304412][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9562.304705][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9562.304977][ C1] ? skb_clone+0x10b/0x330 [ 9562.305207][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9562.305527][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9562.305841][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9562.306114][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9562.306403][ C1] ? __tcf_classify+0x329/0x7d0 [ 9562.306645][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9562.306871][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9562.307164][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9562.307441][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9562.307759][ C1] ? lock_acquire+0x1c1/0x220 [ 9562.307993][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9562.308284][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9562.308563][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9562.308872][ C1] ? __copy_skb_header+0xaf/0x490 [ 9562.309124][ C1] ? __skb_clone+0x57a/0x760 [ 9562.309355][ C1] netif_receive_skb+0x55/0x280 [ 9562.309598][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9562.309901][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9562.310229][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9562.310521][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9562.310787][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9562.311071][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9562.311377][ C1] ? hlock_class+0x4e/0x130 [ 9562.311604][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9562.311874][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9562.312144][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9562.312402][ C1] ? hlock_class+0x4e/0x130 [ 9562.312629][ C1] ? mark_lock+0x38/0x3e0 [ 9562.312843][ C1] ? stack_access_ok+0xda/0x1f0 [ 9562.313086][ C1] ? __lock_acquire+0xb67/0x1610 [ 9562.313335][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9562.313604][ C1] ? get_stack_info+0x36/0xc0 [ 9562.313838][ C1] ? stack_access_ok+0xda/0x1f0 [ 9562.314080][ C1] ? get_reg+0x119/0x190 [ 9562.314291][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9562.314574][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9562.314884][ C1] __tcf_classify+0x329/0x7d0 [ 9562.315128][ C1] tcf_classify+0x283/0x930 [ 9562.315360][ C1] ? arch_stack_walk+0xa2/0x100 [ 9562.315609][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9562.315871][ C1] ? get_stack_info+0x36/0xc0 [ 9562.316108][ C1] tc_run+0x2e4/0x5d0 [ 9562.316308][ C1] ? __pfx_tc_run+0x10/0x10 [ 9562.316537][ C1] ? lock_acquire+0x1c1/0x220 [ 9562.316771][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9562.317026][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9562.317275][ C1] ? lock_acquire+0x1c1/0x220 [ 9562.317507][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9562.317767][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9562.318063][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9562.318333][ C1] ? neigh_hh_output+0x348/0x590 [ 9562.318579][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9562.318839][ C1] ip_finish_output2+0x786/0x18e0 [ 9562.319090][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9562.319362][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9562.319692][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9562.319961][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9562.320209][ C1] ? __ip_finish_output+0x10f/0x770 [ 9562.320469][ C1] ip_output+0x16b/0x4f0 [ 9562.320681][ C1] ? run_timer_softirq+0x72/0x100 [ 9562.320932][ C1] ? __pfx_ip_output+0x10/0x10 [ 9562.321171][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9562.321450][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9562.321696][ C1] ? ip_local_out+0x114/0x3b0 [ 9562.321932][ C1] __ip_queue_xmit+0x672/0x1910 [ 9562.322175][ C1] ? __create_object+0x5e/0xb0 [ 9562.322414][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9562.322676][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9562.322950][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9562.323217][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9562.323494][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9562.323758][ C1] tcp_delack_timer+0x84/0x240 [ 9562.323997][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9562.324263][ C1] call_timer_fn+0x173/0x430 [ 9562.324517][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9562.324780][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9562.325043][ C1] __run_timers.part.0+0x52d/0x890 [ 9562.325306][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9562.325580][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9562.325872][ C1] ? lock_acquire+0x1c1/0x220 [ 9562.326104][ C1] ? clockevents_program_event+0xf6/0x300 [ 9562.326390][ C1] ? lock_release+0x1d5/0x250 [ 9562.326623][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9562.326883][ C1] ? ktime_get+0xb3/0x190 [ 9562.327098][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9562.327389][ C1] run_timer_softirq+0x72/0x100 [ 9562.327633][ C1] __do_softirq+0x1b9/0x7ff [ 9562.327859][ C1] irq_exit_rcu+0x98/0xc0 [ 9562.328075][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9562.328355][ C1] [ 9562.328502][ C1] [ 9562.328649][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9562.328947][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9562.329266][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9562.330217][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9562.330519][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9562.330910][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9562.331300][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9562.331688][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9562.332080][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9562.332475][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9562.332764][ C1] pipe_read+0xa16/0xdf0 [ 9562.332981][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9562.333253][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9562.333492][ C1] ? iterate_tty_write+0x299/0x540 [ 9562.333748][ C1] ? lock_release+0x1d5/0x250 [ 9562.333985][ C1] vfs_read+0x911/0xc00 [ 9562.334194][ C1] ? lock_acquire+0x1c1/0x220 [ 9562.334429][ C1] ? __might_fault+0xc6/0x180 [ 9562.334690][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9562.334929][ C1] ? __might_fault+0xc6/0x180 [ 9562.335171][ C1] ? lock_release+0x1d5/0x250 [ 9562.335413][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9562.335689][ C1] ? __fget_light+0x54/0x1e0 [ 9562.335921][ C1] ksys_read+0x17a/0x1e0 [ 9562.336153][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9562.336401][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9562.336706][ C1] do_syscall_64+0xc9/0x1e0 [ 9562.336938][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9562.337250][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9562.337474][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9562.338426][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9562.338837][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9562.339227][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9562.339618][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9562.340008][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9562.340397][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9562.340789][ C1] [ 9562.340945][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9562.341211][ C2] NMI backtrace for cpu 2 [ 9562.341217][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9562.341223][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9562.341226][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9562.341235][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9562.341240][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9562.341245][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9562.341249][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9562.341253][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9562.341256][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9562.341260][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9562.341265][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9562.341269][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9562.341274][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9562.341278][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9562.341281][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9562.341285][ C2] PKRU: 55555554 [ 9562.341287][ C2] Call Trace: [ 9562.341289][ C2] [ 9562.341292][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9562.341304][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9562.341311][ C2] ? nmi_handle+0x153/0x420 [ 9562.341315][ C2] ? default_do_nmi+0x41/0x100 [ 9562.341318][ C2] ? exc_nmi+0xf3/0x120 [ 9562.341321][ C2] ? end_repeat_nmi+0xf/0x60 [ 9562.341326][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9562.341330][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9562.341333][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9562.341336][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9562.341339][ C2] [ 9562.341340][ C2] [ 9562.341341][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9562.341344][ C2] ? get_stack_info+0x36/0xc0 [ 9562.341348][ C2] ? lock_acquire+0x1c1/0x220 [ 9562.341352][ C2] ? lock_release+0x1d5/0x250 [ 9562.341355][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9562.341358][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9562.341361][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9562.341364][ C2] ? lock_acquire+0x1c1/0x220 [ 9562.341366][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9562.341370][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9562.341373][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9562.341379][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9562.341381][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9562.341385][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9562.341390][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9562.341394][ C2] ip_local_deliver+0x19d/0x480 [ 9562.341396][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9562.341398][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9562.341401][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9562.341406][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9562.341410][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9562.341413][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9562.341422][ C2] ip_rcv+0x564/0x740 [ 9562.341425][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9562.341427][ C2] ? set_track_prepare+0x8a/0xd0 [ 9562.341431][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9562.341434][ C2] ? start_secondary+0x21c/0x2b0 [ 9562.341437][ C2] ? skb_clone+0x10b/0x330 [ 9562.341440][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9562.341446][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9562.341451][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9562.341454][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9562.341462][ C2] ? __tcf_classify+0x329/0x7d0 [ 9562.341465][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9562.341468][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9562.341471][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9562.341474][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9562.341478][ C2] ? lock_acquire+0x1c1/0x220 [ 9562.341481][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9562.341485][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9562.341488][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9562.341492][ C2] ? __copy_skb_header+0xaf/0x490 [ 9562.341497][ C2] ? __skb_clone+0x57a/0x760 [ 9562.341499][ C2] netif_receive_skb+0x55/0x280 [ 9562.341502][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9562.341509][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9562.341515][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9562.341521][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9562.341526][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9562.341535][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9562.341543][ C2] ? get_stack_info+0x36/0xc0 [ 9562.341547][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9562.341550][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9562.341554][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9562.341556][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9562.341560][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9562.341563][ C2] ? kernel_text_address+0x17/0xe0 [ 9562.341566][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9562.341570][ C2] ? arch_stack_walk+0x8c/0x100 [ 9562.341573][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9562.341576][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9562.341579][ C2] ? lock_acquire+0x1c1/0x220 [ 9562.341582][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9562.341585][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9562.341590][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9562.341592][ C2] ? get_stack_info+0x36/0xc0 [ 9562.341597][ C2] __tcf_classify+0x329/0x7d0 [ 9562.341602][ C2] tcf_classify+0x283/0x930 [ 9562.341606][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9562.341609][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9562.341613][ C2] tc_run+0x2e4/0x5d0 [ 9562.341617][ C2] ? __pfx_tc_run+0x10/0x10 [ 9562.341620][ C2] ? lock_acquire+0x1c1/0x220 [ 9562.341622][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9562.341627][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9562.341631][ C2] ? lock_acquire+0x1c1/0x220 [ 9562.341633][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9562.341637][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9562.341640][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9562.341643][ C2] ? neigh_hh_output+0x348/0x590 [ 9562.341646][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9562.341650][ C2] ip_finish_output2+0x786/0x18e0 [ 9562.341653][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9562.341661][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9562.341664][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9562.341668][ C2] ? __ip_finish_output+0x10f/0x770 [ 9562.341671][ C2] ip_output+0x16b/0x4f0 [ 9562.341674][ C2] ? __pfx_ip_output+0x10/0x10 [ 9562.341677][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9562.341679][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9562.341683][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9562.341685][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9562.341687][ C2] ? __alloc_skb+0xd4/0x280 [ 9562.341690][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9562.341693][ C2] ? tcp_fragment+0x168/0x1040 [ 9562.341696][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9562.341699][ C2] ? ip_local_out+0x114/0x3b0 [ 9562.341702][ C2] __ip_queue_xmit+0x672/0x1910 [ 9562.341706][ C2] ? __skb_clone+0x57a/0x760 [ 9562.341709][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9562.341714][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9562.341717][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9562.341720][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9562.341724][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9562.341728][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9562.341731][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9562.341734][ C2] tcp_send_loss_probe+0x348/0x830 [ 9562.341737][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9562.341740][ C2] tcp_write_timer+0x82/0x1d0 [ 9562.341743][ C2] call_timer_fn+0x173/0x430 [ 9562.341746][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9562.341751][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9562.341755][ C2] __run_timers.part.0+0x52d/0x890 [ 9562.341758][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9562.341762][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9562.341765][ C2] ? lock_acquire+0x1c1/0x220 [ 9562.341767][ C2] ? clockevents_program_event+0xf6/0x300 [ 9562.341771][ C2] ? lock_release+0x1d5/0x250 [ 9562.341774][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9562.341777][ C2] ? ktime_get+0xb3/0x190 [ 9562.341781][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9562.341785][ C2] run_timer_softirq+0x72/0x100 [ 9562.341789][ C2] __do_softirq+0x1b9/0x7ff [ 9562.341793][ C2] irq_exit_rcu+0x98/0xc0 [ 9562.341796][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9562.341799][ C2] [ 9562.341799][ C2] [ 9562.341801][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9562.341804][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9562.341807][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9562.341809][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9562.341810][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9562.341812][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9562.341813][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9562.341814][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9562.341816][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9562.341819][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9562.341821][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9562.341824][ C2] default_idle_call+0x69/0xa0 [ 9562.341827][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9562.341829][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9562.341833][ C2] ? lock_release+0x1d5/0x250 [ 9562.341835][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9562.341839][ C2] do_idle+0xfb/0x160 [ 9562.341841][ C2] cpu_startup_entry+0x55/0x60 [ 9562.341843][ C2] start_secondary+0x21c/0x2b0 [ 9562.341846][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9562.341850][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9562.341855][ C2] [ 9588.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6739s! [swapper/2:0] [ 9588.569676][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9588.570894][ C2] irq event stamp: 44114564 [ 9588.571115][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9588.571636][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9588.572131][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9588.572591][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9588.573043][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9588.573487][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9588.574080][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9588.574397][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9588.575337][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9588.575635][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9588.576019][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9588.576408][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9588.576794][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9588.577180][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9588.577565][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9588.577995][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9588.578319][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9588.578709][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9588.579094][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9588.579480][ C2] PKRU: 55555554 [ 9588.579655][ C2] Call Trace: [ 9588.579821][ C2] [ 9588.579963][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9588.580225][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9588.580461][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9588.580729][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9588.580994][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9588.581273][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9588.581529][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9588.581826][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9588.582079][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9588.582334][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9588.582633][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9588.582920][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9588.583226][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9588.583507][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9588.583792][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9588.584071][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9588.584395][ C2] ? get_stack_info+0x36/0xc0 [ 9588.584636][ C2] ? lock_acquire+0x1c1/0x220 [ 9588.584876][ C2] ? lock_release+0x1d5/0x250 [ 9588.585113][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9588.585361][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9588.585640][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9588.585916][ C2] ? lock_acquire+0x1c1/0x220 [ 9588.586147][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9588.586380][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9588.586633][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9588.586860][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9588.587099][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9588.587349][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9588.587615][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9588.587883][ C2] ip_local_deliver+0x19d/0x480 [ 9588.588121][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9588.588387][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9588.588642][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9588.588977][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9588.589222][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9588.589531][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9588.589787][ C2] ip_rcv+0x564/0x740 [ 9588.589982][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9588.590209][ C2] ? set_track_prepare+0x8a/0xd0 [ 9588.590454][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9588.590720][ C2] ? start_secondary+0x21c/0x2b0 [ 9588.590963][ C2] ? skb_clone+0x10b/0x330 [ 9588.591184][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9588.591493][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9588.591788][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9588.592062][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9588.592347][ C2] ? __tcf_classify+0x329/0x7d0 [ 9588.592587][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9588.592812][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9588.593101][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9588.593379][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9588.593694][ C2] ? lock_acquire+0x1c1/0x220 [ 9588.593924][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9588.594213][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9588.594517][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9588.594831][ C2] ? __copy_skb_header+0xaf/0x490 [ 9588.595086][ C2] ? __skb_clone+0x57a/0x760 [ 9588.595319][ C2] netif_receive_skb+0x55/0x280 [ 9588.595575][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9588.595878][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9588.596199][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9588.596490][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9588.596755][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9588.597034][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9588.597336][ C2] ? get_stack_info+0x36/0xc0 [ 9588.597570][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9588.597825][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9588.598131][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9588.598399][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9588.598669][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9588.598972][ C2] ? kernel_text_address+0x17/0xe0 [ 9588.599225][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9588.599528][ C2] ? arch_stack_walk+0x8c/0x100 [ 9588.599767][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9588.600024][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9588.600300][ C2] ? lock_acquire+0x1c1/0x220 [ 9588.600531][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9588.600802][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9588.601098][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9588.601365][ C2] ? get_stack_info+0x36/0xc0 [ 9588.601600][ C2] __tcf_classify+0x329/0x7d0 [ 9588.601834][ C2] tcf_classify+0x283/0x930 [ 9588.602057][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9588.602307][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9588.602610][ C2] tc_run+0x2e4/0x5d0 [ 9588.602809][ C2] ? __pfx_tc_run+0x10/0x10 [ 9588.603032][ C2] ? lock_acquire+0x1c1/0x220 [ 9588.603265][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9588.603517][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9588.603762][ C2] ? lock_acquire+0x1c1/0x220 [ 9588.603996][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9588.604253][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9588.604573][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9588.604845][ C2] ? neigh_hh_output+0x348/0x590 [ 9588.605096][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9588.605362][ C2] ip_finish_output2+0x786/0x18e0 [ 9588.605626][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9588.605953][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9588.606220][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9588.606466][ C2] ? __ip_finish_output+0x10f/0x770 [ 9588.606720][ C2] ip_output+0x16b/0x4f0 [ 9588.606931][ C2] ? __pfx_ip_output+0x10/0x10 [ 9588.607166][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9588.607436][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9588.607738][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9588.608005][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9588.608250][ C2] ? __alloc_skb+0xd4/0x280 [ 9588.608473][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9588.608734][ C2] ? tcp_fragment+0x168/0x1040 [ 9588.608970][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9588.609213][ C2] ? ip_local_out+0x114/0x3b0 [ 9588.609444][ C2] __ip_queue_xmit+0x672/0x1910 [ 9588.609686][ C2] ? __skb_clone+0x57a/0x760 [ 9588.609915][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9588.610174][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9588.610446][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9588.610682][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9588.610924][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9588.611216][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9588.611526][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9588.611762][ C2] tcp_send_loss_probe+0x348/0x830 [ 9588.612014][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9588.612275][ C2] tcp_write_timer+0x82/0x1d0 [ 9588.612506][ C2] call_timer_fn+0x173/0x430 [ 9588.612734][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9588.612987][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9588.613240][ C2] __run_timers.part.0+0x52d/0x890 [ 9588.613493][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9588.613757][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9588.614033][ C2] ? lock_acquire+0x1c1/0x220 [ 9588.614265][ C2] ? clockevents_program_event+0xf6/0x300 [ 9588.614571][ C2] ? lock_release+0x1d5/0x250 [ 9588.614809][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9588.615072][ C2] ? ktime_get+0xb3/0x190 [ 9588.615293][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9588.615596][ C2] run_timer_softirq+0x72/0x100 [ 9588.615837][ C2] __do_softirq+0x1b9/0x7ff [ 9588.616063][ C2] irq_exit_rcu+0x98/0xc0 [ 9588.616276][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9588.616552][ C2] [ 9588.616698][ C2] [ 9588.616843][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9588.617141][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9588.617390][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9588.618330][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9588.618628][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9588.619013][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9588.619404][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9588.619790][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9588.620176][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9588.620564][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9588.620845][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9588.621097][ C2] default_idle_call+0x69/0xa0 [ 9588.621334][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9588.621580][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9588.621849][ C2] ? lock_release+0x1d5/0x250 [ 9588.622080][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9588.622346][ C2] do_idle+0xfb/0x160 [ 9588.622543][ C2] cpu_startup_entry+0x55/0x60 [ 9588.622779][ C2] start_secondary+0x21c/0x2b0 [ 9588.623015][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9588.623279][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9588.623581][ C2] [ 9588.623733][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6739s! [perl:4135] [ 9588.624135][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9588.625403][ C1] irq event stamp: 209232 [ 9588.625632][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9588.626147][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9588.626614][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9588.627073][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9588.627525][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9588.627962][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9588.628562][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9588.628879][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9588.629829][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9588.630129][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9588.630520][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9588.630911][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9588.631302][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9588.631694][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9588.632085][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9588.632522][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9588.632847][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9588.633238][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9588.633630][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9588.634019][ C1] PKRU: 55555554 [ 9588.634198][ C1] Call Trace: [ 9588.634384][ C1] [ 9588.634535][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9588.634797][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9588.635042][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9588.635321][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9588.635604][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9588.635887][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9588.636146][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9588.636446][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9588.636703][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9588.637004][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9588.637295][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9588.637602][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9588.637885][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9588.638176][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9588.638459][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9588.638763][ C1] ? get_stack_info+0x36/0xc0 [ 9588.638998][ C1] ? lock_acquire+0x1c1/0x220 [ 9588.639234][ C1] ? lock_release+0x1d5/0x250 [ 9588.639470][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9588.639713][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9588.639979][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9588.640257][ C1] ? lock_acquire+0x1c1/0x220 [ 9588.640491][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9588.640728][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9588.640984][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9588.641214][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9588.641456][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9588.641708][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9588.641977][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9588.642249][ C1] ip_local_deliver+0x19d/0x480 [ 9588.642491][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9588.642756][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9588.643012][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9588.643352][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9588.643599][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9588.643910][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9588.644166][ C1] ip_rcv+0x564/0x740 [ 9588.644390][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9588.644620][ C1] ? set_track_prepare+0x8a/0xd0 [ 9588.644874][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9588.645153][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9588.645427][ C1] ? skb_clone+0x10b/0x330 [ 9588.645661][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9588.645975][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9588.646277][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9588.646550][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9588.646839][ C1] ? __tcf_classify+0x329/0x7d0 [ 9588.647081][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9588.647305][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9588.647599][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9588.647878][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9588.648197][ C1] ? lock_acquire+0x1c1/0x220 [ 9588.648428][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9588.648718][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9588.648995][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9588.649307][ C1] ? __copy_skb_header+0xaf/0x490 [ 9588.649558][ C1] ? __skb_clone+0x57a/0x760 [ 9588.649788][ C1] netif_receive_skb+0x55/0x280 [ 9588.650030][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9588.650337][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9588.650662][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9588.650953][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9588.651222][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9588.651504][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9588.651808][ C1] ? hlock_class+0x4e/0x130 [ 9588.652035][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9588.652306][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9588.652576][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9588.652833][ C1] ? hlock_class+0x4e/0x130 [ 9588.653061][ C1] ? mark_lock+0x38/0x3e0 [ 9588.653275][ C1] ? stack_access_ok+0xda/0x1f0 [ 9588.653518][ C1] ? __lock_acquire+0xb67/0x1610 [ 9588.653766][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9588.654036][ C1] ? get_stack_info+0x36/0xc0 [ 9588.654272][ C1] ? stack_access_ok+0xda/0x1f0 [ 9588.654538][ C1] ? get_reg+0x119/0x190 [ 9588.654755][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9588.655024][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9588.655336][ C1] __tcf_classify+0x329/0x7d0 [ 9588.655587][ C1] tcf_classify+0x283/0x930 [ 9588.655815][ C1] ? arch_stack_walk+0xa2/0x100 [ 9588.656058][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9588.656310][ C1] ? get_stack_info+0x36/0xc0 [ 9588.656544][ C1] tc_run+0x2e4/0x5d0 [ 9588.656746][ C1] ? __pfx_tc_run+0x10/0x10 [ 9588.656970][ C1] ? lock_acquire+0x1c1/0x220 [ 9588.657205][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9588.657459][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9588.657706][ C1] ? lock_acquire+0x1c1/0x220 [ 9588.657939][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9588.658198][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9588.658497][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9588.658762][ C1] ? neigh_hh_output+0x348/0x590 [ 9588.659009][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9588.659269][ C1] ip_finish_output2+0x786/0x18e0 [ 9588.659518][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9588.659789][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9588.660118][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9588.660391][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9588.660638][ C1] ? __ip_finish_output+0x10f/0x770 [ 9588.660897][ C1] ip_output+0x16b/0x4f0 [ 9588.661107][ C1] ? run_timer_softirq+0x72/0x100 [ 9588.661358][ C1] ? __pfx_ip_output+0x10/0x10 [ 9588.661595][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9588.661874][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9588.662119][ C1] ? ip_local_out+0x114/0x3b0 [ 9588.662356][ C1] __ip_queue_xmit+0x672/0x1910 [ 9588.662599][ C1] ? __create_object+0x5e/0xb0 [ 9588.662838][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9588.663098][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9588.663374][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9588.663642][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9588.663915][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9588.664181][ C1] tcp_delack_timer+0x84/0x240 [ 9588.664449][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9588.664721][ C1] call_timer_fn+0x173/0x430 [ 9588.664960][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9588.665225][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9588.665488][ C1] __run_timers.part.0+0x52d/0x890 [ 9588.665754][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9588.666020][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9588.666303][ C1] ? lock_acquire+0x1c1/0x220 [ 9588.666536][ C1] ? clockevents_program_event+0xf6/0x300 [ 9588.666819][ C1] ? lock_release+0x1d5/0x250 [ 9588.667054][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9588.667314][ C1] ? ktime_get+0xb3/0x190 [ 9588.667529][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9588.667822][ C1] run_timer_softirq+0x72/0x100 [ 9588.668064][ C1] __do_softirq+0x1b9/0x7ff [ 9588.668293][ C1] irq_exit_rcu+0x98/0xc0 [ 9588.668510][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9588.668788][ C1] [ 9588.668938][ C1] [ 9588.669084][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9588.669384][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9588.669705][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9588.670656][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9588.670959][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9588.671351][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9588.671743][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9588.672136][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9588.672527][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9588.672919][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9588.673211][ C1] pipe_read+0xa16/0xdf0 [ 9588.673426][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9588.673698][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9588.673935][ C1] ? iterate_tty_write+0x299/0x540 [ 9588.674191][ C1] ? lock_release+0x1d5/0x250 [ 9588.674452][ C1] vfs_read+0x911/0xc00 [ 9588.674666][ C1] ? lock_acquire+0x1c1/0x220 [ 9588.674907][ C1] ? __might_fault+0xc6/0x180 [ 9588.675150][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9588.675391][ C1] ? __might_fault+0xc6/0x180 [ 9588.675638][ C1] ? lock_release+0x1d5/0x250 [ 9588.675873][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9588.676131][ C1] ? __fget_light+0x54/0x1e0 [ 9588.676366][ C1] ksys_read+0x17a/0x1e0 [ 9588.676577][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9588.676818][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9588.677115][ C1] do_syscall_64+0xc9/0x1e0 [ 9588.677344][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9588.677636][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9588.677859][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9588.678810][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9588.679222][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9588.679613][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9588.680004][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9588.680394][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9588.680785][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9588.681180][ C1] [ 9616.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6765s! [swapper/2:0] [ 9616.569690][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9616.570903][ C2] irq event stamp: 44114564 [ 9616.571124][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9616.571640][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9616.572135][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9616.572599][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9616.573051][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9616.573491][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9616.574082][ C2] RIP: 0010:kasan_check_range+0x69/0x1c0 [ 9616.574363][ C2] Code: 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 <48> c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 [ 9616.575302][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000216 [ 9616.575599][ C2] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9616.575983][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9616.576370][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffff88800a3a1b5b [ 9616.576755][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9616.577139][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9616.577525][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9616.577957][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9616.578280][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9616.578666][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9616.579049][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9616.579437][ C2] PKRU: 55555554 [ 9616.579610][ C2] Call Trace: [ 9616.579775][ C2] [ 9616.579917][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9616.580172][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9616.580407][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9616.580680][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9616.580943][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9616.581225][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9616.581482][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9616.581778][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9616.582030][ C2] ? hrtimer_interrupt+0x31a/0x770 [ 9616.582283][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9616.582534][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9616.582834][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9616.583120][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9616.583426][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9616.583703][ C2] ? kasan_check_range+0x69/0x1c0 [ 9616.583951][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 9616.584243][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9616.584551][ C2] ? get_stack_info+0x36/0xc0 [ 9616.584790][ C2] ? lock_acquire+0x1c1/0x220 [ 9616.585031][ C2] ? lock_release+0x1d5/0x250 [ 9616.585273][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9616.585527][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9616.585791][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9616.586065][ C2] ? lock_acquire+0x1c1/0x220 [ 9616.586299][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9616.586533][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9616.586785][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9616.587011][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9616.587253][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9616.587501][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9616.587769][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9616.588038][ C2] ip_local_deliver+0x19d/0x480 [ 9616.588279][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9616.588541][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9616.588799][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9616.589137][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9616.589384][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9616.589694][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9616.589948][ C2] ip_rcv+0x564/0x740 [ 9616.590147][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9616.590369][ C2] ? set_track_prepare+0x8a/0xd0 [ 9616.590614][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9616.590881][ C2] ? start_secondary+0x21c/0x2b0 [ 9616.591124][ C2] ? skb_clone+0x10b/0x330 [ 9616.591346][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9616.591655][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9616.591951][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9616.592223][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9616.592509][ C2] ? __tcf_classify+0x329/0x7d0 [ 9616.592748][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9616.592971][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9616.593263][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9616.593537][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9616.593850][ C2] ? lock_acquire+0x1c1/0x220 [ 9616.594082][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9616.594395][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9616.594676][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9616.594990][ C2] ? __copy_skb_header+0xaf/0x490 [ 9616.595247][ C2] ? __skb_clone+0x57a/0x760 [ 9616.595490][ C2] netif_receive_skb+0x55/0x280 [ 9616.595732][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9616.596034][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9616.596358][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9616.596648][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9616.596912][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9616.597193][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9616.597495][ C2] ? get_stack_info+0x36/0xc0 [ 9616.597727][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9616.597984][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9616.598291][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9616.598561][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9616.598828][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9616.599132][ C2] ? kernel_text_address+0x17/0xe0 [ 9616.599385][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9616.599688][ C2] ? arch_stack_walk+0x8c/0x100 [ 9616.599929][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9616.600185][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9616.600460][ C2] ? lock_acquire+0x1c1/0x220 [ 9616.600691][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9616.600964][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9616.601260][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9616.601527][ C2] ? get_stack_info+0x36/0xc0 [ 9616.601759][ C2] __tcf_classify+0x329/0x7d0 [ 9616.601994][ C2] tcf_classify+0x283/0x930 [ 9616.602222][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9616.602469][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9616.602772][ C2] tc_run+0x2e4/0x5d0 [ 9616.602972][ C2] ? __pfx_tc_run+0x10/0x10 [ 9616.603194][ C2] ? lock_acquire+0x1c1/0x220 [ 9616.603428][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9616.603679][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9616.603923][ C2] ? lock_acquire+0x1c1/0x220 [ 9616.604155][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9616.604437][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9616.604739][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9616.605008][ C2] ? neigh_hh_output+0x348/0x590 [ 9616.605260][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9616.605531][ C2] ip_finish_output2+0x786/0x18e0 [ 9616.605779][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9616.606104][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9616.606372][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9616.606616][ C2] ? __ip_finish_output+0x10f/0x770 [ 9616.606873][ C2] ip_output+0x16b/0x4f0 [ 9616.607082][ C2] ? __pfx_ip_output+0x10/0x10 [ 9616.607319][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9616.607585][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9616.607887][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9616.608153][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9616.608397][ C2] ? __alloc_skb+0xd4/0x280 [ 9616.608621][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9616.608882][ C2] ? tcp_fragment+0x168/0x1040 [ 9616.609118][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9616.609363][ C2] ? ip_local_out+0x114/0x3b0 [ 9616.609595][ C2] __ip_queue_xmit+0x672/0x1910 [ 9616.609834][ C2] ? __skb_clone+0x57a/0x760 [ 9616.610062][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9616.610321][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9616.610593][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9616.610828][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9616.611070][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9616.611363][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9616.611672][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9616.611909][ C2] tcp_send_loss_probe+0x348/0x830 [ 9616.612161][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9616.612421][ C2] tcp_write_timer+0x82/0x1d0 [ 9616.612654][ C2] call_timer_fn+0x173/0x430 [ 9616.612881][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9616.613134][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9616.613388][ C2] __run_timers.part.0+0x52d/0x890 [ 9616.613639][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9616.613900][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9616.614174][ C2] ? lock_acquire+0x1c1/0x220 [ 9616.614431][ C2] ? clockevents_program_event+0xf6/0x300 [ 9616.614719][ C2] ? lock_release+0x1d5/0x250 [ 9616.614955][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9616.615218][ C2] ? ktime_get+0xb3/0x190 [ 9616.615450][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9616.615735][ C2] run_timer_softirq+0x72/0x100 [ 9616.615973][ C2] __do_softirq+0x1b9/0x7ff [ 9616.616201][ C2] irq_exit_rcu+0x98/0xc0 [ 9616.616413][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9616.616691][ C2] [ 9616.616835][ C2] [ 9616.616981][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9616.617275][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9616.617522][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9616.618463][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9616.618760][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9616.619148][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9616.619535][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9616.619920][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9616.620307][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9616.620695][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9616.620975][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9616.621228][ C2] default_idle_call+0x69/0xa0 [ 9616.621464][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9616.621707][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9616.621974][ C2] ? lock_release+0x1d5/0x250 [ 9616.622207][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9616.622470][ C2] do_idle+0xfb/0x160 [ 9616.622666][ C2] cpu_startup_entry+0x55/0x60 [ 9616.622903][ C2] start_secondary+0x21c/0x2b0 [ 9616.623139][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9616.623399][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9616.623701][ C2] [ 9616.623853][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6765s! [perl:4135] [ 9616.624285][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9616.625551][ C1] irq event stamp: 209232 [ 9616.625762][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9616.626277][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9616.626746][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9616.627204][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9616.627654][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9616.628091][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9616.628691][ C1] RIP: 0010:kasan_check_range+0x161/0x1c0 [ 9616.628974][ C1] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [ 9616.629924][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000282 [ 9616.630225][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [ 9616.630616][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9616.631007][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [ 9616.631400][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9616.631788][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9616.632182][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9616.632620][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9616.632945][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9616.633336][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9616.633725][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9616.634116][ C1] PKRU: 55555554 [ 9616.634317][ C1] Call Trace: [ 9616.634486][ C1] [ 9616.634635][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9616.634898][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9616.635142][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9616.635434][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9616.635700][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9616.635982][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9616.636244][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9616.636540][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9616.636792][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 9616.637048][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9616.637349][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9616.637639][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9616.637946][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9616.638229][ C1] ? kasan_check_range+0x161/0x1c0 [ 9616.638483][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9616.638760][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9616.639063][ C1] ? get_stack_info+0x36/0xc0 [ 9616.639297][ C1] ? lock_acquire+0x1c1/0x220 [ 9616.639533][ C1] ? lock_release+0x1d5/0x250 [ 9616.639768][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9616.640011][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9616.640277][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9616.640553][ C1] ? lock_acquire+0x1c1/0x220 [ 9616.640786][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9616.641021][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9616.641275][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9616.641504][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9616.641744][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9616.641995][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9616.642265][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9616.642535][ C1] ip_local_deliver+0x19d/0x480 [ 9616.642776][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9616.643040][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9616.643298][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9616.643637][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9616.643883][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9616.644200][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9616.644479][ C1] ip_rcv+0x564/0x740 [ 9616.644683][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9616.644914][ C1] ? set_track_prepare+0x8a/0xd0 [ 9616.645167][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9616.645458][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9616.645723][ C1] ? skb_clone+0x10b/0x330 [ 9616.645944][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9616.646257][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9616.646555][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9616.646829][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9616.647115][ C1] ? __tcf_classify+0x329/0x7d0 [ 9616.647360][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9616.647585][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9616.647877][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9616.648156][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9616.648475][ C1] ? lock_acquire+0x1c1/0x220 [ 9616.648707][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9616.648994][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9616.649275][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9616.649584][ C1] ? __copy_skb_header+0xaf/0x490 [ 9616.649834][ C1] ? __skb_clone+0x57a/0x760 [ 9616.650062][ C1] netif_receive_skb+0x55/0x280 [ 9616.650305][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9616.650610][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9616.650934][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9616.651228][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9616.651494][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9616.651774][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9616.652079][ C1] ? hlock_class+0x4e/0x130 [ 9616.652308][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9616.652577][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9616.652846][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9616.653104][ C1] ? hlock_class+0x4e/0x130 [ 9616.653330][ C1] ? mark_lock+0x38/0x3e0 [ 9616.653545][ C1] ? stack_access_ok+0xda/0x1f0 [ 9616.653786][ C1] ? __lock_acquire+0xb67/0x1610 [ 9616.654033][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9616.654329][ C1] ? get_stack_info+0x36/0xc0 [ 9616.654567][ C1] ? stack_access_ok+0xda/0x1f0 [ 9616.654814][ C1] ? get_reg+0x119/0x190 [ 9616.655032][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9616.655303][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9616.655619][ C1] __tcf_classify+0x329/0x7d0 [ 9616.655853][ C1] tcf_classify+0x283/0x930 [ 9616.656080][ C1] ? arch_stack_walk+0xa2/0x100 [ 9616.656323][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9616.656573][ C1] ? get_stack_info+0x36/0xc0 [ 9616.656809][ C1] tc_run+0x2e4/0x5d0 [ 9616.657009][ C1] ? __pfx_tc_run+0x10/0x10 [ 9616.657235][ C1] ? lock_acquire+0x1c1/0x220 [ 9616.657468][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9616.657721][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9616.657967][ C1] ? lock_acquire+0x1c1/0x220 [ 9616.658201][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9616.658460][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9616.658758][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9616.659025][ C1] ? neigh_hh_output+0x348/0x590 [ 9616.659272][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9616.659530][ C1] ip_finish_output2+0x786/0x18e0 [ 9616.659779][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9616.660050][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9616.660381][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9616.660651][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9616.660897][ C1] ? __ip_finish_output+0x10f/0x770 [ 9616.661156][ C1] ip_output+0x16b/0x4f0 [ 9616.661367][ C1] ? run_timer_softirq+0x72/0x100 [ 9616.661618][ C1] ? __pfx_ip_output+0x10/0x10 [ 9616.661855][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9616.662136][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9616.662382][ C1] ? ip_local_out+0x114/0x3b0 [ 9616.662614][ C1] __ip_queue_xmit+0x672/0x1910 [ 9616.662857][ C1] ? __create_object+0x5e/0xb0 [ 9616.663095][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9616.663357][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9616.663631][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9616.663898][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9616.664173][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9616.664462][ C1] tcp_delack_timer+0x84/0x240 [ 9616.664708][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9616.664981][ C1] call_timer_fn+0x173/0x430 [ 9616.665219][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9616.665490][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9616.665743][ C1] __run_timers.part.0+0x52d/0x890 [ 9616.665997][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9616.666270][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9616.666547][ C1] ? lock_acquire+0x1c1/0x220 [ 9616.666781][ C1] ? clockevents_program_event+0xf6/0x300 [ 9616.667063][ C1] ? lock_release+0x1d5/0x250 [ 9616.667297][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9616.667555][ C1] ? ktime_get+0xb3/0x190 [ 9616.667771][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9616.668060][ C1] run_timer_softirq+0x72/0x100 [ 9616.668304][ C1] __do_softirq+0x1b9/0x7ff [ 9616.668531][ C1] irq_exit_rcu+0x98/0xc0 [ 9616.668744][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9616.669023][ C1] [ 9616.669170][ C1] [ 9616.669316][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9616.669619][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9616.669935][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9616.670882][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9616.671184][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9616.671572][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9616.671962][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9616.672355][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9616.672744][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9616.673134][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9616.673427][ C1] pipe_read+0xa16/0xdf0 [ 9616.673641][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9616.673916][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9616.674154][ C1] ? iterate_tty_write+0x299/0x540 [ 9616.674436][ C1] ? lock_release+0x1d5/0x250 [ 9616.674675][ C1] vfs_read+0x911/0xc00 [ 9616.674892][ C1] ? lock_acquire+0x1c1/0x220 [ 9616.675130][ C1] ? __might_fault+0xc6/0x180 [ 9616.675374][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9616.675620][ C1] ? __might_fault+0xc6/0x180 [ 9616.675853][ C1] ? lock_release+0x1d5/0x250 [ 9616.676084][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9616.676344][ C1] ? __fget_light+0x54/0x1e0 [ 9616.676575][ C1] ksys_read+0x17a/0x1e0 [ 9616.676788][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9616.677024][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9616.677325][ C1] do_syscall_64+0xc9/0x1e0 [ 9616.677553][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9616.677843][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9616.678068][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9616.679013][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9616.679426][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9616.679816][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9616.680205][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9616.680592][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9616.680983][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9616.681376][ C1] [ 9640.342103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9640.342455][ C1] rcu: 1-....: (7267076 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1721363 [ 9640.343001][ C1] rcu: (t=7285455 jiffies g=1882453 q=724 ncpus=4) [ 9640.343325][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9640.343762][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9640.344386][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9640.344712][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9640.345682][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9640.345983][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9640.346373][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9640.346761][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9640.347151][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9640.347541][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9640.347930][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9640.348368][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9640.348690][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9640.349083][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9640.349473][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9640.349862][ C1] PKRU: 55555554 [ 9640.350039][ C1] Call Trace: [ 9640.350205][ C1] [ 9640.350349][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9640.350614][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9640.350859][ C1] ? check_cpu_stall+0x284/0x500 [ 9640.351105][ C1] ? rcu_pending+0x92/0x360 [ 9640.351332][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9640.351595][ C1] ? update_process_times+0xb9/0x110 [ 9640.351858][ C1] ? tick_sched_handle+0x67/0x130 [ 9640.352108][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9640.352386][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9640.352621][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9640.352926][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9640.353193][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9640.353474][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9640.353733][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9640.354031][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9640.354311][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9640.354625][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9640.354919][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9640.355247][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9640.355530][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9640.355816][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9640.356099][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9640.356404][ C1] ? get_stack_info+0x36/0xc0 [ 9640.356639][ C1] ? lock_acquire+0x1c1/0x220 [ 9640.356872][ C1] ? lock_release+0x1d5/0x250 [ 9640.357107][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9640.357350][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9640.357616][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9640.357895][ C1] ? lock_acquire+0x1c1/0x220 [ 9640.358126][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9640.358362][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9640.358615][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9640.358844][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9640.359085][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9640.359338][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9640.359606][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9640.359876][ C1] ip_local_deliver+0x19d/0x480 [ 9640.360116][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9640.360384][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9640.360641][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9640.360980][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9640.361228][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9640.361541][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9640.361797][ C1] ip_rcv+0x564/0x740 [ 9640.361996][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9640.362223][ C1] ? set_track_prepare+0x8a/0xd0 [ 9640.362470][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9640.362740][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9640.363005][ C1] ? skb_clone+0x10b/0x330 [ 9640.363230][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9640.363541][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9640.363839][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9640.364136][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9640.364432][ C1] ? __tcf_classify+0x329/0x7d0 [ 9640.364681][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9640.364913][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9640.365212][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9640.365504][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9640.365820][ C1] ? lock_acquire+0x1c1/0x220 [ 9640.366054][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9640.366342][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9640.366622][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9640.366931][ C1] ? __copy_skb_header+0xaf/0x490 [ 9640.367182][ C1] ? __skb_clone+0x57a/0x760 [ 9640.367411][ C1] netif_receive_skb+0x55/0x280 [ 9640.367653][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9640.367958][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9640.368282][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9640.368574][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9640.368841][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9640.369122][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9640.369428][ C1] ? hlock_class+0x4e/0x130 [ 9640.369656][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9640.369925][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9640.370195][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9640.370454][ C1] ? hlock_class+0x4e/0x130 [ 9640.370697][ C1] ? mark_lock+0x38/0x3e0 [ 9640.370918][ C1] ? stack_access_ok+0xda/0x1f0 [ 9640.371166][ C1] ? __lock_acquire+0xb67/0x1610 [ 9640.371422][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9640.371700][ C1] ? get_stack_info+0x36/0xc0 [ 9640.371939][ C1] ? stack_access_ok+0xda/0x1f0 [ 9640.372191][ C1] ? get_reg+0x119/0x190 [ 9640.372405][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9640.372665][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9640.372968][ C1] __tcf_classify+0x329/0x7d0 [ 9640.373205][ C1] tcf_classify+0x283/0x930 [ 9640.373430][ C1] ? arch_stack_walk+0xa2/0x100 [ 9640.373673][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9640.373923][ C1] ? get_stack_info+0x36/0xc0 [ 9640.374182][ C1] tc_run+0x2e4/0x5d0 [ 9640.374388][ C1] ? __pfx_tc_run+0x10/0x10 [ 9640.374624][ C1] ? lock_acquire+0x1c1/0x220 [ 9640.374861][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9640.375123][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9640.375385][ C1] ? lock_acquire+0x1c1/0x220 [ 9640.375618][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9640.375875][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9640.376173][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9640.376438][ C1] ? neigh_hh_output+0x348/0x590 [ 9640.376684][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9640.376942][ C1] ip_finish_output2+0x786/0x18e0 [ 9640.377192][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9640.377464][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9640.377793][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9640.378061][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9640.378308][ C1] ? __ip_finish_output+0x10f/0x770 [ 9640.378566][ C1] ip_output+0x16b/0x4f0 [ 9640.378778][ C1] ? run_timer_softirq+0x72/0x100 [ 9640.379028][ C1] ? __pfx_ip_output+0x10/0x10 [ 9640.379264][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9640.379544][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9640.379790][ C1] ? ip_local_out+0x114/0x3b0 [ 9640.380023][ C1] __ip_queue_xmit+0x672/0x1910 [ 9640.380265][ C1] ? __create_object+0x5e/0xb0 [ 9640.380502][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9640.380765][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9640.381040][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9640.381307][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9640.381580][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9640.381847][ C1] tcp_delack_timer+0x84/0x240 [ 9640.382082][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9640.382350][ C1] call_timer_fn+0x173/0x430 [ 9640.382581][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9640.382835][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9640.383091][ C1] __run_timers.part.0+0x52d/0x890 [ 9640.383345][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9640.383612][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9640.383889][ C1] ? lock_acquire+0x1c1/0x220 [ 9640.384147][ C1] ? clockevents_program_event+0xf6/0x300 [ 9640.384440][ C1] ? lock_release+0x1d5/0x250 [ 9640.384679][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9640.384943][ C1] ? ktime_get+0xb3/0x190 [ 9640.385166][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9640.385470][ C1] run_timer_softirq+0x72/0x100 [ 9640.385710][ C1] __do_softirq+0x1b9/0x7ff [ 9640.385937][ C1] irq_exit_rcu+0x98/0xc0 [ 9640.386150][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9640.386431][ C1] [ 9640.386576][ C1] [ 9640.386723][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9640.387018][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9640.387335][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9640.388283][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9640.388583][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9640.388976][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9640.389366][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9640.389754][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9640.390142][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9640.390535][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9640.390822][ C1] pipe_read+0xa16/0xdf0 [ 9640.391038][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9640.391309][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9640.391547][ C1] ? iterate_tty_write+0x299/0x540 [ 9640.391801][ C1] ? lock_release+0x1d5/0x250 [ 9640.392035][ C1] vfs_read+0x911/0xc00 [ 9640.392245][ C1] ? lock_acquire+0x1c1/0x220 [ 9640.392477][ C1] ? __might_fault+0xc6/0x180 [ 9640.392709][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9640.392943][ C1] ? __might_fault+0xc6/0x180 [ 9640.393178][ C1] ? lock_release+0x1d5/0x250 [ 9640.393413][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9640.393671][ C1] ? __fget_light+0x54/0x1e0 [ 9640.393901][ C1] ksys_read+0x17a/0x1e0 [ 9640.394144][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9640.394391][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9640.394693][ C1] do_syscall_64+0xc9/0x1e0 [ 9640.394927][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9640.395229][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9640.395462][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9640.396408][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9640.396820][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9640.397208][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9640.397596][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9640.397987][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9640.398376][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9640.398767][ C1] [ 9640.398921][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9640.399186][ C2] NMI backtrace for cpu 2 [ 9640.399192][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9640.399197][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9640.399201][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9640.399209][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9640.399213][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9640.399216][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9640.399218][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9640.399219][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9640.399221][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9640.399223][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9640.399224][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9640.399227][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9640.399230][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9640.399232][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9640.399233][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9640.399235][ C2] PKRU: 55555554 [ 9640.399236][ C2] Call Trace: [ 9640.399237][ C2] [ 9640.399239][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9640.399245][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9640.399249][ C2] ? nmi_handle+0x153/0x420 [ 9640.399253][ C2] ? default_do_nmi+0x41/0x100 [ 9640.399256][ C2] ? exc_nmi+0xf3/0x120 [ 9640.399258][ C2] ? end_repeat_nmi+0xf/0x60 [ 9640.399264][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9640.399267][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9640.399270][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9640.399274][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9640.399277][ C2] [ 9640.399278][ C2] [ 9640.399279][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9640.399282][ C2] ? get_stack_info+0x36/0xc0 [ 9640.399286][ C2] ? lock_acquire+0x1c1/0x220 [ 9640.399289][ C2] ? lock_release+0x1d5/0x250 [ 9640.399293][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9640.399296][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9640.399299][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9640.399302][ C2] ? lock_acquire+0x1c1/0x220 [ 9640.399304][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9640.399307][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9640.399310][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9640.399316][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9640.399318][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9640.399323][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9640.399327][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9640.399331][ C2] ip_local_deliver+0x19d/0x480 [ 9640.399333][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9640.399336][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9640.399338][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9640.399343][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9640.399347][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9640.399350][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9640.399358][ C2] ip_rcv+0x564/0x740 [ 9640.399361][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9640.399363][ C2] ? set_track_prepare+0x8a/0xd0 [ 9640.399367][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9640.399371][ C2] ? start_secondary+0x21c/0x2b0 [ 9640.399374][ C2] ? skb_clone+0x10b/0x330 [ 9640.399376][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9640.399382][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9640.399387][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9640.399390][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9640.399398][ C2] ? __tcf_classify+0x329/0x7d0 [ 9640.399401][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9640.399403][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9640.399406][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9640.399409][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9640.399414][ C2] ? lock_acquire+0x1c1/0x220 [ 9640.399416][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9640.399421][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9640.399424][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9640.399428][ C2] ? __copy_skb_header+0xaf/0x490 [ 9640.399432][ C2] ? __skb_clone+0x57a/0x760 [ 9640.399434][ C2] netif_receive_skb+0x55/0x280 [ 9640.399437][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9640.399444][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9640.399450][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9640.399457][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9640.399461][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9640.399471][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9640.399478][ C2] ? get_stack_info+0x36/0xc0 [ 9640.399482][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9640.399485][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9640.399488][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9640.399490][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9640.399494][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9640.399496][ C2] ? kernel_text_address+0x17/0xe0 [ 9640.399498][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9640.399502][ C2] ? arch_stack_walk+0x8c/0x100 [ 9640.399505][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9640.399509][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9640.399512][ C2] ? lock_acquire+0x1c1/0x220 [ 9640.399514][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9640.399518][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9640.399522][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9640.399525][ C2] ? get_stack_info+0x36/0xc0 [ 9640.399529][ C2] __tcf_classify+0x329/0x7d0 [ 9640.399534][ C2] tcf_classify+0x283/0x930 [ 9640.399539][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9640.399542][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9640.399546][ C2] tc_run+0x2e4/0x5d0 [ 9640.399549][ C2] ? __pfx_tc_run+0x10/0x10 [ 9640.399552][ C2] ? lock_acquire+0x1c1/0x220 [ 9640.399554][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9640.399558][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9640.399562][ C2] ? lock_acquire+0x1c1/0x220 [ 9640.399564][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9640.399567][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9640.399570][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9640.399573][ C2] ? neigh_hh_output+0x348/0x590 [ 9640.399577][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9640.399580][ C2] ip_finish_output2+0x786/0x18e0 [ 9640.399584][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9640.399592][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9640.399594][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9640.399598][ C2] ? __ip_finish_output+0x10f/0x770 [ 9640.399602][ C2] ip_output+0x16b/0x4f0 [ 9640.399605][ C2] ? __pfx_ip_output+0x10/0x10 [ 9640.399607][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9640.399610][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9640.399613][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9640.399615][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9640.399618][ C2] ? __alloc_skb+0xd4/0x280 [ 9640.399620][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9640.399624][ C2] ? tcp_fragment+0x168/0x1040 [ 9640.399627][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9640.399630][ C2] ? ip_local_out+0x114/0x3b0 [ 9640.399634][ C2] __ip_queue_xmit+0x672/0x1910 [ 9640.399637][ C2] ? __skb_clone+0x57a/0x760 [ 9640.399640][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9640.399645][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9640.399648][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9640.399651][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9640.399655][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9640.399659][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9640.399662][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9640.399665][ C2] tcp_send_loss_probe+0x348/0x830 [ 9640.399669][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9640.399671][ C2] tcp_write_timer+0x82/0x1d0 [ 9640.399674][ C2] call_timer_fn+0x173/0x430 [ 9640.399678][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9640.399682][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9640.399687][ C2] __run_timers.part.0+0x52d/0x890 [ 9640.399690][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9640.399694][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9640.399697][ C2] ? lock_acquire+0x1c1/0x220 [ 9640.399699][ C2] ? clockevents_program_event+0xf6/0x300 [ 9640.399703][ C2] ? lock_release+0x1d5/0x250 [ 9640.399706][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9640.399709][ C2] ? ktime_get+0xb3/0x190 [ 9640.399712][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9640.399716][ C2] run_timer_softirq+0x72/0x100 [ 9640.399719][ C2] __do_softirq+0x1b9/0x7ff [ 9640.399723][ C2] irq_exit_rcu+0x98/0xc0 [ 9640.399726][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9640.399729][ C2] [ 9640.399730][ C2] [ 9640.399731][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9640.399734][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9640.399737][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9640.399739][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9640.399741][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9640.399742][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9640.399744][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9640.399745][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9640.399746][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9640.399749][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9640.399752][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9640.399756][ C2] default_idle_call+0x69/0xa0 [ 9640.399758][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9640.399760][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9640.399764][ C2] ? lock_release+0x1d5/0x250 [ 9640.399766][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9640.399770][ C2] do_idle+0xfb/0x160 [ 9640.399772][ C2] cpu_startup_entry+0x55/0x60 [ 9640.399775][ C2] start_secondary+0x21c/0x2b0 [ 9640.399777][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9640.399781][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9640.399787][ C2] [ 9664.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6809s! [swapper/2:0] [ 9664.569674][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9664.570888][ C2] irq event stamp: 44114564 [ 9664.571108][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9664.571629][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9664.572124][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9664.572584][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9664.573039][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9664.573483][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9664.574075][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9664.574389][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9664.575332][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9664.575630][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9664.576016][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9664.576403][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9664.576789][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9664.577175][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9664.577561][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9664.577993][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9664.578319][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9664.578706][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9664.579091][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9664.579478][ C2] PKRU: 55555554 [ 9664.579652][ C2] Call Trace: [ 9664.579817][ C2] [ 9664.579963][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9664.580219][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9664.580454][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9664.580723][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9664.580987][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9664.581265][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9664.581524][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9664.581819][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9664.582072][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9664.582326][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9664.582626][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9664.582912][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9664.583219][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9664.583497][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9664.583784][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9664.584084][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9664.584395][ C2] ? get_stack_info+0x36/0xc0 [ 9664.584634][ C2] ? lock_acquire+0x1c1/0x220 [ 9664.584873][ C2] ? lock_release+0x1d5/0x250 [ 9664.585111][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9664.585362][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9664.585627][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9664.585903][ C2] ? lock_acquire+0x1c1/0x220 [ 9664.586134][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9664.586368][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9664.586619][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9664.586845][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9664.587084][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9664.587336][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9664.587602][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9664.587873][ C2] ip_local_deliver+0x19d/0x480 [ 9664.588112][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9664.588378][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9664.588634][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9664.588970][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9664.589216][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9664.589527][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9664.589781][ C2] ip_rcv+0x564/0x740 [ 9664.589978][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9664.590204][ C2] ? set_track_prepare+0x8a/0xd0 [ 9664.590451][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9664.590719][ C2] ? start_secondary+0x21c/0x2b0 [ 9664.590963][ C2] ? skb_clone+0x10b/0x330 [ 9664.591185][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9664.591496][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9664.591792][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9664.592067][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9664.592353][ C2] ? __tcf_classify+0x329/0x7d0 [ 9664.592595][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9664.592820][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9664.593110][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9664.593388][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9664.593705][ C2] ? lock_acquire+0x1c1/0x220 [ 9664.593940][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9664.594251][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9664.594538][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9664.594855][ C2] ? __copy_skb_header+0xaf/0x490 [ 9664.595111][ C2] ? __skb_clone+0x57a/0x760 [ 9664.595354][ C2] netif_receive_skb+0x55/0x280 [ 9664.595594][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9664.595897][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9664.596220][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9664.596512][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9664.596778][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9664.597058][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9664.597362][ C2] ? get_stack_info+0x36/0xc0 [ 9664.597596][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9664.597854][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9664.598160][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9664.598429][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9664.598700][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9664.599006][ C2] ? kernel_text_address+0x17/0xe0 [ 9664.599260][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9664.599564][ C2] ? arch_stack_walk+0x8c/0x100 [ 9664.599806][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9664.600064][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9664.600342][ C2] ? lock_acquire+0x1c1/0x220 [ 9664.600574][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9664.600847][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9664.601143][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9664.601412][ C2] ? get_stack_info+0x36/0xc0 [ 9664.601647][ C2] __tcf_classify+0x329/0x7d0 [ 9664.601883][ C2] tcf_classify+0x283/0x930 [ 9664.602106][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9664.602356][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9664.602662][ C2] tc_run+0x2e4/0x5d0 [ 9664.602861][ C2] ? __pfx_tc_run+0x10/0x10 [ 9664.603086][ C2] ? lock_acquire+0x1c1/0x220 [ 9664.603320][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9664.603573][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9664.603820][ C2] ? lock_acquire+0x1c1/0x220 [ 9664.604073][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9664.604339][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9664.604641][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9664.604915][ C2] ? neigh_hh_output+0x348/0x590 [ 9664.605167][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9664.605436][ C2] ip_finish_output2+0x786/0x18e0 [ 9664.605685][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9664.606013][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9664.606282][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9664.606528][ C2] ? __ip_finish_output+0x10f/0x770 [ 9664.606784][ C2] ip_output+0x16b/0x4f0 [ 9664.606999][ C2] ? __pfx_ip_output+0x10/0x10 [ 9664.607236][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9664.607506][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9664.607811][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9664.608078][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9664.608324][ C2] ? __alloc_skb+0xd4/0x280 [ 9664.608548][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9664.608809][ C2] ? tcp_fragment+0x168/0x1040 [ 9664.609047][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9664.609292][ C2] ? ip_local_out+0x114/0x3b0 [ 9664.609525][ C2] __ip_queue_xmit+0x672/0x1910 [ 9664.609766][ C2] ? __skb_clone+0x57a/0x760 [ 9664.609994][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9664.610255][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9664.610527][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9664.610765][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9664.611007][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9664.611301][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9664.611612][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9664.611848][ C2] tcp_send_loss_probe+0x348/0x830 [ 9664.612101][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9664.612363][ C2] tcp_write_timer+0x82/0x1d0 [ 9664.612595][ C2] call_timer_fn+0x173/0x430 [ 9664.612824][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9664.613077][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9664.613332][ C2] __run_timers.part.0+0x52d/0x890 [ 9664.613585][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9664.613849][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9664.614152][ C2] ? lock_acquire+0x1c1/0x220 [ 9664.614392][ C2] ? clockevents_program_event+0xf6/0x300 [ 9664.614680][ C2] ? lock_release+0x1d5/0x250 [ 9664.614923][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9664.615187][ C2] ? ktime_get+0xb3/0x190 [ 9664.615414][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9664.615700][ C2] run_timer_softirq+0x72/0x100 [ 9664.615941][ C2] __do_softirq+0x1b9/0x7ff [ 9664.616167][ C2] irq_exit_rcu+0x98/0xc0 [ 9664.616381][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9664.616659][ C2] [ 9664.616805][ C2] [ 9664.616950][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9664.617249][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9664.617498][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9664.618440][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9664.618740][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9664.619127][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9664.619516][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9664.619905][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9664.620293][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9664.620681][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9664.620963][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9664.621220][ C2] default_idle_call+0x69/0xa0 [ 9664.621457][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9664.621701][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9664.621970][ C2] ? lock_release+0x1d5/0x250 [ 9664.622205][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9664.622471][ C2] do_idle+0xfb/0x160 [ 9664.622668][ C2] cpu_startup_entry+0x55/0x60 [ 9664.622905][ C2] start_secondary+0x21c/0x2b0 [ 9664.623142][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9664.623404][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9664.623708][ C2] [ 9664.623860][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6809s! [perl:4135] [ 9664.624291][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9664.625547][ C1] irq event stamp: 209232 [ 9664.625761][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9664.626277][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9664.626743][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9664.627203][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9664.627652][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9664.628090][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9664.628690][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9664.629007][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9664.629953][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9664.630256][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9664.630650][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9664.631039][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9664.631430][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9664.631823][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9664.632214][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9664.632651][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9664.632976][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9664.633368][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9664.633760][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9664.634176][ C1] PKRU: 55555554 [ 9664.634360][ C1] Call Trace: [ 9664.634530][ C1] [ 9664.634679][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9664.634943][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9664.635189][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9664.635470][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9664.635736][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9664.636020][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9664.636281][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9664.636580][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9664.636837][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9664.637139][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9664.637429][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9664.637736][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9664.638019][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9664.638309][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9664.638592][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9664.638896][ C1] ? get_stack_info+0x36/0xc0 [ 9664.639130][ C1] ? lock_acquire+0x1c1/0x220 [ 9664.639367][ C1] ? lock_release+0x1d5/0x250 [ 9664.639603][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9664.639845][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9664.640112][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9664.640391][ C1] ? lock_acquire+0x1c1/0x220 [ 9664.640624][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9664.640860][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9664.641114][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9664.641344][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9664.641585][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9664.641837][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9664.642109][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9664.642380][ C1] ip_local_deliver+0x19d/0x480 [ 9664.642622][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9664.642887][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9664.643145][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9664.643484][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9664.643731][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9664.644064][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9664.644328][ C1] ip_rcv+0x564/0x740 [ 9664.644535][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9664.644766][ C1] ? set_track_prepare+0x8a/0xd0 [ 9664.645019][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9664.645306][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9664.645571][ C1] ? skb_clone+0x10b/0x330 [ 9664.645791][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9664.646102][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9664.646403][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9664.646677][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9664.646966][ C1] ? __tcf_classify+0x329/0x7d0 [ 9664.647210][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9664.647433][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9664.647727][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9664.648006][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9664.648325][ C1] ? lock_acquire+0x1c1/0x220 [ 9664.648557][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9664.648846][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9664.649124][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9664.649435][ C1] ? __copy_skb_header+0xaf/0x490 [ 9664.649687][ C1] ? __skb_clone+0x57a/0x760 [ 9664.649917][ C1] netif_receive_skb+0x55/0x280 [ 9664.650160][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9664.650467][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9664.650795][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9664.651087][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9664.651358][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9664.651639][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9664.651944][ C1] ? hlock_class+0x4e/0x130 [ 9664.652171][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9664.652443][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9664.652711][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9664.652967][ C1] ? hlock_class+0x4e/0x130 [ 9664.653195][ C1] ? mark_lock+0x38/0x3e0 [ 9664.653409][ C1] ? stack_access_ok+0xda/0x1f0 [ 9664.653653][ C1] ? __lock_acquire+0xb67/0x1610 [ 9664.653901][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9664.654197][ C1] ? get_stack_info+0x36/0xc0 [ 9664.654438][ C1] ? stack_access_ok+0xda/0x1f0 [ 9664.654686][ C1] ? get_reg+0x119/0x190 [ 9664.654902][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9664.655184][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9664.655486][ C1] __tcf_classify+0x329/0x7d0 [ 9664.655722][ C1] tcf_classify+0x283/0x930 [ 9664.655949][ C1] ? arch_stack_walk+0xa2/0x100 [ 9664.656193][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9664.656444][ C1] ? get_stack_info+0x36/0xc0 [ 9664.656679][ C1] tc_run+0x2e4/0x5d0 [ 9664.656881][ C1] ? __pfx_tc_run+0x10/0x10 [ 9664.657106][ C1] ? lock_acquire+0x1c1/0x220 [ 9664.657341][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9664.657596][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9664.657843][ C1] ? lock_acquire+0x1c1/0x220 [ 9664.658077][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9664.658337][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9664.658635][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9664.658901][ C1] ? neigh_hh_output+0x348/0x590 [ 9664.659148][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9664.659408][ C1] ip_finish_output2+0x786/0x18e0 [ 9664.659657][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9664.659928][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9664.660259][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9664.660530][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9664.660777][ C1] ? __ip_finish_output+0x10f/0x770 [ 9664.661036][ C1] ip_output+0x16b/0x4f0 [ 9664.661247][ C1] ? run_timer_softirq+0x72/0x100 [ 9664.661497][ C1] ? __pfx_ip_output+0x10/0x10 [ 9664.661737][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9664.662017][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9664.662264][ C1] ? ip_local_out+0x114/0x3b0 [ 9664.662500][ C1] __ip_queue_xmit+0x672/0x1910 [ 9664.662743][ C1] ? __create_object+0x5e/0xb0 [ 9664.662983][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9664.663244][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9664.663520][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9664.663788][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9664.664087][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9664.664361][ C1] tcp_delack_timer+0x84/0x240 [ 9664.664606][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9664.664879][ C1] call_timer_fn+0x173/0x430 [ 9664.665118][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9664.665387][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9664.665642][ C1] __run_timers.part.0+0x52d/0x890 [ 9664.665897][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9664.666162][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9664.666444][ C1] ? lock_acquire+0x1c1/0x220 [ 9664.666677][ C1] ? clockevents_program_event+0xf6/0x300 [ 9664.666959][ C1] ? lock_release+0x1d5/0x250 [ 9664.667195][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9664.667454][ C1] ? ktime_get+0xb3/0x190 [ 9664.667668][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9664.667958][ C1] run_timer_softirq+0x72/0x100 [ 9664.668202][ C1] __do_softirq+0x1b9/0x7ff [ 9664.668430][ C1] irq_exit_rcu+0x98/0xc0 [ 9664.668645][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9664.668924][ C1] [ 9664.669074][ C1] [ 9664.669221][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9664.669520][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9664.669837][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9664.670787][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9664.671089][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9664.671479][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9664.671868][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9664.672263][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9664.672653][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9664.673045][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9664.673337][ C1] pipe_read+0xa16/0xdf0 [ 9664.673553][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9664.673823][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9664.674102][ C1] ? iterate_tty_write+0x299/0x540 [ 9664.674366][ C1] ? lock_release+0x1d5/0x250 [ 9664.674610][ C1] vfs_read+0x911/0xc00 [ 9664.674825][ C1] ? lock_acquire+0x1c1/0x220 [ 9664.675066][ C1] ? __might_fault+0xc6/0x180 [ 9664.675320][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9664.675555][ C1] ? __might_fault+0xc6/0x180 [ 9664.675788][ C1] ? lock_release+0x1d5/0x250 [ 9664.676024][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9664.676284][ C1] ? __fget_light+0x54/0x1e0 [ 9664.676517][ C1] ksys_read+0x17a/0x1e0 [ 9664.676729][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9664.676968][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9664.677269][ C1] do_syscall_64+0xc9/0x1e0 [ 9664.677496][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9664.677790][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9664.678014][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9664.678967][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9664.679382][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9664.679774][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9664.680167][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9664.680559][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9664.680950][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9664.681347][ C1] [ 9692.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6835s! [swapper/2:0] [ 9692.569677][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9692.570887][ C2] irq event stamp: 44114564 [ 9692.571111][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9692.571627][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9692.572122][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9692.572586][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9692.573038][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9692.573479][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9692.574097][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9692.574419][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9692.575387][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9692.575684][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9692.576068][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9692.576454][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9692.576839][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9692.577226][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9692.577611][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9692.578044][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9692.578365][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9692.578752][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9692.579140][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9692.579527][ C2] PKRU: 55555554 [ 9692.579703][ C2] Call Trace: [ 9692.579867][ C2] [ 9692.580008][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9692.580263][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9692.580499][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9692.580766][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9692.581029][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9692.581310][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9692.581566][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9692.581863][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9692.582115][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9692.582370][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9692.582671][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9692.582957][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9692.583264][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9692.583544][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9692.583829][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9692.584137][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9692.584447][ C2] ? get_stack_info+0x36/0xc0 [ 9692.584684][ C2] ? lock_acquire+0x1c1/0x220 [ 9692.584924][ C2] ? lock_release+0x1d5/0x250 [ 9692.585172][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9692.585413][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9692.585676][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9692.585951][ C2] ? lock_acquire+0x1c1/0x220 [ 9692.586182][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9692.586416][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9692.586668][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9692.586896][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9692.587134][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9692.587386][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9692.587653][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9692.587921][ C2] ip_local_deliver+0x19d/0x480 [ 9692.588162][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9692.588426][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9692.588685][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9692.589024][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9692.589271][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9692.589582][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9692.589837][ C2] ip_rcv+0x564/0x740 [ 9692.590035][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9692.590260][ C2] ? set_track_prepare+0x8a/0xd0 [ 9692.590506][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9692.590777][ C2] ? start_secondary+0x21c/0x2b0 [ 9692.591022][ C2] ? skb_clone+0x10b/0x330 [ 9692.591243][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9692.591552][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9692.591849][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9692.592122][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9692.592411][ C2] ? __tcf_classify+0x329/0x7d0 [ 9692.592653][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9692.592876][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9692.593168][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9692.593444][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9692.593762][ C2] ? lock_acquire+0x1c1/0x220 [ 9692.594015][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9692.594313][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9692.594595][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9692.594911][ C2] ? __copy_skb_header+0xaf/0x490 [ 9692.595175][ C2] ? __skb_clone+0x57a/0x760 [ 9692.595403][ C2] netif_receive_skb+0x55/0x280 [ 9692.595644][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9692.595946][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9692.596269][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9692.596557][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9692.596825][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9692.597104][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9692.597407][ C2] ? get_stack_info+0x36/0xc0 [ 9692.597639][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9692.597896][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9692.598203][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9692.598471][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9692.598739][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9692.599044][ C2] ? kernel_text_address+0x17/0xe0 [ 9692.599297][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9692.599599][ C2] ? arch_stack_walk+0x8c/0x100 [ 9692.599839][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9692.600095][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9692.600372][ C2] ? lock_acquire+0x1c1/0x220 [ 9692.600602][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9692.600877][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9692.601170][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9692.601440][ C2] ? get_stack_info+0x36/0xc0 [ 9692.601672][ C2] __tcf_classify+0x329/0x7d0 [ 9692.601906][ C2] tcf_classify+0x283/0x930 [ 9692.602131][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9692.602380][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9692.602683][ C2] tc_run+0x2e4/0x5d0 [ 9692.602882][ C2] ? __pfx_tc_run+0x10/0x10 [ 9692.603105][ C2] ? lock_acquire+0x1c1/0x220 [ 9692.603336][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9692.603589][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9692.603834][ C2] ? lock_acquire+0x1c1/0x220 [ 9692.604090][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9692.604354][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9692.604656][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9692.604927][ C2] ? neigh_hh_output+0x348/0x590 [ 9692.605186][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9692.605441][ C2] ip_finish_output2+0x786/0x18e0 [ 9692.605689][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9692.606014][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9692.606285][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9692.606530][ C2] ? __ip_finish_output+0x10f/0x770 [ 9692.606786][ C2] ip_output+0x16b/0x4f0 [ 9692.606995][ C2] ? __pfx_ip_output+0x10/0x10 [ 9692.607231][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9692.607497][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9692.607800][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9692.608067][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9692.608311][ C2] ? __alloc_skb+0xd4/0x280 [ 9692.608538][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9692.608798][ C2] ? tcp_fragment+0x168/0x1040 [ 9692.609034][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9692.609279][ C2] ? ip_local_out+0x114/0x3b0 [ 9692.609512][ C2] __ip_queue_xmit+0x672/0x1910 [ 9692.609752][ C2] ? __skb_clone+0x57a/0x760 [ 9692.609978][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9692.610237][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9692.610510][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9692.610764][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9692.611010][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9692.611313][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9692.611631][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9692.611874][ C2] tcp_send_loss_probe+0x348/0x830 [ 9692.612137][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9692.612398][ C2] tcp_write_timer+0x82/0x1d0 [ 9692.612631][ C2] call_timer_fn+0x173/0x430 [ 9692.612860][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9692.613113][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9692.613368][ C2] __run_timers.part.0+0x52d/0x890 [ 9692.613619][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9692.613901][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9692.614185][ C2] ? lock_acquire+0x1c1/0x220 [ 9692.614423][ C2] ? clockevents_program_event+0xf6/0x300 [ 9692.614713][ C2] ? lock_release+0x1d5/0x250 [ 9692.614949][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9692.615221][ C2] ? ktime_get+0xb3/0x190 [ 9692.615434][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9692.615723][ C2] run_timer_softirq+0x72/0x100 [ 9692.615963][ C2] __do_softirq+0x1b9/0x7ff [ 9692.616189][ C2] irq_exit_rcu+0x98/0xc0 [ 9692.616404][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9692.616679][ C2] [ 9692.616823][ C2] [ 9692.616974][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9692.617270][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9692.617519][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9692.618460][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9692.618756][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9692.619144][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9692.619531][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9692.619916][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9692.620303][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9692.620695][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9692.620975][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9692.621236][ C2] default_idle_call+0x69/0xa0 [ 9692.621472][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9692.621716][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9692.621984][ C2] ? lock_release+0x1d5/0x250 [ 9692.622218][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9692.622482][ C2] do_idle+0xfb/0x160 [ 9692.622681][ C2] cpu_startup_entry+0x55/0x60 [ 9692.622915][ C2] start_secondary+0x21c/0x2b0 [ 9692.623151][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9692.623413][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9692.623715][ C2] [ 9692.623872][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6835s! [perl:4135] [ 9692.624302][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9692.625550][ C1] irq event stamp: 209232 [ 9692.625761][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9692.626274][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9692.626744][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9692.627200][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9692.627649][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9692.628085][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9692.628684][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9692.629000][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9692.629947][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9692.630247][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9692.630636][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9692.631023][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9692.631415][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9692.631804][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9692.632193][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9692.632628][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9692.632951][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9692.633343][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9692.633734][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9692.634150][ C1] PKRU: 55555554 [ 9692.634331][ C1] Call Trace: [ 9692.634503][ C1] [ 9692.634650][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9692.634911][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9692.635164][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9692.635434][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9692.635700][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9692.635982][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9692.636241][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9692.636540][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9692.636796][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9692.637099][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9692.637387][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9692.637694][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9692.637977][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9692.638265][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9692.638548][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9692.638858][ C1] ? get_stack_info+0x36/0xc0 [ 9692.639091][ C1] ? lock_acquire+0x1c1/0x220 [ 9692.639326][ C1] ? lock_release+0x1d5/0x250 [ 9692.639561][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9692.639804][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9692.640070][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9692.640350][ C1] ? lock_acquire+0x1c1/0x220 [ 9692.640581][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9692.640816][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9692.641070][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9692.641300][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9692.641542][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9692.641793][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9692.642061][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9692.642331][ C1] ip_local_deliver+0x19d/0x480 [ 9692.642573][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9692.642836][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9692.643093][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9692.643434][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9692.643681][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9692.644016][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9692.644279][ C1] ip_rcv+0x564/0x740 [ 9692.644483][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9692.644714][ C1] ? set_track_prepare+0x8a/0xd0 [ 9692.644967][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9692.645251][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9692.645515][ C1] ? skb_clone+0x10b/0x330 [ 9692.645737][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9692.646051][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9692.646348][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9692.646624][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9692.646909][ C1] ? __tcf_classify+0x329/0x7d0 [ 9692.647152][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9692.647383][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9692.647674][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9692.647954][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9692.648272][ C1] ? lock_acquire+0x1c1/0x220 [ 9692.648506][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9692.648793][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9692.649073][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9692.649384][ C1] ? __copy_skb_header+0xaf/0x490 [ 9692.649635][ C1] ? __skb_clone+0x57a/0x760 [ 9692.649862][ C1] netif_receive_skb+0x55/0x280 [ 9692.650104][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9692.650410][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9692.650734][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9692.651027][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9692.651296][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9692.651575][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9692.651881][ C1] ? hlock_class+0x4e/0x130 [ 9692.652109][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9692.652378][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9692.652648][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9692.652907][ C1] ? hlock_class+0x4e/0x130 [ 9692.653130][ C1] ? mark_lock+0x38/0x3e0 [ 9692.653346][ C1] ? stack_access_ok+0xda/0x1f0 [ 9692.653588][ C1] ? __lock_acquire+0xb67/0x1610 [ 9692.653835][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9692.654133][ C1] ? get_stack_info+0x36/0xc0 [ 9692.654373][ C1] ? stack_access_ok+0xda/0x1f0 [ 9692.654618][ C1] ? get_reg+0x119/0x190 [ 9692.654837][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9692.655116][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9692.655418][ C1] __tcf_classify+0x329/0x7d0 [ 9692.655653][ C1] tcf_classify+0x283/0x930 [ 9692.655879][ C1] ? arch_stack_walk+0xa2/0x100 [ 9692.656121][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9692.656372][ C1] ? get_stack_info+0x36/0xc0 [ 9692.656607][ C1] tc_run+0x2e4/0x5d0 [ 9692.656806][ C1] ? __pfx_tc_run+0x10/0x10 [ 9692.657032][ C1] ? lock_acquire+0x1c1/0x220 [ 9692.657265][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9692.657519][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9692.657766][ C1] ? lock_acquire+0x1c1/0x220 [ 9692.657998][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9692.658257][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9692.658554][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9692.658819][ C1] ? neigh_hh_output+0x348/0x590 [ 9692.659064][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9692.659323][ C1] ip_finish_output2+0x786/0x18e0 [ 9692.659572][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9692.659844][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9692.660174][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9692.660443][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9692.660690][ C1] ? __ip_finish_output+0x10f/0x770 [ 9692.660947][ C1] ip_output+0x16b/0x4f0 [ 9692.661158][ C1] ? run_timer_softirq+0x72/0x100 [ 9692.661410][ C1] ? __pfx_ip_output+0x10/0x10 [ 9692.661646][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9692.661927][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9692.662173][ C1] ? ip_local_out+0x114/0x3b0 [ 9692.662406][ C1] __ip_queue_xmit+0x672/0x1910 [ 9692.662647][ C1] ? __create_object+0x5e/0xb0 [ 9692.662885][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9692.663144][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9692.663421][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9692.663687][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9692.663982][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9692.664255][ C1] tcp_delack_timer+0x84/0x240 [ 9692.664499][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9692.664773][ C1] call_timer_fn+0x173/0x430 [ 9692.665009][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9692.665277][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9692.665530][ C1] __run_timers.part.0+0x52d/0x890 [ 9692.665784][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9692.666053][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9692.666330][ C1] ? lock_acquire+0x1c1/0x220 [ 9692.666564][ C1] ? clockevents_program_event+0xf6/0x300 [ 9692.666844][ C1] ? lock_release+0x1d5/0x250 [ 9692.667078][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9692.667336][ C1] ? ktime_get+0xb3/0x190 [ 9692.667553][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9692.667840][ C1] run_timer_softirq+0x72/0x100 [ 9692.668083][ C1] __do_softirq+0x1b9/0x7ff [ 9692.668312][ C1] irq_exit_rcu+0x98/0xc0 [ 9692.668526][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9692.668805][ C1] [ 9692.668951][ C1] [ 9692.669098][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9692.669395][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9692.669711][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9692.670658][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9692.670958][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9692.671348][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9692.671738][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9692.672127][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9692.672516][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9692.672907][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9692.673197][ C1] pipe_read+0xa16/0xdf0 [ 9692.673411][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9692.673683][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9692.673942][ C1] ? iterate_tty_write+0x299/0x540 [ 9692.674205][ C1] ? lock_release+0x1d5/0x250 [ 9692.674444][ C1] vfs_read+0x911/0xc00 [ 9692.674661][ C1] ? lock_acquire+0x1c1/0x220 [ 9692.674900][ C1] ? __might_fault+0xc6/0x180 [ 9692.675154][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9692.675389][ C1] ? __might_fault+0xc6/0x180 [ 9692.675624][ C1] ? lock_release+0x1d5/0x250 [ 9692.675856][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9692.676117][ C1] ? __fget_light+0x54/0x1e0 [ 9692.676348][ C1] ksys_read+0x17a/0x1e0 [ 9692.676561][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9692.676799][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9692.677097][ C1] do_syscall_64+0xc9/0x1e0 [ 9692.677325][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9692.677617][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9692.677838][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9692.678785][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9692.679197][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9692.679586][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9692.679974][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9692.680364][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9692.680753][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9692.681149][ C1] [ 9718.400103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9718.400455][ C1] rcu: 1-....: (7344855 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1737521 [ 9718.400999][ C1] rcu: (t=7363513 jiffies g=1882453 q=724 ncpus=4) [ 9718.401325][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9718.401763][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9718.402361][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9718.402680][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9718.403627][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9718.403951][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9718.404350][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9718.404750][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9718.405156][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9718.405544][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9718.405933][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9718.406370][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9718.406694][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9718.407087][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9718.407476][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9718.407864][ C1] PKRU: 55555554 [ 9718.408041][ C1] Call Trace: [ 9718.408208][ C1] [ 9718.408351][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9718.408620][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9718.408866][ C1] ? check_cpu_stall+0x284/0x500 [ 9718.409112][ C1] ? rcu_pending+0x92/0x360 [ 9718.409340][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9718.409602][ C1] ? update_process_times+0xb9/0x110 [ 9718.409864][ C1] ? tick_sched_handle+0x67/0x130 [ 9718.410114][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9718.410394][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9718.410629][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9718.410932][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9718.411201][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9718.411481][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9718.411739][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9718.412037][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9718.412294][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9718.412595][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9718.412885][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9718.413191][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9718.413475][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9718.413765][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9718.414048][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9718.414353][ C1] ? get_stack_info+0x36/0xc0 [ 9718.414588][ C1] ? lock_acquire+0x1c1/0x220 [ 9718.414821][ C1] ? lock_release+0x1d5/0x250 [ 9718.415055][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9718.415298][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9718.415563][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9718.415843][ C1] ? lock_acquire+0x1c1/0x220 [ 9718.416074][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9718.416309][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9718.416562][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9718.416793][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9718.417034][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9718.417287][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9718.417554][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9718.417824][ C1] ip_local_deliver+0x19d/0x480 [ 9718.418065][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9718.418333][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9718.418591][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9718.418932][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9718.419180][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9718.419494][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9718.419752][ C1] ip_rcv+0x564/0x740 [ 9718.419951][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9718.420178][ C1] ? set_track_prepare+0x8a/0xd0 [ 9718.420427][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9718.420698][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9718.420964][ C1] ? skb_clone+0x10b/0x330 [ 9718.421188][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9718.421500][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9718.421799][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9718.422075][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9718.422362][ C1] ? __tcf_classify+0x329/0x7d0 [ 9718.422605][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9718.422831][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9718.423123][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9718.423403][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9718.423721][ C1] ? lock_acquire+0x1c1/0x220 [ 9718.423981][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9718.424278][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9718.424567][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9718.424885][ C1] ? __copy_skb_header+0xaf/0x490 [ 9718.425151][ C1] ? __skb_clone+0x57a/0x760 [ 9718.425381][ C1] netif_receive_skb+0x55/0x280 [ 9718.425624][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9718.425930][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9718.426255][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9718.426548][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9718.426815][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9718.427097][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9718.427402][ C1] ? hlock_class+0x4e/0x130 [ 9718.427632][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9718.427901][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9718.428172][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9718.428431][ C1] ? hlock_class+0x4e/0x130 [ 9718.428655][ C1] ? mark_lock+0x38/0x3e0 [ 9718.428871][ C1] ? stack_access_ok+0xda/0x1f0 [ 9718.429114][ C1] ? __lock_acquire+0xb67/0x1610 [ 9718.429363][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9718.429633][ C1] ? get_stack_info+0x36/0xc0 [ 9718.429868][ C1] ? stack_access_ok+0xda/0x1f0 [ 9718.430109][ C1] ? get_reg+0x119/0x190 [ 9718.430322][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9718.430583][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9718.430886][ C1] __tcf_classify+0x329/0x7d0 [ 9718.431123][ C1] tcf_classify+0x283/0x930 [ 9718.431349][ C1] ? arch_stack_walk+0xa2/0x100 [ 9718.431592][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9718.431842][ C1] ? get_stack_info+0x36/0xc0 [ 9718.432078][ C1] tc_run+0x2e4/0x5d0 [ 9718.432280][ C1] ? __pfx_tc_run+0x10/0x10 [ 9718.432506][ C1] ? lock_acquire+0x1c1/0x220 [ 9718.432739][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9718.432994][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9718.433242][ C1] ? lock_acquire+0x1c1/0x220 [ 9718.433478][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9718.433736][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9718.434074][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9718.434346][ C1] ? neigh_hh_output+0x348/0x590 [ 9718.434600][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9718.434867][ C1] ip_finish_output2+0x786/0x18e0 [ 9718.435130][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9718.435405][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9718.435735][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9718.436004][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9718.436257][ C1] ? __ip_finish_output+0x10f/0x770 [ 9718.436515][ C1] ip_output+0x16b/0x4f0 [ 9718.436728][ C1] ? run_timer_softirq+0x72/0x100 [ 9718.436979][ C1] ? __pfx_ip_output+0x10/0x10 [ 9718.437217][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9718.437497][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9718.437744][ C1] ? ip_local_out+0x114/0x3b0 [ 9718.437979][ C1] __ip_queue_xmit+0x672/0x1910 [ 9718.438221][ C1] ? __create_object+0x5e/0xb0 [ 9718.438459][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9718.438720][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9718.438996][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9718.439263][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9718.439538][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9718.439805][ C1] tcp_delack_timer+0x84/0x240 [ 9718.440043][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9718.440310][ C1] call_timer_fn+0x173/0x430 [ 9718.440540][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9718.440796][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9718.441052][ C1] __run_timers.part.0+0x52d/0x890 [ 9718.441307][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9718.441574][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9718.441852][ C1] ? lock_acquire+0x1c1/0x220 [ 9718.442088][ C1] ? clockevents_program_event+0xf6/0x300 [ 9718.442373][ C1] ? lock_release+0x1d5/0x250 [ 9718.442605][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9718.442864][ C1] ? ktime_get+0xb3/0x190 [ 9718.443081][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9718.443372][ C1] run_timer_softirq+0x72/0x100 [ 9718.443613][ C1] __do_softirq+0x1b9/0x7ff [ 9718.443864][ C1] irq_exit_rcu+0x98/0xc0 [ 9718.444085][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9718.444374][ C1] [ 9718.444524][ C1] [ 9718.444677][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9718.444980][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9718.445310][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9718.446257][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9718.446556][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9718.446949][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9718.447340][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9718.447729][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9718.448120][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9718.448515][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9718.448804][ C1] pipe_read+0xa16/0xdf0 [ 9718.449020][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9718.449292][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9718.449531][ C1] ? iterate_tty_write+0x299/0x540 [ 9718.449786][ C1] ? lock_release+0x1d5/0x250 [ 9718.450022][ C1] vfs_read+0x911/0xc00 [ 9718.450232][ C1] ? lock_acquire+0x1c1/0x220 [ 9718.450466][ C1] ? __might_fault+0xc6/0x180 [ 9718.450699][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9718.450934][ C1] ? __might_fault+0xc6/0x180 [ 9718.451169][ C1] ? lock_release+0x1d5/0x250 [ 9718.451405][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9718.451663][ C1] ? __fget_light+0x54/0x1e0 [ 9718.451894][ C1] ksys_read+0x17a/0x1e0 [ 9718.452107][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9718.452347][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9718.452642][ C1] do_syscall_64+0xc9/0x1e0 [ 9718.452871][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9718.453164][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9718.453386][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9718.454371][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9718.454796][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9718.455198][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9718.455587][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9718.455978][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9718.456368][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9718.456760][ C1] [ 9718.456915][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9718.457184][ C2] NMI backtrace for cpu 2 [ 9718.457190][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9718.457195][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9718.457199][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9718.457208][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9718.457214][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9718.457218][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9718.457221][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9718.457223][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9718.457225][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9718.457227][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9718.457228][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9718.457230][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9718.457233][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9718.457235][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9718.457236][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9718.457237][ C2] PKRU: 55555554 [ 9718.457238][ C2] Call Trace: [ 9718.457240][ C2] [ 9718.457242][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9718.457248][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9718.457252][ C2] ? nmi_handle+0x153/0x420 [ 9718.457257][ C2] ? default_do_nmi+0x41/0x100 [ 9718.457259][ C2] ? exc_nmi+0xf3/0x120 [ 9718.457262][ C2] ? end_repeat_nmi+0xf/0x60 [ 9718.457267][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9718.457270][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9718.457273][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9718.457277][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9718.457280][ C2] [ 9718.457281][ C2] [ 9718.457282][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9718.457285][ C2] ? get_stack_info+0x36/0xc0 [ 9718.457289][ C2] ? lock_acquire+0x1c1/0x220 [ 9718.457293][ C2] ? lock_release+0x1d5/0x250 [ 9718.457296][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9718.457300][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9718.457303][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9718.457306][ C2] ? lock_acquire+0x1c1/0x220 [ 9718.457308][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9718.457312][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9718.457315][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9718.457320][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9718.457323][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9718.457327][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9718.457332][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9718.457336][ C2] ip_local_deliver+0x19d/0x480 [ 9718.457338][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9718.457340][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9718.457343][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9718.457348][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9718.457352][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9718.457355][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9718.457364][ C2] ip_rcv+0x564/0x740 [ 9718.457366][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9718.457369][ C2] ? set_track_prepare+0x8a/0xd0 [ 9718.457373][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9718.457376][ C2] ? start_secondary+0x21c/0x2b0 [ 9718.457379][ C2] ? skb_clone+0x10b/0x330 [ 9718.457382][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9718.457388][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9718.457393][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9718.457396][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9718.457404][ C2] ? __tcf_classify+0x329/0x7d0 [ 9718.457408][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9718.457410][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9718.457413][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9718.457417][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9718.457421][ C2] ? lock_acquire+0x1c1/0x220 [ 9718.457423][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9718.457428][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9718.457431][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9718.457435][ C2] ? __copy_skb_header+0xaf/0x490 [ 9718.457439][ C2] ? __skb_clone+0x57a/0x760 [ 9718.457442][ C2] netif_receive_skb+0x55/0x280 [ 9718.457445][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9718.457452][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9718.457458][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9718.457465][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9718.457469][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9718.457478][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9718.457486][ C2] ? get_stack_info+0x36/0xc0 [ 9718.457490][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9718.457493][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9718.457496][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9718.457499][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9718.457502][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9718.457504][ C2] ? kernel_text_address+0x17/0xe0 [ 9718.457508][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9718.457512][ C2] ? arch_stack_walk+0x8c/0x100 [ 9718.457515][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9718.457518][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9718.457522][ C2] ? lock_acquire+0x1c1/0x220 [ 9718.457524][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9718.457528][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9718.457532][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9718.457535][ C2] ? get_stack_info+0x36/0xc0 [ 9718.457539][ C2] __tcf_classify+0x329/0x7d0 [ 9718.457544][ C2] tcf_classify+0x283/0x930 [ 9718.457549][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9718.457552][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9718.457556][ C2] tc_run+0x2e4/0x5d0 [ 9718.457560][ C2] ? __pfx_tc_run+0x10/0x10 [ 9718.457563][ C2] ? lock_acquire+0x1c1/0x220 [ 9718.457565][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9718.457569][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9718.457573][ C2] ? lock_acquire+0x1c1/0x220 [ 9718.457575][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9718.457578][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9718.457581][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9718.457584][ C2] ? neigh_hh_output+0x348/0x590 [ 9718.457588][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9718.457592][ C2] ip_finish_output2+0x786/0x18e0 [ 9718.457596][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9718.457603][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9718.457606][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9718.457610][ C2] ? __ip_finish_output+0x10f/0x770 [ 9718.457613][ C2] ip_output+0x16b/0x4f0 [ 9718.457616][ C2] ? __pfx_ip_output+0x10/0x10 [ 9718.457619][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9718.457622][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9718.457625][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9718.457627][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9718.457630][ C2] ? __alloc_skb+0xd4/0x280 [ 9718.457632][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9718.457636][ C2] ? tcp_fragment+0x168/0x1040 [ 9718.457639][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9718.457642][ C2] ? ip_local_out+0x114/0x3b0 [ 9718.457645][ C2] __ip_queue_xmit+0x672/0x1910 [ 9718.457649][ C2] ? __skb_clone+0x57a/0x760 [ 9718.457651][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9718.457656][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9718.457659][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9718.457663][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9718.457667][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9718.457671][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9718.457674][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9718.457677][ C2] tcp_send_loss_probe+0x348/0x830 [ 9718.457680][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9718.457682][ C2] tcp_write_timer+0x82/0x1d0 [ 9718.457686][ C2] call_timer_fn+0x173/0x430 [ 9718.457689][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9718.457694][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9718.457698][ C2] __run_timers.part.0+0x52d/0x890 [ 9718.457700][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9718.457704][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9718.457708][ C2] ? lock_acquire+0x1c1/0x220 [ 9718.457710][ C2] ? clockevents_program_event+0xf6/0x300 [ 9718.457714][ C2] ? lock_release+0x1d5/0x250 [ 9718.457717][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9718.457720][ C2] ? ktime_get+0xb3/0x190 [ 9718.457723][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9718.457728][ C2] run_timer_softirq+0x72/0x100 [ 9718.457731][ C2] __do_softirq+0x1b9/0x7ff [ 9718.457735][ C2] irq_exit_rcu+0x98/0xc0 [ 9718.457737][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9718.457741][ C2] [ 9718.457742][ C2] [ 9718.457743][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9718.457746][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9718.457749][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9718.457751][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9718.457753][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9718.457755][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9718.457756][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9718.457757][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9718.457758][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9718.457761][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9718.457764][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9718.457767][ C2] default_idle_call+0x69/0xa0 [ 9718.457770][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9718.457773][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9718.457776][ C2] ? lock_release+0x1d5/0x250 [ 9718.457779][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9718.457783][ C2] do_idle+0xfb/0x160 [ 9718.457785][ C2] cpu_startup_entry+0x55/0x60 [ 9718.457787][ C2] start_secondary+0x21c/0x2b0 [ 9718.457790][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9718.457794][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9718.457800][ C2] [ 9744.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6884s! [swapper/2:0] [ 9744.569690][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9744.570902][ C2] irq event stamp: 44114564 [ 9744.571123][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9744.571643][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9744.572136][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9744.572598][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9744.573049][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9744.573488][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9744.574113][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9744.574437][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9744.575395][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9744.575693][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9744.576077][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9744.576462][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9744.576851][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9744.577237][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9744.577622][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9744.578055][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9744.578376][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9744.578766][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9744.579151][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9744.579537][ C2] PKRU: 55555554 [ 9744.579713][ C2] Call Trace: [ 9744.579882][ C2] [ 9744.580024][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9744.580279][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9744.580514][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9744.580781][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9744.581045][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9744.581326][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9744.581582][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9744.581878][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9744.582130][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9744.582384][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9744.582684][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9744.582969][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9744.583275][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9744.583556][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9744.583867][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9744.584154][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9744.584463][ C2] ? get_stack_info+0x36/0xc0 [ 9744.584705][ C2] ? lock_acquire+0x1c1/0x220 [ 9744.584950][ C2] ? lock_release+0x1d5/0x250 [ 9744.585185][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9744.585426][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9744.585689][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9744.585966][ C2] ? lock_acquire+0x1c1/0x220 [ 9744.586195][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9744.586428][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9744.586679][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9744.586906][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9744.587146][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9744.587397][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9744.587663][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9744.587930][ C2] ip_local_deliver+0x19d/0x480 [ 9744.588171][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9744.588432][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9744.588689][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9744.589025][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9744.589271][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9744.589580][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9744.589834][ C2] ip_rcv+0x564/0x740 [ 9744.590031][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9744.590257][ C2] ? set_track_prepare+0x8a/0xd0 [ 9744.590502][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9744.590769][ C2] ? start_secondary+0x21c/0x2b0 [ 9744.591013][ C2] ? skb_clone+0x10b/0x330 [ 9744.591231][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9744.591540][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9744.591836][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9744.592110][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9744.592396][ C2] ? __tcf_classify+0x329/0x7d0 [ 9744.592637][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9744.592858][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9744.593148][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9744.593426][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9744.593763][ C2] ? lock_acquire+0x1c1/0x220 [ 9744.593997][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9744.594295][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9744.594579][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9744.594903][ C2] ? __copy_skb_header+0xaf/0x490 [ 9744.595151][ C2] ? __skb_clone+0x57a/0x760 [ 9744.595381][ C2] netif_receive_skb+0x55/0x280 [ 9744.595620][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9744.595923][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9744.596245][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9744.596534][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9744.596800][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9744.597077][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9744.597381][ C2] ? get_stack_info+0x36/0xc0 [ 9744.597614][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9744.597870][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9744.598177][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9744.598443][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9744.598710][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9744.599014][ C2] ? kernel_text_address+0x17/0xe0 [ 9744.599267][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9744.599571][ C2] ? arch_stack_walk+0x8c/0x100 [ 9744.599812][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9744.600066][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9744.600344][ C2] ? lock_acquire+0x1c1/0x220 [ 9744.600574][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9744.600848][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9744.601143][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9744.601411][ C2] ? get_stack_info+0x36/0xc0 [ 9744.601644][ C2] __tcf_classify+0x329/0x7d0 [ 9744.601876][ C2] tcf_classify+0x283/0x930 [ 9744.602102][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9744.602351][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9744.602653][ C2] tc_run+0x2e4/0x5d0 [ 9744.602851][ C2] ? __pfx_tc_run+0x10/0x10 [ 9744.603075][ C2] ? lock_acquire+0x1c1/0x220 [ 9744.603306][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9744.603559][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9744.603829][ C2] ? lock_acquire+0x1c1/0x220 [ 9744.604065][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9744.604329][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9744.604631][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9744.604910][ C2] ? neigh_hh_output+0x348/0x590 [ 9744.605154][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9744.605411][ C2] ip_finish_output2+0x786/0x18e0 [ 9744.605662][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9744.605990][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9744.606258][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9744.606504][ C2] ? __ip_finish_output+0x10f/0x770 [ 9744.606759][ C2] ip_output+0x16b/0x4f0 [ 9744.606968][ C2] ? __pfx_ip_output+0x10/0x10 [ 9744.607205][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9744.607471][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9744.607775][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9744.608044][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9744.608288][ C2] ? __alloc_skb+0xd4/0x280 [ 9744.608510][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9744.608770][ C2] ? tcp_fragment+0x168/0x1040 [ 9744.609007][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9744.609251][ C2] ? ip_local_out+0x114/0x3b0 [ 9744.609484][ C2] __ip_queue_xmit+0x672/0x1910 [ 9744.609725][ C2] ? __skb_clone+0x57a/0x760 [ 9744.609950][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9744.610210][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9744.610481][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9744.610718][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9744.610959][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9744.611250][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9744.611559][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9744.611796][ C2] tcp_send_loss_probe+0x348/0x830 [ 9744.612046][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9744.612305][ C2] tcp_write_timer+0x82/0x1d0 [ 9744.612538][ C2] call_timer_fn+0x173/0x430 [ 9744.612768][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9744.613021][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9744.613275][ C2] __run_timers.part.0+0x52d/0x890 [ 9744.613526][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9744.613812][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9744.614095][ C2] ? lock_acquire+0x1c1/0x220 [ 9744.614331][ C2] ? clockevents_program_event+0xf6/0x300 [ 9744.614622][ C2] ? lock_release+0x1d5/0x250 [ 9744.614870][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9744.615124][ C2] ? ktime_get+0xb3/0x190 [ 9744.615338][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9744.615624][ C2] run_timer_softirq+0x72/0x100 [ 9744.615865][ C2] __do_softirq+0x1b9/0x7ff [ 9744.616089][ C2] irq_exit_rcu+0x98/0xc0 [ 9744.616305][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9744.616579][ C2] [ 9744.616725][ C2] [ 9744.616870][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9744.617164][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9744.617414][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9744.618351][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9744.618648][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9744.619034][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9744.619419][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9744.619802][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9744.620191][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9744.620579][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9744.620855][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9744.621109][ C2] default_idle_call+0x69/0xa0 [ 9744.621345][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9744.621588][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9744.621856][ C2] ? lock_release+0x1d5/0x250 [ 9744.622086][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9744.622353][ C2] do_idle+0xfb/0x160 [ 9744.622550][ C2] cpu_startup_entry+0x55/0x60 [ 9744.622785][ C2] start_secondary+0x21c/0x2b0 [ 9744.623019][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9744.623282][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9744.623581][ C2] [ 9744.623757][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6884s! [perl:4135] [ 9744.624176][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9744.625423][ C1] irq event stamp: 209232 [ 9744.625635][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9744.626148][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9744.626614][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9744.627070][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9744.627521][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9744.627959][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9744.628557][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9744.628874][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9744.629817][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9744.630118][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9744.630508][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9744.630896][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9744.631285][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9744.631676][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9744.632064][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9744.632502][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9744.632826][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9744.633216][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9744.633608][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9744.634026][ C1] PKRU: 55555554 [ 9744.634209][ C1] Call Trace: [ 9744.634378][ C1] [ 9744.634527][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9744.634791][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9744.635041][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9744.635311][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9744.635576][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9744.635858][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9744.636116][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9744.636415][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9744.636670][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9744.636971][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9744.637259][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9744.637565][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9744.637847][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9744.638135][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9744.638418][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9744.638721][ C1] ? get_stack_info+0x36/0xc0 [ 9744.638954][ C1] ? lock_acquire+0x1c1/0x220 [ 9744.639190][ C1] ? lock_release+0x1d5/0x250 [ 9744.639425][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9744.639667][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9744.639932][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9744.640211][ C1] ? lock_acquire+0x1c1/0x220 [ 9744.640444][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9744.640679][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9744.640933][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9744.641163][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9744.641403][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9744.641655][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9744.641925][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9744.642196][ C1] ip_local_deliver+0x19d/0x480 [ 9744.642437][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9744.642703][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9744.642961][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9744.643301][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9744.643548][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9744.643885][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9744.644149][ C1] ip_rcv+0x564/0x740 [ 9744.644354][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9744.644585][ C1] ? set_track_prepare+0x8a/0xd0 [ 9744.644839][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9744.645124][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9744.645389][ C1] ? skb_clone+0x10b/0x330 [ 9744.645609][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9744.645921][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9744.646222][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9744.646498][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9744.646785][ C1] ? __tcf_classify+0x329/0x7d0 [ 9744.647026][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9744.647252][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9744.647543][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9744.647822][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9744.648142][ C1] ? lock_acquire+0x1c1/0x220 [ 9744.648374][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9744.648663][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9744.648943][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9744.649253][ C1] ? __copy_skb_header+0xaf/0x490 [ 9744.649503][ C1] ? __skb_clone+0x57a/0x760 [ 9744.649733][ C1] netif_receive_skb+0x55/0x280 [ 9744.649975][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9744.650280][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9744.650604][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9744.650895][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9744.651164][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9744.651445][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9744.651749][ C1] ? hlock_class+0x4e/0x130 [ 9744.651977][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9744.652248][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9744.652518][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9744.652775][ C1] ? hlock_class+0x4e/0x130 [ 9744.653002][ C1] ? mark_lock+0x38/0x3e0 [ 9744.653216][ C1] ? stack_access_ok+0xda/0x1f0 [ 9744.653460][ C1] ? __lock_acquire+0xb67/0x1610 [ 9744.653730][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9744.654007][ C1] ? get_stack_info+0x36/0xc0 [ 9744.654247][ C1] ? stack_access_ok+0xda/0x1f0 [ 9744.654494][ C1] ? get_reg+0x119/0x190 [ 9744.654710][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9744.654986][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9744.655287][ C1] __tcf_classify+0x329/0x7d0 [ 9744.655521][ C1] tcf_classify+0x283/0x930 [ 9744.655747][ C1] ? arch_stack_walk+0xa2/0x100 [ 9744.655989][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9744.656240][ C1] ? get_stack_info+0x36/0xc0 [ 9744.656474][ C1] tc_run+0x2e4/0x5d0 [ 9744.656674][ C1] ? __pfx_tc_run+0x10/0x10 [ 9744.656897][ C1] ? lock_acquire+0x1c1/0x220 [ 9744.657134][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9744.657389][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9744.657635][ C1] ? lock_acquire+0x1c1/0x220 [ 9744.657868][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9744.658126][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9744.658425][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9744.658689][ C1] ? neigh_hh_output+0x348/0x590 [ 9744.658936][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9744.659196][ C1] ip_finish_output2+0x786/0x18e0 [ 9744.659445][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9744.659714][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9744.660044][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9744.660315][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9744.660562][ C1] ? __ip_finish_output+0x10f/0x770 [ 9744.660820][ C1] ip_output+0x16b/0x4f0 [ 9744.661030][ C1] ? run_timer_softirq+0x72/0x100 [ 9744.661280][ C1] ? __pfx_ip_output+0x10/0x10 [ 9744.661518][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9744.661796][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9744.662041][ C1] ? ip_local_out+0x114/0x3b0 [ 9744.662276][ C1] __ip_queue_xmit+0x672/0x1910 [ 9744.662517][ C1] ? __create_object+0x5e/0xb0 [ 9744.662754][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9744.663014][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9744.663288][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9744.663555][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9744.663854][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9744.664126][ C1] tcp_delack_timer+0x84/0x240 [ 9744.664371][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9744.664642][ C1] call_timer_fn+0x173/0x430 [ 9744.664879][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9744.665144][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9744.665399][ C1] __run_timers.part.0+0x52d/0x890 [ 9744.665652][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9744.665919][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9744.666200][ C1] ? lock_acquire+0x1c1/0x220 [ 9744.666434][ C1] ? clockevents_program_event+0xf6/0x300 [ 9744.666716][ C1] ? lock_release+0x1d5/0x250 [ 9744.666950][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9744.667210][ C1] ? ktime_get+0xb3/0x190 [ 9744.667426][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9744.667714][ C1] run_timer_softirq+0x72/0x100 [ 9744.667956][ C1] __do_softirq+0x1b9/0x7ff [ 9744.668185][ C1] irq_exit_rcu+0x98/0xc0 [ 9744.668400][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9744.668677][ C1] [ 9744.668825][ C1] [ 9744.668970][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9744.669268][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9744.669584][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9744.670530][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9744.670830][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9744.671219][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9744.671607][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9744.671996][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9744.672385][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9744.672774][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9744.673064][ C1] pipe_read+0xa16/0xdf0 [ 9744.673279][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9744.673550][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9744.673825][ C1] ? iterate_tty_write+0x299/0x540 [ 9744.674087][ C1] ? lock_release+0x1d5/0x250 [ 9744.674330][ C1] vfs_read+0x911/0xc00 [ 9744.674544][ C1] ? lock_acquire+0x1c1/0x220 [ 9744.674783][ C1] ? __might_fault+0xc6/0x180 [ 9744.675030][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9744.675264][ C1] ? __might_fault+0xc6/0x180 [ 9744.675499][ C1] ? lock_release+0x1d5/0x250 [ 9744.675733][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9744.675989][ C1] ? __fget_light+0x54/0x1e0 [ 9744.676223][ C1] ksys_read+0x17a/0x1e0 [ 9744.676433][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9744.676672][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9744.676969][ C1] do_syscall_64+0xc9/0x1e0 [ 9744.677197][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9744.677488][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9744.677711][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9744.678655][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9744.679065][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9744.679456][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9744.679843][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9744.680231][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9744.680620][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9744.681012][ C1] [ 9772.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6910s! [swapper/2:0] [ 9772.569685][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9772.570899][ C2] irq event stamp: 44114564 [ 9772.571122][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9772.571640][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9772.572134][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9772.572598][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9772.573058][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9772.573504][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9772.574100][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [ 9772.574380][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [ 9772.575322][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [ 9772.575617][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9772.576006][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9772.576393][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9772.576778][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9772.577163][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9772.577551][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9772.577984][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9772.578307][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9772.578694][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9772.579078][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9772.579467][ C2] PKRU: 55555554 [ 9772.579644][ C2] Call Trace: [ 9772.579807][ C2] [ 9772.579951][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9772.580206][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9772.580440][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9772.580709][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9772.580972][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9772.581252][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9772.581509][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9772.581803][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9772.582056][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9772.582311][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9772.582609][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9772.582896][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9772.583202][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9772.583484][ C2] ? kasan_check_range+0x12/0x1c0 [ 9772.583758][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [ 9772.584040][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9772.584351][ C2] ? get_stack_info+0x36/0xc0 [ 9772.584589][ C2] ? lock_acquire+0x1c1/0x220 [ 9772.584836][ C2] ? lock_release+0x1d5/0x250 [ 9772.585068][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9772.585310][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9772.585574][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9772.585850][ C2] ? lock_acquire+0x1c1/0x220 [ 9772.586081][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9772.586316][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9772.586567][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9772.586795][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9772.587033][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9772.587288][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9772.587556][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9772.587824][ C2] ip_local_deliver+0x19d/0x480 [ 9772.588064][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9772.588328][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9772.588584][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9772.588924][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9772.589170][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9772.589481][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9772.589735][ C2] ip_rcv+0x564/0x740 [ 9772.589933][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9772.590156][ C2] ? set_track_prepare+0x8a/0xd0 [ 9772.590402][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9772.590673][ C2] ? start_secondary+0x21c/0x2b0 [ 9772.590917][ C2] ? skb_clone+0x10b/0x330 [ 9772.591136][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9772.591446][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9772.591743][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9772.592015][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9772.592305][ C2] ? __tcf_classify+0x329/0x7d0 [ 9772.592547][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9772.592769][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9772.593060][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9772.593336][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9772.593676][ C2] ? lock_acquire+0x1c1/0x220 [ 9772.593913][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9772.594210][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9772.594493][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9772.594816][ C2] ? __copy_skb_header+0xaf/0x490 [ 9772.595065][ C2] ? __skb_clone+0x57a/0x760 [ 9772.595294][ C2] netif_receive_skb+0x55/0x280 [ 9772.595535][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9772.595838][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9772.596161][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9772.596451][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9772.596719][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9772.596998][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9772.597302][ C2] ? get_stack_info+0x36/0xc0 [ 9772.597535][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9772.597794][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9772.598102][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9772.598371][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9772.598638][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9772.598944][ C2] ? kernel_text_address+0x17/0xe0 [ 9772.599199][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9772.599505][ C2] ? arch_stack_walk+0x8c/0x100 [ 9772.599747][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9772.600002][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9772.600280][ C2] ? lock_acquire+0x1c1/0x220 [ 9772.600510][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9772.600784][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9772.601078][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9772.601351][ C2] ? get_stack_info+0x36/0xc0 [ 9772.601584][ C2] __tcf_classify+0x329/0x7d0 [ 9772.601817][ C2] tcf_classify+0x283/0x930 [ 9772.602044][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9772.602294][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9772.602598][ C2] tc_run+0x2e4/0x5d0 [ 9772.602797][ C2] ? __pfx_tc_run+0x10/0x10 [ 9772.603020][ C2] ? lock_acquire+0x1c1/0x220 [ 9772.603252][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9772.603524][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9772.603777][ C2] ? lock_acquire+0x1c1/0x220 [ 9772.604016][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9772.604280][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9772.604583][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9772.604858][ C2] ? neigh_hh_output+0x348/0x590 [ 9772.605102][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9772.605359][ C2] ip_finish_output2+0x786/0x18e0 [ 9772.605608][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9772.605933][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9772.606204][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9772.606449][ C2] ? __ip_finish_output+0x10f/0x770 [ 9772.606705][ C2] ip_output+0x16b/0x4f0 [ 9772.606913][ C2] ? __pfx_ip_output+0x10/0x10 [ 9772.607150][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9772.607418][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9772.607722][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9772.607990][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9772.608234][ C2] ? __alloc_skb+0xd4/0x280 [ 9772.608458][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9772.608718][ C2] ? tcp_fragment+0x168/0x1040 [ 9772.608956][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9772.609201][ C2] ? ip_local_out+0x114/0x3b0 [ 9772.609434][ C2] __ip_queue_xmit+0x672/0x1910 [ 9772.609675][ C2] ? __skb_clone+0x57a/0x760 [ 9772.609901][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9772.610159][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9772.610434][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9772.610670][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9772.610910][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9772.611202][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9772.611513][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9772.611750][ C2] tcp_send_loss_probe+0x348/0x830 [ 9772.612002][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9772.612262][ C2] tcp_write_timer+0x82/0x1d0 [ 9772.612498][ C2] call_timer_fn+0x173/0x430 [ 9772.612728][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9772.612982][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9772.613236][ C2] __run_timers.part.0+0x52d/0x890 [ 9772.613492][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9772.613776][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9772.614058][ C2] ? lock_acquire+0x1c1/0x220 [ 9772.614297][ C2] ? clockevents_program_event+0xf6/0x300 [ 9772.614586][ C2] ? lock_release+0x1d5/0x250 [ 9772.614830][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9772.615087][ C2] ? ktime_get+0xb3/0x190 [ 9772.615301][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9772.615589][ C2] run_timer_softirq+0x72/0x100 [ 9772.615829][ C2] __do_softirq+0x1b9/0x7ff [ 9772.616054][ C2] irq_exit_rcu+0x98/0xc0 [ 9772.616270][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9772.616545][ C2] [ 9772.616690][ C2] [ 9772.616839][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9772.617133][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9772.617382][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9772.618323][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9772.618620][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9772.619009][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9772.619396][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9772.619781][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9772.620168][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9772.620558][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9772.620837][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9772.621088][ C2] default_idle_call+0x69/0xa0 [ 9772.621327][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9772.621570][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9772.621838][ C2] ? lock_release+0x1d5/0x250 [ 9772.622071][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9772.622335][ C2] do_idle+0xfb/0x160 [ 9772.622533][ C2] cpu_startup_entry+0x55/0x60 [ 9772.622767][ C2] start_secondary+0x21c/0x2b0 [ 9772.623004][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9772.623266][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9772.623593][ C2] [ 9772.623750][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6910s! [perl:4135] [ 9772.624164][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9772.625408][ C1] irq event stamp: 209232 [ 9772.625620][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9772.626134][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9772.626600][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9772.627057][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9772.627509][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9772.627949][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9772.628545][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9772.628861][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9772.629807][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9772.630108][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9772.630497][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9772.630889][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9772.631278][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9772.631667][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9772.632055][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9772.632493][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9772.632819][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9772.633211][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9772.633623][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9772.634026][ C1] PKRU: 55555554 [ 9772.634208][ C1] Call Trace: [ 9772.634380][ C1] [ 9772.634526][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9772.634797][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9772.635035][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9772.635306][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9772.635573][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9772.635854][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9772.636112][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9772.636412][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9772.636668][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9772.636968][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9772.637259][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9772.637566][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9772.637849][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9772.638138][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9772.638421][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9772.638724][ C1] ? get_stack_info+0x36/0xc0 [ 9772.638959][ C1] ? lock_acquire+0x1c1/0x220 [ 9772.639194][ C1] ? lock_release+0x1d5/0x250 [ 9772.639428][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9772.639671][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9772.639935][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9772.640216][ C1] ? lock_acquire+0x1c1/0x220 [ 9772.640449][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9772.640681][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9772.640934][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9772.641165][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9772.641408][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9772.641658][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9772.641926][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9772.642199][ C1] ip_local_deliver+0x19d/0x480 [ 9772.642439][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9772.642705][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9772.642963][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9772.643301][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9772.643567][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9772.643887][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9772.644151][ C1] ip_rcv+0x564/0x740 [ 9772.644354][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9772.644586][ C1] ? set_track_prepare+0x8a/0xd0 [ 9772.644845][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9772.645113][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9772.645379][ C1] ? skb_clone+0x10b/0x330 [ 9772.645602][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9772.645913][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9772.646212][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9772.646486][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9772.646773][ C1] ? __tcf_classify+0x329/0x7d0 [ 9772.647016][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9772.647243][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9772.647536][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9772.647814][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9772.648130][ C1] ? lock_acquire+0x1c1/0x220 [ 9772.648364][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9772.648653][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9772.648932][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9772.649243][ C1] ? __copy_skb_header+0xaf/0x490 [ 9772.649495][ C1] ? __skb_clone+0x57a/0x760 [ 9772.649724][ C1] netif_receive_skb+0x55/0x280 [ 9772.649964][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9772.650270][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9772.650593][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9772.650886][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9772.651153][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9772.651437][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9772.651740][ C1] ? hlock_class+0x4e/0x130 [ 9772.651968][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9772.652238][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9772.652509][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9772.652767][ C1] ? hlock_class+0x4e/0x130 [ 9772.652992][ C1] ? mark_lock+0x38/0x3e0 [ 9772.653208][ C1] ? stack_access_ok+0xda/0x1f0 [ 9772.653452][ C1] ? __lock_acquire+0xb67/0x1610 [ 9772.653729][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9772.654005][ C1] ? get_stack_info+0x36/0xc0 [ 9772.654247][ C1] ? stack_access_ok+0xda/0x1f0 [ 9772.654494][ C1] ? get_reg+0x119/0x190 [ 9772.654721][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9772.654982][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9772.655285][ C1] __tcf_classify+0x329/0x7d0 [ 9772.655521][ C1] tcf_classify+0x283/0x930 [ 9772.655745][ C1] ? arch_stack_walk+0xa2/0x100 [ 9772.655988][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9772.656239][ C1] ? get_stack_info+0x36/0xc0 [ 9772.656475][ C1] tc_run+0x2e4/0x5d0 [ 9772.656676][ C1] ? __pfx_tc_run+0x10/0x10 [ 9772.656902][ C1] ? lock_acquire+0x1c1/0x220 [ 9772.657136][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9772.657392][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9772.657639][ C1] ? lock_acquire+0x1c1/0x220 [ 9772.657869][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9772.658129][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9772.658427][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9772.658693][ C1] ? neigh_hh_output+0x348/0x590 [ 9772.658939][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9772.659200][ C1] ip_finish_output2+0x786/0x18e0 [ 9772.659449][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9772.659721][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9772.660050][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9772.660320][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9772.660567][ C1] ? __ip_finish_output+0x10f/0x770 [ 9772.660824][ C1] ip_output+0x16b/0x4f0 [ 9772.661037][ C1] ? run_timer_softirq+0x72/0x100 [ 9772.661289][ C1] ? __pfx_ip_output+0x10/0x10 [ 9772.661526][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9772.661805][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9772.662051][ C1] ? ip_local_out+0x114/0x3b0 [ 9772.662291][ C1] __ip_queue_xmit+0x672/0x1910 [ 9772.662532][ C1] ? __create_object+0x5e/0xb0 [ 9772.662768][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9772.663030][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9772.663306][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9772.663593][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9772.663874][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9772.664147][ C1] tcp_delack_timer+0x84/0x240 [ 9772.664392][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9772.664664][ C1] call_timer_fn+0x173/0x430 [ 9772.664904][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9772.665159][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9772.665416][ C1] __run_timers.part.0+0x52d/0x890 [ 9772.665669][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9772.665935][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9772.666214][ C1] ? lock_acquire+0x1c1/0x220 [ 9772.666448][ C1] ? clockevents_program_event+0xf6/0x300 [ 9772.666732][ C1] ? lock_release+0x1d5/0x250 [ 9772.666963][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9772.667224][ C1] ? ktime_get+0xb3/0x190 [ 9772.667439][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9772.667729][ C1] run_timer_softirq+0x72/0x100 [ 9772.667973][ C1] __do_softirq+0x1b9/0x7ff [ 9772.668202][ C1] irq_exit_rcu+0x98/0xc0 [ 9772.668416][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9772.668695][ C1] [ 9772.668840][ C1] [ 9772.668988][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9772.669286][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9772.669603][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9772.670551][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9772.670852][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9772.671243][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9772.671632][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9772.672020][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9772.672412][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9772.672805][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9772.673092][ C1] pipe_read+0xa16/0xdf0 [ 9772.673310][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9772.673602][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9772.673846][ C1] ? iterate_tty_write+0x299/0x540 [ 9772.674109][ C1] ? lock_release+0x1d5/0x250 [ 9772.674352][ C1] vfs_read+0x911/0xc00 [ 9772.674566][ C1] ? lock_acquire+0x1c1/0x220 [ 9772.674815][ C1] ? __might_fault+0xc6/0x180 [ 9772.675048][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9772.675281][ C1] ? __might_fault+0xc6/0x180 [ 9772.675516][ C1] ? lock_release+0x1d5/0x250 [ 9772.675754][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9772.676013][ C1] ? __fget_light+0x54/0x1e0 [ 9772.676246][ C1] ksys_read+0x17a/0x1e0 [ 9772.676458][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9772.676697][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9772.676993][ C1] do_syscall_64+0xc9/0x1e0 [ 9772.677223][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9772.677515][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9772.677736][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9772.678683][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9772.679093][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9772.679482][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9772.679871][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9772.680263][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9772.680651][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9772.681042][ C1] [ 9796.458104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9796.458457][ C1] rcu: 1-....: (7422634 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1753779 [ 9796.459002][ C1] rcu: (t=7441571 jiffies g=1882453 q=724 ncpus=4) [ 9796.459326][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9796.459762][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9796.460362][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [ 9796.460640][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [ 9796.461593][ C1] RSP: 0018:ffffc900001c7b60 EFLAGS: 00000282 [ 9796.461892][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9796.462282][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9796.462671][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9796.463059][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9796.463468][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9796.463868][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9796.464316][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9796.464658][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9796.465048][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9796.465436][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9796.465826][ C1] PKRU: 55555554 [ 9796.466002][ C1] Call Trace: [ 9796.466168][ C1] [ 9796.466313][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9796.466581][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9796.466827][ C1] ? check_cpu_stall+0x284/0x500 [ 9796.467072][ C1] ? rcu_pending+0x92/0x360 [ 9796.467298][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9796.467560][ C1] ? update_process_times+0xb9/0x110 [ 9796.467824][ C1] ? tick_sched_handle+0x67/0x130 [ 9796.468074][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9796.468354][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9796.468591][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9796.468896][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9796.469161][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9796.469441][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9796.469701][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9796.469998][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9796.470254][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9796.470556][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9796.470845][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9796.471152][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9796.471434][ C1] ? kasan_check_range+0x1a/0x1c0 [ 9796.471684][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9796.471958][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9796.472261][ C1] ? get_stack_info+0x36/0xc0 [ 9796.472497][ C1] ? lock_acquire+0x1c1/0x220 [ 9796.472732][ C1] ? lock_release+0x1d5/0x250 [ 9796.472966][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9796.473208][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9796.473497][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9796.473781][ C1] ? lock_acquire+0x1c1/0x220 [ 9796.474020][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9796.474263][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9796.474524][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9796.474764][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9796.475005][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9796.475256][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9796.475525][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9796.475796][ C1] ip_local_deliver+0x19d/0x480 [ 9796.476037][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9796.476303][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9796.476560][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9796.476898][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9796.477143][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9796.477457][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9796.477712][ C1] ip_rcv+0x564/0x740 [ 9796.477912][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9796.478136][ C1] ? set_track_prepare+0x8a/0xd0 [ 9796.478384][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9796.478653][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9796.478920][ C1] ? skb_clone+0x10b/0x330 [ 9796.479142][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9796.479455][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9796.479753][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9796.480026][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9796.480316][ C1] ? __tcf_classify+0x329/0x7d0 [ 9796.480560][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9796.480783][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9796.481076][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9796.481355][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9796.481671][ C1] ? lock_acquire+0x1c1/0x220 [ 9796.481903][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9796.482194][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9796.482471][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9796.482780][ C1] ? __copy_skb_header+0xaf/0x490 [ 9796.483031][ C1] ? __skb_clone+0x57a/0x760 [ 9796.483262][ C1] netif_receive_skb+0x55/0x280 [ 9796.483528][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9796.483840][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9796.484174][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9796.484472][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9796.484755][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9796.485034][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9796.485341][ C1] ? hlock_class+0x4e/0x130 [ 9796.485570][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9796.485840][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9796.486108][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9796.486365][ C1] ? hlock_class+0x4e/0x130 [ 9796.486594][ C1] ? mark_lock+0x38/0x3e0 [ 9796.486807][ C1] ? stack_access_ok+0xda/0x1f0 [ 9796.487050][ C1] ? __lock_acquire+0xb67/0x1610 [ 9796.487299][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9796.487567][ C1] ? get_stack_info+0x36/0xc0 [ 9796.487801][ C1] ? stack_access_ok+0xda/0x1f0 [ 9796.488041][ C1] ? get_reg+0x119/0x190 [ 9796.488252][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9796.488517][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9796.488817][ C1] __tcf_classify+0x329/0x7d0 [ 9796.489053][ C1] tcf_classify+0x283/0x930 [ 9796.489281][ C1] ? arch_stack_walk+0xa2/0x100 [ 9796.489524][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9796.489774][ C1] ? get_stack_info+0x36/0xc0 [ 9796.490007][ C1] tc_run+0x2e4/0x5d0 [ 9796.490209][ C1] ? __pfx_tc_run+0x10/0x10 [ 9796.490433][ C1] ? lock_acquire+0x1c1/0x220 [ 9796.490666][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9796.490921][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9796.491167][ C1] ? lock_acquire+0x1c1/0x220 [ 9796.491402][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9796.491660][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9796.491957][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9796.492223][ C1] ? neigh_hh_output+0x348/0x590 [ 9796.492470][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9796.492727][ C1] ip_finish_output2+0x786/0x18e0 [ 9796.492977][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9796.493248][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9796.493601][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9796.493880][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9796.494134][ C1] ? __ip_finish_output+0x10f/0x770 [ 9796.494399][ C1] ip_output+0x16b/0x4f0 [ 9796.494625][ C1] ? run_timer_softirq+0x72/0x100 [ 9796.494874][ C1] ? __pfx_ip_output+0x10/0x10 [ 9796.495112][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9796.495391][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9796.495636][ C1] ? ip_local_out+0x114/0x3b0 [ 9796.495871][ C1] __ip_queue_xmit+0x672/0x1910 [ 9796.496113][ C1] ? __create_object+0x5e/0xb0 [ 9796.496352][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9796.496612][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9796.496885][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9796.497151][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9796.497427][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9796.497692][ C1] tcp_delack_timer+0x84/0x240 [ 9796.497930][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9796.498195][ C1] call_timer_fn+0x173/0x430 [ 9796.498427][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9796.498681][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9796.498936][ C1] __run_timers.part.0+0x52d/0x890 [ 9796.499192][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9796.499457][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9796.499736][ C1] ? lock_acquire+0x1c1/0x220 [ 9796.499968][ C1] ? clockevents_program_event+0xf6/0x300 [ 9796.500252][ C1] ? lock_release+0x1d5/0x250 [ 9796.500486][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9796.500744][ C1] ? ktime_get+0xb3/0x190 [ 9796.500958][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9796.501249][ C1] run_timer_softirq+0x72/0x100 [ 9796.501491][ C1] __do_softirq+0x1b9/0x7ff [ 9796.501717][ C1] irq_exit_rcu+0x98/0xc0 [ 9796.501933][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9796.502211][ C1] [ 9796.502360][ C1] [ 9796.502506][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9796.502804][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9796.503122][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9796.504108][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9796.504418][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9796.504824][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9796.505213][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9796.505606][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9796.506000][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9796.506393][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9796.506684][ C1] pipe_read+0xa16/0xdf0 [ 9796.506899][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9796.507169][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9796.507408][ C1] ? iterate_tty_write+0x299/0x540 [ 9796.507663][ C1] ? lock_release+0x1d5/0x250 [ 9796.507899][ C1] vfs_read+0x911/0xc00 [ 9796.508108][ C1] ? lock_acquire+0x1c1/0x220 [ 9796.508343][ C1] ? __might_fault+0xc6/0x180 [ 9796.508579][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9796.508813][ C1] ? __might_fault+0xc6/0x180 [ 9796.509047][ C1] ? lock_release+0x1d5/0x250 [ 9796.509283][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9796.509542][ C1] ? __fget_light+0x54/0x1e0 [ 9796.509775][ C1] ksys_read+0x17a/0x1e0 [ 9796.509987][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9796.510227][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9796.510525][ C1] do_syscall_64+0xc9/0x1e0 [ 9796.510752][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9796.511045][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9796.511270][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9796.512221][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9796.512631][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9796.513023][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9796.513437][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9796.513837][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9796.514237][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9796.514656][ C1] [ 9796.514814][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9796.515085][ C2] NMI backtrace for cpu 2 [ 9796.515094][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9796.515100][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9796.515104][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9796.515110][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9796.515113][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9796.515116][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9796.515117][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9796.515119][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9796.515121][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9796.515122][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9796.515124][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9796.515126][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9796.515129][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9796.515130][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9796.515131][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9796.515133][ C2] PKRU: 55555554 [ 9796.515134][ C2] Call Trace: [ 9796.515136][ C2] [ 9796.515138][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9796.515144][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9796.515149][ C2] ? nmi_handle+0x153/0x420 [ 9796.515153][ C2] ? default_do_nmi+0x41/0x100 [ 9796.515156][ C2] ? exc_nmi+0xf3/0x120 [ 9796.515159][ C2] ? end_repeat_nmi+0xf/0x60 [ 9796.515164][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9796.515167][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9796.515171][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9796.515174][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9796.515177][ C2] [ 9796.515177][ C2] [ 9796.515179][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9796.515181][ C2] ? get_stack_info+0x36/0xc0 [ 9796.515185][ C2] ? lock_acquire+0x1c1/0x220 [ 9796.515188][ C2] ? lock_release+0x1d5/0x250 [ 9796.515192][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9796.515195][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9796.515198][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9796.515201][ C2] ? lock_acquire+0x1c1/0x220 [ 9796.515203][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9796.515207][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9796.515209][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9796.515215][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9796.515218][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9796.515222][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9796.515227][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9796.515230][ C2] ip_local_deliver+0x19d/0x480 [ 9796.515233][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9796.515235][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9796.515237][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9796.515242][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9796.515246][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9796.515249][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9796.515258][ C2] ip_rcv+0x564/0x740 [ 9796.515260][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9796.515263][ C2] ? set_track_prepare+0x8a/0xd0 [ 9796.515267][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9796.515270][ C2] ? start_secondary+0x21c/0x2b0 [ 9796.515274][ C2] ? skb_clone+0x10b/0x330 [ 9796.515276][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9796.515282][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9796.515287][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9796.515291][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9796.515299][ C2] ? __tcf_classify+0x329/0x7d0 [ 9796.515302][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9796.515304][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9796.515308][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9796.515311][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9796.515315][ C2] ? lock_acquire+0x1c1/0x220 [ 9796.515318][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9796.515322][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9796.515325][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9796.515329][ C2] ? __copy_skb_header+0xaf/0x490 [ 9796.515333][ C2] ? __skb_clone+0x57a/0x760 [ 9796.515335][ C2] netif_receive_skb+0x55/0x280 [ 9796.515338][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9796.515344][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9796.515351][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9796.515357][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9796.515361][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9796.515371][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9796.515378][ C2] ? get_stack_info+0x36/0xc0 [ 9796.515383][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9796.515385][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9796.515389][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9796.515391][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9796.515395][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9796.515397][ C2] ? kernel_text_address+0x17/0xe0 [ 9796.515400][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9796.515404][ C2] ? arch_stack_walk+0x8c/0x100 [ 9796.515408][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9796.515412][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9796.515415][ C2] ? lock_acquire+0x1c1/0x220 [ 9796.515417][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9796.515421][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9796.515425][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9796.515427][ C2] ? get_stack_info+0x36/0xc0 [ 9796.515431][ C2] __tcf_classify+0x329/0x7d0 [ 9796.515436][ C2] tcf_classify+0x283/0x930 [ 9796.515441][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9796.515444][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9796.515448][ C2] tc_run+0x2e4/0x5d0 [ 9796.515452][ C2] ? __pfx_tc_run+0x10/0x10 [ 9796.515454][ C2] ? lock_acquire+0x1c1/0x220 [ 9796.515457][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9796.515461][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9796.515465][ C2] ? lock_acquire+0x1c1/0x220 [ 9796.515467][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9796.515470][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9796.515473][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9796.515476][ C2] ? neigh_hh_output+0x348/0x590 [ 9796.515479][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9796.515483][ C2] ip_finish_output2+0x786/0x18e0 [ 9796.515486][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9796.515494][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9796.515497][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9796.515501][ C2] ? __ip_finish_output+0x10f/0x770 [ 9796.515504][ C2] ip_output+0x16b/0x4f0 [ 9796.515507][ C2] ? __pfx_ip_output+0x10/0x10 [ 9796.515509][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9796.515512][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9796.515515][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9796.515518][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9796.515521][ C2] ? __alloc_skb+0xd4/0x280 [ 9796.515523][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9796.515527][ C2] ? tcp_fragment+0x168/0x1040 [ 9796.515530][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9796.515533][ C2] ? ip_local_out+0x114/0x3b0 [ 9796.515536][ C2] __ip_queue_xmit+0x672/0x1910 [ 9796.515540][ C2] ? __skb_clone+0x57a/0x760 [ 9796.515542][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9796.515547][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9796.515550][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9796.515554][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9796.515558][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9796.515561][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9796.515564][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9796.515567][ C2] tcp_send_loss_probe+0x348/0x830 [ 9796.515570][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9796.515573][ C2] tcp_write_timer+0x82/0x1d0 [ 9796.515576][ C2] call_timer_fn+0x173/0x430 [ 9796.515580][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9796.515584][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9796.515588][ C2] __run_timers.part.0+0x52d/0x890 [ 9796.515591][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9796.515595][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9796.515598][ C2] ? lock_acquire+0x1c1/0x220 [ 9796.515600][ C2] ? clockevents_program_event+0xf6/0x300 [ 9796.515604][ C2] ? lock_release+0x1d5/0x250 [ 9796.515606][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9796.515610][ C2] ? ktime_get+0xb3/0x190 [ 9796.515613][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9796.515617][ C2] run_timer_softirq+0x72/0x100 [ 9796.515621][ C2] __do_softirq+0x1b9/0x7ff [ 9796.515625][ C2] irq_exit_rcu+0x98/0xc0 [ 9796.515627][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9796.515630][ C2] [ 9796.515632][ C2] [ 9796.515633][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9796.515636][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9796.515639][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9796.515641][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9796.515643][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9796.515645][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9796.515646][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9796.515647][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9796.515649][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9796.515652][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9796.515655][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9796.515658][ C2] default_idle_call+0x69/0xa0 [ 9796.515660][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9796.515662][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9796.515666][ C2] ? lock_release+0x1d5/0x250 [ 9796.515668][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9796.515672][ C2] do_idle+0xfb/0x160 [ 9796.515674][ C2] cpu_startup_entry+0x55/0x60 [ 9796.515677][ C2] start_secondary+0x21c/0x2b0 [ 9796.515679][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9796.515683][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9796.515688][ C2] [ 9820.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6955s! [swapper/2:0] [ 9820.569675][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9820.570891][ C2] irq event stamp: 44114564 [ 9820.571113][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9820.571633][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9820.572129][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9820.572591][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9820.573044][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9820.573490][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9820.574084][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [ 9820.574396][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [ 9820.575340][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9820.575638][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9820.576023][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9820.576412][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9820.576799][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9820.577186][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9820.577571][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9820.578003][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9820.578324][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9820.578714][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9820.579100][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9820.579486][ C2] PKRU: 55555554 [ 9820.579663][ C2] Call Trace: [ 9820.579829][ C2] [ 9820.579970][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9820.580225][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9820.580460][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9820.580727][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9820.580990][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9820.581272][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9820.581531][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9820.581827][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9820.582080][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9820.582335][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9820.582636][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9820.582920][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9820.583227][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9820.583534][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [ 9820.583819][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9820.584109][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9820.584420][ C2] ? get_stack_info+0x36/0xc0 [ 9820.584665][ C2] ? lock_acquire+0x1c1/0x220 [ 9820.584899][ C2] ? lock_release+0x1d5/0x250 [ 9820.585132][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9820.585397][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9820.585668][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9820.585951][ C2] ? lock_acquire+0x1c1/0x220 [ 9820.586189][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9820.586429][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9820.586693][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9820.586920][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9820.587158][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9820.587411][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9820.587676][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9820.587943][ C2] ip_local_deliver+0x19d/0x480 [ 9820.588184][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9820.588446][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9820.588700][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9820.589039][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9820.589285][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9820.589593][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9820.589847][ C2] ip_rcv+0x564/0x740 [ 9820.590044][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9820.590269][ C2] ? set_track_prepare+0x8a/0xd0 [ 9820.590514][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9820.590783][ C2] ? start_secondary+0x21c/0x2b0 [ 9820.591026][ C2] ? skb_clone+0x10b/0x330 [ 9820.591245][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9820.591554][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9820.591851][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9820.592124][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9820.592412][ C2] ? __tcf_classify+0x329/0x7d0 [ 9820.592652][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9820.592873][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9820.593164][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9820.593464][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9820.593788][ C2] ? lock_acquire+0x1c1/0x220 [ 9820.594025][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9820.594321][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9820.594612][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9820.594920][ C2] ? __copy_skb_header+0xaf/0x490 [ 9820.595170][ C2] ? __skb_clone+0x57a/0x760 [ 9820.595399][ C2] netif_receive_skb+0x55/0x280 [ 9820.595640][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9820.595942][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9820.596266][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9820.596554][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9820.596821][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9820.597101][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9820.597405][ C2] ? get_stack_info+0x36/0xc0 [ 9820.597638][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9820.597895][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9820.598201][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9820.598469][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9820.598736][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9820.599041][ C2] ? kernel_text_address+0x17/0xe0 [ 9820.599294][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9820.599597][ C2] ? arch_stack_walk+0x8c/0x100 [ 9820.599838][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9820.600094][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9820.600371][ C2] ? lock_acquire+0x1c1/0x220 [ 9820.600602][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9820.600876][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9820.601170][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9820.601441][ C2] ? get_stack_info+0x36/0xc0 [ 9820.601673][ C2] __tcf_classify+0x329/0x7d0 [ 9820.601907][ C2] tcf_classify+0x283/0x930 [ 9820.602133][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9820.602382][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9820.602686][ C2] tc_run+0x2e4/0x5d0 [ 9820.602885][ C2] ? __pfx_tc_run+0x10/0x10 [ 9820.603109][ C2] ? lock_acquire+0x1c1/0x220 [ 9820.603363][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9820.603622][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9820.603873][ C2] ? lock_acquire+0x1c1/0x220 [ 9820.604112][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9820.604376][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9820.604684][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9820.604947][ C2] ? neigh_hh_output+0x348/0x590 [ 9820.605192][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9820.605448][ C2] ip_finish_output2+0x786/0x18e0 [ 9820.605696][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9820.606023][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9820.606295][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9820.606540][ C2] ? __ip_finish_output+0x10f/0x770 [ 9820.606797][ C2] ip_output+0x16b/0x4f0 [ 9820.607006][ C2] ? __pfx_ip_output+0x10/0x10 [ 9820.607243][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9820.607509][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9820.607812][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9820.608080][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9820.608324][ C2] ? __alloc_skb+0xd4/0x280 [ 9820.608549][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9820.608808][ C2] ? tcp_fragment+0x168/0x1040 [ 9820.609045][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9820.609290][ C2] ? ip_local_out+0x114/0x3b0 [ 9820.609523][ C2] __ip_queue_xmit+0x672/0x1910 [ 9820.609764][ C2] ? __skb_clone+0x57a/0x760 [ 9820.609990][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9820.610249][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9820.610522][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9820.610758][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9820.611000][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9820.611292][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9820.611601][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9820.611838][ C2] tcp_send_loss_probe+0x348/0x830 [ 9820.612089][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9820.612351][ C2] tcp_write_timer+0x82/0x1d0 [ 9820.612583][ C2] call_timer_fn+0x173/0x430 [ 9820.612814][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9820.613068][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9820.613345][ C2] __run_timers.part.0+0x52d/0x890 [ 9820.613603][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9820.613870][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9820.614153][ C2] ? lock_acquire+0x1c1/0x220 [ 9820.614392][ C2] ? clockevents_program_event+0xf6/0x300 [ 9820.614687][ C2] ? lock_release+0x1d5/0x250 [ 9820.614921][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9820.615178][ C2] ? ktime_get+0xb3/0x190 [ 9820.615391][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9820.615678][ C2] run_timer_softirq+0x72/0x100 [ 9820.615918][ C2] __do_softirq+0x1b9/0x7ff [ 9820.616143][ C2] irq_exit_rcu+0x98/0xc0 [ 9820.616358][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9820.616633][ C2] [ 9820.616777][ C2] [ 9820.616925][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9820.617220][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9820.617468][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9820.618408][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9820.618705][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9820.619093][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9820.619480][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9820.619864][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9820.620251][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9820.620639][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9820.620917][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9820.621169][ C2] default_idle_call+0x69/0xa0 [ 9820.621406][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9820.621649][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9820.621916][ C2] ? lock_release+0x1d5/0x250 [ 9820.622148][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9820.622413][ C2] do_idle+0xfb/0x160 [ 9820.622611][ C2] cpu_startup_entry+0x55/0x60 [ 9820.622844][ C2] start_secondary+0x21c/0x2b0 [ 9820.623081][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9820.623365][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9820.623673][ C2] [ 9820.623830][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6955s! [perl:4135] [ 9820.624245][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9820.625480][ C1] irq event stamp: 209232 [ 9820.625691][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9820.626206][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9820.626688][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9820.627153][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9820.627615][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9820.628069][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9820.628665][ C1] RIP: 0010:kasan_check_range+0x66/0x1c0 [ 9820.628942][ C1] Code: 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df <4d> 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d [ 9820.629887][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 9820.630185][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9820.630576][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9820.630964][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9820.631354][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9820.631741][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9820.632129][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9820.632566][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9820.632889][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9820.633280][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9820.633698][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9820.634098][ C1] PKRU: 55555554 [ 9820.634280][ C1] Call Trace: [ 9820.634449][ C1] [ 9820.634605][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9820.634860][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9820.635095][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9820.635368][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9820.635634][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9820.635914][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9820.636174][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9820.636470][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9820.636723][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 9820.636978][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9820.637279][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9820.637568][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9820.637875][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9820.638155][ C1] ? kasan_check_range+0x66/0x1c0 [ 9820.638406][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9820.638680][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9820.638983][ C1] ? get_stack_info+0x36/0xc0 [ 9820.639218][ C1] ? lock_acquire+0x1c1/0x220 [ 9820.639454][ C1] ? lock_release+0x1d5/0x250 [ 9820.639689][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9820.639931][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9820.640196][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9820.640473][ C1] ? lock_acquire+0x1c1/0x220 [ 9820.640705][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9820.640940][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9820.641194][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9820.641422][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9820.641662][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9820.641912][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9820.642182][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9820.642452][ C1] ip_local_deliver+0x19d/0x480 [ 9820.642693][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9820.642957][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9820.643215][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9820.643579][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9820.643831][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9820.644152][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9820.644416][ C1] ip_rcv+0x564/0x740 [ 9820.644628][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9820.644850][ C1] ? set_track_prepare+0x8a/0xd0 [ 9820.645096][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9820.645368][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9820.645634][ C1] ? skb_clone+0x10b/0x330 [ 9820.645853][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9820.646165][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9820.646465][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9820.646738][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9820.647026][ C1] ? __tcf_classify+0x329/0x7d0 [ 9820.647270][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9820.647494][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9820.647786][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9820.648064][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9820.648382][ C1] ? lock_acquire+0x1c1/0x220 [ 9820.648613][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9820.648903][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9820.649181][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9820.649492][ C1] ? __copy_skb_header+0xaf/0x490 [ 9820.649742][ C1] ? __skb_clone+0x57a/0x760 [ 9820.649972][ C1] netif_receive_skb+0x55/0x280 [ 9820.650215][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9820.650519][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9820.650842][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9820.651134][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9820.651403][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9820.651682][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9820.651986][ C1] ? hlock_class+0x4e/0x130 [ 9820.652216][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9820.652484][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9820.652752][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9820.653007][ C1] ? hlock_class+0x4e/0x130 [ 9820.653235][ C1] ? mark_lock+0x38/0x3e0 [ 9820.653472][ C1] ? stack_access_ok+0xda/0x1f0 [ 9820.653720][ C1] ? __lock_acquire+0xb67/0x1610 [ 9820.653974][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9820.654251][ C1] ? get_stack_info+0x36/0xc0 [ 9820.654502][ C1] ? stack_access_ok+0xda/0x1f0 [ 9820.654742][ C1] ? get_reg+0x119/0x190 [ 9820.654952][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9820.655215][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9820.655517][ C1] __tcf_classify+0x329/0x7d0 [ 9820.655751][ C1] tcf_classify+0x283/0x930 [ 9820.655977][ C1] ? arch_stack_walk+0xa2/0x100 [ 9820.656224][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9820.656475][ C1] ? get_stack_info+0x36/0xc0 [ 9820.656709][ C1] tc_run+0x2e4/0x5d0 [ 9820.656910][ C1] ? __pfx_tc_run+0x10/0x10 [ 9820.657134][ C1] ? lock_acquire+0x1c1/0x220 [ 9820.657367][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9820.657621][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9820.657868][ C1] ? lock_acquire+0x1c1/0x220 [ 9820.658101][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9820.658360][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9820.658657][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9820.658922][ C1] ? neigh_hh_output+0x348/0x590 [ 9820.659170][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9820.659429][ C1] ip_finish_output2+0x786/0x18e0 [ 9820.659679][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9820.659948][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9820.660280][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9820.660549][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9820.660797][ C1] ? __ip_finish_output+0x10f/0x770 [ 9820.661056][ C1] ip_output+0x16b/0x4f0 [ 9820.661270][ C1] ? run_timer_softirq+0x72/0x100 [ 9820.661521][ C1] ? __pfx_ip_output+0x10/0x10 [ 9820.661759][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9820.662039][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9820.662285][ C1] ? ip_local_out+0x114/0x3b0 [ 9820.662520][ C1] __ip_queue_xmit+0x672/0x1910 [ 9820.662763][ C1] ? __create_object+0x5e/0xb0 [ 9820.663001][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9820.663262][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9820.663565][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9820.663841][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9820.664123][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9820.664396][ C1] tcp_delack_timer+0x84/0x240 [ 9820.664648][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9820.664911][ C1] call_timer_fn+0x173/0x430 [ 9820.665143][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9820.665398][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9820.665652][ C1] __run_timers.part.0+0x52d/0x890 [ 9820.665905][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9820.666171][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9820.666450][ C1] ? lock_acquire+0x1c1/0x220 [ 9820.666684][ C1] ? clockevents_program_event+0xf6/0x300 [ 9820.666964][ C1] ? lock_release+0x1d5/0x250 [ 9820.667199][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9820.667458][ C1] ? ktime_get+0xb3/0x190 [ 9820.667673][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9820.667961][ C1] run_timer_softirq+0x72/0x100 [ 9820.668204][ C1] __do_softirq+0x1b9/0x7ff [ 9820.668432][ C1] irq_exit_rcu+0x98/0xc0 [ 9820.668647][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9820.668926][ C1] [ 9820.669073][ C1] [ 9820.669219][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9820.669517][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9820.669832][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9820.670777][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9820.671077][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9820.671467][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9820.671859][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9820.672251][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9820.672640][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9820.673029][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9820.673341][ C1] pipe_read+0xa16/0xdf0 [ 9820.673560][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9820.673839][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9820.674082][ C1] ? iterate_tty_write+0x299/0x540 [ 9820.674345][ C1] ? lock_release+0x1d5/0x250 [ 9820.674595][ C1] vfs_read+0x911/0xc00 [ 9820.674804][ C1] ? lock_acquire+0x1c1/0x220 [ 9820.675036][ C1] ? __might_fault+0xc6/0x180 [ 9820.675272][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9820.675506][ C1] ? __might_fault+0xc6/0x180 [ 9820.675738][ C1] ? lock_release+0x1d5/0x250 [ 9820.675972][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9820.676230][ C1] ? __fget_light+0x54/0x1e0 [ 9820.676462][ C1] ksys_read+0x17a/0x1e0 [ 9820.676673][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9820.676912][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9820.677209][ C1] do_syscall_64+0xc9/0x1e0 [ 9820.677436][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9820.677726][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9820.677951][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9820.678895][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9820.679305][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9820.679694][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9820.680083][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9820.680472][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9820.680861][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9820.681255][ C1] [ 9848.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 6981s! [swapper/2:0] [ 9848.569707][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9848.570923][ C2] irq event stamp: 44114564 [ 9848.571147][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9848.571673][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9848.572169][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9848.572632][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9848.573089][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9848.573537][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9848.574130][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9848.574446][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9848.575389][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9848.575687][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9848.576071][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9848.576462][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9848.576848][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9848.577234][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9848.577619][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9848.578051][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9848.578377][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9848.578764][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9848.579149][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9848.579536][ C2] PKRU: 55555554 [ 9848.579712][ C2] Call Trace: [ 9848.579878][ C2] [ 9848.580020][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9848.580274][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9848.580511][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9848.580779][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9848.581044][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9848.581324][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9848.581581][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9848.581878][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9848.582131][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9848.582385][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9848.582684][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9848.582972][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9848.583283][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9848.583562][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9848.583849][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9848.584128][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9848.584430][ C2] ? get_stack_info+0x36/0xc0 [ 9848.584672][ C2] ? lock_acquire+0x1c1/0x220 [ 9848.584905][ C2] ? lock_release+0x1d5/0x250 [ 9848.585136][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9848.585379][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9848.585642][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9848.585920][ C2] ? lock_acquire+0x1c1/0x220 [ 9848.586152][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9848.586385][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9848.586638][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9848.586865][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9848.587105][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9848.587358][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9848.587625][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9848.587894][ C2] ip_local_deliver+0x19d/0x480 [ 9848.588133][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9848.588400][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9848.588657][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9848.588993][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9848.589241][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9848.589551][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9848.589808][ C2] ip_rcv+0x564/0x740 [ 9848.590005][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9848.590233][ C2] ? set_track_prepare+0x8a/0xd0 [ 9848.590480][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9848.590748][ C2] ? start_secondary+0x21c/0x2b0 [ 9848.590992][ C2] ? skb_clone+0x10b/0x330 [ 9848.591215][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9848.591525][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9848.591821][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9848.592098][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9848.592385][ C2] ? __tcf_classify+0x329/0x7d0 [ 9848.592628][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9848.592853][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9848.593143][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9848.593447][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9848.593773][ C2] ? lock_acquire+0x1c1/0x220 [ 9848.594012][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9848.594307][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9848.594600][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9848.594908][ C2] ? __copy_skb_header+0xaf/0x490 [ 9848.595159][ C2] ? __skb_clone+0x57a/0x760 [ 9848.595386][ C2] netif_receive_skb+0x55/0x280 [ 9848.595628][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9848.595932][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9848.596255][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9848.596547][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9848.596812][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9848.597092][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9848.597395][ C2] ? get_stack_info+0x36/0xc0 [ 9848.597631][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9848.597887][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9848.598195][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9848.598464][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9848.598736][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9848.599043][ C2] ? kernel_text_address+0x17/0xe0 [ 9848.599298][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9848.599602][ C2] ? arch_stack_walk+0x8c/0x100 [ 9848.599844][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9848.600103][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9848.600381][ C2] ? lock_acquire+0x1c1/0x220 [ 9848.600615][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9848.600890][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9848.601188][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9848.601456][ C2] ? get_stack_info+0x36/0xc0 [ 9848.601691][ C2] __tcf_classify+0x329/0x7d0 [ 9848.601928][ C2] tcf_classify+0x283/0x930 [ 9848.602153][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9848.602403][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9848.602709][ C2] tc_run+0x2e4/0x5d0 [ 9848.602907][ C2] ? __pfx_tc_run+0x10/0x10 [ 9848.603134][ C2] ? lock_acquire+0x1c1/0x220 [ 9848.603393][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9848.603653][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9848.603906][ C2] ? lock_acquire+0x1c1/0x220 [ 9848.604143][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9848.604419][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9848.604710][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9848.604978][ C2] ? neigh_hh_output+0x348/0x590 [ 9848.605224][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9848.605482][ C2] ip_finish_output2+0x786/0x18e0 [ 9848.605732][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9848.606064][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9848.606333][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9848.606579][ C2] ? __ip_finish_output+0x10f/0x770 [ 9848.606837][ C2] ip_output+0x16b/0x4f0 [ 9848.607050][ C2] ? __pfx_ip_output+0x10/0x10 [ 9848.607287][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9848.607558][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9848.607862][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9848.608130][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9848.608377][ C2] ? __alloc_skb+0xd4/0x280 [ 9848.608601][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9848.608865][ C2] ? tcp_fragment+0x168/0x1040 [ 9848.609103][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9848.609349][ C2] ? ip_local_out+0x114/0x3b0 [ 9848.609583][ C2] __ip_queue_xmit+0x672/0x1910 [ 9848.609825][ C2] ? __skb_clone+0x57a/0x760 [ 9848.610055][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9848.610316][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9848.610588][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9848.610827][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9848.611069][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9848.611364][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9848.611676][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9848.611912][ C2] tcp_send_loss_probe+0x348/0x830 [ 9848.612167][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9848.612430][ C2] tcp_write_timer+0x82/0x1d0 [ 9848.612664][ C2] call_timer_fn+0x173/0x430 [ 9848.612894][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9848.613149][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9848.613430][ C2] __run_timers.part.0+0x52d/0x890 [ 9848.613690][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9848.613962][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9848.614249][ C2] ? lock_acquire+0x1c1/0x220 [ 9848.614497][ C2] ? clockevents_program_event+0xf6/0x300 [ 9848.614777][ C2] ? lock_release+0x1d5/0x250 [ 9848.615010][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9848.615268][ C2] ? ktime_get+0xb3/0x190 [ 9848.615483][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9848.615771][ C2] run_timer_softirq+0x72/0x100 [ 9848.616012][ C2] __do_softirq+0x1b9/0x7ff [ 9848.616240][ C2] irq_exit_rcu+0x98/0xc0 [ 9848.616453][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9848.616731][ C2] [ 9848.616878][ C2] [ 9848.617023][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9848.617322][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9848.617571][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9848.618514][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9848.618813][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9848.619201][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9848.619590][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9848.619979][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9848.620367][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9848.620754][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9848.621037][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9848.621292][ C2] default_idle_call+0x69/0xa0 [ 9848.621529][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9848.621773][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9848.622042][ C2] ? lock_release+0x1d5/0x250 [ 9848.622276][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9848.622542][ C2] do_idle+0xfb/0x160 [ 9848.622740][ C2] cpu_startup_entry+0x55/0x60 [ 9848.622977][ C2] start_secondary+0x21c/0x2b0 [ 9848.623236][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9848.623505][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9848.623816][ C2] [ 9848.623972][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 6981s! [perl:4135] [ 9848.624399][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9848.625622][ C1] irq event stamp: 209232 [ 9848.625834][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9848.626348][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9848.626813][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9848.627271][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9848.627720][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9848.628156][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9848.628754][ C1] RIP: 0010:kasan_check_range+0x54/0x1c0 [ 9848.629032][ C1] Code: ff fe 48 39 c7 77 23 44 89 c2 e8 57 e8 ff ff 83 f0 01 5b 5d 41 5c c3 cc cc cc cc 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 76 dd <4c> 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 [ 9848.629978][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000212 [ 9848.630279][ C1] RAX: ffff7fffffffffff RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9848.630667][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9848.631057][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9848.631446][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9848.631835][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9848.632225][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9848.632660][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9848.632986][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9848.633402][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9848.633799][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9848.634198][ C1] PKRU: 55555554 [ 9848.634382][ C1] Call Trace: [ 9848.634559][ C1] [ 9848.634703][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9848.634957][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9848.635194][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9848.635465][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9848.635732][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9848.636012][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9848.636270][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9848.636568][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9848.636821][ C1] ? hrtimer_interrupt+0x31a/0x770 [ 9848.637075][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9848.637379][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9848.637667][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9848.637973][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9848.638258][ C1] ? kasan_check_range+0x54/0x1c0 [ 9848.638507][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [ 9848.638781][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9848.639085][ C1] ? get_stack_info+0x36/0xc0 [ 9848.639323][ C1] ? lock_acquire+0x1c1/0x220 [ 9848.639557][ C1] ? lock_release+0x1d5/0x250 [ 9848.639791][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9848.640032][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9848.640301][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9848.640578][ C1] ? lock_acquire+0x1c1/0x220 [ 9848.640811][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9848.641046][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9848.641301][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9848.641529][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9848.641770][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9848.642022][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9848.642290][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9848.642564][ C1] ip_local_deliver+0x19d/0x480 [ 9848.642806][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9848.643071][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9848.643353][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9848.643700][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9848.643952][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9848.644277][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9848.644546][ C1] ip_rcv+0x564/0x740 [ 9848.644745][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9848.644970][ C1] ? set_track_prepare+0x8a/0xd0 [ 9848.645218][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9848.645487][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9848.645754][ C1] ? skb_clone+0x10b/0x330 [ 9848.645974][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9848.646287][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9848.646587][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9848.646861][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9848.647149][ C1] ? __tcf_classify+0x329/0x7d0 [ 9848.647393][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9848.647617][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9848.647910][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9848.648188][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9848.648505][ C1] ? lock_acquire+0x1c1/0x220 [ 9848.648739][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9848.649029][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9848.649307][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9848.649615][ C1] ? __copy_skb_header+0xaf/0x490 [ 9848.649865][ C1] ? __skb_clone+0x57a/0x760 [ 9848.650095][ C1] netif_receive_skb+0x55/0x280 [ 9848.650338][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9848.650642][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9848.650966][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9848.651258][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9848.651526][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9848.651808][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9848.652114][ C1] ? hlock_class+0x4e/0x130 [ 9848.652341][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9848.652613][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9848.652881][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9848.653138][ C1] ? hlock_class+0x4e/0x130 [ 9848.653414][ C1] ? mark_lock+0x38/0x3e0 [ 9848.653633][ C1] ? stack_access_ok+0xda/0x1f0 [ 9848.653882][ C1] ? __lock_acquire+0xb67/0x1610 [ 9848.654137][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9848.654414][ C1] ? get_stack_info+0x36/0xc0 [ 9848.654659][ C1] ? stack_access_ok+0xda/0x1f0 [ 9848.654900][ C1] ? get_reg+0x119/0x190 [ 9848.655110][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9848.655372][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9848.655673][ C1] __tcf_classify+0x329/0x7d0 [ 9848.655909][ C1] tcf_classify+0x283/0x930 [ 9848.656136][ C1] ? arch_stack_walk+0xa2/0x100 [ 9848.656379][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9848.656629][ C1] ? get_stack_info+0x36/0xc0 [ 9848.656863][ C1] tc_run+0x2e4/0x5d0 [ 9848.657064][ C1] ? __pfx_tc_run+0x10/0x10 [ 9848.657291][ C1] ? lock_acquire+0x1c1/0x220 [ 9848.657525][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9848.657779][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9848.658027][ C1] ? lock_acquire+0x1c1/0x220 [ 9848.658262][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9848.658520][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9848.658817][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9848.659083][ C1] ? neigh_hh_output+0x348/0x590 [ 9848.659331][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9848.659589][ C1] ip_finish_output2+0x786/0x18e0 [ 9848.659839][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9848.660109][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9848.660438][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9848.660709][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9848.660954][ C1] ? __ip_finish_output+0x10f/0x770 [ 9848.661215][ C1] ip_output+0x16b/0x4f0 [ 9848.661425][ C1] ? run_timer_softirq+0x72/0x100 [ 9848.661675][ C1] ? __pfx_ip_output+0x10/0x10 [ 9848.661913][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9848.662191][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9848.662437][ C1] ? ip_local_out+0x114/0x3b0 [ 9848.662672][ C1] __ip_queue_xmit+0x672/0x1910 [ 9848.662914][ C1] ? __create_object+0x5e/0xb0 [ 9848.663153][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9848.663439][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9848.663719][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9848.663990][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9848.664275][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9848.664552][ C1] tcp_delack_timer+0x84/0x240 [ 9848.664790][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9848.665054][ C1] call_timer_fn+0x173/0x430 [ 9848.665286][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9848.665540][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9848.665794][ C1] __run_timers.part.0+0x52d/0x890 [ 9848.666048][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9848.666315][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9848.666594][ C1] ? lock_acquire+0x1c1/0x220 [ 9848.666824][ C1] ? clockevents_program_event+0xf6/0x300 [ 9848.667109][ C1] ? lock_release+0x1d5/0x250 [ 9848.667344][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9848.667602][ C1] ? ktime_get+0xb3/0x190 [ 9848.667816][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9848.668106][ C1] run_timer_softirq+0x72/0x100 [ 9848.668350][ C1] __do_softirq+0x1b9/0x7ff [ 9848.668575][ C1] irq_exit_rcu+0x98/0xc0 [ 9848.668791][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9848.669068][ C1] [ 9848.669217][ C1] [ 9848.669363][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9848.669662][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9848.669979][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9848.670923][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9848.671227][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9848.671617][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9848.672005][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9848.672395][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9848.672785][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9848.673177][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9848.673493][ C1] pipe_read+0xa16/0xdf0 [ 9848.673713][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9848.673990][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9848.674239][ C1] ? iterate_tty_write+0x299/0x540 [ 9848.674510][ C1] ? lock_release+0x1d5/0x250 [ 9848.674747][ C1] vfs_read+0x911/0xc00 [ 9848.674956][ C1] ? lock_acquire+0x1c1/0x220 [ 9848.675190][ C1] ? __might_fault+0xc6/0x180 [ 9848.675426][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9848.675659][ C1] ? __might_fault+0xc6/0x180 [ 9848.675893][ C1] ? lock_release+0x1d5/0x250 [ 9848.676126][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9848.676386][ C1] ? __fget_light+0x54/0x1e0 [ 9848.676619][ C1] ksys_read+0x17a/0x1e0 [ 9848.676830][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9848.677069][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9848.677369][ C1] do_syscall_64+0xc9/0x1e0 [ 9848.677593][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9848.677886][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9848.678116][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9848.679064][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9848.679473][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9848.679868][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9848.680258][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9848.680647][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9848.681035][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9848.681431][ C1] [ 9874.516104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9874.516455][ C1] rcu: 1-....: (7500414 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1769944 [ 9874.516999][ C1] rcu: (t=7519629 jiffies g=1882453 q=724 ncpus=4) [ 9874.517324][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9874.517759][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9874.518353][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9874.518672][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9874.519618][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9874.519917][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9874.520307][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9874.520694][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9874.521079][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9874.521468][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9874.521857][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9874.522291][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9874.522615][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9874.523003][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9874.523396][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9874.523786][ C1] PKRU: 55555554 [ 9874.523962][ C1] Call Trace: [ 9874.524126][ C1] [ 9874.524272][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9874.524537][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9874.524783][ C1] ? check_cpu_stall+0x284/0x500 [ 9874.525029][ C1] ? rcu_pending+0x92/0x360 [ 9874.525253][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9874.525516][ C1] ? update_process_times+0xb9/0x110 [ 9874.525780][ C1] ? tick_sched_handle+0x67/0x130 [ 9874.526028][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9874.526305][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9874.526541][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9874.526845][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9874.527111][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9874.527393][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9874.527651][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9874.527946][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9874.528202][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9874.528504][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9874.528792][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9874.529098][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9874.529379][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9874.529667][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9874.529947][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9874.530250][ C1] ? get_stack_info+0x36/0xc0 [ 9874.530485][ C1] ? lock_acquire+0x1c1/0x220 [ 9874.530720][ C1] ? lock_release+0x1d5/0x250 [ 9874.530953][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9874.531194][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9874.531461][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9874.531737][ C1] ? lock_acquire+0x1c1/0x220 [ 9874.531970][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9874.532205][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9874.532459][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9874.532687][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9874.532928][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9874.533182][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9874.533453][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9874.533724][ C1] ip_local_deliver+0x19d/0x480 [ 9874.533965][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9874.534232][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9874.534487][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9874.534825][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9874.535071][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9874.535383][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9874.535638][ C1] ip_rcv+0x564/0x740 [ 9874.535840][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9874.536064][ C1] ? set_track_prepare+0x8a/0xd0 [ 9874.536312][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9874.536579][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9874.536846][ C1] ? skb_clone+0x10b/0x330 [ 9874.537068][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9874.537378][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9874.537676][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9874.537948][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9874.538238][ C1] ? __tcf_classify+0x329/0x7d0 [ 9874.538480][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9874.538702][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9874.538994][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9874.539271][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9874.539589][ C1] ? lock_acquire+0x1c1/0x220 [ 9874.539820][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9874.540109][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9874.540386][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9874.540700][ C1] ? __copy_skb_header+0xaf/0x490 [ 9874.540950][ C1] ? __skb_clone+0x57a/0x760 [ 9874.541180][ C1] netif_receive_skb+0x55/0x280 [ 9874.541422][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9874.541726][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9874.542049][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9874.542339][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9874.542606][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9874.542886][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9874.543215][ C1] ? hlock_class+0x4e/0x130 [ 9874.543445][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9874.543722][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9874.543996][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9874.544272][ C1] ? hlock_class+0x4e/0x130 [ 9874.544497][ C1] ? mark_lock+0x38/0x3e0 [ 9874.544709][ C1] ? stack_access_ok+0xda/0x1f0 [ 9874.544951][ C1] ? __lock_acquire+0xb67/0x1610 [ 9874.545198][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9874.545466][ C1] ? get_stack_info+0x36/0xc0 [ 9874.545700][ C1] ? stack_access_ok+0xda/0x1f0 [ 9874.545940][ C1] ? get_reg+0x119/0x190 [ 9874.546149][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9874.546413][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9874.546712][ C1] __tcf_classify+0x329/0x7d0 [ 9874.546947][ C1] tcf_classify+0x283/0x930 [ 9874.547173][ C1] ? arch_stack_walk+0xa2/0x100 [ 9874.547416][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9874.547666][ C1] ? get_stack_info+0x36/0xc0 [ 9874.547898][ C1] tc_run+0x2e4/0x5d0 [ 9874.548099][ C1] ? __pfx_tc_run+0x10/0x10 [ 9874.548324][ C1] ? lock_acquire+0x1c1/0x220 [ 9874.548556][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9874.548810][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9874.549056][ C1] ? lock_acquire+0x1c1/0x220 [ 9874.549289][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9874.549554][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9874.549850][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9874.550115][ C1] ? neigh_hh_output+0x348/0x590 [ 9874.550362][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9874.550619][ C1] ip_finish_output2+0x786/0x18e0 [ 9874.550868][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9874.551137][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9874.551474][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9874.551744][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9874.551989][ C1] ? __ip_finish_output+0x10f/0x770 [ 9874.552248][ C1] ip_output+0x16b/0x4f0 [ 9874.552457][ C1] ? run_timer_softirq+0x72/0x100 [ 9874.552706][ C1] ? __pfx_ip_output+0x10/0x10 [ 9874.552944][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9874.553245][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9874.553496][ C1] ? ip_local_out+0x114/0x3b0 [ 9874.553736][ C1] __ip_queue_xmit+0x672/0x1910 [ 9874.553986][ C1] ? __create_object+0x5e/0xb0 [ 9874.554231][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9874.554503][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9874.554796][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9874.555068][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9874.555351][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9874.555622][ C1] tcp_delack_timer+0x84/0x240 [ 9874.555867][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9874.556142][ C1] call_timer_fn+0x173/0x430 [ 9874.556373][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9874.556628][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9874.556882][ C1] __run_timers.part.0+0x52d/0x890 [ 9874.557135][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9874.557401][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9874.557680][ C1] ? lock_acquire+0x1c1/0x220 [ 9874.557911][ C1] ? clockevents_program_event+0xf6/0x300 [ 9874.558194][ C1] ? lock_release+0x1d5/0x250 [ 9874.558428][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9874.558685][ C1] ? ktime_get+0xb3/0x190 [ 9874.558898][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9874.559189][ C1] run_timer_softirq+0x72/0x100 [ 9874.559431][ C1] __do_softirq+0x1b9/0x7ff [ 9874.559655][ C1] irq_exit_rcu+0x98/0xc0 [ 9874.559871][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9874.560147][ C1] [ 9874.560297][ C1] [ 9874.560443][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9874.560741][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9874.561058][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9874.562007][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9874.562309][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9874.562698][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9874.563107][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9874.563508][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9874.563909][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9874.564323][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9874.564612][ C1] pipe_read+0xa16/0xdf0 [ 9874.564827][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9874.565097][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9874.565336][ C1] ? iterate_tty_write+0x299/0x540 [ 9874.565592][ C1] ? lock_release+0x1d5/0x250 [ 9874.565827][ C1] vfs_read+0x911/0xc00 [ 9874.566035][ C1] ? lock_acquire+0x1c1/0x220 [ 9874.566270][ C1] ? __might_fault+0xc6/0x180 [ 9874.566506][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9874.566739][ C1] ? __might_fault+0xc6/0x180 [ 9874.566972][ C1] ? lock_release+0x1d5/0x250 [ 9874.567208][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9874.567467][ C1] ? __fget_light+0x54/0x1e0 [ 9874.567700][ C1] ksys_read+0x17a/0x1e0 [ 9874.567911][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9874.568150][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9874.568450][ C1] do_syscall_64+0xc9/0x1e0 [ 9874.568676][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9874.568969][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9874.569192][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9874.570141][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9874.570553][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9874.570944][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9874.571334][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9874.571723][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9874.572111][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9874.572505][ C1] [ 9874.572662][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9874.572931][ C2] NMI backtrace for cpu 2 [ 9874.572937][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9874.572942][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9874.572946][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9874.572954][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9874.572959][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9874.572964][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9874.572968][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9874.572971][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9874.572975][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9874.572979][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9874.572983][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9874.572987][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9874.572992][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9874.572996][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9874.572999][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9874.573002][ C2] PKRU: 55555554 [ 9874.573004][ C2] Call Trace: [ 9874.573007][ C2] [ 9874.573010][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9874.573022][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9874.573030][ C2] ? nmi_handle+0x153/0x420 [ 9874.573040][ C2] ? default_do_nmi+0x41/0x100 [ 9874.573046][ C2] ? exc_nmi+0xf3/0x120 [ 9874.573052][ C2] ? end_repeat_nmi+0xf/0x60 [ 9874.573061][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9874.573064][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9874.573067][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9874.573071][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9874.573073][ C2] [ 9874.573075][ C2] [ 9874.573076][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9874.573079][ C2] ? get_stack_info+0x36/0xc0 [ 9874.573099][ C2] ? lock_acquire+0x1c1/0x220 [ 9874.573103][ C2] ? lock_release+0x1d5/0x250 [ 9874.573106][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9874.573110][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9874.573113][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9874.573116][ C2] ? lock_acquire+0x1c1/0x220 [ 9874.573119][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9874.573122][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9874.573125][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9874.573131][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9874.573133][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9874.573138][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9874.573142][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9874.573146][ C2] ip_local_deliver+0x19d/0x480 [ 9874.573148][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9874.573150][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9874.573153][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9874.573158][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9874.573162][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9874.573165][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9874.573174][ C2] ip_rcv+0x564/0x740 [ 9874.573176][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9874.573179][ C2] ? set_track_prepare+0x8a/0xd0 [ 9874.573182][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9874.573185][ C2] ? start_secondary+0x21c/0x2b0 [ 9874.573188][ C2] ? skb_clone+0x10b/0x330 [ 9874.573191][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9874.573197][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9874.573202][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9874.573206][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9874.573214][ C2] ? __tcf_classify+0x329/0x7d0 [ 9874.573217][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9874.573219][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9874.573223][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9874.573226][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9874.573230][ C2] ? lock_acquire+0x1c1/0x220 [ 9874.573233][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9874.573237][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9874.573240][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9874.573245][ C2] ? __copy_skb_header+0xaf/0x490 [ 9874.573249][ C2] ? __skb_clone+0x57a/0x760 [ 9874.573251][ C2] netif_receive_skb+0x55/0x280 [ 9874.573254][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9874.573261][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9874.573267][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9874.573274][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9874.573279][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9874.573288][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9874.573296][ C2] ? get_stack_info+0x36/0xc0 [ 9874.573300][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9874.573303][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9874.573306][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9874.573309][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9874.573312][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9874.573314][ C2] ? kernel_text_address+0x17/0xe0 [ 9874.573317][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9874.573320][ C2] ? arch_stack_walk+0x8c/0x100 [ 9874.573324][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9874.573327][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9874.573330][ C2] ? lock_acquire+0x1c1/0x220 [ 9874.573332][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9874.573336][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9874.573340][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9874.573343][ C2] ? get_stack_info+0x36/0xc0 [ 9874.573347][ C2] __tcf_classify+0x329/0x7d0 [ 9874.573352][ C2] tcf_classify+0x283/0x930 [ 9874.573356][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9874.573359][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9874.573364][ C2] tc_run+0x2e4/0x5d0 [ 9874.573367][ C2] ? __pfx_tc_run+0x10/0x10 [ 9874.573370][ C2] ? lock_acquire+0x1c1/0x220 [ 9874.573372][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9874.573376][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9874.573380][ C2] ? lock_acquire+0x1c1/0x220 [ 9874.573383][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9874.573386][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9874.573389][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9874.573392][ C2] ? neigh_hh_output+0x348/0x590 [ 9874.573395][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9874.573399][ C2] ip_finish_output2+0x786/0x18e0 [ 9874.573402][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9874.573410][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9874.573412][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9874.573416][ C2] ? __ip_finish_output+0x10f/0x770 [ 9874.573420][ C2] ip_output+0x16b/0x4f0 [ 9874.573423][ C2] ? __pfx_ip_output+0x10/0x10 [ 9874.573425][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9874.573428][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9874.573431][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9874.573434][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9874.573436][ C2] ? __alloc_skb+0xd4/0x280 [ 9874.573439][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9874.573442][ C2] ? tcp_fragment+0x168/0x1040 [ 9874.573445][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9874.573448][ C2] ? ip_local_out+0x114/0x3b0 [ 9874.573452][ C2] __ip_queue_xmit+0x672/0x1910 [ 9874.573455][ C2] ? __skb_clone+0x57a/0x760 [ 9874.573458][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9874.573463][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9874.573466][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9874.573470][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9874.573473][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9874.573477][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9874.573480][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9874.573483][ C2] tcp_send_loss_probe+0x348/0x830 [ 9874.573487][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9874.573489][ C2] tcp_write_timer+0x82/0x1d0 [ 9874.573492][ C2] call_timer_fn+0x173/0x430 [ 9874.573496][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9874.573501][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9874.573505][ C2] __run_timers.part.0+0x52d/0x890 [ 9874.573508][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9874.573512][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9874.573515][ C2] ? lock_acquire+0x1c1/0x220 [ 9874.573517][ C2] ? clockevents_program_event+0xf6/0x300 [ 9874.573521][ C2] ? lock_release+0x1d5/0x250 [ 9874.573524][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9874.573527][ C2] ? ktime_get+0xb3/0x190 [ 9874.573530][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9874.573535][ C2] run_timer_softirq+0x72/0x100 [ 9874.573538][ C2] __do_softirq+0x1b9/0x7ff [ 9874.573543][ C2] irq_exit_rcu+0x98/0xc0 [ 9874.573545][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9874.573548][ C2] [ 9874.573549][ C2] [ 9874.573550][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9874.573554][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9874.573557][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9874.573559][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9874.573561][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9874.573562][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9874.573563][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9874.573565][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9874.573566][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9874.573569][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9874.573572][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9874.573575][ C2] default_idle_call+0x69/0xa0 [ 9874.573578][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9874.573580][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9874.573584][ C2] ? lock_release+0x1d5/0x250 [ 9874.573586][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9874.573590][ C2] do_idle+0xfb/0x160 [ 9874.573592][ C2] cpu_startup_entry+0x55/0x60 [ 9874.573594][ C2] start_secondary+0x21c/0x2b0 [ 9874.573597][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9874.573601][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9874.573607][ C2] [ 9900.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7029s! [swapper/2:0] [ 9900.569677][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9900.570894][ C2] irq event stamp: 44114564 [ 9900.571113][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9900.571639][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9900.572135][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9900.572597][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9900.573080][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9900.573536][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9900.574155][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9900.574469][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9900.575410][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9900.575708][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9900.576092][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9900.576483][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9900.576870][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9900.577257][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9900.577641][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9900.578073][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9900.578398][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9900.578787][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9900.579173][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9900.579559][ C2] PKRU: 55555554 [ 9900.579736][ C2] Call Trace: [ 9900.579902][ C2] [ 9900.580045][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9900.580300][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9900.580537][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9900.580805][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9900.581071][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9900.581350][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9900.581607][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9900.581904][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9900.582157][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9900.582411][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9900.582711][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9900.583026][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9900.583339][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9900.583628][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9900.583922][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9900.584209][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9900.584524][ C2] ? get_stack_info+0x36/0xc0 [ 9900.584758][ C2] ? lock_acquire+0x1c1/0x220 [ 9900.584991][ C2] ? lock_release+0x1d5/0x250 [ 9900.585224][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9900.585467][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9900.585730][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9900.586008][ C2] ? lock_acquire+0x1c1/0x220 [ 9900.586241][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9900.586473][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9900.586725][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9900.586954][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9900.587193][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9900.587446][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9900.587712][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9900.587981][ C2] ip_local_deliver+0x19d/0x480 [ 9900.588221][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9900.588486][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9900.588741][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9900.589077][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9900.589324][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9900.589634][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9900.589889][ C2] ip_rcv+0x564/0x740 [ 9900.590086][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9900.590312][ C2] ? set_track_prepare+0x8a/0xd0 [ 9900.590558][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9900.590826][ C2] ? start_secondary+0x21c/0x2b0 [ 9900.591070][ C2] ? skb_clone+0x10b/0x330 [ 9900.591291][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9900.591601][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9900.591896][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9900.592176][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9900.592461][ C2] ? __tcf_classify+0x329/0x7d0 [ 9900.592702][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9900.592926][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9900.593242][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9900.593527][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9900.593852][ C2] ? lock_acquire+0x1c1/0x220 [ 9900.594090][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9900.594390][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9900.594668][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9900.594975][ C2] ? __copy_skb_header+0xaf/0x490 [ 9900.595225][ C2] ? __skb_clone+0x57a/0x760 [ 9900.595451][ C2] netif_receive_skb+0x55/0x280 [ 9900.595692][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9900.595995][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9900.596320][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9900.596610][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9900.596876][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9900.597155][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9900.597459][ C2] ? get_stack_info+0x36/0xc0 [ 9900.597693][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9900.597949][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9900.598258][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9900.598525][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9900.598794][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9900.599099][ C2] ? kernel_text_address+0x17/0xe0 [ 9900.599352][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9900.599655][ C2] ? arch_stack_walk+0x8c/0x100 [ 9900.599897][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9900.600154][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9900.600434][ C2] ? lock_acquire+0x1c1/0x220 [ 9900.600666][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9900.600939][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9900.601236][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9900.601504][ C2] ? get_stack_info+0x36/0xc0 [ 9900.601737][ C2] __tcf_classify+0x329/0x7d0 [ 9900.601971][ C2] tcf_classify+0x283/0x930 [ 9900.602196][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9900.602445][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9900.602753][ C2] tc_run+0x2e4/0x5d0 [ 9900.602956][ C2] ? __pfx_tc_run+0x10/0x10 [ 9900.603206][ C2] ? lock_acquire+0x1c1/0x220 [ 9900.603444][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9900.603704][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9900.603956][ C2] ? lock_acquire+0x1c1/0x220 [ 9900.604202][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9900.604460][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9900.604754][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9900.605018][ C2] ? neigh_hh_output+0x348/0x590 [ 9900.605264][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9900.605521][ C2] ip_finish_output2+0x786/0x18e0 [ 9900.605770][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9900.606098][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9900.606366][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9900.606611][ C2] ? __ip_finish_output+0x10f/0x770 [ 9900.606868][ C2] ip_output+0x16b/0x4f0 [ 9900.607078][ C2] ? __pfx_ip_output+0x10/0x10 [ 9900.607314][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9900.607585][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9900.607887][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9900.608155][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9900.608401][ C2] ? __alloc_skb+0xd4/0x280 [ 9900.608622][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9900.608886][ C2] ? tcp_fragment+0x168/0x1040 [ 9900.609121][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9900.609367][ C2] ? ip_local_out+0x114/0x3b0 [ 9900.609601][ C2] __ip_queue_xmit+0x672/0x1910 [ 9900.609842][ C2] ? __skb_clone+0x57a/0x760 [ 9900.610071][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9900.610332][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9900.610603][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9900.610840][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9900.611081][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9900.611373][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9900.611684][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9900.611920][ C2] tcp_send_loss_probe+0x348/0x830 [ 9900.612173][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9900.612436][ C2] tcp_write_timer+0x82/0x1d0 [ 9900.612667][ C2] call_timer_fn+0x173/0x430 [ 9900.612897][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9900.613177][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9900.613437][ C2] __run_timers.part.0+0x52d/0x890 [ 9900.613696][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9900.613965][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9900.614260][ C2] ? lock_acquire+0x1c1/0x220 [ 9900.614491][ C2] ? clockevents_program_event+0xf6/0x300 [ 9900.614773][ C2] ? lock_release+0x1d5/0x250 [ 9900.615006][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9900.615263][ C2] ? ktime_get+0xb3/0x190 [ 9900.615477][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9900.615766][ C2] run_timer_softirq+0x72/0x100 [ 9900.616006][ C2] __do_softirq+0x1b9/0x7ff [ 9900.616232][ C2] irq_exit_rcu+0x98/0xc0 [ 9900.616446][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9900.616721][ C2] [ 9900.616872][ C2] [ 9900.617017][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9900.617313][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9900.617561][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9900.618501][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9900.618799][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9900.619185][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9900.619571][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9900.619958][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9900.620346][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9900.620733][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9900.621014][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9900.621270][ C2] default_idle_call+0x69/0xa0 [ 9900.621506][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9900.621749][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9900.622020][ C2] ? lock_release+0x1d5/0x250 [ 9900.622252][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9900.622519][ C2] do_idle+0xfb/0x160 [ 9900.622716][ C2] cpu_startup_entry+0x55/0x60 [ 9900.622956][ C2] start_secondary+0x21c/0x2b0 [ 9900.623215][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9900.623484][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9900.623792][ C2] [ 9900.623950][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7029s! [perl:4135] [ 9900.624367][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9900.625586][ C1] irq event stamp: 209232 [ 9900.625799][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9900.626312][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9900.626780][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9900.627237][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9900.627684][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9900.628120][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9900.628718][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9900.629034][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9900.629980][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9900.630282][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9900.630671][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9900.631059][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9900.631449][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9900.631840][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9900.632230][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9900.632664][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9900.633009][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9900.633411][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9900.633813][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9900.634222][ C1] PKRU: 55555554 [ 9900.634399][ C1] Call Trace: [ 9900.634565][ C1] [ 9900.634709][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9900.634964][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9900.635202][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9900.635472][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9900.635737][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9900.636020][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9900.636280][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9900.636579][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9900.636835][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9900.637136][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9900.637423][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9900.637729][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9900.638011][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9900.638298][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9900.638581][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9900.638885][ C1] ? get_stack_info+0x36/0xc0 [ 9900.639117][ C1] ? lock_acquire+0x1c1/0x220 [ 9900.639353][ C1] ? lock_release+0x1d5/0x250 [ 9900.639588][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9900.639830][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9900.640095][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9900.640374][ C1] ? lock_acquire+0x1c1/0x220 [ 9900.640607][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9900.640842][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9900.641095][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9900.641325][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9900.641564][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9900.641815][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9900.642084][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9900.642354][ C1] ip_local_deliver+0x19d/0x480 [ 9900.642596][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9900.642860][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9900.643141][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9900.643490][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9900.643742][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9900.644061][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9900.644329][ C1] ip_rcv+0x564/0x740 [ 9900.644528][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9900.644751][ C1] ? set_track_prepare+0x8a/0xd0 [ 9900.644998][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9900.645270][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9900.645535][ C1] ? skb_clone+0x10b/0x330 [ 9900.645754][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9900.646064][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9900.646365][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9900.646638][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9900.646925][ C1] ? __tcf_classify+0x329/0x7d0 [ 9900.647167][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9900.647392][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9900.647683][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9900.647961][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9900.648279][ C1] ? lock_acquire+0x1c1/0x220 [ 9900.648511][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9900.648798][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9900.649076][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9900.649387][ C1] ? __copy_skb_header+0xaf/0x490 [ 9900.649637][ C1] ? __skb_clone+0x57a/0x760 [ 9900.649866][ C1] netif_receive_skb+0x55/0x280 [ 9900.650107][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9900.650412][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9900.650736][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9900.651028][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9900.651297][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9900.651576][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9900.651880][ C1] ? hlock_class+0x4e/0x130 [ 9900.652107][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9900.652376][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9900.652644][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9900.652900][ C1] ? hlock_class+0x4e/0x130 [ 9900.653152][ C1] ? mark_lock+0x38/0x3e0 [ 9900.653371][ C1] ? stack_access_ok+0xda/0x1f0 [ 9900.653618][ C1] ? __lock_acquire+0xb67/0x1610 [ 9900.653872][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9900.654161][ C1] ? get_stack_info+0x36/0xc0 [ 9900.654393][ C1] ? stack_access_ok+0xda/0x1f0 [ 9900.654634][ C1] ? get_reg+0x119/0x190 [ 9900.654846][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9900.655106][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9900.655409][ C1] __tcf_classify+0x329/0x7d0 [ 9900.655642][ C1] tcf_classify+0x283/0x930 [ 9900.655869][ C1] ? arch_stack_walk+0xa2/0x100 [ 9900.656112][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9900.656363][ C1] ? get_stack_info+0x36/0xc0 [ 9900.656598][ C1] tc_run+0x2e4/0x5d0 [ 9900.656797][ C1] ? __pfx_tc_run+0x10/0x10 [ 9900.657022][ C1] ? lock_acquire+0x1c1/0x220 [ 9900.657255][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9900.657509][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9900.657755][ C1] ? lock_acquire+0x1c1/0x220 [ 9900.657988][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9900.658246][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9900.658543][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9900.658810][ C1] ? neigh_hh_output+0x348/0x590 [ 9900.659056][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9900.659316][ C1] ip_finish_output2+0x786/0x18e0 [ 9900.659564][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9900.659838][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9900.660169][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9900.660439][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9900.660687][ C1] ? __ip_finish_output+0x10f/0x770 [ 9900.660947][ C1] ip_output+0x16b/0x4f0 [ 9900.661157][ C1] ? run_timer_softirq+0x72/0x100 [ 9900.661409][ C1] ? __pfx_ip_output+0x10/0x10 [ 9900.661647][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9900.661926][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9900.662172][ C1] ? ip_local_out+0x114/0x3b0 [ 9900.662405][ C1] __ip_queue_xmit+0x672/0x1910 [ 9900.662647][ C1] ? __create_object+0x5e/0xb0 [ 9900.662886][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9900.663172][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9900.663455][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9900.663729][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9900.664010][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9900.664292][ C1] tcp_delack_timer+0x84/0x240 [ 9900.664529][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9900.664795][ C1] call_timer_fn+0x173/0x430 [ 9900.665025][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9900.665280][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9900.665535][ C1] __run_timers.part.0+0x52d/0x890 [ 9900.665789][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9900.666057][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9900.666335][ C1] ? lock_acquire+0x1c1/0x220 [ 9900.666570][ C1] ? clockevents_program_event+0xf6/0x300 [ 9900.666851][ C1] ? lock_release+0x1d5/0x250 [ 9900.667085][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9900.667343][ C1] ? ktime_get+0xb3/0x190 [ 9900.667561][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9900.667849][ C1] run_timer_softirq+0x72/0x100 [ 9900.668091][ C1] __do_softirq+0x1b9/0x7ff [ 9900.668319][ C1] irq_exit_rcu+0x98/0xc0 [ 9900.668534][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9900.668813][ C1] [ 9900.668959][ C1] [ 9900.669105][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9900.669404][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9900.669720][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9900.670665][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9900.670966][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9900.671355][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9900.671746][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9900.672135][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9900.672525][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9900.672914][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9900.673231][ C1] pipe_read+0xa16/0xdf0 [ 9900.673450][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9900.673729][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9900.673971][ C1] ? iterate_tty_write+0x299/0x540 [ 9900.674242][ C1] ? lock_release+0x1d5/0x250 [ 9900.674477][ C1] vfs_read+0x911/0xc00 [ 9900.674686][ C1] ? lock_acquire+0x1c1/0x220 [ 9900.674918][ C1] ? __might_fault+0xc6/0x180 [ 9900.675153][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9900.675389][ C1] ? __might_fault+0xc6/0x180 [ 9900.675623][ C1] ? lock_release+0x1d5/0x250 [ 9900.675855][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9900.676114][ C1] ? __fget_light+0x54/0x1e0 [ 9900.676346][ C1] ksys_read+0x17a/0x1e0 [ 9900.676557][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9900.676793][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9900.677091][ C1] do_syscall_64+0xc9/0x1e0 [ 9900.677319][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9900.677611][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9900.677834][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9900.678784][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9900.679194][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9900.679584][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9900.679971][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9900.680361][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9900.680752][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9900.681144][ C1] [ 9928.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7055s! [swapper/2:0] [ 9928.569680][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9928.570894][ C2] irq event stamp: 44114564 [ 9928.571117][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9928.571636][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9928.572132][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9928.572595][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9928.573055][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9928.573497][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9928.574089][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9928.574405][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9928.575347][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9928.575644][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9928.576031][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9928.576418][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9928.576803][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9928.577191][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9928.577579][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9928.578011][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9928.578334][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9928.578722][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9928.579111][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9928.579499][ C2] PKRU: 55555554 [ 9928.579676][ C2] Call Trace: [ 9928.579837][ C2] [ 9928.579983][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9928.580238][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9928.580473][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9928.580742][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9928.581006][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9928.581287][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9928.581544][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9928.581840][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9928.582093][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9928.582348][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9928.582647][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9928.582938][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9928.583244][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9928.583523][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9928.583811][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9928.584091][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9928.584394][ C2] ? get_stack_info+0x36/0xc0 [ 9928.584627][ C2] ? lock_acquire+0x1c1/0x220 [ 9928.584862][ C2] ? lock_release+0x1d5/0x250 [ 9928.585094][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9928.585336][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9928.585601][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9928.585875][ C2] ? lock_acquire+0x1c1/0x220 [ 9928.586107][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9928.586343][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9928.586595][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9928.586821][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9928.587060][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9928.587313][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9928.587581][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9928.587850][ C2] ip_local_deliver+0x19d/0x480 [ 9928.588090][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9928.588353][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9928.588608][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9928.588944][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9928.589190][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9928.589500][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9928.589754][ C2] ip_rcv+0x564/0x740 [ 9928.589953][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9928.590175][ C2] ? set_track_prepare+0x8a/0xd0 [ 9928.590421][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9928.590689][ C2] ? start_secondary+0x21c/0x2b0 [ 9928.590932][ C2] ? skb_clone+0x10b/0x330 [ 9928.591152][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9928.591469][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9928.591765][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9928.592039][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9928.592326][ C2] ? __tcf_classify+0x329/0x7d0 [ 9928.592566][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9928.592789][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9928.593106][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9928.593388][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9928.593712][ C2] ? lock_acquire+0x1c1/0x220 [ 9928.593950][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9928.594250][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9928.594524][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9928.594830][ C2] ? __copy_skb_header+0xaf/0x490 [ 9928.595080][ C2] ? __skb_clone+0x57a/0x760 [ 9928.595308][ C2] netif_receive_skb+0x55/0x280 [ 9928.595549][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9928.595850][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9928.596172][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9928.596462][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9928.596727][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9928.597008][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9928.597312][ C2] ? get_stack_info+0x36/0xc0 [ 9928.597545][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9928.597801][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9928.598107][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9928.598378][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9928.598646][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9928.598951][ C2] ? kernel_text_address+0x17/0xe0 [ 9928.599205][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9928.599509][ C2] ? arch_stack_walk+0x8c/0x100 [ 9928.599753][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9928.600009][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9928.600284][ C2] ? lock_acquire+0x1c1/0x220 [ 9928.600516][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9928.600789][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9928.601084][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9928.601353][ C2] ? get_stack_info+0x36/0xc0 [ 9928.601585][ C2] __tcf_classify+0x329/0x7d0 [ 9928.601820][ C2] tcf_classify+0x283/0x930 [ 9928.602046][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9928.602295][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9928.602597][ C2] tc_run+0x2e4/0x5d0 [ 9928.602797][ C2] ? __pfx_tc_run+0x10/0x10 [ 9928.603044][ C2] ? lock_acquire+0x1c1/0x220 [ 9928.603284][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9928.603543][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9928.603797][ C2] ? lock_acquire+0x1c1/0x220 [ 9928.604045][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9928.604302][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9928.604597][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9928.604860][ C2] ? neigh_hh_output+0x348/0x590 [ 9928.605105][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9928.605362][ C2] ip_finish_output2+0x786/0x18e0 [ 9928.605610][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9928.605936][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9928.606205][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9928.606449][ C2] ? __ip_finish_output+0x10f/0x770 [ 9928.606706][ C2] ip_output+0x16b/0x4f0 [ 9928.606916][ C2] ? __pfx_ip_output+0x10/0x10 [ 9928.607152][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9928.607420][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9928.607723][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9928.607989][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9928.608234][ C2] ? __alloc_skb+0xd4/0x280 [ 9928.608459][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9928.608718][ C2] ? tcp_fragment+0x168/0x1040 [ 9928.608954][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9928.609199][ C2] ? ip_local_out+0x114/0x3b0 [ 9928.609431][ C2] __ip_queue_xmit+0x672/0x1910 [ 9928.609671][ C2] ? __skb_clone+0x57a/0x760 [ 9928.609900][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9928.610157][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9928.610431][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9928.610666][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9928.610907][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9928.611200][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9928.611511][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9928.611748][ C2] tcp_send_loss_probe+0x348/0x830 [ 9928.612000][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9928.612259][ C2] tcp_write_timer+0x82/0x1d0 [ 9928.612494][ C2] call_timer_fn+0x173/0x430 [ 9928.612722][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9928.613001][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9928.613263][ C2] __run_timers.part.0+0x52d/0x890 [ 9928.613522][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9928.613790][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9928.614080][ C2] ? lock_acquire+0x1c1/0x220 [ 9928.614314][ C2] ? clockevents_program_event+0xf6/0x300 [ 9928.614595][ C2] ? lock_release+0x1d5/0x250 [ 9928.614825][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9928.615081][ C2] ? ktime_get+0xb3/0x190 [ 9928.615298][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9928.615584][ C2] run_timer_softirq+0x72/0x100 [ 9928.615823][ C2] __do_softirq+0x1b9/0x7ff [ 9928.616050][ C2] irq_exit_rcu+0x98/0xc0 [ 9928.616263][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9928.616542][ C2] [ 9928.616686][ C2] [ 9928.616833][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9928.617125][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9928.617375][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9928.618316][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9928.618612][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9928.618999][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9928.619389][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9928.619774][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9928.620159][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9928.620549][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9928.620831][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9928.621083][ C2] default_idle_call+0x69/0xa0 [ 9928.621320][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9928.621563][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9928.621831][ C2] ? lock_release+0x1d5/0x250 [ 9928.622064][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9928.622330][ C2] do_idle+0xfb/0x160 [ 9928.622527][ C2] cpu_startup_entry+0x55/0x60 [ 9928.622764][ C2] start_secondary+0x21c/0x2b0 [ 9928.623026][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9928.623295][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9928.623606][ C2] [ 9928.623762][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7055s! [perl:4135] [ 9928.624183][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9928.625402][ C1] irq event stamp: 209232 [ 9928.625614][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9928.626126][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9928.626594][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9928.627050][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9928.627499][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9928.627935][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9928.628534][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9928.628850][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9928.629798][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9928.630097][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9928.630487][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9928.630875][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9928.631267][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9928.631656][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9928.632044][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9928.632481][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9928.632809][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9928.633227][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9928.633626][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9928.634024][ C1] PKRU: 55555554 [ 9928.634213][ C1] Call Trace: [ 9928.634380][ C1] [ 9928.634523][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9928.634777][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9928.635013][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9928.635283][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9928.635551][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9928.635831][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9928.636088][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9928.636388][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9928.636643][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9928.636944][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9928.637232][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9928.637537][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9928.637821][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9928.638108][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9928.638391][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9928.638695][ C1] ? get_stack_info+0x36/0xc0 [ 9928.638930][ C1] ? lock_acquire+0x1c1/0x220 [ 9928.639163][ C1] ? lock_release+0x1d5/0x250 [ 9928.639399][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9928.639643][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9928.639906][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9928.640186][ C1] ? lock_acquire+0x1c1/0x220 [ 9928.640418][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9928.640652][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9928.640905][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9928.641134][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9928.641377][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9928.641628][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9928.641895][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9928.642165][ C1] ip_local_deliver+0x19d/0x480 [ 9928.642407][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9928.642671][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9928.642950][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9928.643300][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9928.643554][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9928.643874][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9928.644144][ C1] ip_rcv+0x564/0x740 [ 9928.644343][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9928.644568][ C1] ? set_track_prepare+0x8a/0xd0 [ 9928.644814][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9928.645083][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9928.645349][ C1] ? skb_clone+0x10b/0x330 [ 9928.645571][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9928.645882][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9928.646179][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9928.646455][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9928.646743][ C1] ? __tcf_classify+0x329/0x7d0 [ 9928.646985][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9928.647211][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9928.647501][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9928.647779][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9928.648096][ C1] ? lock_acquire+0x1c1/0x220 [ 9928.648329][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9928.648617][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9928.648896][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9928.649205][ C1] ? __copy_skb_header+0xaf/0x490 [ 9928.649456][ C1] ? __skb_clone+0x57a/0x760 [ 9928.649682][ C1] netif_receive_skb+0x55/0x280 [ 9928.649924][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9928.650228][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9928.650551][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9928.650843][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9928.651109][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9928.651392][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9928.651696][ C1] ? hlock_class+0x4e/0x130 [ 9928.651925][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9928.652194][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9928.652463][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9928.652720][ C1] ? hlock_class+0x4e/0x130 [ 9928.652966][ C1] ? mark_lock+0x38/0x3e0 [ 9928.653189][ C1] ? stack_access_ok+0xda/0x1f0 [ 9928.653437][ C1] ? __lock_acquire+0xb67/0x1610 [ 9928.653690][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9928.653968][ C1] ? get_stack_info+0x36/0xc0 [ 9928.654213][ C1] ? stack_access_ok+0xda/0x1f0 [ 9928.654450][ C1] ? get_reg+0x119/0x190 [ 9928.654663][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9928.654924][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9928.655227][ C1] __tcf_classify+0x329/0x7d0 [ 9928.655461][ C1] tcf_classify+0x283/0x930 [ 9928.655687][ C1] ? arch_stack_walk+0xa2/0x100 [ 9928.655928][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9928.656180][ C1] ? get_stack_info+0x36/0xc0 [ 9928.656416][ C1] tc_run+0x2e4/0x5d0 [ 9928.656615][ C1] ? __pfx_tc_run+0x10/0x10 [ 9928.656840][ C1] ? lock_acquire+0x1c1/0x220 [ 9928.657071][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9928.657325][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9928.657572][ C1] ? lock_acquire+0x1c1/0x220 [ 9928.657806][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9928.658063][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9928.658360][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9928.658625][ C1] ? neigh_hh_output+0x348/0x590 [ 9928.658871][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9928.659130][ C1] ip_finish_output2+0x786/0x18e0 [ 9928.659380][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9928.659651][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9928.659979][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9928.660248][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9928.660494][ C1] ? __ip_finish_output+0x10f/0x770 [ 9928.660752][ C1] ip_output+0x16b/0x4f0 [ 9928.660963][ C1] ? run_timer_softirq+0x72/0x100 [ 9928.661214][ C1] ? __pfx_ip_output+0x10/0x10 [ 9928.661451][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9928.661732][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9928.661978][ C1] ? ip_local_out+0x114/0x3b0 [ 9928.662211][ C1] __ip_queue_xmit+0x672/0x1910 [ 9928.662452][ C1] ? __create_object+0x5e/0xb0 [ 9928.662690][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9928.662975][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9928.663259][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9928.663531][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9928.663811][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9928.664094][ C1] tcp_delack_timer+0x84/0x240 [ 9928.664330][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9928.664596][ C1] call_timer_fn+0x173/0x430 [ 9928.664825][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9928.665079][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9928.665333][ C1] __run_timers.part.0+0x52d/0x890 [ 9928.665587][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9928.665855][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9928.666132][ C1] ? lock_acquire+0x1c1/0x220 [ 9928.666366][ C1] ? clockevents_program_event+0xf6/0x300 [ 9928.666647][ C1] ? lock_release+0x1d5/0x250 [ 9928.666881][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9928.667137][ C1] ? ktime_get+0xb3/0x190 [ 9928.667355][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9928.667642][ C1] run_timer_softirq+0x72/0x100 [ 9928.667884][ C1] __do_softirq+0x1b9/0x7ff [ 9928.668112][ C1] irq_exit_rcu+0x98/0xc0 [ 9928.668326][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9928.668604][ C1] [ 9928.668749][ C1] [ 9928.668896][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9928.669193][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9928.669509][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9928.670454][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9928.670757][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9928.671145][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9928.671537][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9928.671925][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9928.672339][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9928.672739][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9928.673040][ C1] pipe_read+0xa16/0xdf0 [ 9928.673262][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9928.673541][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9928.673784][ C1] ? iterate_tty_write+0x299/0x540 [ 9928.674055][ C1] ? lock_release+0x1d5/0x250 [ 9928.674288][ C1] vfs_read+0x911/0xc00 [ 9928.674498][ C1] ? lock_acquire+0x1c1/0x220 [ 9928.674732][ C1] ? __might_fault+0xc6/0x180 [ 9928.674965][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9928.675199][ C1] ? __might_fault+0xc6/0x180 [ 9928.675433][ C1] ? lock_release+0x1d5/0x250 [ 9928.675665][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9928.675923][ C1] ? __fget_light+0x54/0x1e0 [ 9928.676153][ C1] ksys_read+0x17a/0x1e0 [ 9928.676366][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9928.676603][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9928.676899][ C1] do_syscall_64+0xc9/0x1e0 [ 9928.677126][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9928.677418][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9928.677640][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9928.678585][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9928.678995][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9928.679384][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9928.679771][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9928.680159][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9928.680549][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9928.680940][ C1] [ 9952.574108][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [ 9952.574468][ C1] rcu: 1-....: (7578195 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1786115 [ 9952.575013][ C1] rcu: (t=7597687 jiffies g=1882453 q=724 ncpus=4) [ 9952.575340][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9952.575777][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9952.576381][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9952.576700][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9952.577644][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9952.577945][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9952.578333][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9952.578722][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9952.579111][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9952.579500][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9952.579889][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9952.580327][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9952.580651][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9952.581043][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9952.581431][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9952.581818][ C1] PKRU: 55555554 [ 9952.581995][ C1] Call Trace: [ 9952.582162][ C1] [ 9952.582307][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [ 9952.582575][ C1] ? print_cpu_stall+0x263/0x6a0 [ 9952.582843][ C1] ? check_cpu_stall+0x284/0x500 [ 9952.583094][ C1] ? rcu_pending+0x92/0x360 [ 9952.583327][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [ 9952.583597][ C1] ? update_process_times+0xb9/0x110 [ 9952.583865][ C1] ? tick_sched_handle+0x67/0x130 [ 9952.584125][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [ 9952.584406][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9952.584645][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 9952.584948][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9952.585216][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9952.585496][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9952.585754][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9952.586052][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9952.586308][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9952.586609][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9952.586898][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9952.587205][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9952.587487][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9952.587775][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9952.588056][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9952.588360][ C1] ? get_stack_info+0x36/0xc0 [ 9952.588595][ C1] ? lock_acquire+0x1c1/0x220 [ 9952.588829][ C1] ? lock_release+0x1d5/0x250 [ 9952.589062][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9952.589306][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9952.589570][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9952.589849][ C1] ? lock_acquire+0x1c1/0x220 [ 9952.590082][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9952.590315][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9952.590567][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9952.590796][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9952.591037][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9952.591289][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9952.591560][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9952.591831][ C1] ip_local_deliver+0x19d/0x480 [ 9952.592071][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9952.592337][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9952.592594][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9952.592969][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9952.593223][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9952.593545][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9952.593810][ C1] ip_rcv+0x564/0x740 [ 9952.594023][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9952.594251][ C1] ? set_track_prepare+0x8a/0xd0 [ 9952.594498][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9952.594768][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9952.595035][ C1] ? skb_clone+0x10b/0x330 [ 9952.595259][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9952.595571][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9952.595871][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9952.596145][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9952.596435][ C1] ? __tcf_classify+0x329/0x7d0 [ 9952.596677][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9952.596902][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9952.597196][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9952.597474][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9952.597791][ C1] ? lock_acquire+0x1c1/0x220 [ 9952.598025][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9952.598318][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9952.598596][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9952.598908][ C1] ? __copy_skb_header+0xaf/0x490 [ 9952.599159][ C1] ? __skb_clone+0x57a/0x760 [ 9952.599390][ C1] netif_receive_skb+0x55/0x280 [ 9952.599633][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9952.599938][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9952.600265][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9952.600556][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9952.600824][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9952.601106][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9952.601412][ C1] ? hlock_class+0x4e/0x130 [ 9952.601638][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9952.601909][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9952.602180][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9952.602437][ C1] ? hlock_class+0x4e/0x130 [ 9952.602664][ C1] ? mark_lock+0x38/0x3e0 [ 9952.602903][ C1] ? stack_access_ok+0xda/0x1f0 [ 9952.603152][ C1] ? __lock_acquire+0xb67/0x1610 [ 9952.603407][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9952.603683][ C1] ? get_stack_info+0x36/0xc0 [ 9952.603935][ C1] ? stack_access_ok+0xda/0x1f0 [ 9952.604176][ C1] ? get_reg+0x119/0x190 [ 9952.604388][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9952.604648][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9952.604950][ C1] __tcf_classify+0x329/0x7d0 [ 9952.605188][ C1] tcf_classify+0x283/0x930 [ 9952.605415][ C1] ? arch_stack_walk+0xa2/0x100 [ 9952.605657][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9952.605907][ C1] ? get_stack_info+0x36/0xc0 [ 9952.606142][ C1] tc_run+0x2e4/0x5d0 [ 9952.606342][ C1] ? __pfx_tc_run+0x10/0x10 [ 9952.606569][ C1] ? lock_acquire+0x1c1/0x220 [ 9952.606804][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9952.607059][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9952.607307][ C1] ? lock_acquire+0x1c1/0x220 [ 9952.607540][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9952.607799][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9952.608095][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9952.608364][ C1] ? neigh_hh_output+0x348/0x590 [ 9952.608610][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9952.608870][ C1] ip_finish_output2+0x786/0x18e0 [ 9952.609120][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9952.609391][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9952.609720][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9952.609990][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9952.610238][ C1] ? __ip_finish_output+0x10f/0x770 [ 9952.610498][ C1] ip_output+0x16b/0x4f0 [ 9952.610709][ C1] ? run_timer_softirq+0x72/0x100 [ 9952.610960][ C1] ? __pfx_ip_output+0x10/0x10 [ 9952.611200][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9952.611479][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9952.611725][ C1] ? ip_local_out+0x114/0x3b0 [ 9952.611961][ C1] __ip_queue_xmit+0x672/0x1910 [ 9952.612206][ C1] ? __create_object+0x5e/0xb0 [ 9952.612444][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9952.612707][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9952.613004][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9952.613277][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9952.613561][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9952.613834][ C1] tcp_delack_timer+0x84/0x240 [ 9952.614087][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9952.614352][ C1] call_timer_fn+0x173/0x430 [ 9952.614584][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9952.614840][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9952.615095][ C1] __run_timers.part.0+0x52d/0x890 [ 9952.615352][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9952.615619][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9952.615899][ C1] ? lock_acquire+0x1c1/0x220 [ 9952.616131][ C1] ? clockevents_program_event+0xf6/0x300 [ 9952.616418][ C1] ? lock_release+0x1d5/0x250 [ 9952.616651][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9952.616910][ C1] ? ktime_get+0xb3/0x190 [ 9952.617124][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9952.617416][ C1] run_timer_softirq+0x72/0x100 [ 9952.617658][ C1] __do_softirq+0x1b9/0x7ff [ 9952.617884][ C1] irq_exit_rcu+0x98/0xc0 [ 9952.618100][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9952.618379][ C1] [ 9952.618526][ C1] [ 9952.618674][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9952.618971][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9952.619291][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9952.620240][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9952.620542][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9952.620931][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9952.621321][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9952.621708][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9952.622101][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9952.622494][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9952.622808][ C1] pipe_read+0xa16/0xdf0 [ 9952.623032][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9952.623311][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9952.623556][ C1] ? iterate_tty_write+0x299/0x540 [ 9952.623819][ C1] ? lock_release+0x1d5/0x250 [ 9952.624069][ C1] vfs_read+0x911/0xc00 [ 9952.624277][ C1] ? lock_acquire+0x1c1/0x220 [ 9952.624511][ C1] ? __might_fault+0xc6/0x180 [ 9952.624748][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9952.624979][ C1] ? __might_fault+0xc6/0x180 [ 9952.625214][ C1] ? lock_release+0x1d5/0x250 [ 9952.625450][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9952.625709][ C1] ? __fget_light+0x54/0x1e0 [ 9952.625941][ C1] ksys_read+0x17a/0x1e0 [ 9952.626153][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9952.626394][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9952.626691][ C1] do_syscall_64+0xc9/0x1e0 [ 9952.626916][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9952.627211][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9952.627434][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9952.628384][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9952.628794][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9952.629184][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9952.629576][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9952.629968][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9952.630358][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9952.630751][ C1] [ 9952.630906][ C1] Sending NMI from CPU 1 to CPUs 2: [ 9952.631175][ C2] NMI backtrace for cpu 2 [ 9952.631181][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9952.631187][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9952.631191][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9952.631199][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9952.631204][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9952.631209][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9952.631212][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9952.631216][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9952.631220][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9952.631222][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9952.631224][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9952.631226][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9952.631229][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9952.631231][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9952.631232][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9952.631233][ C2] PKRU: 55555554 [ 9952.631234][ C2] Call Trace: [ 9952.631236][ C2] [ 9952.631238][ C2] ? nmi_cpu_backtrace+0x112/0x220 [ 9952.631243][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [ 9952.631248][ C2] ? nmi_handle+0x153/0x420 [ 9952.631252][ C2] ? default_do_nmi+0x41/0x100 [ 9952.631255][ C2] ? exc_nmi+0xf3/0x120 [ 9952.631257][ C2] ? end_repeat_nmi+0xf/0x60 [ 9952.631262][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9952.631266][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9952.631268][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9952.631272][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9952.631275][ C2] [ 9952.631275][ C2] [ 9952.631277][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9952.631279][ C2] ? get_stack_info+0x36/0xc0 [ 9952.631283][ C2] ? lock_acquire+0x1c1/0x220 [ 9952.631287][ C2] ? lock_release+0x1d5/0x250 [ 9952.631290][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9952.631294][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9952.631297][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9952.631300][ C2] ? lock_acquire+0x1c1/0x220 [ 9952.631302][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9952.631305][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9952.631308][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9952.631314][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9952.631317][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9952.631321][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9952.631326][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9952.631329][ C2] ip_local_deliver+0x19d/0x480 [ 9952.631331][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9952.631334][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9952.631336][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9952.631341][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9952.631345][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9952.631348][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9952.631356][ C2] ip_rcv+0x564/0x740 [ 9952.631359][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9952.631361][ C2] ? set_track_prepare+0x8a/0xd0 [ 9952.631365][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9952.631368][ C2] ? start_secondary+0x21c/0x2b0 [ 9952.631371][ C2] ? skb_clone+0x10b/0x330 [ 9952.631374][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9952.631380][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9952.631385][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9952.631388][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9952.631396][ C2] ? __tcf_classify+0x329/0x7d0 [ 9952.631400][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9952.631402][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9952.631405][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9952.631408][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9952.631413][ C2] ? lock_acquire+0x1c1/0x220 [ 9952.631415][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9952.631419][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9952.631422][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9952.631426][ C2] ? __copy_skb_header+0xaf/0x490 [ 9952.631430][ C2] ? __skb_clone+0x57a/0x760 [ 9952.631432][ C2] netif_receive_skb+0x55/0x280 [ 9952.631436][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9952.631442][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9952.631448][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9952.631455][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9952.631459][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9952.631468][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9952.631475][ C2] ? get_stack_info+0x36/0xc0 [ 9952.631480][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9952.631483][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9952.631486][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9952.631488][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9952.631491][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9952.631494][ C2] ? kernel_text_address+0x17/0xe0 [ 9952.631496][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9952.631500][ C2] ? arch_stack_walk+0x8c/0x100 [ 9952.631504][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9952.631507][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9952.631510][ C2] ? lock_acquire+0x1c1/0x220 [ 9952.631513][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9952.631517][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9952.631521][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9952.631524][ C2] ? get_stack_info+0x36/0xc0 [ 9952.631528][ C2] __tcf_classify+0x329/0x7d0 [ 9952.631533][ C2] tcf_classify+0x283/0x930 [ 9952.631538][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9952.631541][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9952.631545][ C2] tc_run+0x2e4/0x5d0 [ 9952.631549][ C2] ? __pfx_tc_run+0x10/0x10 [ 9952.631551][ C2] ? lock_acquire+0x1c1/0x220 [ 9952.631554][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9952.631557][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9952.631561][ C2] ? lock_acquire+0x1c1/0x220 [ 9952.631563][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9952.631566][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9952.631569][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9952.631572][ C2] ? neigh_hh_output+0x348/0x590 [ 9952.631576][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9952.631579][ C2] ip_finish_output2+0x786/0x18e0 [ 9952.631583][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9952.631590][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9952.631593][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9952.631597][ C2] ? __ip_finish_output+0x10f/0x770 [ 9952.631600][ C2] ip_output+0x16b/0x4f0 [ 9952.631603][ C2] ? __pfx_ip_output+0x10/0x10 [ 9952.631605][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9952.631608][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9952.631611][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9952.631614][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9952.631616][ C2] ? __alloc_skb+0xd4/0x280 [ 9952.631619][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9952.631622][ C2] ? tcp_fragment+0x168/0x1040 [ 9952.631625][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9952.631628][ C2] ? ip_local_out+0x114/0x3b0 [ 9952.631631][ C2] __ip_queue_xmit+0x672/0x1910 [ 9952.631635][ C2] ? __skb_clone+0x57a/0x760 [ 9952.631637][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9952.631642][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9952.631645][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9952.631648][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9952.631652][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9952.631656][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9952.631659][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9952.631662][ C2] tcp_send_loss_probe+0x348/0x830 [ 9952.631665][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9952.631667][ C2] tcp_write_timer+0x82/0x1d0 [ 9952.631670][ C2] call_timer_fn+0x173/0x430 [ 9952.631674][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9952.631679][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9952.631682][ C2] __run_timers.part.0+0x52d/0x890 [ 9952.631685][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9952.631689][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9952.631692][ C2] ? lock_acquire+0x1c1/0x220 [ 9952.631694][ C2] ? clockevents_program_event+0xf6/0x300 [ 9952.631698][ C2] ? lock_release+0x1d5/0x250 [ 9952.631701][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9952.631704][ C2] ? ktime_get+0xb3/0x190 [ 9952.631707][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9952.631711][ C2] run_timer_softirq+0x72/0x100 [ 9952.631714][ C2] __do_softirq+0x1b9/0x7ff [ 9952.631718][ C2] irq_exit_rcu+0x98/0xc0 [ 9952.631720][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9952.631723][ C2] [ 9952.631724][ C2] [ 9952.631725][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9952.631728][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9952.631731][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9952.631733][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9952.631735][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9952.631737][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9952.631738][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9952.631739][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9952.631741][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9952.631744][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9952.631746][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9952.631749][ C2] default_idle_call+0x69/0xa0 [ 9952.631752][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9952.631754][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9952.631758][ C2] ? lock_release+0x1d5/0x250 [ 9952.631760][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9952.631764][ C2] do_idle+0xfb/0x160 [ 9952.631767][ C2] cpu_startup_entry+0x55/0x60 [ 9952.631769][ C2] start_secondary+0x21c/0x2b0 [ 9952.631772][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9952.631776][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9952.631781][ C2] [ 9980.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7104s! [swapper/2:0] [ 9980.569680][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9980.570902][ C2] irq event stamp: 44114564 [ 9980.571125][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9980.571646][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [ 9980.572140][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [ 9980.572607][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [ 9980.573061][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [ 9980.573502][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9980.574094][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9980.574409][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9980.575346][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [ 9980.575645][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9980.576029][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [ 9980.576416][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [ 9980.576801][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [ 9980.577188][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [ 9980.577572][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [ 9980.578004][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9980.578334][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [ 9980.578721][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9980.579108][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9980.579493][ C2] PKRU: 55555554 [ 9980.579669][ C2] Call Trace: [ 9980.579833][ C2] [ 9980.579976][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9980.580230][ C2] ? __run_hrtimer+0x1c0/0x710 [ 9980.580467][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9980.580734][ C2] ? __hrtimer_run_queues+0x197/0x270 [ 9980.580997][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9980.581278][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9980.581535][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9980.581830][ C2] ? hrtimer_interrupt+0x2c3/0x770 [ 9980.582086][ C2] ? trace_rcu_dyntick+0x10a/0x150 [ 9980.582341][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9980.582663][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9980.582956][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9980.583269][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9980.583557][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9980.583858][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9980.584139][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9980.584441][ C2] ? get_stack_info+0x36/0xc0 [ 9980.584672][ C2] ? lock_acquire+0x1c1/0x220 [ 9980.584906][ C2] ? lock_release+0x1d5/0x250 [ 9980.585139][ C2] do_raw_spin_lock+0x1ec/0x270 [ 9980.585381][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9980.585644][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9980.585919][ C2] ? lock_acquire+0x1c1/0x220 [ 9980.586149][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9980.586387][ C2] _raw_spin_lock_nested+0x65/0x80 [ 9980.586639][ C2] tcp_v4_rcv+0x221e/0x2ac0 [ 9980.586866][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9980.587105][ C2] ? __pfx_raw_v4_input+0x10/0x10 [ 9980.587356][ C2] ip_protocol_deliver_rcu+0x93/0x360 [ 9980.587624][ C2] ip_local_deliver_finish+0x2ae/0x480 [ 9980.587892][ C2] ip_local_deliver+0x19d/0x480 [ 9980.588131][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [ 9980.588395][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9980.588648][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9980.588987][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9980.589234][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9980.589544][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9980.589798][ C2] ip_rcv+0x564/0x740 [ 9980.589995][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9980.590219][ C2] ? set_track_prepare+0x8a/0xd0 [ 9980.590471][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9980.590741][ C2] ? start_secondary+0x21c/0x2b0 [ 9980.590984][ C2] ? skb_clone+0x10b/0x330 [ 9980.591205][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9980.591514][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9980.591811][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9980.592083][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9980.592372][ C2] ? __tcf_classify+0x329/0x7d0 [ 9980.592618][ C2] ? __pfx_ip_rcv+0x10/0x10 [ 9980.592840][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [ 9980.593132][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9980.593407][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9980.593723][ C2] ? lock_acquire+0x1c1/0x220 [ 9980.593954][ C2] ? netif_receive_skb_internal+0x84/0x300 [ 9980.594242][ C2] netif_receive_skb_internal+0xb0/0x300 [ 9980.594518][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9980.594825][ C2] ? __copy_skb_header+0xaf/0x490 [ 9980.595074][ C2] ? __skb_clone+0x57a/0x760 [ 9980.595304][ C2] netif_receive_skb+0x55/0x280 [ 9980.595545][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9980.595847][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9980.596171][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9980.596460][ C2] tcf_action_exec.part.0+0x112/0x3d0 [ 9980.596728][ C2] fl_classify+0x4dc/0x650 [cls_flower] [ 9980.597007][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9980.597311][ C2] ? get_stack_info+0x36/0xc0 [ 9980.597544][ C2] ? unwind_next_frame+0x1cc/0x1d10 [ 9980.597801][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9980.598109][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9980.598377][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [ 9980.598644][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [ 9980.598949][ C2] ? kernel_text_address+0x17/0xe0 [ 9980.599201][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9980.599505][ C2] ? arch_stack_walk+0x8c/0x100 [ 9980.599746][ C2] ? do_raw_spin_trylock+0xb9/0x190 [ 9980.600002][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9980.600279][ C2] ? lock_acquire+0x1c1/0x220 [ 9980.600510][ C2] ? stack_depot_save_flags+0x281/0x550 [ 9980.600785][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9980.601078][ C2] ? get_stack_info_noinstr+0x18/0x110 [ 9980.601349][ C2] ? get_stack_info+0x36/0xc0 [ 9980.601581][ C2] __tcf_classify+0x329/0x7d0 [ 9980.601815][ C2] tcf_classify+0x283/0x930 [ 9980.602041][ C2] ? __pfx_tcf_classify+0x10/0x10 [ 9980.602290][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [ 9980.602614][ C2] tc_run+0x2e4/0x5d0 [ 9980.602818][ C2] ? __pfx_tc_run+0x10/0x10 [ 9980.603047][ C2] ? lock_acquire+0x1c1/0x220 [ 9980.603284][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [ 9980.603544][ C2] __dev_queue_xmit+0x686/0x17e0 [ 9980.603806][ C2] ? lock_acquire+0x1c1/0x220 [ 9980.604038][ C2] ? ip_finish_output2+0x786/0x18e0 [ 9980.604294][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9980.604589][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9980.604852][ C2] ? neigh_hh_output+0x348/0x590 [ 9980.605097][ C2] ? ip_finish_output2+0x262/0x18e0 [ 9980.605353][ C2] ip_finish_output2+0x786/0x18e0 [ 9980.605601][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9980.605926][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [ 9980.606196][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9980.606442][ C2] ? __ip_finish_output+0x10f/0x770 [ 9980.606698][ C2] ip_output+0x16b/0x4f0 [ 9980.606907][ C2] ? __pfx_ip_output+0x10/0x10 [ 9980.607143][ C2] ? __pfx_set_track_prepare+0x10/0x10 [ 9980.607410][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9980.607713][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [ 9980.607979][ C2] ? kmalloc_reserve+0x11c/0x1f0 [ 9980.608224][ C2] ? __alloc_skb+0xd4/0x280 [ 9980.608448][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [ 9980.608708][ C2] ? tcp_fragment+0x168/0x1040 [ 9980.608945][ C2] ? rcu_read_lock_held+0xe/0x50 [ 9980.609189][ C2] ? ip_local_out+0x114/0x3b0 [ 9980.609423][ C2] __ip_queue_xmit+0x672/0x1910 [ 9980.609664][ C2] ? __skb_clone+0x57a/0x760 [ 9980.609890][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [ 9980.610148][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9980.610423][ C2] ? ipv4_dst_check+0xe3/0x170 [ 9980.610659][ C2] ? __sk_dst_check+0x1a1/0x2b0 [ 9980.610900][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [ 9980.611191][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [ 9980.611501][ C2] ? tcp_fragment+0xb0e/0x1040 [ 9980.611738][ C2] tcp_send_loss_probe+0x348/0x830 [ 9980.611990][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9980.612250][ C2] tcp_write_timer+0x82/0x1d0 [ 9980.612483][ C2] call_timer_fn+0x173/0x430 [ 9980.612717][ C2] ? __pfx_call_timer_fn+0x10/0x10 [ 9980.612971][ C2] ? next_expiry_recalc+0xcd/0x220 [ 9980.613224][ C2] __run_timers.part.0+0x52d/0x890 [ 9980.613476][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [ 9980.613736][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [ 9980.614011][ C2] ? lock_acquire+0x1c1/0x220 [ 9980.614243][ C2] ? clockevents_program_event+0xf6/0x300 [ 9980.614526][ C2] ? lock_release+0x1d5/0x250 [ 9980.614756][ C2] ? kvm_clock_get_cycles+0x18/0x30 [ 9980.615013][ C2] ? ktime_get+0xb3/0x190 [ 9980.615228][ C2] ? clockevents_program_event+0x1ea/0x300 [ 9980.615514][ C2] run_timer_softirq+0x72/0x100 [ 9980.615755][ C2] __do_softirq+0x1b9/0x7ff [ 9980.615980][ C2] irq_exit_rcu+0x98/0xc0 [ 9980.616194][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [ 9980.616470][ C2] [ 9980.616615][ C2] [ 9980.616763][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9980.617056][ C2] RIP: 0010:default_idle+0xf/0x20 [ 9980.617306][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [ 9980.618248][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [ 9980.618545][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [ 9980.618933][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [ 9980.619319][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [ 9980.619703][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [ 9980.620091][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [ 9980.620482][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [ 9980.620761][ C2] ? cpuidle_idle_call+0x1f6/0x280 [ 9980.621012][ C2] default_idle_call+0x69/0xa0 [ 9980.621250][ C2] cpuidle_idle_call+0x1f6/0x280 [ 9980.621492][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [ 9980.621759][ C2] ? lock_release+0x1d5/0x250 [ 9980.621991][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [ 9980.622256][ C2] do_idle+0xfb/0x160 [ 9980.622454][ C2] cpu_startup_entry+0x55/0x60 [ 9980.622711][ C2] start_secondary+0x21c/0x2b0 [ 9980.622954][ C2] ? __pfx_start_secondary+0x10/0x10 [ 9980.623221][ C2] secondary_startup_64_no_verify+0x16d/0x17b [ 9980.623531][ C2] [ 9980.623689][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7104s! [perl:4135] [ 9980.624107][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [ 9980.625329][ C1] irq event stamp: 209232 [ 9980.625542][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [ 9980.626056][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [ 9980.626522][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [ 9980.626979][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [ 9980.627430][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [ 9980.627867][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [ 9980.628463][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [ 9980.628779][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [ 9980.629729][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [ 9980.630028][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [ 9980.630419][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [ 9980.630810][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [ 9980.631199][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [ 9980.631587][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [ 9980.631976][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [ 9980.632411][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 9980.632740][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [ 9980.633134][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 9980.633522][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 9980.633912][ C1] PKRU: 55555554 [ 9980.634087][ C1] Call Trace: [ 9980.634255][ C1] [ 9980.634399][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [ 9980.634655][ C1] ? __run_hrtimer+0x1c0/0x710 [ 9980.634891][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 9980.635162][ C1] ? __hrtimer_run_queues+0x197/0x270 [ 9980.635429][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [ 9980.635708][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9980.635967][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [ 9980.636266][ C1] ? hrtimer_interrupt+0x2c3/0x770 [ 9980.636521][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [ 9980.636823][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [ 9980.637112][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9980.637419][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9980.637700][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [ 9980.637989][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [ 9980.638270][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [ 9980.638575][ C1] ? get_stack_info+0x36/0xc0 [ 9980.638811][ C1] ? lock_acquire+0x1c1/0x220 [ 9980.639045][ C1] ? lock_release+0x1d5/0x250 [ 9980.639278][ C1] do_raw_spin_lock+0x1ec/0x270 [ 9980.639521][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [ 9980.639787][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9980.640065][ C1] ? lock_acquire+0x1c1/0x220 [ 9980.640301][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [ 9980.640533][ C1] _raw_spin_lock_nested+0x65/0x80 [ 9980.640789][ C1] tcp_v4_rcv+0x221e/0x2ac0 [ 9980.641018][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [ 9980.641261][ C1] ? __pfx_raw_v4_input+0x10/0x10 [ 9980.641513][ C1] ip_protocol_deliver_rcu+0x93/0x360 [ 9980.641780][ C1] ip_local_deliver_finish+0x2ae/0x480 [ 9980.642050][ C1] ip_local_deliver+0x19d/0x480 [ 9980.642290][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [ 9980.642558][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [ 9980.642841][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [ 9980.643188][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9980.643441][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [ 9980.643772][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [ 9980.644028][ C1] ip_rcv+0x564/0x740 [ 9980.644229][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9980.644456][ C1] ? set_track_prepare+0x8a/0xd0 [ 9980.644703][ C1] ? __pfx_set_track_prepare+0x10/0x10 [ 9980.644973][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [ 9980.645238][ C1] ? skb_clone+0x10b/0x330 [ 9980.645460][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [ 9980.645772][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [ 9980.646071][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [ 9980.646346][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [ 9980.646634][ C1] ? __tcf_classify+0x329/0x7d0 [ 9980.646875][ C1] ? __pfx_ip_rcv+0x10/0x10 [ 9980.647102][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [ 9980.647397][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9980.647675][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [ 9980.647991][ C1] ? lock_acquire+0x1c1/0x220 [ 9980.648226][ C1] ? netif_receive_skb_internal+0x84/0x300 [ 9980.648515][ C1] netif_receive_skb_internal+0xb0/0x300 [ 9980.648794][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [ 9980.649104][ C1] ? __copy_skb_header+0xaf/0x490 [ 9980.649357][ C1] ? __skb_clone+0x57a/0x760 [ 9980.649587][ C1] netif_receive_skb+0x55/0x280 [ 9980.649828][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [ 9980.650130][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [ 9980.650456][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [ 9980.650748][ C1] tcf_action_exec.part.0+0x112/0x3d0 [ 9980.651014][ C1] fl_classify+0x4dc/0x650 [cls_flower] [ 9980.651299][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [ 9980.651603][ C1] ? hlock_class+0x4e/0x130 [ 9980.651830][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9980.652099][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9980.652371][ C1] ? __pfx_validate_chain+0x10/0x10 [ 9980.652631][ C1] ? hlock_class+0x4e/0x130 [ 9980.652856][ C1] ? mark_lock+0x38/0x3e0 [ 9980.653070][ C1] ? stack_access_ok+0xda/0x1f0 [ 9980.653313][ C1] ? __lock_acquire+0xb67/0x1610 [ 9980.653561][ C1] ? get_stack_info_noinstr+0x18/0x110 [ 9980.653829][ C1] ? get_stack_info+0x36/0xc0 [ 9980.654065][ C1] ? stack_access_ok+0xda/0x1f0 [ 9980.654306][ C1] ? get_reg+0x119/0x190 [ 9980.654518][ C1] ? unwind_next_frame+0x12af/0x1d10 [ 9980.654778][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9980.655080][ C1] __tcf_classify+0x329/0x7d0 [ 9980.655318][ C1] tcf_classify+0x283/0x930 [ 9980.655544][ C1] ? arch_stack_walk+0xa2/0x100 [ 9980.655786][ C1] ? __pfx_tcf_classify+0x10/0x10 [ 9980.656036][ C1] ? get_stack_info+0x36/0xc0 [ 9980.656273][ C1] tc_run+0x2e4/0x5d0 [ 9980.656473][ C1] ? __pfx_tc_run+0x10/0x10 [ 9980.656702][ C1] ? lock_acquire+0x1c1/0x220 [ 9980.656935][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [ 9980.657191][ C1] __dev_queue_xmit+0x686/0x17e0 [ 9980.657439][ C1] ? lock_acquire+0x1c1/0x220 [ 9980.657670][ C1] ? ip_finish_output2+0x786/0x18e0 [ 9980.657929][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9980.658225][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [ 9980.658492][ C1] ? neigh_hh_output+0x348/0x590 [ 9980.658738][ C1] ? ip_finish_output2+0x262/0x18e0 [ 9980.658997][ C1] ip_finish_output2+0x786/0x18e0 [ 9980.659249][ C1] ? stack_depot_save_flags+0x45/0x550 [ 9980.659519][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [ 9980.659847][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [ 9980.660116][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9980.660365][ C1] ? __ip_finish_output+0x10f/0x770 [ 9980.660625][ C1] ip_output+0x16b/0x4f0 [ 9980.660836][ C1] ? run_timer_softirq+0x72/0x100 [ 9980.661087][ C1] ? __pfx_ip_output+0x10/0x10 [ 9980.661328][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [ 9980.661606][ C1] ? rcu_read_lock_held+0xe/0x50 [ 9980.661852][ C1] ? ip_local_out+0x114/0x3b0 [ 9980.662087][ C1] __ip_queue_xmit+0x672/0x1910 [ 9980.662331][ C1] ? __create_object+0x5e/0xb0 [ 9980.662573][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [ 9980.662857][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [ 9980.663138][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [ 9980.663411][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [ 9980.663694][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9980.663971][ C1] tcp_delack_timer+0x84/0x240 [ 9980.664211][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9980.664476][ C1] call_timer_fn+0x173/0x430 [ 9980.664707][ C1] ? __pfx_call_timer_fn+0x10/0x10 [ 9980.664962][ C1] ? next_expiry_recalc+0xcd/0x220 [ 9980.665218][ C1] __run_timers.part.0+0x52d/0x890 [ 9980.665472][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [ 9980.665738][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [ 9980.666016][ C1] ? lock_acquire+0x1c1/0x220 [ 9980.666249][ C1] ? clockevents_program_event+0xf6/0x300 [ 9980.666533][ C1] ? lock_release+0x1d5/0x250 [ 9980.666765][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9980.667024][ C1] ? ktime_get+0xb3/0x190 [ 9980.667240][ C1] ? clockevents_program_event+0x1ea/0x300 [ 9980.667530][ C1] run_timer_softirq+0x72/0x100 [ 9980.667771][ C1] __do_softirq+0x1b9/0x7ff [ 9980.667996][ C1] irq_exit_rcu+0x98/0xc0 [ 9980.668213][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [ 9980.668491][ C1] [ 9980.668637][ C1] [ 9980.668784][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 9980.669080][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [ 9980.669398][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [ 9980.670344][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [ 9980.670644][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [ 9980.671033][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [ 9980.671422][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [ 9980.671808][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [ 9980.672198][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [ 9980.672592][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [ 9980.672903][ C1] pipe_read+0xa16/0xdf0 [ 9980.673125][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [ 9980.673401][ C1] ? __pfx_pipe_read+0x10/0x10 [ 9980.673645][ C1] ? iterate_tty_write+0x299/0x540 [ 9980.673914][ C1] ? lock_release+0x1d5/0x250 [ 9980.674151][ C1] vfs_read+0x911/0xc00 [ 9980.674360][ C1] ? lock_acquire+0x1c1/0x220 [ 9980.674593][ C1] ? __might_fault+0xc6/0x180 [ 9980.674827][ C1] ? __pfx_vfs_read+0x10/0x10 [ 9980.675058][ C1] ? __might_fault+0xc6/0x180 [ 9980.675293][ C1] ? lock_release+0x1d5/0x250 [ 9980.675528][ C1] ? kvm_clock_get_cycles+0x18/0x30 [ 9980.675785][ C1] ? __fget_light+0x54/0x1e0 [ 9980.676018][ C1] ksys_read+0x17a/0x1e0 [ 9980.676230][ C1] ? __pfx_ksys_read+0x10/0x10 [ 9980.676468][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [ 9980.676765][ C1] do_syscall_64+0xc9/0x1e0 [ 9980.676991][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [ 9980.677285][ C1] RIP: 0033:0x7f08a1ea38b2 [ 9980.677507][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [ 9980.678459][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [ 9980.678869][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [ 9980.679259][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [ 9980.679651][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 9980.680058][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [ 9980.680455][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [ 9980.680857][ C1] [10008.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7130s! [swapper/2:0] [10008.569676][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10008.570885][ C2] irq event stamp: 44114564 [10008.571108][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10008.571625][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10008.572120][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10008.572586][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10008.573040][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10008.573482][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10008.574074][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10008.574390][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10008.575329][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10008.575626][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10008.576012][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10008.576398][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10008.576783][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10008.577171][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10008.577558][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10008.577990][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10008.578313][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10008.578699][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10008.579087][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10008.579473][ C2] PKRU: 55555554 [10008.579649][ C2] Call Trace: [10008.579812][ C2] [10008.579956][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10008.580211][ C2] ? __run_hrtimer+0x1c0/0x710 [10008.580447][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10008.580714][ C2] ? __hrtimer_run_queues+0x197/0x270 [10008.580977][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10008.581263][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10008.581519][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10008.581816][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10008.582069][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10008.582324][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10008.582626][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10008.582913][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10008.583237][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10008.583524][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10008.583822][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10008.584126][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10008.584436][ C2] ? get_stack_info+0x36/0xc0 [10008.584676][ C2] ? lock_acquire+0x1c1/0x220 [10008.584915][ C2] ? lock_release+0x1d5/0x250 [10008.585155][ C2] do_raw_spin_lock+0x1ec/0x270 [10008.585402][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10008.585683][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10008.585956][ C2] ? lock_acquire+0x1c1/0x220 [10008.586189][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10008.586423][ C2] _raw_spin_lock_nested+0x65/0x80 [10008.586675][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10008.586902][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10008.587141][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10008.587392][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10008.587662][ C2] ip_local_deliver_finish+0x2ae/0x480 [10008.587930][ C2] ip_local_deliver+0x19d/0x480 [10008.588171][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10008.588433][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10008.588688][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10008.589026][ C2] ? rcu_read_lock_held+0xe/0x50 [10008.589272][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10008.589582][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10008.589835][ C2] ip_rcv+0x564/0x740 [10008.590034][ C2] ? __pfx_ip_rcv+0x10/0x10 [10008.590256][ C2] ? set_track_prepare+0x8a/0xd0 [10008.590502][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10008.590771][ C2] ? start_secondary+0x21c/0x2b0 [10008.591014][ C2] ? skb_clone+0x10b/0x330 [10008.591235][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10008.591544][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10008.591841][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10008.592113][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10008.592401][ C2] ? __tcf_classify+0x329/0x7d0 [10008.592666][ C2] ? __pfx_ip_rcv+0x10/0x10 [10008.592893][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10008.593193][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10008.593475][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10008.593806][ C2] ? lock_acquire+0x1c1/0x220 [10008.594037][ C2] ? netif_receive_skb_internal+0x84/0x300 [10008.594327][ C2] netif_receive_skb_internal+0xb0/0x300 [10008.594601][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10008.594909][ C2] ? __copy_skb_header+0xaf/0x490 [10008.595158][ C2] ? __skb_clone+0x57a/0x760 [10008.595385][ C2] netif_receive_skb+0x55/0x280 [10008.595626][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10008.595930][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10008.596253][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10008.596541][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10008.596807][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10008.597088][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10008.597392][ C2] ? get_stack_info+0x36/0xc0 [10008.597624][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10008.597882][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10008.598188][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10008.598458][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10008.598725][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10008.599031][ C2] ? kernel_text_address+0x17/0xe0 [10008.599284][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10008.599588][ C2] ? arch_stack_walk+0x8c/0x100 [10008.599830][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10008.600086][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10008.600362][ C2] ? lock_acquire+0x1c1/0x220 [10008.600594][ C2] ? stack_depot_save_flags+0x281/0x550 [10008.600867][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10008.601163][ C2] ? get_stack_info_noinstr+0x18/0x110 [10008.601433][ C2] ? get_stack_info+0x36/0xc0 [10008.601664][ C2] __tcf_classify+0x329/0x7d0 [10008.601898][ C2] tcf_classify+0x283/0x930 [10008.602124][ C2] ? __pfx_tcf_classify+0x10/0x10 [10008.602373][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10008.602682][ C2] tc_run+0x2e4/0x5d0 [10008.602882][ C2] ? __pfx_tc_run+0x10/0x10 [10008.603103][ C2] ? lock_acquire+0x1c1/0x220 [10008.603336][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10008.603589][ C2] __dev_queue_xmit+0x686/0x17e0 [10008.603834][ C2] ? lock_acquire+0x1c1/0x220 [10008.604086][ C2] ? ip_finish_output2+0x786/0x18e0 [10008.604351][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10008.604654][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10008.604924][ C2] ? neigh_hh_output+0x348/0x590 [10008.605176][ C2] ? ip_finish_output2+0x262/0x18e0 [10008.605440][ C2] ip_finish_output2+0x786/0x18e0 [10008.605695][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10008.606034][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10008.606303][ C2] ? rcu_read_lock_held+0xe/0x50 [10008.606546][ C2] ? __ip_finish_output+0x10f/0x770 [10008.606804][ C2] ip_output+0x16b/0x4f0 [10008.607014][ C2] ? __pfx_ip_output+0x10/0x10 [10008.607251][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10008.607517][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10008.607820][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10008.608086][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10008.608331][ C2] ? __alloc_skb+0xd4/0x280 [10008.608556][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10008.608816][ C2] ? tcp_fragment+0x168/0x1040 [10008.609054][ C2] ? rcu_read_lock_held+0xe/0x50 [10008.609299][ C2] ? ip_local_out+0x114/0x3b0 [10008.609532][ C2] __ip_queue_xmit+0x672/0x1910 [10008.609771][ C2] ? __skb_clone+0x57a/0x760 [10008.609999][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10008.610258][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10008.610532][ C2] ? ipv4_dst_check+0xe3/0x170 [10008.610769][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10008.611010][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10008.611303][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10008.611613][ C2] ? tcp_fragment+0xb0e/0x1040 [10008.611850][ C2] tcp_send_loss_probe+0x348/0x830 [10008.612103][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10008.612363][ C2] tcp_write_timer+0x82/0x1d0 [10008.612621][ C2] call_timer_fn+0x173/0x430 [10008.612855][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10008.613117][ C2] ? next_expiry_recalc+0xcd/0x220 [10008.613378][ C2] __run_timers.part.0+0x52d/0x890 [10008.613637][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10008.613909][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10008.614185][ C2] ? lock_acquire+0x1c1/0x220 [10008.614417][ C2] ? clockevents_program_event+0xf6/0x300 [10008.614721][ C2] ? lock_release+0x1d5/0x250 [10008.614957][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10008.615223][ C2] ? ktime_get+0xb3/0x190 [10008.615444][ C2] ? clockevents_program_event+0x1ea/0x300 [10008.615739][ C2] run_timer_softirq+0x72/0x100 [10008.615990][ C2] __do_softirq+0x1b9/0x7ff [10008.616218][ C2] irq_exit_rcu+0x98/0xc0 [10008.616431][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10008.616707][ C2] [10008.616851][ C2] [10008.616998][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10008.617293][ C2] RIP: 0010:default_idle+0xf/0x20 [10008.617541][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10008.618485][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10008.618782][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10008.619171][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10008.619558][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10008.619945][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10008.620331][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10008.620720][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10008.621000][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10008.621252][ C2] default_idle_call+0x69/0xa0 [10008.621489][ C2] cpuidle_idle_call+0x1f6/0x280 [10008.621733][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10008.622001][ C2] ? lock_release+0x1d5/0x250 [10008.622234][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10008.622521][ C2] do_idle+0xfb/0x160 [10008.622722][ C2] cpu_startup_entry+0x55/0x60 [10008.622963][ C2] start_secondary+0x21c/0x2b0 [10008.623206][ C2] ? __pfx_start_secondary+0x10/0x10 [10008.623475][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10008.623790][ C2] [10008.623943][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7130s! [perl:4135] [10008.624346][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10008.625566][ C1] irq event stamp: 209232 [10008.625781][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10008.626296][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10008.626759][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10008.627219][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10008.627672][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10008.628109][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10008.628705][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10008.629023][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10008.629969][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10008.630268][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10008.630660][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10008.631048][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10008.631437][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10008.631824][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10008.632216][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10008.632681][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10008.633013][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10008.633414][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10008.633820][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10008.634209][ C1] PKRU: 55555554 [10008.634387][ C1] Call Trace: [10008.634551][ C1] [10008.634696][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10008.634951][ C1] ? __run_hrtimer+0x1c0/0x710 [10008.635188][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10008.635460][ C1] ? __hrtimer_run_queues+0x197/0x270 [10008.635725][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10008.636006][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10008.636266][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10008.636563][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10008.636819][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10008.637119][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10008.637410][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10008.637718][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10008.637999][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10008.638290][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10008.638574][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10008.638879][ C1] ? get_stack_info+0x36/0xc0 [10008.639114][ C1] ? lock_acquire+0x1c1/0x220 [10008.639351][ C1] ? lock_release+0x1d5/0x250 [10008.639584][ C1] do_raw_spin_lock+0x1ec/0x270 [10008.639825][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10008.640093][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10008.640371][ C1] ? lock_acquire+0x1c1/0x220 [10008.640607][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10008.640842][ C1] _raw_spin_lock_nested+0x65/0x80 [10008.641095][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10008.641324][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10008.641566][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10008.641816][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10008.642082][ C1] ip_local_deliver_finish+0x2ae/0x480 [10008.642357][ C1] ip_local_deliver+0x19d/0x480 [10008.642623][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10008.642894][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10008.643159][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10008.643506][ C1] ? rcu_read_lock_held+0xe/0x50 [10008.643767][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10008.644079][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10008.644336][ C1] ip_rcv+0x564/0x740 [10008.644535][ C1] ? __pfx_ip_rcv+0x10/0x10 [10008.644761][ C1] ? set_track_prepare+0x8a/0xd0 [10008.645008][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10008.645278][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10008.645546][ C1] ? skb_clone+0x10b/0x330 [10008.645766][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10008.646077][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10008.646378][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10008.646651][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10008.646940][ C1] ? __tcf_classify+0x329/0x7d0 [10008.647183][ C1] ? __pfx_ip_rcv+0x10/0x10 [10008.647407][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10008.647700][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10008.647978][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10008.648297][ C1] ? lock_acquire+0x1c1/0x220 [10008.648531][ C1] ? netif_receive_skb_internal+0x84/0x300 [10008.648821][ C1] netif_receive_skb_internal+0xb0/0x300 [10008.649097][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10008.649409][ C1] ? __copy_skb_header+0xaf/0x490 [10008.649659][ C1] ? __skb_clone+0x57a/0x760 [10008.649889][ C1] netif_receive_skb+0x55/0x280 [10008.650132][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10008.650436][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10008.650762][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10008.651052][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10008.651322][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10008.651604][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10008.651909][ C1] ? hlock_class+0x4e/0x130 [10008.652134][ C1] ? get_stack_info_noinstr+0x18/0x110 [10008.652407][ C1] ? get_stack_info_noinstr+0x18/0x110 [10008.652701][ C1] ? __pfx_validate_chain+0x10/0x10 [10008.652964][ C1] ? hlock_class+0x4e/0x130 [10008.653199][ C1] ? mark_lock+0x38/0x3e0 [10008.653418][ C1] ? stack_access_ok+0xda/0x1f0 [10008.653677][ C1] ? __lock_acquire+0xb67/0x1610 [10008.653924][ C1] ? get_stack_info_noinstr+0x18/0x110 [10008.654194][ C1] ? get_stack_info+0x36/0xc0 [10008.654430][ C1] ? stack_access_ok+0xda/0x1f0 [10008.654671][ C1] ? get_reg+0x119/0x190 [10008.654881][ C1] ? unwind_next_frame+0x12af/0x1d10 [10008.655143][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10008.655445][ C1] __tcf_classify+0x329/0x7d0 [10008.655681][ C1] tcf_classify+0x283/0x930 [10008.655907][ C1] ? arch_stack_walk+0xa2/0x100 [10008.656149][ C1] ? __pfx_tcf_classify+0x10/0x10 [10008.656401][ C1] ? get_stack_info+0x36/0xc0 [10008.656635][ C1] tc_run+0x2e4/0x5d0 [10008.656834][ C1] ? __pfx_tc_run+0x10/0x10 [10008.657060][ C1] ? lock_acquire+0x1c1/0x220 [10008.657295][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10008.657550][ C1] __dev_queue_xmit+0x686/0x17e0 [10008.657797][ C1] ? lock_acquire+0x1c1/0x220 [10008.658030][ C1] ? ip_finish_output2+0x786/0x18e0 [10008.658289][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10008.658585][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10008.658852][ C1] ? neigh_hh_output+0x348/0x590 [10008.659099][ C1] ? ip_finish_output2+0x262/0x18e0 [10008.659359][ C1] ip_finish_output2+0x786/0x18e0 [10008.659608][ C1] ? stack_depot_save_flags+0x45/0x550 [10008.659877][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10008.660207][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10008.660477][ C1] ? rcu_read_lock_held+0xe/0x50 [10008.660724][ C1] ? __ip_finish_output+0x10f/0x770 [10008.660983][ C1] ip_output+0x16b/0x4f0 [10008.661194][ C1] ? run_timer_softirq+0x72/0x100 [10008.661445][ C1] ? __pfx_ip_output+0x10/0x10 [10008.661682][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10008.661960][ C1] ? rcu_read_lock_held+0xe/0x50 [10008.662207][ C1] ? ip_local_out+0x114/0x3b0 [10008.662446][ C1] __ip_queue_xmit+0x672/0x1910 [10008.662710][ C1] ? __create_object+0x5e/0xb0 [10008.662956][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10008.663224][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10008.663505][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10008.663784][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10008.664061][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10008.664327][ C1] tcp_delack_timer+0x84/0x240 [10008.664566][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10008.664830][ C1] call_timer_fn+0x173/0x430 [10008.665060][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10008.665317][ C1] ? next_expiry_recalc+0xcd/0x220 [10008.665572][ C1] __run_timers.part.0+0x52d/0x890 [10008.665826][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10008.666092][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10008.666374][ C1] ? lock_acquire+0x1c1/0x220 [10008.666605][ C1] ? clockevents_program_event+0xf6/0x300 [10008.666889][ C1] ? lock_release+0x1d5/0x250 [10008.667123][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10008.667382][ C1] ? ktime_get+0xb3/0x190 [10008.667596][ C1] ? clockevents_program_event+0x1ea/0x300 [10008.667886][ C1] run_timer_softirq+0x72/0x100 [10008.668128][ C1] __do_softirq+0x1b9/0x7ff [10008.668354][ C1] irq_exit_rcu+0x98/0xc0 [10008.668572][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10008.668849][ C1] [10008.668997][ C1] [10008.669143][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10008.669442][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10008.669758][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10008.670709][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10008.671010][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10008.671400][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10008.671789][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10008.672178][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10008.672593][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10008.672994][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10008.673293][ C1] pipe_read+0xa16/0xdf0 [10008.673514][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10008.673799][ C1] ? __pfx_pipe_read+0x10/0x10 [10008.674036][ C1] ? iterate_tty_write+0x299/0x540 [10008.674292][ C1] ? lock_release+0x1d5/0x250 [10008.674527][ C1] vfs_read+0x911/0xc00 [10008.674735][ C1] ? lock_acquire+0x1c1/0x220 [10008.674968][ C1] ? __might_fault+0xc6/0x180 [10008.675204][ C1] ? __pfx_vfs_read+0x10/0x10 [10008.675436][ C1] ? __might_fault+0xc6/0x180 [10008.675669][ C1] ? lock_release+0x1d5/0x250 [10008.675903][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10008.676162][ C1] ? __fget_light+0x54/0x1e0 [10008.676395][ C1] ksys_read+0x17a/0x1e0 [10008.676606][ C1] ? __pfx_ksys_read+0x10/0x10 [10008.676847][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10008.677145][ C1] do_syscall_64+0xc9/0x1e0 [10008.677371][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10008.677664][ C1] RIP: 0033:0x7f08a1ea38b2 [10008.677887][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10008.678833][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10008.679243][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10008.679630][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10008.680020][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10008.680409][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10008.680796][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10008.681188][ C1] [10030.632104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10030.632455][ C1] rcu: 1-....: (7655975 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1802416 [10030.633001][ C1] rcu: (t=7675745 jiffies g=1882453 q=724 ncpus=4) [10030.633325][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10030.633760][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10030.634360][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10030.634674][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [10030.635619][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10030.635919][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10030.636308][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10030.636696][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10030.637084][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10030.637474][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10030.637862][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10030.638299][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10030.638621][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10030.639011][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10030.639401][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10030.639789][ C1] PKRU: 55555554 [10030.639966][ C1] Call Trace: [10030.640131][ C1] [10030.640277][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10030.640542][ C1] ? print_cpu_stall+0x263/0x6a0 [10030.640792][ C1] ? check_cpu_stall+0x284/0x500 [10030.641038][ C1] ? rcu_pending+0x92/0x360 [10030.641264][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10030.641528][ C1] ? update_process_times+0xb9/0x110 [10030.641789][ C1] ? tick_sched_handle+0x67/0x130 [10030.642039][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10030.642317][ C1] ? __run_hrtimer+0x1c0/0x710 [10030.642577][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10030.642889][ C1] ? __hrtimer_run_queues+0x197/0x270 [10030.643162][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10030.643452][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10030.643722][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10030.644019][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10030.644275][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10030.644576][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10030.644864][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10030.645170][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10030.645454][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [10030.645735][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10030.646017][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10030.646321][ C1] ? get_stack_info+0x36/0xc0 [10030.646555][ C1] ? lock_acquire+0x1c1/0x220 [10030.646789][ C1] ? lock_release+0x1d5/0x250 [10030.647024][ C1] do_raw_spin_lock+0x1ec/0x270 [10030.647266][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10030.647532][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10030.647808][ C1] ? lock_acquire+0x1c1/0x220 [10030.648042][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10030.648277][ C1] _raw_spin_lock_nested+0x65/0x80 [10030.648531][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10030.648759][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10030.648999][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10030.649250][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10030.649520][ C1] ip_local_deliver_finish+0x2ae/0x480 [10030.649790][ C1] ip_local_deliver+0x19d/0x480 [10030.650031][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10030.650303][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10030.650560][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10030.650899][ C1] ? rcu_read_lock_held+0xe/0x50 [10030.651144][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10030.651457][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10030.651712][ C1] ip_rcv+0x564/0x740 [10030.651911][ C1] ? __pfx_ip_rcv+0x10/0x10 [10030.652134][ C1] ? set_track_prepare+0x8a/0xd0 [10030.652385][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10030.652656][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10030.652921][ C1] ? skb_clone+0x10b/0x330 [10030.653141][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10030.653453][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10030.653752][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10030.654025][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10030.654314][ C1] ? __tcf_classify+0x329/0x7d0 [10030.654557][ C1] ? __pfx_ip_rcv+0x10/0x10 [10030.654781][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10030.655074][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10030.655354][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10030.655671][ C1] ? lock_acquire+0x1c1/0x220 [10030.655901][ C1] ? netif_receive_skb_internal+0x84/0x300 [10030.656190][ C1] netif_receive_skb_internal+0xb0/0x300 [10030.656469][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10030.656777][ C1] ? __copy_skb_header+0xaf/0x490 [10030.657029][ C1] ? __skb_clone+0x57a/0x760 [10030.657260][ C1] netif_receive_skb+0x55/0x280 [10030.657502][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10030.657806][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10030.658129][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10030.658421][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10030.658689][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10030.658968][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10030.659276][ C1] ? hlock_class+0x4e/0x130 [10030.659503][ C1] ? get_stack_info_noinstr+0x18/0x110 [10030.659772][ C1] ? get_stack_info_noinstr+0x18/0x110 [10030.660039][ C1] ? __pfx_validate_chain+0x10/0x10 [10030.660296][ C1] ? hlock_class+0x4e/0x130 [10030.660523][ C1] ? mark_lock+0x38/0x3e0 [10030.660735][ C1] ? stack_access_ok+0xda/0x1f0 [10030.660978][ C1] ? __lock_acquire+0xb67/0x1610 [10030.661226][ C1] ? get_stack_info_noinstr+0x18/0x110 [10030.661496][ C1] ? get_stack_info+0x36/0xc0 [10030.661729][ C1] ? stack_access_ok+0xda/0x1f0 [10030.661969][ C1] ? get_reg+0x119/0x190 [10030.662181][ C1] ? unwind_next_frame+0x12af/0x1d10 [10030.662464][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10030.662772][ C1] __tcf_classify+0x329/0x7d0 [10030.663013][ C1] tcf_classify+0x283/0x930 [10030.663247][ C1] ? arch_stack_walk+0xa2/0x100 [10030.663496][ C1] ? __pfx_tcf_classify+0x10/0x10 [10030.663757][ C1] ? get_stack_info+0x36/0xc0 [10030.663991][ C1] tc_run+0x2e4/0x5d0 [10030.664192][ C1] ? __pfx_tc_run+0x10/0x10 [10030.664416][ C1] ? lock_acquire+0x1c1/0x220 [10030.664649][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10030.664903][ C1] __dev_queue_xmit+0x686/0x17e0 [10030.665149][ C1] ? lock_acquire+0x1c1/0x220 [10030.665383][ C1] ? ip_finish_output2+0x786/0x18e0 [10030.665640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10030.665938][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10030.666203][ C1] ? neigh_hh_output+0x348/0x590 [10030.666449][ C1] ? ip_finish_output2+0x262/0x18e0 [10030.666707][ C1] ip_finish_output2+0x786/0x18e0 [10030.666956][ C1] ? stack_depot_save_flags+0x45/0x550 [10030.667226][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10030.667555][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10030.667825][ C1] ? rcu_read_lock_held+0xe/0x50 [10030.668071][ C1] ? __ip_finish_output+0x10f/0x770 [10030.668330][ C1] ip_output+0x16b/0x4f0 [10030.668539][ C1] ? run_timer_softirq+0x72/0x100 [10030.668788][ C1] ? __pfx_ip_output+0x10/0x10 [10030.669026][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10030.669305][ C1] ? rcu_read_lock_held+0xe/0x50 [10030.669549][ C1] ? ip_local_out+0x114/0x3b0 [10030.669783][ C1] __ip_queue_xmit+0x672/0x1910 [10030.670024][ C1] ? __create_object+0x5e/0xb0 [10030.670263][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10030.670522][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10030.670796][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10030.671063][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10030.671338][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10030.671602][ C1] tcp_delack_timer+0x84/0x240 [10030.671840][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10030.672104][ C1] call_timer_fn+0x173/0x430 [10030.672336][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10030.672594][ C1] ? next_expiry_recalc+0xcd/0x220 [10030.672848][ C1] __run_timers.part.0+0x52d/0x890 [10030.673101][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10030.673368][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10030.673647][ C1] ? lock_acquire+0x1c1/0x220 [10030.673880][ C1] ? clockevents_program_event+0xf6/0x300 [10030.674162][ C1] ? lock_release+0x1d5/0x250 [10030.674395][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10030.674652][ C1] ? ktime_get+0xb3/0x190 [10030.674868][ C1] ? clockevents_program_event+0x1ea/0x300 [10030.675157][ C1] run_timer_softirq+0x72/0x100 [10030.675400][ C1] __do_softirq+0x1b9/0x7ff [10030.675630][ C1] irq_exit_rcu+0x98/0xc0 [10030.675844][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10030.676122][ C1] [10030.676269][ C1] [10030.676414][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10030.676711][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10030.677030][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10030.677976][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10030.678276][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10030.678664][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10030.679052][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10030.679442][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10030.679831][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10030.680222][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10030.680512][ C1] pipe_read+0xa16/0xdf0 [10030.680725][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10030.680996][ C1] ? __pfx_pipe_read+0x10/0x10 [10030.681232][ C1] ? iterate_tty_write+0x299/0x540 [10030.681487][ C1] ? lock_release+0x1d5/0x250 [10030.681721][ C1] vfs_read+0x911/0xc00 [10030.681929][ C1] ? lock_acquire+0x1c1/0x220 [10030.682162][ C1] ? __might_fault+0xc6/0x180 [10030.682417][ C1] ? __pfx_vfs_read+0x10/0x10 [10030.682657][ C1] ? __might_fault+0xc6/0x180 [10030.682896][ C1] ? lock_release+0x1d5/0x250 [10030.683136][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10030.683401][ C1] ? __fget_light+0x54/0x1e0 [10030.683647][ C1] ksys_read+0x17a/0x1e0 [10030.683858][ C1] ? __pfx_ksys_read+0x10/0x10 [10030.684096][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10030.684394][ C1] do_syscall_64+0xc9/0x1e0 [10030.684621][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10030.684912][ C1] RIP: 0033:0x7f08a1ea38b2 [10030.685134][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10030.686077][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10030.686490][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10030.686879][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10030.687268][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10030.687654][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10030.688047][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10030.688440][ C1] [10030.688592][ C1] Sending NMI from CPU 1 to CPUs 2: [10030.688856][ C2] NMI backtrace for cpu 2 [10030.688861][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10030.688867][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10030.688871][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10030.688879][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10030.688884][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10030.688889][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10030.688892][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10030.688896][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10030.688900][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10030.688904][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10030.688907][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10030.688912][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10030.688917][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10030.688921][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10030.688924][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10030.688927][ C2] PKRU: 55555554 [10030.688929][ C2] Call Trace: [10030.688931][ C2] [10030.688933][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10030.688940][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10030.688944][ C2] ? nmi_handle+0x153/0x420 [10030.688948][ C2] ? default_do_nmi+0x41/0x100 [10030.688951][ C2] ? exc_nmi+0xf3/0x120 [10030.688954][ C2] ? end_repeat_nmi+0xf/0x60 [10030.688958][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10030.688962][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10030.688964][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10030.688968][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10030.688971][ C2] [10030.688971][ C2] [10030.688972][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10030.688975][ C2] ? get_stack_info+0x36/0xc0 [10030.688979][ C2] ? lock_acquire+0x1c1/0x220 [10030.688982][ C2] ? lock_release+0x1d5/0x250 [10030.688985][ C2] do_raw_spin_lock+0x1ec/0x270 [10030.688989][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10030.688992][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10030.688995][ C2] ? lock_acquire+0x1c1/0x220 [10030.688997][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10030.689000][ C2] _raw_spin_lock_nested+0x65/0x80 [10030.689003][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10030.689009][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10030.689011][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10030.689015][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10030.689020][ C2] ip_local_deliver_finish+0x2ae/0x480 [10030.689023][ C2] ip_local_deliver+0x19d/0x480 [10030.689025][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10030.689027][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10030.689030][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10030.689034][ C2] ? rcu_read_lock_held+0xe/0x50 [10030.689038][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10030.689041][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10030.689049][ C2] ip_rcv+0x564/0x740 [10030.689052][ C2] ? __pfx_ip_rcv+0x10/0x10 [10030.689054][ C2] ? set_track_prepare+0x8a/0xd0 [10030.689058][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10030.689061][ C2] ? start_secondary+0x21c/0x2b0 [10030.689064][ C2] ? skb_clone+0x10b/0x330 [10030.689066][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10030.689072][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10030.689077][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10030.689081][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10030.689088][ C2] ? __tcf_classify+0x329/0x7d0 [10030.689092][ C2] ? __pfx_ip_rcv+0x10/0x10 [10030.689094][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10030.689097][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10030.689100][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10030.689104][ C2] ? lock_acquire+0x1c1/0x220 [10030.689107][ C2] ? netif_receive_skb_internal+0x84/0x300 [10030.689111][ C2] netif_receive_skb_internal+0xb0/0x300 [10030.689114][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10030.689118][ C2] ? __copy_skb_header+0xaf/0x490 [10030.689122][ C2] ? __skb_clone+0x57a/0x760 [10030.689124][ C2] netif_receive_skb+0x55/0x280 [10030.689127][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10030.689134][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10030.689140][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10030.689146][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10030.689151][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10030.689160][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10030.689167][ C2] ? get_stack_info+0x36/0xc0 [10030.689172][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10030.689174][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10030.689177][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10030.689180][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10030.689183][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10030.689185][ C2] ? kernel_text_address+0x17/0xe0 [10030.689188][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10030.689191][ C2] ? arch_stack_walk+0x8c/0x100 [10030.689194][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10030.689198][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10030.689201][ C2] ? lock_acquire+0x1c1/0x220 [10030.689203][ C2] ? stack_depot_save_flags+0x281/0x550 [10030.689207][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10030.689210][ C2] ? get_stack_info_noinstr+0x18/0x110 [10030.689213][ C2] ? get_stack_info+0x36/0xc0 [10030.689217][ C2] __tcf_classify+0x329/0x7d0 [10030.689222][ C2] tcf_classify+0x283/0x930 [10030.689226][ C2] ? __pfx_tcf_classify+0x10/0x10 [10030.689229][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10030.689234][ C2] tc_run+0x2e4/0x5d0 [10030.689237][ C2] ? __pfx_tc_run+0x10/0x10 [10030.689240][ C2] ? lock_acquire+0x1c1/0x220 [10030.689242][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10030.689246][ C2] __dev_queue_xmit+0x686/0x17e0 [10030.689250][ C2] ? lock_acquire+0x1c1/0x220 [10030.689252][ C2] ? ip_finish_output2+0x786/0x18e0 [10030.689255][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10030.689258][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10030.689260][ C2] ? neigh_hh_output+0x348/0x590 [10030.689264][ C2] ? ip_finish_output2+0x262/0x18e0 [10030.689268][ C2] ip_finish_output2+0x786/0x18e0 [10030.689271][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10030.689278][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10030.689281][ C2] ? rcu_read_lock_held+0xe/0x50 [10030.689284][ C2] ? __ip_finish_output+0x10f/0x770 [10030.689288][ C2] ip_output+0x16b/0x4f0 [10030.689291][ C2] ? __pfx_ip_output+0x10/0x10 [10030.689293][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10030.689296][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10030.689299][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10030.689302][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10030.689304][ C2] ? __alloc_skb+0xd4/0x280 [10030.689307][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10030.689310][ C2] ? tcp_fragment+0x168/0x1040 [10030.689313][ C2] ? rcu_read_lock_held+0xe/0x50 [10030.689316][ C2] ? ip_local_out+0x114/0x3b0 [10030.689319][ C2] __ip_queue_xmit+0x672/0x1910 [10030.689323][ C2] ? __skb_clone+0x57a/0x760 [10030.689325][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10030.689330][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10030.689333][ C2] ? ipv4_dst_check+0xe3/0x170 [10030.689337][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10030.689341][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10030.689344][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10030.689347][ C2] ? tcp_fragment+0xb0e/0x1040 [10030.689351][ C2] tcp_send_loss_probe+0x348/0x830 [10030.689354][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10030.689356][ C2] tcp_write_timer+0x82/0x1d0 [10030.689359][ C2] call_timer_fn+0x173/0x430 [10030.689363][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10030.689367][ C2] ? next_expiry_recalc+0xcd/0x220 [10030.689371][ C2] __run_timers.part.0+0x52d/0x890 [10030.689374][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10030.689378][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10030.689381][ C2] ? lock_acquire+0x1c1/0x220 [10030.689383][ C2] ? clockevents_program_event+0xf6/0x300 [10030.689387][ C2] ? lock_release+0x1d5/0x250 [10030.689390][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10030.689392][ C2] ? ktime_get+0xb3/0x190 [10030.689395][ C2] ? clockevents_program_event+0x1ea/0x300 [10030.689400][ C2] run_timer_softirq+0x72/0x100 [10030.689403][ C2] __do_softirq+0x1b9/0x7ff [10030.689407][ C2] irq_exit_rcu+0x98/0xc0 [10030.689409][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10030.689412][ C2] [10030.689413][ C2] [10030.689414][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10030.689417][ C2] RIP: 0010:default_idle+0xf/0x20 [10030.689420][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10030.689422][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10030.689424][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10030.689425][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10030.689427][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10030.689428][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10030.689429][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10030.689432][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10030.689435][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10030.689438][ C2] default_idle_call+0x69/0xa0 [10030.689441][ C2] cpuidle_idle_call+0x1f6/0x280 [10030.689443][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10030.689447][ C2] ? lock_release+0x1d5/0x250 [10030.689449][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10030.689453][ C2] do_idle+0xfb/0x160 [10030.689455][ C2] cpu_startup_entry+0x55/0x60 [10030.689457][ C2] start_secondary+0x21c/0x2b0 [10030.689460][ C2] ? __pfx_start_secondary+0x10/0x10 [10030.689464][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10030.689469][ C2] [10056.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7174s! [swapper/2:0] [10056.569676][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10056.570920][ C2] irq event stamp: 44114564 [10056.571158][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10056.571696][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10056.572244][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10056.572731][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10056.573211][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10056.573666][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10056.574284][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10056.574608][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10056.575579][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10056.575877][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10056.576265][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10056.576654][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10056.577041][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10056.577428][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10056.577814][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10056.578249][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10056.578571][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10056.578960][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10056.579347][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10056.579733][ C2] PKRU: 55555554 [10056.579908][ C2] Call Trace: [10056.580074][ C2] [10056.580217][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10056.580473][ C2] ? __run_hrtimer+0x1c0/0x710 [10056.580709][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10056.580978][ C2] ? __hrtimer_run_queues+0x197/0x270 [10056.581244][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10056.581522][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10056.581780][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10056.582076][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10056.582354][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10056.582614][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10056.582922][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10056.583219][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10056.583541][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10056.583821][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10056.584109][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10056.584388][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10056.584692][ C2] ? get_stack_info+0x36/0xc0 [10056.584927][ C2] ? lock_acquire+0x1c1/0x220 [10056.585161][ C2] ? lock_release+0x1d5/0x250 [10056.585392][ C2] do_raw_spin_lock+0x1ec/0x270 [10056.585634][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10056.585899][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10056.586178][ C2] ? lock_acquire+0x1c1/0x220 [10056.586410][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10056.586642][ C2] _raw_spin_lock_nested+0x65/0x80 [10056.586895][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10056.587122][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10056.587362][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10056.587614][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10056.587879][ C2] ip_local_deliver_finish+0x2ae/0x480 [10056.588150][ C2] ip_local_deliver+0x19d/0x480 [10056.588390][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10056.588654][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10056.588910][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10056.589247][ C2] ? rcu_read_lock_held+0xe/0x50 [10056.589492][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10056.589802][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10056.590057][ C2] ip_rcv+0x564/0x740 [10056.590254][ C2] ? __pfx_ip_rcv+0x10/0x10 [10056.590479][ C2] ? set_track_prepare+0x8a/0xd0 [10056.590726][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10056.590992][ C2] ? start_secondary+0x21c/0x2b0 [10056.591236][ C2] ? skb_clone+0x10b/0x330 [10056.591457][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10056.591771][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10056.592066][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10056.592365][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10056.592656][ C2] ? __tcf_classify+0x329/0x7d0 [10056.592904][ C2] ? __pfx_ip_rcv+0x10/0x10 [10056.593134][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10056.593432][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10056.593720][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10056.594036][ C2] ? lock_acquire+0x1c1/0x220 [10056.594270][ C2] ? netif_receive_skb_internal+0x84/0x300 [10056.594556][ C2] netif_receive_skb_internal+0xb0/0x300 [10056.594834][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10056.595143][ C2] ? __copy_skb_header+0xaf/0x490 [10056.595394][ C2] ? __skb_clone+0x57a/0x760 [10056.595620][ C2] netif_receive_skb+0x55/0x280 [10056.595861][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10056.596165][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10056.596487][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10056.596778][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10056.597044][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10056.597325][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10056.597627][ C2] ? get_stack_info+0x36/0xc0 [10056.597861][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10056.598117][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10056.598425][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10056.598691][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10056.598962][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10056.599268][ C2] ? kernel_text_address+0x17/0xe0 [10056.599521][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10056.599825][ C2] ? arch_stack_walk+0x8c/0x100 [10056.600065][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10056.600324][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10056.600600][ C2] ? lock_acquire+0x1c1/0x220 [10056.600832][ C2] ? stack_depot_save_flags+0x281/0x550 [10056.601105][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10056.601403][ C2] ? get_stack_info_noinstr+0x18/0x110 [10056.601670][ C2] ? get_stack_info+0x36/0xc0 [10056.601904][ C2] __tcf_classify+0x329/0x7d0 [10056.602139][ C2] tcf_classify+0x283/0x930 [10056.602389][ C2] ? __pfx_tcf_classify+0x10/0x10 [10056.602644][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10056.602956][ C2] tc_run+0x2e4/0x5d0 [10056.603159][ C2] ? __pfx_tc_run+0x10/0x10 [10056.603392][ C2] ? lock_acquire+0x1c1/0x220 [10056.603636][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10056.603888][ C2] __dev_queue_xmit+0x686/0x17e0 [10056.604133][ C2] ? lock_acquire+0x1c1/0x220 [10056.604365][ C2] ? ip_finish_output2+0x786/0x18e0 [10056.604622][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10056.604913][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10056.605181][ C2] ? neigh_hh_output+0x348/0x590 [10056.605425][ C2] ? ip_finish_output2+0x262/0x18e0 [10056.605682][ C2] ip_finish_output2+0x786/0x18e0 [10056.605931][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10056.606259][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10056.606525][ C2] ? rcu_read_lock_held+0xe/0x50 [10056.606769][ C2] ? __ip_finish_output+0x10f/0x770 [10056.607025][ C2] ip_output+0x16b/0x4f0 [10056.607237][ C2] ? __pfx_ip_output+0x10/0x10 [10056.607472][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10056.607742][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10056.608044][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10056.608313][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10056.608557][ C2] ? __alloc_skb+0xd4/0x280 [10056.608780][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10056.609042][ C2] ? tcp_fragment+0x168/0x1040 [10056.609279][ C2] ? rcu_read_lock_held+0xe/0x50 [10056.609522][ C2] ? ip_local_out+0x114/0x3b0 [10056.609756][ C2] __ip_queue_xmit+0x672/0x1910 [10056.609996][ C2] ? __skb_clone+0x57a/0x760 [10056.610225][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10056.610482][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10056.610753][ C2] ? ipv4_dst_check+0xe3/0x170 [10056.610990][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10056.611232][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10056.611525][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10056.611835][ C2] ? tcp_fragment+0xb0e/0x1040 [10056.612070][ C2] tcp_send_loss_probe+0x348/0x830 [10056.612345][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10056.612614][ C2] tcp_write_timer+0x82/0x1d0 [10056.612851][ C2] call_timer_fn+0x173/0x430 [10056.613086][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10056.613347][ C2] ? next_expiry_recalc+0xcd/0x220 [10056.613613][ C2] __run_timers.part.0+0x52d/0x890 [10056.613864][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10056.614127][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10056.614404][ C2] ? lock_acquire+0x1c1/0x220 [10056.614639][ C2] ? clockevents_program_event+0xf6/0x300 [10056.614920][ C2] ? lock_release+0x1d5/0x250 [10056.615152][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10056.615408][ C2] ? ktime_get+0xb3/0x190 [10056.615622][ C2] ? clockevents_program_event+0x1ea/0x300 [10056.615909][ C2] run_timer_softirq+0x72/0x100 [10056.616150][ C2] __do_softirq+0x1b9/0x7ff [10056.616377][ C2] irq_exit_rcu+0x98/0xc0 [10056.616590][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10056.616864][ C2] [10056.617010][ C2] [10056.617155][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10056.617451][ C2] RIP: 0010:default_idle+0xf/0x20 [10056.617700][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10056.618638][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10056.618934][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10056.619321][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10056.619706][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10056.620093][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10056.620480][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10056.620866][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10056.621147][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10056.621400][ C2] default_idle_call+0x69/0xa0 [10056.621636][ C2] cpuidle_idle_call+0x1f6/0x280 [10056.621878][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10056.622152][ C2] ? lock_release+0x1d5/0x250 [10056.622409][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10056.622681][ C2] do_idle+0xfb/0x160 [10056.622883][ C2] cpu_startup_entry+0x55/0x60 [10056.623126][ C2] start_secondary+0x21c/0x2b0 [10056.623370][ C2] ? __pfx_start_secondary+0x10/0x10 [10056.623643][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10056.623943][ C2] [10056.624095][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7174s! [perl:4135] [10056.624497][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10056.625713][ C1] irq event stamp: 209232 [10056.625926][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10056.626440][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10056.626903][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10056.627360][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10056.627808][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10056.628245][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10056.628842][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10056.629159][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10056.630103][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10056.630404][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10056.630791][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10056.631179][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10056.631568][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10056.631958][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10056.632370][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10056.632817][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10056.633150][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10056.633556][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10056.633947][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10056.634335][ C1] PKRU: 55555554 [10056.634513][ C1] Call Trace: [10056.634680][ C1] [10056.634824][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10056.635078][ C1] ? __run_hrtimer+0x1c0/0x710 [10056.635315][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10056.635584][ C1] ? __hrtimer_run_queues+0x197/0x270 [10056.635848][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10056.636133][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10056.636393][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10056.636690][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10056.636945][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10056.637245][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10056.637532][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10056.637837][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10056.638118][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10056.638405][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10056.638687][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10056.638989][ C1] ? get_stack_info+0x36/0xc0 [10056.639224][ C1] ? lock_acquire+0x1c1/0x220 [10056.639467][ C1] ? lock_release+0x1d5/0x250 [10056.639700][ C1] do_raw_spin_lock+0x1ec/0x270 [10056.639942][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10056.640207][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10056.640485][ C1] ? lock_acquire+0x1c1/0x220 [10056.640718][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10056.640952][ C1] _raw_spin_lock_nested+0x65/0x80 [10056.641205][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10056.641433][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10056.641672][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10056.641922][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10056.642192][ C1] ip_local_deliver_finish+0x2ae/0x480 [10056.642486][ C1] ip_local_deliver+0x19d/0x480 [10056.642734][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10056.643005][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10056.643270][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10056.643623][ C1] ? rcu_read_lock_held+0xe/0x50 [10056.643868][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10056.644183][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10056.644438][ C1] ip_rcv+0x564/0x740 [10056.644638][ C1] ? __pfx_ip_rcv+0x10/0x10 [10056.644860][ C1] ? set_track_prepare+0x8a/0xd0 [10056.645106][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10056.645377][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10056.645642][ C1] ? skb_clone+0x10b/0x330 [10056.645860][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10056.646171][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10056.646470][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10056.646742][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10056.647029][ C1] ? __tcf_classify+0x329/0x7d0 [10056.647272][ C1] ? __pfx_ip_rcv+0x10/0x10 [10056.647495][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10056.647787][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10056.648064][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10056.648382][ C1] ? lock_acquire+0x1c1/0x220 [10056.648612][ C1] ? netif_receive_skb_internal+0x84/0x300 [10056.648900][ C1] netif_receive_skb_internal+0xb0/0x300 [10056.649179][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10056.649485][ C1] ? __copy_skb_header+0xaf/0x490 [10056.649735][ C1] ? __skb_clone+0x57a/0x760 [10056.649965][ C1] netif_receive_skb+0x55/0x280 [10056.650209][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10056.650514][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10056.650836][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10056.651126][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10056.651396][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10056.651675][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10056.651982][ C1] ? hlock_class+0x4e/0x130 [10056.652209][ C1] ? get_stack_info_noinstr+0x18/0x110 [10056.652503][ C1] ? get_stack_info_noinstr+0x18/0x110 [10056.652776][ C1] ? __pfx_validate_chain+0x10/0x10 [10056.653038][ C1] ? hlock_class+0x4e/0x130 [10056.653271][ C1] ? mark_lock+0x38/0x3e0 [10056.653498][ C1] ? stack_access_ok+0xda/0x1f0 [10056.653740][ C1] ? __lock_acquire+0xb67/0x1610 [10056.653986][ C1] ? get_stack_info_noinstr+0x18/0x110 [10056.654255][ C1] ? get_stack_info+0x36/0xc0 [10056.654487][ C1] ? stack_access_ok+0xda/0x1f0 [10056.654727][ C1] ? get_reg+0x119/0x190 [10056.654937][ C1] ? unwind_next_frame+0x12af/0x1d10 [10056.655200][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10056.655501][ C1] __tcf_classify+0x329/0x7d0 [10056.655735][ C1] tcf_classify+0x283/0x930 [10056.655960][ C1] ? arch_stack_walk+0xa2/0x100 [10056.656203][ C1] ? __pfx_tcf_classify+0x10/0x10 [10056.656453][ C1] ? get_stack_info+0x36/0xc0 [10056.656686][ C1] tc_run+0x2e4/0x5d0 [10056.656887][ C1] ? __pfx_tc_run+0x10/0x10 [10056.657110][ C1] ? lock_acquire+0x1c1/0x220 [10056.657344][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10056.657597][ C1] __dev_queue_xmit+0x686/0x17e0 [10056.657844][ C1] ? lock_acquire+0x1c1/0x220 [10056.658076][ C1] ? ip_finish_output2+0x786/0x18e0 [10056.658334][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10056.658631][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10056.658894][ C1] ? neigh_hh_output+0x348/0x590 [10056.659141][ C1] ? ip_finish_output2+0x262/0x18e0 [10056.659399][ C1] ip_finish_output2+0x786/0x18e0 [10056.659648][ C1] ? stack_depot_save_flags+0x45/0x550 [10056.659917][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10056.660248][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10056.660516][ C1] ? rcu_read_lock_held+0xe/0x50 [10056.660763][ C1] ? __ip_finish_output+0x10f/0x770 [10056.661020][ C1] ip_output+0x16b/0x4f0 [10056.661231][ C1] ? run_timer_softirq+0x72/0x100 [10056.661479][ C1] ? __pfx_ip_output+0x10/0x10 [10056.661716][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10056.661994][ C1] ? rcu_read_lock_held+0xe/0x50 [10056.662241][ C1] ? ip_local_out+0x114/0x3b0 [10056.662496][ C1] __ip_queue_xmit+0x672/0x1910 [10056.662744][ C1] ? __create_object+0x5e/0xb0 [10056.662988][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10056.663255][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10056.663543][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10056.663808][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10056.664081][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10056.664346][ C1] tcp_delack_timer+0x84/0x240 [10056.664583][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10056.664847][ C1] call_timer_fn+0x173/0x430 [10056.665077][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10056.665332][ C1] ? next_expiry_recalc+0xcd/0x220 [10056.665585][ C1] __run_timers.part.0+0x52d/0x890 [10056.665838][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10056.666104][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10056.666382][ C1] ? lock_acquire+0x1c1/0x220 [10056.666615][ C1] ? clockevents_program_event+0xf6/0x300 [10056.666895][ C1] ? lock_release+0x1d5/0x250 [10056.667128][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10056.667386][ C1] ? ktime_get+0xb3/0x190 [10056.667601][ C1] ? clockevents_program_event+0x1ea/0x300 [10056.667889][ C1] run_timer_softirq+0x72/0x100 [10056.668131][ C1] __do_softirq+0x1b9/0x7ff [10056.668358][ C1] irq_exit_rcu+0x98/0xc0 [10056.668571][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10056.668848][ C1] [10056.668995][ C1] [10056.669140][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10056.669437][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10056.669753][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10056.670693][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10056.670992][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10056.671381][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10056.671768][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10056.672157][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10056.672593][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10056.672993][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10056.673292][ C1] pipe_read+0xa16/0xdf0 [10056.673520][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10056.673790][ C1] ? __pfx_pipe_read+0x10/0x10 [10056.674026][ C1] ? iterate_tty_write+0x299/0x540 [10056.674282][ C1] ? lock_release+0x1d5/0x250 [10056.674518][ C1] vfs_read+0x911/0xc00 [10056.674727][ C1] ? lock_acquire+0x1c1/0x220 [10056.674959][ C1] ? __might_fault+0xc6/0x180 [10056.675195][ C1] ? __pfx_vfs_read+0x10/0x10 [10056.675429][ C1] ? __might_fault+0xc6/0x180 [10056.675662][ C1] ? lock_release+0x1d5/0x250 [10056.675896][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10056.676152][ C1] ? __fget_light+0x54/0x1e0 [10056.676385][ C1] ksys_read+0x17a/0x1e0 [10056.676596][ C1] ? __pfx_ksys_read+0x10/0x10 [10056.676835][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10056.677133][ C1] do_syscall_64+0xc9/0x1e0 [10056.677360][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10056.677651][ C1] RIP: 0033:0x7f08a1ea38b2 [10056.677873][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10056.678820][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10056.679231][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10056.679620][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10056.680009][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10056.680398][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10056.680787][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10056.681181][ C1] [10084.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7200s! [swapper/2:0] [10084.569697][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10084.570914][ C2] irq event stamp: 44114564 [10084.571135][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10084.571665][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10084.572163][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10084.572628][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10084.573086][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10084.573528][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10084.574120][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10084.574435][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10084.575373][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10084.575669][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10084.576055][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10084.576441][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10084.576825][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10084.577211][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10084.577598][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10084.578030][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10084.578352][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10084.578738][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10084.579124][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10084.579511][ C2] PKRU: 55555554 [10084.579687][ C2] Call Trace: [10084.579850][ C2] [10084.580001][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10084.580257][ C2] ? __run_hrtimer+0x1c0/0x710 [10084.580493][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10084.580761][ C2] ? __hrtimer_run_queues+0x197/0x270 [10084.581024][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10084.581306][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10084.581564][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10084.581860][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10084.582133][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10084.582395][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10084.582703][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10084.582997][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10084.583322][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10084.583601][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10084.583885][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10084.584166][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10084.584468][ C2] ? get_stack_info+0x36/0xc0 [10084.584701][ C2] ? lock_acquire+0x1c1/0x220 [10084.584931][ C2] ? lock_release+0x1d5/0x250 [10084.585163][ C2] do_raw_spin_lock+0x1ec/0x270 [10084.585405][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10084.585667][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10084.585943][ C2] ? lock_acquire+0x1c1/0x220 [10084.586173][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10084.586407][ C2] _raw_spin_lock_nested+0x65/0x80 [10084.586658][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10084.586885][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10084.587124][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10084.587375][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10084.587641][ C2] ip_local_deliver_finish+0x2ae/0x480 [10084.587907][ C2] ip_local_deliver+0x19d/0x480 [10084.588146][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10084.588409][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10084.588665][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10084.589002][ C2] ? rcu_read_lock_held+0xe/0x50 [10084.589248][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10084.589558][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10084.589812][ C2] ip_rcv+0x564/0x740 [10084.590008][ C2] ? __pfx_ip_rcv+0x10/0x10 [10084.590233][ C2] ? set_track_prepare+0x8a/0xd0 [10084.590478][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10084.590745][ C2] ? start_secondary+0x21c/0x2b0 [10084.590989][ C2] ? skb_clone+0x10b/0x330 [10084.591208][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10084.591517][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10084.591813][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10084.592085][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10084.592399][ C2] ? __tcf_classify+0x329/0x7d0 [10084.592646][ C2] ? __pfx_ip_rcv+0x10/0x10 [10084.592875][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10084.593173][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10084.593464][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10084.593778][ C2] ? lock_acquire+0x1c1/0x220 [10084.594008][ C2] ? netif_receive_skb_internal+0x84/0x300 [10084.594297][ C2] netif_receive_skb_internal+0xb0/0x300 [10084.594572][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10084.594878][ C2] ? __copy_skb_header+0xaf/0x490 [10084.595128][ C2] ? __skb_clone+0x57a/0x760 [10084.595356][ C2] netif_receive_skb+0x55/0x280 [10084.595597][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10084.595900][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10084.596222][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10084.596511][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10084.596777][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10084.597054][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10084.597356][ C2] ? get_stack_info+0x36/0xc0 [10084.597590][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10084.597846][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10084.598153][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10084.598420][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10084.598688][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10084.598996][ C2] ? kernel_text_address+0x17/0xe0 [10084.599250][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10084.599552][ C2] ? arch_stack_walk+0x8c/0x100 [10084.599793][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10084.600048][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10084.600327][ C2] ? lock_acquire+0x1c1/0x220 [10084.600557][ C2] ? stack_depot_save_flags+0x281/0x550 [10084.600831][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10084.601127][ C2] ? get_stack_info_noinstr+0x18/0x110 [10084.601395][ C2] ? get_stack_info+0x36/0xc0 [10084.601629][ C2] __tcf_classify+0x329/0x7d0 [10084.601862][ C2] tcf_classify+0x283/0x930 [10084.602087][ C2] ? __pfx_tcf_classify+0x10/0x10 [10084.602341][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10084.602644][ C2] tc_run+0x2e4/0x5d0 [10084.602842][ C2] ? __pfx_tc_run+0x10/0x10 [10084.603066][ C2] ? lock_acquire+0x1c1/0x220 [10084.603298][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10084.603550][ C2] __dev_queue_xmit+0x686/0x17e0 [10084.603794][ C2] ? lock_acquire+0x1c1/0x220 [10084.604024][ C2] ? ip_finish_output2+0x786/0x18e0 [10084.604280][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10084.604574][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10084.604837][ C2] ? neigh_hh_output+0x348/0x590 [10084.605080][ C2] ? ip_finish_output2+0x262/0x18e0 [10084.605338][ C2] ip_finish_output2+0x786/0x18e0 [10084.605586][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10084.605914][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10084.606180][ C2] ? rcu_read_lock_held+0xe/0x50 [10084.606425][ C2] ? __ip_finish_output+0x10f/0x770 [10084.606680][ C2] ip_output+0x16b/0x4f0 [10084.606890][ C2] ? __pfx_ip_output+0x10/0x10 [10084.607124][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10084.607396][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10084.607700][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10084.607969][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10084.608214][ C2] ? __alloc_skb+0xd4/0x280 [10084.608435][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10084.608697][ C2] ? tcp_fragment+0x168/0x1040 [10084.608932][ C2] ? rcu_read_lock_held+0xe/0x50 [10084.609176][ C2] ? ip_local_out+0x114/0x3b0 [10084.609410][ C2] __ip_queue_xmit+0x672/0x1910 [10084.609651][ C2] ? __skb_clone+0x57a/0x760 [10084.609879][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10084.610137][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10084.610409][ C2] ? ipv4_dst_check+0xe3/0x170 [10084.610645][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10084.610886][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10084.611179][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10084.611488][ C2] ? tcp_fragment+0xb0e/0x1040 [10084.611724][ C2] tcp_send_loss_probe+0x348/0x830 [10084.611975][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10084.612258][ C2] tcp_write_timer+0x82/0x1d0 [10084.612496][ C2] call_timer_fn+0x173/0x430 [10084.612732][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10084.612993][ C2] ? next_expiry_recalc+0xcd/0x220 [10084.613255][ C2] __run_timers.part.0+0x52d/0x890 [10084.613517][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10084.613775][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10084.614053][ C2] ? lock_acquire+0x1c1/0x220 [10084.614284][ C2] ? clockevents_program_event+0xf6/0x300 [10084.614567][ C2] ? lock_release+0x1d5/0x250 [10084.614799][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10084.615054][ C2] ? ktime_get+0xb3/0x190 [10084.615267][ C2] ? clockevents_program_event+0x1ea/0x300 [10084.615555][ C2] run_timer_softirq+0x72/0x100 [10084.615800][ C2] __do_softirq+0x1b9/0x7ff [10084.616025][ C2] irq_exit_rcu+0x98/0xc0 [10084.616240][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10084.616515][ C2] [10084.616663][ C2] [10084.616807][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10084.617106][ C2] RIP: 0010:default_idle+0xf/0x20 [10084.617356][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10084.618295][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10084.618594][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10084.618979][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10084.619365][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10084.619750][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10084.620137][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10084.620528][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10084.620808][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10084.621060][ C2] default_idle_call+0x69/0xa0 [10084.621295][ C2] cpuidle_idle_call+0x1f6/0x280 [10084.621538][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10084.621810][ C2] ? lock_release+0x1d5/0x250 [10084.622042][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10084.622337][ C2] do_idle+0xfb/0x160 [10084.622539][ C2] cpu_startup_entry+0x55/0x60 [10084.622781][ C2] start_secondary+0x21c/0x2b0 [10084.623022][ C2] ? __pfx_start_secondary+0x10/0x10 [10084.623303][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10084.623602][ C2] [10084.623756][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7200s! [perl:4135] [10084.624160][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10084.625381][ C1] irq event stamp: 209232 [10084.625593][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10084.626108][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10084.626574][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10084.627029][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10084.627479][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10084.627915][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10084.628513][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10084.628828][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10084.629775][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10084.630074][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10084.630463][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10084.630853][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10084.631243][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10084.631631][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10084.632018][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10084.632457][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10084.632782][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10084.633174][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10084.633562][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10084.633948][ C1] PKRU: 55555554 [10084.634126][ C1] Call Trace: [10084.634293][ C1] [10084.634436][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10084.634691][ C1] ? __run_hrtimer+0x1c0/0x710 [10084.634928][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10084.635200][ C1] ? __hrtimer_run_queues+0x197/0x270 [10084.635467][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10084.635746][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10084.636004][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10084.636304][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10084.636561][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10084.636863][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10084.637151][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10084.637458][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10084.637740][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10084.638029][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10084.638310][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10084.638615][ C1] ? get_stack_info+0x36/0xc0 [10084.638850][ C1] ? lock_acquire+0x1c1/0x220 [10084.639082][ C1] ? lock_release+0x1d5/0x250 [10084.639318][ C1] do_raw_spin_lock+0x1ec/0x270 [10084.639560][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10084.639825][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10084.640105][ C1] ? lock_acquire+0x1c1/0x220 [10084.640339][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10084.640572][ C1] _raw_spin_lock_nested+0x65/0x80 [10084.640825][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10084.641056][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10084.641298][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10084.641549][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10084.641816][ C1] ip_local_deliver_finish+0x2ae/0x480 [10084.642085][ C1] ip_local_deliver+0x19d/0x480 [10084.642351][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10084.642623][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10084.642888][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10084.643235][ C1] ? rcu_read_lock_held+0xe/0x50 [10084.643493][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10084.643805][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10084.644061][ C1] ip_rcv+0x564/0x740 [10084.644261][ C1] ? __pfx_ip_rcv+0x10/0x10 [10084.644487][ C1] ? set_track_prepare+0x8a/0xd0 [10084.644733][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10084.645002][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10084.645267][ C1] ? skb_clone+0x10b/0x330 [10084.645489][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10084.645800][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10084.646097][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10084.646372][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10084.646657][ C1] ? __tcf_classify+0x329/0x7d0 [10084.646899][ C1] ? __pfx_ip_rcv+0x10/0x10 [10084.647123][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10084.647416][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10084.647693][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10084.648010][ C1] ? lock_acquire+0x1c1/0x220 [10084.648245][ C1] ? netif_receive_skb_internal+0x84/0x300 [10084.648533][ C1] netif_receive_skb_internal+0xb0/0x300 [10084.648811][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10084.649119][ C1] ? __copy_skb_header+0xaf/0x490 [10084.649371][ C1] ? __skb_clone+0x57a/0x760 [10084.649599][ C1] netif_receive_skb+0x55/0x280 [10084.649839][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10084.650144][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10084.650467][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10084.650760][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10084.651026][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10084.651310][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10084.651612][ C1] ? hlock_class+0x4e/0x130 [10084.651840][ C1] ? get_stack_info_noinstr+0x18/0x110 [10084.652113][ C1] ? get_stack_info_noinstr+0x18/0x110 [10084.652384][ C1] ? __pfx_validate_chain+0x10/0x10 [10084.652641][ C1] ? hlock_class+0x4e/0x130 [10084.652864][ C1] ? mark_lock+0x38/0x3e0 [10084.653080][ C1] ? stack_access_ok+0xda/0x1f0 [10084.653324][ C1] ? __lock_acquire+0xb67/0x1610 [10084.653571][ C1] ? get_stack_info_noinstr+0x18/0x110 [10084.653840][ C1] ? get_stack_info+0x36/0xc0 [10084.654074][ C1] ? stack_access_ok+0xda/0x1f0 [10084.654316][ C1] ? get_reg+0x119/0x190 [10084.654526][ C1] ? unwind_next_frame+0x12af/0x1d10 [10084.654787][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10084.655089][ C1] __tcf_classify+0x329/0x7d0 [10084.655326][ C1] tcf_classify+0x283/0x930 [10084.655549][ C1] ? arch_stack_walk+0xa2/0x100 [10084.655791][ C1] ? __pfx_tcf_classify+0x10/0x10 [10084.656040][ C1] ? get_stack_info+0x36/0xc0 [10084.656275][ C1] tc_run+0x2e4/0x5d0 [10084.656474][ C1] ? __pfx_tc_run+0x10/0x10 [10084.656700][ C1] ? lock_acquire+0x1c1/0x220 [10084.656931][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10084.657187][ C1] __dev_queue_xmit+0x686/0x17e0 [10084.657433][ C1] ? lock_acquire+0x1c1/0x220 [10084.657664][ C1] ? ip_finish_output2+0x786/0x18e0 [10084.657921][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10084.658219][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10084.658482][ C1] ? neigh_hh_output+0x348/0x590 [10084.658729][ C1] ? ip_finish_output2+0x262/0x18e0 [10084.658987][ C1] ip_finish_output2+0x786/0x18e0 [10084.659238][ C1] ? stack_depot_save_flags+0x45/0x550 [10084.659509][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10084.659838][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10084.660106][ C1] ? rcu_read_lock_held+0xe/0x50 [10084.660353][ C1] ? __ip_finish_output+0x10f/0x770 [10084.660609][ C1] ip_output+0x16b/0x4f0 [10084.660821][ C1] ? run_timer_softirq+0x72/0x100 [10084.661071][ C1] ? __pfx_ip_output+0x10/0x10 [10084.661309][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10084.661587][ C1] ? rcu_read_lock_held+0xe/0x50 [10084.661832][ C1] ? ip_local_out+0x114/0x3b0 [10084.662067][ C1] __ip_queue_xmit+0x672/0x1910 [10084.662336][ C1] ? __create_object+0x5e/0xb0 [10084.662578][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10084.662845][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10084.663128][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10084.663411][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10084.663684][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10084.663951][ C1] tcp_delack_timer+0x84/0x240 [10084.664188][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10084.664455][ C1] call_timer_fn+0x173/0x430 [10084.664684][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10084.664939][ C1] ? next_expiry_recalc+0xcd/0x220 [10084.665195][ C1] __run_timers.part.0+0x52d/0x890 [10084.665448][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10084.665717][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10084.665992][ C1] ? lock_acquire+0x1c1/0x220 [10084.666226][ C1] ? clockevents_program_event+0xf6/0x300 [10084.666512][ C1] ? lock_release+0x1d5/0x250 [10084.666742][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10084.666999][ C1] ? ktime_get+0xb3/0x190 [10084.667216][ C1] ? clockevents_program_event+0x1ea/0x300 [10084.667505][ C1] run_timer_softirq+0x72/0x100 [10084.667745][ C1] __do_softirq+0x1b9/0x7ff [10084.667973][ C1] irq_exit_rcu+0x98/0xc0 [10084.668189][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10084.668468][ C1] [10084.668614][ C1] [10084.668761][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10084.669056][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10084.669374][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10084.670319][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10084.670617][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10084.671009][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10084.671399][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10084.671788][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10084.672222][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10084.672626][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10084.672923][ C1] pipe_read+0xa16/0xdf0 [10084.673146][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10084.673432][ C1] ? __pfx_pipe_read+0x10/0x10 [10084.673670][ C1] ? iterate_tty_write+0x299/0x540 [10084.673925][ C1] ? lock_release+0x1d5/0x250 [10084.674161][ C1] vfs_read+0x911/0xc00 [10084.674371][ C1] ? lock_acquire+0x1c1/0x220 [10084.674605][ C1] ? __might_fault+0xc6/0x180 [10084.674839][ C1] ? __pfx_vfs_read+0x10/0x10 [10084.675073][ C1] ? __might_fault+0xc6/0x180 [10084.675310][ C1] ? lock_release+0x1d5/0x250 [10084.675544][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10084.675803][ C1] ? __fget_light+0x54/0x1e0 [10084.676035][ C1] ksys_read+0x17a/0x1e0 [10084.676251][ C1] ? __pfx_ksys_read+0x10/0x10 [10084.676491][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10084.676787][ C1] do_syscall_64+0xc9/0x1e0 [10084.677015][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10084.677310][ C1] RIP: 0033:0x7f08a1ea38b2 [10084.677537][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10084.678488][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10084.678900][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10084.679289][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10084.679679][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10084.680069][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10084.680459][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10084.680851][ C1] [10108.690103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10108.690457][ C1] rcu: 1-....: (7733756 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1818605 [10108.691002][ C1] rcu: (t=7753803 jiffies g=1882453 q=724 ncpus=4) [10108.691327][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10108.691763][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10108.692364][ C1] RIP: 0010:kasan_check_range+0x84/0x1c0 [10108.692645][ C1] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [10108.693590][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000202 [10108.693890][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [10108.694278][ C1] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10108.694665][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [10108.695055][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10108.695445][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10108.695832][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10108.696269][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10108.696592][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10108.696984][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10108.697372][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10108.697760][ C1] PKRU: 55555554 [10108.697939][ C1] Call Trace: [10108.698106][ C1] [10108.698250][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10108.698515][ C1] ? print_cpu_stall+0x263/0x6a0 [10108.698761][ C1] ? check_cpu_stall+0x284/0x500 [10108.699006][ C1] ? rcu_pending+0x92/0x360 [10108.699234][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10108.699495][ C1] ? update_process_times+0xb9/0x110 [10108.699757][ C1] ? tick_sched_handle+0x67/0x130 [10108.700007][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10108.700285][ C1] ? __run_hrtimer+0x1c0/0x710 [10108.700521][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10108.700826][ C1] ? __hrtimer_run_queues+0x197/0x270 [10108.701090][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10108.701373][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10108.701631][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10108.701928][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10108.702185][ C1] ? hrtimer_interrupt+0x31a/0x770 [10108.702440][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10108.702742][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10108.703028][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10108.703335][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10108.703619][ C1] ? kasan_check_range+0x84/0x1c0 [10108.703868][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10108.704141][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10108.704445][ C1] ? get_stack_info+0x36/0xc0 [10108.704681][ C1] ? lock_acquire+0x1c1/0x220 [10108.704913][ C1] ? lock_release+0x1d5/0x250 [10108.705146][ C1] do_raw_spin_lock+0x1ec/0x270 [10108.705389][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10108.705654][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10108.705933][ C1] ? lock_acquire+0x1c1/0x220 [10108.706165][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10108.706400][ C1] _raw_spin_lock_nested+0x65/0x80 [10108.706653][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10108.706882][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10108.707123][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10108.707375][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10108.707641][ C1] ip_local_deliver_finish+0x2ae/0x480 [10108.707911][ C1] ip_local_deliver+0x19d/0x480 [10108.708151][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10108.708421][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10108.708679][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10108.709018][ C1] ? rcu_read_lock_held+0xe/0x50 [10108.709265][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10108.709577][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10108.709833][ C1] ip_rcv+0x564/0x740 [10108.710032][ C1] ? __pfx_ip_rcv+0x10/0x10 [10108.710260][ C1] ? set_track_prepare+0x8a/0xd0 [10108.710508][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10108.710777][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10108.711041][ C1] ? skb_clone+0x10b/0x330 [10108.711267][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10108.711579][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10108.711879][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10108.712179][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10108.712473][ C1] ? __tcf_classify+0x329/0x7d0 [10108.712722][ C1] ? __pfx_ip_rcv+0x10/0x10 [10108.712954][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10108.713266][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10108.713544][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10108.713863][ C1] ? lock_acquire+0x1c1/0x220 [10108.714096][ C1] ? netif_receive_skb_internal+0x84/0x300 [10108.714385][ C1] netif_receive_skb_internal+0xb0/0x300 [10108.714664][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10108.714974][ C1] ? __copy_skb_header+0xaf/0x490 [10108.715226][ C1] ? __skb_clone+0x57a/0x760 [10108.715456][ C1] netif_receive_skb+0x55/0x280 [10108.715698][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10108.716002][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10108.716351][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10108.716652][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10108.716926][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10108.717227][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10108.717531][ C1] ? hlock_class+0x4e/0x130 [10108.717758][ C1] ? get_stack_info_noinstr+0x18/0x110 [10108.718027][ C1] ? get_stack_info_noinstr+0x18/0x110 [10108.718301][ C1] ? __pfx_validate_chain+0x10/0x10 [10108.718559][ C1] ? hlock_class+0x4e/0x130 [10108.718784][ C1] ? mark_lock+0x38/0x3e0 [10108.718999][ C1] ? stack_access_ok+0xda/0x1f0 [10108.719244][ C1] ? __lock_acquire+0xb67/0x1610 [10108.719495][ C1] ? get_stack_info_noinstr+0x18/0x110 [10108.719764][ C1] ? get_stack_info+0x36/0xc0 [10108.719999][ C1] ? stack_access_ok+0xda/0x1f0 [10108.720241][ C1] ? get_reg+0x119/0x190 [10108.720452][ C1] ? unwind_next_frame+0x12af/0x1d10 [10108.720712][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10108.721014][ C1] __tcf_classify+0x329/0x7d0 [10108.721252][ C1] tcf_classify+0x283/0x930 [10108.721476][ C1] ? arch_stack_walk+0xa2/0x100 [10108.721719][ C1] ? __pfx_tcf_classify+0x10/0x10 [10108.721970][ C1] ? get_stack_info+0x36/0xc0 [10108.722231][ C1] tc_run+0x2e4/0x5d0 [10108.722436][ C1] ? __pfx_tc_run+0x10/0x10 [10108.722669][ C1] ? lock_acquire+0x1c1/0x220 [10108.722908][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10108.723170][ C1] __dev_queue_xmit+0x686/0x17e0 [10108.723428][ C1] ? lock_acquire+0x1c1/0x220 [10108.723659][ C1] ? ip_finish_output2+0x786/0x18e0 [10108.723918][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10108.724215][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10108.724481][ C1] ? neigh_hh_output+0x348/0x590 [10108.724726][ C1] ? ip_finish_output2+0x262/0x18e0 [10108.724986][ C1] ip_finish_output2+0x786/0x18e0 [10108.725237][ C1] ? stack_depot_save_flags+0x45/0x550 [10108.725509][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10108.725838][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10108.726107][ C1] ? rcu_read_lock_held+0xe/0x50 [10108.726355][ C1] ? __ip_finish_output+0x10f/0x770 [10108.726613][ C1] ip_output+0x16b/0x4f0 [10108.726826][ C1] ? run_timer_softirq+0x72/0x100 [10108.727077][ C1] ? __pfx_ip_output+0x10/0x10 [10108.727314][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10108.727593][ C1] ? rcu_read_lock_held+0xe/0x50 [10108.727839][ C1] ? ip_local_out+0x114/0x3b0 [10108.728074][ C1] __ip_queue_xmit+0x672/0x1910 [10108.728317][ C1] ? __create_object+0x5e/0xb0 [10108.728553][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10108.728814][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10108.729088][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10108.729355][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10108.729629][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10108.729896][ C1] tcp_delack_timer+0x84/0x240 [10108.730134][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10108.730399][ C1] call_timer_fn+0x173/0x430 [10108.730629][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10108.730885][ C1] ? next_expiry_recalc+0xcd/0x220 [10108.731141][ C1] __run_timers.part.0+0x52d/0x890 [10108.731395][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10108.731662][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10108.731939][ C1] ? lock_acquire+0x1c1/0x220 [10108.732199][ C1] ? clockevents_program_event+0xf6/0x300 [10108.732492][ C1] ? lock_release+0x1d5/0x250 [10108.732730][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10108.732995][ C1] ? ktime_get+0xb3/0x190 [10108.733227][ C1] ? clockevents_program_event+0x1ea/0x300 [10108.733516][ C1] run_timer_softirq+0x72/0x100 [10108.733758][ C1] __do_softirq+0x1b9/0x7ff [10108.733983][ C1] irq_exit_rcu+0x98/0xc0 [10108.734199][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10108.734477][ C1] [10108.734623][ C1] [10108.734772][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10108.735067][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10108.735385][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10108.736331][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10108.736631][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10108.737023][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10108.737411][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10108.737800][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10108.738190][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10108.738582][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10108.738869][ C1] pipe_read+0xa16/0xdf0 [10108.739086][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10108.739357][ C1] ? __pfx_pipe_read+0x10/0x10 [10108.739596][ C1] ? iterate_tty_write+0x299/0x540 [10108.739851][ C1] ? lock_release+0x1d5/0x250 [10108.740087][ C1] vfs_read+0x911/0xc00 [10108.740303][ C1] ? lock_acquire+0x1c1/0x220 [10108.740537][ C1] ? __might_fault+0xc6/0x180 [10108.740770][ C1] ? __pfx_vfs_read+0x10/0x10 [10108.741002][ C1] ? __might_fault+0xc6/0x180 [10108.741238][ C1] ? lock_release+0x1d5/0x250 [10108.741473][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10108.741731][ C1] ? __fget_light+0x54/0x1e0 [10108.741962][ C1] ksys_read+0x17a/0x1e0 [10108.742199][ C1] ? __pfx_ksys_read+0x10/0x10 [10108.742446][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10108.742751][ C1] do_syscall_64+0xc9/0x1e0 [10108.742984][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10108.743298][ C1] RIP: 0033:0x7f08a1ea38b2 [10108.743519][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10108.744467][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10108.744881][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10108.745271][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10108.745662][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10108.746051][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10108.746440][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10108.746832][ C1] [10108.746987][ C1] Sending NMI from CPU 1 to CPUs 2: [10108.747253][ C2] NMI backtrace for cpu 2 [10108.747263][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10108.747269][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10108.747273][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10108.747278][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10108.747281][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10108.747284][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10108.747286][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10108.747287][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10108.747289][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10108.747291][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10108.747292][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10108.747294][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10108.747297][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10108.747298][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10108.747300][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10108.747301][ C2] PKRU: 55555554 [10108.747302][ C2] Call Trace: [10108.747303][ C2] [10108.747305][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10108.747312][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10108.747316][ C2] ? nmi_handle+0x153/0x420 [10108.747320][ C2] ? default_do_nmi+0x41/0x100 [10108.747323][ C2] ? exc_nmi+0xf3/0x120 [10108.747326][ C2] ? end_repeat_nmi+0xf/0x60 [10108.747331][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10108.747334][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10108.747337][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10108.747340][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10108.747343][ C2] [10108.747344][ C2] [10108.747345][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10108.747348][ C2] ? get_stack_info+0x36/0xc0 [10108.747352][ C2] ? lock_acquire+0x1c1/0x220 [10108.747356][ C2] ? lock_release+0x1d5/0x250 [10108.747360][ C2] do_raw_spin_lock+0x1ec/0x270 [10108.747364][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10108.747367][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10108.747370][ C2] ? lock_acquire+0x1c1/0x220 [10108.747372][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10108.747376][ C2] _raw_spin_lock_nested+0x65/0x80 [10108.747378][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10108.747385][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10108.747387][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10108.747391][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10108.747396][ C2] ip_local_deliver_finish+0x2ae/0x480 [10108.747400][ C2] ip_local_deliver+0x19d/0x480 [10108.747402][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10108.747404][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10108.747407][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10108.747412][ C2] ? rcu_read_lock_held+0xe/0x50 [10108.747416][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10108.747419][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10108.747428][ C2] ip_rcv+0x564/0x740 [10108.747431][ C2] ? __pfx_ip_rcv+0x10/0x10 [10108.747433][ C2] ? set_track_prepare+0x8a/0xd0 [10108.747437][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10108.747441][ C2] ? start_secondary+0x21c/0x2b0 [10108.747444][ C2] ? skb_clone+0x10b/0x330 [10108.747446][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10108.747452][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10108.747457][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10108.747460][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10108.747468][ C2] ? __tcf_classify+0x329/0x7d0 [10108.747472][ C2] ? __pfx_ip_rcv+0x10/0x10 [10108.747474][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10108.747477][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10108.747480][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10108.747485][ C2] ? lock_acquire+0x1c1/0x220 [10108.747487][ C2] ? netif_receive_skb_internal+0x84/0x300 [10108.747491][ C2] netif_receive_skb_internal+0xb0/0x300 [10108.747495][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10108.747499][ C2] ? __copy_skb_header+0xaf/0x490 [10108.747503][ C2] ? __skb_clone+0x57a/0x760 [10108.747505][ C2] netif_receive_skb+0x55/0x280 [10108.747508][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10108.747515][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10108.747521][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10108.747528][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10108.747532][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10108.747542][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10108.747549][ C2] ? get_stack_info+0x36/0xc0 [10108.747553][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10108.747556][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10108.747560][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10108.747562][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10108.747565][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10108.747568][ C2] ? kernel_text_address+0x17/0xe0 [10108.747571][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10108.747575][ C2] ? arch_stack_walk+0x8c/0x100 [10108.747578][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10108.747581][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10108.747585][ C2] ? lock_acquire+0x1c1/0x220 [10108.747587][ C2] ? stack_depot_save_flags+0x281/0x550 [10108.747591][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10108.747595][ C2] ? get_stack_info_noinstr+0x18/0x110 [10108.747598][ C2] ? get_stack_info+0x36/0xc0 [10108.747602][ C2] __tcf_classify+0x329/0x7d0 [10108.747607][ C2] tcf_classify+0x283/0x930 [10108.747611][ C2] ? __pfx_tcf_classify+0x10/0x10 [10108.747614][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10108.747619][ C2] tc_run+0x2e4/0x5d0 [10108.747622][ C2] ? __pfx_tc_run+0x10/0x10 [10108.747625][ C2] ? lock_acquire+0x1c1/0x220 [10108.747627][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10108.747631][ C2] __dev_queue_xmit+0x686/0x17e0 [10108.747635][ C2] ? lock_acquire+0x1c1/0x220 [10108.747638][ C2] ? ip_finish_output2+0x786/0x18e0 [10108.747641][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10108.747644][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10108.747647][ C2] ? neigh_hh_output+0x348/0x590 [10108.747651][ C2] ? ip_finish_output2+0x262/0x18e0 [10108.747654][ C2] ip_finish_output2+0x786/0x18e0 [10108.747658][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10108.747665][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10108.747668][ C2] ? rcu_read_lock_held+0xe/0x50 [10108.747671][ C2] ? __ip_finish_output+0x10f/0x770 [10108.747675][ C2] ip_output+0x16b/0x4f0 [10108.747678][ C2] ? __pfx_ip_output+0x10/0x10 [10108.747680][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10108.747683][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10108.747686][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10108.747690][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10108.747692][ C2] ? __alloc_skb+0xd4/0x280 [10108.747695][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10108.747699][ C2] ? tcp_fragment+0x168/0x1040 [10108.747702][ C2] ? rcu_read_lock_held+0xe/0x50 [10108.747705][ C2] ? ip_local_out+0x114/0x3b0 [10108.747709][ C2] __ip_queue_xmit+0x672/0x1910 [10108.747712][ C2] ? __skb_clone+0x57a/0x760 [10108.747715][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10108.747720][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10108.747723][ C2] ? ipv4_dst_check+0xe3/0x170 [10108.747728][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10108.747732][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10108.747736][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10108.747739][ C2] ? tcp_fragment+0xb0e/0x1040 [10108.747742][ C2] tcp_send_loss_probe+0x348/0x830 [10108.747746][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10108.747748][ C2] tcp_write_timer+0x82/0x1d0 [10108.747752][ C2] call_timer_fn+0x173/0x430 [10108.747755][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10108.747760][ C2] ? next_expiry_recalc+0xcd/0x220 [10108.747764][ C2] __run_timers.part.0+0x52d/0x890 [10108.747767][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10108.747771][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10108.747774][ C2] ? lock_acquire+0x1c1/0x220 [10108.747776][ C2] ? clockevents_program_event+0xf6/0x300 [10108.747780][ C2] ? lock_release+0x1d5/0x250 [10108.747783][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10108.747786][ C2] ? ktime_get+0xb3/0x190 [10108.747790][ C2] ? clockevents_program_event+0x1ea/0x300 [10108.747794][ C2] run_timer_softirq+0x72/0x100 [10108.747798][ C2] __do_softirq+0x1b9/0x7ff [10108.747802][ C2] irq_exit_rcu+0x98/0xc0 [10108.747804][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10108.747808][ C2] [10108.747808][ C2] [10108.747810][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10108.747813][ C2] RIP: 0010:default_idle+0xf/0x20 [10108.747816][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10108.747818][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10108.747820][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10108.747822][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10108.747824][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10108.747825][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10108.747827][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10108.747830][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10108.747833][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10108.747836][ C2] default_idle_call+0x69/0xa0 [10108.747839][ C2] cpuidle_idle_call+0x1f6/0x280 [10108.747842][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10108.747845][ C2] ? lock_release+0x1d5/0x250 [10108.747848][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10108.747852][ C2] do_idle+0xfb/0x160 [10108.747855][ C2] cpu_startup_entry+0x55/0x60 [10108.747857][ C2] start_secondary+0x21c/0x2b0 [10108.747860][ C2] ? __pfx_start_secondary+0x10/0x10 [10108.747864][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10108.747870][ C2] [10136.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7249s! [perl:4135] [10136.569676][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10136.570895][ C1] irq event stamp: 209232 [10136.571107][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10136.571623][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10136.572092][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10136.572547][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10136.572993][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10136.573431][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10136.574030][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10136.574349][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10136.575292][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10136.575591][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10136.575978][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10136.576367][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10136.576755][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10136.577143][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10136.577529][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10136.577963][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10136.578287][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10136.578677][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10136.579066][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10136.579454][ C1] PKRU: 55555554 [10136.579631][ C1] Call Trace: [10136.579797][ C1] [10136.579940][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10136.580195][ C1] ? __run_hrtimer+0x1c0/0x710 [10136.580434][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10136.580702][ C1] ? __hrtimer_run_queues+0x197/0x270 [10136.580968][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10136.581249][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10136.581507][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10136.581805][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10136.582063][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10136.582385][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10136.582680][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10136.582992][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10136.583288][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10136.583575][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10136.583855][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10136.584159][ C1] ? get_stack_info+0x36/0xc0 [10136.584394][ C1] ? lock_acquire+0x1c1/0x220 [10136.584627][ C1] ? lock_release+0x1d5/0x250 [10136.584861][ C1] do_raw_spin_lock+0x1ec/0x270 [10136.585103][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10136.585369][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10136.585648][ C1] ? lock_acquire+0x1c1/0x220 [10136.585879][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10136.586113][ C1] _raw_spin_lock_nested+0x65/0x80 [10136.586366][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10136.586596][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10136.586838][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10136.587089][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10136.587358][ C1] ip_local_deliver_finish+0x2ae/0x480 [10136.587626][ C1] ip_local_deliver+0x19d/0x480 [10136.587869][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10136.588133][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10136.588392][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10136.588730][ C1] ? rcu_read_lock_held+0xe/0x50 [10136.588975][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10136.589287][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10136.589542][ C1] ip_rcv+0x564/0x740 [10136.589741][ C1] ? __pfx_ip_rcv+0x10/0x10 [10136.589967][ C1] ? set_track_prepare+0x8a/0xd0 [10136.590215][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10136.590483][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10136.590748][ C1] ? skb_clone+0x10b/0x330 [10136.590970][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10136.591281][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10136.591579][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10136.591854][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10136.592167][ C1] ? __tcf_classify+0x329/0x7d0 [10136.592416][ C1] ? __pfx_ip_rcv+0x10/0x10 [10136.592647][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10136.592946][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10136.593239][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10136.593579][ C1] ? lock_acquire+0x1c1/0x220 [10136.593818][ C1] ? netif_receive_skb_internal+0x84/0x300 [10136.594113][ C1] netif_receive_skb_internal+0xb0/0x300 [10136.594401][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10136.594722][ C1] ? __copy_skb_header+0xaf/0x490 [10136.594971][ C1] ? __skb_clone+0x57a/0x760 [10136.595200][ C1] netif_receive_skb+0x55/0x280 [10136.595441][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10136.595747][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10136.596070][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10136.596365][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10136.596631][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10136.596912][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10136.597217][ C1] ? hlock_class+0x4e/0x130 [10136.597444][ C1] ? get_stack_info_noinstr+0x18/0x110 [10136.597712][ C1] ? get_stack_info_noinstr+0x18/0x110 [10136.597982][ C1] ? __pfx_validate_chain+0x10/0x10 [10136.598240][ C1] ? hlock_class+0x4e/0x130 [10136.598462][ C1] ? mark_lock+0x38/0x3e0 [10136.598678][ C1] ? stack_access_ok+0xda/0x1f0 [10136.598920][ C1] ? __lock_acquire+0xb67/0x1610 [10136.599168][ C1] ? get_stack_info_noinstr+0x18/0x110 [10136.599437][ C1] ? get_stack_info+0x36/0xc0 [10136.599671][ C1] ? stack_access_ok+0xda/0x1f0 [10136.599911][ C1] ? get_reg+0x119/0x190 [10136.600121][ C1] ? unwind_next_frame+0x12af/0x1d10 [10136.600384][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10136.600686][ C1] __tcf_classify+0x329/0x7d0 [10136.600923][ C1] tcf_classify+0x283/0x930 [10136.601146][ C1] ? arch_stack_walk+0xa2/0x100 [10136.601389][ C1] ? __pfx_tcf_classify+0x10/0x10 [10136.601639][ C1] ? get_stack_info+0x36/0xc0 [10136.601877][ C1] tc_run+0x2e4/0x5d0 [10136.602098][ C1] ? __pfx_tc_run+0x10/0x10 [10136.602332][ C1] ? lock_acquire+0x1c1/0x220 [10136.602569][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10136.602831][ C1] __dev_queue_xmit+0x686/0x17e0 [10136.603093][ C1] ? lock_acquire+0x1c1/0x220 [10136.603326][ C1] ? ip_finish_output2+0x786/0x18e0 [10136.603583][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10136.603880][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10136.604147][ C1] ? neigh_hh_output+0x348/0x590 [10136.604394][ C1] ? ip_finish_output2+0x262/0x18e0 [10136.604653][ C1] ip_finish_output2+0x786/0x18e0 [10136.604904][ C1] ? stack_depot_save_flags+0x45/0x550 [10136.605177][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10136.605505][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10136.605773][ C1] ? rcu_read_lock_held+0xe/0x50 [10136.606019][ C1] ? __ip_finish_output+0x10f/0x770 [10136.606277][ C1] ip_output+0x16b/0x4f0 [10136.606490][ C1] ? run_timer_softirq+0x72/0x100 [10136.606740][ C1] ? __pfx_ip_output+0x10/0x10 [10136.606975][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10136.607255][ C1] ? rcu_read_lock_held+0xe/0x50 [10136.607501][ C1] ? ip_local_out+0x114/0x3b0 [10136.607735][ C1] __ip_queue_xmit+0x672/0x1910 [10136.607976][ C1] ? __create_object+0x5e/0xb0 [10136.608214][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10136.608475][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10136.608748][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10136.609012][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10136.609288][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10136.609554][ C1] tcp_delack_timer+0x84/0x240 [10136.609791][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10136.610056][ C1] call_timer_fn+0x173/0x430 [10136.610286][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10136.610541][ C1] ? next_expiry_recalc+0xcd/0x220 [10136.610796][ C1] __run_timers.part.0+0x52d/0x890 [10136.611049][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10136.611316][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10136.611592][ C1] ? lock_acquire+0x1c1/0x220 [10136.611825][ C1] ? clockevents_program_event+0xf6/0x300 [10136.612136][ C1] ? lock_release+0x1d5/0x250 [10136.612372][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10136.612636][ C1] ? ktime_get+0xb3/0x190 [10136.612857][ C1] ? clockevents_program_event+0x1ea/0x300 [10136.613163][ C1] run_timer_softirq+0x72/0x100 [10136.613403][ C1] __do_softirq+0x1b9/0x7ff [10136.613630][ C1] irq_exit_rcu+0x98/0xc0 [10136.613844][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10136.614123][ C1] [10136.614268][ C1] [10136.614417][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10136.614710][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10136.615026][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10136.615971][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10136.616269][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10136.616661][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10136.617049][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10136.617442][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10136.617828][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10136.618221][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10136.618508][ C1] pipe_read+0xa16/0xdf0 [10136.618723][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10136.618993][ C1] ? __pfx_pipe_read+0x10/0x10 [10136.619232][ C1] ? iterate_tty_write+0x299/0x540 [10136.619485][ C1] ? lock_release+0x1d5/0x250 [10136.619720][ C1] vfs_read+0x911/0xc00 [10136.619927][ C1] ? lock_acquire+0x1c1/0x220 [10136.620160][ C1] ? __might_fault+0xc6/0x180 [10136.620392][ C1] ? __pfx_vfs_read+0x10/0x10 [10136.620626][ C1] ? __might_fault+0xc6/0x180 [10136.620858][ C1] ? lock_release+0x1d5/0x250 [10136.621091][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10136.621351][ C1] ? __fget_light+0x54/0x1e0 [10136.621581][ C1] ksys_read+0x17a/0x1e0 [10136.621793][ C1] ? __pfx_ksys_read+0x10/0x10 [10136.622057][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10136.622359][ C1] do_syscall_64+0xc9/0x1e0 [10136.622593][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10136.622893][ C1] RIP: 0033:0x7f08a1ea38b2 [10136.623128][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10136.624070][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10136.624483][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10136.624870][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10136.625260][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10136.625649][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10136.626036][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10136.626428][ C1] [10136.626581][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7249s! [swapper/2:0] [10136.626989][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10136.628204][ C2] irq event stamp: 44114564 [10136.628426][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10136.628944][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10136.629440][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10136.629903][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10136.630359][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10136.630801][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10136.631392][ C2] RIP: 0010:kasan_check_range+0x156/0x1c0 [10136.631676][ C2] Code: d0 74 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea 09 48 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 [10136.632656][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000286 [10136.632961][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [10136.633361][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10136.633745][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [10136.634133][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10136.634520][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10136.634928][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10136.635371][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10136.635701][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10136.636107][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10136.636494][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10136.636878][ C2] PKRU: 55555554 [10136.637053][ C2] Call Trace: [10136.637220][ C2] [10136.637361][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10136.637613][ C2] ? __run_hrtimer+0x1c0/0x710 [10136.637849][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10136.638115][ C2] ? __hrtimer_run_queues+0x197/0x270 [10136.638381][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10136.638660][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10136.638917][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10136.639214][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10136.639466][ C2] ? hrtimer_interrupt+0x31a/0x770 [10136.639718][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10136.639970][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10136.640271][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10136.640557][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10136.640859][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10136.641141][ C2] ? kasan_check_range+0x156/0x1c0 [10136.641396][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [10136.641667][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10136.641997][ C2] ? get_stack_info+0x36/0xc0 [10136.642238][ C2] ? lock_acquire+0x1c1/0x220 [10136.642477][ C2] ? lock_release+0x1d5/0x250 [10136.642714][ C2] do_raw_spin_lock+0x1ec/0x270 [10136.642960][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10136.643240][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10136.643515][ C2] ? lock_acquire+0x1c1/0x220 [10136.643748][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10136.643979][ C2] _raw_spin_lock_nested+0x65/0x80 [10136.644232][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10136.644458][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10136.644698][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10136.644946][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10136.645211][ C2] ip_local_deliver_finish+0x2ae/0x480 [10136.645481][ C2] ip_local_deliver+0x19d/0x480 [10136.645719][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10136.645982][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10136.646238][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10136.646576][ C2] ? rcu_read_lock_held+0xe/0x50 [10136.646820][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10136.647129][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10136.647383][ C2] ip_rcv+0x564/0x740 [10136.647579][ C2] ? __pfx_ip_rcv+0x10/0x10 [10136.647804][ C2] ? set_track_prepare+0x8a/0xd0 [10136.648049][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10136.648319][ C2] ? start_secondary+0x21c/0x2b0 [10136.648562][ C2] ? skb_clone+0x10b/0x330 [10136.648782][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10136.649091][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10136.649387][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10136.649661][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10136.649945][ C2] ? __tcf_classify+0x329/0x7d0 [10136.650186][ C2] ? __pfx_ip_rcv+0x10/0x10 [10136.650411][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10136.650701][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10136.650978][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10136.651295][ C2] ? lock_acquire+0x1c1/0x220 [10136.651527][ C2] ? netif_receive_skb_internal+0x84/0x300 [10136.651811][ C2] netif_receive_skb_internal+0xb0/0x300 [10136.652116][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10136.652432][ C2] ? __copy_skb_header+0xaf/0x490 [10136.652688][ C2] ? __skb_clone+0x57a/0x760 [10136.652921][ C2] netif_receive_skb+0x55/0x280 [10136.653177][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10136.653481][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10136.653805][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10136.654095][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10136.654362][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10136.654640][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10136.654941][ C2] ? get_stack_info+0x36/0xc0 [10136.655177][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10136.655433][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10136.655740][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10136.656007][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10136.656277][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10136.656583][ C2] ? kernel_text_address+0x17/0xe0 [10136.656835][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10136.657140][ C2] ? arch_stack_walk+0x8c/0x100 [10136.657382][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10136.657639][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10136.657914][ C2] ? lock_acquire+0x1c1/0x220 [10136.658146][ C2] ? stack_depot_save_flags+0x281/0x550 [10136.658418][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10136.658714][ C2] ? get_stack_info_noinstr+0x18/0x110 [10136.658981][ C2] ? get_stack_info+0x36/0xc0 [10136.659217][ C2] __tcf_classify+0x329/0x7d0 [10136.659451][ C2] tcf_classify+0x283/0x930 [10136.659675][ C2] ? __pfx_tcf_classify+0x10/0x10 [10136.659923][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10136.660229][ C2] tc_run+0x2e4/0x5d0 [10136.660427][ C2] ? __pfx_tc_run+0x10/0x10 [10136.660651][ C2] ? lock_acquire+0x1c1/0x220 [10136.660882][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10136.661135][ C2] __dev_queue_xmit+0x686/0x17e0 [10136.661383][ C2] ? lock_acquire+0x1c1/0x220 [10136.661614][ C2] ? ip_finish_output2+0x786/0x18e0 [10136.661874][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10136.662193][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10136.662466][ C2] ? neigh_hh_output+0x348/0x590 [10136.662718][ C2] ? ip_finish_output2+0x262/0x18e0 [10136.662981][ C2] ip_finish_output2+0x786/0x18e0 [10136.663245][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10136.663570][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10136.663836][ C2] ? rcu_read_lock_held+0xe/0x50 [10136.664080][ C2] ? __ip_finish_output+0x10f/0x770 [10136.664338][ C2] ip_output+0x16b/0x4f0 [10136.664550][ C2] ? __pfx_ip_output+0x10/0x10 [10136.664786][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10136.665054][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10136.665357][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10136.665624][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10136.665868][ C2] ? __alloc_skb+0xd4/0x280 [10136.666092][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10136.666353][ C2] ? tcp_fragment+0x168/0x1040 [10136.666589][ C2] ? rcu_read_lock_held+0xe/0x50 [10136.666833][ C2] ? ip_local_out+0x114/0x3b0 [10136.667063][ C2] __ip_queue_xmit+0x672/0x1910 [10136.667305][ C2] ? __skb_clone+0x57a/0x760 [10136.667533][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10136.667792][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10136.668061][ C2] ? ipv4_dst_check+0xe3/0x170 [10136.668300][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10136.668541][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10136.668833][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10136.669143][ C2] ? tcp_fragment+0xb0e/0x1040 [10136.669381][ C2] tcp_send_loss_probe+0x348/0x830 [10136.669634][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10136.669893][ C2] tcp_write_timer+0x82/0x1d0 [10136.670126][ C2] call_timer_fn+0x173/0x430 [10136.670354][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10136.670607][ C2] ? next_expiry_recalc+0xcd/0x220 [10136.670859][ C2] __run_timers.part.0+0x52d/0x890 [10136.671113][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10136.671376][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10136.671652][ C2] ? lock_acquire+0x1c1/0x220 [10136.671904][ C2] ? clockevents_program_event+0xf6/0x300 [10136.672193][ C2] ? lock_release+0x1d5/0x250 [10136.672432][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10136.672695][ C2] ? ktime_get+0xb3/0x190 [10136.672916][ C2] ? clockevents_program_event+0x1ea/0x300 [10136.673217][ C2] run_timer_softirq+0x72/0x100 [10136.673458][ C2] __do_softirq+0x1b9/0x7ff [10136.673684][ C2] irq_exit_rcu+0x98/0xc0 [10136.673895][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10136.674173][ C2] [10136.674318][ C2] [10136.674463][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10136.674758][ C2] RIP: 0010:default_idle+0xf/0x20 [10136.675006][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10136.675950][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10136.676251][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10136.676636][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10136.677023][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10136.677411][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10136.677797][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10136.678185][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10136.678468][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10136.678720][ C2] default_idle_call+0x69/0xa0 [10136.678957][ C2] cpuidle_idle_call+0x1f6/0x280 [10136.679202][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10136.679470][ C2] ? lock_release+0x1d5/0x250 [10136.679704][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10136.679968][ C2] do_idle+0xfb/0x160 [10136.680166][ C2] cpu_startup_entry+0x55/0x60 [10136.680402][ C2] start_secondary+0x21c/0x2b0 [10136.680638][ C2] ? __pfx_start_secondary+0x10/0x10 [10136.680899][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10136.681202][ C2] [10164.569269][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7275s! [swapper/2:0] [10164.569676][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10164.570888][ C2] irq event stamp: 44114564 [10164.571110][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10164.571629][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10164.572127][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10164.572588][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10164.573044][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10164.573486][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10164.574075][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10164.574389][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10164.575330][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10164.575627][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10164.576014][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10164.576401][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10164.576786][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10164.577169][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10164.577556][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10164.577988][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10164.578312][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10164.578699][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10164.579082][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10164.579471][ C2] PKRU: 55555554 [10164.579646][ C2] Call Trace: [10164.579810][ C2] [10164.579952][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10164.580207][ C2] ? __run_hrtimer+0x1c0/0x710 [10164.580442][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10164.580712][ C2] ? __hrtimer_run_queues+0x197/0x270 [10164.580977][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10164.581258][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10164.581516][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10164.581831][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10164.582090][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10164.582351][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10164.582659][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10164.582963][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10164.583269][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10164.583548][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10164.583834][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10164.584111][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10164.584416][ C2] ? get_stack_info+0x36/0xc0 [10164.584652][ C2] ? lock_acquire+0x1c1/0x220 [10164.584885][ C2] ? lock_release+0x1d5/0x250 [10164.585117][ C2] do_raw_spin_lock+0x1ec/0x270 [10164.585361][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10164.585627][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10164.585902][ C2] ? lock_acquire+0x1c1/0x220 [10164.586135][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10164.586367][ C2] _raw_spin_lock_nested+0x65/0x80 [10164.586620][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10164.586845][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10164.587084][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10164.587338][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10164.587604][ C2] ip_local_deliver_finish+0x2ae/0x480 [10164.587875][ C2] ip_local_deliver+0x19d/0x480 [10164.588114][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10164.588380][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10164.588635][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10164.588971][ C2] ? rcu_read_lock_held+0xe/0x50 [10164.589218][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10164.589528][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10164.589783][ C2] ip_rcv+0x564/0x740 [10164.589980][ C2] ? __pfx_ip_rcv+0x10/0x10 [10164.590207][ C2] ? set_track_prepare+0x8a/0xd0 [10164.590454][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10164.590722][ C2] ? start_secondary+0x21c/0x2b0 [10164.590967][ C2] ? skb_clone+0x10b/0x330 [10164.591189][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10164.591500][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10164.591817][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10164.592099][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10164.592392][ C2] ? __tcf_classify+0x329/0x7d0 [10164.592642][ C2] ? __pfx_ip_rcv+0x10/0x10 [10164.592873][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10164.593177][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10164.593454][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10164.593770][ C2] ? lock_acquire+0x1c1/0x220 [10164.594003][ C2] ? netif_receive_skb_internal+0x84/0x300 [10164.594290][ C2] netif_receive_skb_internal+0xb0/0x300 [10164.594569][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10164.594877][ C2] ? __copy_skb_header+0xaf/0x490 [10164.595127][ C2] ? __skb_clone+0x57a/0x760 [10164.595355][ C2] netif_receive_skb+0x55/0x280 [10164.595596][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10164.595900][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10164.596222][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10164.596515][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10164.596781][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10164.597060][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10164.597364][ C2] ? get_stack_info+0x36/0xc0 [10164.597599][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10164.597855][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10164.598162][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10164.598433][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10164.598704][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10164.599011][ C2] ? kernel_text_address+0x17/0xe0 [10164.599267][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10164.599571][ C2] ? arch_stack_walk+0x8c/0x100 [10164.599812][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10164.600070][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10164.600348][ C2] ? lock_acquire+0x1c1/0x220 [10164.600581][ C2] ? stack_depot_save_flags+0x281/0x550 [10164.600855][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10164.601151][ C2] ? get_stack_info_noinstr+0x18/0x110 [10164.601420][ C2] ? get_stack_info+0x36/0xc0 [10164.601656][ C2] __tcf_classify+0x329/0x7d0 [10164.601917][ C2] tcf_classify+0x283/0x930 [10164.602149][ C2] ? __pfx_tcf_classify+0x10/0x10 [10164.602405][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10164.602719][ C2] tc_run+0x2e4/0x5d0 [10164.602924][ C2] ? __pfx_tc_run+0x10/0x10 [10164.603161][ C2] ? lock_acquire+0x1c1/0x220 [10164.603395][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10164.603649][ C2] __dev_queue_xmit+0x686/0x17e0 [10164.603896][ C2] ? lock_acquire+0x1c1/0x220 [10164.604129][ C2] ? ip_finish_output2+0x786/0x18e0 [10164.604391][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10164.604686][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10164.604952][ C2] ? neigh_hh_output+0x348/0x590 [10164.605199][ C2] ? ip_finish_output2+0x262/0x18e0 [10164.605456][ C2] ip_finish_output2+0x786/0x18e0 [10164.605706][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10164.606034][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10164.606303][ C2] ? rcu_read_lock_held+0xe/0x50 [10164.606550][ C2] ? __ip_finish_output+0x10f/0x770 [10164.606806][ C2] ip_output+0x16b/0x4f0 [10164.607019][ C2] ? __pfx_ip_output+0x10/0x10 [10164.607256][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10164.607526][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10164.607831][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10164.608099][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10164.608350][ C2] ? __alloc_skb+0xd4/0x280 [10164.608575][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10164.608837][ C2] ? tcp_fragment+0x168/0x1040 [10164.609074][ C2] ? rcu_read_lock_held+0xe/0x50 [10164.609320][ C2] ? ip_local_out+0x114/0x3b0 [10164.609552][ C2] __ip_queue_xmit+0x672/0x1910 [10164.609794][ C2] ? __skb_clone+0x57a/0x760 [10164.610023][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10164.610283][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10164.610555][ C2] ? ipv4_dst_check+0xe3/0x170 [10164.610793][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10164.611035][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10164.611330][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10164.611642][ C2] ? tcp_fragment+0xb0e/0x1040 [10164.611901][ C2] tcp_send_loss_probe+0x348/0x830 [10164.612163][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10164.612431][ C2] tcp_write_timer+0x82/0x1d0 [10164.612669][ C2] call_timer_fn+0x173/0x430 [10164.612905][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10164.613170][ C2] ? next_expiry_recalc+0xcd/0x220 [10164.613423][ C2] __run_timers.part.0+0x52d/0x890 [10164.613679][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10164.613943][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10164.614220][ C2] ? lock_acquire+0x1c1/0x220 [10164.614453][ C2] ? clockevents_program_event+0xf6/0x300 [10164.614734][ C2] ? lock_release+0x1d5/0x250 [10164.614967][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10164.615225][ C2] ? ktime_get+0xb3/0x190 [10164.615440][ C2] ? clockevents_program_event+0x1ea/0x300 [10164.615726][ C2] run_timer_softirq+0x72/0x100 [10164.615966][ C2] __do_softirq+0x1b9/0x7ff [10164.616194][ C2] irq_exit_rcu+0x98/0xc0 [10164.616407][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10164.616685][ C2] [10164.616833][ C2] [10164.616978][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10164.617277][ C2] RIP: 0010:default_idle+0xf/0x20 [10164.617525][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10164.618466][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10164.618765][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10164.619152][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10164.619541][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10164.619930][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10164.620318][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10164.620705][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10164.620988][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10164.621242][ C2] default_idle_call+0x69/0xa0 [10164.621479][ C2] cpuidle_idle_call+0x1f6/0x280 [10164.621723][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10164.622018][ C2] ? lock_release+0x1d5/0x250 [10164.622257][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10164.622533][ C2] do_idle+0xfb/0x160 [10164.622737][ C2] cpu_startup_entry+0x55/0x60 [10164.622990][ C2] start_secondary+0x21c/0x2b0 [10164.623227][ C2] ? __pfx_start_secondary+0x10/0x10 [10164.623489][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10164.623792][ C2] [10164.623944][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7275s! [perl:4135] [10164.624348][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10164.625568][ C1] irq event stamp: 209232 [10164.625779][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10164.626292][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10164.626759][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10164.627214][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10164.627663][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10164.628098][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10164.628699][ C1] RIP: 0010:kasan_check_range+0x12/0x1c0 [10164.628977][ C1] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [10164.629927][ C1] RSP: 0018:ffffc900001c7b68 EFLAGS: 00000202 [10164.630228][ C1] RAX: ffff88800a3a0e18 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10164.630617][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10164.631007][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10164.631397][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10164.631806][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10164.632206][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10164.632653][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10164.632995][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10164.633384][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10164.633772][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10164.634161][ C1] PKRU: 55555554 [10164.634338][ C1] Call Trace: [10164.634504][ C1] [10164.634649][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10164.634903][ C1] ? __run_hrtimer+0x1c0/0x710 [10164.635139][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10164.635411][ C1] ? __hrtimer_run_queues+0x197/0x270 [10164.635676][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10164.635955][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10164.636215][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10164.636511][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10164.636765][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10164.637066][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10164.637356][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10164.637661][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10164.637941][ C1] ? kasan_check_range+0x12/0x1c0 [10164.638192][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10164.638466][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10164.638768][ C1] ? get_stack_info+0x36/0xc0 [10164.639004][ C1] ? lock_acquire+0x1c1/0x220 [10164.639240][ C1] ? lock_release+0x1d5/0x250 [10164.639474][ C1] do_raw_spin_lock+0x1ec/0x270 [10164.639715][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10164.639981][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10164.640258][ C1] ? lock_acquire+0x1c1/0x220 [10164.640492][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10164.640726][ C1] _raw_spin_lock_nested+0x65/0x80 [10164.640979][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10164.641206][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10164.641447][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10164.641697][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10164.641989][ C1] ip_local_deliver_finish+0x2ae/0x480 [10164.642268][ C1] ip_local_deliver+0x19d/0x480 [10164.642515][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10164.642786][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10164.643058][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10164.643397][ C1] ? rcu_read_lock_held+0xe/0x50 [10164.643643][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10164.643954][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10164.644210][ C1] ip_rcv+0x564/0x740 [10164.644411][ C1] ? __pfx_ip_rcv+0x10/0x10 [10164.644635][ C1] ? set_track_prepare+0x8a/0xd0 [10164.644881][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10164.645151][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10164.645419][ C1] ? skb_clone+0x10b/0x330 [10164.645638][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10164.645952][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10164.646252][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10164.646526][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10164.646815][ C1] ? __tcf_classify+0x329/0x7d0 [10164.647057][ C1] ? __pfx_ip_rcv+0x10/0x10 [10164.647280][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10164.647573][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10164.647851][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10164.648168][ C1] ? lock_acquire+0x1c1/0x220 [10164.648400][ C1] ? netif_receive_skb_internal+0x84/0x300 [10164.648690][ C1] netif_receive_skb_internal+0xb0/0x300 [10164.648967][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10164.649277][ C1] ? __copy_skb_header+0xaf/0x490 [10164.649529][ C1] ? __skb_clone+0x57a/0x760 [10164.649759][ C1] netif_receive_skb+0x55/0x280 [10164.650003][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10164.650309][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10164.650633][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10164.650923][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10164.651193][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10164.651475][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10164.651802][ C1] ? hlock_class+0x4e/0x130 [10164.652034][ C1] ? get_stack_info_noinstr+0x18/0x110 [10164.652313][ C1] ? get_stack_info_noinstr+0x18/0x110 [10164.652589][ C1] ? __pfx_validate_chain+0x10/0x10 [10164.652853][ C1] ? hlock_class+0x4e/0x130 [10164.653096][ C1] ? mark_lock+0x38/0x3e0 [10164.653311][ C1] ? stack_access_ok+0xda/0x1f0 [10164.653553][ C1] ? __lock_acquire+0xb67/0x1610 [10164.653798][ C1] ? get_stack_info_noinstr+0x18/0x110 [10164.654066][ C1] ? get_stack_info+0x36/0xc0 [10164.654303][ C1] ? stack_access_ok+0xda/0x1f0 [10164.654543][ C1] ? get_reg+0x119/0x190 [10164.654753][ C1] ? unwind_next_frame+0x12af/0x1d10 [10164.655016][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10164.655318][ C1] __tcf_classify+0x329/0x7d0 [10164.655553][ C1] tcf_classify+0x283/0x930 [10164.655779][ C1] ? arch_stack_walk+0xa2/0x100 [10164.656021][ C1] ? __pfx_tcf_classify+0x10/0x10 [10164.656272][ C1] ? get_stack_info+0x36/0xc0 [10164.656505][ C1] tc_run+0x2e4/0x5d0 [10164.656706][ C1] ? __pfx_tc_run+0x10/0x10 [10164.656930][ C1] ? lock_acquire+0x1c1/0x220 [10164.657163][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10164.657418][ C1] __dev_queue_xmit+0x686/0x17e0 [10164.657664][ C1] ? lock_acquire+0x1c1/0x220 [10164.657897][ C1] ? ip_finish_output2+0x786/0x18e0 [10164.658156][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10164.658453][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10164.658718][ C1] ? neigh_hh_output+0x348/0x590 [10164.658964][ C1] ? ip_finish_output2+0x262/0x18e0 [10164.659223][ C1] ip_finish_output2+0x786/0x18e0 [10164.659473][ C1] ? stack_depot_save_flags+0x45/0x550 [10164.659743][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10164.660069][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10164.660341][ C1] ? rcu_read_lock_held+0xe/0x50 [10164.660589][ C1] ? __ip_finish_output+0x10f/0x770 [10164.660847][ C1] ip_output+0x16b/0x4f0 [10164.661056][ C1] ? run_timer_softirq+0x72/0x100 [10164.661308][ C1] ? __pfx_ip_output+0x10/0x10 [10164.661545][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10164.661846][ C1] ? rcu_read_lock_held+0xe/0x50 [10164.662098][ C1] ? ip_local_out+0x114/0x3b0 [10164.662340][ C1] __ip_queue_xmit+0x672/0x1910 [10164.662588][ C1] ? __create_object+0x5e/0xb0 [10164.662833][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10164.663106][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10164.663379][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10164.663645][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10164.663919][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10164.664184][ C1] tcp_delack_timer+0x84/0x240 [10164.664423][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10164.664687][ C1] call_timer_fn+0x173/0x430 [10164.664917][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10164.665173][ C1] ? next_expiry_recalc+0xcd/0x220 [10164.665428][ C1] __run_timers.part.0+0x52d/0x890 [10164.665682][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10164.665947][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10164.666228][ C1] ? lock_acquire+0x1c1/0x220 [10164.666459][ C1] ? clockevents_program_event+0xf6/0x300 [10164.666741][ C1] ? lock_release+0x1d5/0x250 [10164.666975][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10164.667234][ C1] ? ktime_get+0xb3/0x190 [10164.667447][ C1] ? clockevents_program_event+0x1ea/0x300 [10164.667738][ C1] run_timer_softirq+0x72/0x100 [10164.667979][ C1] __do_softirq+0x1b9/0x7ff [10164.668208][ C1] irq_exit_rcu+0x98/0xc0 [10164.668424][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10164.668701][ C1] [10164.668849][ C1] [10164.668994][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10164.669292][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10164.669607][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10164.670551][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10164.670853][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10164.671242][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10164.671629][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10164.672044][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10164.672445][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10164.672845][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10164.673147][ C1] pipe_read+0xa16/0xdf0 [10164.673362][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10164.673632][ C1] ? __pfx_pipe_read+0x10/0x10 [10164.673868][ C1] ? iterate_tty_write+0x299/0x540 [10164.674122][ C1] ? lock_release+0x1d5/0x250 [10164.674359][ C1] vfs_read+0x911/0xc00 [10164.674566][ C1] ? lock_acquire+0x1c1/0x220 [10164.674799][ C1] ? __might_fault+0xc6/0x180 [10164.675034][ C1] ? __pfx_vfs_read+0x10/0x10 [10164.675268][ C1] ? __might_fault+0xc6/0x180 [10164.675500][ C1] ? lock_release+0x1d5/0x250 [10164.675734][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10164.675991][ C1] ? __fget_light+0x54/0x1e0 [10164.676224][ C1] ksys_read+0x17a/0x1e0 [10164.676435][ C1] ? __pfx_ksys_read+0x10/0x10 [10164.676673][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10164.676969][ C1] do_syscall_64+0xc9/0x1e0 [10164.677194][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10164.677487][ C1] RIP: 0033:0x7f08a1ea38b2 [10164.677709][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10164.678653][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10164.679061][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10164.679453][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10164.679841][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10164.680229][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10164.680616][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10164.681008][ C1] [10186.748103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10186.748450][ C1] rcu: 1-....: (7811590 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1834766 [10186.748997][ C1] rcu: (t=7831861 jiffies g=1882453 q=724 ncpus=4) [10186.749322][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10186.749758][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10186.750355][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [10186.750632][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [10186.751577][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [10186.751881][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10186.752270][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10186.752659][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10186.753049][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10186.753458][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10186.753857][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10186.754305][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10186.754644][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10186.755036][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10186.755425][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10186.755813][ C1] PKRU: 55555554 [10186.755990][ C1] Call Trace: [10186.756157][ C1] [10186.756301][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10186.756566][ C1] ? print_cpu_stall+0x263/0x6a0 [10186.756812][ C1] ? check_cpu_stall+0x284/0x500 [10186.757057][ C1] ? rcu_pending+0x92/0x360 [10186.757284][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10186.757547][ C1] ? update_process_times+0xb9/0x110 [10186.757809][ C1] ? tick_sched_handle+0x67/0x130 [10186.758059][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10186.758337][ C1] ? __run_hrtimer+0x1c0/0x710 [10186.758572][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10186.758877][ C1] ? __hrtimer_run_queues+0x197/0x270 [10186.759142][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10186.759425][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10186.759683][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10186.759981][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10186.760238][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10186.760539][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10186.760826][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10186.761132][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10186.761416][ C1] ? __pfx___kasan_check_read+0x10/0x10 [10186.761693][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10186.761967][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10186.762271][ C1] ? get_stack_info+0x36/0xc0 [10186.762506][ C1] ? lock_acquire+0x1c1/0x220 [10186.762741][ C1] ? lock_release+0x1d5/0x250 [10186.762974][ C1] do_raw_spin_lock+0x1ec/0x270 [10186.763216][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10186.763482][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10186.763759][ C1] ? lock_acquire+0x1c1/0x220 [10186.763993][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10186.764228][ C1] _raw_spin_lock_nested+0x65/0x80 [10186.764482][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10186.764708][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10186.764949][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10186.765203][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10186.765471][ C1] ip_local_deliver_finish+0x2ae/0x480 [10186.765742][ C1] ip_local_deliver+0x19d/0x480 [10186.765983][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10186.766251][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10186.766508][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10186.766845][ C1] ? rcu_read_lock_held+0xe/0x50 [10186.767093][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10186.767406][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10186.767662][ C1] ip_rcv+0x564/0x740 [10186.767861][ C1] ? __pfx_ip_rcv+0x10/0x10 [10186.768087][ C1] ? set_track_prepare+0x8a/0xd0 [10186.768334][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10186.768603][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10186.768871][ C1] ? skb_clone+0x10b/0x330 [10186.769090][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10186.769401][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10186.769699][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10186.769971][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10186.770263][ C1] ? __tcf_classify+0x329/0x7d0 [10186.770504][ C1] ? __pfx_ip_rcv+0x10/0x10 [10186.770727][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10186.771020][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10186.771297][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10186.771615][ C1] ? lock_acquire+0x1c1/0x220 [10186.771871][ C1] ? netif_receive_skb_internal+0x84/0x300 [10186.772167][ C1] netif_receive_skb_internal+0xb0/0x300 [10186.772451][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10186.772767][ C1] ? __copy_skb_header+0xaf/0x490 [10186.773030][ C1] ? __skb_clone+0x57a/0x760 [10186.773260][ C1] netif_receive_skb+0x55/0x280 [10186.773502][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10186.773805][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10186.774129][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10186.774419][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10186.774687][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10186.774967][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10186.775272][ C1] ? hlock_class+0x4e/0x130 [10186.775496][ C1] ? get_stack_info_noinstr+0x18/0x110 [10186.775767][ C1] ? get_stack_info_noinstr+0x18/0x110 [10186.776035][ C1] ? __pfx_validate_chain+0x10/0x10 [10186.776292][ C1] ? hlock_class+0x4e/0x130 [10186.776517][ C1] ? mark_lock+0x38/0x3e0 [10186.776729][ C1] ? stack_access_ok+0xda/0x1f0 [10186.776970][ C1] ? __lock_acquire+0xb67/0x1610 [10186.777218][ C1] ? get_stack_info_noinstr+0x18/0x110 [10186.777486][ C1] ? get_stack_info+0x36/0xc0 [10186.777720][ C1] ? stack_access_ok+0xda/0x1f0 [10186.777961][ C1] ? get_reg+0x119/0x190 [10186.778170][ C1] ? unwind_next_frame+0x12af/0x1d10 [10186.778433][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10186.778733][ C1] __tcf_classify+0x329/0x7d0 [10186.778968][ C1] tcf_classify+0x283/0x930 [10186.779195][ C1] ? arch_stack_walk+0xa2/0x100 [10186.779437][ C1] ? __pfx_tcf_classify+0x10/0x10 [10186.779686][ C1] ? get_stack_info+0x36/0xc0 [10186.779918][ C1] tc_run+0x2e4/0x5d0 [10186.780118][ C1] ? __pfx_tc_run+0x10/0x10 [10186.780344][ C1] ? lock_acquire+0x1c1/0x220 [10186.780576][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10186.780831][ C1] __dev_queue_xmit+0x686/0x17e0 [10186.781077][ C1] ? lock_acquire+0x1c1/0x220 [10186.781312][ C1] ? ip_finish_output2+0x786/0x18e0 [10186.781569][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10186.781890][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10186.782164][ C1] ? neigh_hh_output+0x348/0x590 [10186.782417][ C1] ? ip_finish_output2+0x262/0x18e0 [10186.782681][ C1] ip_finish_output2+0x786/0x18e0 [10186.782946][ C1] ? stack_depot_save_flags+0x45/0x550 [10186.783217][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10186.783545][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10186.783815][ C1] ? rcu_read_lock_held+0xe/0x50 [10186.784061][ C1] ? __ip_finish_output+0x10f/0x770 [10186.784320][ C1] ip_output+0x16b/0x4f0 [10186.784529][ C1] ? run_timer_softirq+0x72/0x100 [10186.784780][ C1] ? __pfx_ip_output+0x10/0x10 [10186.785017][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10186.785297][ C1] ? rcu_read_lock_held+0xe/0x50 [10186.785542][ C1] ? ip_local_out+0x114/0x3b0 [10186.785776][ C1] __ip_queue_xmit+0x672/0x1910 [10186.786019][ C1] ? __create_object+0x5e/0xb0 [10186.786258][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10186.786517][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10186.786791][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10186.787056][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10186.787332][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10186.787597][ C1] tcp_delack_timer+0x84/0x240 [10186.787835][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10186.788099][ C1] call_timer_fn+0x173/0x430 [10186.788331][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10186.788585][ C1] ? next_expiry_recalc+0xcd/0x220 [10186.788840][ C1] __run_timers.part.0+0x52d/0x890 [10186.789093][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10186.789359][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10186.789639][ C1] ? lock_acquire+0x1c1/0x220 [10186.789869][ C1] ? clockevents_program_event+0xf6/0x300 [10186.790152][ C1] ? lock_release+0x1d5/0x250 [10186.790387][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10186.790644][ C1] ? ktime_get+0xb3/0x190 [10186.790862][ C1] ? clockevents_program_event+0x1ea/0x300 [10186.791152][ C1] run_timer_softirq+0x72/0x100 [10186.791396][ C1] __do_softirq+0x1b9/0x7ff [10186.791620][ C1] irq_exit_rcu+0x98/0xc0 [10186.791862][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10186.792146][ C1] [10186.792298][ C1] [10186.792448][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10186.792753][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10186.793082][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10186.794024][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10186.794324][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10186.794712][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10186.795098][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10186.795487][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10186.795876][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10186.796267][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10186.796556][ C1] pipe_read+0xa16/0xdf0 [10186.796770][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10186.797039][ C1] ? __pfx_pipe_read+0x10/0x10 [10186.797277][ C1] ? iterate_tty_write+0x299/0x540 [10186.797530][ C1] ? lock_release+0x1d5/0x250 [10186.797764][ C1] vfs_read+0x911/0xc00 [10186.797971][ C1] ? lock_acquire+0x1c1/0x220 [10186.798206][ C1] ? __might_fault+0xc6/0x180 [10186.798443][ C1] ? __pfx_vfs_read+0x10/0x10 [10186.798675][ C1] ? __might_fault+0xc6/0x180 [10186.798908][ C1] ? lock_release+0x1d5/0x250 [10186.799143][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10186.799400][ C1] ? __fget_light+0x54/0x1e0 [10186.799632][ C1] ksys_read+0x17a/0x1e0 [10186.799842][ C1] ? __pfx_ksys_read+0x10/0x10 [10186.800080][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10186.800377][ C1] do_syscall_64+0xc9/0x1e0 [10186.800602][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10186.800895][ C1] RIP: 0033:0x7f08a1ea38b2 [10186.801116][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10186.802091][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10186.802509][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10186.802920][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10186.803309][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10186.803697][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10186.804083][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10186.804477][ C1] [10186.804629][ C1] Sending NMI from CPU 1 to CPUs 2: [10186.804893][ C2] NMI backtrace for cpu 2 [10186.804898][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10186.804904][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10186.804907][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10186.804916][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10186.804922][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10186.804926][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10186.804930][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10186.804934][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10186.804937][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10186.804941][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10186.804945][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10186.804950][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10186.804955][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10186.804958][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10186.804962][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10186.804965][ C2] PKRU: 55555554 [10186.804967][ C2] Call Trace: [10186.804969][ C2] [10186.804972][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10186.804983][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10186.804991][ C2] ? nmi_handle+0x153/0x420 [10186.805000][ C2] ? default_do_nmi+0x41/0x100 [10186.805007][ C2] ? exc_nmi+0xf3/0x120 [10186.805012][ C2] ? end_repeat_nmi+0xf/0x60 [10186.805024][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10186.805032][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10186.805039][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10186.805048][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10186.805056][ C2] [10186.805058][ C2] [10186.805061][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10186.805067][ C2] ? get_stack_info+0x36/0xc0 [10186.805073][ C2] ? lock_acquire+0x1c1/0x220 [10186.805077][ C2] ? lock_release+0x1d5/0x250 [10186.805080][ C2] do_raw_spin_lock+0x1ec/0x270 [10186.805083][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10186.805086][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10186.805089][ C2] ? lock_acquire+0x1c1/0x220 [10186.805092][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10186.805095][ C2] _raw_spin_lock_nested+0x65/0x80 [10186.805098][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10186.805104][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10186.805106][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10186.805111][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10186.805116][ C2] ip_local_deliver_finish+0x2ae/0x480 [10186.805119][ C2] ip_local_deliver+0x19d/0x480 [10186.805121][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10186.805123][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10186.805126][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10186.805131][ C2] ? rcu_read_lock_held+0xe/0x50 [10186.805135][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10186.805138][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10186.805146][ C2] ip_rcv+0x564/0x740 [10186.805149][ C2] ? __pfx_ip_rcv+0x10/0x10 [10186.805151][ C2] ? set_track_prepare+0x8a/0xd0 [10186.805156][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10186.805159][ C2] ? start_secondary+0x21c/0x2b0 [10186.805162][ C2] ? skb_clone+0x10b/0x330 [10186.805165][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10186.805171][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10186.805176][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10186.805180][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10186.805188][ C2] ? __tcf_classify+0x329/0x7d0 [10186.805192][ C2] ? __pfx_ip_rcv+0x10/0x10 [10186.805194][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10186.805197][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10186.805200][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10186.805205][ C2] ? lock_acquire+0x1c1/0x220 [10186.805207][ C2] ? netif_receive_skb_internal+0x84/0x300 [10186.805211][ C2] netif_receive_skb_internal+0xb0/0x300 [10186.805214][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10186.805218][ C2] ? __copy_skb_header+0xaf/0x490 [10186.805222][ C2] ? __skb_clone+0x57a/0x760 [10186.805225][ C2] netif_receive_skb+0x55/0x280 [10186.805228][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10186.805234][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10186.805240][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10186.805246][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10186.805251][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10186.805260][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10186.805267][ C2] ? get_stack_info+0x36/0xc0 [10186.805272][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10186.805274][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10186.805277][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10186.805280][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10186.805283][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10186.805285][ C2] ? kernel_text_address+0x17/0xe0 [10186.805288][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10186.805292][ C2] ? arch_stack_walk+0x8c/0x100 [10186.805295][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10186.805298][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10186.805301][ C2] ? lock_acquire+0x1c1/0x220 [10186.805304][ C2] ? stack_depot_save_flags+0x281/0x550 [10186.805308][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10186.805312][ C2] ? get_stack_info_noinstr+0x18/0x110 [10186.805315][ C2] ? get_stack_info+0x36/0xc0 [10186.805319][ C2] __tcf_classify+0x329/0x7d0 [10186.805324][ C2] tcf_classify+0x283/0x930 [10186.805329][ C2] ? __pfx_tcf_classify+0x10/0x10 [10186.805332][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10186.805337][ C2] tc_run+0x2e4/0x5d0 [10186.805340][ C2] ? __pfx_tc_run+0x10/0x10 [10186.805343][ C2] ? lock_acquire+0x1c1/0x220 [10186.805345][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10186.805349][ C2] __dev_queue_xmit+0x686/0x17e0 [10186.805353][ C2] ? lock_acquire+0x1c1/0x220 [10186.805356][ C2] ? ip_finish_output2+0x786/0x18e0 [10186.805359][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10186.805362][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10186.805364][ C2] ? neigh_hh_output+0x348/0x590 [10186.805368][ C2] ? ip_finish_output2+0x262/0x18e0 [10186.805372][ C2] ip_finish_output2+0x786/0x18e0 [10186.805375][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10186.805382][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10186.805385][ C2] ? rcu_read_lock_held+0xe/0x50 [10186.805388][ C2] ? __ip_finish_output+0x10f/0x770 [10186.805392][ C2] ip_output+0x16b/0x4f0 [10186.805395][ C2] ? __pfx_ip_output+0x10/0x10 [10186.805397][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10186.805400][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10186.805403][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10186.805406][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10186.805409][ C2] ? __alloc_skb+0xd4/0x280 [10186.805411][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10186.805415][ C2] ? tcp_fragment+0x168/0x1040 [10186.805418][ C2] ? rcu_read_lock_held+0xe/0x50 [10186.805421][ C2] ? ip_local_out+0x114/0x3b0 [10186.805424][ C2] __ip_queue_xmit+0x672/0x1910 [10186.805428][ C2] ? __skb_clone+0x57a/0x760 [10186.805430][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10186.805435][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10186.805439][ C2] ? ipv4_dst_check+0xe3/0x170 [10186.805442][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10186.805446][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10186.805450][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10186.805453][ C2] ? tcp_fragment+0xb0e/0x1040 [10186.805456][ C2] tcp_send_loss_probe+0x348/0x830 [10186.805459][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10186.805461][ C2] tcp_write_timer+0x82/0x1d0 [10186.805464][ C2] call_timer_fn+0x173/0x430 [10186.805468][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10186.805472][ C2] ? next_expiry_recalc+0xcd/0x220 [10186.805477][ C2] __run_timers.part.0+0x52d/0x890 [10186.805479][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10186.805483][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10186.805486][ C2] ? lock_acquire+0x1c1/0x220 [10186.805488][ C2] ? clockevents_program_event+0xf6/0x300 [10186.805492][ C2] ? lock_release+0x1d5/0x250 [10186.805495][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10186.805498][ C2] ? ktime_get+0xb3/0x190 [10186.805501][ C2] ? clockevents_program_event+0x1ea/0x300 [10186.805506][ C2] run_timer_softirq+0x72/0x100 [10186.805509][ C2] __do_softirq+0x1b9/0x7ff [10186.805513][ C2] irq_exit_rcu+0x98/0xc0 [10186.805516][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10186.805519][ C2] [10186.805519][ C2] [10186.805521][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10186.805524][ C2] RIP: 0010:default_idle+0xf/0x20 [10186.805527][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10186.805529][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10186.805531][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10186.805533][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10186.805534][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10186.805535][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10186.805537][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10186.805539][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10186.805542][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10186.805545][ C2] default_idle_call+0x69/0xa0 [10186.805548][ C2] cpuidle_idle_call+0x1f6/0x280 [10186.805550][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10186.805554][ C2] ? lock_release+0x1d5/0x250 [10186.805556][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10186.805560][ C2] do_idle+0xfb/0x160 [10186.805562][ C2] cpu_startup_entry+0x55/0x60 [10186.805565][ C2] start_secondary+0x21c/0x2b0 [10186.805567][ C2] ? __pfx_start_secondary+0x10/0x10 [10186.805571][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10186.805576][ C2] [10212.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7320s! [perl:4135] [10212.569896][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10212.571659][ C1] irq event stamp: 209232 [10212.571969][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10212.572716][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10212.573392][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10212.574039][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10212.574694][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10212.575349][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10212.576218][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10212.576670][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10212.578035][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10212.578470][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10212.579033][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10212.579613][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10212.580152][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10212.580685][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10212.581264][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10212.581909][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10212.582367][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10212.582916][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10212.583469][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10212.584062][ C1] PKRU: 55555554 [10212.584349][ C1] Call Trace: [10212.584613][ C1] [10212.584836][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10212.585241][ C1] ? __run_hrtimer+0x1c0/0x710 [10212.585622][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10212.586051][ C1] ? __hrtimer_run_queues+0x197/0x270 [10212.586477][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10212.586914][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10212.587327][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10212.587808][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10212.588288][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10212.588781][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10212.589243][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10212.589744][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10212.590202][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10212.590682][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10212.591156][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10212.591680][ C1] ? get_stack_info+0x36/0xc0 [10212.592067][ C1] ? lock_acquire+0x1c1/0x220 [10212.592454][ C1] ? lock_release+0x1d5/0x250 [10212.592852][ C1] do_raw_spin_lock+0x1ec/0x270 [10212.593262][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10212.593701][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10212.594156][ C1] ? lock_acquire+0x1c1/0x220 [10212.594545][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10212.594936][ C1] _raw_spin_lock_nested+0x65/0x80 [10212.595361][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10212.595747][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10212.596140][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10212.596563][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10212.596981][ C1] ip_local_deliver_finish+0x2ae/0x480 [10212.597437][ C1] ip_local_deliver+0x19d/0x480 [10212.597839][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10212.598272][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10212.598704][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10212.599270][ C1] ? rcu_read_lock_held+0xe/0x50 [10212.599684][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10212.600193][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10212.600624][ C1] ip_rcv+0x564/0x740 [10212.600955][ C1] ? __pfx_ip_rcv+0x10/0x10 [10212.601335][ C1] ? set_track_prepare+0x8a/0xd0 [10212.601736][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10212.602179][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10212.602621][ C1] ? skb_clone+0x10b/0x330 [10212.602950][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10212.603463][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10212.603957][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10212.604412][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10212.604892][ C1] ? __tcf_classify+0x329/0x7d0 [10212.605301][ C1] ? __pfx_ip_rcv+0x10/0x10 [10212.605679][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10212.606160][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10212.606623][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10212.607152][ C1] ? lock_acquire+0x1c1/0x220 [10212.607540][ C1] ? netif_receive_skb_internal+0x84/0x300 [10212.608012][ C1] netif_receive_skb_internal+0xb0/0x300 [10212.608479][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10212.608994][ C1] ? __copy_skb_header+0xaf/0x490 [10212.609416][ C1] ? __skb_clone+0x57a/0x760 [10212.609787][ C1] netif_receive_skb+0x55/0x280 [10212.610192][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10212.610699][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10212.611244][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10212.611711][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10212.612128][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10212.612581][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10212.613080][ C1] ? hlock_class+0x4e/0x130 [10212.613456][ C1] ? get_stack_info_noinstr+0x18/0x110 [10212.613898][ C1] ? get_stack_info_noinstr+0x18/0x110 [10212.614357][ C1] ? __pfx_validate_chain+0x10/0x10 [10212.614782][ C1] ? hlock_class+0x4e/0x130 [10212.615165][ C1] ? mark_lock+0x38/0x3e0 [10212.615523][ C1] ? stack_access_ok+0xda/0x1f0 [10212.615920][ C1] ? __lock_acquire+0xb67/0x1610 [10212.616303][ C1] ? get_stack_info_noinstr+0x18/0x110 [10212.616737][ C1] ? get_stack_info+0x36/0xc0 [10212.617121][ C1] ? stack_access_ok+0xda/0x1f0 [10212.617514][ C1] ? get_reg+0x119/0x190 [10212.617860][ C1] ? unwind_next_frame+0x12af/0x1d10 [10212.618284][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10212.618777][ C1] __tcf_classify+0x329/0x7d0 [10212.619185][ C1] tcf_classify+0x283/0x930 [10212.619506][ C1] ? arch_stack_walk+0xa2/0x100 [10212.619825][ C1] ? __pfx_tcf_classify+0x10/0x10 [10212.620202][ C1] ? get_stack_info+0x36/0xc0 [10212.620584][ C1] tc_run+0x2e4/0x5d0 [10212.620917][ C1] ? __pfx_tc_run+0x10/0x10 [10212.621310][ C1] ? lock_acquire+0x1c1/0x220 [10212.621708][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10212.622135][ C1] __dev_queue_xmit+0x686/0x17e0 [10212.622541][ C1] ? lock_acquire+0x1c1/0x220 [10212.622926][ C1] ? ip_finish_output2+0x786/0x18e0 [10212.623349][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10212.623831][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10212.624266][ C1] ? neigh_hh_output+0x348/0x590 [10212.624667][ C1] ? ip_finish_output2+0x262/0x18e0 [10212.625091][ C1] ip_finish_output2+0x786/0x18e0 [10212.625495][ C1] ? stack_depot_save_flags+0x45/0x550 [10212.625944][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10212.626483][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10212.626922][ C1] ? rcu_read_lock_held+0xe/0x50 [10212.627324][ C1] ? __ip_finish_output+0x10f/0x770 [10212.627745][ C1] ip_output+0x16b/0x4f0 [10212.628089][ C1] ? run_timer_softirq+0x72/0x100 [10212.628495][ C1] ? __pfx_ip_output+0x10/0x10 [10212.628879][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10212.629338][ C1] ? rcu_read_lock_held+0xe/0x50 [10212.629741][ C1] ? ip_local_out+0x114/0x3b0 [10212.630118][ C1] __ip_queue_xmit+0x672/0x1910 [10212.630513][ C1] ? __create_object+0x5e/0xb0 [10212.630903][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10212.631327][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10212.631794][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10212.632226][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10212.632671][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10212.633102][ C1] tcp_delack_timer+0x84/0x240 [10212.633491][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10212.633931][ C1] call_timer_fn+0x173/0x430 [10212.634300][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10212.634726][ C1] ? next_expiry_recalc+0xcd/0x220 [10212.635160][ C1] __run_timers.part.0+0x52d/0x890 [10212.635577][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10212.636011][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10212.636466][ C1] ? lock_acquire+0x1c1/0x220 [10212.636844][ C1] ? clockevents_program_event+0xf6/0x300 [10212.637311][ C1] ? lock_release+0x1d5/0x250 [10212.637691][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10212.638112][ C1] ? ktime_get+0xb3/0x190 [10212.638467][ C1] ? clockevents_program_event+0x1ea/0x300 [10212.638935][ C1] run_timer_softirq+0x72/0x100 [10212.639333][ C1] __do_softirq+0x1b9/0x7ff [10212.639703][ C1] irq_exit_rcu+0x98/0xc0 [10212.640054][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10212.640517][ C1] [10212.640766][ C1] [10212.641000][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10212.641471][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10212.641985][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10212.643539][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10212.644028][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10212.644664][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10212.645301][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10212.645932][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10212.646562][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10212.647198][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10212.647667][ C1] pipe_read+0xa16/0xdf0 [10212.648016][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10212.648453][ C1] ? __pfx_pipe_read+0x10/0x10 [10212.648835][ C1] ? iterate_tty_write+0x299/0x540 [10212.649249][ C1] ? lock_release+0x1d5/0x250 [10212.649623][ C1] vfs_read+0x911/0xc00 [10212.649959][ C1] ? lock_acquire+0x1c1/0x220 [10212.650335][ C1] ? __might_fault+0xc6/0x180 [10212.650726][ C1] ? __pfx_vfs_read+0x10/0x10 [10212.651087][ C1] ? __might_fault+0xc6/0x180 [10212.651451][ C1] ? lock_release+0x1d5/0x250 [10212.651844][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10212.652278][ C1] ? __fget_light+0x54/0x1e0 [10212.652651][ C1] ksys_read+0x17a/0x1e0 [10212.652992][ C1] ? __pfx_ksys_read+0x10/0x10 [10212.653372][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10212.653857][ C1] do_syscall_64+0xc9/0x1e0 [10212.654229][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10212.654696][ C1] RIP: 0033:0x7f08a1ea38b2 [10212.655067][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10212.656582][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10212.657270][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10212.657897][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10212.658521][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10212.659154][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10212.659786][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10212.660421][ C1] [10212.660670][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7320s! [swapper/2:0] [10212.661380][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10212.663439][ C2] irq event stamp: 44114564 [10212.663800][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10212.664597][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10212.665447][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10212.666192][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10212.666967][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10212.667696][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10212.668689][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10212.669201][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10212.670731][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10212.671232][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10212.671879][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10212.672513][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10212.673166][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10212.673774][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10212.674394][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10212.675112][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10212.675639][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10212.676277][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10212.676909][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10212.677537][ C2] PKRU: 55555554 [10212.677826][ C2] Call Trace: [10212.678100][ C2] [10212.678341][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10212.678761][ C2] ? __run_hrtimer+0x1c0/0x710 [10212.679156][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10212.679598][ C2] ? __hrtimer_run_queues+0x197/0x270 [10212.680035][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10212.680499][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10212.680919][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10212.681406][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10212.681839][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10212.682262][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10212.682750][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10212.683227][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10212.683732][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10212.684195][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10212.684666][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10212.685130][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10212.685625][ C2] ? get_stack_info+0x36/0xc0 [10212.686015][ C2] ? lock_acquire+0x1c1/0x220 [10212.686404][ C2] ? lock_release+0x1d5/0x250 [10212.686784][ C2] do_raw_spin_lock+0x1ec/0x270 [10212.687177][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10212.687609][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10212.688063][ C2] ? lock_acquire+0x1c1/0x220 [10212.688445][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10212.688829][ C2] _raw_spin_lock_nested+0x65/0x80 [10212.689240][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10212.689614][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10212.690013][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10212.690425][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10212.690862][ C2] ip_local_deliver_finish+0x2ae/0x480 [10212.691307][ C2] ip_local_deliver+0x19d/0x480 [10212.691712][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10212.692145][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10212.692564][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10212.693116][ C2] ? rcu_read_lock_held+0xe/0x50 [10212.693520][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10212.694029][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10212.694446][ C2] ip_rcv+0x564/0x740 [10212.694769][ C2] ? __pfx_ip_rcv+0x10/0x10 [10212.695135][ C2] ? set_track_prepare+0x8a/0xd0 [10212.695536][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10212.695975][ C2] ? start_secondary+0x21c/0x2b0 [10212.696380][ C2] ? skb_clone+0x10b/0x330 [10212.696742][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10212.697247][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10212.697716][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10212.698131][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10212.698530][ C2] ? __tcf_classify+0x329/0x7d0 [10212.698854][ C2] ? __pfx_ip_rcv+0x10/0x10 [10212.699156][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10212.699548][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10212.699922][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10212.700344][ C2] ? lock_acquire+0x1c1/0x220 [10212.700655][ C2] ? netif_receive_skb_internal+0x84/0x300 [10212.701043][ C2] netif_receive_skb_internal+0xb0/0x300 [10212.701417][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10212.701863][ C2] ? __copy_skb_header+0xaf/0x490 [10212.702273][ C2] ? __skb_clone+0x57a/0x760 [10212.702651][ C2] netif_receive_skb+0x55/0x280 [10212.703050][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10212.703554][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10212.704063][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10212.704544][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10212.704986][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10212.705445][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10212.705928][ C2] ? get_stack_info+0x36/0xc0 [10212.706311][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10212.706738][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10212.707242][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10212.707665][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10212.708108][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10212.708626][ C2] ? kernel_text_address+0x17/0xe0 [10212.709038][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10212.709534][ C2] ? arch_stack_walk+0x8c/0x100 [10212.709925][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10212.710348][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10212.710799][ C2] ? lock_acquire+0x1c1/0x220 [10212.711177][ C2] ? stack_depot_save_flags+0x281/0x550 [10212.711623][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10212.712065][ C2] ? get_stack_info_noinstr+0x18/0x110 [10212.712494][ C2] ? get_stack_info+0x36/0xc0 [10212.712868][ C2] __tcf_classify+0x329/0x7d0 [10212.713248][ C2] tcf_classify+0x283/0x930 [10212.713604][ C2] ? __pfx_tcf_classify+0x10/0x10 [10212.714037][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10212.714534][ C2] tc_run+0x2e4/0x5d0 [10212.714863][ C2] ? __pfx_tc_run+0x10/0x10 [10212.715233][ C2] ? lock_acquire+0x1c1/0x220 [10212.715612][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10212.716033][ C2] __dev_queue_xmit+0x686/0x17e0 [10212.716437][ C2] ? lock_acquire+0x1c1/0x220 [10212.716820][ C2] ? ip_finish_output2+0x786/0x18e0 [10212.717243][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10212.717733][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10212.718169][ C2] ? neigh_hh_output+0x348/0x590 [10212.718568][ C2] ? ip_finish_output2+0x262/0x18e0 [10212.719003][ C2] ip_finish_output2+0x786/0x18e0 [10212.719417][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10212.719936][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10212.720362][ C2] ? rcu_read_lock_held+0xe/0x50 [10212.720775][ C2] ? __ip_finish_output+0x10f/0x770 [10212.721190][ C2] ip_output+0x16b/0x4f0 [10212.721554][ C2] ? __pfx_ip_output+0x10/0x10 [10212.721940][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10212.722383][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10212.722883][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10212.723319][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10212.723720][ C2] ? __alloc_skb+0xd4/0x280 [10212.724083][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10212.724510][ C2] ? tcp_fragment+0x168/0x1040 [10212.724897][ C2] ? rcu_read_lock_held+0xe/0x50 [10212.725293][ C2] ? ip_local_out+0x114/0x3b0 [10212.725677][ C2] __ip_queue_xmit+0x672/0x1910 [10212.726069][ C2] ? __skb_clone+0x57a/0x760 [10212.726446][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10212.726871][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10212.727317][ C2] ? ipv4_dst_check+0xe3/0x170 [10212.727705][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10212.728099][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10212.728580][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10212.729084][ C2] ? tcp_fragment+0xb0e/0x1040 [10212.729474][ C2] tcp_send_loss_probe+0x348/0x830 [10212.729899][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10212.730316][ C2] tcp_write_timer+0x82/0x1d0 [10212.730685][ C2] call_timer_fn+0x173/0x430 [10212.731082][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10212.731500][ C2] ? next_expiry_recalc+0xcd/0x220 [10212.731928][ C2] __run_timers.part.0+0x52d/0x890 [10212.732344][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10212.732781][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10212.733234][ C2] ? lock_acquire+0x1c1/0x220 [10212.733626][ C2] ? clockevents_program_event+0xf6/0x300 [10212.734072][ C2] ? lock_release+0x1d5/0x250 [10212.734449][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10212.734852][ C2] ? ktime_get+0xb3/0x190 [10212.735215][ C2] ? clockevents_program_event+0x1ea/0x300 [10212.735685][ C2] run_timer_softirq+0x72/0x100 [10212.736074][ C2] __do_softirq+0x1b9/0x7ff [10212.736447][ C2] irq_exit_rcu+0x98/0xc0 [10212.736792][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10212.737237][ C2] [10212.737477][ C2] [10212.737712][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10212.738198][ C2] RIP: 0010:default_idle+0xf/0x20 [10212.738600][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10212.740110][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10212.740595][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10212.741219][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10212.741849][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10212.742467][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10212.743088][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10212.743717][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10212.744174][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10212.744582][ C2] default_idle_call+0x69/0xa0 [10212.744957][ C2] cpuidle_idle_call+0x1f6/0x280 [10212.745349][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10212.745781][ C2] ? lock_release+0x1d5/0x250 [10212.746155][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10212.746579][ C2] do_idle+0xfb/0x160 [10212.746896][ C2] cpu_startup_entry+0x55/0x60 [10212.747273][ C2] start_secondary+0x21c/0x2b0 [10212.747654][ C2] ? __pfx_start_secondary+0x10/0x10 [10212.748078][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10212.748569][ C2] [10240.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7346s! [perl:4135] [10240.569968][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10240.572026][ C1] irq event stamp: 209232 [10240.572388][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10240.573262][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10240.574052][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10240.574806][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10240.575542][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10240.576258][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10240.577235][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10240.577748][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [10240.579243][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10240.579735][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10240.580369][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10240.581000][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10240.581648][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10240.582286][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10240.582919][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10240.583626][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10240.584155][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10240.584820][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10240.585489][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10240.586151][ C1] PKRU: 55555554 [10240.586444][ C1] Call Trace: [10240.586713][ C1] [10240.586927][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10240.587344][ C1] ? __run_hrtimer+0x1c0/0x710 [10240.587732][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10240.588170][ C1] ? __hrtimer_run_queues+0x197/0x270 [10240.588613][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10240.589078][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10240.589511][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10240.590003][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10240.590397][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10240.590885][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10240.591350][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10240.591878][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10240.592352][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [10240.592831][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10240.593290][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10240.593785][ C1] ? get_stack_info+0x36/0xc0 [10240.594172][ C1] ? lock_acquire+0x1c1/0x220 [10240.594557][ C1] ? lock_release+0x1d5/0x250 [10240.594948][ C1] do_raw_spin_lock+0x1ec/0x270 [10240.595343][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10240.595783][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10240.596262][ C1] ? lock_acquire+0x1c1/0x220 [10240.596667][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10240.597078][ C1] _raw_spin_lock_nested+0x65/0x80 [10240.597497][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10240.597876][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10240.598274][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10240.598687][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10240.599156][ C1] ip_local_deliver_finish+0x2ae/0x480 [10240.599613][ C1] ip_local_deliver+0x19d/0x480 [10240.600022][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10240.600456][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10240.600857][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10240.601415][ C1] ? rcu_read_lock_held+0xe/0x50 [10240.601817][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10240.602325][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10240.602764][ C1] ip_rcv+0x564/0x740 [10240.603104][ C1] ? __pfx_ip_rcv+0x10/0x10 [10240.603487][ C1] ? set_track_prepare+0x8a/0xd0 [10240.603907][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10240.604347][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10240.604789][ C1] ? skb_clone+0x10b/0x330 [10240.605152][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10240.605665][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10240.606137][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10240.606584][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10240.607040][ C1] ? __tcf_classify+0x329/0x7d0 [10240.607435][ C1] ? __pfx_ip_rcv+0x10/0x10 [10240.607793][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10240.608264][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10240.608706][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10240.609214][ C1] ? lock_acquire+0x1c1/0x220 [10240.609591][ C1] ? netif_receive_skb_internal+0x84/0x300 [10240.610059][ C1] netif_receive_skb_internal+0xb0/0x300 [10240.610505][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10240.611016][ C1] ? __copy_skb_header+0xaf/0x490 [10240.611443][ C1] ? __skb_clone+0x57a/0x760 [10240.611831][ C1] netif_receive_skb+0x55/0x280 [10240.612235][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10240.612735][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10240.613268][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10240.613745][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10240.614189][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10240.614654][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10240.615182][ C1] ? hlock_class+0x4e/0x130 [10240.615560][ C1] ? get_stack_info_noinstr+0x18/0x110 [10240.616016][ C1] ? get_stack_info_noinstr+0x18/0x110 [10240.616455][ C1] ? __pfx_validate_chain+0x10/0x10 [10240.616875][ C1] ? hlock_class+0x4e/0x130 [10240.617250][ C1] ? mark_lock+0x38/0x3e0 [10240.617600][ C1] ? stack_access_ok+0xda/0x1f0 [10240.618004][ C1] ? __lock_acquire+0xb67/0x1610 [10240.618411][ C1] ? get_stack_info_noinstr+0x18/0x110 [10240.618851][ C1] ? get_stack_info+0x36/0xc0 [10240.619244][ C1] ? stack_access_ok+0xda/0x1f0 [10240.619653][ C1] ? get_reg+0x119/0x190 [10240.620005][ C1] ? unwind_next_frame+0x12af/0x1d10 [10240.620445][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10240.620958][ C1] __tcf_classify+0x329/0x7d0 [10240.621356][ C1] tcf_classify+0x283/0x930 [10240.621722][ C1] ? arch_stack_walk+0xa2/0x100 [10240.622103][ C1] ? __pfx_tcf_classify+0x10/0x10 [10240.622506][ C1] ? get_stack_info+0x36/0xc0 [10240.622886][ C1] tc_run+0x2e4/0x5d0 [10240.623213][ C1] ? __pfx_tc_run+0x10/0x10 [10240.623576][ C1] ? lock_acquire+0x1c1/0x220 [10240.623953][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10240.624363][ C1] __dev_queue_xmit+0x686/0x17e0 [10240.624766][ C1] ? lock_acquire+0x1c1/0x220 [10240.625145][ C1] ? ip_finish_output2+0x786/0x18e0 [10240.625567][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10240.626052][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10240.626491][ C1] ? neigh_hh_output+0x348/0x590 [10240.626892][ C1] ? ip_finish_output2+0x262/0x18e0 [10240.627312][ C1] ip_finish_output2+0x786/0x18e0 [10240.627712][ C1] ? stack_depot_save_flags+0x45/0x550 [10240.628152][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10240.628703][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10240.629156][ C1] ? rcu_read_lock_held+0xe/0x50 [10240.629569][ C1] ? __ip_finish_output+0x10f/0x770 [10240.630008][ C1] ip_output+0x16b/0x4f0 [10240.630338][ C1] ? run_timer_softirq+0x72/0x100 [10240.630732][ C1] ? __pfx_ip_output+0x10/0x10 [10240.631115][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10240.631571][ C1] ? rcu_read_lock_held+0xe/0x50 [10240.631971][ C1] ? ip_local_out+0x114/0x3b0 [10240.632350][ C1] __ip_queue_xmit+0x672/0x1910 [10240.632739][ C1] ? __create_object+0x5e/0xb0 [10240.633132][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10240.633557][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10240.634005][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10240.634441][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10240.634893][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10240.635329][ C1] tcp_delack_timer+0x84/0x240 [10240.635724][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10240.636158][ C1] call_timer_fn+0x173/0x430 [10240.636535][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10240.636958][ C1] ? next_expiry_recalc+0xcd/0x220 [10240.637377][ C1] __run_timers.part.0+0x52d/0x890 [10240.637795][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10240.638256][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10240.638737][ C1] ? lock_acquire+0x1c1/0x220 [10240.639119][ C1] ? clockevents_program_event+0xf6/0x300 [10240.639587][ C1] ? lock_release+0x1d5/0x250 [10240.639965][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10240.640369][ C1] ? ktime_get+0xb3/0x190 [10240.640716][ C1] ? clockevents_program_event+0x1ea/0x300 [10240.641182][ C1] run_timer_softirq+0x72/0x100 [10240.641577][ C1] __do_softirq+0x1b9/0x7ff [10240.641954][ C1] irq_exit_rcu+0x98/0xc0 [10240.642312][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10240.642769][ C1] [10240.643022][ C1] [10240.643259][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10240.643743][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10240.644250][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10240.645777][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10240.646264][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10240.646884][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10240.647518][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10240.648148][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10240.648780][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10240.649421][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10240.649906][ C1] pipe_read+0xa16/0xdf0 [10240.650264][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10240.650703][ C1] ? __pfx_pipe_read+0x10/0x10 [10240.651090][ C1] ? iterate_tty_write+0x299/0x540 [10240.651515][ C1] ? lock_release+0x1d5/0x250 [10240.651898][ C1] vfs_read+0x911/0xc00 [10240.652234][ C1] ? lock_acquire+0x1c1/0x220 [10240.652608][ C1] ? __might_fault+0xc6/0x180 [10240.652987][ C1] ? __pfx_vfs_read+0x10/0x10 [10240.653358][ C1] ? __might_fault+0xc6/0x180 [10240.653736][ C1] ? lock_release+0x1d5/0x250 [10240.654120][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10240.654534][ C1] ? __fget_light+0x54/0x1e0 [10240.654912][ C1] ksys_read+0x17a/0x1e0 [10240.655255][ C1] ? __pfx_ksys_read+0x10/0x10 [10240.655643][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10240.656141][ C1] do_syscall_64+0xc9/0x1e0 [10240.656505][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10240.656986][ C1] RIP: 0033:0x7f08a1ea38b2 [10240.657344][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10240.658859][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10240.659496][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10240.660123][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10240.660760][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10240.661371][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10240.662007][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10240.662652][ C1] [10240.662925][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7346s! [swapper/2:0] [10240.663618][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10240.665672][ C2] irq event stamp: 44114564 [10240.666040][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10240.666879][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10240.667678][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10240.668447][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10240.669213][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10240.669937][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10240.670943][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10240.671627][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10240.673209][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10240.673715][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10240.674372][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10240.675024][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10240.675673][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10240.676317][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10240.676960][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10240.677687][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10240.678234][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10240.678887][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10240.679538][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10240.680211][ C2] PKRU: 55555554 [10240.680512][ C2] Call Trace: [10240.680808][ C2] [10240.681044][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10240.681492][ C2] ? __run_hrtimer+0x1c0/0x710 [10240.681881][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10240.682308][ C2] ? __hrtimer_run_queues+0x197/0x270 [10240.682742][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10240.683199][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10240.683628][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10240.684107][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10240.684530][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10240.684951][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10240.685451][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10240.685942][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10240.686461][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10240.686937][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10240.687411][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10240.687876][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10240.688383][ C2] ? get_stack_info+0x36/0xc0 [10240.688768][ C2] ? lock_acquire+0x1c1/0x220 [10240.689148][ C2] ? lock_release+0x1d5/0x250 [10240.689520][ C2] do_raw_spin_lock+0x1ec/0x270 [10240.689919][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10240.690360][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10240.690817][ C2] ? lock_acquire+0x1c1/0x220 [10240.691211][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10240.691612][ C2] _raw_spin_lock_nested+0x65/0x80 [10240.692036][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10240.692413][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10240.692810][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10240.693233][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10240.693684][ C2] ip_local_deliver_finish+0x2ae/0x480 [10240.694117][ C2] ip_local_deliver+0x19d/0x480 [10240.694493][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10240.694914][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10240.695331][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10240.695892][ C2] ? rcu_read_lock_held+0xe/0x50 [10240.696310][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10240.696829][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10240.697257][ C2] ip_rcv+0x564/0x740 [10240.697588][ C2] ? __pfx_ip_rcv+0x10/0x10 [10240.697970][ C2] ? set_track_prepare+0x8a/0xd0 [10240.698382][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10240.698835][ C2] ? start_secondary+0x21c/0x2b0 [10240.699270][ C2] ? skb_clone+0x10b/0x330 [10240.699661][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10240.700181][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10240.700682][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10240.701149][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10240.701639][ C2] ? __tcf_classify+0x329/0x7d0 [10240.702049][ C2] ? __pfx_ip_rcv+0x10/0x10 [10240.702423][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10240.702913][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10240.703380][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10240.703913][ C2] ? lock_acquire+0x1c1/0x220 [10240.704303][ C2] ? netif_receive_skb_internal+0x84/0x300 [10240.704778][ C2] netif_receive_skb_internal+0xb0/0x300 [10240.705245][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10240.705757][ C2] ? __copy_skb_header+0xaf/0x490 [10240.706173][ C2] ? __skb_clone+0x57a/0x760 [10240.706577][ C2] netif_receive_skb+0x55/0x280 [10240.706999][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10240.707505][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10240.708049][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10240.708532][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10240.708983][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10240.709461][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10240.709990][ C2] ? get_stack_info+0x36/0xc0 [10240.710398][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10240.710853][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10240.711372][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10240.711971][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10240.712429][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10240.712945][ C2] ? kernel_text_address+0x17/0xe0 [10240.713363][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10240.713875][ C2] ? arch_stack_walk+0x8c/0x100 [10240.714280][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10240.714734][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10240.715214][ C2] ? lock_acquire+0x1c1/0x220 [10240.715606][ C2] ? stack_depot_save_flags+0x281/0x550 [10240.716067][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10240.716538][ C2] ? get_stack_info_noinstr+0x18/0x110 [10240.716991][ C2] ? get_stack_info+0x36/0xc0 [10240.717383][ C2] __tcf_classify+0x329/0x7d0 [10240.717782][ C2] tcf_classify+0x283/0x930 [10240.718176][ C2] ? __pfx_tcf_classify+0x10/0x10 [10240.718596][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10240.719109][ C2] tc_run+0x2e4/0x5d0 [10240.719445][ C2] ? __pfx_tc_run+0x10/0x10 [10240.719822][ C2] ? lock_acquire+0x1c1/0x220 [10240.720216][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10240.720646][ C2] __dev_queue_xmit+0x686/0x17e0 [10240.721064][ C2] ? lock_acquire+0x1c1/0x220 [10240.721470][ C2] ? ip_finish_output2+0x786/0x18e0 [10240.721919][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10240.722422][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10240.722892][ C2] ? neigh_hh_output+0x348/0x590 [10240.723314][ C2] ? ip_finish_output2+0x262/0x18e0 [10240.723771][ C2] ip_finish_output2+0x786/0x18e0 [10240.724195][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10240.724749][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10240.725205][ C2] ? rcu_read_lock_held+0xe/0x50 [10240.725623][ C2] ? __ip_finish_output+0x10f/0x770 [10240.726059][ C2] ip_output+0x16b/0x4f0 [10240.726414][ C2] ? __pfx_ip_output+0x10/0x10 [10240.726814][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10240.727268][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10240.727764][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10240.728243][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10240.728669][ C2] ? __alloc_skb+0xd4/0x280 [10240.729063][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10240.729522][ C2] ? tcp_fragment+0x168/0x1040 [10240.729940][ C2] ? rcu_read_lock_held+0xe/0x50 [10240.730355][ C2] ? ip_local_out+0x114/0x3b0 [10240.730749][ C2] __ip_queue_xmit+0x672/0x1910 [10240.731152][ C2] ? __skb_clone+0x57a/0x760 [10240.731554][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10240.731989][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10240.732451][ C2] ? ipv4_dst_check+0xe3/0x170 [10240.732846][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10240.733248][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10240.733745][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10240.734275][ C2] ? tcp_fragment+0xb0e/0x1040 [10240.734675][ C2] tcp_send_loss_probe+0x348/0x830 [10240.735101][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10240.735535][ C2] tcp_write_timer+0x82/0x1d0 [10240.735914][ C2] call_timer_fn+0x173/0x430 [10240.736294][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10240.736721][ C2] ? next_expiry_recalc+0xcd/0x220 [10240.737146][ C2] __run_timers.part.0+0x52d/0x890 [10240.737571][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10240.738015][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10240.738480][ C2] ? lock_acquire+0x1c1/0x220 [10240.738879][ C2] ? clockevents_program_event+0xf6/0x300 [10240.739351][ C2] ? lock_release+0x1d5/0x250 [10240.739736][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10240.740174][ C2] ? ktime_get+0xb3/0x190 [10240.740538][ C2] ? clockevents_program_event+0x1ea/0x300 [10240.741021][ C2] run_timer_softirq+0x72/0x100 [10240.741436][ C2] __do_softirq+0x1b9/0x7ff [10240.741821][ C2] irq_exit_rcu+0x98/0xc0 [10240.742183][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10240.742648][ C2] [10240.742897][ C2] [10240.743145][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10240.743645][ C2] RIP: 0010:default_idle+0xf/0x20 [10240.744061][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10240.745643][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10240.746153][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10240.746809][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10240.747461][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10240.748115][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10240.748779][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10240.749449][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10240.749959][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10240.750394][ C2] default_idle_call+0x69/0xa0 [10240.750801][ C2] cpuidle_idle_call+0x1f6/0x280 [10240.751218][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10240.751819][ C2] ? lock_release+0x1d5/0x250 [10240.752210][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10240.752654][ C2] do_idle+0xfb/0x160 [10240.752984][ C2] cpu_startup_entry+0x55/0x60 [10240.753378][ C2] start_secondary+0x21c/0x2b0 [10240.753772][ C2] ? __pfx_start_secondary+0x10/0x10 [10240.754209][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10240.754715][ C2] [10264.806114][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10264.806704][ C1] rcu: 1-....: (7886960 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1853170 [10264.807581][ C1] rcu: (t=7909919 jiffies g=1882453 q=724 ncpus=4) [10264.808124][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10264.808832][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10264.809850][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10264.810378][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10264.831954][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10264.832445][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10264.833080][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10264.833735][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10264.834382][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10264.835019][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10264.835665][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10264.836376][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10264.836927][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10264.837574][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10264.838236][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10264.838892][ C1] PKRU: 55555554 [10264.839204][ C1] Call Trace: [10264.839478][ C1] [10264.839717][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10264.840161][ C1] ? print_cpu_stall+0x263/0x6a0 [10264.840560][ C1] ? check_cpu_stall+0x284/0x500 [10264.840962][ C1] ? rcu_pending+0x92/0x360 [10264.841347][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10264.841775][ C1] ? update_process_times+0xb9/0x110 [10264.842234][ C1] ? tick_sched_handle+0x67/0x130 [10264.842663][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10264.843137][ C1] ? __run_hrtimer+0x1c0/0x710 [10264.843516][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10264.844010][ C1] ? __hrtimer_run_queues+0x197/0x270 [10264.844450][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10264.844907][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10264.845327][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10264.845808][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10264.846246][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10264.846756][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10264.847246][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10264.847743][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10264.848196][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10264.848666][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10264.849126][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10264.849624][ C1] ? get_stack_info+0x36/0xc0 [10264.850023][ C1] ? lock_acquire+0x1c1/0x220 [10264.850414][ C1] ? lock_release+0x1d5/0x250 [10264.850803][ C1] do_raw_spin_lock+0x1ec/0x270 [10264.851208][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10264.871752][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10264.872235][ C1] ? lock_acquire+0x1c1/0x220 [10264.872635][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10264.873009][ C1] _raw_spin_lock_nested+0x65/0x80 [10264.873424][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10264.873799][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10264.874192][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10264.874606][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10264.875057][ C1] ip_local_deliver_finish+0x2ae/0x480 [10264.875513][ C1] ip_local_deliver+0x19d/0x480 [10264.875911][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10264.876349][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10264.876769][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10264.877329][ C1] ? rcu_read_lock_held+0xe/0x50 [10264.877737][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10264.878253][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10264.878678][ C1] ip_rcv+0x564/0x740 [10264.879021][ C1] ? __pfx_ip_rcv+0x10/0x10 [10264.879404][ C1] ? set_track_prepare+0x8a/0xd0 [10264.879817][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10264.880268][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10264.880721][ C1] ? skb_clone+0x10b/0x330 [10264.881099][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10264.881612][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10264.882084][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10264.882512][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10264.882981][ C1] ? __tcf_classify+0x329/0x7d0 [10264.883380][ C1] ? __pfx_ip_rcv+0x10/0x10 [10264.883741][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10264.884225][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10264.884668][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10264.885170][ C1] ? lock_acquire+0x1c1/0x220 [10264.885548][ C1] ? netif_receive_skb_internal+0x84/0x300 [10264.886013][ C1] netif_receive_skb_internal+0xb0/0x300 [10264.886459][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10264.886948][ C1] ? __copy_skb_header+0xaf/0x490 [10264.887346][ C1] ? __skb_clone+0x57a/0x760 [10264.887706][ C1] netif_receive_skb+0x55/0x280 [10264.888089][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10264.888564][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10264.889083][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10264.889537][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10264.889952][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10264.890395][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10264.890872][ C1] ? hlock_class+0x4e/0x130 [10264.891231][ C1] ? get_stack_info_noinstr+0x18/0x110 [10264.902000][ C1] ? get_stack_info_noinstr+0x18/0x110 [10264.902524][ C1] ? __pfx_validate_chain+0x10/0x10 [10264.903027][ C1] ? hlock_class+0x4e/0x130 [10264.903461][ C1] ? mark_lock+0x38/0x3e0 [10264.903864][ C1] ? stack_access_ok+0xda/0x1f0 [10264.904334][ C1] ? __lock_acquire+0xb67/0x1610 [10264.904830][ C1] ? get_stack_info_noinstr+0x18/0x110 [10264.905302][ C1] ? get_stack_info+0x36/0xc0 [10264.905656][ C1] ? stack_access_ok+0xda/0x1f0 [10264.906029][ C1] ? get_reg+0x119/0x190 [10264.906351][ C1] ? unwind_next_frame+0x12af/0x1d10 [10264.906747][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10264.907209][ C1] __tcf_classify+0x329/0x7d0 [10264.907575][ C1] tcf_classify+0x283/0x930 [10264.908007][ C1] ? arch_stack_walk+0xa2/0x100 [10264.908491][ C1] ? __pfx_tcf_classify+0x10/0x10 [10264.908987][ C1] ? get_stack_info+0x36/0xc0 [10264.909454][ C1] tc_run+0x2e4/0x5d0 [10264.909859][ C1] ? __pfx_tc_run+0x10/0x10 [10264.910317][ C1] ? lock_acquire+0x1c1/0x220 [10264.910764][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10264.911249][ C1] __dev_queue_xmit+0x686/0x17e0 [10264.931769][ C1] ? lock_acquire+0x1c1/0x220 [10264.932123][ C1] ? ip_finish_output2+0x786/0x18e0 [10264.932503][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10264.932930][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10264.933333][ C1] ? neigh_hh_output+0x348/0x590 [10264.933717][ C1] ? ip_finish_output2+0x262/0x18e0 [10264.934132][ C1] ip_finish_output2+0x786/0x18e0 [10264.934534][ C1] ? stack_depot_save_flags+0x45/0x550 [10264.934993][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10264.935551][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10264.936014][ C1] ? rcu_read_lock_held+0xe/0x50 [10264.936428][ C1] ? __ip_finish_output+0x10f/0x770 [10264.936854][ C1] ip_output+0x16b/0x4f0 [10264.937209][ C1] ? run_timer_softirq+0x72/0x100 [10264.937619][ C1] ? __pfx_ip_output+0x10/0x10 [10264.937994][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10264.938439][ C1] ? rcu_read_lock_held+0xe/0x50 [10264.938831][ C1] ? ip_local_out+0x114/0x3b0 [10264.939206][ C1] __ip_queue_xmit+0x672/0x1910 [10264.939600][ C1] ? __create_object+0x5e/0xb0 [10264.939977][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10264.940404][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10264.940845][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10264.941286][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10264.941732][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10264.942161][ C1] tcp_delack_timer+0x84/0x240 [10264.942544][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10264.942969][ C1] call_timer_fn+0x173/0x430 [10264.943351][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10264.943761][ C1] ? next_expiry_recalc+0xcd/0x220 [10264.944190][ C1] __run_timers.part.0+0x52d/0x890 [10264.944617][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10264.945067][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10264.945532][ C1] ? lock_acquire+0x1c1/0x220 [10264.945921][ C1] ? clockevents_program_event+0xf6/0x300 [10264.946398][ C1] ? lock_release+0x1d5/0x250 [10264.946784][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10264.947212][ C1] ? ktime_get+0xb3/0x190 [10264.947563][ C1] ? clockevents_program_event+0x1ea/0x300 [10264.948029][ C1] run_timer_softirq+0x72/0x100 [10264.948420][ C1] __do_softirq+0x1b9/0x7ff [10264.948782][ C1] irq_exit_rcu+0x98/0xc0 [10264.949125][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10264.949578][ C1] [10264.949817][ C1] [10264.950053][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10264.950527][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10264.951029][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10264.972914][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10264.973416][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10264.974032][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10264.974900][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10264.975909][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10264.976482][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10264.977155][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10264.977705][ C1] pipe_read+0xa16/0xdf0 [10264.978118][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10264.978637][ C1] ? __pfx_pipe_read+0x10/0x10 [10264.979092][ C1] ? iterate_tty_write+0x299/0x540 [10264.979584][ C1] ? lock_release+0x1d5/0x250 [10264.980018][ C1] vfs_read+0x911/0xc00 [10264.980421][ C1] ? lock_acquire+0x1c1/0x220 [10264.980878][ C1] ? __might_fault+0xc6/0x180 [10264.981342][ C1] ? __pfx_vfs_read+0x10/0x10 [10264.981739][ C1] ? __might_fault+0xc6/0x180 [10264.982117][ C1] ? lock_release+0x1d5/0x250 [10264.982505][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10264.982927][ C1] ? __fget_light+0x54/0x1e0 [10264.983306][ C1] ksys_read+0x17a/0x1e0 [10264.983651][ C1] ? __pfx_ksys_read+0x10/0x10 [10264.984040][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10264.984526][ C1] do_syscall_64+0xc9/0x1e0 [10264.984890][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10264.985373][ C1] RIP: 0033:0x7f08a1ea38b2 [10264.985731][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10264.987329][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10264.987994][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10264.988625][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10264.989263][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10264.989885][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10264.990515][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10264.991190][ C1] [10265.031640][ C1] Sending NMI from CPU 1 to CPUs 2: [10265.045439][ C2] NMI backtrace for cpu 2 [10265.045468][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10265.045480][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10265.045485][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10265.045501][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10265.045506][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10265.045513][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10265.045516][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10265.045519][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10265.045522][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10265.045525][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10265.045528][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10265.045532][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10265.045537][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10265.045541][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10265.045543][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10265.045546][ C2] PKRU: 55555554 [10265.045548][ C2] Call Trace: [10265.045555][ C2] [10265.045562][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10265.045575][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10265.045585][ C2] ? nmi_handle+0x153/0x420 [10265.045594][ C2] ? default_do_nmi+0x41/0x100 [10265.045600][ C2] ? exc_nmi+0xf3/0x120 [10265.045605][ C2] ? end_repeat_nmi+0xf/0x60 [10265.045616][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10265.045621][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10265.045627][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10265.045633][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10265.045639][ C2] [10265.045640][ C2] [10265.045643][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10265.045648][ C2] ? get_stack_info+0x36/0xc0 [10265.045656][ C2] ? lock_acquire+0x1c1/0x220 [10265.045664][ C2] ? lock_release+0x1d5/0x250 [10265.045670][ C2] do_raw_spin_lock+0x1ec/0x270 [10265.045678][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10265.045684][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10265.045690][ C2] ? lock_acquire+0x1c1/0x220 [10265.045694][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10265.045703][ C2] _raw_spin_lock_nested+0x65/0x80 [10265.045708][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10265.045721][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10265.045726][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10265.045736][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10265.045749][ C2] ip_local_deliver_finish+0x2ae/0x480 [10265.045755][ C2] ip_local_deliver+0x19d/0x480 [10265.045760][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10265.045763][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10265.045767][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10265.045778][ C2] ? rcu_read_lock_held+0xe/0x50 [10265.045787][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10265.045792][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10265.045812][ C2] ip_rcv+0x564/0x740 [10265.045817][ C2] ? __pfx_ip_rcv+0x10/0x10 [10265.045821][ C2] ? set_track_prepare+0x8a/0xd0 [10265.045829][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10265.045834][ C2] ? start_secondary+0x21c/0x2b0 [10265.045841][ C2] ? skb_clone+0x10b/0x330 [10265.045848][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10265.045860][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10265.045870][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10265.045878][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10265.045894][ C2] ? __tcf_classify+0x329/0x7d0 [10265.045901][ C2] ? __pfx_ip_rcv+0x10/0x10 [10265.045905][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10265.045911][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10265.045917][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10265.045923][ C2] ? lock_acquire+0x1c1/0x220 [10265.045927][ C2] ? netif_receive_skb_internal+0x84/0x300 [10265.045935][ C2] netif_receive_skb_internal+0xb0/0x300 [10265.045941][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10265.045948][ C2] ? __copy_skb_header+0xaf/0x490 [10265.045957][ C2] ? __skb_clone+0x57a/0x760 [10265.045961][ C2] netif_receive_skb+0x55/0x280 [10265.045967][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10265.045981][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10265.045995][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10265.046008][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10265.046017][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10265.046035][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10265.046049][ C2] ? get_stack_info+0x36/0xc0 [10265.046058][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10265.046064][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10265.046073][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10265.046078][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10265.046085][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10265.046089][ C2] ? kernel_text_address+0x17/0xe0 [10265.046095][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10265.046104][ C2] ? arch_stack_walk+0x8c/0x100 [10265.046111][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10265.046116][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10265.046122][ C2] ? lock_acquire+0x1c1/0x220 [10265.046127][ C2] ? stack_depot_save_flags+0x281/0x550 [10265.046136][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10265.046146][ C2] ? get_stack_info_noinstr+0x18/0x110 [10265.046151][ C2] ? get_stack_info+0x36/0xc0 [10265.046159][ C2] __tcf_classify+0x329/0x7d0 [10265.046168][ C2] tcf_classify+0x283/0x930 [10265.046177][ C2] ? __pfx_tcf_classify+0x10/0x10 [10265.046182][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10265.046191][ C2] tc_run+0x2e4/0x5d0 [10265.046198][ C2] ? __pfx_tc_run+0x10/0x10 [10265.046204][ C2] ? lock_acquire+0x1c1/0x220 [10265.046208][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10265.046215][ C2] __dev_queue_xmit+0x686/0x17e0 [10265.046223][ C2] ? lock_acquire+0x1c1/0x220 [10265.046227][ C2] ? ip_finish_output2+0x786/0x18e0 [10265.046233][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10265.046238][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10265.046242][ C2] ? neigh_hh_output+0x348/0x590 [10265.046248][ C2] ? ip_finish_output2+0x262/0x18e0 [10265.046255][ C2] ip_finish_output2+0x786/0x18e0 [10265.046262][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10265.046274][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10265.046278][ C2] ? rcu_read_lock_held+0xe/0x50 [10265.046285][ C2] ? __ip_finish_output+0x10f/0x770 [10265.046292][ C2] ip_output+0x16b/0x4f0 [10265.046297][ C2] ? __pfx_ip_output+0x10/0x10 [10265.046302][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10265.046307][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10265.046312][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10265.046318][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10265.046323][ C2] ? __alloc_skb+0xd4/0x280 [10265.046327][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10265.046334][ C2] ? tcp_fragment+0x168/0x1040 [10265.046341][ C2] ? rcu_read_lock_held+0xe/0x50 [10265.046346][ C2] ? ip_local_out+0x114/0x3b0 [10265.046353][ C2] __ip_queue_xmit+0x672/0x1910 [10265.046359][ C2] ? __skb_clone+0x57a/0x760 [10265.046365][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10265.046376][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10265.046382][ C2] ? ipv4_dst_check+0xe3/0x170 [10265.046390][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10265.046399][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10265.046408][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10265.046414][ C2] ? tcp_fragment+0xb0e/0x1040 [10265.046421][ C2] tcp_send_loss_probe+0x348/0x830 [10265.046427][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10265.046432][ C2] tcp_write_timer+0x82/0x1d0 [10265.046438][ C2] call_timer_fn+0x173/0x430 [10265.046447][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10265.046455][ C2] ? next_expiry_recalc+0xcd/0x220 [10265.046462][ C2] __run_timers.part.0+0x52d/0x890 [10265.046468][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10265.046475][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10265.046481][ C2] ? lock_acquire+0x1c1/0x220 [10265.046485][ C2] ? clockevents_program_event+0xf6/0x300 [10265.046495][ C2] ? lock_release+0x1d5/0x250 [10265.046500][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10265.046508][ C2] ? ktime_get+0xb3/0x190 [10265.046515][ C2] ? clockevents_program_event+0x1ea/0x300 [10265.046523][ C2] run_timer_softirq+0x72/0x100 [10265.046529][ C2] __do_softirq+0x1b9/0x7ff [10265.046538][ C2] irq_exit_rcu+0x98/0xc0 [10265.046543][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10265.046550][ C2] [10265.046552][ C2] [10265.046554][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10265.046561][ C2] RIP: 0010:default_idle+0xf/0x20 [10265.046568][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10265.046573][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10265.046578][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10265.046582][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10265.046585][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10265.046587][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10265.046590][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10265.046597][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10265.046602][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10265.046609][ C2] default_idle_call+0x69/0xa0 [10265.046615][ C2] cpuidle_idle_call+0x1f6/0x280 [10265.046619][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10265.046627][ C2] ? lock_release+0x1d5/0x250 [10265.046632][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10265.046639][ C2] do_idle+0xfb/0x160 [10265.046644][ C2] cpu_startup_entry+0x55/0x60 [10265.046648][ C2] start_secondary+0x21c/0x2b0 [10265.046654][ C2] ? __pfx_start_secondary+0x10/0x10 [10265.046661][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10265.046673][ C2] [10292.611224][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7394s! [swapper/2:0] [10292.611962][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10292.613959][ C2] irq event stamp: 44114564 [10292.614327][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10292.615179][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10292.615988][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10292.616740][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10292.617482][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10292.618205][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10292.619161][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10292.619673][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10292.691303][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10292.691737][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10292.692299][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10292.692875][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10292.693509][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10292.694145][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10292.694776][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10292.695481][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10292.696011][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10292.696655][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10292.697287][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10292.697921][ C2] PKRU: 55555554 [10292.698210][ C2] Call Trace: [10292.698486][ C2] [10292.698724][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10292.699145][ C2] ? __run_hrtimer+0x1c0/0x710 [10292.699527][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10292.699972][ C2] ? __hrtimer_run_queues+0x197/0x270 [10292.700411][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10292.700873][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10292.771411][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10292.771906][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10292.772299][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10292.772700][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10292.773182][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10292.773655][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10292.774161][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10292.774624][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10292.775089][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10292.775548][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10292.776040][ C2] ? get_stack_info+0x36/0xc0 [10292.776430][ C2] ? lock_acquire+0x1c1/0x220 [10292.776809][ C2] ? lock_release+0x1d5/0x250 [10292.777204][ C2] do_raw_spin_lock+0x1ec/0x270 [10292.777587][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10292.778017][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10292.778468][ C2] ? lock_acquire+0x1c1/0x220 [10292.778845][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10292.779230][ C2] _raw_spin_lock_nested+0x65/0x80 [10292.779649][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10292.780027][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10292.780428][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10292.780830][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10292.806373][ C2] ip_local_deliver_finish+0x2ae/0x480 [10292.806837][ C2] ip_local_deliver+0x19d/0x480 [10292.807243][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10292.807686][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10292.808108][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10292.808664][ C2] ? rcu_read_lock_held+0xe/0x50 [10292.809075][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10292.809590][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10292.810016][ C2] ip_rcv+0x564/0x740 [10292.810345][ C2] ? __pfx_ip_rcv+0x10/0x10 [10292.810715][ C2] ? set_track_prepare+0x8a/0xd0 [10292.811124][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10292.828689][ C2] ? start_secondary+0x21c/0x2b0 [10292.829106][ C2] ? skb_clone+0x10b/0x330 [10292.829471][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10292.829976][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10292.830471][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10292.830929][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10292.831394][ C2] ? __tcf_classify+0x329/0x7d0 [10292.831804][ C2] ? __pfx_ip_rcv+0x10/0x10 [10292.832184][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10292.832676][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10292.833152][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10292.833674][ C2] ? lock_acquire+0x1c1/0x220 [10292.834064][ C2] ? netif_receive_skb_internal+0x84/0x300 [10292.834549][ C2] netif_receive_skb_internal+0xb0/0x300 [10292.835028][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10292.835548][ C2] ? __copy_skb_header+0xaf/0x490 [10292.835974][ C2] ? __skb_clone+0x57a/0x760 [10292.836355][ C2] netif_receive_skb+0x55/0x280 [10292.836763][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10292.837278][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10292.837826][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10292.838323][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10292.838782][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10292.839253][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10292.839758][ C2] ? get_stack_info+0x36/0xc0 [10292.840156][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10292.840592][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10292.841116][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10292.981665][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10292.982137][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10292.982660][ C2] ? kernel_text_address+0x17/0xe0 [10292.983092][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10292.983601][ C2] ? arch_stack_walk+0x8c/0x100 [10292.984004][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10292.984439][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10292.984906][ C2] ? lock_acquire+0x1c1/0x220 [10292.985303][ C2] ? stack_depot_save_flags+0x281/0x550 [10292.985765][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10292.986271][ C2] ? get_stack_info_noinstr+0x18/0x110 [10292.986725][ C2] ? get_stack_info+0x36/0xc0 [10292.987128][ C2] __tcf_classify+0x329/0x7d0 [10292.987534][ C2] tcf_classify+0x283/0x930 [10292.987914][ C2] ? __pfx_tcf_classify+0x10/0x10 [10292.988336][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10292.988847][ C2] tc_run+0x2e4/0x5d0 [10292.989187][ C2] ? __pfx_tc_run+0x10/0x10 [10292.989555][ C2] ? lock_acquire+0x1c1/0x220 [10292.989946][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10292.990375][ C2] __dev_queue_xmit+0x686/0x17e0 [10292.990785][ C2] ? lock_acquire+0x1c1/0x220 [10293.033794][ C2] ? ip_finish_output2+0x786/0x18e0 [10293.034247][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10293.034749][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10293.035201][ C2] ? neigh_hh_output+0x348/0x590 [10293.035618][ C2] ? ip_finish_output2+0x262/0x18e0 [10293.036056][ C2] ip_finish_output2+0x786/0x18e0 [10293.036482][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10293.037042][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10293.037493][ C2] ? rcu_read_lock_held+0xe/0x50 [10293.037912][ C2] ? __ip_finish_output+0x10f/0x770 [10293.038356][ C2] ip_output+0x16b/0x4f0 [10293.038721][ C2] ? __pfx_ip_output+0x10/0x10 [10293.039125][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10293.039580][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10293.040097][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10293.040553][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10293.040965][ C2] ? __alloc_skb+0xd4/0x280 [10293.066718][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10293.067172][ C2] ? tcp_fragment+0x168/0x1040 [10293.067559][ C2] ? rcu_read_lock_held+0xe/0x50 [10293.067969][ C2] ? ip_local_out+0x114/0x3b0 [10293.068361][ C2] __ip_queue_xmit+0x672/0x1910 [10293.068763][ C2] ? __skb_clone+0x57a/0x760 [10293.069156][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10293.069603][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10293.070066][ C2] ? ipv4_dst_check+0xe3/0x170 [10293.070469][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10293.070879][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10293.111479][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10293.112024][ C2] ? tcp_fragment+0xb0e/0x1040 [10293.112436][ C2] tcp_send_loss_probe+0x348/0x830 [10293.112869][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10293.113317][ C2] tcp_write_timer+0x82/0x1d0 [10293.113720][ C2] call_timer_fn+0x173/0x430 [10293.114120][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10293.114559][ C2] ? next_expiry_recalc+0xcd/0x220 [10293.115000][ C2] __run_timers.part.0+0x52d/0x890 [10293.115416][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10293.115871][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10293.116355][ C2] ? lock_acquire+0x1c1/0x220 [10293.116765][ C2] ? clockevents_program_event+0xf6/0x300 [10293.117248][ C2] ? lock_release+0x1d5/0x250 [10293.117642][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10293.118085][ C2] ? ktime_get+0xb3/0x190 [10293.118454][ C2] ? clockevents_program_event+0x1ea/0x300 [10293.118942][ C2] run_timer_softirq+0x72/0x100 [10293.119363][ C2] __do_softirq+0x1b9/0x7ff [10293.119754][ C2] irq_exit_rcu+0x98/0xc0 [10293.120122][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10293.120592][ C2] [10293.120840][ C2] [10293.121090][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10293.201693][ C2] RIP: 0010:default_idle+0xf/0x20 [10293.202130][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10293.203699][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10293.204207][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10293.204851][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10293.205500][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10293.206143][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10293.206788][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10293.207453][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10293.207930][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10293.208359][ C2] default_idle_call+0x69/0xa0 [10293.208754][ C2] cpuidle_idle_call+0x1f6/0x280 [10293.209162][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10293.209605][ C2] ? lock_release+0x1d5/0x250 [10293.209997][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10293.210439][ C2] do_idle+0xfb/0x160 [10293.210772][ C2] cpu_startup_entry+0x55/0x60 [10293.249282][ C2] start_secondary+0x21c/0x2b0 [10293.249679][ C2] ? __pfx_start_secondary+0x10/0x10 [10293.250116][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10293.250641][ C2] [10293.250948][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7394s! [perl:4135] [10293.251634][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10293.253695][ C1] irq event stamp: 209232 [10293.254057][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10293.254911][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10293.255687][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10293.256435][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10293.257170][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10293.257904][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10293.258960][ C1] RIP: 0010:kasan_check_range+0x4/0x1c0 [10293.259442][ C1] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [10293.261077][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000246 [10293.310311][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10293.310943][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10293.361665][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10293.362305][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10293.362957][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10293.363598][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10293.364315][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10293.364856][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10293.365533][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10293.366204][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10293.366846][ C1] PKRU: 55555554 [10293.367139][ C1] Call Trace: [10293.367417][ C1] [10293.367659][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10293.368100][ C1] ? __run_hrtimer+0x1c0/0x710 [10293.368485][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10293.368945][ C1] ? __hrtimer_run_queues+0x197/0x270 [10293.369387][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10293.369871][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10293.370315][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10293.370821][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10293.411337][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10293.411830][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10293.412312][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10293.412817][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10293.413289][ C1] ? kasan_check_range+0x4/0x1c0 [10293.413703][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10293.414160][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10293.414661][ C1] ? get_stack_info+0x36/0xc0 [10293.415051][ C1] ? lock_acquire+0x1c1/0x220 [10293.415438][ C1] ? lock_release+0x1d5/0x250 [10293.415842][ C1] do_raw_spin_lock+0x1ec/0x270 [10293.416254][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10293.416703][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10293.417174][ C1] ? lock_acquire+0x1c1/0x220 [10293.417576][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10293.417988][ C1] _raw_spin_lock_nested+0x65/0x80 [10293.418399][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10293.418779][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10293.419169][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10293.419587][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10293.420029][ C1] ip_local_deliver_finish+0x2ae/0x480 [10293.420472][ C1] ip_local_deliver+0x19d/0x480 [10293.420874][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10293.547409][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10293.547848][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10293.548449][ C1] ? rcu_read_lock_held+0xe/0x50 [10293.548844][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10293.549404][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10293.549800][ C1] ip_rcv+0x564/0x740 [10293.550166][ C1] ? __pfx_ip_rcv+0x10/0x10 [10293.550530][ C1] ? set_track_prepare+0x8a/0xd0 [10293.550926][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10293.551408][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10293.552048][ C1] ? skb_clone+0x10b/0x330 [10293.552639][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10293.553338][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10293.554026][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10293.579635][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10293.585233][ C1] ? __tcf_classify+0x329/0x7d0 [10293.585635][ C1] ? __pfx_ip_rcv+0x10/0x10 [10293.585998][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10293.591563][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10293.592028][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10293.597646][ C1] ? lock_acquire+0x1c1/0x220 [10293.598047][ C1] ? netif_receive_skb_internal+0x84/0x300 [10293.621758][ C1] netif_receive_skb_internal+0xb0/0x300 [10293.622368][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10293.622829][ C1] ? __copy_skb_header+0xaf/0x490 [10293.623237][ C1] ? __skb_clone+0x57a/0x760 [10293.623584][ C1] netif_receive_skb+0x55/0x280 [10293.623953][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10293.624480][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10293.625068][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10293.625677][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10293.665305][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10293.665783][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10293.666332][ C1] ? hlock_class+0x4e/0x130 [10293.666709][ C1] ? get_stack_info_noinstr+0x18/0x110 [10293.667194][ C1] ? get_stack_info_noinstr+0x18/0x110 [10293.667635][ C1] ? __pfx_validate_chain+0x10/0x10 [10293.668051][ C1] ? hlock_class+0x4e/0x130 [10293.668470][ C1] ? mark_lock+0x38/0x3e0 [10293.668847][ C1] ? stack_access_ok+0xda/0x1f0 [10293.669322][ C1] ? __lock_acquire+0xb67/0x1610 [10293.669741][ C1] ? get_stack_info_noinstr+0x18/0x110 [10293.691363][ C1] ? get_stack_info+0x36/0xc0 [10293.691833][ C1] ? stack_access_ok+0xda/0x1f0 [10293.692324][ C1] ? get_reg+0x119/0x190 [10293.692707][ C1] ? unwind_next_frame+0x12af/0x1d10 [10293.693230][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10293.693780][ C1] __tcf_classify+0x329/0x7d0 [10293.694290][ C1] tcf_classify+0x283/0x930 [10293.694704][ C1] ? arch_stack_walk+0xa2/0x100 [10293.723265][ C1] ? __pfx_tcf_classify+0x10/0x10 [10293.723681][ C1] ? get_stack_info+0x36/0xc0 [10293.724065][ C1] tc_run+0x2e4/0x5d0 [10293.724452][ C1] ? __pfx_tc_run+0x10/0x10 [10293.724836][ C1] ? lock_acquire+0x1c1/0x220 [10293.725258][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10293.725674][ C1] __dev_queue_xmit+0x686/0x17e0 [10293.726079][ C1] ? lock_acquire+0x1c1/0x220 [10293.726500][ C1] ? ip_finish_output2+0x786/0x18e0 [10293.726909][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10293.727421][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10293.727851][ C1] ? neigh_hh_output+0x348/0x590 [10293.751428][ C1] ? ip_finish_output2+0x262/0x18e0 [10293.751961][ C1] ip_finish_output2+0x786/0x18e0 [10293.752487][ C1] ? stack_depot_save_flags+0x45/0x550 [10293.753016][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10293.753611][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10293.754167][ C1] ? rcu_read_lock_held+0xe/0x50 [10293.754662][ C1] ? __ip_finish_output+0x10f/0x770 [10293.755226][ C1] ip_output+0x16b/0x4f0 [10293.755645][ C1] ? run_timer_softirq+0x72/0x100 [10293.756098][ C1] ? __pfx_ip_output+0x10/0x10 [10293.795594][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10293.796053][ C1] ? rcu_read_lock_held+0xe/0x50 [10293.796494][ C1] ? ip_local_out+0x114/0x3b0 [10293.796893][ C1] __ip_queue_xmit+0x672/0x1910 [10293.797334][ C1] ? __create_object+0x5e/0xb0 [10293.797744][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10293.798207][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10293.798655][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10293.799093][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10293.799624][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10293.800069][ C1] tcp_delack_timer+0x84/0x240 [10293.822528][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10293.822939][ C1] call_timer_fn+0x173/0x430 [10293.829408][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10293.829785][ C1] ? next_expiry_recalc+0xcd/0x220 [10293.834278][ C1] __run_timers.part.0+0x52d/0x890 [10293.834692][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10293.840247][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10293.840717][ C1] ? lock_acquire+0x1c1/0x220 [10293.841091][ C1] ? clockevents_program_event+0xf6/0x300 [10293.844682][ C1] ? lock_release+0x1d5/0x250 [10293.845097][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10293.850629][ C1] ? ktime_get+0xb3/0x190 [10293.850990][ C1] ? clockevents_program_event+0x1ea/0x300 [10293.855631][ C1] run_timer_softirq+0x72/0x100 [10293.860164][ C1] __do_softirq+0x1b9/0x7ff [10293.860643][ C1] irq_exit_rcu+0x98/0xc0 [10293.861040][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10293.865617][ C1] [10293.865871][ C1] [10293.870234][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10293.870733][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10293.875353][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10293.880947][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10293.885571][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10293.890330][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10293.891010][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10293.903881][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10293.908773][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10293.912568][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10293.913035][ C1] pipe_read+0xa16/0xdf0 [10293.916507][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10293.916981][ C1] ? __pfx_pipe_read+0x10/0x10 [10293.921491][ C1] ? iterate_tty_write+0x299/0x540 [10293.921931][ C1] ? lock_release+0x1d5/0x250 [10293.927459][ C1] vfs_read+0x911/0xc00 [10293.927830][ C1] ? lock_acquire+0x1c1/0x220 [10293.933311][ C1] ? __might_fault+0xc6/0x180 [10293.933708][ C1] ? __pfx_vfs_read+0x10/0x10 [10293.934091][ C1] ? __might_fault+0xc6/0x180 [10293.934550][ C1] ? lock_release+0x1d5/0x250 [10293.934943][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10293.951668][ C1] ? __fget_light+0x54/0x1e0 [10293.952052][ C1] ksys_read+0x17a/0x1e0 [10293.952407][ C1] ? __pfx_ksys_read+0x10/0x10 [10293.952767][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10293.953276][ C1] do_syscall_64+0xc9/0x1e0 [10293.953628][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10293.954086][ C1] RIP: 0033:0x7f08a1ea38b2 [10293.954507][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10293.955911][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10293.978861][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10293.979582][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10293.980282][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10293.980942][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10293.981626][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10293.982329][ C1] [10320.571077][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7420s! [perl:4135] [10320.571843][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10320.573821][ C1] irq event stamp: 209232 [10320.574185][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10320.575020][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10320.575786][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10320.576529][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10320.577242][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10320.577944][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10320.578930][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10320.579447][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10320.580980][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10320.621592][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10320.622165][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10320.622753][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10320.623378][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10320.624030][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10320.624650][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10320.625332][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10320.625859][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10320.626487][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10320.627108][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10320.627721][ C1] PKRU: 55555554 [10320.628026][ C1] Call Trace: [10320.628302][ C1] [10320.628540][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10320.628961][ C1] ? __run_hrtimer+0x1c0/0x710 [10320.629354][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10320.629801][ C1] ? __hrtimer_run_queues+0x197/0x270 [10320.630247][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10320.630718][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10320.721244][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10320.721728][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10320.722146][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10320.722637][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10320.723108][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10320.723594][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10320.724041][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10320.724495][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10320.724945][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10320.725415][ C1] ? get_stack_info+0x36/0xc0 [10320.725783][ C1] ? lock_acquire+0x1c1/0x220 [10320.726152][ C1] ? lock_release+0x1d5/0x250 [10320.726531][ C1] do_raw_spin_lock+0x1ec/0x270 [10320.726922][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10320.727349][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10320.727791][ C1] ? lock_acquire+0x1c1/0x220 [10320.728170][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10320.728547][ C1] _raw_spin_lock_nested+0x65/0x80 [10320.728958][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10320.729319][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10320.729706][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10320.730107][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10320.730538][ C1] ip_local_deliver_finish+0x2ae/0x480 [10320.730966][ C1] ip_local_deliver+0x19d/0x480 [10320.791464][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10320.791915][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10320.792337][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10320.792918][ C1] ? rcu_read_lock_held+0xe/0x50 [10320.793320][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10320.793846][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10320.794279][ C1] ip_rcv+0x564/0x740 [10320.794615][ C1] ? __pfx_ip_rcv+0x10/0x10 [10320.794986][ C1] ? set_track_prepare+0x8a/0xd0 [10320.795403][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10320.795854][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10320.796321][ C1] ? skb_clone+0x10b/0x330 [10320.796710][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10320.797253][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10320.797770][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10320.798243][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10320.798726][ C1] ? __tcf_classify+0x329/0x7d0 [10320.799132][ C1] ? __pfx_ip_rcv+0x10/0x10 [10320.799508][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10320.800024][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10320.800504][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10320.861366][ C1] ? lock_acquire+0x1c1/0x220 [10320.861766][ C1] ? netif_receive_skb_internal+0x84/0x300 [10320.862237][ C1] netif_receive_skb_internal+0xb0/0x300 [10320.862690][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10320.863340][ C1] ? __copy_skb_header+0xaf/0x490 [10320.863762][ C1] ? __skb_clone+0x57a/0x760 [10320.864147][ C1] netif_receive_skb+0x55/0x280 [10320.864553][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10320.865054][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10320.865601][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10320.866124][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10320.866597][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10320.867092][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10320.867620][ C1] ? hlock_class+0x4e/0x130 [10320.868015][ C1] ? get_stack_info_noinstr+0x18/0x110 [10320.868481][ C1] ? get_stack_info_noinstr+0x18/0x110 [10320.868947][ C1] ? __pfx_validate_chain+0x10/0x10 [10320.869397][ C1] ? hlock_class+0x4e/0x130 [10320.869799][ C1] ? mark_lock+0x38/0x3e0 [10320.870159][ C1] ? stack_access_ok+0xda/0x1f0 [10320.870568][ C1] ? __lock_acquire+0xb67/0x1610 [10320.870985][ C1] ? get_stack_info_noinstr+0x18/0x110 [10320.911519][ C1] ? get_stack_info+0x36/0xc0 [10320.911910][ C1] ? stack_access_ok+0xda/0x1f0 [10320.912305][ C1] ? get_reg+0x119/0x190 [10320.912649][ C1] ? unwind_next_frame+0x12af/0x1d10 [10320.913091][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10320.913577][ C1] __tcf_classify+0x329/0x7d0 [10320.913954][ C1] tcf_classify+0x283/0x930 [10320.914306][ C1] ? arch_stack_walk+0xa2/0x100 [10320.914697][ C1] ? __pfx_tcf_classify+0x10/0x10 [10320.915114][ C1] ? get_stack_info+0x36/0xc0 [10320.915501][ C1] tc_run+0x2e4/0x5d0 [10320.915841][ C1] ? __pfx_tc_run+0x10/0x10 [10320.916212][ C1] ? lock_acquire+0x1c1/0x220 [10320.916598][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10320.917021][ C1] __dev_queue_xmit+0x686/0x17e0 [10320.917426][ C1] ? lock_acquire+0x1c1/0x220 [10320.917803][ C1] ? ip_finish_output2+0x786/0x18e0 [10320.918236][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10320.918727][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10320.919163][ C1] ? neigh_hh_output+0x348/0x590 [10320.919567][ C1] ? ip_finish_output2+0x262/0x18e0 [10320.920001][ C1] ip_finish_output2+0x786/0x18e0 [10320.920399][ C1] ? stack_depot_save_flags+0x45/0x550 [10320.920829][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10321.011475][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10321.011924][ C1] ? rcu_read_lock_held+0xe/0x50 [10321.012327][ C1] ? __ip_finish_output+0x10f/0x770 [10321.012747][ C1] ip_output+0x16b/0x4f0 [10321.013108][ C1] ? run_timer_softirq+0x72/0x100 [10321.013530][ C1] ? __pfx_ip_output+0x10/0x10 [10321.013935][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10321.014391][ C1] ? rcu_read_lock_held+0xe/0x50 [10321.014809][ C1] ? ip_local_out+0x114/0x3b0 [10321.015200][ C1] __ip_queue_xmit+0x672/0x1910 [10321.015606][ C1] ? __create_object+0x5e/0xb0 [10321.016001][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10321.016436][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10321.016903][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10321.017329][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10321.017773][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10321.018208][ C1] tcp_delack_timer+0x84/0x240 [10321.018594][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10321.019048][ C1] call_timer_fn+0x173/0x430 [10321.019436][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10321.019864][ C1] ? next_expiry_recalc+0xcd/0x220 [10321.020292][ C1] __run_timers.part.0+0x52d/0x890 [10321.020713][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10321.111264][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10321.111718][ C1] ? lock_acquire+0x1c1/0x220 [10321.112093][ C1] ? clockevents_program_event+0xf6/0x300 [10321.112554][ C1] ? lock_release+0x1d5/0x250 [10321.112932][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10321.113350][ C1] ? ktime_get+0xb3/0x190 [10321.113703][ C1] ? clockevents_program_event+0x1ea/0x300 [10321.114172][ C1] run_timer_softirq+0x72/0x100 [10321.114562][ C1] __do_softirq+0x1b9/0x7ff [10321.114936][ C1] irq_exit_rcu+0x98/0xc0 [10321.115277][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10321.115728][ C1] [10321.115985][ C1] [10321.116234][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10321.116731][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10321.117257][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10321.118806][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10321.119302][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10321.119959][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10321.120583][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10321.201357][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10321.201997][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10321.202671][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10321.203123][ C1] pipe_read+0xa16/0xdf0 [10321.203454][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10321.203925][ C1] ? __pfx_pipe_read+0x10/0x10 [10321.204307][ C1] ? iterate_tty_write+0x299/0x540 [10321.204732][ C1] ? lock_release+0x1d5/0x250 [10321.205128][ C1] vfs_read+0x911/0xc00 [10321.205484][ C1] ? lock_acquire+0x1c1/0x220 [10321.205884][ C1] ? __might_fault+0xc6/0x180 [10321.206287][ C1] ? __pfx_vfs_read+0x10/0x10 [10321.206689][ C1] ? __might_fault+0xc6/0x180 [10321.207099][ C1] ? lock_release+0x1d5/0x250 [10321.207502][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10321.207945][ C1] ? __fget_light+0x54/0x1e0 [10321.208345][ C1] ksys_read+0x17a/0x1e0 [10321.208709][ C1] ? __pfx_ksys_read+0x10/0x10 [10321.209117][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10321.209612][ C1] do_syscall_64+0xc9/0x1e0 [10321.209986][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10321.210486][ C1] RIP: 0033:0x7f08a1ea38b2 [10321.210853][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10321.282471][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10321.283132][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10321.283763][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10321.284397][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10321.285043][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10321.285685][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10321.286341][ C1] [10321.331041][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7420s! [swapper/2:0] [10321.331756][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10321.333741][ C2] irq event stamp: 44114564 [10321.334112][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10321.334967][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10321.335791][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10321.336538][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10321.337277][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10321.337996][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10321.338976][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10321.339507][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10321.341004][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10321.421599][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10321.422239][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10321.422879][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10321.423525][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10321.424149][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10321.424786][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10321.425527][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10321.426069][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10321.426754][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10321.427384][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10321.428029][ C2] PKRU: 55555554 [10321.428318][ C2] Call Trace: [10321.428596][ C2] [10321.428837][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10321.429259][ C2] ? __run_hrtimer+0x1c0/0x710 [10321.429644][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10321.430080][ C2] ? __hrtimer_run_queues+0x197/0x270 [10321.430521][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10321.430983][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10321.499641][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10321.500172][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10321.500608][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10321.501057][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10321.501538][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10321.502009][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10321.502512][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10321.502967][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10321.503441][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10321.503926][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10321.504443][ C2] ? get_stack_info+0x36/0xc0 [10321.504848][ C2] ? lock_acquire+0x1c1/0x220 [10321.505249][ C2] ? lock_release+0x1d5/0x250 [10321.505645][ C2] do_raw_spin_lock+0x1ec/0x270 [10321.506041][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10321.506498][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10321.506954][ C2] ? lock_acquire+0x1c1/0x220 [10321.507345][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10321.507706][ C2] _raw_spin_lock_nested+0x65/0x80 [10321.508090][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10321.508439][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10321.508873][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10321.509271][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10321.509695][ C2] ip_local_deliver_finish+0x2ae/0x480 [10321.510116][ C2] ip_local_deliver+0x19d/0x480 [10321.510484][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10321.510913][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10321.651439][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10321.652024][ C2] ? rcu_read_lock_held+0xe/0x50 [10321.652441][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10321.652976][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10321.653413][ C2] ip_rcv+0x564/0x740 [10321.653751][ C2] ? __pfx_ip_rcv+0x10/0x10 [10321.654132][ C2] ? set_track_prepare+0x8a/0xd0 [10321.654553][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10321.655001][ C2] ? start_secondary+0x21c/0x2b0 [10321.655425][ C2] ? skb_clone+0x10b/0x330 [10321.655799][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10321.656329][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10321.656834][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10321.657300][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10321.657783][ C2] ? __tcf_classify+0x329/0x7d0 [10321.658185][ C2] ? __pfx_ip_rcv+0x10/0x10 [10321.658573][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10321.659061][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10321.659524][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10321.660051][ C2] ? lock_acquire+0x1c1/0x220 [10321.660439][ C2] ? netif_receive_skb_internal+0x84/0x300 [10321.660912][ C2] netif_receive_skb_internal+0xb0/0x300 [10321.741487][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10321.741952][ C2] ? __copy_skb_header+0xaf/0x490 [10321.742316][ C2] ? __skb_clone+0x57a/0x760 [10321.742647][ C2] netif_receive_skb+0x55/0x280 [10321.743005][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10321.743467][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10321.743945][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10321.744396][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10321.744821][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10321.745251][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10321.745715][ C2] ? get_stack_info+0x36/0xc0 [10321.746093][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10321.746507][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10321.746972][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10321.747395][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10321.747836][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10321.748332][ C2] ? kernel_text_address+0x17/0xe0 [10321.748772][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10321.749277][ C2] ? arch_stack_walk+0x8c/0x100 [10321.749699][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10321.750144][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10321.750557][ C2] ? lock_acquire+0x1c1/0x220 [10321.750909][ C2] ? stack_depot_save_flags+0x281/0x550 [10321.841477][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10321.841989][ C2] ? get_stack_info_noinstr+0x18/0x110 [10321.842446][ C2] ? get_stack_info+0x36/0xc0 [10321.842848][ C2] __tcf_classify+0x329/0x7d0 [10321.843254][ C2] tcf_classify+0x283/0x930 [10321.843637][ C2] ? __pfx_tcf_classify+0x10/0x10 [10321.844057][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10321.844585][ C2] tc_run+0x2e4/0x5d0 [10321.844931][ C2] ? __pfx_tc_run+0x10/0x10 [10321.845312][ C2] ? lock_acquire+0x1c1/0x220 [10321.845706][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10321.846139][ C2] __dev_queue_xmit+0x686/0x17e0 [10321.846557][ C2] ? lock_acquire+0x1c1/0x220 [10321.846941][ C2] ? ip_finish_output2+0x786/0x18e0 [10321.847371][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10321.847863][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10321.848313][ C2] ? neigh_hh_output+0x348/0x590 [10321.848731][ C2] ? ip_finish_output2+0x262/0x18e0 [10321.849174][ C2] ip_finish_output2+0x786/0x18e0 [10321.849596][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10321.850161][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10321.850610][ C2] ? rcu_read_lock_held+0xe/0x50 [10321.961136][ C2] ? __ip_finish_output+0x10f/0x770 [10321.961572][ C2] ip_output+0x16b/0x4f0 [10321.961941][ C2] ? __pfx_ip_output+0x10/0x10 [10321.962354][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10321.962815][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10321.963349][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10321.963820][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10321.964249][ C2] ? __alloc_skb+0xd4/0x280 [10321.964637][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10321.965084][ C2] ? tcp_fragment+0x168/0x1040 [10321.965488][ C2] ? rcu_read_lock_held+0xe/0x50 [10321.965908][ C2] ? ip_local_out+0x114/0x3b0 [10321.966307][ C2] __ip_queue_xmit+0x672/0x1910 [10321.966733][ C2] ? __skb_clone+0x57a/0x760 [10321.967127][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10321.967575][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10321.968053][ C2] ? ipv4_dst_check+0xe3/0x170 [10321.968471][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10321.968932][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10321.969476][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10321.970022][ C2] ? tcp_fragment+0xb0e/0x1040 [10321.970434][ C2] tcp_send_loss_probe+0x348/0x830 [10321.970876][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10322.081419][ C2] tcp_write_timer+0x82/0x1d0 [10322.081828][ C2] call_timer_fn+0x173/0x430 [10322.082216][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10322.082645][ C2] ? next_expiry_recalc+0xcd/0x220 [10322.083071][ C2] __run_timers.part.0+0x52d/0x890 [10322.083499][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10322.083939][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10322.084404][ C2] ? lock_acquire+0x1c1/0x220 [10322.084800][ C2] ? clockevents_program_event+0xf6/0x300 [10322.085278][ C2] ? lock_release+0x1d5/0x250 [10322.085668][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10322.086100][ C2] ? ktime_get+0xb3/0x190 [10322.086462][ C2] ? clockevents_program_event+0x1ea/0x300 [10322.086945][ C2] run_timer_softirq+0x72/0x100 [10322.087356][ C2] __do_softirq+0x1b9/0x7ff [10322.087742][ C2] irq_exit_rcu+0x98/0xc0 [10322.088101][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10322.088566][ C2] [10322.088809][ C2] [10322.089049][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10322.089550][ C2] RIP: 0010:default_idle+0xf/0x20 [10322.089968][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10322.201622][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10322.202075][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10322.202658][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10322.203252][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10322.203840][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10322.204433][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10322.205019][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10322.205450][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10322.205826][ C2] default_idle_call+0x69/0xa0 [10322.206183][ C2] cpuidle_idle_call+0x1f6/0x280 [10322.206552][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10322.206961][ C2] ? lock_release+0x1d5/0x250 [10322.207317][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10322.207728][ C2] do_idle+0xfb/0x160 [10322.208027][ C2] cpu_startup_entry+0x55/0x60 [10322.208386][ C2] start_secondary+0x21c/0x2b0 [10322.208736][ C2] ? __pfx_start_secondary+0x10/0x10 [10322.209166][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10322.209675][ C2] [10343.055122][ C0] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [10343.055770][ C0] rcu: 1-....: (7910758 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1868699 [10343.056706][ C0] rcu: 2-....: (5 ticks this GP) idle=6c54/0/0x1 softirq=610529/610531 fqs=1868699 [10343.057506][ C0] rcu: (detected by 0, t=7988168 jiffies, g=1882453, q=724 ncpus=4) [10343.058157][ C0] Sending NMI from CPU 0 to CPUs 1: [10343.060254][ C1] NMI backtrace for cpu 1 [10343.060263][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10343.060269][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10343.060273][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10343.060285][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10343.060290][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10343.060304][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10343.060308][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10343.060311][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10343.060314][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10343.060318][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10343.060320][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10343.060324][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10343.060332][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10343.060335][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10343.060337][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10343.060340][ C1] PKRU: 55555554 [10343.060342][ C1] Call Trace: [10343.060348][ C1] [10343.060353][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10343.060367][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10343.060376][ C1] ? nmi_handle+0x153/0x420 [10343.060383][ C1] ? default_do_nmi+0x41/0x100 [10343.060389][ C1] ? exc_nmi+0xf3/0x120 [10343.060393][ C1] ? end_repeat_nmi+0xf/0x60 [10343.060403][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10343.060408][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10343.060414][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10343.060420][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10343.060425][ C1] [10343.060426][ C1] [10343.060429][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10343.060434][ C1] ? get_stack_info+0x36/0xc0 [10343.060441][ C1] ? lock_acquire+0x1c1/0x220 [10343.060448][ C1] ? lock_release+0x1d5/0x250 [10343.060455][ C1] do_raw_spin_lock+0x1ec/0x270 [10343.060462][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10343.060466][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10343.060472][ C1] ? lock_acquire+0x1c1/0x220 [10343.060476][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10343.060484][ C1] _raw_spin_lock_nested+0x65/0x80 [10343.060490][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10343.060502][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10343.060506][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10343.060516][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10343.060527][ C1] ip_local_deliver_finish+0x2ae/0x480 [10343.060533][ C1] ip_local_deliver+0x19d/0x480 [10343.060537][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10343.060541][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10343.060544][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10343.060552][ C1] ? rcu_read_lock_held+0xe/0x50 [10343.060558][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10343.060563][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10343.060577][ C1] ip_rcv+0x564/0x740 [10343.060582][ C1] ? __pfx_ip_rcv+0x10/0x10 [10343.060587][ C1] ? set_track_prepare+0x8a/0xd0 [10343.060593][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10343.060598][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10343.060603][ C1] ? skb_clone+0x10b/0x330 [10343.060610][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10343.060620][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10343.060630][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10343.060637][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10343.060653][ C1] ? __tcf_classify+0x329/0x7d0 [10343.060661][ C1] ? __pfx_ip_rcv+0x10/0x10 [10343.060665][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10343.060671][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10343.060677][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10343.060685][ C1] ? lock_acquire+0x1c1/0x220 [10343.060690][ C1] ? netif_receive_skb_internal+0x84/0x300 [10343.060698][ C1] netif_receive_skb_internal+0xb0/0x300 [10343.060704][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10343.060711][ C1] ? __copy_skb_header+0xaf/0x490 [10343.060720][ C1] ? __skb_clone+0x57a/0x760 [10343.060724][ C1] netif_receive_skb+0x55/0x280 [10343.060731][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10343.060746][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10343.060759][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10343.060772][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10343.060781][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10343.060800][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10343.060815][ C1] ? hlock_class+0x4e/0x130 [10343.060823][ C1] ? get_stack_info_noinstr+0x18/0x110 [10343.060828][ C1] ? get_stack_info_noinstr+0x18/0x110 [10343.060833][ C1] ? __pfx_validate_chain+0x10/0x10 [10343.060838][ C1] ? hlock_class+0x4e/0x130 [10343.060843][ C1] ? mark_lock+0x38/0x3e0 [10343.060847][ C1] ? stack_access_ok+0xda/0x1f0 [10343.060854][ C1] ? __lock_acquire+0xb67/0x1610 [10343.060864][ C1] ? get_stack_info_noinstr+0x18/0x110 [10343.060869][ C1] ? get_stack_info+0x36/0xc0 [10343.060876][ C1] ? stack_access_ok+0xda/0x1f0 [10343.060879][ C1] ? get_reg+0x119/0x190 [10343.060884][ C1] ? unwind_next_frame+0x12af/0x1d10 [10343.060889][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10343.060898][ C1] __tcf_classify+0x329/0x7d0 [10343.060907][ C1] tcf_classify+0x283/0x930 [10343.060913][ C1] ? arch_stack_walk+0xa2/0x100 [10343.060937][ C1] ? __pfx_tcf_classify+0x10/0x10 [10343.060942][ C1] ? get_stack_info+0x36/0xc0 [10343.060948][ C1] tc_run+0x2e4/0x5d0 [10343.060954][ C1] ? __pfx_tc_run+0x10/0x10 [10343.060959][ C1] ? lock_acquire+0x1c1/0x220 [10343.060963][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10343.060969][ C1] __dev_queue_xmit+0x686/0x17e0 [10343.060976][ C1] ? lock_acquire+0x1c1/0x220 [10343.060979][ C1] ? ip_finish_output2+0x786/0x18e0 [10343.060985][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10343.060993][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10343.060997][ C1] ? neigh_hh_output+0x348/0x590 [10343.061003][ C1] ? ip_finish_output2+0x262/0x18e0 [10343.061009][ C1] ip_finish_output2+0x786/0x18e0 [10343.061014][ C1] ? stack_depot_save_flags+0x45/0x550 [10343.061022][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10343.061034][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10343.061038][ C1] ? rcu_read_lock_held+0xe/0x50 [10343.061045][ C1] ? __ip_finish_output+0x10f/0x770 [10343.061051][ C1] ip_output+0x16b/0x4f0 [10343.061056][ C1] ? run_timer_softirq+0x72/0x100 [10343.061064][ C1] ? __pfx_ip_output+0x10/0x10 [10343.061068][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10343.061077][ C1] ? rcu_read_lock_held+0xe/0x50 [10343.061082][ C1] ? ip_local_out+0x114/0x3b0 [10343.061089][ C1] __ip_queue_xmit+0x672/0x1910 [10343.061095][ C1] ? __create_object+0x5e/0xb0 [10343.061101][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10343.061112][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10343.061119][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10343.061125][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10343.061131][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10343.061135][ C1] tcp_delack_timer+0x84/0x240 [10343.061141][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10343.061145][ C1] call_timer_fn+0x173/0x430 [10343.061152][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10343.061160][ C1] ? next_expiry_recalc+0xcd/0x220 [10343.061168][ C1] __run_timers.part.0+0x52d/0x890 [10343.061173][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10343.061180][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10343.061185][ C1] ? lock_acquire+0x1c1/0x220 [10343.061188][ C1] ? clockevents_program_event+0xf6/0x300 [10343.061196][ C1] ? lock_release+0x1d5/0x250 [10343.061201][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10343.061209][ C1] ? ktime_get+0xb3/0x190 [10343.061215][ C1] ? clockevents_program_event+0x1ea/0x300 [10343.061223][ C1] run_timer_softirq+0x72/0x100 [10343.061228][ C1] __do_softirq+0x1b9/0x7ff [10343.061236][ C1] irq_exit_rcu+0x98/0xc0 [10343.061241][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10343.061248][ C1] [10343.061250][ C1] [10343.061252][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10343.061258][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10343.061265][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10343.061271][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10343.061276][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10343.061280][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10343.061284][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10343.061287][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10343.061291][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10343.061298][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10343.061305][ C1] pipe_read+0xa16/0xdf0 [10343.061317][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10343.061324][ C1] ? __pfx_pipe_read+0x10/0x10 [10343.061329][ C1] ? iterate_tty_write+0x299/0x540 [10343.061337][ C1] ? lock_release+0x1d5/0x250 [10343.061344][ C1] vfs_read+0x911/0xc00 [10343.061351][ C1] ? lock_acquire+0x1c1/0x220 [10343.061355][ C1] ? __might_fault+0xc6/0x180 [10343.061362][ C1] ? __pfx_vfs_read+0x10/0x10 [10343.061366][ C1] ? __might_fault+0xc6/0x180 [10343.061372][ C1] ? lock_release+0x1d5/0x250 [10343.061378][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10343.061384][ C1] ? __fget_light+0x54/0x1e0 [10343.061392][ C1] ksys_read+0x17a/0x1e0 [10343.061398][ C1] ? __pfx_ksys_read+0x10/0x10 [10343.061405][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10343.061413][ C1] do_syscall_64+0xc9/0x1e0 [10343.061420][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10343.061426][ C1] RIP: 0033:0x7f08a1ea38b2 [10343.061432][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10343.061438][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10343.061443][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10343.061447][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10343.061449][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10343.061452][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10343.061455][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10343.061464][ C1] [10343.061576][ C0] Sending NMI from CPU 0 to CPUs 2: [10343.894755][ C2] NMI backtrace for cpu 2 [10343.894773][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10343.894786][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10343.894795][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10343.894812][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10343.894817][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10343.894824][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10343.894827][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10343.894830][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10343.894833][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10343.894836][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10343.894839][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10343.894844][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10343.894851][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10343.894854][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10343.894857][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10343.894861][ C2] PKRU: 55555554 [10343.894863][ C2] Call Trace: [10343.894870][ C2] [10343.894878][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10343.894891][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10343.894900][ C2] ? nmi_handle+0x153/0x420 [10343.894910][ C2] ? default_do_nmi+0x41/0x100 [10343.894917][ C2] ? exc_nmi+0xf3/0x120 [10343.894922][ C2] ? end_repeat_nmi+0xf/0x60 [10343.894934][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10343.894941][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10343.894947][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10343.894953][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10343.894959][ C2] [10343.894961][ C2] [10343.894964][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10343.894969][ C2] ? get_stack_info+0x36/0xc0 [10343.894977][ C2] ? lock_acquire+0x1c1/0x220 [10343.894986][ C2] ? lock_release+0x1d5/0x250 [10343.894993][ C2] do_raw_spin_lock+0x1ec/0x270 [10343.895001][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10343.895006][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10343.895013][ C2] ? lock_acquire+0x1c1/0x220 [10343.895017][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10343.895026][ C2] _raw_spin_lock_nested+0x65/0x80 [10343.895032][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10343.895046][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10343.895051][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10343.895061][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10343.895075][ C2] ip_local_deliver_finish+0x2ae/0x480 [10343.895082][ C2] ip_local_deliver+0x19d/0x480 [10343.895087][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10343.895091][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10343.895095][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10343.895108][ C2] ? rcu_read_lock_held+0xe/0x50 [10343.895117][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10343.895123][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10343.895142][ C2] ip_rcv+0x564/0x740 [10343.895147][ C2] ? __pfx_ip_rcv+0x10/0x10 [10343.895152][ C2] ? set_track_prepare+0x8a/0xd0 [10343.895161][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10343.895166][ C2] ? start_secondary+0x21c/0x2b0 [10343.895173][ C2] ? skb_clone+0x10b/0x330 [10343.895180][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10343.895191][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10343.895201][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10343.895210][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10343.895225][ C2] ? __tcf_classify+0x329/0x7d0 [10343.895233][ C2] ? __pfx_ip_rcv+0x10/0x10 [10343.895237][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10343.895243][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10343.895249][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10343.895257][ C2] ? lock_acquire+0x1c1/0x220 [10343.895261][ C2] ? netif_receive_skb_internal+0x84/0x300 [10343.895269][ C2] netif_receive_skb_internal+0xb0/0x300 [10343.895276][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10343.895283][ C2] ? __copy_skb_header+0xaf/0x490 [10343.895293][ C2] ? __skb_clone+0x57a/0x760 [10343.895298][ C2] netif_receive_skb+0x55/0x280 [10343.895304][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10343.895317][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10343.895331][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10343.895343][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10343.895353][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10343.895373][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10343.895388][ C2] ? get_stack_info+0x36/0xc0 [10343.895397][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10343.895404][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10343.895414][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10343.895418][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10343.895426][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10343.895430][ C2] ? kernel_text_address+0x17/0xe0 [10343.895437][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10343.895446][ C2] ? arch_stack_walk+0x8c/0x100 [10343.895455][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10343.895460][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10343.895466][ C2] ? lock_acquire+0x1c1/0x220 [10343.895471][ C2] ? stack_depot_save_flags+0x281/0x550 [10343.895479][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10343.895488][ C2] ? get_stack_info_noinstr+0x18/0x110 [10343.895493][ C2] ? get_stack_info+0x36/0xc0 [10343.895501][ C2] __tcf_classify+0x329/0x7d0 [10343.895511][ C2] tcf_classify+0x283/0x930 [10343.895520][ C2] ? __pfx_tcf_classify+0x10/0x10 [10343.895526][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10343.895534][ C2] tc_run+0x2e4/0x5d0 [10343.895541][ C2] ? __pfx_tc_run+0x10/0x10 [10343.895547][ C2] ? lock_acquire+0x1c1/0x220 [10343.895551][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10343.895559][ C2] __dev_queue_xmit+0x686/0x17e0 [10343.895567][ C2] ? lock_acquire+0x1c1/0x220 [10343.895571][ C2] ? ip_finish_output2+0x786/0x18e0 [10343.895577][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10343.895583][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10343.895588][ C2] ? neigh_hh_output+0x348/0x590 [10343.895595][ C2] ? ip_finish_output2+0x262/0x18e0 [10343.895601][ C2] ip_finish_output2+0x786/0x18e0 [10343.895608][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10343.895620][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10343.895623][ C2] ? rcu_read_lock_held+0xe/0x50 [10343.895629][ C2] ? __ip_finish_output+0x10f/0x770 [10343.895635][ C2] ip_output+0x16b/0x4f0 [10343.895641][ C2] ? __pfx_ip_output+0x10/0x10 [10343.895646][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10343.895652][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10343.895658][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10343.895664][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10343.895669][ C2] ? __alloc_skb+0xd4/0x280 [10343.895674][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10343.895683][ C2] ? tcp_fragment+0x168/0x1040 [10343.895690][ C2] ? rcu_read_lock_held+0xe/0x50 [10343.895696][ C2] ? ip_local_out+0x114/0x3b0 [10343.895702][ C2] __ip_queue_xmit+0x672/0x1910 [10343.895708][ C2] ? __skb_clone+0x57a/0x760 [10343.895713][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10343.895725][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10343.895731][ C2] ? ipv4_dst_check+0xe3/0x170 [10343.895738][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10343.895747][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10343.895756][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10343.895762][ C2] ? tcp_fragment+0xb0e/0x1040 [10343.895769][ C2] tcp_send_loss_probe+0x348/0x830 [10343.895776][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10343.895781][ C2] tcp_write_timer+0x82/0x1d0 [10343.895787][ C2] call_timer_fn+0x173/0x430 [10343.895796][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10343.895804][ C2] ? next_expiry_recalc+0xcd/0x220 [10343.895812][ C2] __run_timers.part.0+0x52d/0x890 [10343.895818][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10343.895827][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10343.895833][ C2] ? lock_acquire+0x1c1/0x220 [10343.895837][ C2] ? clockevents_program_event+0xf6/0x300 [10343.895846][ C2] ? lock_release+0x1d5/0x250 [10343.895851][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10343.895858][ C2] ? ktime_get+0xb3/0x190 [10343.895865][ C2] ? clockevents_program_event+0x1ea/0x300 [10343.895873][ C2] run_timer_softirq+0x72/0x100 [10343.895880][ C2] __do_softirq+0x1b9/0x7ff [10343.895888][ C2] irq_exit_rcu+0x98/0xc0 [10343.895893][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10343.895901][ C2] [10343.895903][ C2] [10343.895905][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10343.895912][ C2] RIP: 0010:default_idle+0xf/0x20 [10343.895920][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10343.895925][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10343.895931][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10343.895935][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10343.895938][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10343.895941][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10343.895945][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10343.895951][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10343.895958][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10343.895965][ C2] default_idle_call+0x69/0xa0 [10343.895971][ C2] cpuidle_idle_call+0x1f6/0x280 [10343.895976][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10343.895983][ C2] ? lock_release+0x1d5/0x250 [10343.895987][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10343.895995][ C2] do_idle+0xfb/0x160 [10343.896001][ C2] cpu_startup_entry+0x55/0x60 [10343.896006][ C2] start_secondary+0x21c/0x2b0 [10343.896011][ C2] ? __pfx_start_secondary+0x10/0x10 [10343.896020][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10343.896033][ C2] [10368.580864][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7465s! [perl:4135] [10368.581569][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10368.583538][ C1] irq event stamp: 209232 [10368.583875][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10368.584737][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10368.585527][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10368.586299][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10368.587050][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10368.587785][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10368.588801][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10368.589330][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10368.664180][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10368.664672][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10368.665330][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10368.665972][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10368.666626][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10368.667265][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10368.667913][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10368.668726][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10368.669333][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10368.670038][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10368.670753][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10368.741504][ C1] PKRU: 55555554 [10368.741782][ C1] Call Trace: [10368.742037][ C1] [10368.742263][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10368.742660][ C1] ? __run_hrtimer+0x1c0/0x710 [10368.743034][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10368.743455][ C1] ? __hrtimer_run_queues+0x197/0x270 [10368.743873][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10368.744304][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10368.744698][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10368.745140][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10368.745515][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10368.745986][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10368.746437][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10368.746921][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10368.747375][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10368.747821][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10368.748266][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10368.748733][ C1] ? get_stack_info+0x36/0xc0 [10368.749092][ C1] ? lock_acquire+0x1c1/0x220 [10368.749454][ C1] ? lock_release+0x1d5/0x250 [10368.749820][ C1] do_raw_spin_lock+0x1ec/0x270 [10368.750204][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10368.750617][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10368.771183][ C1] ? lock_acquire+0x1c1/0x220 [10368.771575][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10368.771970][ C1] _raw_spin_lock_nested+0x65/0x80 [10368.772394][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10368.772773][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10368.773179][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10368.773574][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10368.774003][ C1] ip_local_deliver_finish+0x2ae/0x480 [10368.774434][ C1] ip_local_deliver+0x19d/0x480 [10368.774819][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10368.775239][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10368.775650][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10368.776197][ C1] ? rcu_read_lock_held+0xe/0x50 [10368.776594][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10368.777118][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10368.777536][ C1] ip_rcv+0x564/0x740 [10368.777864][ C1] ? __pfx_ip_rcv+0x10/0x10 [10368.778234][ C1] ? set_track_prepare+0x8a/0xd0 [10368.778635][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10368.779097][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10368.779537][ C1] ? skb_clone+0x10b/0x330 [10368.779906][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10368.780410][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10368.897093][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10368.897544][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10368.898012][ C1] ? __tcf_classify+0x329/0x7d0 [10368.898413][ C1] ? __pfx_ip_rcv+0x10/0x10 [10368.898778][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10368.899280][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10368.899732][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10368.900261][ C1] ? lock_acquire+0x1c1/0x220 [10368.900650][ C1] ? netif_receive_skb_internal+0x84/0x300 [10368.921225][ C1] netif_receive_skb_internal+0xb0/0x300 [10368.921702][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10368.922210][ C1] ? __copy_skb_header+0xaf/0x490 [10368.922625][ C1] ? __skb_clone+0x57a/0x760 [10368.923005][ C1] netif_receive_skb+0x55/0x280 [10368.923407][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10368.923926][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10368.924442][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10368.924918][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10368.925343][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10368.925816][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10368.926324][ C1] ? hlock_class+0x4e/0x130 [10368.926710][ C1] ? get_stack_info_noinstr+0x18/0x110 [10368.927165][ C1] ? get_stack_info_noinstr+0x18/0x110 [10368.927601][ C1] ? __pfx_validate_chain+0x10/0x10 [10368.928018][ C1] ? hlock_class+0x4e/0x130 [10368.928387][ C1] ? mark_lock+0x38/0x3e0 [10368.928730][ C1] ? stack_access_ok+0xda/0x1f0 [10368.929105][ C1] ? __lock_acquire+0xb67/0x1610 [10368.929501][ C1] ? get_stack_info_noinstr+0x18/0x110 [10368.929960][ C1] ? get_stack_info+0x36/0xc0 [10368.930355][ C1] ? stack_access_ok+0xda/0x1f0 [10368.930763][ C1] ? get_reg+0x119/0x190 [10368.981277][ C1] ? unwind_next_frame+0x12af/0x1d10 [10368.981702][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10368.982189][ C1] __tcf_classify+0x329/0x7d0 [10368.982568][ C1] tcf_classify+0x283/0x930 [10368.982934][ C1] ? arch_stack_walk+0xa2/0x100 [10368.983323][ C1] ? __pfx_tcf_classify+0x10/0x10 [10368.983717][ C1] ? get_stack_info+0x36/0xc0 [10368.984089][ C1] tc_run+0x2e4/0x5d0 [10368.984410][ C1] ? __pfx_tc_run+0x10/0x10 [10368.984796][ C1] ? lock_acquire+0x1c1/0x220 [10368.985186][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10368.985600][ C1] __dev_queue_xmit+0x686/0x17e0 [10368.986012][ C1] ? lock_acquire+0x1c1/0x220 [10368.986403][ C1] ? ip_finish_output2+0x786/0x18e0 [10368.986826][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10368.987298][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10368.987719][ C1] ? neigh_hh_output+0x348/0x590 [10368.988123][ C1] ? ip_finish_output2+0x262/0x18e0 [10368.988537][ C1] ip_finish_output2+0x786/0x18e0 [10368.988953][ C1] ? stack_depot_save_flags+0x45/0x550 [10368.989394][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10368.989936][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10368.990377][ C1] ? rcu_read_lock_held+0xe/0x50 [10368.990794][ C1] ? __ip_finish_output+0x10f/0x770 [10369.051663][ C1] ip_output+0x16b/0x4f0 [10369.052035][ C1] ? run_timer_softirq+0x72/0x100 [10369.052463][ C1] ? __pfx_ip_output+0x10/0x10 [10369.052850][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10369.053311][ C1] ? rcu_read_lock_held+0xe/0x50 [10369.053701][ C1] ? ip_local_out+0x114/0x3b0 [10369.054074][ C1] __ip_queue_xmit+0x672/0x1910 [10369.054468][ C1] ? __create_object+0x5e/0xb0 [10369.054861][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10369.055300][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10369.055757][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10369.056210][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10369.056667][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10369.057090][ C1] tcp_delack_timer+0x84/0x240 [10369.057496][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10369.057943][ C1] call_timer_fn+0x173/0x430 [10369.058327][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10369.058748][ C1] ? next_expiry_recalc+0xcd/0x220 [10369.059193][ C1] __run_timers.part.0+0x52d/0x890 [10369.059608][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10369.060052][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10369.060506][ C1] ? lock_acquire+0x1c1/0x220 [10369.150984][ C1] ? clockevents_program_event+0xf6/0x300 [10369.151449][ C1] ? lock_release+0x1d5/0x250 [10369.151821][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10369.152242][ C1] ? ktime_get+0xb3/0x190 [10369.152582][ C1] ? clockevents_program_event+0x1ea/0x300 [10369.153034][ C1] run_timer_softirq+0x72/0x100 [10369.153417][ C1] __do_softirq+0x1b9/0x7ff [10369.153804][ C1] irq_exit_rcu+0x98/0xc0 [10369.154192][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10369.154703][ C1] [10369.154960][ C1] [10369.155198][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10369.155669][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10369.156181][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10369.157716][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10369.158209][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10369.208857][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10369.209514][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10369.210154][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10369.210767][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10369.211435][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10369.211956][ C1] pipe_read+0xa16/0xdf0 [10369.212320][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10369.212777][ C1] ? __pfx_pipe_read+0x10/0x10 [10369.213173][ C1] ? iterate_tty_write+0x299/0x540 [10369.213589][ C1] ? lock_release+0x1d5/0x250 [10369.213984][ C1] vfs_read+0x911/0xc00 [10369.214337][ C1] ? lock_acquire+0x1c1/0x220 [10369.214727][ C1] ? __might_fault+0xc6/0x180 [10369.215124][ C1] ? __pfx_vfs_read+0x10/0x10 [10369.215519][ C1] ? __might_fault+0xc6/0x180 [10369.215928][ C1] ? lock_release+0x1d5/0x250 [10369.216308][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10369.216742][ C1] ? __fget_light+0x54/0x1e0 [10369.217124][ C1] ksys_read+0x17a/0x1e0 [10369.217480][ C1] ? __pfx_ksys_read+0x10/0x10 [10369.217888][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10369.218405][ C1] do_syscall_64+0xc9/0x1e0 [10369.218800][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10369.219310][ C1] RIP: 0033:0x7f08a1ea38b2 [10369.219694][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10369.381390][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10369.382084][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10369.382721][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10369.383353][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10369.383972][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10369.384610][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10369.385262][ C1] [10369.430874][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7465s! [swapper/2:0] [10369.431610][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10369.433658][ C2] irq event stamp: 44114564 [10369.434030][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10369.434910][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10369.435740][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10369.436524][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10369.437292][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10369.438035][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10369.439070][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10369.439616][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10369.631311][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10369.631793][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10369.632411][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10369.633046][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10369.633672][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10369.634309][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10369.634938][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10369.635658][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10369.636221][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10369.636892][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10369.637519][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10369.638160][ C2] PKRU: 55555554 [10369.638448][ C2] Call Trace: [10369.638725][ C2] [10369.638966][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10369.639395][ C2] ? __run_hrtimer+0x1c0/0x710 [10369.639784][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10369.640221][ C2] ? __hrtimer_run_queues+0x197/0x270 [10369.640651][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10369.741221][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10369.741685][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10369.742173][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10369.742594][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10369.743018][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10369.743495][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10369.743977][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10369.744489][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10369.744959][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10369.745444][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10369.745912][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10369.746416][ C2] ? get_stack_info+0x36/0xc0 [10369.746807][ C2] ? lock_acquire+0x1c1/0x220 [10369.747194][ C2] ? lock_release+0x1d5/0x250 [10369.747584][ C2] do_raw_spin_lock+0x1ec/0x270 [10369.747987][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10369.748430][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10369.748896][ C2] ? lock_acquire+0x1c1/0x220 [10369.749289][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10369.749678][ C2] _raw_spin_lock_nested+0x65/0x80 [10369.750106][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10369.750471][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10369.930972][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10369.931405][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10369.931856][ C2] ip_local_deliver_finish+0x2ae/0x480 [10369.932310][ C2] ip_local_deliver+0x19d/0x480 [10369.932711][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10369.933152][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10369.933582][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10369.934149][ C2] ? rcu_read_lock_held+0xe/0x50 [10369.934561][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10369.935084][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10369.935513][ C2] ip_rcv+0x564/0x740 [10369.935840][ C2] ? __pfx_ip_rcv+0x10/0x10 [10369.936204][ C2] ? set_track_prepare+0x8a/0xd0 [10369.936617][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10369.937059][ C2] ? start_secondary+0x21c/0x2b0 [10369.937470][ C2] ? skb_clone+0x10b/0x330 [10369.937842][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10369.938361][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10369.938859][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10369.939343][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10369.939825][ C2] ? __tcf_classify+0x329/0x7d0 [10369.940241][ C2] ? __pfx_ip_rcv+0x10/0x10 [10369.940646][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10370.071229][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10370.071678][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10370.072184][ C2] ? lock_acquire+0x1c1/0x220 [10370.072546][ C2] ? netif_receive_skb_internal+0x84/0x300 [10370.072991][ C2] netif_receive_skb_internal+0xb0/0x300 [10370.073424][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10370.073917][ C2] ? __copy_skb_header+0xaf/0x490 [10370.074331][ C2] ? __skb_clone+0x57a/0x760 [10370.074719][ C2] netif_receive_skb+0x55/0x280 [10370.075129][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10370.075640][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10370.076179][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10370.076688][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10370.077171][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10370.077672][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10370.078189][ C2] ? get_stack_info+0x36/0xc0 [10370.078592][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10370.079038][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10370.079563][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10370.080009][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10370.080488][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10370.135460][ C2] ? kernel_text_address+0x17/0xe0 [10370.135926][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10370.136483][ C2] ? arch_stack_walk+0x8c/0x100 [10370.136908][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10370.137363][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10370.137855][ C2] ? lock_acquire+0x1c1/0x220 [10370.138221][ C2] ? stack_depot_save_flags+0x281/0x550 [10370.138677][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10370.139189][ C2] ? get_stack_info_noinstr+0x18/0x110 [10370.139651][ C2] ? get_stack_info+0x36/0xc0 [10370.140055][ C2] __tcf_classify+0x329/0x7d0 [10370.140467][ C2] tcf_classify+0x283/0x930 [10370.280901][ C2] ? __pfx_tcf_classify+0x10/0x10 [10370.281323][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10370.281834][ C2] tc_run+0x2e4/0x5d0 [10370.282173][ C2] ? __pfx_tc_run+0x10/0x10 [10370.282554][ C2] ? lock_acquire+0x1c1/0x220 [10370.282936][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10370.283364][ C2] __dev_queue_xmit+0x686/0x17e0 [10370.283777][ C2] ? lock_acquire+0x1c1/0x220 [10370.284164][ C2] ? ip_finish_output2+0x786/0x18e0 [10370.284593][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10370.285089][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10370.285532][ C2] ? neigh_hh_output+0x348/0x590 [10370.285944][ C2] ? ip_finish_output2+0x262/0x18e0 [10370.371193][ C2] ip_finish_output2+0x786/0x18e0 [10370.371632][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10370.372189][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10370.372635][ C2] ? rcu_read_lock_held+0xe/0x50 [10370.373031][ C2] ? __ip_finish_output+0x10f/0x770 [10370.373455][ C2] ip_output+0x16b/0x4f0 [10370.373806][ C2] ? __pfx_ip_output+0x10/0x10 [10370.374191][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10370.374637][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10370.375129][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10370.375570][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10370.375957][ C2] ? __alloc_skb+0xd4/0x280 [10370.376328][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10370.376765][ C2] ? tcp_fragment+0x168/0x1040 [10370.377163][ C2] ? rcu_read_lock_held+0xe/0x50 [10370.377571][ C2] ? ip_local_out+0x114/0x3b0 [10370.377952][ C2] __ip_queue_xmit+0x672/0x1910 [10370.378356][ C2] ? __skb_clone+0x57a/0x760 [10370.378740][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10370.379165][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10370.379585][ C2] ? ipv4_dst_check+0xe3/0x170 [10370.379982][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10370.380386][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10370.481003][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10370.481527][ C2] ? tcp_fragment+0xb0e/0x1040 [10370.481911][ C2] tcp_send_loss_probe+0x348/0x830 [10370.482331][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10370.482760][ C2] tcp_write_timer+0x82/0x1d0 [10370.483148][ C2] call_timer_fn+0x173/0x430 [10370.483535][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10370.483945][ C2] ? next_expiry_recalc+0xcd/0x220 [10370.484368][ C2] __run_timers.part.0+0x52d/0x890 [10370.484787][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10370.485226][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10370.485686][ C2] ? lock_acquire+0x1c1/0x220 [10370.486076][ C2] ? clockevents_program_event+0xf6/0x300 [10370.486538][ C2] ? lock_release+0x1d5/0x250 [10370.486928][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10370.487360][ C2] ? ktime_get+0xb3/0x190 [10370.487743][ C2] ? clockevents_program_event+0x1ea/0x300 [10370.488246][ C2] run_timer_softirq+0x72/0x100 [10370.488668][ C2] __do_softirq+0x1b9/0x7ff [10370.489072][ C2] irq_exit_rcu+0x98/0xc0 [10370.489439][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10370.489899][ C2] [10370.490147][ C2] [10370.490399][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10370.621015][ C2] RIP: 0010:default_idle+0xf/0x20 [10370.621433][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10370.622987][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10370.623479][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10370.624110][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10370.624776][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10370.625448][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10370.626105][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10370.626759][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10370.627275][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10370.627725][ C2] default_idle_call+0x69/0xa0 [10370.628123][ C2] cpuidle_idle_call+0x1f6/0x280 [10370.628549][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10370.628996][ C2] ? lock_release+0x1d5/0x250 [10370.629374][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10370.629813][ C2] do_idle+0xfb/0x160 [10370.630151][ C2] cpu_startup_entry+0x55/0x60 [10370.630535][ C2] start_secondary+0x21c/0x2b0 [10370.761036][ C2] ? __pfx_start_secondary+0x10/0x10 [10370.761481][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10370.761982][ C2] [10396.570739][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7491s! [perl:4135] [10396.571470][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10396.573541][ C1] irq event stamp: 209232 [10396.573892][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10396.574782][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10396.575576][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10396.576359][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10396.577115][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10396.577821][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10396.578739][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10396.579272][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10396.680925][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10396.681373][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10396.682000][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10396.682626][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10396.683270][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10396.683914][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10396.684555][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10396.685273][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10396.685794][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10396.686434][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10396.687074][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10396.687750][ C1] PKRU: 55555554 [10396.688052][ C1] Call Trace: [10396.688338][ C1] [10396.688583][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10396.689011][ C1] ? __run_hrtimer+0x1c0/0x710 [10396.689410][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10396.689852][ C1] ? __hrtimer_run_queues+0x197/0x270 [10396.690286][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10396.756333][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10396.756777][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10396.757281][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10396.757713][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10396.758229][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10396.758696][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10396.759195][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10396.759659][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10396.760132][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10396.760619][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10396.831209][ C1] ? get_stack_info+0x36/0xc0 [10396.831604][ C1] ? lock_acquire+0x1c1/0x220 [10396.832000][ C1] ? lock_release+0x1d5/0x250 [10396.832391][ C1] do_raw_spin_lock+0x1ec/0x270 [10396.832795][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10396.833240][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10396.833718][ C1] ? lock_acquire+0x1c1/0x220 [10396.834115][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10396.834500][ C1] _raw_spin_lock_nested+0x65/0x80 [10396.834942][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10396.835326][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10396.835734][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10396.836181][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10396.836646][ C1] ip_local_deliver_finish+0x2ae/0x480 [10396.837108][ C1] ip_local_deliver+0x19d/0x480 [10396.837526][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10396.837974][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10396.838416][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10396.839003][ C1] ? rcu_read_lock_held+0xe/0x50 [10396.839427][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10396.839967][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10396.840412][ C1] ip_rcv+0x564/0x740 [10396.941007][ C1] ? __pfx_ip_rcv+0x10/0x10 [10396.941382][ C1] ? set_track_prepare+0x8a/0xd0 [10396.941796][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10396.942253][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10396.942682][ C1] ? skb_clone+0x10b/0x330 [10396.943046][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10396.943553][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10396.944038][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10396.944488][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10396.944961][ C1] ? __tcf_classify+0x329/0x7d0 [10396.945367][ C1] ? __pfx_ip_rcv+0x10/0x10 [10396.945738][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10396.946225][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10396.946697][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10396.947223][ C1] ? lock_acquire+0x1c1/0x220 [10396.947619][ C1] ? netif_receive_skb_internal+0x84/0x300 [10396.948106][ C1] netif_receive_skb_internal+0xb0/0x300 [10396.948580][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10396.949079][ C1] ? __copy_skb_header+0xaf/0x490 [10396.949486][ C1] ? __skb_clone+0x57a/0x760 [10396.949874][ C1] netif_receive_skb+0x55/0x280 [10396.950281][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10397.010900][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10397.011449][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10397.011923][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10397.012354][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10397.012797][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10397.013260][ C1] ? hlock_class+0x4e/0x130 [10397.013619][ C1] ? get_stack_info_noinstr+0x18/0x110 [10397.014052][ C1] ? get_stack_info_noinstr+0x18/0x110 [10397.014498][ C1] ? __pfx_validate_chain+0x10/0x10 [10397.014914][ C1] ? hlock_class+0x4e/0x130 [10397.015286][ C1] ? mark_lock+0x38/0x3e0 [10397.015622][ C1] ? stack_access_ok+0xda/0x1f0 [10397.016015][ C1] ? __lock_acquire+0xb67/0x1610 [10397.016422][ C1] ? get_stack_info_noinstr+0x18/0x110 [10397.016867][ C1] ? get_stack_info+0x36/0xc0 [10397.017250][ C1] ? stack_access_ok+0xda/0x1f0 [10397.017647][ C1] ? get_reg+0x119/0x190 [10397.017996][ C1] ? unwind_next_frame+0x12af/0x1d10 [10397.018398][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10397.018898][ C1] __tcf_classify+0x329/0x7d0 [10397.019301][ C1] tcf_classify+0x283/0x930 [10397.019664][ C1] ? arch_stack_walk+0xa2/0x100 [10397.020054][ C1] ? __pfx_tcf_classify+0x10/0x10 [10397.020429][ C1] ? get_stack_info+0x36/0xc0 [10397.190914][ C1] tc_run+0x2e4/0x5d0 [10397.191261][ C1] ? __pfx_tc_run+0x10/0x10 [10397.191619][ C1] ? lock_acquire+0x1c1/0x220 [10397.191987][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10397.192395][ C1] __dev_queue_xmit+0x686/0x17e0 [10397.192778][ C1] ? lock_acquire+0x1c1/0x220 [10397.193146][ C1] ? ip_finish_output2+0x786/0x18e0 [10397.193565][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10397.194056][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10397.194474][ C1] ? neigh_hh_output+0x348/0x590 [10397.194874][ C1] ? ip_finish_output2+0x262/0x18e0 [10397.195299][ C1] ip_finish_output2+0x786/0x18e0 [10397.195700][ C1] ? stack_depot_save_flags+0x45/0x550 [10397.196139][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10397.196673][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10397.197109][ C1] ? rcu_read_lock_held+0xe/0x50 [10397.197502][ C1] ? __ip_finish_output+0x10f/0x770 [10397.197911][ C1] ip_output+0x16b/0x4f0 [10397.198244][ C1] ? run_timer_softirq+0x72/0x100 [10397.198636][ C1] ? __pfx_ip_output+0x10/0x10 [10397.198997][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10397.199437][ C1] ? rcu_read_lock_held+0xe/0x50 [10397.199823][ C1] ? ip_local_out+0x114/0x3b0 [10397.200202][ C1] __ip_queue_xmit+0x672/0x1910 [10397.200591][ C1] ? __create_object+0x5e/0xb0 [10397.311067][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10397.311508][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10397.311956][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10397.312422][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10397.312882][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10397.313326][ C1] tcp_delack_timer+0x84/0x240 [10397.313717][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10397.314170][ C1] call_timer_fn+0x173/0x430 [10397.314545][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10397.314965][ C1] ? next_expiry_recalc+0xcd/0x220 [10397.315380][ C1] __run_timers.part.0+0x52d/0x890 [10397.315793][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10397.316232][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10397.316685][ C1] ? lock_acquire+0x1c1/0x220 [10397.317067][ C1] ? clockevents_program_event+0xf6/0x300 [10397.317546][ C1] ? lock_release+0x1d5/0x250 [10397.317939][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10397.318377][ C1] ? ktime_get+0xb3/0x190 [10397.318738][ C1] ? clockevents_program_event+0x1ea/0x300 [10397.319221][ C1] run_timer_softirq+0x72/0x100 [10397.319617][ C1] __do_softirq+0x1b9/0x7ff [10397.320003][ C1] irq_exit_rcu+0x98/0xc0 [10397.320368][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10397.430944][ C1] [10397.431192][ C1] [10397.431436][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10397.431943][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10397.432476][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10397.434036][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10397.434534][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10397.435166][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10397.435829][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10397.436484][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10397.437147][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10397.437805][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10397.438302][ C1] pipe_read+0xa16/0xdf0 [10397.438670][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10397.439114][ C1] ? __pfx_pipe_read+0x10/0x10 [10397.439514][ C1] ? iterate_tty_write+0x299/0x540 [10397.439956][ C1] ? lock_release+0x1d5/0x250 [10397.440353][ C1] vfs_read+0x911/0xc00 [10397.480805][ C1] ? lock_acquire+0x1c1/0x220 [10397.481205][ C1] ? __might_fault+0xc6/0x180 [10397.481588][ C1] ? __pfx_vfs_read+0x10/0x10 [10397.481966][ C1] ? __might_fault+0xc6/0x180 [10397.482346][ C1] ? lock_release+0x1d5/0x250 [10397.482716][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10397.483131][ C1] ? __fget_light+0x54/0x1e0 [10397.483501][ C1] ksys_read+0x17a/0x1e0 [10397.483849][ C1] ? __pfx_ksys_read+0x10/0x10 [10397.484238][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10397.484722][ C1] do_syscall_64+0xc9/0x1e0 [10397.485108][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10397.485603][ C1] RIP: 0033:0x7f08a1ea38b2 [10397.485976][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10397.487546][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10397.488232][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10397.488872][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10397.489510][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10397.490155][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10397.660908][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10397.661557][ C1] [10397.706153][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7491s! [swapper/2:0] [10397.706920][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10397.708960][ C2] irq event stamp: 44114564 [10397.709330][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10397.710190][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10397.781133][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10397.781919][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10397.782703][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10397.783431][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10397.784437][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10397.784975][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10397.786554][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10397.787053][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10397.787715][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10397.788402][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10397.789088][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10397.789737][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10397.790394][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10397.870692][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10397.871234][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10397.871882][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10397.872533][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10397.873187][ C2] PKRU: 55555554 [10397.873485][ C2] Call Trace: [10397.873766][ C2] [10397.874001][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10397.874435][ C2] ? __run_hrtimer+0x1c0/0x710 [10397.874836][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10397.875300][ C2] ? __hrtimer_run_queues+0x197/0x270 [10397.875742][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10397.876222][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10397.876677][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10397.877199][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10397.877639][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10397.878084][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10397.878600][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10397.879102][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10397.879613][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10397.880084][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10397.880565][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10397.971188][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10397.971730][ C2] ? get_stack_info+0x36/0xc0 [10397.972153][ C2] ? lock_acquire+0x1c1/0x220 [10397.972546][ C2] ? lock_release+0x1d5/0x250 [10397.972940][ C2] do_raw_spin_lock+0x1ec/0x270 [10397.973353][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10397.973799][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10397.974272][ C2] ? lock_acquire+0x1c1/0x220 [10397.974665][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10397.975060][ C2] _raw_spin_lock_nested+0x65/0x80 [10397.975497][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10397.975885][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10397.976298][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10397.976729][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10397.977183][ C2] ip_local_deliver_finish+0x2ae/0x480 [10397.977648][ C2] ip_local_deliver+0x19d/0x480 [10397.978058][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10397.978500][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10397.978927][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10397.979491][ C2] ? rcu_read_lock_held+0xe/0x50 [10397.979902][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10397.980422][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10398.060950][ C2] ip_rcv+0x564/0x740 [10398.061273][ C2] ? __pfx_ip_rcv+0x10/0x10 [10398.061626][ C2] ? set_track_prepare+0x8a/0xd0 [10398.062037][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10398.062479][ C2] ? start_secondary+0x21c/0x2b0 [10398.062884][ C2] ? skb_clone+0x10b/0x330 [10398.063253][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10398.063769][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10398.064259][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10398.064721][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10398.065201][ C2] ? __tcf_classify+0x329/0x7d0 [10398.065608][ C2] ? __pfx_ip_rcv+0x10/0x10 [10398.065977][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10398.066457][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10398.066925][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10398.067449][ C2] ? lock_acquire+0x1c1/0x220 [10398.067841][ C2] ? netif_receive_skb_internal+0x84/0x300 [10398.068325][ C2] netif_receive_skb_internal+0xb0/0x300 [10398.068786][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10398.069297][ C2] ? __copy_skb_header+0xaf/0x490 [10398.069712][ C2] ? __skb_clone+0x57a/0x760 [10398.070069][ C2] netif_receive_skb+0x55/0x280 [10398.070474][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10398.111141][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10398.111691][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10398.112193][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10398.112658][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10398.113123][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10398.113631][ C2] ? get_stack_info+0x36/0xc0 [10398.114040][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10398.114478][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10398.115004][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10398.115458][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10398.115917][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10398.116449][ C2] ? kernel_text_address+0x17/0xe0 [10398.116886][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10398.117409][ C2] ? arch_stack_walk+0x8c/0x100 [10398.117822][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10398.118288][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10398.118779][ C2] ? lock_acquire+0x1c1/0x220 [10398.119191][ C2] ? stack_depot_save_flags+0x281/0x550 [10398.119674][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10398.120211][ C2] ? get_stack_info_noinstr+0x18/0x110 [10398.120667][ C2] ? get_stack_info+0x36/0xc0 [10398.191662][ C2] __tcf_classify+0x329/0x7d0 [10398.192078][ C2] tcf_classify+0x283/0x930 [10398.192464][ C2] ? __pfx_tcf_classify+0x10/0x10 [10398.192885][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10398.193402][ C2] tc_run+0x2e4/0x5d0 [10398.193740][ C2] ? __pfx_tc_run+0x10/0x10 [10398.194129][ C2] ? lock_acquire+0x1c1/0x220 [10398.194523][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10398.194961][ C2] __dev_queue_xmit+0x686/0x17e0 [10398.195383][ C2] ? lock_acquire+0x1c1/0x220 [10398.195781][ C2] ? ip_finish_output2+0x786/0x18e0 [10398.196236][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10398.196756][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10398.197232][ C2] ? neigh_hh_output+0x348/0x590 [10398.197653][ C2] ? ip_finish_output2+0x262/0x18e0 [10398.198095][ C2] ip_finish_output2+0x786/0x18e0 [10398.198529][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10398.199084][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10398.199540][ C2] ? rcu_read_lock_held+0xe/0x50 [10398.199961][ C2] ? __ip_finish_output+0x10f/0x770 [10398.200400][ C2] ip_output+0x16b/0x4f0 [10398.320865][ C2] ? __pfx_ip_output+0x10/0x10 [10398.321238][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10398.321655][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10398.322110][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10398.322511][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10398.322889][ C2] ? __alloc_skb+0xd4/0x280 [10398.323220][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10398.323642][ C2] ? tcp_fragment+0x168/0x1040 [10398.324015][ C2] ? rcu_read_lock_held+0xe/0x50 [10398.324396][ C2] ? ip_local_out+0x114/0x3b0 [10398.324759][ C2] __ip_queue_xmit+0x672/0x1910 [10398.325133][ C2] ? __skb_clone+0x57a/0x760 [10398.325488][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10398.325891][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10398.326314][ C2] ? ipv4_dst_check+0xe3/0x170 [10398.326683][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10398.327063][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10398.327547][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10398.328016][ C2] ? tcp_fragment+0xb0e/0x1040 [10398.328369][ C2] tcp_send_loss_probe+0x348/0x830 [10398.328746][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10398.329146][ C2] tcp_write_timer+0x82/0x1d0 [10398.329510][ C2] call_timer_fn+0x173/0x430 [10398.329896][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10398.330305][ C2] ? next_expiry_recalc+0xcd/0x220 [10398.420872][ C2] __run_timers.part.0+0x52d/0x890 [10398.421316][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10398.421773][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10398.422237][ C2] ? lock_acquire+0x1c1/0x220 [10398.422616][ C2] ? clockevents_program_event+0xf6/0x300 [10398.423080][ C2] ? lock_release+0x1d5/0x250 [10398.423458][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10398.423882][ C2] ? ktime_get+0xb3/0x190 [10398.424242][ C2] ? clockevents_program_event+0x1ea/0x300 [10398.424723][ C2] run_timer_softirq+0x72/0x100 [10398.425124][ C2] __do_softirq+0x1b9/0x7ff [10398.425504][ C2] irq_exit_rcu+0x98/0xc0 [10398.425863][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10398.426334][ C2] [10398.426577][ C2] [10398.426823][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10398.427320][ C2] RIP: 0010:default_idle+0xf/0x20 [10398.427755][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10398.429345][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10398.429840][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10398.430479][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10398.516681][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10398.517335][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10398.517981][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10398.518629][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10398.519114][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10398.519538][ C2] default_idle_call+0x69/0xa0 [10398.519937][ C2] cpuidle_idle_call+0x1f6/0x280 [10398.520342][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10398.560936][ C2] ? lock_release+0x1d5/0x250 [10398.561337][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10398.561807][ C2] do_idle+0xfb/0x160 [10398.562140][ C2] cpu_startup_entry+0x55/0x60 [10398.562514][ C2] start_secondary+0x21c/0x2b0 [10398.562902][ C2] ? __pfx_start_secondary+0x10/0x10 [10398.563343][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10398.563853][ C2] [10421.915127][ C0] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [10421.915751][ C0] rcu: 1-....: (7926919 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1884044 [10421.916698][ C0] rcu: 2-....: (5 ticks this GP) idle=6c54/0/0x1 softirq=610529/610531 fqs=1884044 [10421.917488][ C0] rcu: (detected by 0, t=8067028 jiffies, g=1882453, q=724 ncpus=4) [10421.918153][ C0] Sending NMI from CPU 0 to CPUs 1: [10421.920640][ C1] NMI backtrace for cpu 1 [10421.920649][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10421.920656][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10421.920660][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10421.920673][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10421.920678][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10421.920683][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10421.920686][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10421.920688][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10421.920691][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10421.920694][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10421.920697][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10421.920701][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10421.920707][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10421.920710][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10421.920713][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10421.920715][ C1] PKRU: 55555554 [10421.920717][ C1] Call Trace: [10421.920723][ C1] [10421.920729][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10421.920743][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10421.920752][ C1] ? nmi_handle+0x153/0x420 [10421.920759][ C1] ? default_do_nmi+0x41/0x100 [10421.920765][ C1] ? exc_nmi+0xf3/0x120 [10421.920770][ C1] ? end_repeat_nmi+0xf/0x60 [10421.920779][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10421.920784][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10421.920790][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10421.920795][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10421.920800][ C1] [10421.920801][ C1] [10421.920804][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10421.920808][ C1] ? get_stack_info+0x36/0xc0 [10421.920815][ C1] ? lock_acquire+0x1c1/0x220 [10421.920822][ C1] ? lock_release+0x1d5/0x250 [10421.920828][ C1] do_raw_spin_lock+0x1ec/0x270 [10421.920835][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10421.920840][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10421.920846][ C1] ? lock_acquire+0x1c1/0x220 [10421.920850][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10421.920857][ C1] _raw_spin_lock_nested+0x65/0x80 [10421.920862][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10421.920874][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10421.920878][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10421.920887][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10421.920897][ C1] ip_local_deliver_finish+0x2ae/0x480 [10421.920903][ C1] ip_local_deliver+0x19d/0x480 [10421.920907][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10421.920911][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10421.920915][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10421.920925][ C1] ? rcu_read_lock_held+0xe/0x50 [10421.920931][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10421.920937][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10421.920954][ C1] ip_rcv+0x564/0x740 [10421.920959][ C1] ? __pfx_ip_rcv+0x10/0x10 [10421.920965][ C1] ? set_track_prepare+0x8a/0xd0 [10421.920972][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10421.920977][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10421.920982][ C1] ? skb_clone+0x10b/0x330 [10421.920988][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10421.920998][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10421.921007][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10421.921015][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10421.921044][ C1] ? __tcf_classify+0x329/0x7d0 [10421.921051][ C1] ? __pfx_ip_rcv+0x10/0x10 [10421.921054][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10421.921060][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10421.921066][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10421.921074][ C1] ? lock_acquire+0x1c1/0x220 [10421.921078][ C1] ? netif_receive_skb_internal+0x84/0x300 [10421.921084][ C1] netif_receive_skb_internal+0xb0/0x300 [10421.921089][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10421.921096][ C1] ? __copy_skb_header+0xaf/0x490 [10421.921103][ C1] ? __skb_clone+0x57a/0x760 [10421.921106][ C1] netif_receive_skb+0x55/0x280 [10421.921112][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10421.921127][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10421.921139][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10421.921150][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10421.921159][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10421.921177][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10421.921191][ C1] ? hlock_class+0x4e/0x130 [10421.921200][ C1] ? get_stack_info_noinstr+0x18/0x110 [10421.921203][ C1] ? get_stack_info_noinstr+0x18/0x110 [10421.921207][ C1] ? __pfx_validate_chain+0x10/0x10 [10421.921211][ C1] ? hlock_class+0x4e/0x130 [10421.921216][ C1] ? mark_lock+0x38/0x3e0 [10421.921219][ C1] ? stack_access_ok+0xda/0x1f0 [10421.921226][ C1] ? __lock_acquire+0xb67/0x1610 [10421.921235][ C1] ? get_stack_info_noinstr+0x18/0x110 [10421.921240][ C1] ? get_stack_info+0x36/0xc0 [10421.921247][ C1] ? stack_access_ok+0xda/0x1f0 [10421.921250][ C1] ? get_reg+0x119/0x190 [10421.921256][ C1] ? unwind_next_frame+0x12af/0x1d10 [10421.921260][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10421.921268][ C1] __tcf_classify+0x329/0x7d0 [10421.921278][ C1] tcf_classify+0x283/0x930 [10421.921284][ C1] ? arch_stack_walk+0xa2/0x100 [10421.921292][ C1] ? __pfx_tcf_classify+0x10/0x10 [10421.921298][ C1] ? get_stack_info+0x36/0xc0 [10421.921306][ C1] tc_run+0x2e4/0x5d0 [10421.921312][ C1] ? __pfx_tc_run+0x10/0x10 [10421.921316][ C1] ? lock_acquire+0x1c1/0x220 [10421.921320][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10421.921325][ C1] __dev_queue_xmit+0x686/0x17e0 [10421.921332][ C1] ? lock_acquire+0x1c1/0x220 [10421.921336][ C1] ? ip_finish_output2+0x786/0x18e0 [10421.921341][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10421.921348][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10421.921351][ C1] ? neigh_hh_output+0x348/0x590 [10421.921357][ C1] ? ip_finish_output2+0x262/0x18e0 [10421.921364][ C1] ip_finish_output2+0x786/0x18e0 [10421.921369][ C1] ? stack_depot_save_flags+0x45/0x550 [10421.921376][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10421.921391][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10421.921395][ C1] ? rcu_read_lock_held+0xe/0x50 [10421.921402][ C1] ? __ip_finish_output+0x10f/0x770 [10421.921409][ C1] ip_output+0x16b/0x4f0 [10421.921413][ C1] ? run_timer_softirq+0x72/0x100 [10421.921421][ C1] ? __pfx_ip_output+0x10/0x10 [10421.921426][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10421.921434][ C1] ? rcu_read_lock_held+0xe/0x50 [10421.921439][ C1] ? ip_local_out+0x114/0x3b0 [10421.921446][ C1] __ip_queue_xmit+0x672/0x1910 [10421.921452][ C1] ? __create_object+0x5e/0xb0 [10421.921458][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10421.921469][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10421.921477][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10421.921483][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10421.921490][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10421.921494][ C1] tcp_delack_timer+0x84/0x240 [10421.921500][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10421.921504][ C1] call_timer_fn+0x173/0x430 [10421.921511][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10421.921520][ C1] ? next_expiry_recalc+0xcd/0x220 [10421.921528][ C1] __run_timers.part.0+0x52d/0x890 [10421.921533][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10421.921541][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10421.921547][ C1] ? lock_acquire+0x1c1/0x220 [10421.921551][ C1] ? clockevents_program_event+0xf6/0x300 [10421.921559][ C1] ? lock_release+0x1d5/0x250 [10421.921564][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10421.921570][ C1] ? ktime_get+0xb3/0x190 [10421.921577][ C1] ? clockevents_program_event+0x1ea/0x300 [10421.921585][ C1] run_timer_softirq+0x72/0x100 [10421.921590][ C1] __do_softirq+0x1b9/0x7ff [10421.921597][ C1] irq_exit_rcu+0x98/0xc0 [10421.921602][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10421.921609][ C1] [10421.921611][ C1] [10421.921612][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10421.921619][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10421.921624][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10421.921629][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10421.921634][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10421.921637][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10421.921640][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10421.921642][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10421.921645][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10421.921652][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10421.921660][ C1] pipe_read+0xa16/0xdf0 [10421.921671][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10421.921678][ C1] ? __pfx_pipe_read+0x10/0x10 [10421.921683][ C1] ? iterate_tty_write+0x299/0x540 [10421.921691][ C1] ? lock_release+0x1d5/0x250 [10421.921698][ C1] vfs_read+0x911/0xc00 [10421.921706][ C1] ? lock_acquire+0x1c1/0x220 [10421.921710][ C1] ? __might_fault+0xc6/0x180 [10421.921717][ C1] ? __pfx_vfs_read+0x10/0x10 [10421.921721][ C1] ? __might_fault+0xc6/0x180 [10421.921728][ C1] ? lock_release+0x1d5/0x250 [10421.921734][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10421.921740][ C1] ? __fget_light+0x54/0x1e0 [10421.921748][ C1] ksys_read+0x17a/0x1e0 [10421.921755][ C1] ? __pfx_ksys_read+0x10/0x10 [10421.921761][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10421.921769][ C1] do_syscall_64+0xc9/0x1e0 [10421.921776][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10421.921782][ C1] RIP: 0033:0x7f08a1ea38b2 [10421.921788][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10421.921792][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10421.921796][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10421.921800][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10421.921802][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10421.921805][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10421.921808][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10421.921817][ C1] [10421.922616][ C0] Sending NMI from CPU 0 to CPUs 2: [10422.750636][ C2] NMI backtrace for cpu 2 [10422.750656][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10422.750664][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10422.750669][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10422.750688][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10422.750694][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10422.750700][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10422.750704][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10422.750707][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10422.750710][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10422.750713][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10422.750716][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10422.750720][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10422.750727][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10422.750730][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10422.750733][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10422.750736][ C2] PKRU: 55555554 [10422.750738][ C2] Call Trace: [10422.750745][ C2] [10422.750754][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10422.750767][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10422.750776][ C2] ? nmi_handle+0x153/0x420 [10422.750786][ C2] ? default_do_nmi+0x41/0x100 [10422.750793][ C2] ? exc_nmi+0xf3/0x120 [10422.750798][ C2] ? end_repeat_nmi+0xf/0x60 [10422.750810][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10422.750816][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10422.750822][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10422.750828][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10422.750833][ C2] [10422.750835][ C2] [10422.750837][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10422.750842][ C2] ? get_stack_info+0x36/0xc0 [10422.750851][ C2] ? lock_acquire+0x1c1/0x220 [10422.750860][ C2] ? lock_release+0x1d5/0x250 [10422.750866][ C2] do_raw_spin_lock+0x1ec/0x270 [10422.750874][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10422.750880][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10422.750885][ C2] ? lock_acquire+0x1c1/0x220 [10422.750889][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10422.750898][ C2] _raw_spin_lock_nested+0x65/0x80 [10422.750904][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10422.750916][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10422.750922][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10422.750932][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10422.750945][ C2] ip_local_deliver_finish+0x2ae/0x480 [10422.750952][ C2] ip_local_deliver+0x19d/0x480 [10422.750957][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10422.750960][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10422.750964][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10422.750975][ C2] ? rcu_read_lock_held+0xe/0x50 [10422.750983][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10422.750989][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10422.751008][ C2] ip_rcv+0x564/0x740 [10422.751013][ C2] ? __pfx_ip_rcv+0x10/0x10 [10422.751018][ C2] ? set_track_prepare+0x8a/0xd0 [10422.751027][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10422.751032][ C2] ? start_secondary+0x21c/0x2b0 [10422.751039][ C2] ? skb_clone+0x10b/0x330 [10422.751046][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10422.751057][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10422.751087][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10422.751096][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10422.751112][ C2] ? __tcf_classify+0x329/0x7d0 [10422.751118][ C2] ? __pfx_ip_rcv+0x10/0x10 [10422.751123][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10422.751129][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10422.751136][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10422.751144][ C2] ? lock_acquire+0x1c1/0x220 [10422.751148][ C2] ? netif_receive_skb_internal+0x84/0x300 [10422.751157][ C2] netif_receive_skb_internal+0xb0/0x300 [10422.751163][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10422.751171][ C2] ? __copy_skb_header+0xaf/0x490 [10422.751179][ C2] ? __skb_clone+0x57a/0x760 [10422.751184][ C2] netif_receive_skb+0x55/0x280 [10422.751191][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10422.751206][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10422.751218][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10422.751231][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10422.751240][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10422.751258][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10422.751270][ C2] ? get_stack_info+0x36/0xc0 [10422.751280][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10422.751287][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10422.751295][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10422.751300][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10422.751306][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10422.751310][ C2] ? kernel_text_address+0x17/0xe0 [10422.751316][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10422.751324][ C2] ? arch_stack_walk+0x8c/0x100 [10422.751331][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10422.751337][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10422.751343][ C2] ? lock_acquire+0x1c1/0x220 [10422.751348][ C2] ? stack_depot_save_flags+0x281/0x550 [10422.751356][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10422.751365][ C2] ? get_stack_info_noinstr+0x18/0x110 [10422.751370][ C2] ? get_stack_info+0x36/0xc0 [10422.751379][ C2] __tcf_classify+0x329/0x7d0 [10422.751390][ C2] tcf_classify+0x283/0x930 [10422.751399][ C2] ? __pfx_tcf_classify+0x10/0x10 [10422.751404][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10422.751412][ C2] tc_run+0x2e4/0x5d0 [10422.751419][ C2] ? __pfx_tc_run+0x10/0x10 [10422.751424][ C2] ? lock_acquire+0x1c1/0x220 [10422.751427][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10422.751434][ C2] __dev_queue_xmit+0x686/0x17e0 [10422.751442][ C2] ? lock_acquire+0x1c1/0x220 [10422.751446][ C2] ? ip_finish_output2+0x786/0x18e0 [10422.751451][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10422.751457][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10422.751463][ C2] ? neigh_hh_output+0x348/0x590 [10422.751471][ C2] ? ip_finish_output2+0x262/0x18e0 [10422.751478][ C2] ip_finish_output2+0x786/0x18e0 [10422.751485][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10422.751500][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10422.751504][ C2] ? rcu_read_lock_held+0xe/0x50 [10422.751511][ C2] ? __ip_finish_output+0x10f/0x770 [10422.751517][ C2] ip_output+0x16b/0x4f0 [10422.751524][ C2] ? __pfx_ip_output+0x10/0x10 [10422.751529][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10422.751534][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10422.751540][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10422.751547][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10422.751552][ C2] ? __alloc_skb+0xd4/0x280 [10422.751556][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10422.751564][ C2] ? tcp_fragment+0x168/0x1040 [10422.751571][ C2] ? rcu_read_lock_held+0xe/0x50 [10422.751576][ C2] ? ip_local_out+0x114/0x3b0 [10422.751583][ C2] __ip_queue_xmit+0x672/0x1910 [10422.751591][ C2] ? __skb_clone+0x57a/0x760 [10422.751596][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10422.751609][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10422.751615][ C2] ? ipv4_dst_check+0xe3/0x170 [10422.751622][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10422.751631][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10422.751640][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10422.751646][ C2] ? tcp_fragment+0xb0e/0x1040 [10422.751652][ C2] tcp_send_loss_probe+0x348/0x830 [10422.751659][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10422.751664][ C2] tcp_write_timer+0x82/0x1d0 [10422.751671][ C2] call_timer_fn+0x173/0x430 [10422.751680][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10422.751701][ C2] ? next_expiry_recalc+0xcd/0x220 [10422.751709][ C2] __run_timers.part.0+0x52d/0x890 [10422.751715][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10422.751722][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10422.751745][ C2] ? lock_acquire+0x1c1/0x220 [10422.751750][ C2] ? clockevents_program_event+0xf6/0x300 [10422.751759][ C2] ? lock_release+0x1d5/0x250 [10422.751764][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10422.751771][ C2] ? ktime_get+0xb3/0x190 [10422.751778][ C2] ? clockevents_program_event+0x1ea/0x300 [10422.751786][ C2] run_timer_softirq+0x72/0x100 [10422.751792][ C2] __do_softirq+0x1b9/0x7ff [10422.751801][ C2] irq_exit_rcu+0x98/0xc0 [10422.751807][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10422.751814][ C2] [10422.751815][ C2] [10422.751817][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10422.751824][ C2] RIP: 0010:default_idle+0xf/0x20 [10422.751831][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10422.751834][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10422.751840][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10422.751843][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10422.751845][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10422.751848][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10422.751851][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10422.751857][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10422.751863][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10422.751870][ C2] default_idle_call+0x69/0xa0 [10422.751876][ C2] cpuidle_idle_call+0x1f6/0x280 [10422.751881][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10422.751888][ C2] ? lock_release+0x1d5/0x250 [10422.751893][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10422.751902][ C2] do_idle+0xfb/0x160 [10422.751907][ C2] cpu_startup_entry+0x55/0x60 [10422.751911][ C2] start_secondary+0x21c/0x2b0 [10422.751917][ C2] ? __pfx_start_secondary+0x10/0x10 [10422.751925][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10422.751937][ C2] [10448.650524][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7540s! [perl:4135] [10448.651218][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10448.653240][ C1] irq event stamp: 209232 [10448.653605][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10448.654513][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10448.655328][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10448.656107][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10448.656860][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10448.657592][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10448.658623][ C1] RIP: 0010:kasan_check_range+0x1b/0x1c0 [10448.659105][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 53 <72> 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 23 [10448.800808][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000282 [10448.801318][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10448.801957][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10448.802608][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10448.803276][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10448.803933][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10448.804599][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10448.805347][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10448.805884][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10448.806535][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10448.807203][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10448.807865][ C1] PKRU: 55555554 [10448.808172][ C1] Call Trace: [10448.808460][ C1] [10448.808705][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10448.809146][ C1] ? __run_hrtimer+0x1c0/0x710 [10448.809557][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10448.810019][ C1] ? __hrtimer_run_queues+0x197/0x270 [10448.881055][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10448.881546][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10448.881977][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10448.882469][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10448.882884][ C1] ? hrtimer_interrupt+0x31a/0x770 [10448.883313][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10448.883813][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10448.884299][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10448.884796][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10448.885255][ C1] ? kasan_check_range+0x1b/0x1c0 [10448.885661][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10448.886131][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10448.886629][ C1] ? get_stack_info+0x36/0xc0 [10448.887018][ C1] ? lock_acquire+0x1c1/0x220 [10448.887411][ C1] ? lock_release+0x1d5/0x250 [10448.887789][ C1] do_raw_spin_lock+0x1ec/0x270 [10448.888190][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10448.888626][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10448.889092][ C1] ? lock_acquire+0x1c1/0x220 [10448.889478][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10448.889867][ C1] _raw_spin_lock_nested+0x65/0x80 [10448.890285][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10448.960762][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10448.961181][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10448.961596][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10448.962041][ C1] ip_local_deliver_finish+0x2ae/0x480 [10448.962479][ C1] ip_local_deliver+0x19d/0x480 [10448.962877][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10448.963324][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10448.963740][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10448.964275][ C1] ? rcu_read_lock_held+0xe/0x50 [10448.964686][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10448.965218][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10448.965640][ C1] ip_rcv+0x564/0x740 [10448.965992][ C1] ? __pfx_ip_rcv+0x10/0x10 [10448.966361][ C1] ? set_track_prepare+0x8a/0xd0 [10448.966748][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10448.967209][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10448.967662][ C1] ? skb_clone+0x10b/0x330 [10448.968047][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10448.968557][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10448.969047][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10448.969501][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10448.969981][ C1] ? __tcf_classify+0x329/0x7d0 [10448.970381][ C1] ? __pfx_ip_rcv+0x10/0x10 [10449.040863][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10449.041370][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10449.041844][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10449.042383][ C1] ? lock_acquire+0x1c1/0x220 [10449.042778][ C1] ? netif_receive_skb_internal+0x84/0x300 [10449.043270][ C1] netif_receive_skb_internal+0xb0/0x300 [10449.043734][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10449.044247][ C1] ? __copy_skb_header+0xaf/0x490 [10449.044664][ C1] ? __skb_clone+0x57a/0x760 [10449.045060][ C1] netif_receive_skb+0x55/0x280 [10449.045475][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10449.045996][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10449.046556][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10449.047062][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10449.047523][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10449.048011][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10449.048543][ C1] ? hlock_class+0x4e/0x130 [10449.048935][ C1] ? get_stack_info_noinstr+0x18/0x110 [10449.049369][ C1] ? get_stack_info_noinstr+0x18/0x110 [10449.049827][ C1] ? __pfx_validate_chain+0x10/0x10 [10449.050281][ C1] ? hlock_class+0x4e/0x130 [10449.120745][ C1] ? mark_lock+0x38/0x3e0 [10449.121106][ C1] ? stack_access_ok+0xda/0x1f0 [10449.121522][ C1] ? __lock_acquire+0xb67/0x1610 [10449.121924][ C1] ? get_stack_info_noinstr+0x18/0x110 [10449.122372][ C1] ? get_stack_info+0x36/0xc0 [10449.122762][ C1] ? stack_access_ok+0xda/0x1f0 [10449.123146][ C1] ? get_reg+0x119/0x190 [10449.123484][ C1] ? unwind_next_frame+0x12af/0x1d10 [10449.123899][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10449.124397][ C1] __tcf_classify+0x329/0x7d0 [10449.124801][ C1] tcf_classify+0x283/0x930 [10449.125175][ C1] ? arch_stack_walk+0xa2/0x100 [10449.125574][ C1] ? __pfx_tcf_classify+0x10/0x10 [10449.125988][ C1] ? get_stack_info+0x36/0xc0 [10449.126381][ C1] tc_run+0x2e4/0x5d0 [10449.126715][ C1] ? __pfx_tc_run+0x10/0x10 [10449.127094][ C1] ? lock_acquire+0x1c1/0x220 [10449.127480][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10449.127902][ C1] __dev_queue_xmit+0x686/0x17e0 [10449.128310][ C1] ? lock_acquire+0x1c1/0x220 [10449.128697][ C1] ? ip_finish_output2+0x786/0x18e0 [10449.129123][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10449.129617][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10449.130065][ C1] ? neigh_hh_output+0x348/0x590 [10449.250594][ C1] ? ip_finish_output2+0x262/0x18e0 [10449.251016][ C1] ip_finish_output2+0x786/0x18e0 [10449.251410][ C1] ? stack_depot_save_flags+0x45/0x550 [10449.251858][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10449.252378][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10449.252800][ C1] ? rcu_read_lock_held+0xe/0x50 [10449.253200][ C1] ? __ip_finish_output+0x10f/0x770 [10449.253614][ C1] ip_output+0x16b/0x4f0 [10449.253976][ C1] ? run_timer_softirq+0x72/0x100 [10449.254401][ C1] ? __pfx_ip_output+0x10/0x10 [10449.254803][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10449.255279][ C1] ? rcu_read_lock_held+0xe/0x50 [10449.255672][ C1] ? ip_local_out+0x114/0x3b0 [10449.256052][ C1] __ip_queue_xmit+0x672/0x1910 [10449.256450][ C1] ? __create_object+0x5e/0xb0 [10449.256840][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10449.257262][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10449.257711][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10449.258162][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10449.258625][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10449.259069][ C1] tcp_delack_timer+0x84/0x240 [10449.259458][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10449.259902][ C1] call_timer_fn+0x173/0x430 [10449.260292][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10449.320515][ C1] ? next_expiry_recalc+0xcd/0x220 [10449.320936][ C1] __run_timers.part.0+0x52d/0x890 [10449.321344][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10449.321781][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10449.322239][ C1] ? lock_acquire+0x1c1/0x220 [10449.322594][ C1] ? clockevents_program_event+0xf6/0x300 [10449.323045][ C1] ? lock_release+0x1d5/0x250 [10449.323430][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10449.323838][ C1] ? ktime_get+0xb3/0x190 [10449.324210][ C1] ? clockevents_program_event+0x1ea/0x300 [10449.324698][ C1] run_timer_softirq+0x72/0x100 [10449.325112][ C1] __do_softirq+0x1b9/0x7ff [10449.325499][ C1] irq_exit_rcu+0x98/0xc0 [10449.325863][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10449.326328][ C1] [10449.326580][ C1] [10449.326831][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10449.327336][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10449.327864][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10449.329381][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10449.329862][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10449.440812][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10449.441476][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10449.442105][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10449.442759][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10449.443397][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10449.443903][ C1] pipe_read+0xa16/0xdf0 [10449.444271][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10449.444739][ C1] ? __pfx_pipe_read+0x10/0x10 [10449.445157][ C1] ? iterate_tty_write+0x299/0x540 [10449.445584][ C1] ? lock_release+0x1d5/0x250 [10449.445991][ C1] vfs_read+0x911/0xc00 [10449.446344][ C1] ? lock_acquire+0x1c1/0x220 [10449.446751][ C1] ? __might_fault+0xc6/0x180 [10449.447134][ C1] ? __pfx_vfs_read+0x10/0x10 [10449.447524][ C1] ? __might_fault+0xc6/0x180 [10449.447932][ C1] ? lock_release+0x1d5/0x250 [10449.448337][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10449.448788][ C1] ? __fget_light+0x54/0x1e0 [10449.449191][ C1] ksys_read+0x17a/0x1e0 [10449.449548][ C1] ? __pfx_ksys_read+0x10/0x10 [10449.449967][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10449.540720][ C1] do_syscall_64+0xc9/0x1e0 [10449.541097][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10449.541572][ C1] RIP: 0033:0x7f08a1ea38b2 [10449.541935][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10449.543483][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10449.544154][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10449.544815][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10449.545484][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10449.546158][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10449.546795][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10449.547441][ C1] [10449.600500][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7540s! [swapper/2:0] [10449.601218][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10449.603246][ C2] irq event stamp: 44114564 [10449.603660][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10449.604581][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10449.605454][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10449.606226][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10449.606969][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10449.607696][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10449.608683][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10449.609224][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10449.690907][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10449.691356][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10449.691927][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10449.692550][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10449.693189][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10449.693832][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10449.694469][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10449.695167][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10449.695697][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10449.696350][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10449.696999][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10449.697652][ C2] PKRU: 55555554 [10449.697978][ C2] Call Trace: [10449.698274][ C2] [10449.698524][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10449.698971][ C2] ? __run_hrtimer+0x1c0/0x710 [10449.699393][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10449.699835][ C2] ? __hrtimer_run_queues+0x197/0x270 [10449.700263][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10449.820810][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10449.821230][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10449.821719][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10449.822161][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10449.822555][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10449.823025][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10449.823498][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10449.824019][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10449.824524][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10449.825009][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10449.825485][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10449.826013][ C2] ? get_stack_info+0x36/0xc0 [10449.826409][ C2] ? lock_acquire+0x1c1/0x220 [10449.826824][ C2] ? lock_release+0x1d5/0x250 [10449.827244][ C2] do_raw_spin_lock+0x1ec/0x270 [10449.827658][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10449.828096][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10449.828544][ C2] ? lock_acquire+0x1c1/0x220 [10449.828925][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10449.829322][ C2] _raw_spin_lock_nested+0x65/0x80 [10449.829752][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10449.830146][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10449.920662][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10449.921119][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10449.921586][ C2] ip_local_deliver_finish+0x2ae/0x480 [10449.922045][ C2] ip_local_deliver+0x19d/0x480 [10449.922443][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10449.922902][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10449.923321][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10449.923890][ C2] ? rcu_read_lock_held+0xe/0x50 [10449.924303][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10449.924840][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10449.925274][ C2] ip_rcv+0x564/0x740 [10449.925618][ C2] ? __pfx_ip_rcv+0x10/0x10 [10449.926007][ C2] ? set_track_prepare+0x8a/0xd0 [10449.926428][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10449.926891][ C2] ? start_secondary+0x21c/0x2b0 [10449.927318][ C2] ? skb_clone+0x10b/0x330 [10449.927701][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10449.928241][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10449.928751][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10449.929224][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10449.929717][ C2] ? __tcf_classify+0x329/0x7d0 [10449.930140][ C2] ? __pfx_ip_rcv+0x10/0x10 [10450.020643][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10450.021175][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10450.021652][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10450.022192][ C2] ? lock_acquire+0x1c1/0x220 [10450.022587][ C2] ? netif_receive_skb_internal+0x84/0x300 [10450.023082][ C2] netif_receive_skb_internal+0xb0/0x300 [10450.023553][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10450.024077][ C2] ? __copy_skb_header+0xaf/0x490 [10450.024492][ C2] ? __skb_clone+0x57a/0x760 [10450.024881][ C2] netif_receive_skb+0x55/0x280 [10450.025294][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10450.025798][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10450.026353][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10450.026848][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10450.027309][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10450.027785][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10450.028280][ C2] ? get_stack_info+0x36/0xc0 [10450.028691][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10450.029136][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10450.029670][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10450.030134][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10450.150806][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10450.151298][ C2] ? kernel_text_address+0x17/0xe0 [10450.151692][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10450.152139][ C2] ? arch_stack_walk+0x8c/0x100 [10450.152489][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10450.152868][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10450.153278][ C2] ? lock_acquire+0x1c1/0x220 [10450.153622][ C2] ? stack_depot_save_flags+0x281/0x550 [10450.154042][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10450.154488][ C2] ? get_stack_info_noinstr+0x18/0x110 [10450.154892][ C2] ? get_stack_info+0x36/0xc0 [10450.155244][ C2] __tcf_classify+0x329/0x7d0 [10450.155607][ C2] tcf_classify+0x283/0x930 [10450.155965][ C2] ? __pfx_tcf_classify+0x10/0x10 [10450.156369][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10450.156881][ C2] tc_run+0x2e4/0x5d0 [10450.157211][ C2] ? __pfx_tc_run+0x10/0x10 [10450.157584][ C2] ? lock_acquire+0x1c1/0x220 [10450.157976][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10450.158412][ C2] __dev_queue_xmit+0x686/0x17e0 [10450.158862][ C2] ? lock_acquire+0x1c1/0x220 [10450.159270][ C2] ? ip_finish_output2+0x786/0x18e0 [10450.159731][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10450.160233][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10450.250826][ C2] ? neigh_hh_output+0x348/0x590 [10450.251266][ C2] ? ip_finish_output2+0x262/0x18e0 [10450.251713][ C2] ip_finish_output2+0x786/0x18e0 [10450.252154][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10450.252710][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10450.253167][ C2] ? rcu_read_lock_held+0xe/0x50 [10450.253580][ C2] ? __ip_finish_output+0x10f/0x770 [10450.254012][ C2] ip_output+0x16b/0x4f0 [10450.254367][ C2] ? __pfx_ip_output+0x10/0x10 [10450.254764][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10450.255217][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10450.255719][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10450.256165][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10450.256570][ C2] ? __alloc_skb+0xd4/0x280 [10450.256946][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10450.257391][ C2] ? tcp_fragment+0x168/0x1040 [10450.257798][ C2] ? rcu_read_lock_held+0xe/0x50 [10450.258202][ C2] ? ip_local_out+0x114/0x3b0 [10450.258594][ C2] __ip_queue_xmit+0x672/0x1910 [10450.258999][ C2] ? __skb_clone+0x57a/0x760 [10450.259390][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10450.259832][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10450.260296][ C2] ? ipv4_dst_check+0xe3/0x170 [10450.360869][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10450.361289][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10450.361796][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10450.362322][ C2] ? tcp_fragment+0xb0e/0x1040 [10450.362731][ C2] tcp_send_loss_probe+0x348/0x830 [10450.363163][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10450.363607][ C2] tcp_write_timer+0x82/0x1d0 [10450.363996][ C2] call_timer_fn+0x173/0x430 [10450.364390][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10450.364830][ C2] ? next_expiry_recalc+0xcd/0x220 [10450.365266][ C2] __run_timers.part.0+0x52d/0x890 [10450.365722][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10450.366202][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10450.366708][ C2] ? lock_acquire+0x1c1/0x220 [10450.367114][ C2] ? clockevents_program_event+0xf6/0x300 [10450.367614][ C2] ? lock_release+0x1d5/0x250 [10450.368024][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10450.368473][ C2] ? ktime_get+0xb3/0x190 [10450.368830][ C2] ? clockevents_program_event+0x1ea/0x300 [10450.369324][ C2] run_timer_softirq+0x72/0x100 [10450.369756][ C2] __do_softirq+0x1b9/0x7ff [10450.370152][ C2] irq_exit_rcu+0x98/0xc0 [10450.460705][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10450.461193][ C2] [10450.461452][ C2] [10450.461702][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10450.462229][ C2] RIP: 0010:default_idle+0xf/0x20 [10450.462657][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10450.464300][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10450.464823][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10450.465498][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10450.466206][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10450.466900][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10450.467584][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10450.468265][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10450.468769][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10450.469212][ C2] default_idle_call+0x69/0xa0 [10450.469627][ C2] cpuidle_idle_call+0x1f6/0x280 [10450.470058][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10450.570681][ C2] ? lock_release+0x1d5/0x250 [10450.571123][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10450.571587][ C2] do_idle+0xfb/0x160 [10450.571941][ C2] cpu_startup_entry+0x55/0x60 [10450.572350][ C2] start_secondary+0x21c/0x2b0 [10450.572748][ C2] ? __pfx_start_secondary+0x10/0x10 [10450.573172][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10450.573670][ C2] [10476.580174][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7566s! [swapper/2:0] [10476.580922][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10476.582928][ C2] irq event stamp: 44114564 [10476.583303][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10476.584168][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10476.584986][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10476.585744][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10476.586494][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10476.587199][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10476.588176][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10476.588740][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10476.590333][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10476.660949][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10476.661601][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10476.662250][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10476.662905][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10476.663553][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10476.664198][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10476.664924][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10476.665462][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10476.666110][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10476.666779][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10476.667444][ C2] PKRU: 55555554 [10476.667758][ C2] Call Trace: [10476.668054][ C2] [10476.668296][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10476.668723][ C2] ? __run_hrtimer+0x1c0/0x710 [10476.669107][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10476.669549][ C2] ? __hrtimer_run_queues+0x197/0x270 [10476.669983][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10476.820539][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10476.821001][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10476.821522][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10476.821967][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10476.822394][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10476.822889][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10476.823371][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10476.823896][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10476.824377][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10476.824868][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10476.825348][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10476.825865][ C2] ? get_stack_info+0x36/0xc0 [10476.826267][ C2] ? lock_acquire+0x1c1/0x220 [10476.826670][ C2] ? lock_release+0x1d5/0x250 [10476.827069][ C2] do_raw_spin_lock+0x1ec/0x270 [10476.827485][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10476.827940][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10476.828416][ C2] ? lock_acquire+0x1c1/0x220 [10476.828812][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10476.829210][ C2] _raw_spin_lock_nested+0x65/0x80 [10476.829641][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10476.830034][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10476.950597][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10476.950991][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10476.951441][ C2] ip_local_deliver_finish+0x2ae/0x480 [10476.951888][ C2] ip_local_deliver+0x19d/0x480 [10476.952255][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10476.952690][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10476.953118][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10476.953706][ C2] ? rcu_read_lock_held+0xe/0x50 [10476.954132][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10476.954671][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10476.955115][ C2] ip_rcv+0x564/0x740 [10476.955466][ C2] ? __pfx_ip_rcv+0x10/0x10 [10476.955881][ C2] ? set_track_prepare+0x8a/0xd0 [10476.956327][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10476.956814][ C2] ? start_secondary+0x21c/0x2b0 [10476.957259][ C2] ? skb_clone+0x10b/0x330 [10476.957644][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10476.958188][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10476.958663][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10476.959174][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10476.959636][ C2] ? __tcf_classify+0x329/0x7d0 [10476.960056][ C2] ? __pfx_ip_rcv+0x10/0x10 [10477.088014][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10477.088510][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10477.088968][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10477.089488][ C2] ? lock_acquire+0x1c1/0x220 [10477.089873][ C2] ? netif_receive_skb_internal+0x84/0x300 [10477.090337][ C2] netif_receive_skb_internal+0xb0/0x300 [10477.090794][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10477.091292][ C2] ? __copy_skb_header+0xaf/0x490 [10477.091695][ C2] ? __skb_clone+0x57a/0x760 [10477.092050][ C2] netif_receive_skb+0x55/0x280 [10477.092445][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10477.092943][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10477.093478][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10477.093965][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10477.094443][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10477.094926][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10477.095461][ C2] ? get_stack_info+0x36/0xc0 [10477.095856][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10477.096285][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10477.096798][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10477.097243][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10477.097705][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10477.098212][ C2] ? kernel_text_address+0x17/0xe0 [10477.098632][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10477.099162][ C2] ? arch_stack_walk+0x8c/0x100 [10477.099581][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10477.100037][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10477.190595][ C2] ? lock_acquire+0x1c1/0x220 [10477.190989][ C2] ? stack_depot_save_flags+0x281/0x550 [10477.191443][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10477.191929][ C2] ? get_stack_info_noinstr+0x18/0x110 [10477.192372][ C2] ? get_stack_info+0x36/0xc0 [10477.192764][ C2] __tcf_classify+0x329/0x7d0 [10477.193161][ C2] tcf_classify+0x283/0x930 [10477.193539][ C2] ? __pfx_tcf_classify+0x10/0x10 [10477.193947][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10477.194464][ C2] tc_run+0x2e4/0x5d0 [10477.194793][ C2] ? __pfx_tc_run+0x10/0x10 [10477.195169][ C2] ? lock_acquire+0x1c1/0x220 [10477.195565][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10477.195986][ C2] __dev_queue_xmit+0x686/0x17e0 [10477.196386][ C2] ? lock_acquire+0x1c1/0x220 [10477.196731][ C2] ? ip_finish_output2+0x786/0x18e0 [10477.197131][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10477.197614][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10477.198067][ C2] ? neigh_hh_output+0x348/0x590 [10477.198471][ C2] ? ip_finish_output2+0x262/0x18e0 [10477.198896][ C2] ip_finish_output2+0x786/0x18e0 [10477.199312][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10477.199898][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10477.370483][ C2] ? rcu_read_lock_held+0xe/0x50 [10477.370911][ C2] ? __ip_finish_output+0x10f/0x770 [10477.371345][ C2] ip_output+0x16b/0x4f0 [10477.371699][ C2] ? __pfx_ip_output+0x10/0x10 [10477.372092][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10477.372544][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10477.373066][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10477.373519][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10477.373934][ C2] ? __alloc_skb+0xd4/0x280 [10477.374304][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10477.374761][ C2] ? tcp_fragment+0x168/0x1040 [10477.375164][ C2] ? rcu_read_lock_held+0xe/0x50 [10477.375576][ C2] ? ip_local_out+0x114/0x3b0 [10477.375978][ C2] __ip_queue_xmit+0x672/0x1910 [10477.376395][ C2] ? __skb_clone+0x57a/0x760 [10477.376785][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10477.377256][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10477.377750][ C2] ? ipv4_dst_check+0xe3/0x170 [10477.378160][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10477.378574][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10477.379065][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10477.379587][ C2] ? tcp_fragment+0xb0e/0x1040 [10477.379990][ C2] tcp_send_loss_probe+0x348/0x830 [10477.490552][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10477.491009][ C2] tcp_write_timer+0x82/0x1d0 [10477.491402][ C2] call_timer_fn+0x173/0x430 [10477.491793][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10477.492221][ C2] ? next_expiry_recalc+0xcd/0x220 [10477.492639][ C2] __run_timers.part.0+0x52d/0x890 [10477.493062][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10477.493501][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10477.493974][ C2] ? lock_acquire+0x1c1/0x220 [10477.494369][ C2] ? clockevents_program_event+0xf6/0x300 [10477.494895][ C2] ? lock_release+0x1d5/0x250 [10477.495300][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10477.495755][ C2] ? ktime_get+0xb3/0x190 [10477.496142][ C2] ? clockevents_program_event+0x1ea/0x300 [10477.496623][ C2] run_timer_softirq+0x72/0x100 [10477.497044][ C2] __do_softirq+0x1b9/0x7ff [10477.497428][ C2] irq_exit_rcu+0x98/0xc0 [10477.497792][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10477.498265][ C2] [10477.498510][ C2] [10477.498752][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10477.499253][ C2] RIP: 0010:default_idle+0xf/0x20 [10477.499677][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10477.611361][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10477.611863][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10477.612475][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10477.613109][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10477.613764][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10477.614412][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10477.615079][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10477.615568][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10477.615999][ C2] default_idle_call+0x69/0xa0 [10477.616404][ C2] cpuidle_idle_call+0x1f6/0x280 [10477.616822][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10477.617276][ C2] ? lock_release+0x1d5/0x250 [10477.617673][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10477.618167][ C2] do_idle+0xfb/0x160 [10477.618514][ C2] cpu_startup_entry+0x55/0x60 [10477.618921][ C2] start_secondary+0x21c/0x2b0 [10477.619345][ C2] ? __pfx_start_secondary+0x10/0x10 [10477.619790][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10477.620294][ C2] [10477.830151][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7566s! [perl:4135] [10477.830828][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10477.832776][ C1] irq event stamp: 209232 [10477.833133][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10477.833997][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10477.834781][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10477.835549][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10477.836312][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10477.837046][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10477.838055][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10477.838571][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [10477.840125][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10477.932016][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10477.932624][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10477.933263][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10477.933899][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10477.934520][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10477.935147][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10477.935843][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10477.936395][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10477.937039][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10477.937681][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10477.938319][ C1] PKRU: 55555554 [10477.938614][ C1] Call Trace: [10477.938897][ C1] [10477.939141][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10477.939570][ C1] ? __run_hrtimer+0x1c0/0x710 [10477.939981][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10478.031276][ C1] ? __hrtimer_run_queues+0x197/0x270 [10478.031709][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10478.032156][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10478.032531][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10478.032964][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10478.033333][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10478.033791][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10478.034193][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10478.034666][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10478.035113][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [10478.035554][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10478.035987][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10478.036451][ C1] ? get_stack_info+0x36/0xc0 [10478.036801][ C1] ? lock_acquire+0x1c1/0x220 [10478.037157][ C1] ? lock_release+0x1d5/0x250 [10478.037515][ C1] do_raw_spin_lock+0x1ec/0x270 [10478.037892][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10478.038313][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10478.038773][ C1] ? lock_acquire+0x1c1/0x220 [10478.039166][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10478.039559][ C1] _raw_spin_lock_nested+0x65/0x80 [10478.039973][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10478.100462][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10478.100915][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10478.101353][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10478.101818][ C1] ip_local_deliver_finish+0x2ae/0x480 [10478.102290][ C1] ip_local_deliver+0x19d/0x480 [10478.102662][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10478.103096][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10478.103528][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10478.104095][ C1] ? rcu_read_lock_held+0xe/0x50 [10478.104510][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10478.105031][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10478.105464][ C1] ip_rcv+0x564/0x740 [10478.105812][ C1] ? __pfx_ip_rcv+0x10/0x10 [10478.106198][ C1] ? set_track_prepare+0x8a/0xd0 [10478.106625][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10478.107087][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10478.107546][ C1] ? skb_clone+0x10b/0x330 [10478.107923][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10478.108461][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10478.108971][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10478.109444][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10478.109936][ C1] ? __tcf_classify+0x329/0x7d0 [10478.200443][ C1] ? __pfx_ip_rcv+0x10/0x10 [10478.200852][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10478.201355][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10478.201837][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10478.202385][ C1] ? lock_acquire+0x1c1/0x220 [10478.202784][ C1] ? netif_receive_skb_internal+0x84/0x300 [10478.203284][ C1] netif_receive_skb_internal+0xb0/0x300 [10478.203746][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10478.204258][ C1] ? __copy_skb_header+0xaf/0x490 [10478.204675][ C1] ? __skb_clone+0x57a/0x760 [10478.205056][ C1] netif_receive_skb+0x55/0x280 [10478.205462][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10478.205988][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10478.206545][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10478.207031][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10478.207479][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10478.207957][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10478.208476][ C1] ? hlock_class+0x4e/0x130 [10478.208862][ C1] ? get_stack_info_noinstr+0x18/0x110 [10478.209318][ C1] ? get_stack_info_noinstr+0x18/0x110 [10478.209771][ C1] ? __pfx_validate_chain+0x10/0x10 [10478.210205][ C1] ? hlock_class+0x4e/0x130 [10478.290692][ C1] ? mark_lock+0x38/0x3e0 [10478.291049][ C1] ? stack_access_ok+0xda/0x1f0 [10478.291440][ C1] ? __lock_acquire+0xb67/0x1610 [10478.291852][ C1] ? get_stack_info_noinstr+0x18/0x110 [10478.292295][ C1] ? get_stack_info+0x36/0xc0 [10478.292681][ C1] ? stack_access_ok+0xda/0x1f0 [10478.293071][ C1] ? get_reg+0x119/0x190 [10478.293411][ C1] ? unwind_next_frame+0x12af/0x1d10 [10478.293832][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10478.294337][ C1] __tcf_classify+0x329/0x7d0 [10478.294720][ C1] tcf_classify+0x283/0x930 [10478.295109][ C1] ? arch_stack_walk+0xa2/0x100 [10478.295518][ C1] ? __pfx_tcf_classify+0x10/0x10 [10478.295936][ C1] ? get_stack_info+0x36/0xc0 [10478.296334][ C1] tc_run+0x2e4/0x5d0 [10478.296667][ C1] ? __pfx_tc_run+0x10/0x10 [10478.297045][ C1] ? lock_acquire+0x1c1/0x220 [10478.297437][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10478.297861][ C1] __dev_queue_xmit+0x686/0x17e0 [10478.298274][ C1] ? lock_acquire+0x1c1/0x220 [10478.298662][ C1] ? ip_finish_output2+0x786/0x18e0 [10478.299084][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10478.299577][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10478.300035][ C1] ? neigh_hh_output+0x348/0x590 [10478.370552][ C1] ? ip_finish_output2+0x262/0x18e0 [10478.371013][ C1] ip_finish_output2+0x786/0x18e0 [10478.371430][ C1] ? stack_depot_save_flags+0x45/0x550 [10478.371867][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10478.372416][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10478.372881][ C1] ? rcu_read_lock_held+0xe/0x50 [10478.373293][ C1] ? __ip_finish_output+0x10f/0x770 [10478.373719][ C1] ip_output+0x16b/0x4f0 [10478.374080][ C1] ? run_timer_softirq+0x72/0x100 [10478.374492][ C1] ? __pfx_ip_output+0x10/0x10 [10478.374896][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10478.375377][ C1] ? rcu_read_lock_held+0xe/0x50 [10478.375801][ C1] ? ip_local_out+0x114/0x3b0 [10478.376194][ C1] __ip_queue_xmit+0x672/0x1910 [10478.376587][ C1] ? __create_object+0x5e/0xb0 [10478.376979][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10478.377408][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10478.377862][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10478.378321][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10478.378781][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10478.379226][ C1] tcp_delack_timer+0x84/0x240 [10478.379627][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10478.380076][ C1] call_timer_fn+0x173/0x430 [10478.440571][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10478.441007][ C1] ? next_expiry_recalc+0xcd/0x220 [10478.441444][ C1] __run_timers.part.0+0x52d/0x890 [10478.441897][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10478.442347][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10478.442812][ C1] ? lock_acquire+0x1c1/0x220 [10478.443211][ C1] ? clockevents_program_event+0xf6/0x300 [10478.443702][ C1] ? lock_release+0x1d5/0x250 [10478.444096][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10478.444533][ C1] ? ktime_get+0xb3/0x190 [10478.444893][ C1] ? clockevents_program_event+0x1ea/0x300 [10478.445383][ C1] run_timer_softirq+0x72/0x100 [10478.445807][ C1] __do_softirq+0x1b9/0x7ff [10478.446185][ C1] irq_exit_rcu+0x98/0xc0 [10478.446541][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10478.447021][ C1] [10478.447269][ C1] [10478.447514][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10478.448018][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10478.448553][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10478.450145][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10478.514633][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10478.515276][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10478.515894][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10478.516532][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10478.517178][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10478.517833][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10478.518326][ C1] pipe_read+0xa16/0xdf0 [10478.518689][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10478.519153][ C1] ? __pfx_pipe_read+0x10/0x10 [10478.519536][ C1] ? iterate_tty_write+0x299/0x540 [10478.519978][ C1] ? lock_release+0x1d5/0x250 [10478.530493][ C1] vfs_read+0x911/0xc00 [10478.530848][ C1] ? lock_acquire+0x1c1/0x220 [10478.531236][ C1] ? __might_fault+0xc6/0x180 [10478.531624][ C1] ? __pfx_vfs_read+0x10/0x10 [10478.532019][ C1] ? __might_fault+0xc6/0x180 [10478.532408][ C1] ? lock_release+0x1d5/0x250 [10478.532799][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10478.533235][ C1] ? __fget_light+0x54/0x1e0 [10478.533627][ C1] ksys_read+0x17a/0x1e0 [10478.533997][ C1] ? __pfx_ksys_read+0x10/0x10 [10478.534392][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10478.534882][ C1] do_syscall_64+0xc9/0x1e0 [10478.535256][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10478.535721][ C1] RIP: 0033:0x7f08a1ea38b2 [10478.536086][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10478.537642][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10478.538329][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10478.538986][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10478.539635][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10478.540280][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10478.661015][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10478.661688][ C1] [10500.809130][ C3] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [10500.809773][ C3] rcu: 1-....: (7940643 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1899330 [10500.810665][ C3] rcu: 2-....: (5 ticks this GP) idle=6c54/0/0x1 softirq=610529/610531 fqs=1899330 [10500.811468][ C3] rcu: (detected by 3, t=8145923 jiffies, g=1882453, q=724 ncpus=4) [10500.812148][ C3] Sending NMI from CPU 3 to CPUs 1: [10500.830289][ C1] NMI backtrace for cpu 1 [10500.830302][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10500.830309][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10500.830313][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10500.830327][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10500.830331][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10500.830337][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10500.830340][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10500.830343][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10500.830346][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10500.830349][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10500.830352][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10500.830355][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10500.830363][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10500.830366][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10500.830368][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10500.830371][ C1] PKRU: 55555554 [10500.830373][ C1] Call Trace: [10500.830379][ C1] [10500.830385][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10500.830398][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10500.830406][ C1] ? nmi_handle+0x153/0x420 [10500.830415][ C1] ? default_do_nmi+0x41/0x100 [10500.830421][ C1] ? exc_nmi+0xf3/0x120 [10500.830425][ C1] ? end_repeat_nmi+0xf/0x60 [10500.830435][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10500.830441][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10500.830446][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10500.830451][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10500.830456][ C1] [10500.830457][ C1] [10500.830460][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10500.830464][ C1] ? get_stack_info+0x36/0xc0 [10500.830470][ C1] ? lock_acquire+0x1c1/0x220 [10500.830477][ C1] ? lock_release+0x1d5/0x250 [10500.830483][ C1] do_raw_spin_lock+0x1ec/0x270 [10500.830490][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10500.830494][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10500.830500][ C1] ? lock_acquire+0x1c1/0x220 [10500.830504][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10500.830512][ C1] _raw_spin_lock_nested+0x65/0x80 [10500.830517][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10500.830529][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10500.830534][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10500.830543][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10500.830555][ C1] ip_local_deliver_finish+0x2ae/0x480 [10500.830561][ C1] ip_local_deliver+0x19d/0x480 [10500.830566][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10500.830570][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10500.830574][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10500.830584][ C1] ? rcu_read_lock_held+0xe/0x50 [10500.830591][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10500.830597][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10500.830614][ C1] ip_rcv+0x564/0x740 [10500.830619][ C1] ? __pfx_ip_rcv+0x10/0x10 [10500.830623][ C1] ? set_track_prepare+0x8a/0xd0 [10500.830631][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10500.830635][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10500.830640][ C1] ? skb_clone+0x10b/0x330 [10500.830646][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10500.830657][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10500.830666][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10500.830673][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10500.830688][ C1] ? __tcf_classify+0x329/0x7d0 [10500.830695][ C1] ? __pfx_ip_rcv+0x10/0x10 [10500.830699][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10500.830704][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10500.830710][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10500.830717][ C1] ? lock_acquire+0x1c1/0x220 [10500.830721][ C1] ? netif_receive_skb_internal+0x84/0x300 [10500.830727][ C1] netif_receive_skb_internal+0xb0/0x300 [10500.830733][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10500.830739][ C1] ? __copy_skb_header+0xaf/0x490 [10500.830747][ C1] ? __skb_clone+0x57a/0x760 [10500.830751][ C1] netif_receive_skb+0x55/0x280 [10500.830757][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10500.830773][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10500.830786][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10500.830799][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10500.830808][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10500.830827][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10500.830854][ C1] ? hlock_class+0x4e/0x130 [10500.830861][ C1] ? get_stack_info_noinstr+0x18/0x110 [10500.830867][ C1] ? get_stack_info_noinstr+0x18/0x110 [10500.830871][ C1] ? __pfx_validate_chain+0x10/0x10 [10500.830876][ C1] ? hlock_class+0x4e/0x130 [10500.830880][ C1] ? mark_lock+0x38/0x3e0 [10500.830884][ C1] ? stack_access_ok+0xda/0x1f0 [10500.830891][ C1] ? __lock_acquire+0xb67/0x1610 [10500.830899][ C1] ? get_stack_info_noinstr+0x18/0x110 [10500.830904][ C1] ? get_stack_info+0x36/0xc0 [10500.830910][ C1] ? stack_access_ok+0xda/0x1f0 [10500.830913][ C1] ? get_reg+0x119/0x190 [10500.830918][ C1] ? unwind_next_frame+0x12af/0x1d10 [10500.830923][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10500.830931][ C1] __tcf_classify+0x329/0x7d0 [10500.830940][ C1] tcf_classify+0x283/0x930 [10500.830947][ C1] ? arch_stack_walk+0xa2/0x100 [10500.830954][ C1] ? __pfx_tcf_classify+0x10/0x10 [10500.830960][ C1] ? get_stack_info+0x36/0xc0 [10500.830967][ C1] tc_run+0x2e4/0x5d0 [10500.830974][ C1] ? __pfx_tc_run+0x10/0x10 [10500.830979][ C1] ? lock_acquire+0x1c1/0x220 [10500.830983][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10500.830990][ C1] __dev_queue_xmit+0x686/0x17e0 [10500.830997][ C1] ? lock_acquire+0x1c1/0x220 [10500.831000][ C1] ? ip_finish_output2+0x786/0x18e0 [10500.831006][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10500.831013][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10500.831019][ C1] ? neigh_hh_output+0x348/0x590 [10500.831026][ C1] ? ip_finish_output2+0x262/0x18e0 [10500.831032][ C1] ip_finish_output2+0x786/0x18e0 [10500.831037][ C1] ? stack_depot_save_flags+0x45/0x550 [10500.831045][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10500.831059][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10500.831063][ C1] ? rcu_read_lock_held+0xe/0x50 [10500.831069][ C1] ? __ip_finish_output+0x10f/0x770 [10500.831075][ C1] ip_output+0x16b/0x4f0 [10500.831080][ C1] ? run_timer_softirq+0x72/0x100 [10500.831087][ C1] ? __pfx_ip_output+0x10/0x10 [10500.831091][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10500.831100][ C1] ? rcu_read_lock_held+0xe/0x50 [10500.831104][ C1] ? ip_local_out+0x114/0x3b0 [10500.831111][ C1] __ip_queue_xmit+0x672/0x1910 [10500.831117][ C1] ? __create_object+0x5e/0xb0 [10500.831123][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10500.831134][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10500.831141][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10500.831146][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10500.831151][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10500.831155][ C1] tcp_delack_timer+0x84/0x240 [10500.831161][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10500.831165][ C1] call_timer_fn+0x173/0x430 [10500.831171][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10500.831180][ C1] ? next_expiry_recalc+0xcd/0x220 [10500.831187][ C1] __run_timers.part.0+0x52d/0x890 [10500.831193][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10500.831201][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10500.831206][ C1] ? lock_acquire+0x1c1/0x220 [10500.831209][ C1] ? clockevents_program_event+0xf6/0x300 [10500.831217][ C1] ? lock_release+0x1d5/0x250 [10500.831222][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10500.831228][ C1] ? ktime_get+0xb3/0x190 [10500.831234][ C1] ? clockevents_program_event+0x1ea/0x300 [10500.831242][ C1] run_timer_softirq+0x72/0x100 [10500.831248][ C1] __do_softirq+0x1b9/0x7ff [10500.831255][ C1] irq_exit_rcu+0x98/0xc0 [10500.831260][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10500.831266][ C1] [10500.831268][ C1] [10500.831270][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10500.831277][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10500.831282][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10500.831286][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10500.831292][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10500.831294][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10500.831297][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10500.831299][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10500.831302][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10500.831309][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10500.831316][ C1] pipe_read+0xa16/0xdf0 [10500.831329][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10500.831336][ C1] ? __pfx_pipe_read+0x10/0x10 [10500.831341][ C1] ? iterate_tty_write+0x299/0x540 [10500.831349][ C1] ? lock_release+0x1d5/0x250 [10500.831354][ C1] vfs_read+0x911/0xc00 [10500.831362][ C1] ? lock_acquire+0x1c1/0x220 [10500.831365][ C1] ? __might_fault+0xc6/0x180 [10500.831372][ C1] ? __pfx_vfs_read+0x10/0x10 [10500.831377][ C1] ? __might_fault+0xc6/0x180 [10500.831382][ C1] ? lock_release+0x1d5/0x250 [10500.831387][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10500.831393][ C1] ? __fget_light+0x54/0x1e0 [10500.831401][ C1] ksys_read+0x17a/0x1e0 [10500.831408][ C1] ? __pfx_ksys_read+0x10/0x10 [10500.831415][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10500.831422][ C1] do_syscall_64+0xc9/0x1e0 [10500.831430][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10500.831435][ C1] RIP: 0033:0x7f08a1ea38b2 [10500.831442][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10500.831446][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10500.831451][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10500.831455][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10500.831458][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10500.831460][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10500.831463][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10500.831471][ C1] [10500.910289][ C3] Sending NMI from CPU 3 to CPUs 2: [10501.570297][ C2] NMI backtrace for cpu 2 [10501.570316][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10501.570328][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10501.570336][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10501.570359][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10501.570369][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10501.570379][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10501.570385][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10501.570392][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10501.570398][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10501.570405][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10501.570408][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10501.570411][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10501.570419][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10501.570423][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10501.570426][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10501.570429][ C2] PKRU: 55555554 [10501.570431][ C2] Call Trace: [10501.570440][ C2] [10501.570447][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10501.570459][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10501.570469][ C2] ? nmi_handle+0x153/0x420 [10501.570479][ C2] ? default_do_nmi+0x41/0x100 [10501.570485][ C2] ? exc_nmi+0xf3/0x120 [10501.570489][ C2] ? end_repeat_nmi+0xf/0x60 [10501.570501][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10501.570507][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10501.570513][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10501.570518][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10501.570523][ C2] [10501.570524][ C2] [10501.570527][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10501.570532][ C2] ? get_stack_info+0x36/0xc0 [10501.570539][ C2] ? lock_acquire+0x1c1/0x220 [10501.570548][ C2] ? lock_release+0x1d5/0x250 [10501.570554][ C2] do_raw_spin_lock+0x1ec/0x270 [10501.570561][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10501.570566][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10501.570572][ C2] ? lock_acquire+0x1c1/0x220 [10501.570576][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10501.570584][ C2] _raw_spin_lock_nested+0x65/0x80 [10501.570590][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10501.570603][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10501.570607][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10501.570617][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10501.570629][ C2] ip_local_deliver_finish+0x2ae/0x480 [10501.570636][ C2] ip_local_deliver+0x19d/0x480 [10501.570641][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10501.570645][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10501.570650][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10501.570661][ C2] ? rcu_read_lock_held+0xe/0x50 [10501.570669][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10501.570674][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10501.570693][ C2] ip_rcv+0x564/0x740 [10501.570698][ C2] ? __pfx_ip_rcv+0x10/0x10 [10501.570703][ C2] ? set_track_prepare+0x8a/0xd0 [10501.570711][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10501.570717][ C2] ? start_secondary+0x21c/0x2b0 [10501.570722][ C2] ? skb_clone+0x10b/0x330 [10501.570729][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10501.570741][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10501.570751][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10501.570759][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10501.570774][ C2] ? __tcf_classify+0x329/0x7d0 [10501.570782][ C2] ? __pfx_ip_rcv+0x10/0x10 [10501.570786][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10501.570793][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10501.570799][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10501.570806][ C2] ? lock_acquire+0x1c1/0x220 [10501.570810][ C2] ? netif_receive_skb_internal+0x84/0x300 [10501.570817][ C2] netif_receive_skb_internal+0xb0/0x300 [10501.570823][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10501.570830][ C2] ? __copy_skb_header+0xaf/0x490 [10501.570836][ C2] ? __skb_clone+0x57a/0x760 [10501.570840][ C2] netif_receive_skb+0x55/0x280 [10501.570845][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10501.570858][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10501.570872][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10501.570885][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10501.570893][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10501.570913][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10501.570927][ C2] ? get_stack_info+0x36/0xc0 [10501.570935][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10501.570941][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10501.570950][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10501.570954][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10501.570961][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10501.570965][ C2] ? kernel_text_address+0x17/0xe0 [10501.570972][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10501.570981][ C2] ? arch_stack_walk+0x8c/0x100 [10501.570988][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10501.570993][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10501.570999][ C2] ? lock_acquire+0x1c1/0x220 [10501.571003][ C2] ? stack_depot_save_flags+0x281/0x550 [10501.571011][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10501.571020][ C2] ? get_stack_info_noinstr+0x18/0x110 [10501.571025][ C2] ? get_stack_info+0x36/0xc0 [10501.571033][ C2] __tcf_classify+0x329/0x7d0 [10501.571043][ C2] tcf_classify+0x283/0x930 [10501.571050][ C2] ? __pfx_tcf_classify+0x10/0x10 [10501.571054][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10501.571061][ C2] tc_run+0x2e4/0x5d0 [10501.571068][ C2] ? __pfx_tc_run+0x10/0x10 [10501.571072][ C2] ? lock_acquire+0x1c1/0x220 [10501.571075][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10501.571081][ C2] __dev_queue_xmit+0x686/0x17e0 [10501.571088][ C2] ? lock_acquire+0x1c1/0x220 [10501.571091][ C2] ? ip_finish_output2+0x786/0x18e0 [10501.571097][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10501.571103][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10501.571107][ C2] ? neigh_hh_output+0x348/0x590 [10501.571113][ C2] ? ip_finish_output2+0x262/0x18e0 [10501.571119][ C2] ip_finish_output2+0x786/0x18e0 [10501.571126][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10501.571139][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10501.571144][ C2] ? rcu_read_lock_held+0xe/0x50 [10501.571151][ C2] ? __ip_finish_output+0x10f/0x770 [10501.571158][ C2] ip_output+0x16b/0x4f0 [10501.571165][ C2] ? __pfx_ip_output+0x10/0x10 [10501.571169][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10501.571174][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10501.571180][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10501.571186][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10501.571191][ C2] ? __alloc_skb+0xd4/0x280 [10501.571196][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10501.571205][ C2] ? tcp_fragment+0x168/0x1040 [10501.571212][ C2] ? rcu_read_lock_held+0xe/0x50 [10501.571217][ C2] ? ip_local_out+0x114/0x3b0 [10501.571223][ C2] __ip_queue_xmit+0x672/0x1910 [10501.571230][ C2] ? __skb_clone+0x57a/0x760 [10501.571235][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10501.571245][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10501.571251][ C2] ? ipv4_dst_check+0xe3/0x170 [10501.571259][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10501.571268][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10501.571276][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10501.571281][ C2] ? tcp_fragment+0xb0e/0x1040 [10501.571286][ C2] tcp_send_loss_probe+0x348/0x830 [10501.571291][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10501.571296][ C2] tcp_write_timer+0x82/0x1d0 [10501.571302][ C2] call_timer_fn+0x173/0x430 [10501.571310][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10501.571319][ C2] ? next_expiry_recalc+0xcd/0x220 [10501.571326][ C2] __run_timers.part.0+0x52d/0x890 [10501.571332][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10501.571340][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10501.571346][ C2] ? lock_acquire+0x1c1/0x220 [10501.571349][ C2] ? clockevents_program_event+0xf6/0x300 [10501.571358][ C2] ? lock_release+0x1d5/0x250 [10501.571363][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10501.571370][ C2] ? ktime_get+0xb3/0x190 [10501.571378][ C2] ? clockevents_program_event+0x1ea/0x300 [10501.571385][ C2] run_timer_softirq+0x72/0x100 [10501.571391][ C2] __do_softirq+0x1b9/0x7ff [10501.571399][ C2] irq_exit_rcu+0x98/0xc0 [10501.571405][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10501.571412][ C2] [10501.571414][ C2] [10501.571416][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10501.571422][ C2] RIP: 0010:default_idle+0xf/0x20 [10501.571429][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10501.571434][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10501.571439][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10501.571443][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10501.571446][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10501.571448][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10501.571451][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10501.571457][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10501.571463][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10501.571471][ C2] default_idle_call+0x69/0xa0 [10501.571477][ C2] cpuidle_idle_call+0x1f6/0x280 [10501.571481][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10501.571489][ C2] ? lock_release+0x1d5/0x250 [10501.571494][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10501.571501][ C2] do_idle+0xfb/0x160 [10501.571507][ C2] cpu_startup_entry+0x55/0x60 [10501.571512][ C2] start_secondary+0x21c/0x2b0 [10501.571518][ C2] ? __pfx_start_secondary+0x10/0x10 [10501.571525][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10501.571538][ C2] [10528.580181][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7614s! [perl:4135] [10528.580910][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10528.582888][ C1] irq event stamp: 209232 [10528.583256][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10528.584121][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10528.584900][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10528.585665][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10528.586409][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10528.587136][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10528.588138][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10528.588663][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10528.770419][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10528.770929][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10528.771577][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10528.772203][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10528.772799][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10528.773421][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10528.774028][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10528.774722][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10528.775250][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10528.775895][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10528.776543][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10528.777175][ C1] PKRU: 55555554 [10528.777469][ C1] Call Trace: [10528.777743][ C1] [10528.777982][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10528.778406][ C1] ? __run_hrtimer+0x1c0/0x710 [10528.778796][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10528.779235][ C1] ? __hrtimer_run_queues+0x197/0x270 [10528.779667][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10528.880161][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10528.880665][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10528.881171][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10528.881606][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10528.882099][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10528.882564][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10528.883051][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10528.883536][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10528.884024][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10528.884500][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10528.885013][ C1] ? get_stack_info+0x36/0xc0 [10528.885403][ C1] ? lock_acquire+0x1c1/0x220 [10528.885771][ C1] ? lock_release+0x1d5/0x250 [10528.886157][ C1] do_raw_spin_lock+0x1ec/0x270 [10528.886546][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10528.886980][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10528.887456][ C1] ? lock_acquire+0x1c1/0x220 [10528.887853][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10528.888243][ C1] _raw_spin_lock_nested+0x65/0x80 [10528.888673][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10528.889059][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10528.889468][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10528.889901][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10529.040457][ C1] ip_local_deliver_finish+0x2ae/0x480 [10529.040926][ C1] ip_local_deliver+0x19d/0x480 [10529.041321][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10529.041755][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10529.042187][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10529.042747][ C1] ? rcu_read_lock_held+0xe/0x50 [10529.043155][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10529.043679][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10529.044126][ C1] ip_rcv+0x564/0x740 [10529.044473][ C1] ? __pfx_ip_rcv+0x10/0x10 [10529.044850][ C1] ? set_track_prepare+0x8a/0xd0 [10529.045268][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10529.045730][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10529.046188][ C1] ? skb_clone+0x10b/0x330 [10529.046562][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10529.047083][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10529.047607][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10529.048082][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10529.048573][ C1] ? __tcf_classify+0x329/0x7d0 [10529.048990][ C1] ? __pfx_ip_rcv+0x10/0x10 [10529.049371][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10529.049874][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10529.170457][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10529.171002][ C1] ? lock_acquire+0x1c1/0x220 [10529.171384][ C1] ? netif_receive_skb_internal+0x84/0x300 [10529.171856][ C1] netif_receive_skb_internal+0xb0/0x300 [10529.172304][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10529.172802][ C1] ? __copy_skb_header+0xaf/0x490 [10529.173212][ C1] ? __skb_clone+0x57a/0x760 [10529.173579][ C1] netif_receive_skb+0x55/0x280 [10529.174005][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10529.174518][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10529.175058][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10529.175543][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10529.176004][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10529.176466][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10529.176968][ C1] ? hlock_class+0x4e/0x130 [10529.177364][ C1] ? get_stack_info_noinstr+0x18/0x110 [10529.177818][ C1] ? get_stack_info_noinstr+0x18/0x110 [10529.178265][ C1] ? __pfx_validate_chain+0x10/0x10 [10529.178691][ C1] ? hlock_class+0x4e/0x130 [10529.179069][ C1] ? mark_lock+0x38/0x3e0 [10529.179418][ C1] ? stack_access_ok+0xda/0x1f0 [10529.179826][ C1] ? __lock_acquire+0xb67/0x1610 [10529.310324][ C1] ? get_stack_info_noinstr+0x18/0x110 [10529.310789][ C1] ? get_stack_info+0x36/0xc0 [10529.311169][ C1] ? stack_access_ok+0xda/0x1f0 [10529.311563][ C1] ? get_reg+0x119/0x190 [10529.311908][ C1] ? unwind_next_frame+0x12af/0x1d10 [10529.312334][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10529.312834][ C1] __tcf_classify+0x329/0x7d0 [10529.313222][ C1] tcf_classify+0x283/0x930 [10529.313595][ C1] ? arch_stack_walk+0xa2/0x100 [10529.314012][ C1] ? __pfx_tcf_classify+0x10/0x10 [10529.314444][ C1] ? get_stack_info+0x36/0xc0 [10529.314837][ C1] tc_run+0x2e4/0x5d0 [10529.315177][ C1] ? __pfx_tc_run+0x10/0x10 [10529.315549][ C1] ? lock_acquire+0x1c1/0x220 [10529.315937][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10529.316396][ C1] __dev_queue_xmit+0x686/0x17e0 [10529.316824][ C1] ? lock_acquire+0x1c1/0x220 [10529.317210][ C1] ? ip_finish_output2+0x786/0x18e0 [10529.317631][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10529.318140][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10529.318588][ C1] ? neigh_hh_output+0x348/0x590 [10529.318996][ C1] ? ip_finish_output2+0x262/0x18e0 [10529.319416][ C1] ip_finish_output2+0x786/0x18e0 [10529.319835][ C1] ? stack_depot_save_flags+0x45/0x550 [10529.450433][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10529.450984][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10529.451452][ C1] ? rcu_read_lock_held+0xe/0x50 [10529.451865][ C1] ? __ip_finish_output+0x10f/0x770 [10529.452294][ C1] ip_output+0x16b/0x4f0 [10529.452641][ C1] ? run_timer_softirq+0x72/0x100 [10529.453062][ C1] ? __pfx_ip_output+0x10/0x10 [10529.453480][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10529.453959][ C1] ? rcu_read_lock_held+0xe/0x50 [10529.454384][ C1] ? ip_local_out+0x114/0x3b0 [10529.454788][ C1] __ip_queue_xmit+0x672/0x1910 [10529.455206][ C1] ? __create_object+0x5e/0xb0 [10529.455616][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10529.456059][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10529.456519][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10529.456992][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10529.457462][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10529.457899][ C1] tcp_delack_timer+0x84/0x240 [10529.458305][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10529.458763][ C1] call_timer_fn+0x173/0x430 [10529.459155][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10529.459588][ C1] ? next_expiry_recalc+0xcd/0x220 [10529.460022][ C1] __run_timers.part.0+0x52d/0x890 [10529.570509][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10529.570978][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10529.571453][ C1] ? lock_acquire+0x1c1/0x220 [10529.571850][ C1] ? clockevents_program_event+0xf6/0x300 [10529.572326][ C1] ? lock_release+0x1d5/0x250 [10529.572713][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10529.573151][ C1] ? ktime_get+0xb3/0x190 [10529.573518][ C1] ? clockevents_program_event+0x1ea/0x300 [10529.574019][ C1] run_timer_softirq+0x72/0x100 [10529.574438][ C1] __do_softirq+0x1b9/0x7ff [10529.574816][ C1] irq_exit_rcu+0x98/0xc0 [10529.575179][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10529.575642][ C1] [10529.575884][ C1] [10529.576145][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10529.576652][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10529.577188][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10529.578777][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10529.579293][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10529.579948][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10529.730659][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10529.731287][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10529.731924][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10529.732539][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10529.732999][ C1] pipe_read+0xa16/0xdf0 [10529.733338][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10529.733791][ C1] ? __pfx_pipe_read+0x10/0x10 [10529.734185][ C1] ? iterate_tty_write+0x299/0x540 [10529.734603][ C1] ? lock_release+0x1d5/0x250 [10529.734987][ C1] vfs_read+0x911/0xc00 [10529.735329][ C1] ? lock_acquire+0x1c1/0x220 [10529.735710][ C1] ? __might_fault+0xc6/0x180 [10529.736098][ C1] ? __pfx_vfs_read+0x10/0x10 [10529.736478][ C1] ? __might_fault+0xc6/0x180 [10529.736859][ C1] ? lock_release+0x1d5/0x250 [10529.737257][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10529.737681][ C1] ? __fget_light+0x54/0x1e0 [10529.738046][ C1] ksys_read+0x17a/0x1e0 [10529.738385][ C1] ? __pfx_ksys_read+0x10/0x10 [10529.738771][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10529.739240][ C1] do_syscall_64+0xc9/0x1e0 [10529.739610][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10529.740078][ C1] RIP: 0033:0x7f08a1ea38b2 [10529.860543][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10529.862115][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10529.862789][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10529.863423][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10529.864056][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10529.864715][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10529.865363][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10529.866027][ C1] [10529.970163][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7614s! [swapper/2:0] [10529.970932][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10529.972942][ C2] irq event stamp: 44114564 [10529.973321][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10529.974195][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10529.975007][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10529.975779][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10529.976539][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10529.977280][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10529.978255][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10529.978775][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10530.080422][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10530.080894][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10530.081490][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10530.082131][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10530.082770][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10530.083412][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10530.084049][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10530.084752][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10530.085280][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10530.085928][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10530.086561][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10530.087204][ C2] PKRU: 55555554 [10530.087486][ C2] Call Trace: [10530.087753][ C2] [10530.087991][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10530.088411][ C2] ? __run_hrtimer+0x1c0/0x710 [10530.088801][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10530.089245][ C2] ? __hrtimer_run_queues+0x197/0x270 [10530.089687][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10530.180319][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10530.180773][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10530.181287][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10530.181723][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10530.182145][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10530.182653][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10530.183147][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10530.183668][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10530.184142][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10530.184635][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10530.185116][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10530.185637][ C2] ? get_stack_info+0x36/0xc0 [10530.186040][ C2] ? lock_acquire+0x1c1/0x220 [10530.186450][ C2] ? lock_release+0x1d5/0x250 [10530.186868][ C2] do_raw_spin_lock+0x1ec/0x270 [10530.187277][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10530.187691][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10530.188108][ C2] ? lock_acquire+0x1c1/0x220 [10530.188475][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10530.188841][ C2] _raw_spin_lock_nested+0x65/0x80 [10530.189244][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10530.189617][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10530.190011][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10530.280552][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10530.281025][ C2] ip_local_deliver_finish+0x2ae/0x480 [10530.281490][ C2] ip_local_deliver+0x19d/0x480 [10530.281893][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10530.282341][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10530.282775][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10530.283345][ C2] ? rcu_read_lock_held+0xe/0x50 [10530.283761][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10530.284286][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10530.284715][ C2] ip_rcv+0x564/0x740 [10530.285052][ C2] ? __pfx_ip_rcv+0x10/0x10 [10530.285425][ C2] ? set_track_prepare+0x8a/0xd0 [10530.285836][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10530.286291][ C2] ? start_secondary+0x21c/0x2b0 [10530.286704][ C2] ? skb_clone+0x10b/0x330 [10530.287082][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10530.287603][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10530.288147][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10530.288642][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10530.304475][ C2] ? __tcf_classify+0x329/0x7d0 [10530.304886][ C2] ? __pfx_ip_rcv+0x10/0x10 [10530.305256][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10530.305754][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10530.306206][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10530.306702][ C2] ? lock_acquire+0x1c1/0x220 [10530.307065][ C2] ? netif_receive_skb_internal+0x84/0x300 [10530.307520][ C2] netif_receive_skb_internal+0xb0/0x300 [10530.307949][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10530.308423][ C2] ? __copy_skb_header+0xaf/0x490 [10530.308818][ C2] ? __skb_clone+0x57a/0x760 [10530.309188][ C2] netif_receive_skb+0x55/0x280 [10530.309565][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10530.310052][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10530.420667][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10530.421088][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10530.421466][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10530.421873][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10530.422399][ C2] ? get_stack_info+0x36/0xc0 [10530.422748][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10530.423127][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10530.423578][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10530.423968][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10530.424359][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10530.424801][ C2] ? kernel_text_address+0x17/0xe0 [10530.425170][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10530.425629][ C2] ? arch_stack_walk+0x8c/0x100 [10530.425990][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10530.426375][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10530.426787][ C2] ? lock_acquire+0x1c1/0x220 [10530.427132][ C2] ? stack_depot_save_flags+0x281/0x550 [10530.427538][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10530.427986][ C2] ? get_stack_info_noinstr+0x18/0x110 [10530.428386][ C2] ? get_stack_info+0x36/0xc0 [10530.428734][ C2] __tcf_classify+0x329/0x7d0 [10530.429081][ C2] tcf_classify+0x283/0x930 [10530.429406][ C2] ? __pfx_tcf_classify+0x10/0x10 [10530.429765][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10530.430252][ C2] tc_run+0x2e4/0x5d0 [10530.430598][ C2] ? __pfx_tc_run+0x10/0x10 [10530.430977][ C2] ? lock_acquire+0x1c1/0x220 [10530.431370][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10530.431801][ C2] __dev_queue_xmit+0x686/0x17e0 [10530.432219][ C2] ? lock_acquire+0x1c1/0x220 [10530.432610][ C2] ? ip_finish_output2+0x786/0x18e0 [10530.433045][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10530.433527][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10530.433964][ C2] ? neigh_hh_output+0x348/0x590 [10530.434379][ C2] ? ip_finish_output2+0x262/0x18e0 [10530.434800][ C2] ip_finish_output2+0x786/0x18e0 [10530.435234][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10530.435800][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10530.436251][ C2] ? rcu_read_lock_held+0xe/0x50 [10530.436676][ C2] ? __ip_finish_output+0x10f/0x770 [10530.437115][ C2] ip_output+0x16b/0x4f0 [10530.437498][ C2] ? __pfx_ip_output+0x10/0x10 [10530.437903][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10530.438365][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10530.438904][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10530.439357][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10530.439772][ C2] ? __alloc_skb+0xd4/0x280 [10530.546292][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10530.546754][ C2] ? tcp_fragment+0x168/0x1040 [10530.547165][ C2] ? rcu_read_lock_held+0xe/0x50 [10530.547590][ C2] ? ip_local_out+0x114/0x3b0 [10530.547996][ C2] __ip_queue_xmit+0x672/0x1910 [10530.548410][ C2] ? __skb_clone+0x57a/0x760 [10530.548816][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10530.549276][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10530.549756][ C2] ? ipv4_dst_check+0xe3/0x170 [10530.580318][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10530.580765][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10530.581284][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10530.581789][ C2] ? tcp_fragment+0xb0e/0x1040 [10530.582171][ C2] tcp_send_loss_probe+0x348/0x830 [10530.582604][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10530.583040][ C2] tcp_write_timer+0x82/0x1d0 [10530.583438][ C2] call_timer_fn+0x173/0x430 [10530.583837][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10530.584271][ C2] ? next_expiry_recalc+0xcd/0x220 [10530.584709][ C2] __run_timers.part.0+0x52d/0x890 [10530.585135][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10530.585575][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10530.586041][ C2] ? lock_acquire+0x1c1/0x220 [10530.586443][ C2] ? clockevents_program_event+0xf6/0x300 [10530.586934][ C2] ? lock_release+0x1d5/0x250 [10530.587333][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10530.587768][ C2] ? ktime_get+0xb3/0x190 [10530.588133][ C2] ? clockevents_program_event+0x1ea/0x300 [10530.588627][ C2] run_timer_softirq+0x72/0x100 [10530.589041][ C2] __do_softirq+0x1b9/0x7ff [10530.589437][ C2] irq_exit_rcu+0x98/0xc0 [10530.589805][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10530.730408][ C2] [10530.730650][ C2] [10530.730891][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10530.731387][ C2] RIP: 0010:default_idle+0xf/0x20 [10530.731798][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10530.733502][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10530.734003][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10530.734648][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10530.735293][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10530.735919][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10530.736553][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10530.737204][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10530.737708][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10530.738146][ C2] default_idle_call+0x69/0xa0 [10530.738564][ C2] cpuidle_idle_call+0x1f6/0x280 [10530.738984][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10530.739444][ C2] ? lock_release+0x1d5/0x250 [10530.739824][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10530.785493][ C2] do_idle+0xfb/0x160 [10530.785851][ C2] cpu_startup_entry+0x55/0x60 [10530.786259][ C2] start_secondary+0x21c/0x2b0 [10530.786669][ C2] ? __pfx_start_secondary+0x10/0x10 [10530.787118][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10530.787635][ C2] [10556.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7640s! [perl:4135] [10556.569964][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10556.602955][ C1] irq event stamp: 209232 [10556.603329][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10556.604193][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10556.604994][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10556.605787][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10556.606569][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10556.607332][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10556.608350][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10556.608908][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10556.680647][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10556.681122][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10556.681730][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10556.682359][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10556.682984][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10556.683635][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10556.684283][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10556.685005][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10556.685530][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10556.686157][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10556.686809][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10556.687453][ C1] PKRU: 55555554 [10556.687759][ C1] Call Trace: [10556.688027][ C1] [10556.688264][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10556.688678][ C1] ? __run_hrtimer+0x1c0/0x710 [10556.689048][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10556.689491][ C1] ? __hrtimer_run_queues+0x197/0x270 [10556.689922][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10556.760473][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10556.760906][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10556.761378][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10556.761798][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10556.762307][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10556.762784][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10556.763304][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10556.763765][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10556.764251][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10556.764741][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10556.765238][ C1] ? get_stack_info+0x36/0xc0 [10556.765620][ C1] ? lock_acquire+0x1c1/0x220 [10556.765989][ C1] ? lock_release+0x1d5/0x250 [10556.766394][ C1] do_raw_spin_lock+0x1ec/0x270 [10556.766801][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10556.767243][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10556.767708][ C1] ? lock_acquire+0x1c1/0x220 [10556.768099][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10556.768494][ C1] _raw_spin_lock_nested+0x65/0x80 [10556.768918][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10556.769295][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10556.769696][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10556.840211][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10556.840647][ C1] ip_local_deliver_finish+0x2ae/0x480 [10556.841081][ C1] ip_local_deliver+0x19d/0x480 [10556.841451][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10556.841882][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10556.842302][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10556.842851][ C1] ? rcu_read_lock_held+0xe/0x50 [10556.843243][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10556.843754][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10556.844187][ C1] ip_rcv+0x564/0x740 [10556.844504][ C1] ? __pfx_ip_rcv+0x10/0x10 [10556.844861][ C1] ? set_track_prepare+0x8a/0xd0 [10556.845245][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10556.845673][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10556.846114][ C1] ? skb_clone+0x10b/0x330 [10556.846477][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10556.846989][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10556.847474][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10556.847922][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10556.848397][ C1] ? __tcf_classify+0x329/0x7d0 [10556.848801][ C1] ? __pfx_ip_rcv+0x10/0x10 [10556.849161][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10556.849649][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10556.890201][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10556.890719][ C1] ? lock_acquire+0x1c1/0x220 [10556.891103][ C1] ? netif_receive_skb_internal+0x84/0x300 [10556.891566][ C1] netif_receive_skb_internal+0xb0/0x300 [10556.892030][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10556.892536][ C1] ? __copy_skb_header+0xaf/0x490 [10556.892954][ C1] ? __skb_clone+0x57a/0x760 [10556.893344][ C1] netif_receive_skb+0x55/0x280 [10556.893753][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10556.894275][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10556.894809][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10556.895285][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10556.895733][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10556.896206][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10556.896719][ C1] ? hlock_class+0x4e/0x130 [10556.897098][ C1] ? get_stack_info_noinstr+0x18/0x110 [10556.897551][ C1] ? get_stack_info_noinstr+0x18/0x110 [10556.897994][ C1] ? __pfx_validate_chain+0x10/0x10 [10556.898404][ C1] ? hlock_class+0x4e/0x130 [10556.898767][ C1] ? mark_lock+0x38/0x3e0 [10556.899113][ C1] ? stack_access_ok+0xda/0x1f0 [10556.899502][ C1] ? __lock_acquire+0xb67/0x1610 [10556.899908][ C1] ? get_stack_info_noinstr+0x18/0x110 [10557.040420][ C1] ? get_stack_info+0x36/0xc0 [10557.040770][ C1] ? stack_access_ok+0xda/0x1f0 [10557.041142][ C1] ? get_reg+0x119/0x190 [10557.041443][ C1] ? unwind_next_frame+0x12af/0x1d10 [10557.041818][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10557.042259][ C1] __tcf_classify+0x329/0x7d0 [10557.042587][ C1] tcf_classify+0x283/0x930 [10557.042907][ C1] ? arch_stack_walk+0xa2/0x100 [10557.043248][ C1] ? __pfx_tcf_classify+0x10/0x10 [10557.043600][ C1] ? get_stack_info+0x36/0xc0 [10557.043934][ C1] tc_run+0x2e4/0x5d0 [10557.044233][ C1] ? __pfx_tc_run+0x10/0x10 [10557.044547][ C1] ? lock_acquire+0x1c1/0x220 [10557.044867][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10557.045244][ C1] __dev_queue_xmit+0x686/0x17e0 [10557.045602][ C1] ? lock_acquire+0x1c1/0x220 [10557.045949][ C1] ? ip_finish_output2+0x786/0x18e0 [10557.046336][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10557.046769][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10557.047134][ C1] ? neigh_hh_output+0x348/0x590 [10557.047491][ C1] ? ip_finish_output2+0x262/0x18e0 [10557.047846][ C1] ip_finish_output2+0x786/0x18e0 [10557.048216][ C1] ? stack_depot_save_flags+0x45/0x550 [10557.048660][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10557.049187][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10557.049619][ C1] ? rcu_read_lock_held+0xe/0x50 [10557.070127][ C1] ? __ip_finish_output+0x10f/0x770 [10557.070556][ C1] ip_output+0x16b/0x4f0 [10557.070904][ C1] ? run_timer_softirq+0x72/0x100 [10557.071320][ C1] ? __pfx_ip_output+0x10/0x10 [10557.071674][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10557.072059][ C1] ? rcu_read_lock_held+0xe/0x50 [10557.072397][ C1] ? ip_local_out+0x114/0x3b0 [10557.072743][ C1] __ip_queue_xmit+0x672/0x1910 [10557.073093][ C1] ? __create_object+0x5e/0xb0 [10557.073497][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10557.073943][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10557.074409][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10557.074860][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10557.075336][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10557.075777][ C1] tcp_delack_timer+0x84/0x240 [10557.076175][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10557.076618][ C1] call_timer_fn+0x173/0x430 [10557.077021][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10557.077452][ C1] ? next_expiry_recalc+0xcd/0x220 [10557.077882][ C1] __run_timers.part.0+0x52d/0x890 [10557.078313][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10557.078759][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10557.079229][ C1] ? lock_acquire+0x1c1/0x220 [10557.079623][ C1] ? clockevents_program_event+0xf6/0x300 [10557.130212][ C1] ? lock_release+0x1d5/0x250 [10557.130595][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10557.131031][ C1] ? ktime_get+0xb3/0x190 [10557.131384][ C1] ? clockevents_program_event+0x1ea/0x300 [10557.131847][ C1] run_timer_softirq+0x72/0x100 [10557.132238][ C1] __do_softirq+0x1b9/0x7ff [10557.132617][ C1] irq_exit_rcu+0x98/0xc0 [10557.132972][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10557.133432][ C1] [10557.133667][ C1] [10557.133910][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10557.134416][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10557.134933][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10557.136474][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10557.136979][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10557.137638][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10557.138295][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10557.138952][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10557.139591][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10557.220340][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10557.220804][ C1] pipe_read+0xa16/0xdf0 [10557.221148][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10557.221571][ C1] ? __pfx_pipe_read+0x10/0x10 [10557.221945][ C1] ? iterate_tty_write+0x299/0x540 [10557.222343][ C1] ? lock_release+0x1d5/0x250 [10557.222743][ C1] vfs_read+0x911/0xc00 [10557.223083][ C1] ? lock_acquire+0x1c1/0x220 [10557.223461][ C1] ? __might_fault+0xc6/0x180 [10557.223837][ C1] ? __pfx_vfs_read+0x10/0x10 [10557.224219][ C1] ? __might_fault+0xc6/0x180 [10557.224596][ C1] ? lock_release+0x1d5/0x250 [10557.224976][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10557.225409][ C1] ? __fget_light+0x54/0x1e0 [10557.225779][ C1] ksys_read+0x17a/0x1e0 [10557.226120][ C1] ? __pfx_ksys_read+0x10/0x10 [10557.226501][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10557.226994][ C1] do_syscall_64+0xc9/0x1e0 [10557.227370][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10557.227855][ C1] RIP: 0033:0x7f08a1ea38b2 [10557.228219][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10557.229751][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10557.310550][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10557.311131][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10557.311699][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10557.312270][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10557.312868][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10557.313500][ C1] [10557.313812][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7640s! [swapper/2:0] [10557.314480][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10557.316294][ C2] irq event stamp: 44114564 [10557.316645][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10557.317445][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10557.318247][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10557.319028][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10557.319781][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10557.380615][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10557.381575][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10557.382105][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10557.383645][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10557.384154][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10557.384790][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10557.385362][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10557.385904][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10557.386473][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10557.387055][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10557.387726][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10557.388240][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10557.388857][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10557.389477][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10557.424356][ C2] PKRU: 55555554 [10557.424669][ C2] Call Trace: [10557.424972][ C2] [10557.425215][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10557.425643][ C2] ? __run_hrtimer+0x1c0/0x710 [10557.426036][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10557.426487][ C2] ? __hrtimer_run_queues+0x197/0x270 [10557.426919][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10557.427405][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10557.427841][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10557.428347][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10557.428801][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10557.429237][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10557.429770][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10557.470389][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10557.470924][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10557.471401][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10557.471891][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10557.472365][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10557.472881][ C2] ? get_stack_info+0x36/0xc0 [10557.473277][ C2] ? lock_acquire+0x1c1/0x220 [10557.473677][ C2] ? lock_release+0x1d5/0x250 [10557.474076][ C2] do_raw_spin_lock+0x1ec/0x270 [10557.474484][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10557.474948][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10557.475425][ C2] ? lock_acquire+0x1c1/0x220 [10557.475826][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10557.476245][ C2] _raw_spin_lock_nested+0x65/0x80 [10557.476679][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10557.477061][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10557.477466][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10557.477889][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10557.478345][ C2] ip_local_deliver_finish+0x2ae/0x480 [10557.478796][ C2] ip_local_deliver+0x19d/0x480 [10557.479200][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10557.479643][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10557.580222][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10557.580815][ C2] ? rcu_read_lock_held+0xe/0x50 [10557.581234][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10557.581760][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10557.582194][ C2] ip_rcv+0x564/0x740 [10557.582539][ C2] ? __pfx_ip_rcv+0x10/0x10 [10557.582921][ C2] ? set_track_prepare+0x8a/0xd0 [10557.583344][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10557.583798][ C2] ? start_secondary+0x21c/0x2b0 [10557.584226][ C2] ? skb_clone+0x10b/0x330 [10557.584607][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10557.585142][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10557.585655][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10557.586130][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10557.586628][ C2] ? __tcf_classify+0x329/0x7d0 [10557.587049][ C2] ? __pfx_ip_rcv+0x10/0x10 [10557.587440][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10557.587951][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10557.588435][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10557.588981][ C2] ? lock_acquire+0x1c1/0x220 [10557.589389][ C2] ? netif_receive_skb_internal+0x84/0x300 [10557.589883][ C2] netif_receive_skb_internal+0xb0/0x300 [10557.660504][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10557.660971][ C2] ? __copy_skb_header+0xaf/0x490 [10557.661352][ C2] ? __skb_clone+0x57a/0x760 [10557.661691][ C2] netif_receive_skb+0x55/0x280 [10557.662064][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10557.662551][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10557.663033][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10557.663469][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10557.663873][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10557.664295][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10557.664739][ C2] ? get_stack_info+0x36/0xc0 [10557.665101][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10557.665499][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10557.666001][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10557.666438][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10557.666877][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10557.667383][ C2] ? kernel_text_address+0x17/0xe0 [10557.667797][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10557.668282][ C2] ? arch_stack_walk+0x8c/0x100 [10557.668673][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10557.669118][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10557.669583][ C2] ? lock_acquire+0x1c1/0x220 [10557.669970][ C2] ? stack_depot_save_flags+0x281/0x550 [10557.724707][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10557.725224][ C2] ? get_stack_info_noinstr+0x18/0x110 [10557.725677][ C2] ? get_stack_info+0x36/0xc0 [10557.726077][ C2] __tcf_classify+0x329/0x7d0 [10557.726501][ C2] tcf_classify+0x283/0x930 [10557.726915][ C2] ? __pfx_tcf_classify+0x10/0x10 [10557.727372][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10557.727887][ C2] tc_run+0x2e4/0x5d0 [10557.728234][ C2] ? __pfx_tc_run+0x10/0x10 [10557.728610][ C2] ? lock_acquire+0x1c1/0x220 [10557.729009][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10557.729443][ C2] __dev_queue_xmit+0x686/0x17e0 [10557.729857][ C2] ? lock_acquire+0x1c1/0x220 [10557.770369][ C2] ? ip_finish_output2+0x786/0x18e0 [10557.770798][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10557.771293][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10557.771716][ C2] ? neigh_hh_output+0x348/0x590 [10557.772139][ C2] ? ip_finish_output2+0x262/0x18e0 [10557.772577][ C2] ip_finish_output2+0x786/0x18e0 [10557.773021][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10557.773588][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10557.774049][ C2] ? rcu_read_lock_held+0xe/0x50 [10557.774480][ C2] ? __ip_finish_output+0x10f/0x770 [10557.774912][ C2] ip_output+0x16b/0x4f0 [10557.775278][ C2] ? __pfx_ip_output+0x10/0x10 [10557.775677][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10557.776147][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10557.776666][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10557.777129][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10557.777552][ C2] ? __alloc_skb+0xd4/0x280 [10557.777935][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10557.778387][ C2] ? tcp_fragment+0x168/0x1040 [10557.778801][ C2] ? rcu_read_lock_held+0xe/0x50 [10557.779252][ C2] ? ip_local_out+0x114/0x3b0 [10557.779679][ C2] __ip_queue_xmit+0x672/0x1910 [10557.840224][ C2] ? __skb_clone+0x57a/0x760 [10557.840650][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10557.841080][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10557.841537][ C2] ? ipv4_dst_check+0xe3/0x170 [10557.841946][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10557.842370][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10557.842869][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10557.843402][ C2] ? tcp_fragment+0xb0e/0x1040 [10557.843806][ C2] tcp_send_loss_probe+0x348/0x830 [10557.844231][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10557.844671][ C2] tcp_write_timer+0x82/0x1d0 [10557.845065][ C2] call_timer_fn+0x173/0x430 [10557.845452][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10557.845883][ C2] ? next_expiry_recalc+0xcd/0x220 [10557.846310][ C2] __run_timers.part.0+0x52d/0x890 [10557.846735][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10557.847178][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10557.847649][ C2] ? lock_acquire+0x1c1/0x220 [10557.848047][ C2] ? clockevents_program_event+0xf6/0x300 [10557.848538][ C2] ? lock_release+0x1d5/0x250 [10557.848942][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10557.849393][ C2] ? ktime_get+0xb3/0x190 [10557.849790][ C2] ? clockevents_program_event+0x1ea/0x300 [10557.894521][ C2] run_timer_softirq+0x72/0x100 [10557.894940][ C2] __do_softirq+0x1b9/0x7ff [10557.895326][ C2] irq_exit_rcu+0x98/0xc0 [10557.895686][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10557.896152][ C2] [10557.896389][ C2] [10557.896635][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10557.897136][ C2] RIP: 0010:default_idle+0xf/0x20 [10557.897560][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10557.899157][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10557.899671][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10557.940739][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10557.941419][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10557.942084][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10557.942757][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10557.943440][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10557.943928][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10557.944357][ C2] default_idle_call+0x69/0xa0 [10557.944770][ C2] cpuidle_idle_call+0x1f6/0x280 [10557.945190][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10557.945673][ C2] ? lock_release+0x1d5/0x250 [10557.946103][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10557.946583][ C2] do_idle+0xfb/0x160 [10557.946926][ C2] cpu_startup_entry+0x55/0x60 [10557.947338][ C2] start_secondary+0x21c/0x2b0 [10557.947752][ C2] ? __pfx_start_secondary+0x10/0x10 [10557.948206][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10557.948730][ C2] [10579.625125][ C0] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: [10579.625710][ C0] rcu: 1-....: (7954721 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1914607 [10579.626502][ C0] rcu: 2-....: (5 ticks this GP) idle=6c54/0/0x1 softirq=610529/610531 fqs=1914607 [10579.627168][ C0] rcu: (detected by 0, t=8224738 jiffies, g=1882453, q=727 ncpus=4) [10579.627742][ C0] Sending NMI from CPU 0 to CPUs 1: [10579.630230][ C1] NMI backtrace for cpu 1 [10579.630241][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10579.630248][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10579.630252][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10579.630264][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10579.630269][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10579.630274][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10579.630277][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10579.630281][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10579.630284][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10579.630286][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10579.630290][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10579.630294][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10579.630300][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10579.630303][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10579.630305][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10579.630308][ C1] PKRU: 55555554 [10579.630310][ C1] Call Trace: [10579.630315][ C1] [10579.630320][ C1] ? nmi_cpu_backtrace+0x112/0x220 [10579.630332][ C1] ? nmi_cpu_backtrace_handler+0x11/0x20 [10579.630341][ C1] ? nmi_handle+0x153/0x420 [10579.630349][ C1] ? default_do_nmi+0x41/0x100 [10579.630354][ C1] ? exc_nmi+0xf3/0x120 [10579.630358][ C1] ? end_repeat_nmi+0xf/0x60 [10579.630369][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10579.630375][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10579.630380][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10579.630386][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10579.630391][ C1] [10579.630393][ C1] [10579.630395][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10579.630400][ C1] ? get_stack_info+0x36/0xc0 [10579.630407][ C1] ? lock_acquire+0x1c1/0x220 [10579.630414][ C1] ? lock_release+0x1d5/0x250 [10579.630420][ C1] do_raw_spin_lock+0x1ec/0x270 [10579.630427][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10579.630432][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10579.630437][ C1] ? lock_acquire+0x1c1/0x220 [10579.630441][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10579.630449][ C1] _raw_spin_lock_nested+0x65/0x80 [10579.630454][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10579.630466][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10579.630470][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10579.630479][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10579.630490][ C1] ip_local_deliver_finish+0x2ae/0x480 [10579.630496][ C1] ip_local_deliver+0x19d/0x480 [10579.630501][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10579.630505][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10579.630509][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10579.630518][ C1] ? rcu_read_lock_held+0xe/0x50 [10579.630525][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10579.630530][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10579.630546][ C1] ip_rcv+0x564/0x740 [10579.630551][ C1] ? __pfx_ip_rcv+0x10/0x10 [10579.630556][ C1] ? set_track_prepare+0x8a/0xd0 [10579.630562][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10579.630567][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10579.630572][ C1] ? skb_clone+0x10b/0x330 [10579.630579][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10579.630589][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10579.630599][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10579.630606][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10579.630622][ C1] ? __tcf_classify+0x329/0x7d0 [10579.630628][ C1] ? __pfx_ip_rcv+0x10/0x10 [10579.630632][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10579.630638][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10579.630643][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10579.630651][ C1] ? lock_acquire+0x1c1/0x220 [10579.630655][ C1] ? netif_receive_skb_internal+0x84/0x300 [10579.630664][ C1] netif_receive_skb_internal+0xb0/0x300 [10579.630670][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10579.630678][ C1] ? __copy_skb_header+0xaf/0x490 [10579.630686][ C1] ? __skb_clone+0x57a/0x760 [10579.630691][ C1] netif_receive_skb+0x55/0x280 [10579.630697][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10579.630713][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10579.630741][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10579.630754][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10579.630764][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10579.630783][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10579.630798][ C1] ? hlock_class+0x4e/0x130 [10579.630806][ C1] ? get_stack_info_noinstr+0x18/0x110 [10579.630810][ C1] ? get_stack_info_noinstr+0x18/0x110 [10579.630814][ C1] ? __pfx_validate_chain+0x10/0x10 [10579.630819][ C1] ? hlock_class+0x4e/0x130 [10579.630823][ C1] ? mark_lock+0x38/0x3e0 [10579.630827][ C1] ? stack_access_ok+0xda/0x1f0 [10579.630834][ C1] ? __lock_acquire+0xb67/0x1610 [10579.630843][ C1] ? get_stack_info_noinstr+0x18/0x110 [10579.630847][ C1] ? get_stack_info+0x36/0xc0 [10579.630853][ C1] ? stack_access_ok+0xda/0x1f0 [10579.630857][ C1] ? get_reg+0x119/0x190 [10579.630861][ C1] ? unwind_next_frame+0x12af/0x1d10 [10579.630866][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10579.630874][ C1] __tcf_classify+0x329/0x7d0 [10579.630883][ C1] tcf_classify+0x283/0x930 [10579.630888][ C1] ? arch_stack_walk+0xa2/0x100 [10579.630895][ C1] ? __pfx_tcf_classify+0x10/0x10 [10579.630900][ C1] ? get_stack_info+0x36/0xc0 [10579.630908][ C1] tc_run+0x2e4/0x5d0 [10579.630914][ C1] ? __pfx_tc_run+0x10/0x10 [10579.630919][ C1] ? lock_acquire+0x1c1/0x220 [10579.630923][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10579.630930][ C1] __dev_queue_xmit+0x686/0x17e0 [10579.630937][ C1] ? lock_acquire+0x1c1/0x220 [10579.630941][ C1] ? ip_finish_output2+0x786/0x18e0 [10579.630947][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10579.630955][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10579.630960][ C1] ? neigh_hh_output+0x348/0x590 [10579.630966][ C1] ? ip_finish_output2+0x262/0x18e0 [10579.630973][ C1] ip_finish_output2+0x786/0x18e0 [10579.630977][ C1] ? stack_depot_save_flags+0x45/0x550 [10579.630984][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10579.630997][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10579.631001][ C1] ? rcu_read_lock_held+0xe/0x50 [10579.631008][ C1] ? __ip_finish_output+0x10f/0x770 [10579.631014][ C1] ip_output+0x16b/0x4f0 [10579.631018][ C1] ? run_timer_softirq+0x72/0x100 [10579.631025][ C1] ? __pfx_ip_output+0x10/0x10 [10579.631030][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10579.631038][ C1] ? rcu_read_lock_held+0xe/0x50 [10579.631042][ C1] ? ip_local_out+0x114/0x3b0 [10579.631049][ C1] __ip_queue_xmit+0x672/0x1910 [10579.631054][ C1] ? __create_object+0x5e/0xb0 [10579.631060][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10579.631070][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10579.631077][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10579.631083][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10579.631090][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10579.631094][ C1] tcp_delack_timer+0x84/0x240 [10579.631099][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10579.631103][ C1] call_timer_fn+0x173/0x430 [10579.631110][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10579.631118][ C1] ? next_expiry_recalc+0xcd/0x220 [10579.631125][ C1] __run_timers.part.0+0x52d/0x890 [10579.631130][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10579.631138][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10579.631143][ C1] ? lock_acquire+0x1c1/0x220 [10579.631146][ C1] ? clockevents_program_event+0xf6/0x300 [10579.631154][ C1] ? lock_release+0x1d5/0x250 [10579.631159][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10579.631164][ C1] ? ktime_get+0xb3/0x190 [10579.631171][ C1] ? clockevents_program_event+0x1ea/0x300 [10579.631178][ C1] run_timer_softirq+0x72/0x100 [10579.631183][ C1] __do_softirq+0x1b9/0x7ff [10579.631191][ C1] irq_exit_rcu+0x98/0xc0 [10579.631196][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10579.631202][ C1] [10579.631204][ C1] [10579.631206][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10579.631211][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10579.631216][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10579.631220][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10579.631224][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10579.631227][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10579.631230][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10579.631232][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10579.631235][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10579.631241][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10579.631248][ C1] pipe_read+0xa16/0xdf0 [10579.631260][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10579.631266][ C1] ? __pfx_pipe_read+0x10/0x10 [10579.631270][ C1] ? iterate_tty_write+0x299/0x540 [10579.631277][ C1] ? lock_release+0x1d5/0x250 [10579.631284][ C1] vfs_read+0x911/0xc00 [10579.631291][ C1] ? lock_acquire+0x1c1/0x220 [10579.631295][ C1] ? __might_fault+0xc6/0x180 [10579.631301][ C1] ? __pfx_vfs_read+0x10/0x10 [10579.631306][ C1] ? __might_fault+0xc6/0x180 [10579.631312][ C1] ? lock_release+0x1d5/0x250 [10579.631317][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10579.631322][ C1] ? __fget_light+0x54/0x1e0 [10579.631330][ C1] ksys_read+0x17a/0x1e0 [10579.631336][ C1] ? __pfx_ksys_read+0x10/0x10 [10579.631343][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10579.631349][ C1] do_syscall_64+0xc9/0x1e0 [10579.631356][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10579.631362][ C1] RIP: 0033:0x7f08a1ea38b2 [10579.631368][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10579.631372][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10579.631376][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10579.631379][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10579.631382][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10579.631384][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10579.631387][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10579.631395][ C1] [10579.632147][ C0] Sending NMI from CPU 0 to CPUs 2: [10580.330078][ C2] NMI backtrace for cpu 2 [10580.330098][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10580.330108][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10580.330116][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10580.330136][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10580.330145][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10580.330154][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10580.330159][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10580.330165][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10580.330170][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10580.330177][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10580.330183][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10580.330190][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10580.330201][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10580.330207][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10580.330212][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10580.330217][ C2] PKRU: 55555554 [10580.330220][ C2] Call Trace: [10580.330229][ C2] [10580.330240][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10580.330259][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10580.330273][ C2] ? nmi_handle+0x153/0x420 [10580.330291][ C2] ? default_do_nmi+0x41/0x100 [10580.330302][ C2] ? exc_nmi+0xf3/0x120 [10580.330313][ C2] ? end_repeat_nmi+0xf/0x60 [10580.330334][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10580.330346][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10580.330358][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10580.330371][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10580.330380][ C2] [10580.330381][ C2] [10580.330384][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10580.330388][ C2] ? get_stack_info+0x36/0xc0 [10580.330396][ C2] ? lock_acquire+0x1c1/0x220 [10580.330404][ C2] ? lock_release+0x1d5/0x250 [10580.330410][ C2] do_raw_spin_lock+0x1ec/0x270 [10580.330417][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10580.330421][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10580.330427][ C2] ? lock_acquire+0x1c1/0x220 [10580.330431][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10580.330439][ C2] _raw_spin_lock_nested+0x65/0x80 [10580.330444][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10580.330456][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10580.330461][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10580.330470][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10580.330482][ C2] ip_local_deliver_finish+0x2ae/0x480 [10580.330489][ C2] ip_local_deliver+0x19d/0x480 [10580.330494][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10580.330497][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10580.330502][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10580.330513][ C2] ? rcu_read_lock_held+0xe/0x50 [10580.330521][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10580.330526][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10580.330544][ C2] ip_rcv+0x564/0x740 [10580.330549][ C2] ? __pfx_ip_rcv+0x10/0x10 [10580.330554][ C2] ? set_track_prepare+0x8a/0xd0 [10580.330562][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10580.330567][ C2] ? start_secondary+0x21c/0x2b0 [10580.330573][ C2] ? skb_clone+0x10b/0x330 [10580.330579][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10580.330590][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10580.330599][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10580.330608][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10580.330622][ C2] ? __tcf_classify+0x329/0x7d0 [10580.330629][ C2] ? __pfx_ip_rcv+0x10/0x10 [10580.330633][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10580.330640][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10580.330645][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10580.330653][ C2] ? lock_acquire+0x1c1/0x220 [10580.330656][ C2] ? netif_receive_skb_internal+0x84/0x300 [10580.330663][ C2] netif_receive_skb_internal+0xb0/0x300 [10580.330669][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10580.330676][ C2] ? __copy_skb_header+0xaf/0x490 [10580.330686][ C2] ? __skb_clone+0x57a/0x760 [10580.330690][ C2] netif_receive_skb+0x55/0x280 [10580.330695][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10580.330708][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10580.330722][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10580.330734][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10580.330743][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10580.330763][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10580.330777][ C2] ? get_stack_info+0x36/0xc0 [10580.330786][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10580.330793][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10580.330801][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10580.330806][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10580.330813][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10580.330817][ C2] ? kernel_text_address+0x17/0xe0 [10580.330824][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10580.330832][ C2] ? arch_stack_walk+0x8c/0x100 [10580.330840][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10580.330846][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10580.330852][ C2] ? lock_acquire+0x1c1/0x220 [10580.330857][ C2] ? stack_depot_save_flags+0x281/0x550 [10580.330866][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10580.330875][ C2] ? get_stack_info_noinstr+0x18/0x110 [10580.330880][ C2] ? get_stack_info+0x36/0xc0 [10580.330888][ C2] __tcf_classify+0x329/0x7d0 [10580.330897][ C2] tcf_classify+0x283/0x930 [10580.330906][ C2] ? __pfx_tcf_classify+0x10/0x10 [10580.330912][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10580.330920][ C2] tc_run+0x2e4/0x5d0 [10580.330928][ C2] ? __pfx_tc_run+0x10/0x10 [10580.330934][ C2] ? lock_acquire+0x1c1/0x220 [10580.330938][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10580.330946][ C2] __dev_queue_xmit+0x686/0x17e0 [10580.330954][ C2] ? lock_acquire+0x1c1/0x220 [10580.330958][ C2] ? ip_finish_output2+0x786/0x18e0 [10580.330963][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10580.330969][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10580.330972][ C2] ? neigh_hh_output+0x348/0x590 [10580.330978][ C2] ? ip_finish_output2+0x262/0x18e0 [10580.330985][ C2] ip_finish_output2+0x786/0x18e0 [10580.330992][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10580.331007][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10580.331011][ C2] ? rcu_read_lock_held+0xe/0x50 [10580.331018][ C2] ? __ip_finish_output+0x10f/0x770 [10580.331025][ C2] ip_output+0x16b/0x4f0 [10580.331031][ C2] ? __pfx_ip_output+0x10/0x10 [10580.331036][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10580.331042][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10580.331048][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10580.331054][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10580.331059][ C2] ? __alloc_skb+0xd4/0x280 [10580.331063][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10580.331071][ C2] ? tcp_fragment+0x168/0x1040 [10580.331079][ C2] ? rcu_read_lock_held+0xe/0x50 [10580.331084][ C2] ? ip_local_out+0x114/0x3b0 [10580.331091][ C2] __ip_queue_xmit+0x672/0x1910 [10580.331099][ C2] ? __skb_clone+0x57a/0x760 [10580.331103][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10580.331114][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10580.331120][ C2] ? ipv4_dst_check+0xe3/0x170 [10580.331126][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10580.331134][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10580.331142][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10580.331147][ C2] ? tcp_fragment+0xb0e/0x1040 [10580.331153][ C2] tcp_send_loss_probe+0x348/0x830 [10580.331160][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10580.331165][ C2] tcp_write_timer+0x82/0x1d0 [10580.331171][ C2] call_timer_fn+0x173/0x430 [10580.331180][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10580.331189][ C2] ? next_expiry_recalc+0xcd/0x220 [10580.331197][ C2] __run_timers.part.0+0x52d/0x890 [10580.331202][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10580.331211][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10580.331216][ C2] ? lock_acquire+0x1c1/0x220 [10580.331220][ C2] ? clockevents_program_event+0xf6/0x300 [10580.331230][ C2] ? lock_release+0x1d5/0x250 [10580.331235][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10580.331242][ C2] ? ktime_get+0xb3/0x190 [10580.331250][ C2] ? clockevents_program_event+0x1ea/0x300 [10580.331259][ C2] run_timer_softirq+0x72/0x100 [10580.331265][ C2] __do_softirq+0x1b9/0x7ff [10580.331274][ C2] irq_exit_rcu+0x98/0xc0 [10580.331280][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10580.331288][ C2] [10580.331289][ C2] [10580.331292][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10580.331299][ C2] RIP: 0010:default_idle+0xf/0x20 [10580.331307][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10580.331312][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10580.331318][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10580.331322][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10580.331325][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10580.331328][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10580.331331][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10580.331338][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10580.331344][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10580.331352][ C2] default_idle_call+0x69/0xa0 [10580.331358][ C2] cpuidle_idle_call+0x1f6/0x280 [10580.331364][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10580.331371][ C2] ? lock_release+0x1d5/0x250 [10580.331376][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10580.331383][ C2] do_idle+0xfb/0x160 [10580.331388][ C2] cpu_startup_entry+0x55/0x60 [10580.331393][ C2] start_secondary+0x21c/0x2b0 [10580.331398][ C2] ? __pfx_start_secondary+0x10/0x10 [10580.331406][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10580.331420][ C2] [10604.569806][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7685s! [perl:4135] [10604.570517][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10604.572522][ C1] irq event stamp: 209232 [10604.572882][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10604.573734][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10604.574498][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10604.575244][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10604.575984][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10604.576704][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10604.577685][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10604.578213][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10604.579732][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10604.600302][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10604.600951][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10604.601573][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10604.602203][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10604.602825][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10604.603497][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10604.604225][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10604.604700][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10604.605271][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10604.605840][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10604.606402][ C1] PKRU: 55555554 [10604.606658][ C1] Call Trace: [10604.606898][ C1] [10604.607105][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10604.607471][ C1] ? __run_hrtimer+0x1c0/0x710 [10604.607812][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10604.608230][ C1] ? __hrtimer_run_queues+0x197/0x270 [10604.608628][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10604.609041][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10604.609421][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10604.609886][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10604.610304][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10604.610802][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10604.611287][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10604.611772][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10604.612227][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10604.612684][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10604.613138][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10604.613618][ C1] ? get_stack_info+0x36/0xc0 [10604.614004][ C1] ? lock_acquire+0x1c1/0x220 [10604.614394][ C1] ? lock_release+0x1d5/0x250 [10604.614780][ C1] do_raw_spin_lock+0x1ec/0x270 [10604.615175][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10604.615613][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10604.616085][ C1] ? lock_acquire+0x1c1/0x220 [10604.616477][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10604.616869][ C1] _raw_spin_lock_nested+0x65/0x80 [10604.617293][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10604.617674][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10604.618072][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10604.618491][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10604.618932][ C1] ip_local_deliver_finish+0x2ae/0x480 [10604.619378][ C1] ip_local_deliver+0x19d/0x480 [10604.619784][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10604.620204][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10604.620631][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10604.621173][ C1] ? rcu_read_lock_held+0xe/0x50 [10604.621579][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10604.622098][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10604.622517][ C1] ip_rcv+0x564/0x740 [10604.622853][ C1] ? __pfx_ip_rcv+0x10/0x10 [10604.623226][ C1] ? set_track_prepare+0x8a/0xd0 [10604.623627][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10604.624078][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10604.624517][ C1] ? skb_clone+0x10b/0x330 [10604.624886][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10604.625403][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10604.625885][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10604.626339][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10604.626813][ C1] ? __tcf_classify+0x329/0x7d0 [10604.627217][ C1] ? __pfx_ip_rcv+0x10/0x10 [10604.627588][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10604.628070][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10604.628528][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10604.629075][ C1] ? lock_acquire+0x1c1/0x220 [10604.629468][ C1] ? netif_receive_skb_internal+0x84/0x300 [10604.629951][ C1] netif_receive_skb_internal+0xb0/0x300 [10604.630410][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10604.630913][ C1] ? __copy_skb_header+0xaf/0x490 [10604.631324][ C1] ? __skb_clone+0x57a/0x760 [10604.631695][ C1] netif_receive_skb+0x55/0x280 [10604.632090][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10604.632599][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10604.633161][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10604.633651][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10604.634104][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10604.634570][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10604.635086][ C1] ? hlock_class+0x4e/0x130 [10604.635470][ C1] ? get_stack_info_noinstr+0x18/0x110 [10604.635916][ C1] ? get_stack_info_noinstr+0x18/0x110 [10604.636375][ C1] ? __pfx_validate_chain+0x10/0x10 [10604.636802][ C1] ? hlock_class+0x4e/0x130 [10604.637185][ C1] ? mark_lock+0x38/0x3e0 [10604.637544][ C1] ? stack_access_ok+0xda/0x1f0 [10604.637952][ C1] ? __lock_acquire+0xb67/0x1610 [10604.638369][ C1] ? get_stack_info_noinstr+0x18/0x110 [10604.638826][ C1] ? get_stack_info+0x36/0xc0 [10604.639221][ C1] ? stack_access_ok+0xda/0x1f0 [10604.639620][ C1] ? get_reg+0x119/0x190 [10604.639999][ C1] ? unwind_next_frame+0x12af/0x1d10 [10604.640378][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10604.640829][ C1] __tcf_classify+0x329/0x7d0 [10604.641207][ C1] tcf_classify+0x283/0x930 [10604.641560][ C1] ? arch_stack_walk+0xa2/0x100 [10604.641968][ C1] ? __pfx_tcf_classify+0x10/0x10 [10604.642387][ C1] ? get_stack_info+0x36/0xc0 [10604.642775][ C1] tc_run+0x2e4/0x5d0 [10604.643109][ C1] ? __pfx_tc_run+0x10/0x10 [10604.643483][ C1] ? lock_acquire+0x1c1/0x220 [10604.643870][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10604.644295][ C1] __dev_queue_xmit+0x686/0x17e0 [10604.644710][ C1] ? lock_acquire+0x1c1/0x220 [10604.645103][ C1] ? ip_finish_output2+0x786/0x18e0 [10604.645526][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10604.646009][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10604.646472][ C1] ? neigh_hh_output+0x348/0x590 [10604.646887][ C1] ? ip_finish_output2+0x262/0x18e0 [10604.647319][ C1] ip_finish_output2+0x786/0x18e0 [10604.647739][ C1] ? stack_depot_save_flags+0x45/0x550 [10604.648199][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10604.648752][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10604.649203][ C1] ? rcu_read_lock_held+0xe/0x50 [10604.649616][ C1] ? __ip_finish_output+0x10f/0x770 [10604.650036][ C1] ip_output+0x16b/0x4f0 [10604.650335][ C1] ? run_timer_softirq+0x72/0x100 [10604.650687][ C1] ? __pfx_ip_output+0x10/0x10 [10604.651013][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10604.651407][ C1] ? rcu_read_lock_held+0xe/0x50 [10604.651803][ C1] ? ip_local_out+0x114/0x3b0 [10604.652138][ C1] __ip_queue_xmit+0x672/0x1910 [10604.652503][ C1] ? __create_object+0x5e/0xb0 [10604.652873][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10604.653238][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10604.653650][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10604.654048][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10604.654447][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10604.654841][ C1] tcp_delack_timer+0x84/0x240 [10604.655182][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10604.655576][ C1] call_timer_fn+0x173/0x430 [10604.655909][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10604.656278][ C1] ? next_expiry_recalc+0xcd/0x220 [10604.656653][ C1] __run_timers.part.0+0x52d/0x890 [10604.657022][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10604.657415][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10604.657843][ C1] ? lock_acquire+0x1c1/0x220 [10604.658181][ C1] ? clockevents_program_event+0xf6/0x300 [10604.658580][ C1] ? lock_release+0x1d5/0x250 [10604.658924][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10604.659295][ C1] ? ktime_get+0xb3/0x190 [10604.659606][ C1] ? clockevents_program_event+0x1ea/0x300 [10604.660065][ C1] run_timer_softirq+0x72/0x100 [10604.660464][ C1] __do_softirq+0x1b9/0x7ff [10604.660841][ C1] irq_exit_rcu+0x98/0xc0 [10604.661196][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10604.661655][ C1] [10604.661890][ C1] [10604.662125][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10604.662601][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10604.663132][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10604.664688][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10604.665181][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10604.665816][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10604.666460][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10604.667096][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10604.667737][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10604.668388][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10604.668871][ C1] pipe_read+0xa16/0xdf0 [10604.669223][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10604.669666][ C1] ? __pfx_pipe_read+0x10/0x10 [10604.670072][ C1] ? iterate_tty_write+0x299/0x540 [10604.670497][ C1] ? lock_release+0x1d5/0x250 [10604.670873][ C1] vfs_read+0x911/0xc00 [10604.671216][ C1] ? lock_acquire+0x1c1/0x220 [10604.671597][ C1] ? __might_fault+0xc6/0x180 [10604.671987][ C1] ? __pfx_vfs_read+0x10/0x10 [10604.672370][ C1] ? __might_fault+0xc6/0x180 [10604.672767][ C1] ? lock_release+0x1d5/0x250 [10604.673166][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10604.673606][ C1] ? __fget_light+0x54/0x1e0 [10604.673992][ C1] ksys_read+0x17a/0x1e0 [10604.674347][ C1] ? __pfx_ksys_read+0x10/0x10 [10604.674740][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10604.675256][ C1] do_syscall_64+0xc9/0x1e0 [10604.675624][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10604.676101][ C1] RIP: 0033:0x7f08a1ea38b2 [10604.676470][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10604.678028][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10604.678708][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10604.679348][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10604.679989][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10604.680606][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10604.681216][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10604.681845][ C1] [10604.682162][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7685s! [swapper/2:0] [10604.682881][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10604.684934][ C2] irq event stamp: 44114564 [10604.685310][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10604.686199][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10604.687069][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10604.687845][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10604.688650][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10604.689432][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10604.720548][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [10604.721020][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [10604.722626][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [10604.723140][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10604.723802][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10604.724475][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10604.725119][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10604.725780][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10604.726455][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10604.727197][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10604.727745][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10604.728418][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10604.729080][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10604.749796][ C2] PKRU: 55555554 [10604.750175][ C2] Call Trace: [10604.750456][ C2] [10604.750702][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10604.751138][ C2] ? __run_hrtimer+0x1c0/0x710 [10604.751537][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10604.751991][ C2] ? __hrtimer_run_queues+0x197/0x270 [10604.752434][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10604.752913][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10604.753356][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10604.753860][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10604.754287][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10604.754720][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10604.755234][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10604.755730][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10604.756246][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10604.756748][ C2] ? __pfx___kasan_check_read+0x10/0x10 [10604.757236][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [10604.757732][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10604.758246][ C2] ? get_stack_info+0x36/0xc0 [10604.758644][ C2] ? lock_acquire+0x1c1/0x220 [10604.759040][ C2] ? lock_release+0x1d5/0x250 [10604.759460][ C2] do_raw_spin_lock+0x1ec/0x270 [10604.770002][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10604.770478][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10604.770963][ C2] ? lock_acquire+0x1c1/0x220 [10604.771365][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10604.771777][ C2] _raw_spin_lock_nested+0x65/0x80 [10604.772223][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10604.772615][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10604.773028][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10604.773465][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10604.800010][ C2] ip_local_deliver_finish+0x2ae/0x480 [10604.800475][ C2] ip_local_deliver+0x19d/0x480 [10604.800879][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10604.801330][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10604.801759][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10604.802329][ C2] ? rcu_read_lock_held+0xe/0x50 [10604.802756][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10604.803289][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10604.803728][ C2] ip_rcv+0x564/0x740 [10604.804051][ C2] ? __pfx_ip_rcv+0x10/0x10 [10604.804423][ C2] ? set_track_prepare+0x8a/0xd0 [10604.804835][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10604.805276][ C2] ? start_secondary+0x21c/0x2b0 [10604.805695][ C2] ? skb_clone+0x10b/0x330 [10604.806073][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10604.806608][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10604.807108][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10604.807587][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10604.808093][ C2] ? __tcf_classify+0x329/0x7d0 [10604.808505][ C2] ? __pfx_ip_rcv+0x10/0x10 [10604.808870][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10604.809355][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10604.810937][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10604.811473][ C2] ? lock_acquire+0x1c1/0x220 [10604.811862][ C2] ? netif_receive_skb_internal+0x84/0x300 [10604.812348][ C2] netif_receive_skb_internal+0xb0/0x300 [10604.812834][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10604.813345][ C2] ? __copy_skb_header+0xaf/0x490 [10604.813750][ C2] ? __skb_clone+0x57a/0x760 [10604.814132][ C2] netif_receive_skb+0x55/0x280 [10604.814573][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10604.815112][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10604.815676][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10604.816173][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10604.816636][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10604.817116][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10604.817624][ C2] ? get_stack_info+0x36/0xc0 [10604.818014][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10604.818449][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10604.818972][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10604.819430][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10604.832148][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10604.832703][ C2] ? kernel_text_address+0x17/0xe0 [10604.833133][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10604.833660][ C2] ? arch_stack_walk+0x8c/0x100 [10604.834080][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10604.834516][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10604.834978][ C2] ? lock_acquire+0x1c1/0x220 [10604.835365][ C2] ? stack_depot_save_flags+0x281/0x550 [10604.835826][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10604.836324][ C2] ? get_stack_info_noinstr+0x18/0x110 [10604.836779][ C2] ? get_stack_info+0x36/0xc0 [10604.837175][ C2] __tcf_classify+0x329/0x7d0 [10604.837580][ C2] tcf_classify+0x283/0x930 [10604.837960][ C2] ? __pfx_tcf_classify+0x10/0x10 [10604.838378][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10604.838933][ C2] tc_run+0x2e4/0x5d0 [10604.839285][ C2] ? __pfx_tc_run+0x10/0x10 [10604.839684][ C2] ? lock_acquire+0x1c1/0x220 [10604.840079][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10604.840486][ C2] __dev_queue_xmit+0x686/0x17e0 [10604.840885][ C2] ? lock_acquire+0x1c1/0x220 [10604.841264][ C2] ? ip_finish_output2+0x786/0x18e0 [10604.841686][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10604.842175][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10604.842616][ C2] ? neigh_hh_output+0x348/0x590 [10604.843019][ C2] ? ip_finish_output2+0x262/0x18e0 [10604.843445][ C2] ip_finish_output2+0x786/0x18e0 [10604.843851][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10604.844385][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10604.844833][ C2] ? rcu_read_lock_held+0xe/0x50 [10604.845244][ C2] ? __ip_finish_output+0x10f/0x770 [10604.845673][ C2] ip_output+0x16b/0x4f0 [10604.846020][ C2] ? __pfx_ip_output+0x10/0x10 [10604.846410][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10604.846866][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10604.847380][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10604.847839][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10604.848258][ C2] ? __alloc_skb+0xd4/0x280 [10604.848641][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10604.849099][ C2] ? tcp_fragment+0x168/0x1040 [10604.849530][ C2] ? rcu_read_lock_held+0xe/0x50 [10604.849925][ C2] ? ip_local_out+0x114/0x3b0 [10604.850274][ C2] __ip_queue_xmit+0x672/0x1910 [10604.850641][ C2] ? __skb_clone+0x57a/0x760 [10604.851018][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10604.851437][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10604.851876][ C2] ? ipv4_dst_check+0xe3/0x170 [10604.852261][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10604.852661][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10604.853157][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10604.853685][ C2] ? tcp_fragment+0xb0e/0x1040 [10604.854086][ C2] tcp_send_loss_probe+0x348/0x830 [10604.854527][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10604.854958][ C2] tcp_write_timer+0x82/0x1d0 [10604.855338][ C2] call_timer_fn+0x173/0x430 [10604.855716][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10604.856132][ C2] ? next_expiry_recalc+0xcd/0x220 [10604.856542][ C2] __run_timers.part.0+0x52d/0x890 [10604.856991][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10604.857424][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10604.857898][ C2] ? lock_acquire+0x1c1/0x220 [10604.858284][ C2] ? clockevents_program_event+0xf6/0x300 [10604.858750][ C2] ? lock_release+0x1d5/0x250 [10604.859136][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10604.859574][ C2] ? ktime_get+0xb3/0x190 [10604.860545][ C2] ? clockevents_program_event+0x1ea/0x300 [10604.861085][ C2] run_timer_softirq+0x72/0x100 [10604.861511][ C2] __do_softirq+0x1b9/0x7ff [10604.861910][ C2] irq_exit_rcu+0x98/0xc0 [10604.862270][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10604.862722][ C2] [10604.862944][ C2] [10604.863178][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10604.863674][ C2] RIP: 0010:default_idle+0xf/0x20 [10604.864108][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10604.865745][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10604.866270][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10604.866947][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10604.867653][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10604.868350][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10604.869057][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10604.869738][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10604.874835][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10604.875273][ C2] default_idle_call+0x69/0xa0 [10604.875677][ C2] cpuidle_idle_call+0x1f6/0x280 [10604.876086][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10604.876560][ C2] ? lock_release+0x1d5/0x250 [10604.876953][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10604.877407][ C2] do_idle+0xfb/0x160 [10604.877744][ C2] cpu_startup_entry+0x55/0x60 [10604.878147][ C2] start_secondary+0x21c/0x2b0 [10604.878573][ C2] ? __pfx_start_secondary+0x10/0x10 [10604.879050][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10604.879611][ C2] [10632.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7711s! [perl:4135] [10632.569975][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10632.572091][ C1] irq event stamp: 209232 [10632.572473][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10632.573382][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10632.574196][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10632.574979][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10632.575747][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10632.576490][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10632.577486][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10632.578045][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10632.579690][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10632.580198][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10632.580857][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10632.581521][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10632.582196][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10632.582865][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10632.583537][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10632.584288][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10632.584830][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10632.585516][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10632.586194][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10632.586871][ C1] PKRU: 55555554 [10632.587179][ C1] Call Trace: [10632.587470][ C1] [10632.587721][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10632.588167][ C1] ? __run_hrtimer+0x1c0/0x710 [10632.588579][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10632.589045][ C1] ? __hrtimer_run_queues+0x197/0x270 [10632.589505][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10632.589967][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10632.590374][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10632.590836][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10632.591225][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10632.591706][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10632.592155][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10632.592615][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10632.593028][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10632.593467][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10632.593892][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10632.594371][ C1] ? get_stack_info+0x36/0xc0 [10632.594739][ C1] ? lock_acquire+0x1c1/0x220 [10632.595111][ C1] ? lock_release+0x1d5/0x250 [10632.595480][ C1] do_raw_spin_lock+0x1ec/0x270 [10632.595860][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10632.596276][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10632.596707][ C1] ? lock_acquire+0x1c1/0x220 [10632.597067][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10632.597432][ C1] _raw_spin_lock_nested+0x65/0x80 [10632.597819][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10632.598162][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10632.598532][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10632.598916][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10632.599315][ C1] ip_local_deliver_finish+0x2ae/0x480 [10632.599744][ C1] ip_local_deliver+0x19d/0x480 [10632.600141][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10632.600599][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10632.601044][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10632.601621][ C1] ? rcu_read_lock_held+0xe/0x50 [10632.602052][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10632.602593][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10632.603027][ C1] ip_rcv+0x564/0x740 [10632.603371][ C1] ? __pfx_ip_rcv+0x10/0x10 [10632.603762][ C1] ? set_track_prepare+0x8a/0xd0 [10632.604188][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10632.604652][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10632.605115][ C1] ? skb_clone+0x10b/0x330 [10632.605503][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10632.606056][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10632.606581][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10632.607054][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10632.607564][ C1] ? __tcf_classify+0x329/0x7d0 [10632.607997][ C1] ? __pfx_ip_rcv+0x10/0x10 [10632.608392][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10632.608885][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10632.609369][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10632.609920][ C1] ? lock_acquire+0x1c1/0x220 [10632.610324][ C1] ? netif_receive_skb_internal+0x84/0x300 [10632.610796][ C1] netif_receive_skb_internal+0xb0/0x300 [10632.611265][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10632.611779][ C1] ? __copy_skb_header+0xaf/0x490 [10632.612205][ C1] ? __skb_clone+0x57a/0x760 [10632.612589][ C1] netif_receive_skb+0x55/0x280 [10632.613025][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10632.613556][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10632.614121][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10632.614625][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10632.615092][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10632.615580][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10632.616112][ C1] ? hlock_class+0x4e/0x130 [10632.616500][ C1] ? get_stack_info_noinstr+0x18/0x110 [10632.616966][ C1] ? get_stack_info_noinstr+0x18/0x110 [10632.617434][ C1] ? __pfx_validate_chain+0x10/0x10 [10632.617877][ C1] ? hlock_class+0x4e/0x130 [10632.618268][ C1] ? mark_lock+0x38/0x3e0 [10632.618638][ C1] ? stack_access_ok+0xda/0x1f0 [10632.619056][ C1] ? __lock_acquire+0xb67/0x1610 [10632.619489][ C1] ? get_stack_info_noinstr+0x18/0x110 [10632.619924][ C1] ? get_stack_info+0x36/0xc0 [10632.620283][ C1] ? stack_access_ok+0xda/0x1f0 [10632.620649][ C1] ? get_reg+0x119/0x190 [10632.620972][ C1] ? unwind_next_frame+0x12af/0x1d10 [10632.621385][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10632.621868][ C1] __tcf_classify+0x329/0x7d0 [10632.622237][ C1] tcf_classify+0x283/0x930 [10632.622593][ C1] ? arch_stack_walk+0xa2/0x100 [10632.622970][ C1] ? __pfx_tcf_classify+0x10/0x10 [10632.623367][ C1] ? get_stack_info+0x36/0xc0 [10632.623739][ C1] tc_run+0x2e4/0x5d0 [10632.624057][ C1] ? __pfx_tc_run+0x10/0x10 [10632.624430][ C1] ? lock_acquire+0x1c1/0x220 [10632.624829][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10632.625279][ C1] __dev_queue_xmit+0x686/0x17e0 [10632.625688][ C1] ? lock_acquire+0x1c1/0x220 [10632.626082][ C1] ? ip_finish_output2+0x786/0x18e0 [10632.626543][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10632.627057][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10632.627526][ C1] ? neigh_hh_output+0x348/0x590 [10632.627968][ C1] ? ip_finish_output2+0x262/0x18e0 [10632.628429][ C1] ip_finish_output2+0x786/0x18e0 [10632.628880][ C1] ? stack_depot_save_flags+0x45/0x550 [10632.629354][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10632.629955][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10632.630422][ C1] ? rcu_read_lock_held+0xe/0x50 [10632.630849][ C1] ? __ip_finish_output+0x10f/0x770 [10632.631292][ C1] ip_output+0x16b/0x4f0 [10632.631643][ C1] ? run_timer_softirq+0x72/0x100 [10632.632064][ C1] ? __pfx_ip_output+0x10/0x10 [10632.632462][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10632.632933][ C1] ? rcu_read_lock_held+0xe/0x50 [10632.633344][ C1] ? ip_local_out+0x114/0x3b0 [10632.633752][ C1] __ip_queue_xmit+0x672/0x1910 [10632.634170][ C1] ? __create_object+0x5e/0xb0 [10632.634582][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10632.635039][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10632.635514][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10632.635979][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10632.636460][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10632.636924][ C1] tcp_delack_timer+0x84/0x240 [10632.637344][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10632.637800][ C1] call_timer_fn+0x173/0x430 [10632.638197][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10632.638636][ C1] ? next_expiry_recalc+0xcd/0x220 [10632.639077][ C1] __run_timers.part.0+0x52d/0x890 [10632.639519][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10632.660067][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10632.660536][ C1] ? lock_acquire+0x1c1/0x220 [10632.660917][ C1] ? clockevents_program_event+0xf6/0x300 [10632.661378][ C1] ? lock_release+0x1d5/0x250 [10632.661778][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10632.662196][ C1] ? ktime_get+0xb3/0x190 [10632.662541][ C1] ? clockevents_program_event+0x1ea/0x300 [10632.663012][ C1] run_timer_softirq+0x72/0x100 [10632.663427][ C1] __do_softirq+0x1b9/0x7ff [10632.663797][ C1] irq_exit_rcu+0x98/0xc0 [10632.664155][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10632.664611][ C1] [10632.664863][ C1] [10632.665098][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10632.665572][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10632.666107][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10632.667651][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10632.668155][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10632.668745][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10632.669392][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10632.680138][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10632.680774][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10632.681433][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10632.681936][ C1] pipe_read+0xa16/0xdf0 [10632.682304][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10632.682751][ C1] ? __pfx_pipe_read+0x10/0x10 [10632.683156][ C1] ? iterate_tty_write+0x299/0x540 [10632.683597][ C1] ? lock_release+0x1d5/0x250 [10632.683986][ C1] vfs_read+0x911/0xc00 [10632.684357][ C1] ? lock_acquire+0x1c1/0x220 [10632.684732][ C1] ? __might_fault+0xc6/0x180 [10632.685144][ C1] ? __pfx_vfs_read+0x10/0x10 [10632.685560][ C1] ? __might_fault+0xc6/0x180 [10632.685975][ C1] ? lock_release+0x1d5/0x250 [10632.686371][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10632.686810][ C1] ? __fget_light+0x54/0x1e0 [10632.687197][ C1] ksys_read+0x17a/0x1e0 [10632.687550][ C1] ? __pfx_ksys_read+0x10/0x10 [10632.687969][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10632.688484][ C1] do_syscall_64+0xc9/0x1e0 [10632.688873][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10632.689373][ C1] RIP: 0033:0x7f08a1ea38b2 [10632.700162][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10632.701649][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10632.702296][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10632.702897][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10632.703491][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10632.704086][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10632.704682][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10632.705286][ C1] [10632.705583][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7711s! [swapper/2:0] [10632.706326][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10632.708357][ C2] irq event stamp: 44114564 [10632.708736][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10632.709661][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10632.710490][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10632.711245][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10632.712000][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10632.712737][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10632.713716][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10632.714247][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10632.715816][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10632.716315][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10632.716959][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10632.717605][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10632.718253][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10632.718899][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10632.719546][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10632.770706][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10632.771259][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10632.771906][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10632.772556][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10632.773204][ C2] PKRU: 55555554 [10632.773494][ C2] Call Trace: [10632.773772][ C2] [10632.774024][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10632.774456][ C2] ? __run_hrtimer+0x1c0/0x710 [10632.774841][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10632.775290][ C2] ? __hrtimer_run_queues+0x197/0x270 [10632.775757][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10632.776233][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10632.776686][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10632.777202][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10632.777631][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10632.778041][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10632.778536][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10632.779017][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10632.779523][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10632.800147][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10632.800658][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10632.801145][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10632.801662][ C2] ? get_stack_info+0x36/0xc0 [10632.802065][ C2] ? lock_acquire+0x1c1/0x220 [10632.802473][ C2] ? lock_release+0x1d5/0x250 [10632.802882][ C2] do_raw_spin_lock+0x1ec/0x270 [10632.803298][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10632.803757][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10632.804231][ C2] ? lock_acquire+0x1c1/0x220 [10632.804631][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10632.805040][ C2] _raw_spin_lock_nested+0x65/0x80 [10632.805480][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10632.805876][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10632.806285][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10632.806732][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10632.807208][ C2] ip_local_deliver_finish+0x2ae/0x480 [10632.807675][ C2] ip_local_deliver+0x19d/0x480 [10632.808078][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10632.808528][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10632.808971][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10632.809561][ C2] ? rcu_read_lock_held+0xe/0x50 [10632.810005][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10632.810546][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10632.810997][ C2] ip_rcv+0x564/0x740 [10632.811321][ C2] ? __pfx_ip_rcv+0x10/0x10 [10632.811705][ C2] ? set_track_prepare+0x8a/0xd0 [10632.812137][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10632.812608][ C2] ? start_secondary+0x21c/0x2b0 [10632.813041][ C2] ? skb_clone+0x10b/0x330 [10632.813428][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10632.813975][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10632.814494][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10632.814970][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10632.815465][ C2] ? __tcf_classify+0x329/0x7d0 [10632.815884][ C2] ? __pfx_ip_rcv+0x10/0x10 [10632.816280][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10632.816796][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10632.817286][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10632.817846][ C2] ? lock_acquire+0x1c1/0x220 [10632.818257][ C2] ? netif_receive_skb_internal+0x84/0x300 [10632.818771][ C2] netif_receive_skb_internal+0xb0/0x300 [10632.819295][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10632.839970][ C2] ? __copy_skb_header+0xaf/0x490 [10632.840385][ C2] ? __skb_clone+0x57a/0x760 [10632.840770][ C2] netif_receive_skb+0x55/0x280 [10632.841183][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10632.841656][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10632.842221][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10632.842730][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10632.843210][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10632.843711][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10632.844252][ C2] ? get_stack_info+0x36/0xc0 [10632.844668][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10632.845126][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10632.845701][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10632.846162][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10632.846642][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10632.847203][ C2] ? kernel_text_address+0x17/0xe0 [10632.847598][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10632.848067][ C2] ? arch_stack_walk+0x8c/0x100 [10632.848446][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10632.848850][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10632.849295][ C2] ? lock_acquire+0x1c1/0x220 [10632.859813][ C2] ? stack_depot_save_flags+0x281/0x550 [10632.860314][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10632.860856][ C2] ? get_stack_info_noinstr+0x18/0x110 [10632.861321][ C2] ? get_stack_info+0x36/0xc0 [10632.861726][ C2] __tcf_classify+0x329/0x7d0 [10632.862136][ C2] tcf_classify+0x283/0x930 [10632.862528][ C2] ? __pfx_tcf_classify+0x10/0x10 [10632.862955][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10632.863469][ C2] tc_run+0x2e4/0x5d0 [10632.863806][ C2] ? __pfx_tc_run+0x10/0x10 [10632.864187][ C2] ? lock_acquire+0x1c1/0x220 [10632.864583][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10632.865014][ C2] __dev_queue_xmit+0x686/0x17e0 [10632.865430][ C2] ? lock_acquire+0x1c1/0x220 [10632.865819][ C2] ? ip_finish_output2+0x786/0x18e0 [10632.866256][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10632.866738][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10632.867160][ C2] ? neigh_hh_output+0x348/0x590 [10632.867566][ C2] ? ip_finish_output2+0x262/0x18e0 [10632.867978][ C2] ip_finish_output2+0x786/0x18e0 [10632.868409][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10632.868964][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10632.869411][ C2] ? rcu_read_lock_held+0xe/0x50 [10632.884505][ C2] ? __ip_finish_output+0x10f/0x770 [10632.884966][ C2] ip_output+0x16b/0x4f0 [10632.885330][ C2] ? __pfx_ip_output+0x10/0x10 [10632.885722][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10632.886173][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10632.886686][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10632.887130][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10632.887553][ C2] ? __alloc_skb+0xd4/0x280 [10632.887937][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10632.888378][ C2] ? tcp_fragment+0x168/0x1040 [10632.888793][ C2] ? rcu_read_lock_held+0xe/0x50 [10632.889222][ C2] ? ip_local_out+0x114/0x3b0 [10632.889602][ C2] __ip_queue_xmit+0x672/0x1910 [10632.890005][ C2] ? __skb_clone+0x57a/0x760 [10632.890383][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10632.890796][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10632.891245][ C2] ? ipv4_dst_check+0xe3/0x170 [10632.891626][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10632.892014][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10632.892521][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10632.893041][ C2] ? tcp_fragment+0xb0e/0x1040 [10632.893420][ C2] tcp_send_loss_probe+0x348/0x830 [10632.893828][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10632.894254][ C2] tcp_write_timer+0x82/0x1d0 [10632.894609][ C2] call_timer_fn+0x173/0x430 [10632.894988][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10632.895401][ C2] ? next_expiry_recalc+0xcd/0x220 [10632.895808][ C2] __run_timers.part.0+0x52d/0x890 [10632.896207][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10632.896612][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10632.897038][ C2] ? lock_acquire+0x1c1/0x220 [10632.897404][ C2] ? clockevents_program_event+0xf6/0x300 [10632.897844][ C2] ? lock_release+0x1d5/0x250 [10632.898205][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10632.898610][ C2] ? ktime_get+0xb3/0x190 [10632.898968][ C2] ? clockevents_program_event+0x1ea/0x300 [10632.899408][ C2] run_timer_softirq+0x72/0x100 [10632.939920][ C2] __do_softirq+0x1b9/0x7ff [10632.940317][ C2] irq_exit_rcu+0x98/0xc0 [10632.940684][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10632.941124][ C2] [10632.941369][ C2] [10632.941621][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10632.942134][ C2] RIP: 0010:default_idle+0xf/0x20 [10632.942576][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10632.944318][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10632.944850][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10632.945522][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10632.946168][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10632.946867][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10632.947520][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10632.948187][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10632.948656][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10632.949088][ C2] default_idle_call+0x69/0xa0 [10632.949484][ C2] cpuidle_idle_call+0x1f6/0x280 [10632.980015][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10632.980479][ C2] ? lock_release+0x1d5/0x250 [10632.980875][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10632.981330][ C2] do_idle+0xfb/0x160 [10632.981665][ C2] cpu_startup_entry+0x55/0x60 [10632.982051][ C2] start_secondary+0x21c/0x2b0 [10632.982455][ C2] ? __pfx_start_secondary+0x10/0x10 [10632.982898][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10632.983409][ C2] [10658.412104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10658.412487][ C1] rcu: 1-....: (7993371 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1931055 [10658.413047][ C1] rcu: (t=8303525 jiffies g=1882453 q=727 ncpus=4) [10658.413380][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10658.413830][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10658.414448][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10658.414779][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10658.415752][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10658.416062][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10658.416462][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10658.416861][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10658.417264][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10658.417666][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10658.418066][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10658.418513][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10658.418846][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10658.419250][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10658.419657][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10658.420057][ C1] PKRU: 55555554 [10658.420239][ C1] Call Trace: [10658.420412][ C1] [10658.420560][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10658.420833][ C1] ? print_cpu_stall+0x263/0x6a0 [10658.421086][ C1] ? check_cpu_stall+0x284/0x500 [10658.421339][ C1] ? rcu_pending+0x92/0x360 [10658.421572][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10658.421842][ C1] ? update_process_times+0xb9/0x110 [10658.422112][ C1] ? tick_sched_handle+0x67/0x130 [10658.422369][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10658.422655][ C1] ? __run_hrtimer+0x1c0/0x710 [10658.422897][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10658.423210][ C1] ? __hrtimer_run_queues+0x197/0x270 [10658.423488][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10658.423777][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10658.424044][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10658.424352][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10658.424614][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10658.424926][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10658.425223][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10658.425538][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10658.425829][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10658.426125][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10658.426415][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10658.426727][ C1] ? get_stack_info+0x36/0xc0 [10658.426969][ C1] ? lock_acquire+0x1c1/0x220 [10658.427208][ C1] ? lock_release+0x1d5/0x250 [10658.427449][ C1] do_raw_spin_lock+0x1ec/0x270 [10658.427699][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10658.427971][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10658.428258][ C1] ? lock_acquire+0x1c1/0x220 [10658.428495][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10658.428738][ C1] _raw_spin_lock_nested+0x65/0x80 [10658.428999][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10658.429235][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10658.429494][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10658.429754][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10658.430032][ C1] ip_local_deliver_finish+0x2ae/0x480 [10658.430311][ C1] ip_local_deliver+0x19d/0x480 [10658.430560][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10658.430835][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10658.431100][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10658.431449][ C1] ? rcu_read_lock_held+0xe/0x50 [10658.431703][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10658.432027][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10658.432291][ C1] ip_rcv+0x564/0x740 [10658.432496][ C1] ? __pfx_ip_rcv+0x10/0x10 [10658.432730][ C1] ? set_track_prepare+0x8a/0xd0 [10658.432986][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10658.433263][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10658.433537][ C1] ? skb_clone+0x10b/0x330 [10658.433767][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10658.434090][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10658.434396][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10658.434681][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10658.434977][ C1] ? __tcf_classify+0x329/0x7d0 [10658.435228][ C1] ? __pfx_ip_rcv+0x10/0x10 [10658.435460][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10658.435761][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10658.436049][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10658.436377][ C1] ? lock_acquire+0x1c1/0x220 [10658.436619][ C1] ? netif_receive_skb_internal+0x84/0x300 [10658.436917][ C1] netif_receive_skb_internal+0xb0/0x300 [10658.437206][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10658.437525][ C1] ? __copy_skb_header+0xaf/0x490 [10658.437785][ C1] ? __skb_clone+0x57a/0x760 [10658.438020][ C1] netif_receive_skb+0x55/0x280 [10658.438271][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10658.438589][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10658.438922][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10658.439225][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10658.439511][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10658.439804][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10658.440119][ C1] ? hlock_class+0x4e/0x130 [10658.440354][ C1] ? get_stack_info_noinstr+0x18/0x110 [10658.440631][ C1] ? get_stack_info_noinstr+0x18/0x110 [10658.440908][ C1] ? __pfx_validate_chain+0x10/0x10 [10658.441174][ C1] ? hlock_class+0x4e/0x130 [10658.441405][ C1] ? mark_lock+0x38/0x3e0 [10658.441627][ C1] ? stack_access_ok+0xda/0x1f0 [10658.441875][ C1] ? __lock_acquire+0xb67/0x1610 [10658.442130][ C1] ? get_stack_info_noinstr+0x18/0x110 [10658.442407][ C1] ? get_stack_info+0x36/0xc0 [10658.442648][ C1] ? stack_access_ok+0xda/0x1f0 [10658.442898][ C1] ? get_reg+0x119/0x190 [10658.443116][ C1] ? unwind_next_frame+0x12af/0x1d10 [10658.443384][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10658.443696][ C1] __tcf_classify+0x329/0x7d0 [10658.443937][ C1] tcf_classify+0x283/0x930 [10658.444169][ C1] ? arch_stack_walk+0xa2/0x100 [10658.444418][ C1] ? __pfx_tcf_classify+0x10/0x10 [10658.444674][ C1] ? get_stack_info+0x36/0xc0 [10658.444916][ C1] tc_run+0x2e4/0x5d0 [10658.445122][ C1] ? __pfx_tc_run+0x10/0x10 [10658.445353][ C1] ? lock_acquire+0x1c1/0x220 [10658.445590][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10658.445852][ C1] __dev_queue_xmit+0x686/0x17e0 [10658.446106][ C1] ? lock_acquire+0x1c1/0x220 [10658.446346][ C1] ? ip_finish_output2+0x786/0x18e0 [10658.446611][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10658.446921][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10658.447194][ C1] ? neigh_hh_output+0x348/0x590 [10658.447447][ C1] ? ip_finish_output2+0x262/0x18e0 [10658.447715][ C1] ip_finish_output2+0x786/0x18e0 [10658.447972][ C1] ? stack_depot_save_flags+0x45/0x550 [10658.448252][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10658.448592][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10658.448868][ C1] ? rcu_read_lock_held+0xe/0x50 [10658.449124][ C1] ? __ip_finish_output+0x10f/0x770 [10658.449389][ C1] ip_output+0x16b/0x4f0 [10658.449612][ C1] ? run_timer_softirq+0x72/0x100 [10658.449870][ C1] ? __pfx_ip_output+0x10/0x10 [10658.450113][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10658.450403][ C1] ? rcu_read_lock_held+0xe/0x50 [10658.450655][ C1] ? ip_local_out+0x114/0x3b0 [10658.450896][ C1] __ip_queue_xmit+0x672/0x1910 [10658.451144][ C1] ? __create_object+0x5e/0xb0 [10658.451389][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10658.451656][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10658.451939][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10658.452212][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10658.452493][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10658.452765][ C1] tcp_delack_timer+0x84/0x240 [10658.453008][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10658.453282][ C1] call_timer_fn+0x173/0x430 [10658.453518][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10658.453780][ C1] ? next_expiry_recalc+0xcd/0x220 [10658.454041][ C1] __run_timers.part.0+0x52d/0x890 [10658.454304][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10658.454579][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10658.454863][ C1] ? lock_acquire+0x1c1/0x220 [10658.455103][ C1] ? clockevents_program_event+0xf6/0x300 [10658.455392][ C1] ? lock_release+0x1d5/0x250 [10658.455632][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10658.455898][ C1] ? ktime_get+0xb3/0x190 [10658.456121][ C1] ? clockevents_program_event+0x1ea/0x300 [10658.456416][ C1] run_timer_softirq+0x72/0x100 [10658.456665][ C1] __do_softirq+0x1b9/0x7ff [10658.456900][ C1] irq_exit_rcu+0x98/0xc0 [10658.457121][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10658.457410][ C1] [10658.457561][ C1] [10658.457711][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10658.458016][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10658.458342][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10658.459313][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10658.459630][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10658.460030][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10658.460432][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10658.460830][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10658.461229][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10658.461631][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10658.461929][ C1] pipe_read+0xa16/0xdf0 [10658.462150][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10658.462429][ C1] ? __pfx_pipe_read+0x10/0x10 [10658.462673][ C1] ? iterate_tty_write+0x299/0x540 [10658.462936][ C1] ? lock_release+0x1d5/0x250 [10658.463176][ C1] vfs_read+0x911/0xc00 [10658.463393][ C1] ? lock_acquire+0x1c1/0x220 [10658.463632][ C1] ? __might_fault+0xc6/0x180 [10658.463872][ C1] ? __pfx_vfs_read+0x10/0x10 [10658.464111][ C1] ? __might_fault+0xc6/0x180 [10658.464352][ C1] ? lock_release+0x1d5/0x250 [10658.464591][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10658.464857][ C1] ? __fget_light+0x54/0x1e0 [10658.465092][ C1] ksys_read+0x17a/0x1e0 [10658.465312][ C1] ? __pfx_ksys_read+0x10/0x10 [10658.465557][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10658.465863][ C1] do_syscall_64+0xc9/0x1e0 [10658.466097][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10658.466398][ C1] RIP: 0033:0x7f08a1ea38b2 [10658.466626][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10658.467597][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10658.468020][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10658.468420][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10658.468817][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10658.469217][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10658.469624][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10658.470027][ C1] [10658.470185][ C1] Sending NMI from CPU 1 to CPUs 2: [10658.470469][ C2] NMI backtrace for cpu 2 [10658.470480][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10658.470487][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10658.470493][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10658.470507][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10658.470513][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10658.470520][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10658.470523][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10658.470528][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10658.470532][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10658.470534][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10658.470536][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10658.470538][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10658.470542][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10658.470544][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10658.470545][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10658.470547][ C2] PKRU: 55555554 [10658.470548][ C2] Call Trace: [10658.470552][ C2] [10658.470558][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10658.470567][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10658.470574][ C2] ? nmi_handle+0x153/0x420 [10658.470580][ C2] ? default_do_nmi+0x41/0x100 [10658.470583][ C2] ? exc_nmi+0xf3/0x120 [10658.470586][ C2] ? end_repeat_nmi+0xf/0x60 [10658.470593][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10658.470596][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10658.470599][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10658.470602][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10658.470606][ C2] [10658.470606][ C2] [10658.470608][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10658.470611][ C2] ? get_stack_info+0x36/0xc0 [10658.470615][ C2] ? lock_acquire+0x1c1/0x220 [10658.470620][ C2] ? lock_release+0x1d5/0x250 [10658.470624][ C2] do_raw_spin_lock+0x1ec/0x270 [10658.470629][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10658.470632][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10658.470635][ C2] ? lock_acquire+0x1c1/0x220 [10658.470637][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10658.470643][ C2] _raw_spin_lock_nested+0x65/0x80 [10658.470646][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10658.470653][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10658.470656][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10658.470661][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10658.470669][ C2] ip_local_deliver_finish+0x2ae/0x480 [10658.470672][ C2] ip_local_deliver+0x19d/0x480 [10658.470675][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10658.470677][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10658.470679][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10658.470686][ C2] ? rcu_read_lock_held+0xe/0x50 [10658.470691][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10658.470694][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10658.470705][ C2] ip_rcv+0x564/0x740 [10658.470708][ C2] ? __pfx_ip_rcv+0x10/0x10 [10658.470710][ C2] ? set_track_prepare+0x8a/0xd0 [10658.470716][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10658.470719][ C2] ? start_secondary+0x21c/0x2b0 [10658.470723][ C2] ? skb_clone+0x10b/0x330 [10658.470728][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10658.470735][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10658.470740][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10658.470747][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10658.470755][ C2] ? __tcf_classify+0x329/0x7d0 [10658.470759][ C2] ? __pfx_ip_rcv+0x10/0x10 [10658.470762][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10658.470766][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10658.470769][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10658.470773][ C2] ? lock_acquire+0x1c1/0x220 [10658.470776][ C2] ? netif_receive_skb_internal+0x84/0x300 [10658.470780][ C2] netif_receive_skb_internal+0xb0/0x300 [10658.470784][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10658.470788][ C2] ? __copy_skb_header+0xaf/0x490 [10658.470794][ C2] ? __skb_clone+0x57a/0x760 [10658.470797][ C2] netif_receive_skb+0x55/0x280 [10658.470800][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10658.470809][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10658.470816][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10658.470822][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10658.470828][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10658.470838][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10658.470845][ C2] ? get_stack_info+0x36/0xc0 [10658.470850][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10658.470854][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10658.470860][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10658.470862][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10658.470866][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10658.470868][ C2] ? kernel_text_address+0x17/0xe0 [10658.470872][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10658.470878][ C2] ? arch_stack_walk+0x8c/0x100 [10658.470883][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10658.470887][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10658.470890][ C2] ? lock_acquire+0x1c1/0x220 [10658.470892][ C2] ? stack_depot_save_flags+0x281/0x550 [10658.470898][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10658.470904][ C2] ? get_stack_info_noinstr+0x18/0x110 [10658.470906][ C2] ? get_stack_info+0x36/0xc0 [10658.470911][ C2] __tcf_classify+0x329/0x7d0 [10658.470917][ C2] tcf_classify+0x283/0x930 [10658.470921][ C2] ? __pfx_tcf_classify+0x10/0x10 [10658.470924][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10658.470929][ C2] tc_run+0x2e4/0x5d0 [10658.470934][ C2] ? __pfx_tc_run+0x10/0x10 [10658.470937][ C2] ? lock_acquire+0x1c1/0x220 [10658.470940][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10658.470944][ C2] __dev_queue_xmit+0x686/0x17e0 [10658.470948][ C2] ? lock_acquire+0x1c1/0x220 [10658.470951][ C2] ? ip_finish_output2+0x786/0x18e0 [10658.470955][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10658.470958][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10658.470961][ C2] ? neigh_hh_output+0x348/0x590 [10658.470965][ C2] ? ip_finish_output2+0x262/0x18e0 [10658.470968][ C2] ip_finish_output2+0x786/0x18e0 [10658.470972][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10658.470980][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10658.470982][ C2] ? rcu_read_lock_held+0xe/0x50 [10658.470986][ C2] ? __ip_finish_output+0x10f/0x770 [10658.470990][ C2] ip_output+0x16b/0x4f0 [10658.470993][ C2] ? __pfx_ip_output+0x10/0x10 [10658.470996][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10658.470999][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10658.471002][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10658.471006][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10658.471009][ C2] ? __alloc_skb+0xd4/0x280 [10658.471011][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10658.471017][ C2] ? tcp_fragment+0x168/0x1040 [10658.471021][ C2] ? rcu_read_lock_held+0xe/0x50 [10658.471024][ C2] ? ip_local_out+0x114/0x3b0 [10658.471028][ C2] __ip_queue_xmit+0x672/0x1910 [10658.471032][ C2] ? __skb_clone+0x57a/0x760 [10658.471035][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10658.471041][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10658.471044][ C2] ? ipv4_dst_check+0xe3/0x170 [10658.471049][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10658.471055][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10658.471060][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10658.471063][ C2] ? tcp_fragment+0xb0e/0x1040 [10658.471066][ C2] tcp_send_loss_probe+0x348/0x830 [10658.471070][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10658.471072][ C2] tcp_write_timer+0x82/0x1d0 [10658.471076][ C2] call_timer_fn+0x173/0x430 [10658.471082][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10658.471086][ C2] ? next_expiry_recalc+0xcd/0x220 [10658.471091][ C2] __run_timers.part.0+0x52d/0x890 [10658.471094][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10658.471098][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10658.471101][ C2] ? lock_acquire+0x1c1/0x220 [10658.471104][ C2] ? clockevents_program_event+0xf6/0x300 [10658.471110][ C2] ? lock_release+0x1d5/0x250 [10658.471113][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10658.471117][ C2] ? ktime_get+0xb3/0x190 [10658.471121][ C2] ? clockevents_program_event+0x1ea/0x300 [10658.471126][ C2] run_timer_softirq+0x72/0x100 [10658.471129][ C2] __do_softirq+0x1b9/0x7ff [10658.471134][ C2] irq_exit_rcu+0x98/0xc0 [10658.471137][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10658.471141][ C2] [10658.471142][ C2] [10658.471143][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10658.471147][ C2] RIP: 0010:default_idle+0xf/0x20 [10658.471151][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10658.471154][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10658.471157][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10658.471159][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10658.471161][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10658.471163][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10658.471164][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10658.471168][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10658.471171][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10658.471175][ C2] default_idle_call+0x69/0xa0 [10658.471179][ C2] cpuidle_idle_call+0x1f6/0x280 [10658.471182][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10658.471186][ C2] ? lock_release+0x1d5/0x250 [10658.471189][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10658.471193][ C2] do_idle+0xfb/0x160 [10658.471196][ C2] cpu_startup_entry+0x55/0x60 [10658.471199][ C2] start_secondary+0x21c/0x2b0 [10658.471202][ C2] ? __pfx_start_secondary+0x10/0x10 [10658.471206][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10658.471213][ C2] [10684.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7759s! [perl:4135] [10684.569715][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10684.570964][ C1] irq event stamp: 209232 [10684.571177][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10684.571690][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10684.572153][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10684.572612][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10684.573087][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10684.573537][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10684.574149][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10684.574477][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10684.575427][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10684.575725][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10684.576148][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10684.576536][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10684.576924][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10684.577312][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10684.577704][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10684.578141][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10684.578465][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10684.578854][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10684.579244][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10684.579672][ C1] PKRU: 55555554 [10684.579854][ C1] Call Trace: [10684.580022][ C1] [10684.580173][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10684.580435][ C1] ? __run_hrtimer+0x1c0/0x710 [10684.580679][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10684.580960][ C1] ? __hrtimer_run_queues+0x197/0x270 [10684.581233][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10684.581528][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10684.581808][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10684.582114][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10684.582376][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10684.582685][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10684.582982][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10684.583300][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10684.583599][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10684.583896][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10684.584184][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10684.584496][ C1] ? get_stack_info+0x36/0xc0 [10684.584743][ C1] ? lock_acquire+0x1c1/0x220 [10684.584989][ C1] ? lock_release+0x1d5/0x250 [10684.585223][ C1] do_raw_spin_lock+0x1ec/0x270 [10684.585465][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10684.585731][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10684.586026][ C1] ? lock_acquire+0x1c1/0x220 [10684.586265][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10684.586507][ C1] _raw_spin_lock_nested+0x65/0x80 [10684.586768][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10684.587001][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10684.587257][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10684.587506][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10684.587775][ C1] ip_local_deliver_finish+0x2ae/0x480 [10684.588047][ C1] ip_local_deliver+0x19d/0x480 [10684.588289][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10684.588576][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10684.588839][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10684.589186][ C1] ? rcu_read_lock_held+0xe/0x50 [10684.589455][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10684.589776][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10684.590038][ C1] ip_rcv+0x564/0x740 [10684.590243][ C1] ? __pfx_ip_rcv+0x10/0x10 [10684.590475][ C1] ? set_track_prepare+0x8a/0xd0 [10684.590727][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10684.591030][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10684.591306][ C1] ? skb_clone+0x10b/0x330 [10684.591533][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10684.591852][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10684.592160][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10684.592466][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10684.592762][ C1] ? __tcf_classify+0x329/0x7d0 [10684.593012][ C1] ? __pfx_ip_rcv+0x10/0x10 [10684.593242][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10684.593546][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10684.593835][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10684.594153][ C1] ? lock_acquire+0x1c1/0x220 [10684.594384][ C1] ? netif_receive_skb_internal+0x84/0x300 [10684.594695][ C1] netif_receive_skb_internal+0xb0/0x300 [10684.594979][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10684.595297][ C1] ? __copy_skb_header+0xaf/0x490 [10684.595554][ C1] ? __skb_clone+0x57a/0x760 [10684.595789][ C1] netif_receive_skb+0x55/0x280 [10684.596042][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10684.596370][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10684.596705][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10684.597003][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10684.597279][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10684.597575][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10684.597879][ C1] ? hlock_class+0x4e/0x130 [10684.598106][ C1] ? get_stack_info_noinstr+0x18/0x110 [10684.598396][ C1] ? get_stack_info_noinstr+0x18/0x110 [10684.598671][ C1] ? __pfx_validate_chain+0x10/0x10 [10684.598934][ C1] ? hlock_class+0x4e/0x130 [10684.599166][ C1] ? mark_lock+0x38/0x3e0 [10684.599389][ C1] ? stack_access_ok+0xda/0x1f0 [10684.599638][ C1] ? __lock_acquire+0xb67/0x1610 [10684.599892][ C1] ? get_stack_info_noinstr+0x18/0x110 [10684.600168][ C1] ? get_stack_info+0x36/0xc0 [10684.600409][ C1] ? stack_access_ok+0xda/0x1f0 [10684.600656][ C1] ? get_reg+0x119/0x190 [10684.600878][ C1] ? unwind_next_frame+0x12af/0x1d10 [10684.601156][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10684.601464][ C1] __tcf_classify+0x329/0x7d0 [10684.601709][ C1] tcf_classify+0x283/0x930 [10684.601942][ C1] ? arch_stack_walk+0xa2/0x100 [10684.602191][ C1] ? __pfx_tcf_classify+0x10/0x10 [10684.602447][ C1] ? get_stack_info+0x36/0xc0 [10684.602686][ C1] tc_run+0x2e4/0x5d0 [10684.602892][ C1] ? __pfx_tc_run+0x10/0x10 [10684.603124][ C1] ? lock_acquire+0x1c1/0x220 [10684.603368][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10684.603622][ C1] __dev_queue_xmit+0x686/0x17e0 [10684.603869][ C1] ? lock_acquire+0x1c1/0x220 [10684.604121][ C1] ? ip_finish_output2+0x786/0x18e0 [10684.604387][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10684.604692][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10684.604969][ C1] ? neigh_hh_output+0x348/0x590 [10684.605232][ C1] ? ip_finish_output2+0x262/0x18e0 [10684.605490][ C1] ip_finish_output2+0x786/0x18e0 [10684.605740][ C1] ? stack_depot_save_flags+0x45/0x550 [10684.606011][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10684.606340][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10684.606614][ C1] ? rcu_read_lock_held+0xe/0x50 [10684.606860][ C1] ? __ip_finish_output+0x10f/0x770 [10684.607119][ C1] ip_output+0x16b/0x4f0 [10684.607329][ C1] ? run_timer_softirq+0x72/0x100 [10684.607600][ C1] ? __pfx_ip_output+0x10/0x10 [10684.607844][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10684.608130][ C1] ? rcu_read_lock_held+0xe/0x50 [10684.608382][ C1] ? ip_local_out+0x114/0x3b0 [10684.608623][ C1] __ip_queue_xmit+0x672/0x1910 [10684.608873][ C1] ? __create_object+0x5e/0xb0 [10684.609118][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10684.609389][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10684.609670][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10684.609943][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10684.610227][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10684.610499][ C1] tcp_delack_timer+0x84/0x240 [10684.610749][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10684.611034][ C1] call_timer_fn+0x173/0x430 [10684.611271][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10684.611534][ C1] ? next_expiry_recalc+0xcd/0x220 [10684.611796][ C1] __run_timers.part.0+0x52d/0x890 [10684.612067][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10684.612334][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10684.612616][ C1] ? lock_acquire+0x1c1/0x220 [10684.612848][ C1] ? clockevents_program_event+0xf6/0x300 [10684.613154][ C1] ? lock_release+0x1d5/0x250 [10684.613394][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10684.613659][ C1] ? ktime_get+0xb3/0x190 [10684.613879][ C1] ? clockevents_program_event+0x1ea/0x300 [10684.614187][ C1] run_timer_softirq+0x72/0x100 [10684.614429][ C1] __do_softirq+0x1b9/0x7ff [10684.614654][ C1] irq_exit_rcu+0x98/0xc0 [10684.614870][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10684.615147][ C1] [10684.615295][ C1] [10684.615458][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10684.615764][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10684.616088][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10684.617062][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10684.617363][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10684.617751][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10684.618139][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10684.618529][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10684.618918][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10684.619309][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10684.619626][ C1] pipe_read+0xa16/0xdf0 [10684.619848][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10684.620131][ C1] ? __pfx_pipe_read+0x10/0x10 [10684.620376][ C1] ? iterate_tty_write+0x299/0x540 [10684.620638][ C1] ? lock_release+0x1d5/0x250 [10684.620879][ C1] vfs_read+0x911/0xc00 [10684.621093][ C1] ? lock_acquire+0x1c1/0x220 [10684.621334][ C1] ? __might_fault+0xc6/0x180 [10684.621575][ C1] ? __pfx_vfs_read+0x10/0x10 [10684.621822][ C1] ? __might_fault+0xc6/0x180 [10684.622076][ C1] ? lock_release+0x1d5/0x250 [10684.622316][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10684.622581][ C1] ? __fget_light+0x54/0x1e0 [10684.622820][ C1] ksys_read+0x17a/0x1e0 [10684.623036][ C1] ? __pfx_ksys_read+0x10/0x10 [10684.623302][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10684.623608][ C1] do_syscall_64+0xc9/0x1e0 [10684.623841][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10684.624142][ C1] RIP: 0033:0x7f08a1ea38b2 [10684.624372][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10684.625364][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10684.625784][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10684.626186][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10684.626585][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10684.626983][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10684.627382][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10684.627790][ C1] [10684.627943][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7759s! [swapper/2:0] [10684.628343][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10684.629546][ C2] irq event stamp: 44114564 [10684.629767][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10684.630293][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10684.630786][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10684.631225][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10684.631657][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10684.632078][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10684.632705][ C2] RIP: 0010:kasan_check_range+0x1a/0x1c0 [10684.632991][ C2] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [10684.633933][ C2] RSP: 0018:ffffc9000021fa80 EFLAGS: 00000286 [10684.634216][ C2] RAX: ffff88800a3a1b5c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10684.634586][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10684.634988][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10684.635376][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10684.635765][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10684.636155][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10684.636566][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10684.636872][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10684.637242][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10684.637609][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10684.637978][ C2] PKRU: 55555554 [10684.638146][ C2] Call Trace: [10684.638302][ C2] [10684.638450][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10684.638712][ C2] ? __run_hrtimer+0x1c0/0x710 [10684.638947][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10684.639219][ C2] ? __hrtimer_run_queues+0x197/0x270 [10684.639509][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10684.639797][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10684.640072][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10684.640368][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10684.640628][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10684.640875][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10684.641160][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10684.641436][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10684.641726][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10684.641991][ C2] ? kasan_check_range+0x1a/0x1c0 [10684.642228][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [10684.642491][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10684.642778][ C2] ? get_stack_info+0x36/0xc0 [10684.642998][ C2] ? lock_acquire+0x1c1/0x220 [10684.643221][ C2] ? lock_release+0x1d5/0x250 [10684.643447][ C2] do_raw_spin_lock+0x1ec/0x270 [10684.643676][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10684.643927][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10684.644189][ C2] ? lock_acquire+0x1c1/0x220 [10684.644410][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10684.644632][ C2] _raw_spin_lock_nested+0x65/0x80 [10684.644872][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10684.645088][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10684.645316][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10684.645554][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10684.645810][ C2] ip_local_deliver_finish+0x2ae/0x480 [10684.646064][ C2] ip_local_deliver+0x19d/0x480 [10684.646313][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10684.646583][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10684.646844][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10684.647194][ C2] ? rcu_read_lock_held+0xe/0x50 [10684.647447][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10684.647755][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10684.647998][ C2] ip_rcv+0x564/0x740 [10684.648187][ C2] ? __pfx_ip_rcv+0x10/0x10 [10684.648398][ C2] ? set_track_prepare+0x8a/0xd0 [10684.648632][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10684.648889][ C2] ? start_secondary+0x21c/0x2b0 [10684.649122][ C2] ? skb_clone+0x10b/0x330 [10684.649349][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10684.649684][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10684.649988][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10684.650270][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10684.650580][ C2] ? __tcf_classify+0x329/0x7d0 [10684.650808][ C2] ? __pfx_ip_rcv+0x10/0x10 [10684.651019][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10684.651299][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10684.651561][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10684.651860][ C2] ? lock_acquire+0x1c1/0x220 [10684.652081][ C2] ? netif_receive_skb_internal+0x84/0x300 [10684.652356][ C2] netif_receive_skb_internal+0xb0/0x300 [10684.652618][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10684.652917][ C2] ? __copy_skb_header+0xaf/0x490 [10684.653161][ C2] ? __skb_clone+0x57a/0x760 [10684.653378][ C2] netif_receive_skb+0x55/0x280 [10684.653607][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10684.653894][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10684.654203][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10684.654477][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10684.654730][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10684.654996][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10684.655286][ C2] ? get_stack_info+0x36/0xc0 [10684.655507][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10684.655751][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10684.656043][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10684.656299][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10684.656553][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10684.656843][ C2] ? kernel_text_address+0x17/0xe0 [10684.657091][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10684.657381][ C2] ? arch_stack_walk+0x8c/0x100 [10684.657610][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10684.657853][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10684.658117][ C2] ? lock_acquire+0x1c1/0x220 [10684.658337][ C2] ? stack_depot_save_flags+0x281/0x550 [10684.658598][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10684.658877][ C2] ? get_stack_info_noinstr+0x18/0x110 [10684.659154][ C2] ? get_stack_info+0x36/0xc0 [10684.659414][ C2] __tcf_classify+0x329/0x7d0 [10684.659656][ C2] tcf_classify+0x283/0x930 [10684.659889][ C2] ? __pfx_tcf_classify+0x10/0x10 [10684.660147][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10684.660459][ C2] tc_run+0x2e4/0x5d0 [10684.660673][ C2] ? __pfx_tc_run+0x10/0x10 [10684.660897][ C2] ? lock_acquire+0x1c1/0x220 [10684.661129][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10684.661382][ C2] __dev_queue_xmit+0x686/0x17e0 [10684.661629][ C2] ? lock_acquire+0x1c1/0x220 [10684.661849][ C2] ? ip_finish_output2+0x786/0x18e0 [10684.662092][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10684.662374][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10684.662624][ C2] ? neigh_hh_output+0x348/0x590 [10684.662857][ C2] ? ip_finish_output2+0x262/0x18e0 [10684.663101][ C2] ip_finish_output2+0x786/0x18e0 [10684.663337][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10684.663647][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10684.663903][ C2] ? rcu_read_lock_held+0xe/0x50 [10684.664136][ C2] ? __ip_finish_output+0x10f/0x770 [10684.664380][ C2] ip_output+0x16b/0x4f0 [10684.664580][ C2] ? __pfx_ip_output+0x10/0x10 [10684.664803][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10684.665060][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10684.665349][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10684.665602][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10684.665834][ C2] ? __alloc_skb+0xd4/0x280 [10684.666047][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10684.666296][ C2] ? tcp_fragment+0x168/0x1040 [10684.666521][ C2] ? rcu_read_lock_held+0xe/0x50 [10684.666754][ C2] ? ip_local_out+0x114/0x3b0 [10684.666976][ C2] __ip_queue_xmit+0x672/0x1910 [10684.667205][ C2] ? __skb_clone+0x57a/0x760 [10684.667421][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10684.667692][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10684.667965][ C2] ? ipv4_dst_check+0xe3/0x170 [10684.668225][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10684.668472][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10684.668780][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10684.669090][ C2] ? tcp_fragment+0xb0e/0x1040 [10684.669328][ C2] tcp_send_loss_probe+0x348/0x830 [10684.669586][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10684.669845][ C2] tcp_write_timer+0x82/0x1d0 [10684.670079][ C2] call_timer_fn+0x173/0x430 [10684.670311][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10684.670572][ C2] ? next_expiry_recalc+0xcd/0x220 [10684.670813][ C2] __run_timers.part.0+0x52d/0x890 [10684.671053][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10684.671301][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10684.671562][ C2] ? lock_acquire+0x1c1/0x220 [10684.671783][ C2] ? clockevents_program_event+0xf6/0x300 [10684.672053][ C2] ? lock_release+0x1d5/0x250 [10684.672272][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10684.672517][ C2] ? ktime_get+0xb3/0x190 [10684.672720][ C2] ? clockevents_program_event+0x1ea/0x300 [10684.672993][ C2] run_timer_softirq+0x72/0x100 [10684.673222][ C2] __do_softirq+0x1b9/0x7ff [10684.673437][ C2] irq_exit_rcu+0x98/0xc0 [10684.673639][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10684.673902][ C2] [10684.674039][ C2] [10684.674181][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10684.674459][ C2] RIP: 0010:default_idle+0xf/0x20 [10684.674697][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10684.675592][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10684.675873][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10684.676244][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10684.676641][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10684.677036][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10684.677434][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10684.677841][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10684.678107][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10684.678347][ C2] default_idle_call+0x69/0xa0 [10684.678572][ C2] cpuidle_idle_call+0x1f6/0x280 [10684.678803][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10684.679060][ C2] ? lock_release+0x1d5/0x250 [10684.679283][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10684.679588][ C2] do_idle+0xfb/0x160 [10684.679791][ C2] cpu_startup_entry+0x55/0x60 [10684.680033][ C2] start_secondary+0x21c/0x2b0 [10684.680278][ C2] ? __pfx_start_secondary+0x10/0x10 [10684.680561][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10684.680848][ C2] [10712.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7785s! [swapper/2:0] [10712.569711][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10712.570975][ C2] irq event stamp: 44114564 [10712.571206][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10712.571742][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10712.572252][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10712.572725][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10712.573199][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10712.573654][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10712.574265][ C2] RIP: 0010:kasan_check_range+0x158/0x1c0 [10712.574558][ C2] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [10712.575527][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000246 [10712.575834][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [10712.576232][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10712.576629][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [10712.577028][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10712.577426][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10712.577823][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10712.578269][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10712.578600][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10712.579001][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10712.579408][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10712.579804][ C2] PKRU: 55555554 [10712.579986][ C2] Call Trace: [10712.580159][ C2] [10712.580306][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10712.580568][ C2] ? __run_hrtimer+0x1c0/0x710 [10712.580811][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10712.581086][ C2] ? __hrtimer_run_queues+0x197/0x270 [10712.581359][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10712.581647][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10712.581913][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10712.582219][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10712.582478][ C2] ? hrtimer_interrupt+0x31a/0x770 [10712.582738][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10712.583000][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10712.583310][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10712.583604][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10712.583917][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10712.584209][ C2] ? kasan_check_range+0x158/0x1c0 [10712.584469][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [10712.584749][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10712.585059][ C2] ? get_stack_info+0x36/0xc0 [10712.585303][ C2] ? lock_acquire+0x1c1/0x220 [10712.585544][ C2] ? lock_release+0x1d5/0x250 [10712.585781][ C2] do_raw_spin_lock+0x1ec/0x270 [10712.586029][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10712.586303][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10712.586587][ C2] ? lock_acquire+0x1c1/0x220 [10712.586827][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10712.587066][ C2] _raw_spin_lock_nested+0x65/0x80 [10712.587332][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10712.587565][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10712.587812][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10712.588070][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10712.588347][ C2] ip_local_deliver_finish+0x2ae/0x480 [10712.588624][ C2] ip_local_deliver+0x19d/0x480 [10712.588870][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10712.589144][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10712.589415][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10712.589762][ C2] ? rcu_read_lock_held+0xe/0x50 [10712.590014][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10712.590334][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10712.590597][ C2] ip_rcv+0x564/0x740 [10712.590799][ C2] ? __pfx_ip_rcv+0x10/0x10 [10712.591030][ C2] ? set_track_prepare+0x8a/0xd0 [10712.591286][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10712.591560][ C2] ? start_secondary+0x21c/0x2b0 [10712.591811][ C2] ? skb_clone+0x10b/0x330 [10712.592039][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10712.592358][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10712.592661][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10712.592945][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10712.593239][ C2] ? __tcf_classify+0x329/0x7d0 [10712.593487][ C2] ? __pfx_ip_rcv+0x10/0x10 [10712.593718][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10712.594016][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10712.594302][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10712.594626][ C2] ? lock_acquire+0x1c1/0x220 [10712.594866][ C2] ? netif_receive_skb_internal+0x84/0x300 [10712.595160][ C2] netif_receive_skb_internal+0xb0/0x300 [10712.595446][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10712.595761][ C2] ? __copy_skb_header+0xaf/0x490 [10712.596020][ C2] ? __skb_clone+0x57a/0x760 [10712.596253][ C2] netif_receive_skb+0x55/0x280 [10712.596501][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10712.596814][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10712.597145][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10712.597446][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10712.597719][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10712.598006][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10712.598318][ C2] ? get_stack_info+0x36/0xc0 [10712.598559][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10712.598822][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10712.599139][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10712.599419][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10712.599697][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10712.600011][ C2] ? kernel_text_address+0x17/0xe0 [10712.600273][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10712.600586][ C2] ? arch_stack_walk+0x8c/0x100 [10712.600834][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10712.601099][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10712.601383][ C2] ? lock_acquire+0x1c1/0x220 [10712.601622][ C2] ? stack_depot_save_flags+0x281/0x550 [10712.601903][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10712.602209][ C2] ? get_stack_info_noinstr+0x18/0x110 [10712.602509][ C2] ? get_stack_info+0x36/0xc0 [10712.602750][ C2] __tcf_classify+0x329/0x7d0 [10712.602992][ C2] tcf_classify+0x283/0x930 [10712.603223][ C2] ? __pfx_tcf_classify+0x10/0x10 [10712.603479][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10712.603791][ C2] tc_run+0x2e4/0x5d0 [10712.603994][ C2] ? __pfx_tc_run+0x10/0x10 [10712.604228][ C2] ? lock_acquire+0x1c1/0x220 [10712.604468][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10712.604729][ C2] __dev_queue_xmit+0x686/0x17e0 [10712.604983][ C2] ? lock_acquire+0x1c1/0x220 [10712.605221][ C2] ? ip_finish_output2+0x786/0x18e0 [10712.605485][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10712.605786][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10712.606059][ C2] ? neigh_hh_output+0x348/0x590 [10712.606313][ C2] ? ip_finish_output2+0x262/0x18e0 [10712.606587][ C2] ip_finish_output2+0x786/0x18e0 [10712.606836][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10712.607184][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10712.607458][ C2] ? rcu_read_lock_held+0xe/0x50 [10712.607711][ C2] ? __ip_finish_output+0x10f/0x770 [10712.607974][ C2] ip_output+0x16b/0x4f0 [10712.608197][ C2] ? __pfx_ip_output+0x10/0x10 [10712.608438][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10712.608715][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10712.609026][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10712.609309][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10712.609560][ C2] ? __alloc_skb+0xd4/0x280 [10712.609790][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10712.610061][ C2] ? tcp_fragment+0x168/0x1040 [10712.610305][ C2] ? rcu_read_lock_held+0xe/0x50 [10712.610556][ C2] ? ip_local_out+0x114/0x3b0 [10712.610795][ C2] __ip_queue_xmit+0x672/0x1910 [10712.611043][ C2] ? __skb_clone+0x57a/0x760 [10712.611279][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10712.611553][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10712.611824][ C2] ? ipv4_dst_check+0xe3/0x170 [10712.612062][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10712.612336][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10712.612630][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10712.612940][ C2] ? tcp_fragment+0xb0e/0x1040 [10712.613177][ C2] tcp_send_loss_probe+0x348/0x830 [10712.613430][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10712.613708][ C2] tcp_write_timer+0x82/0x1d0 [10712.613947][ C2] call_timer_fn+0x173/0x430 [10712.614185][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10712.614446][ C2] ? next_expiry_recalc+0xcd/0x220 [10712.614715][ C2] __run_timers.part.0+0x52d/0x890 [10712.614967][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10712.615231][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10712.615508][ C2] ? lock_acquire+0x1c1/0x220 [10712.615764][ C2] ? clockevents_program_event+0xf6/0x300 [10712.616053][ C2] ? lock_release+0x1d5/0x250 [10712.616294][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10712.616556][ C2] ? ktime_get+0xb3/0x190 [10712.616777][ C2] ? clockevents_program_event+0x1ea/0x300 [10712.617072][ C2] run_timer_softirq+0x72/0x100 [10712.617321][ C2] __do_softirq+0x1b9/0x7ff [10712.617554][ C2] irq_exit_rcu+0x98/0xc0 [10712.617772][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10712.618056][ C2] [10712.618208][ C2] [10712.618357][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10712.618667][ C2] RIP: 0010:default_idle+0xf/0x20 [10712.618917][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10712.619906][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10712.620214][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10712.620611][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10712.621008][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10712.621407][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10712.621803][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10712.622203][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10712.622497][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10712.622758][ C2] default_idle_call+0x69/0xa0 [10712.623002][ C2] cpuidle_idle_call+0x1f6/0x280 [10712.623252][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10712.623530][ C2] ? lock_release+0x1d5/0x250 [10712.623768][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10712.624040][ C2] do_idle+0xfb/0x160 [10712.624246][ C2] cpu_startup_entry+0x55/0x60 [10712.624488][ C2] start_secondary+0x21c/0x2b0 [10712.624731][ C2] ? __pfx_start_secondary+0x10/0x10 [10712.625000][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10712.625311][ C2] [10712.625468][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7785s! [perl:4135] [10712.625891][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10712.627148][ C1] irq event stamp: 209232 [10712.627368][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10712.627897][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10712.628374][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10712.628845][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10712.629315][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10712.629763][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10712.630373][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10712.630700][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10712.631670][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10712.631976][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10712.632379][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10712.632778][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10712.633176][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10712.633574][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10712.633976][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10712.634424][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10712.634757][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10712.635161][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10712.635560][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10712.635960][ C1] PKRU: 55555554 [10712.636141][ C1] Call Trace: [10712.636310][ C1] [10712.636461][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10712.636723][ C1] ? __run_hrtimer+0x1c0/0x710 [10712.636965][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10712.637243][ C1] ? __hrtimer_run_queues+0x197/0x270 [10712.637516][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10712.637803][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10712.638070][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10712.638374][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10712.638637][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10712.638945][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10712.639247][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10712.639563][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10712.639850][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10712.640147][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10712.640434][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10712.640745][ C1] ? get_stack_info+0x36/0xc0 [10712.640987][ C1] ? lock_acquire+0x1c1/0x220 [10712.641228][ C1] ? lock_release+0x1d5/0x250 [10712.641467][ C1] do_raw_spin_lock+0x1ec/0x270 [10712.641715][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10712.641989][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10712.642274][ C1] ? lock_acquire+0x1c1/0x220 [10712.642513][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10712.642755][ C1] _raw_spin_lock_nested+0x65/0x80 [10712.643016][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10712.643249][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10712.643497][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10712.643754][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10712.644029][ C1] ip_local_deliver_finish+0x2ae/0x480 [10712.644308][ C1] ip_local_deliver+0x19d/0x480 [10712.644555][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10712.644827][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10712.645091][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10712.645438][ C1] ? rcu_read_lock_held+0xe/0x50 [10712.645786][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10712.646122][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10712.646385][ C1] ip_rcv+0x564/0x740 [10712.646590][ C1] ? __pfx_ip_rcv+0x10/0x10 [10712.646822][ C1] ? set_track_prepare+0x8a/0xd0 [10712.647076][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10712.647352][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10712.647625][ C1] ? skb_clone+0x10b/0x330 [10712.647852][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10712.648172][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10712.648477][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10712.648758][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10712.649054][ C1] ? __tcf_classify+0x329/0x7d0 [10712.649319][ C1] ? __pfx_ip_rcv+0x10/0x10 [10712.649548][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10712.649849][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10712.650134][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10712.650461][ C1] ? lock_acquire+0x1c1/0x220 [10712.650702][ C1] ? netif_receive_skb_internal+0x84/0x300 [10712.651001][ C1] netif_receive_skb_internal+0xb0/0x300 [10712.651286][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10712.651603][ C1] ? __copy_skb_header+0xaf/0x490 [10712.651861][ C1] ? __skb_clone+0x57a/0x760 [10712.652097][ C1] netif_receive_skb+0x55/0x280 [10712.652345][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10712.652658][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10712.652991][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10712.653290][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10712.653565][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10712.653854][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10712.654167][ C1] ? hlock_class+0x4e/0x130 [10712.654400][ C1] ? get_stack_info_noinstr+0x18/0x110 [10712.654678][ C1] ? get_stack_info_noinstr+0x18/0x110 [10712.654954][ C1] ? __pfx_validate_chain+0x10/0x10 [10712.655218][ C1] ? hlock_class+0x4e/0x130 [10712.655450][ C1] ? mark_lock+0x38/0x3e0 [10712.655669][ C1] ? stack_access_ok+0xda/0x1f0 [10712.655918][ C1] ? __lock_acquire+0xb67/0x1610 [10712.656172][ C1] ? get_stack_info_noinstr+0x18/0x110 [10712.656448][ C1] ? get_stack_info+0x36/0xc0 [10712.656689][ C1] ? stack_access_ok+0xda/0x1f0 [10712.656937][ C1] ? get_reg+0x119/0x190 [10712.657153][ C1] ? unwind_next_frame+0x12af/0x1d10 [10712.657422][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10712.657731][ C1] __tcf_classify+0x329/0x7d0 [10712.657974][ C1] tcf_classify+0x283/0x930 [10712.658206][ C1] ? arch_stack_walk+0xa2/0x100 [10712.658455][ C1] ? __pfx_tcf_classify+0x10/0x10 [10712.658712][ C1] ? get_stack_info+0x36/0xc0 [10712.658953][ C1] tc_run+0x2e4/0x5d0 [10712.659159][ C1] ? __pfx_tc_run+0x10/0x10 [10712.659397][ C1] ? lock_acquire+0x1c1/0x220 [10712.659637][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10712.659898][ C1] __dev_queue_xmit+0x686/0x17e0 [10712.660152][ C1] ? lock_acquire+0x1c1/0x220 [10712.660392][ C1] ? ip_finish_output2+0x786/0x18e0 [10712.660658][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10712.660961][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10712.661236][ C1] ? neigh_hh_output+0x348/0x590 [10712.661489][ C1] ? ip_finish_output2+0x262/0x18e0 [10712.661754][ C1] ip_finish_output2+0x786/0x18e0 [10712.662010][ C1] ? stack_depot_save_flags+0x45/0x550 [10712.662288][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10712.662625][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10712.662903][ C1] ? rcu_read_lock_held+0xe/0x50 [10712.663157][ C1] ? __ip_finish_output+0x10f/0x770 [10712.663424][ C1] ip_output+0x16b/0x4f0 [10712.663640][ C1] ? run_timer_softirq+0x72/0x100 [10712.663896][ C1] ? __pfx_ip_output+0x10/0x10 [10712.664143][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10712.664429][ C1] ? rcu_read_lock_held+0xe/0x50 [10712.664681][ C1] ? ip_local_out+0x114/0x3b0 [10712.664922][ C1] __ip_queue_xmit+0x672/0x1910 [10712.665171][ C1] ? __create_object+0x5e/0xb0 [10712.665419][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10712.665688][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10712.665969][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10712.666242][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10712.666528][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10712.666800][ C1] tcp_delack_timer+0x84/0x240 [10712.667045][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10712.667318][ C1] call_timer_fn+0x173/0x430 [10712.667555][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10712.667818][ C1] ? next_expiry_recalc+0xcd/0x220 [10712.668100][ C1] __run_timers.part.0+0x52d/0x890 [10712.668500][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10712.668877][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10712.669327][ C1] ? lock_acquire+0x1c1/0x220 [10712.669655][ C1] ? clockevents_program_event+0xf6/0x300 [10712.670102][ C1] ? lock_release+0x1d5/0x250 [10712.670437][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10712.670846][ C1] ? ktime_get+0xb3/0x190 [10712.671115][ C1] ? clockevents_program_event+0x1ea/0x300 [10712.671574][ C1] run_timer_softirq+0x72/0x100 [10712.671916][ C1] __do_softirq+0x1b9/0x7ff [10712.672276][ C1] irq_exit_rcu+0x98/0xc0 [10712.672565][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10712.672986][ C1] [10712.673219][ C1] [10712.673425][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10712.673895][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10712.674340][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10712.675734][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10712.676211][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10712.676781][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10712.677346][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10712.677831][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10712.678232][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10712.678634][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10712.678933][ C1] pipe_read+0xa16/0xdf0 [10712.679156][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10712.679443][ C1] ? __pfx_pipe_read+0x10/0x10 [10712.679687][ C1] ? iterate_tty_write+0x299/0x540 [10712.679948][ C1] ? lock_release+0x1d5/0x250 [10712.680192][ C1] vfs_read+0x911/0xc00 [10712.680406][ C1] ? lock_acquire+0x1c1/0x220 [10712.680646][ C1] ? __might_fault+0xc6/0x180 [10712.680888][ C1] ? __pfx_vfs_read+0x10/0x10 [10712.681127][ C1] ? __might_fault+0xc6/0x180 [10712.681368][ C1] ? lock_release+0x1d5/0x250 [10712.681610][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10712.681877][ C1] ? __fget_light+0x54/0x1e0 [10712.682116][ C1] ksys_read+0x17a/0x1e0 [10712.682335][ C1] ? __pfx_ksys_read+0x10/0x10 [10712.682582][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10712.682890][ C1] do_syscall_64+0xc9/0x1e0 [10712.683123][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10712.683454][ C1] RIP: 0033:0x7f08a1ea38b2 [10712.683685][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10712.684661][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10712.685084][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10712.685487][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10712.685888][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10712.686316][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10712.686713][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10712.687117][ C1] [10736.470103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10736.470468][ C1] rcu: 1-....: (8071197 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1950080 [10736.471025][ C1] rcu: (t=8381583 jiffies g=1882453 q=727 ncpus=4) [10736.471357][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10736.471804][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10736.472410][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10736.472736][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10736.473701][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10736.474006][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10736.474404][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10736.474801][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10736.475197][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10736.475592][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10736.475990][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10736.476435][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10736.476765][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10736.477163][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10736.477559][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10736.477958][ C1] PKRU: 55555554 [10736.478138][ C1] Call Trace: [10736.478307][ C1] [10736.478455][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10736.478727][ C1] ? print_cpu_stall+0x263/0x6a0 [10736.478978][ C1] ? check_cpu_stall+0x284/0x500 [10736.479250][ C1] ? rcu_pending+0x92/0x360 [10736.479479][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10736.479746][ C1] ? update_process_times+0xb9/0x110 [10736.480016][ C1] ? tick_sched_handle+0x67/0x130 [10736.480271][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10736.480553][ C1] ? __run_hrtimer+0x1c0/0x710 [10736.480795][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10736.481106][ C1] ? __hrtimer_run_queues+0x197/0x270 [10736.481377][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10736.481663][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10736.481928][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10736.482232][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10736.482492][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10736.482801][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10736.483096][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10736.483409][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10736.483698][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10736.483993][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10736.484282][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10736.484592][ C1] ? get_stack_info+0x36/0xc0 [10736.484833][ C1] ? lock_acquire+0x1c1/0x220 [10736.485073][ C1] ? lock_release+0x1d5/0x250 [10736.485311][ C1] do_raw_spin_lock+0x1ec/0x270 [10736.485558][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10736.485831][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10736.486117][ C1] ? lock_acquire+0x1c1/0x220 [10736.486355][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10736.486593][ C1] _raw_spin_lock_nested+0x65/0x80 [10736.486853][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10736.487087][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10736.487333][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10736.487589][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10736.487862][ C1] ip_local_deliver_finish+0x2ae/0x480 [10736.488140][ C1] ip_local_deliver+0x19d/0x480 [10736.488385][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10736.488656][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10736.488917][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10736.489267][ C1] ? rcu_read_lock_held+0xe/0x50 [10736.489519][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10736.489837][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10736.490097][ C1] ip_rcv+0x564/0x740 [10736.490300][ C1] ? __pfx_ip_rcv+0x10/0x10 [10736.490530][ C1] ? set_track_prepare+0x8a/0xd0 [10736.490782][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10736.491056][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10736.491328][ C1] ? skb_clone+0x10b/0x330 [10736.491555][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10736.491873][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10736.492179][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10736.492458][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10736.492752][ C1] ? __tcf_classify+0x329/0x7d0 [10736.492999][ C1] ? __pfx_ip_rcv+0x10/0x10 [10736.493226][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10736.493526][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10736.493807][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10736.494131][ C1] ? lock_acquire+0x1c1/0x220 [10736.494369][ C1] ? netif_receive_skb_internal+0x84/0x300 [10736.494666][ C1] netif_receive_skb_internal+0xb0/0x300 [10736.494948][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10736.495264][ C1] ? __copy_skb_header+0xaf/0x490 [10736.495520][ C1] ? __skb_clone+0x57a/0x760 [10736.495753][ C1] netif_receive_skb+0x55/0x280 [10736.496000][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10736.496311][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10736.496643][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10736.496938][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10736.497213][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10736.497501][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10736.497813][ C1] ? hlock_class+0x4e/0x130 [10736.498042][ C1] ? get_stack_info_noinstr+0x18/0x110 [10736.498319][ C1] ? get_stack_info_noinstr+0x18/0x110 [10736.498593][ C1] ? __pfx_validate_chain+0x10/0x10 [10736.498855][ C1] ? hlock_class+0x4e/0x130 [10736.499086][ C1] ? mark_lock+0x38/0x3e0 [10736.499308][ C1] ? stack_access_ok+0xda/0x1f0 [10736.499555][ C1] ? __lock_acquire+0xb67/0x1610 [10736.499808][ C1] ? get_stack_info_noinstr+0x18/0x110 [10736.500082][ C1] ? get_stack_info+0x36/0xc0 [10736.500321][ C1] ? stack_access_ok+0xda/0x1f0 [10736.500567][ C1] ? get_reg+0x119/0x190 [10736.500780][ C1] ? unwind_next_frame+0x12af/0x1d10 [10736.501047][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10736.501354][ C1] __tcf_classify+0x329/0x7d0 [10736.501596][ C1] tcf_classify+0x283/0x930 [10736.501827][ C1] ? arch_stack_walk+0xa2/0x100 [10736.502074][ C1] ? __pfx_tcf_classify+0x10/0x10 [10736.502329][ C1] ? get_stack_info+0x36/0xc0 [10736.502568][ C1] tc_run+0x2e4/0x5d0 [10736.502773][ C1] ? __pfx_tc_run+0x10/0x10 [10736.503003][ C1] ? lock_acquire+0x1c1/0x220 [10736.503241][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10736.503501][ C1] __dev_queue_xmit+0x686/0x17e0 [10736.503754][ C1] ? lock_acquire+0x1c1/0x220 [10736.503992][ C1] ? ip_finish_output2+0x786/0x18e0 [10736.504256][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10736.504558][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10736.504830][ C1] ? neigh_hh_output+0x348/0x590 [10736.505081][ C1] ? ip_finish_output2+0x262/0x18e0 [10736.505344][ C1] ip_finish_output2+0x786/0x18e0 [10736.505599][ C1] ? stack_depot_save_flags+0x45/0x550 [10736.505875][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10736.506209][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10736.506485][ C1] ? rcu_read_lock_held+0xe/0x50 [10736.506736][ C1] ? __ip_finish_output+0x10f/0x770 [10736.507004][ C1] ip_output+0x16b/0x4f0 [10736.507219][ C1] ? run_timer_softirq+0x72/0x100 [10736.507473][ C1] ? __pfx_ip_output+0x10/0x10 [10736.507716][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10736.508000][ C1] ? rcu_read_lock_held+0xe/0x50 [10736.508251][ C1] ? ip_local_out+0x114/0x3b0 [10736.508490][ C1] __ip_queue_xmit+0x672/0x1910 [10736.508738][ C1] ? __create_object+0x5e/0xb0 [10736.508981][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10736.509251][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10736.509529][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10736.509799][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10736.510081][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10736.510351][ C1] tcp_delack_timer+0x84/0x240 [10736.510594][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10736.510863][ C1] call_timer_fn+0x173/0x430 [10736.511099][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10736.511360][ C1] ? next_expiry_recalc+0xcd/0x220 [10736.511619][ C1] __run_timers.part.0+0x52d/0x890 [10736.511878][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10736.512150][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10736.512434][ C1] ? lock_acquire+0x1c1/0x220 [10736.512668][ C1] ? clockevents_program_event+0xf6/0x300 [10736.512960][ C1] ? lock_release+0x1d5/0x250 [10736.513198][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10736.513460][ C1] ? ktime_get+0xb3/0x190 [10736.513678][ C1] ? clockevents_program_event+0x1ea/0x300 [10736.513974][ C1] run_timer_softirq+0x72/0x100 [10736.514224][ C1] __do_softirq+0x1b9/0x7ff [10736.514452][ C1] irq_exit_rcu+0x98/0xc0 [10736.514673][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10736.514956][ C1] [10736.515110][ C1] [10736.515260][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10736.515563][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10736.515886][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10736.516850][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10736.517157][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10736.517552][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10736.517947][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10736.518342][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10736.518740][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10736.519144][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10736.519439][ C1] pipe_read+0xa16/0xdf0 [10736.519658][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10736.519933][ C1] ? __pfx_pipe_read+0x10/0x10 [10736.520176][ C1] ? iterate_tty_write+0x299/0x540 [10736.520435][ C1] ? lock_release+0x1d5/0x250 [10736.520675][ C1] vfs_read+0x911/0xc00 [10736.520886][ C1] ? lock_acquire+0x1c1/0x220 [10736.521124][ C1] ? __might_fault+0xc6/0x180 [10736.521364][ C1] ? __pfx_vfs_read+0x10/0x10 [10736.521600][ C1] ? __might_fault+0xc6/0x180 [10736.521837][ C1] ? lock_release+0x1d5/0x250 [10736.522076][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10736.522338][ C1] ? __fget_light+0x54/0x1e0 [10736.522575][ C1] ksys_read+0x17a/0x1e0 [10736.522790][ C1] ? __pfx_ksys_read+0x10/0x10 [10736.523033][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10736.523336][ C1] do_syscall_64+0xc9/0x1e0 [10736.523565][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10736.523864][ C1] RIP: 0033:0x7f08a1ea38b2 [10736.524091][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10736.525055][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10736.525472][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10736.525869][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10736.526266][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10736.526666][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10736.527061][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10736.527461][ C1] [10736.527618][ C1] Sending NMI from CPU 1 to CPUs 2: [10736.527889][ C2] NMI backtrace for cpu 2 [10736.527896][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10736.527903][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10736.527908][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10736.527918][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10736.527924][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10736.527929][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10736.527933][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10736.527937][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10736.527942][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10736.527945][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10736.527949][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10736.527954][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10736.527960][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10736.527964][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10736.527967][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10736.527970][ C2] PKRU: 55555554 [10736.527973][ C2] Call Trace: [10736.527976][ C2] [10736.527979][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10736.527993][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10736.528002][ C2] ? nmi_handle+0x153/0x420 [10736.528009][ C2] ? default_do_nmi+0x41/0x100 [10736.528012][ C2] ? exc_nmi+0xf3/0x120 [10736.528015][ C2] ? end_repeat_nmi+0xf/0x60 [10736.528021][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10736.528024][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10736.528027][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10736.528030][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10736.528033][ C2] [10736.528034][ C2] [10736.528035][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10736.528038][ C2] ? get_stack_info+0x36/0xc0 [10736.528042][ C2] ? lock_acquire+0x1c1/0x220 [10736.528046][ C2] ? lock_release+0x1d5/0x250 [10736.528049][ C2] do_raw_spin_lock+0x1ec/0x270 [10736.528053][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10736.528056][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10736.528059][ C2] ? lock_acquire+0x1c1/0x220 [10736.528061][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10736.528065][ C2] _raw_spin_lock_nested+0x65/0x80 [10736.528068][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10736.528075][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10736.528077][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10736.528082][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10736.528088][ C2] ip_local_deliver_finish+0x2ae/0x480 [10736.528091][ C2] ip_local_deliver+0x19d/0x480 [10736.528094][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10736.528096][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10736.528098][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10736.528104][ C2] ? rcu_read_lock_held+0xe/0x50 [10736.528108][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10736.528110][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10736.528120][ C2] ip_rcv+0x564/0x740 [10736.528122][ C2] ? __pfx_ip_rcv+0x10/0x10 [10736.528124][ C2] ? set_track_prepare+0x8a/0xd0 [10736.528129][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10736.528132][ C2] ? start_secondary+0x21c/0x2b0 [10736.528135][ C2] ? skb_clone+0x10b/0x330 [10736.528139][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10736.528145][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10736.528150][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10736.528155][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10736.528163][ C2] ? __tcf_classify+0x329/0x7d0 [10736.528167][ C2] ? __pfx_ip_rcv+0x10/0x10 [10736.528169][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10736.528172][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10736.528176][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10736.528180][ C2] ? lock_acquire+0x1c1/0x220 [10736.528183][ C2] ? netif_receive_skb_internal+0x84/0x300 [10736.528187][ C2] netif_receive_skb_internal+0xb0/0x300 [10736.528191][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10736.528195][ C2] ? __copy_skb_header+0xaf/0x490 [10736.528200][ C2] ? __skb_clone+0x57a/0x760 [10736.528202][ C2] netif_receive_skb+0x55/0x280 [10736.528205][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10736.528213][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10736.528220][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10736.528227][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10736.528232][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10736.528242][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10736.528249][ C2] ? get_stack_info+0x36/0xc0 [10736.528254][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10736.528257][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10736.528260][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10736.528263][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10736.528267][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10736.528269][ C2] ? kernel_text_address+0x17/0xe0 [10736.528273][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10736.528277][ C2] ? arch_stack_walk+0x8c/0x100 [10736.528281][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10736.528285][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10736.528288][ C2] ? lock_acquire+0x1c1/0x220 [10736.528290][ C2] ? stack_depot_save_flags+0x281/0x550 [10736.528295][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10736.528300][ C2] ? get_stack_info_noinstr+0x18/0x110 [10736.528303][ C2] ? get_stack_info+0x36/0xc0 [10736.528307][ C2] __tcf_classify+0x329/0x7d0 [10736.528313][ C2] tcf_classify+0x283/0x930 [10736.528317][ C2] ? __pfx_tcf_classify+0x10/0x10 [10736.528321][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10736.528325][ C2] tc_run+0x2e4/0x5d0 [10736.528329][ C2] ? __pfx_tc_run+0x10/0x10 [10736.528332][ C2] ? lock_acquire+0x1c1/0x220 [10736.528334][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10736.528339][ C2] __dev_queue_xmit+0x686/0x17e0 [10736.528343][ C2] ? lock_acquire+0x1c1/0x220 [10736.528345][ C2] ? ip_finish_output2+0x786/0x18e0 [10736.528349][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10736.528352][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10736.528355][ C2] ? neigh_hh_output+0x348/0x590 [10736.528358][ C2] ? ip_finish_output2+0x262/0x18e0 [10736.528362][ C2] ip_finish_output2+0x786/0x18e0 [10736.528366][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10736.528373][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10736.528376][ C2] ? rcu_read_lock_held+0xe/0x50 [10736.528380][ C2] ? __ip_finish_output+0x10f/0x770 [10736.528383][ C2] ip_output+0x16b/0x4f0 [10736.528386][ C2] ? __pfx_ip_output+0x10/0x10 [10736.528389][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10736.528392][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10736.528395][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10736.528398][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10736.528401][ C2] ? __alloc_skb+0xd4/0x280 [10736.528403][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10736.528408][ C2] ? tcp_fragment+0x168/0x1040 [10736.528412][ C2] ? rcu_read_lock_held+0xe/0x50 [10736.528414][ C2] ? ip_local_out+0x114/0x3b0 [10736.528418][ C2] __ip_queue_xmit+0x672/0x1910 [10736.528421][ C2] ? __skb_clone+0x57a/0x760 [10736.528424][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10736.528430][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10736.528433][ C2] ? ipv4_dst_check+0xe3/0x170 [10736.528436][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10736.528441][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10736.528446][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10736.528449][ C2] ? tcp_fragment+0xb0e/0x1040 [10736.528452][ C2] tcp_send_loss_probe+0x348/0x830 [10736.528455][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10736.528458][ C2] tcp_write_timer+0x82/0x1d0 [10736.528461][ C2] call_timer_fn+0x173/0x430 [10736.528466][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10736.528471][ C2] ? next_expiry_recalc+0xcd/0x220 [10736.528475][ C2] __run_timers.part.0+0x52d/0x890 [10736.528478][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10736.528482][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10736.528486][ C2] ? lock_acquire+0x1c1/0x220 [10736.528488][ C2] ? clockevents_program_event+0xf6/0x300 [10736.528493][ C2] ? lock_release+0x1d5/0x250 [10736.528495][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10736.528499][ C2] ? ktime_get+0xb3/0x190 [10736.528502][ C2] ? clockevents_program_event+0x1ea/0x300 [10736.528506][ C2] run_timer_softirq+0x72/0x100 [10736.528510][ C2] __do_softirq+0x1b9/0x7ff [10736.528514][ C2] irq_exit_rcu+0x98/0xc0 [10736.528517][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10736.528520][ C2] [10736.528521][ C2] [10736.528522][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10736.528525][ C2] RIP: 0010:default_idle+0xf/0x20 [10736.528529][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10736.528531][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10736.528533][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10736.528534][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10736.528536][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10736.528537][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10736.528538][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10736.528542][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10736.528545][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10736.528548][ C2] default_idle_call+0x69/0xa0 [10736.528551][ C2] cpuidle_idle_call+0x1f6/0x280 [10736.528554][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10736.528557][ C2] ? lock_release+0x1d5/0x250 [10736.528560][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10736.528564][ C2] do_idle+0xfb/0x160 [10736.528566][ C2] cpu_startup_entry+0x55/0x60 [10736.528568][ C2] start_secondary+0x21c/0x2b0 [10736.528571][ C2] ? __pfx_start_secondary+0x10/0x10 [10736.528575][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10736.528581][ C2] [10760.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7830s! [perl:4135] [10760.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10760.570965][ C1] irq event stamp: 209232 [10760.571183][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10760.571717][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10760.572198][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10760.572668][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10760.573137][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10760.573586][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10760.574200][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10760.574525][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10760.575500][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10760.575809][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10760.576209][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10760.576609][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10760.577009][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10760.577420][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10760.577819][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10760.578269][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10760.578604][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10760.579017][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10760.579419][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10760.579819][ C1] PKRU: 55555554 [10760.580003][ C1] Call Trace: [10760.580176][ C1] [10760.580325][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10760.580588][ C1] ? __run_hrtimer+0x1c0/0x710 [10760.580835][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10760.581114][ C1] ? __hrtimer_run_queues+0x197/0x270 [10760.581399][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10760.581686][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10760.581953][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10760.582262][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10760.582525][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10760.582836][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10760.583135][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10760.583453][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10760.583744][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10760.584042][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10760.584333][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10760.584645][ C1] ? get_stack_info+0x36/0xc0 [10760.584889][ C1] ? lock_acquire+0x1c1/0x220 [10760.585130][ C1] ? lock_release+0x1d5/0x250 [10760.585378][ C1] do_raw_spin_lock+0x1ec/0x270 [10760.585629][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10760.585902][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10760.586191][ C1] ? lock_acquire+0x1c1/0x220 [10760.586430][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10760.586671][ C1] _raw_spin_lock_nested+0x65/0x80 [10760.586932][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10760.587171][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10760.587419][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10760.587679][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10760.587959][ C1] ip_local_deliver_finish+0x2ae/0x480 [10760.588239][ C1] ip_local_deliver+0x19d/0x480 [10760.588487][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10760.588760][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10760.589045][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10760.589397][ C1] ? rcu_read_lock_held+0xe/0x50 [10760.589696][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10760.590156][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10760.590539][ C1] ip_rcv+0x564/0x740 [10760.590851][ C1] ? __pfx_ip_rcv+0x10/0x10 [10760.591200][ C1] ? set_track_prepare+0x8a/0xd0 [10760.591579][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10760.591883][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10760.592156][ C1] ? skb_clone+0x10b/0x330 [10760.592386][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10760.592706][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10760.593010][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10760.593312][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10760.593611][ C1] ? __tcf_classify+0x329/0x7d0 [10760.593861][ C1] ? __pfx_ip_rcv+0x10/0x10 [10760.594103][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10760.594407][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10760.594695][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10760.595021][ C1] ? lock_acquire+0x1c1/0x220 [10760.595264][ C1] ? netif_receive_skb_internal+0x84/0x300 [10760.595571][ C1] netif_receive_skb_internal+0xb0/0x300 [10760.595859][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10760.596177][ C1] ? __copy_skb_header+0xaf/0x490 [10760.596437][ C1] ? __skb_clone+0x57a/0x760 [10760.596672][ C1] netif_receive_skb+0x55/0x280 [10760.596920][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10760.597238][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10760.597571][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10760.597891][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10760.598177][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10760.598466][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10760.598776][ C1] ? hlock_class+0x4e/0x130 [10760.599033][ C1] ? get_stack_info_noinstr+0x18/0x110 [10760.599309][ C1] ? get_stack_info_noinstr+0x18/0x110 [10760.599587][ C1] ? __pfx_validate_chain+0x10/0x10 [10760.599851][ C1] ? hlock_class+0x4e/0x130 [10760.600080][ C1] ? mark_lock+0x38/0x3e0 [10760.600303][ C1] ? stack_access_ok+0xda/0x1f0 [10760.600558][ C1] ? __lock_acquire+0xb67/0x1610 [10760.600815][ C1] ? get_stack_info_noinstr+0x18/0x110 [10760.601093][ C1] ? get_stack_info+0x36/0xc0 [10760.601336][ C1] ? stack_access_ok+0xda/0x1f0 [10760.601583][ C1] ? get_reg+0x119/0x190 [10760.601800][ C1] ? unwind_next_frame+0x12af/0x1d10 [10760.602068][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10760.602381][ C1] __tcf_classify+0x329/0x7d0 [10760.602625][ C1] tcf_classify+0x283/0x930 [10760.602855][ C1] ? arch_stack_walk+0xa2/0x100 [10760.603105][ C1] ? __pfx_tcf_classify+0x10/0x10 [10760.603361][ C1] ? get_stack_info+0x36/0xc0 [10760.603602][ C1] tc_run+0x2e4/0x5d0 [10760.603807][ C1] ? __pfx_tc_run+0x10/0x10 [10760.604040][ C1] ? lock_acquire+0x1c1/0x220 [10760.604289][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10760.604551][ C1] __dev_queue_xmit+0x686/0x17e0 [10760.604805][ C1] ? lock_acquire+0x1c1/0x220 [10760.605043][ C1] ? ip_finish_output2+0x786/0x18e0 [10760.605309][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10760.605619][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10760.605890][ C1] ? neigh_hh_output+0x348/0x590 [10760.606144][ C1] ? ip_finish_output2+0x262/0x18e0 [10760.606412][ C1] ip_finish_output2+0x786/0x18e0 [10760.606669][ C1] ? stack_depot_save_flags+0x45/0x550 [10760.606950][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10760.607290][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10760.607567][ C1] ? rcu_read_lock_held+0xe/0x50 [10760.607873][ C1] ? __ip_finish_output+0x10f/0x770 [10760.608149][ C1] ip_output+0x16b/0x4f0 [10760.608368][ C1] ? run_timer_softirq+0x72/0x100 [10760.608626][ C1] ? __pfx_ip_output+0x10/0x10 [10760.608875][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10760.609176][ C1] ? rcu_read_lock_held+0xe/0x50 [10760.609428][ C1] ? ip_local_out+0x114/0x3b0 [10760.609668][ C1] __ip_queue_xmit+0x672/0x1910 [10760.609917][ C1] ? __create_object+0x5e/0xb0 [10760.610161][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10760.610512][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10760.610935][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10760.611346][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10760.611773][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10760.612179][ C1] tcp_delack_timer+0x84/0x240 [10760.612434][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10760.612706][ C1] call_timer_fn+0x173/0x430 [10760.612944][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10760.613237][ C1] ? next_expiry_recalc+0xcd/0x220 [10760.613592][ C1] __run_timers.part.0+0x52d/0x890 [10760.613986][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10760.614404][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10760.614837][ C1] ? lock_acquire+0x1c1/0x220 [10760.615200][ C1] ? clockevents_program_event+0xf6/0x300 [10760.615536][ C1] ? lock_release+0x1d5/0x250 [10760.615776][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10760.616042][ C1] ? ktime_get+0xb3/0x190 [10760.616266][ C1] ? clockevents_program_event+0x1ea/0x300 [10760.616564][ C1] run_timer_softirq+0x72/0x100 [10760.616813][ C1] __do_softirq+0x1b9/0x7ff [10760.617049][ C1] irq_exit_rcu+0x98/0xc0 [10760.617328][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10760.617768][ C1] [10760.617995][ C1] [10760.618226][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10760.618694][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10760.619205][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10760.620691][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10760.621177][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10760.621802][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10760.622422][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10760.623030][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10760.623637][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10760.624260][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10760.624715][ C1] pipe_read+0xa16/0xdf0 [10760.625061][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10760.625480][ C1] ? __pfx_pipe_read+0x10/0x10 [10760.625857][ C1] ? iterate_tty_write+0x299/0x540 [10760.626263][ C1] ? lock_release+0x1d5/0x250 [10760.626639][ C1] vfs_read+0x911/0xc00 [10760.626974][ C1] ? lock_acquire+0x1c1/0x220 [10760.627344][ C1] ? __might_fault+0xc6/0x180 [10760.627709][ C1] ? __pfx_vfs_read+0x10/0x10 [10760.628064][ C1] ? __might_fault+0xc6/0x180 [10760.628430][ C1] ? lock_release+0x1d5/0x250 [10760.628796][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10760.629216][ C1] ? __fget_light+0x54/0x1e0 [10760.629583][ C1] ksys_read+0x17a/0x1e0 [10760.629925][ C1] ? __pfx_ksys_read+0x10/0x10 [10760.630302][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10760.630772][ C1] do_syscall_64+0xc9/0x1e0 [10760.631138][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10760.631599][ C1] RIP: 0033:0x7f08a1ea38b2 [10760.631952][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10760.633440][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10760.634080][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10760.634680][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10760.635286][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10760.635904][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10760.636507][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10760.637120][ C1] [10760.637362][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7830s! [swapper/2:0] [10760.638047][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10760.639988][ C2] irq event stamp: 44114564 [10760.640331][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10760.641117][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10760.641893][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10760.642632][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10760.643359][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10760.644061][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10760.645015][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10760.645525][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10760.647025][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10760.647523][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10760.648141][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10760.648751][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10760.649369][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10760.649979][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10760.650599][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10760.651283][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10760.651792][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10760.652392][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10760.653001][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10760.653612][ C2] PKRU: 55555554 [10760.653888][ C2] Call Trace: [10760.654149][ C2] [10760.654374][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10760.654778][ C2] ? __run_hrtimer+0x1c0/0x710 [10760.655148][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10760.655577][ C2] ? __hrtimer_run_queues+0x197/0x270 [10760.656002][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10760.656447][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10760.656857][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10760.657329][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10760.657739][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10760.658144][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10760.658623][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10760.659086][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10760.659570][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10760.660016][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10760.660477][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10760.660924][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10760.661406][ C2] ? get_stack_info+0x36/0xc0 [10760.661776][ C2] ? lock_acquire+0x1c1/0x220 [10760.662144][ C2] ? lock_release+0x1d5/0x250 [10760.662514][ C2] do_raw_spin_lock+0x1ec/0x270 [10760.662902][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10760.663328][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10760.663777][ C2] ? lock_acquire+0x1c1/0x220 [10760.664144][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10760.664515][ C2] _raw_spin_lock_nested+0x65/0x80 [10760.664929][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10760.665284][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10760.665665][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10760.666066][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10760.666491][ C2] ip_local_deliver_finish+0x2ae/0x480 [10760.666923][ C2] ip_local_deliver+0x19d/0x480 [10760.667308][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10760.667726][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10760.668132][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10760.668666][ C2] ? rcu_read_lock_held+0xe/0x50 [10760.669076][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10760.669574][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10760.669978][ C2] ip_rcv+0x564/0x740 [10760.670296][ C2] ? __pfx_ip_rcv+0x10/0x10 [10760.670655][ C2] ? set_track_prepare+0x8a/0xd0 [10760.671047][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10760.671475][ C2] ? start_secondary+0x21c/0x2b0 [10760.671864][ C2] ? skb_clone+0x10b/0x330 [10760.672217][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10760.672711][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10760.673188][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10760.673623][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10760.674091][ C2] ? __tcf_classify+0x329/0x7d0 [10760.674474][ C2] ? __pfx_ip_rcv+0x10/0x10 [10760.674827][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10760.675284][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10760.675686][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10760.676172][ C2] ? lock_acquire+0x1c1/0x220 [10760.676534][ C2] ? netif_receive_skb_internal+0x84/0x300 [10760.676985][ C2] netif_receive_skb_internal+0xb0/0x300 [10760.677419][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10760.677905][ C2] ? __copy_skb_header+0xaf/0x490 [10760.678304][ C2] ? __skb_clone+0x57a/0x760 [10760.678662][ C2] netif_receive_skb+0x55/0x280 [10760.679061][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10760.679540][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10760.680041][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10760.680503][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10760.680941][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10760.681384][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10760.681840][ C2] ? get_stack_info+0x36/0xc0 [10760.682198][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10760.682607][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10760.683091][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10760.683513][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10760.683938][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10760.684415][ C2] ? kernel_text_address+0x17/0xe0 [10760.684807][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10760.685280][ C2] ? arch_stack_walk+0x8c/0x100 [10760.685652][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10760.686056][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10760.686490][ C2] ? lock_acquire+0x1c1/0x220 [10760.686855][ C2] ? stack_depot_save_flags+0x281/0x550 [10760.687284][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10760.687745][ C2] ? get_stack_info_noinstr+0x18/0x110 [10760.688173][ C2] ? get_stack_info+0x36/0xc0 [10760.688550][ C2] __tcf_classify+0x329/0x7d0 [10760.688932][ C2] tcf_classify+0x283/0x930 [10760.689295][ C2] ? __pfx_tcf_classify+0x10/0x10 [10760.689692][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10760.690183][ C2] tc_run+0x2e4/0x5d0 [10760.690497][ C2] ? __pfx_tc_run+0x10/0x10 [10760.690843][ C2] ? lock_acquire+0x1c1/0x220 [10760.691206][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10760.691611][ C2] __dev_queue_xmit+0x686/0x17e0 [10760.691996][ C2] ? lock_acquire+0x1c1/0x220 [10760.692355][ C2] ? ip_finish_output2+0x786/0x18e0 [10760.692775][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10760.693236][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10760.693651][ C2] ? neigh_hh_output+0x348/0x590 [10760.694034][ C2] ? ip_finish_output2+0x262/0x18e0 [10760.694456][ C2] ip_finish_output2+0x786/0x18e0 [10760.694848][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10760.695359][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10760.695775][ C2] ? rcu_read_lock_held+0xe/0x50 [10760.696157][ C2] ? __ip_finish_output+0x10f/0x770 [10760.696558][ C2] ip_output+0x16b/0x4f0 [10760.696895][ C2] ? __pfx_ip_output+0x10/0x10 [10760.697265][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10760.697687][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10760.698168][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10760.698585][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10760.698967][ C2] ? __alloc_skb+0xd4/0x280 [10760.699336][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10760.699759][ C2] ? tcp_fragment+0x168/0x1040 [10760.700128][ C2] ? rcu_read_lock_held+0xe/0x50 [10760.700509][ C2] ? ip_local_out+0x114/0x3b0 [10760.700871][ C2] __ip_queue_xmit+0x672/0x1910 [10760.701259][ C2] ? __skb_clone+0x57a/0x760 [10760.701624][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10760.702024][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10760.702441][ C2] ? ipv4_dst_check+0xe3/0x170 [10760.702811][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10760.703191][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10760.703652][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10760.704140][ C2] ? tcp_fragment+0xb0e/0x1040 [10760.704514][ C2] tcp_send_loss_probe+0x348/0x830 [10760.704923][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10760.705333][ C2] tcp_write_timer+0x82/0x1d0 [10760.705708][ C2] call_timer_fn+0x173/0x430 [10760.706043][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10760.706445][ C2] ? next_expiry_recalc+0xcd/0x220 [10760.706851][ C2] __run_timers.part.0+0x52d/0x890 [10760.707253][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10760.707673][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10760.708112][ C2] ? lock_acquire+0x1c1/0x220 [10760.708483][ C2] ? clockevents_program_event+0xf6/0x300 [10760.708932][ C2] ? lock_release+0x1d5/0x250 [10760.709287][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10760.709693][ C2] ? ktime_get+0xb3/0x190 [10760.710010][ C2] ? clockevents_program_event+0x1ea/0x300 [10760.710440][ C2] run_timer_softirq+0x72/0x100 [10760.710807][ C2] __do_softirq+0x1b9/0x7ff [10760.711160][ C2] irq_exit_rcu+0x98/0xc0 [10760.711498][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10760.711927][ C2] [10760.712148][ C2] [10760.712367][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10760.712834][ C2] RIP: 0010:default_idle+0xf/0x20 [10760.713244][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10760.714733][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10760.715224][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10760.715839][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10760.716454][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10760.717053][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10760.717663][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10760.718269][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10760.718721][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10760.719134][ C2] default_idle_call+0x69/0xa0 [10760.719506][ C2] cpuidle_idle_call+0x1f6/0x280 [10760.719890][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10760.720312][ C2] ? lock_release+0x1d5/0x250 [10760.720680][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10760.721103][ C2] do_idle+0xfb/0x160 [10760.721419][ C2] cpu_startup_entry+0x55/0x60 [10760.721791][ C2] start_secondary+0x21c/0x2b0 [10760.722169][ C2] ? __pfx_start_secondary+0x10/0x10 [10760.722586][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10760.723080][ C2] [10788.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7856s! [perl:4135] [10788.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10788.570969][ C1] irq event stamp: 209232 [10788.571184][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10788.571717][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10788.572195][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10788.572663][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10788.573134][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10788.573588][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10788.574202][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [10788.574485][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [10788.575479][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [10788.575786][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10788.576186][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10788.576586][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10788.576985][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10788.577384][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10788.577785][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10788.578232][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10788.578565][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10788.578973][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10788.579372][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10788.579769][ C1] PKRU: 55555554 [10788.579951][ C1] Call Trace: [10788.580124][ C1] [10788.580272][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10788.580532][ C1] ? __run_hrtimer+0x1c0/0x710 [10788.580776][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10788.581052][ C1] ? __hrtimer_run_queues+0x197/0x270 [10788.581337][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10788.581616][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10788.581896][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10788.582202][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10788.582464][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10788.582775][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10788.583070][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10788.583385][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10788.583679][ C1] ? __pfx___kasan_check_read+0x10/0x10 [10788.583951][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10788.584228][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10788.584554][ C1] ? get_stack_info+0x36/0xc0 [10788.584793][ C1] ? lock_acquire+0x1c1/0x220 [10788.585034][ C1] ? lock_release+0x1d5/0x250 [10788.585276][ C1] do_raw_spin_lock+0x1ec/0x270 [10788.585526][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10788.585798][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10788.586081][ C1] ? lock_acquire+0x1c1/0x220 [10788.586321][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10788.586563][ C1] _raw_spin_lock_nested+0x65/0x80 [10788.586822][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10788.587056][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10788.587303][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10788.587560][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10788.587852][ C1] ip_local_deliver_finish+0x2ae/0x480 [10788.588122][ C1] ip_local_deliver+0x19d/0x480 [10788.588363][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10788.588628][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10788.588911][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10788.589260][ C1] ? rcu_read_lock_held+0xe/0x50 [10788.589515][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10788.589835][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10788.590097][ C1] ip_rcv+0x564/0x740 [10788.590329][ C1] ? __pfx_ip_rcv+0x10/0x10 [10788.590557][ C1] ? set_track_prepare+0x8a/0xd0 [10788.590810][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10788.591087][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10788.591361][ C1] ? skb_clone+0x10b/0x330 [10788.591586][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10788.591904][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10788.592215][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10788.592488][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10788.592794][ C1] ? __tcf_classify+0x329/0x7d0 [10788.593043][ C1] ? __pfx_ip_rcv+0x10/0x10 [10788.593273][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10788.593573][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10788.593859][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10788.594185][ C1] ? lock_acquire+0x1c1/0x220 [10788.594422][ C1] ? netif_receive_skb_internal+0x84/0x300 [10788.594722][ C1] netif_receive_skb_internal+0xb0/0x300 [10788.595007][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10788.595324][ C1] ? __copy_skb_header+0xaf/0x490 [10788.595581][ C1] ? __skb_clone+0x57a/0x760 [10788.595819][ C1] netif_receive_skb+0x55/0x280 [10788.596067][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10788.596380][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10788.596713][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10788.597012][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10788.597288][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10788.597576][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10788.597888][ C1] ? hlock_class+0x4e/0x130 [10788.598123][ C1] ? get_stack_info_noinstr+0x18/0x110 [10788.598399][ C1] ? get_stack_info_noinstr+0x18/0x110 [10788.598681][ C1] ? __pfx_validate_chain+0x10/0x10 [10788.598965][ C1] ? hlock_class+0x4e/0x130 [10788.599198][ C1] ? mark_lock+0x38/0x3e0 [10788.599417][ C1] ? stack_access_ok+0xda/0x1f0 [10788.599665][ C1] ? __lock_acquire+0xb67/0x1610 [10788.599919][ C1] ? get_stack_info_noinstr+0x18/0x110 [10788.600197][ C1] ? get_stack_info+0x36/0xc0 [10788.600436][ C1] ? stack_access_ok+0xda/0x1f0 [10788.600691][ C1] ? get_reg+0x119/0x190 [10788.600901][ C1] ? unwind_next_frame+0x12af/0x1d10 [10788.601163][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10788.601481][ C1] __tcf_classify+0x329/0x7d0 [10788.601720][ C1] tcf_classify+0x283/0x930 [10788.601953][ C1] ? arch_stack_walk+0xa2/0x100 [10788.602203][ C1] ? __pfx_tcf_classify+0x10/0x10 [10788.602460][ C1] ? get_stack_info+0x36/0xc0 [10788.602700][ C1] tc_run+0x2e4/0x5d0 [10788.602906][ C1] ? __pfx_tc_run+0x10/0x10 [10788.603135][ C1] ? lock_acquire+0x1c1/0x220 [10788.603375][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10788.603636][ C1] __dev_queue_xmit+0x686/0x17e0 [10788.603888][ C1] ? lock_acquire+0x1c1/0x220 [10788.604128][ C1] ? ip_finish_output2+0x786/0x18e0 [10788.604393][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10788.604698][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10788.604970][ C1] ? neigh_hh_output+0x348/0x590 [10788.605223][ C1] ? ip_finish_output2+0x262/0x18e0 [10788.605487][ C1] ip_finish_output2+0x786/0x18e0 [10788.605743][ C1] ? stack_depot_save_flags+0x45/0x550 [10788.606021][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10788.606361][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10788.606638][ C1] ? rcu_read_lock_held+0xe/0x50 [10788.606890][ C1] ? __ip_finish_output+0x10f/0x770 [10788.607156][ C1] ip_output+0x16b/0x4f0 [10788.607370][ C1] ? run_timer_softirq+0x72/0x100 [10788.607628][ C1] ? __pfx_ip_output+0x10/0x10 [10788.607871][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10788.608159][ C1] ? rcu_read_lock_held+0xe/0x50 [10788.608410][ C1] ? ip_local_out+0x114/0x3b0 [10788.608649][ C1] __ip_queue_xmit+0x672/0x1910 [10788.608902][ C1] ? __create_object+0x5e/0xb0 [10788.609147][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10788.609413][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10788.609694][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10788.609968][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10788.610248][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10788.610519][ C1] tcp_delack_timer+0x84/0x240 [10788.610763][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10788.611034][ C1] call_timer_fn+0x173/0x430 [10788.611271][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10788.611533][ C1] ? next_expiry_recalc+0xcd/0x220 [10788.611793][ C1] __run_timers.part.0+0x52d/0x890 [10788.612053][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10788.612328][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10788.612612][ C1] ? lock_acquire+0x1c1/0x220 [10788.612851][ C1] ? clockevents_program_event+0xf6/0x300 [10788.613139][ C1] ? lock_release+0x1d5/0x250 [10788.613378][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10788.613642][ C1] ? ktime_get+0xb3/0x190 [10788.613862][ C1] ? clockevents_program_event+0x1ea/0x300 [10788.614159][ C1] run_timer_softirq+0x72/0x100 [10788.614408][ C1] __do_softirq+0x1b9/0x7ff [10788.614640][ C1] irq_exit_rcu+0x98/0xc0 [10788.614859][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10788.615145][ C1] [10788.615296][ C1] [10788.615446][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10788.615750][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10788.616073][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10788.617044][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10788.617353][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10788.617750][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10788.618149][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10788.618548][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10788.618954][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10788.619354][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10788.619652][ C1] pipe_read+0xa16/0xdf0 [10788.619871][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10788.620152][ C1] ? __pfx_pipe_read+0x10/0x10 [10788.620393][ C1] ? iterate_tty_write+0x299/0x540 [10788.620656][ C1] ? lock_release+0x1d5/0x250 [10788.620896][ C1] vfs_read+0x911/0xc00 [10788.621111][ C1] ? lock_acquire+0x1c1/0x220 [10788.621348][ C1] ? __might_fault+0xc6/0x180 [10788.621589][ C1] ? __pfx_vfs_read+0x10/0x10 [10788.621828][ C1] ? __might_fault+0xc6/0x180 [10788.622066][ C1] ? lock_release+0x1d5/0x250 [10788.622305][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10788.622569][ C1] ? __fget_light+0x54/0x1e0 [10788.622807][ C1] ksys_read+0x17a/0x1e0 [10788.623024][ C1] ? __pfx_ksys_read+0x10/0x10 [10788.623269][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10788.623575][ C1] do_syscall_64+0xc9/0x1e0 [10788.623808][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10788.624106][ C1] RIP: 0033:0x7f08a1ea38b2 [10788.624336][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10788.625305][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10788.625727][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10788.626127][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10788.626524][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10788.626921][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10788.627321][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10788.627722][ C1] [10788.627879][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7856s! [swapper/2:0] [10788.628324][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10788.629589][ C2] irq event stamp: 44114564 [10788.629821][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10788.630363][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10788.630879][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10788.631356][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10788.631827][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10788.632286][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10788.632897][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10788.633219][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [10788.634191][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10788.634504][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10788.634901][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10788.635303][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10788.635702][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10788.636101][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10788.636499][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10788.636946][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10788.637283][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10788.637685][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10788.638084][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10788.638484][ C2] PKRU: 55555554 [10788.638665][ C2] Call Trace: [10788.638846][ C2] [10788.638996][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10788.639259][ C2] ? __run_hrtimer+0x1c0/0x710 [10788.639505][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10788.639784][ C2] ? __hrtimer_run_queues+0x197/0x270 [10788.640059][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10788.640345][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10788.640611][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10788.640920][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10788.641181][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10788.641442][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10788.641752][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10788.642050][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10788.642367][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10788.642656][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [10788.642946][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10788.643241][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10788.643552][ C2] ? get_stack_info+0x36/0xc0 [10788.643795][ C2] ? lock_acquire+0x1c1/0x220 [10788.644035][ C2] ? lock_release+0x1d5/0x250 [10788.644276][ C2] do_raw_spin_lock+0x1ec/0x270 [10788.644526][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10788.644797][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10788.645084][ C2] ? lock_acquire+0x1c1/0x220 [10788.645323][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10788.645567][ C2] _raw_spin_lock_nested+0x65/0x80 [10788.645827][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10788.646063][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10788.646311][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10788.646569][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10788.646843][ C2] ip_local_deliver_finish+0x2ae/0x480 [10788.647120][ C2] ip_local_deliver+0x19d/0x480 [10788.647368][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10788.647640][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10788.647903][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10788.648250][ C2] ? rcu_read_lock_held+0xe/0x50 [10788.648503][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10788.648822][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10788.649093][ C2] ip_rcv+0x564/0x740 [10788.649297][ C2] ? __pfx_ip_rcv+0x10/0x10 [10788.649528][ C2] ? set_track_prepare+0x8a/0xd0 [10788.649781][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10788.650057][ C2] ? start_secondary+0x21c/0x2b0 [10788.650309][ C2] ? skb_clone+0x10b/0x330 [10788.650537][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10788.650854][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10788.651160][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10788.651444][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10788.651738][ C2] ? __tcf_classify+0x329/0x7d0 [10788.651987][ C2] ? __pfx_ip_rcv+0x10/0x10 [10788.652218][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10788.652517][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10788.652804][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10788.653129][ C2] ? lock_acquire+0x1c1/0x220 [10788.653368][ C2] ? netif_receive_skb_internal+0x84/0x300 [10788.653663][ C2] netif_receive_skb_internal+0xb0/0x300 [10788.653948][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10788.654265][ C2] ? __copy_skb_header+0xaf/0x490 [10788.654523][ C2] ? __skb_clone+0x57a/0x760 [10788.654756][ C2] netif_receive_skb+0x55/0x280 [10788.655004][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10788.655318][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10788.655650][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10788.655950][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10788.656224][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10788.656510][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10788.656823][ C2] ? get_stack_info+0x36/0xc0 [10788.657065][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10788.657330][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10788.657648][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10788.657922][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10788.658204][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10788.658518][ C2] ? kernel_text_address+0x17/0xe0 [10788.658779][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10788.659098][ C2] ? arch_stack_walk+0x8c/0x100 [10788.659346][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10788.659610][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10788.659896][ C2] ? lock_acquire+0x1c1/0x220 [10788.660136][ C2] ? stack_depot_save_flags+0x281/0x550 [10788.660417][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10788.660722][ C2] ? get_stack_info_noinstr+0x18/0x110 [10788.660997][ C2] ? get_stack_info+0x36/0xc0 [10788.661239][ C2] __tcf_classify+0x329/0x7d0 [10788.661481][ C2] tcf_classify+0x283/0x930 [10788.661712][ C2] ? __pfx_tcf_classify+0x10/0x10 [10788.661968][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10788.662281][ C2] tc_run+0x2e4/0x5d0 [10788.662486][ C2] ? __pfx_tc_run+0x10/0x10 [10788.662718][ C2] ? lock_acquire+0x1c1/0x220 [10788.662958][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10788.663219][ C2] __dev_queue_xmit+0x686/0x17e0 [10788.663473][ C2] ? lock_acquire+0x1c1/0x220 [10788.663708][ C2] ? ip_finish_output2+0x786/0x18e0 [10788.663974][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10788.664278][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10788.664550][ C2] ? neigh_hh_output+0x348/0x590 [10788.664802][ C2] ? ip_finish_output2+0x262/0x18e0 [10788.665066][ C2] ip_finish_output2+0x786/0x18e0 [10788.665323][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10788.665661][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10788.665936][ C2] ? rcu_read_lock_held+0xe/0x50 [10788.666190][ C2] ? __ip_finish_output+0x10f/0x770 [10788.666454][ C2] ip_output+0x16b/0x4f0 [10788.666671][ C2] ? __pfx_ip_output+0x10/0x10 [10788.666912][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10788.667190][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10788.667501][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10788.667779][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10788.668030][ C2] ? __alloc_skb+0xd4/0x280 [10788.668260][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10788.668532][ C2] ? tcp_fragment+0x168/0x1040 [10788.668774][ C2] ? rcu_read_lock_held+0xe/0x50 [10788.669032][ C2] ? ip_local_out+0x114/0x3b0 [10788.669273][ C2] __ip_queue_xmit+0x672/0x1910 [10788.669522][ C2] ? __skb_clone+0x57a/0x760 [10788.669757][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10788.670024][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10788.670303][ C2] ? ipv4_dst_check+0xe3/0x170 [10788.670548][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10788.670798][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10788.671097][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10788.671417][ C2] ? tcp_fragment+0xb0e/0x1040 [10788.671660][ C2] tcp_send_loss_probe+0x348/0x830 [10788.671919][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10788.672190][ C2] tcp_write_timer+0x82/0x1d0 [10788.672428][ C2] call_timer_fn+0x173/0x430 [10788.672665][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10788.672926][ C2] ? next_expiry_recalc+0xcd/0x220 [10788.673187][ C2] __run_timers.part.0+0x52d/0x890 [10788.673446][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10788.673714][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10788.674001][ C2] ? lock_acquire+0x1c1/0x220 [10788.674240][ C2] ? clockevents_program_event+0xf6/0x300 [10788.674531][ C2] ? lock_release+0x1d5/0x250 [10788.674769][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10788.675033][ C2] ? ktime_get+0xb3/0x190 [10788.675253][ C2] ? clockevents_program_event+0x1ea/0x300 [10788.675549][ C2] run_timer_softirq+0x72/0x100 [10788.675798][ C2] __do_softirq+0x1b9/0x7ff [10788.676030][ C2] irq_exit_rcu+0x98/0xc0 [10788.676251][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10788.676535][ C2] [10788.676688][ C2] [10788.676837][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10788.677142][ C2] RIP: 0010:default_idle+0xf/0x20 [10788.677400][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10788.678368][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10788.678676][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10788.679081][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10788.679478][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10788.679877][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10788.680277][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10788.680676][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10788.680965][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10788.681227][ C2] default_idle_call+0x69/0xa0 [10788.681468][ C2] cpuidle_idle_call+0x1f6/0x280 [10788.681717][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10788.681998][ C2] ? lock_release+0x1d5/0x250 [10788.682235][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10788.682509][ C2] do_idle+0xfb/0x160 [10788.682712][ C2] cpu_startup_entry+0x55/0x60 [10788.682955][ C2] start_secondary+0x21c/0x2b0 [10788.683199][ C2] ? __pfx_start_secondary+0x10/0x10 [10788.683473][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10788.683787][ C2] [10814.528103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10814.528472][ C1] rcu: 1-....: (8149074 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1968484 [10814.529037][ C1] rcu: (t=8459641 jiffies g=1882453 q=727 ncpus=4) [10814.529371][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10814.529819][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10814.530432][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10814.530757][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [10814.531725][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10814.532033][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10814.532430][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10814.532828][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10814.533229][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10814.533627][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10814.534025][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10814.534474][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10814.534804][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10814.535208][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10814.535607][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10814.536004][ C1] PKRU: 55555554 [10814.536187][ C1] Call Trace: [10814.536358][ C1] [10814.536506][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10814.536778][ C1] ? print_cpu_stall+0x263/0x6a0 [10814.537030][ C1] ? check_cpu_stall+0x284/0x500 [10814.537282][ C1] ? rcu_pending+0x92/0x360 [10814.537513][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10814.537782][ C1] ? update_process_times+0xb9/0x110 [10814.538050][ C1] ? tick_sched_handle+0x67/0x130 [10814.538306][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10814.538592][ C1] ? __run_hrtimer+0x1c0/0x710 [10814.538839][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10814.539149][ C1] ? __hrtimer_run_queues+0x197/0x270 [10814.539424][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10814.539709][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10814.539973][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10814.540279][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10814.540540][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10814.540852][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10814.541148][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10814.541460][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10814.541751][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [10814.542038][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10814.542328][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10814.542640][ C1] ? get_stack_info+0x36/0xc0 [10814.542880][ C1] ? lock_acquire+0x1c1/0x220 [10814.543120][ C1] ? lock_release+0x1d5/0x250 [10814.543360][ C1] do_raw_spin_lock+0x1ec/0x270 [10814.543609][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10814.543880][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10814.544165][ C1] ? lock_acquire+0x1c1/0x220 [10814.544401][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10814.544643][ C1] _raw_spin_lock_nested+0x65/0x80 [10814.544902][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10814.545138][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10814.545385][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10814.545642][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10814.545925][ C1] ip_local_deliver_finish+0x2ae/0x480 [10814.546203][ C1] ip_local_deliver+0x19d/0x480 [10814.546451][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10814.546724][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10814.546987][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10814.547333][ C1] ? rcu_read_lock_held+0xe/0x50 [10814.547587][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10814.547907][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10814.548173][ C1] ip_rcv+0x564/0x740 [10814.548376][ C1] ? __pfx_ip_rcv+0x10/0x10 [10814.548608][ C1] ? set_track_prepare+0x8a/0xd0 [10814.548874][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10814.549149][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10814.549420][ C1] ? skb_clone+0x10b/0x330 [10814.549648][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10814.549967][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10814.550273][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10814.550556][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10814.550850][ C1] ? __tcf_classify+0x329/0x7d0 [10814.551097][ C1] ? __pfx_ip_rcv+0x10/0x10 [10814.551329][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10814.551629][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10814.551912][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10814.552236][ C1] ? lock_acquire+0x1c1/0x220 [10814.552475][ C1] ? netif_receive_skb_internal+0x84/0x300 [10814.552771][ C1] netif_receive_skb_internal+0xb0/0x300 [10814.553055][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10814.553373][ C1] ? __copy_skb_header+0xaf/0x490 [10814.553630][ C1] ? __skb_clone+0x57a/0x760 [10814.553865][ C1] netif_receive_skb+0x55/0x280 [10814.554113][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10814.554424][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10814.554756][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10814.555054][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10814.555327][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10814.555619][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10814.555930][ C1] ? hlock_class+0x4e/0x130 [10814.556163][ C1] ? get_stack_info_noinstr+0x18/0x110 [10814.556438][ C1] ? get_stack_info_noinstr+0x18/0x110 [10814.556714][ C1] ? __pfx_validate_chain+0x10/0x10 [10814.556977][ C1] ? hlock_class+0x4e/0x130 [10814.557208][ C1] ? mark_lock+0x38/0x3e0 [10814.557428][ C1] ? stack_access_ok+0xda/0x1f0 [10814.557678][ C1] ? __lock_acquire+0xb67/0x1610 [10814.557932][ C1] ? get_stack_info_noinstr+0x18/0x110 [10814.558207][ C1] ? get_stack_info+0x36/0xc0 [10814.558447][ C1] ? stack_access_ok+0xda/0x1f0 [10814.558702][ C1] ? get_reg+0x119/0x190 [10814.558930][ C1] ? unwind_next_frame+0x12af/0x1d10 [10814.559197][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10814.559507][ C1] __tcf_classify+0x329/0x7d0 [10814.559749][ C1] tcf_classify+0x283/0x930 [10814.559980][ C1] ? arch_stack_walk+0xa2/0x100 [10814.560228][ C1] ? __pfx_tcf_classify+0x10/0x10 [10814.560484][ C1] ? get_stack_info+0x36/0xc0 [10814.560725][ C1] tc_run+0x2e4/0x5d0 [10814.560929][ C1] ? __pfx_tc_run+0x10/0x10 [10814.561163][ C1] ? lock_acquire+0x1c1/0x220 [10814.561402][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10814.561663][ C1] __dev_queue_xmit+0x686/0x17e0 [10814.561915][ C1] ? lock_acquire+0x1c1/0x220 [10814.562152][ C1] ? ip_finish_output2+0x786/0x18e0 [10814.562418][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10814.562721][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10814.562994][ C1] ? neigh_hh_output+0x348/0x590 [10814.563246][ C1] ? ip_finish_output2+0x262/0x18e0 [10814.563511][ C1] ip_finish_output2+0x786/0x18e0 [10814.563766][ C1] ? stack_depot_save_flags+0x45/0x550 [10814.564044][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10814.564384][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10814.564658][ C1] ? rcu_read_lock_held+0xe/0x50 [10814.564910][ C1] ? __ip_finish_output+0x10f/0x770 [10814.565176][ C1] ip_output+0x16b/0x4f0 [10814.565393][ C1] ? run_timer_softirq+0x72/0x100 [10814.565650][ C1] ? __pfx_ip_output+0x10/0x10 [10814.565894][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10814.566179][ C1] ? rcu_read_lock_held+0xe/0x50 [10814.566433][ C1] ? ip_local_out+0x114/0x3b0 [10814.566674][ C1] __ip_queue_xmit+0x672/0x1910 [10814.566923][ C1] ? __create_object+0x5e/0xb0 [10814.567165][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10814.567434][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10814.567715][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10814.567986][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10814.568270][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10814.568542][ C1] tcp_delack_timer+0x84/0x240 [10814.568798][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10814.569069][ C1] call_timer_fn+0x173/0x430 [10814.569306][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10814.569569][ C1] ? next_expiry_recalc+0xcd/0x220 [10814.569829][ C1] __run_timers.part.0+0x52d/0x890 [10814.570089][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10814.570362][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10814.570647][ C1] ? lock_acquire+0x1c1/0x220 [10814.570884][ C1] ? clockevents_program_event+0xf6/0x300 [10814.571177][ C1] ? lock_release+0x1d5/0x250 [10814.571414][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10814.571678][ C1] ? ktime_get+0xb3/0x190 [10814.571898][ C1] ? clockevents_program_event+0x1ea/0x300 [10814.572195][ C1] run_timer_softirq+0x72/0x100 [10814.572442][ C1] __do_softirq+0x1b9/0x7ff [10814.572674][ C1] irq_exit_rcu+0x98/0xc0 [10814.572895][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10814.573180][ C1] [10814.573330][ C1] [10814.573482][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10814.573786][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10814.574111][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10814.575080][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10814.575388][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10814.575788][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10814.576187][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10814.576585][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10814.576984][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10814.577385][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10814.577680][ C1] pipe_read+0xa16/0xdf0 [10814.577903][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10814.578181][ C1] ? __pfx_pipe_read+0x10/0x10 [10814.578425][ C1] ? iterate_tty_write+0x299/0x540 [10814.578695][ C1] ? lock_release+0x1d5/0x250 [10814.578938][ C1] vfs_read+0x911/0xc00 [10814.579152][ C1] ? lock_acquire+0x1c1/0x220 [10814.579391][ C1] ? __might_fault+0xc6/0x180 [10814.579631][ C1] ? __pfx_vfs_read+0x10/0x10 [10814.579868][ C1] ? __might_fault+0xc6/0x180 [10814.580108][ C1] ? lock_release+0x1d5/0x250 [10814.580348][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10814.580612][ C1] ? __fget_light+0x54/0x1e0 [10814.580850][ C1] ksys_read+0x17a/0x1e0 [10814.581066][ C1] ? __pfx_ksys_read+0x10/0x10 [10814.581311][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10814.581615][ C1] do_syscall_64+0xc9/0x1e0 [10814.581846][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10814.582151][ C1] RIP: 0033:0x7f08a1ea38b2 [10814.582379][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10814.583351][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10814.583770][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10814.584169][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10814.584569][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10814.584967][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10814.585365][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10814.585765][ C1] [10814.585924][ C1] Sending NMI from CPU 1 to CPUs 2: [10814.586206][ C2] NMI backtrace for cpu 2 [10814.586213][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10814.586220][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10814.586225][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [10814.586236][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [10814.586242][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [10814.586245][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10814.586247][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10814.586249][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10814.586251][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10814.586252][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10814.586254][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10814.586256][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10814.586259][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10814.586261][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10814.586262][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10814.586264][ C2] PKRU: 55555554 [10814.586265][ C2] Call Trace: [10814.586267][ C2] [10814.586271][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10814.586279][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10814.586285][ C2] ? nmi_handle+0x153/0x420 [10814.586290][ C2] ? default_do_nmi+0x41/0x100 [10814.586293][ C2] ? exc_nmi+0xf3/0x120 [10814.586295][ C2] ? end_repeat_nmi+0xf/0x60 [10814.586301][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10814.586304][ C2] ? __pfx___kasan_check_read+0x10/0x10 [10814.586308][ C2] ? __pfx___kasan_check_read+0x10/0x10 [10814.586312][ C2] ? __pfx___kasan_check_read+0x10/0x10 [10814.586315][ C2] [10814.586316][ C2] [10814.586317][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [10814.586320][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10814.586323][ C2] ? get_stack_info+0x36/0xc0 [10814.586327][ C2] ? lock_acquire+0x1c1/0x220 [10814.586331][ C2] ? lock_release+0x1d5/0x250 [10814.586334][ C2] do_raw_spin_lock+0x1ec/0x270 [10814.586338][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10814.586341][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10814.586344][ C2] ? lock_acquire+0x1c1/0x220 [10814.586346][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10814.586350][ C2] _raw_spin_lock_nested+0x65/0x80 [10814.586354][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10814.586360][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10814.586363][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10814.586368][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10814.586374][ C2] ip_local_deliver_finish+0x2ae/0x480 [10814.586377][ C2] ip_local_deliver+0x19d/0x480 [10814.586380][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10814.586382][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10814.586385][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10814.586390][ C2] ? rcu_read_lock_held+0xe/0x50 [10814.586394][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10814.586397][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10814.586407][ C2] ip_rcv+0x564/0x740 [10814.586410][ C2] ? __pfx_ip_rcv+0x10/0x10 [10814.586412][ C2] ? set_track_prepare+0x8a/0xd0 [10814.586416][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10814.586419][ C2] ? start_secondary+0x21c/0x2b0 [10814.586422][ C2] ? skb_clone+0x10b/0x330 [10814.586425][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10814.586431][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10814.586437][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10814.586441][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10814.586449][ C2] ? __tcf_classify+0x329/0x7d0 [10814.586453][ C2] ? __pfx_ip_rcv+0x10/0x10 [10814.586455][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10814.586459][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10814.586462][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10814.586466][ C2] ? lock_acquire+0x1c1/0x220 [10814.586469][ C2] ? netif_receive_skb_internal+0x84/0x300 [10814.586473][ C2] netif_receive_skb_internal+0xb0/0x300 [10814.586477][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10814.586481][ C2] ? __copy_skb_header+0xaf/0x490 [10814.586485][ C2] ? __skb_clone+0x57a/0x760 [10814.586488][ C2] netif_receive_skb+0x55/0x280 [10814.586491][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10814.586499][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10814.586505][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10814.586512][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10814.586517][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10814.586527][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10814.586534][ C2] ? get_stack_info+0x36/0xc0 [10814.586539][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10814.586542][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10814.586545][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10814.586548][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10814.586551][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10814.586554][ C2] ? kernel_text_address+0x17/0xe0 [10814.586557][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10814.586561][ C2] ? arch_stack_walk+0x8c/0x100 [10814.586565][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10814.586568][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10814.586572][ C2] ? lock_acquire+0x1c1/0x220 [10814.586574][ C2] ? stack_depot_save_flags+0x281/0x550 [10814.586579][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10814.586583][ C2] ? get_stack_info_noinstr+0x18/0x110 [10814.586586][ C2] ? get_stack_info+0x36/0xc0 [10814.586590][ C2] __tcf_classify+0x329/0x7d0 [10814.586595][ C2] tcf_classify+0x283/0x930 [10814.586600][ C2] ? __pfx_tcf_classify+0x10/0x10 [10814.586603][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10814.586607][ C2] tc_run+0x2e4/0x5d0 [10814.586610][ C2] ? __pfx_tc_run+0x10/0x10 [10814.586613][ C2] ? lock_acquire+0x1c1/0x220 [10814.586616][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10814.586620][ C2] __dev_queue_xmit+0x686/0x17e0 [10814.586624][ C2] ? lock_acquire+0x1c1/0x220 [10814.586626][ C2] ? ip_finish_output2+0x786/0x18e0 [10814.586630][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10814.586633][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10814.586636][ C2] ? neigh_hh_output+0x348/0x590 [10814.586640][ C2] ? ip_finish_output2+0x262/0x18e0 [10814.586643][ C2] ip_finish_output2+0x786/0x18e0 [10814.586648][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10814.586656][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10814.586658][ C2] ? rcu_read_lock_held+0xe/0x50 [10814.586663][ C2] ? __ip_finish_output+0x10f/0x770 [10814.586667][ C2] ip_output+0x16b/0x4f0 [10814.586670][ C2] ? __pfx_ip_output+0x10/0x10 [10814.586672][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10814.586675][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10814.586678][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10814.586681][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10814.586684][ C2] ? __alloc_skb+0xd4/0x280 [10814.586686][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10814.586690][ C2] ? tcp_fragment+0x168/0x1040 [10814.586693][ C2] ? rcu_read_lock_held+0xe/0x50 [10814.586696][ C2] ? ip_local_out+0x114/0x3b0 [10814.586700][ C2] __ip_queue_xmit+0x672/0x1910 [10814.586703][ C2] ? __skb_clone+0x57a/0x760 [10814.586706][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10814.586711][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10814.586714][ C2] ? ipv4_dst_check+0xe3/0x170 [10814.586718][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10814.586722][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10814.586727][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10814.586730][ C2] ? tcp_fragment+0xb0e/0x1040 [10814.586733][ C2] tcp_send_loss_probe+0x348/0x830 [10814.586736][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10814.586739][ C2] tcp_write_timer+0x82/0x1d0 [10814.586742][ C2] call_timer_fn+0x173/0x430 [10814.586746][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10814.586750][ C2] ? next_expiry_recalc+0xcd/0x220 [10814.586754][ C2] __run_timers.part.0+0x52d/0x890 [10814.586757][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10814.586761][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10814.586764][ C2] ? lock_acquire+0x1c1/0x220 [10814.586766][ C2] ? clockevents_program_event+0xf6/0x300 [10814.586770][ C2] ? lock_release+0x1d5/0x250 [10814.586772][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10814.586775][ C2] ? ktime_get+0xb3/0x190 [10814.586778][ C2] ? clockevents_program_event+0x1ea/0x300 [10814.586783][ C2] run_timer_softirq+0x72/0x100 [10814.586786][ C2] __do_softirq+0x1b9/0x7ff [10814.586790][ C2] irq_exit_rcu+0x98/0xc0 [10814.586793][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10814.586796][ C2] [10814.586797][ C2] [10814.586798][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10814.586802][ C2] RIP: 0010:default_idle+0xf/0x20 [10814.586805][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10814.586808][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10814.586810][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10814.586812][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10814.586814][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10814.586815][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10814.586817][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10814.586820][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10814.586823][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10814.586826][ C2] default_idle_call+0x69/0xa0 [10814.586829][ C2] cpuidle_idle_call+0x1f6/0x280 [10814.586832][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10814.586836][ C2] ? lock_release+0x1d5/0x250 [10814.586838][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10814.586842][ C2] do_idle+0xfb/0x160 [10814.586845][ C2] cpu_startup_entry+0x55/0x60 [10814.586847][ C2] start_secondary+0x21c/0x2b0 [10814.586850][ C2] ? __pfx_start_secondary+0x10/0x10 [10814.586854][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10814.586860][ C2] [10840.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7905s! [perl:4135] [10840.569698][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10840.570988][ C1] irq event stamp: 209232 [10840.571209][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10840.571738][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10840.572214][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10840.572686][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10840.573149][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10840.573598][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10840.574209][ C1] RIP: 0010:kasan_check_range+0x158/0x1c0 [10840.574502][ C1] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [10840.575474][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000246 [10840.575783][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [10840.576185][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10840.576583][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [10840.576983][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10840.577384][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10840.577783][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10840.578232][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10840.578578][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10840.578979][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10840.579381][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10840.579781][ C1] PKRU: 55555554 [10840.579964][ C1] Call Trace: [10840.580137][ C1] [10840.580286][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10840.580548][ C1] ? __run_hrtimer+0x1c0/0x710 [10840.580793][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10840.581070][ C1] ? __hrtimer_run_queues+0x197/0x270 [10840.581343][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10840.581634][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10840.581900][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10840.582209][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10840.582469][ C1] ? hrtimer_interrupt+0x31a/0x770 [10840.582731][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10840.583042][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10840.583339][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10840.583655][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10840.583946][ C1] ? kasan_check_range+0x158/0x1c0 [10840.584210][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [10840.584492][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10840.584806][ C1] ? get_stack_info+0x36/0xc0 [10840.585048][ C1] ? lock_acquire+0x1c1/0x220 [10840.585291][ C1] ? lock_release+0x1d5/0x250 [10840.585531][ C1] do_raw_spin_lock+0x1ec/0x270 [10840.585781][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10840.586053][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10840.586342][ C1] ? lock_acquire+0x1c1/0x220 [10840.586581][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10840.586820][ C1] _raw_spin_lock_nested+0x65/0x80 [10840.587084][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10840.587322][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10840.587571][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10840.587830][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10840.588109][ C1] ip_local_deliver_finish+0x2ae/0x480 [10840.588388][ C1] ip_local_deliver+0x19d/0x480 [10840.588660][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10840.588934][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10840.589200][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10840.589549][ C1] ? rcu_read_lock_held+0xe/0x50 [10840.589802][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10840.590124][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10840.590387][ C1] ip_rcv+0x564/0x740 [10840.590592][ C1] ? __pfx_ip_rcv+0x10/0x10 [10840.590823][ C1] ? set_track_prepare+0x8a/0xd0 [10840.591077][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10840.591356][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10840.591628][ C1] ? skb_clone+0x10b/0x330 [10840.591858][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10840.592179][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10840.592487][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10840.592770][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10840.593067][ C1] ? __tcf_classify+0x329/0x7d0 [10840.593316][ C1] ? __pfx_ip_rcv+0x10/0x10 [10840.593548][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10840.593850][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10840.594137][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10840.594463][ C1] ? lock_acquire+0x1c1/0x220 [10840.594704][ C1] ? netif_receive_skb_internal+0x84/0x300 [10840.595001][ C1] netif_receive_skb_internal+0xb0/0x300 [10840.595288][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10840.595607][ C1] ? __copy_skb_header+0xaf/0x490 [10840.595866][ C1] ? __skb_clone+0x57a/0x760 [10840.596102][ C1] netif_receive_skb+0x55/0x280 [10840.596350][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10840.596662][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10840.596995][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10840.597296][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10840.597571][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10840.597862][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10840.598175][ C1] ? hlock_class+0x4e/0x130 [10840.598409][ C1] ? get_stack_info_noinstr+0x18/0x110 [10840.598694][ C1] ? get_stack_info_noinstr+0x18/0x110 [10840.598973][ C1] ? __pfx_validate_chain+0x10/0x10 [10840.599239][ C1] ? hlock_class+0x4e/0x130 [10840.599470][ C1] ? mark_lock+0x38/0x3e0 [10840.599692][ C1] ? stack_access_ok+0xda/0x1f0 [10840.599943][ C1] ? __lock_acquire+0xb67/0x1610 [10840.600201][ C1] ? get_stack_info_noinstr+0x18/0x110 [10840.600477][ C1] ? get_stack_info+0x36/0xc0 [10840.600718][ C1] ? stack_access_ok+0xda/0x1f0 [10840.600966][ C1] ? get_reg+0x119/0x190 [10840.601184][ C1] ? unwind_next_frame+0x12af/0x1d10 [10840.601452][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10840.601762][ C1] __tcf_classify+0x329/0x7d0 [10840.602006][ C1] tcf_classify+0x283/0x930 [10840.602237][ C1] ? arch_stack_walk+0xa2/0x100 [10840.602487][ C1] ? __pfx_tcf_classify+0x10/0x10 [10840.602744][ C1] ? get_stack_info+0x36/0xc0 [10840.602986][ C1] tc_run+0x2e4/0x5d0 [10840.603193][ C1] ? __pfx_tc_run+0x10/0x10 [10840.603426][ C1] ? lock_acquire+0x1c1/0x220 [10840.603665][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10840.603927][ C1] __dev_queue_xmit+0x686/0x17e0 [10840.604183][ C1] ? lock_acquire+0x1c1/0x220 [10840.604421][ C1] ? ip_finish_output2+0x786/0x18e0 [10840.604686][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10840.604992][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10840.605266][ C1] ? neigh_hh_output+0x348/0x590 [10840.605518][ C1] ? ip_finish_output2+0x262/0x18e0 [10840.605785][ C1] ip_finish_output2+0x786/0x18e0 [10840.606041][ C1] ? stack_depot_save_flags+0x45/0x550 [10840.606321][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10840.606659][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10840.606935][ C1] ? rcu_read_lock_held+0xe/0x50 [10840.607191][ C1] ? __ip_finish_output+0x10f/0x770 [10840.607455][ C1] ip_output+0x16b/0x4f0 [10840.607674][ C1] ? run_timer_softirq+0x72/0x100 [10840.607932][ C1] ? __pfx_ip_output+0x10/0x10 [10840.608177][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10840.608463][ C1] ? rcu_read_lock_held+0xe/0x50 [10840.608728][ C1] ? ip_local_out+0x114/0x3b0 [10840.608969][ C1] __ip_queue_xmit+0x672/0x1910 [10840.609220][ C1] ? __create_object+0x5e/0xb0 [10840.609462][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10840.609731][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10840.610013][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10840.610287][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10840.610570][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10840.610844][ C1] tcp_delack_timer+0x84/0x240 [10840.611088][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10840.611361][ C1] call_timer_fn+0x173/0x430 [10840.611598][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10840.611861][ C1] ? next_expiry_recalc+0xcd/0x220 [10840.612124][ C1] __run_timers.part.0+0x52d/0x890 [10840.612389][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10840.612663][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10840.612947][ C1] ? lock_acquire+0x1c1/0x220 [10840.613188][ C1] ? clockevents_program_event+0xf6/0x300 [10840.613483][ C1] ? lock_release+0x1d5/0x250 [10840.613721][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10840.613988][ C1] ? ktime_get+0xb3/0x190 [10840.614212][ C1] ? clockevents_program_event+0x1ea/0x300 [10840.614510][ C1] run_timer_softirq+0x72/0x100 [10840.614759][ C1] __do_softirq+0x1b9/0x7ff [10840.614992][ C1] irq_exit_rcu+0x98/0xc0 [10840.615215][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10840.615502][ C1] [10840.615653][ C1] [10840.615806][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10840.616111][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10840.616438][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10840.617416][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10840.617724][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10840.618126][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10840.618523][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10840.618934][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10840.619334][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10840.619737][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10840.620033][ C1] pipe_read+0xa16/0xdf0 [10840.620258][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10840.620536][ C1] ? __pfx_pipe_read+0x10/0x10 [10840.620781][ C1] ? iterate_tty_write+0x299/0x540 [10840.621044][ C1] ? lock_release+0x1d5/0x250 [10840.621288][ C1] vfs_read+0x911/0xc00 [10840.621503][ C1] ? lock_acquire+0x1c1/0x220 [10840.621744][ C1] ? __might_fault+0xc6/0x180 [10840.621983][ C1] ? __pfx_vfs_read+0x10/0x10 [10840.622224][ C1] ? __might_fault+0xc6/0x180 [10840.622465][ C1] ? lock_release+0x1d5/0x250 [10840.622707][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10840.622972][ C1] ? __fget_light+0x54/0x1e0 [10840.623211][ C1] ksys_read+0x17a/0x1e0 [10840.623430][ C1] ? __pfx_ksys_read+0x10/0x10 [10840.623678][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10840.623983][ C1] do_syscall_64+0xc9/0x1e0 [10840.624220][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10840.624525][ C1] RIP: 0033:0x7f08a1ea38b2 [10840.624752][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10840.625729][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10840.626154][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10840.626553][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10840.626954][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10840.627355][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10840.627753][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10840.628156][ C1] [10840.628318][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7905s! [swapper/2:0] [10840.628797][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10840.630096][ C2] irq event stamp: 44114564 [10840.630330][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10840.630901][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10840.631429][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10840.631918][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10840.632407][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10840.632879][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10840.633510][ C2] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [10840.633835][ C2] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 ca 35 0c fe 89 d8 [10840.634838][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000246 [10840.635155][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10840.635568][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10840.635985][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10840.636391][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10840.636811][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10840.637233][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10840.637689][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10840.638031][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10840.638450][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10840.638885][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10840.639302][ C2] PKRU: 55555554 [10840.639486][ C2] Call Trace: [10840.639664][ C2] [10840.639824][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10840.640095][ C2] ? __run_hrtimer+0x1c0/0x710 [10840.640358][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10840.640642][ C2] ? __hrtimer_run_queues+0x197/0x270 [10840.640933][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10840.641233][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10840.641504][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10840.641826][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10840.642091][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10840.642370][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10840.642691][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10840.643005][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10840.643340][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10840.643636][ C2] ? queued_spin_lock_slowpath+0xc2/0xb90 [10840.643941][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10840.644233][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10840.644560][ C2] ? get_stack_info+0x36/0xc0 [10840.644820][ C2] ? lock_acquire+0x1c1/0x220 [10840.645067][ C2] ? lock_release+0x1d5/0x250 [10840.645321][ C2] do_raw_spin_lock+0x1ec/0x270 [10840.645574][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10840.645868][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10840.646159][ C2] ? lock_acquire+0x1c1/0x220 [10840.646415][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10840.646661][ C2] _raw_spin_lock_nested+0x65/0x80 [10840.646934][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10840.647176][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10840.647438][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10840.647716][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10840.648002][ C2] ip_local_deliver_finish+0x2ae/0x480 [10840.648290][ C2] ip_local_deliver+0x19d/0x480 [10840.648555][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10840.648836][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10840.649108][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10840.649469][ C2] ? rcu_read_lock_held+0xe/0x50 [10840.649726][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10840.650056][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10840.650327][ C2] ip_rcv+0x564/0x740 [10840.650538][ C2] ? __pfx_ip_rcv+0x10/0x10 [10840.650778][ C2] ? set_track_prepare+0x8a/0xd0 [10840.651039][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10840.651324][ C2] ? start_secondary+0x21c/0x2b0 [10840.651584][ C2] ? skb_clone+0x10b/0x330 [10840.651831][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10840.652163][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10840.652483][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10840.652784][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10840.653104][ C2] ? __tcf_classify+0x329/0x7d0 [10840.653362][ C2] ? __pfx_ip_rcv+0x10/0x10 [10840.653604][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10840.653916][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10840.654215][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10840.654557][ C2] ? lock_acquire+0x1c1/0x220 [10840.654811][ C2] ? netif_receive_skb_internal+0x84/0x300 [10840.655123][ C2] netif_receive_skb_internal+0xb0/0x300 [10840.655428][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10840.655764][ C2] ? __copy_skb_header+0xaf/0x490 [10840.656040][ C2] ? __skb_clone+0x57a/0x760 [10840.656287][ C2] netif_receive_skb+0x55/0x280 [10840.656547][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10840.656890][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10840.657232][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10840.657546][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10840.657841][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10840.658149][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10840.658480][ C2] ? get_stack_info+0x36/0xc0 [10840.658753][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10840.659026][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10840.659366][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10840.659643][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10840.659939][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10840.660272][ C2] ? kernel_text_address+0x17/0xe0 [10840.660537][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10840.660861][ C2] ? arch_stack_walk+0x8c/0x100 [10840.661118][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10840.661394][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10840.661688][ C2] ? lock_acquire+0x1c1/0x220 [10840.661940][ C2] ? stack_depot_save_flags+0x281/0x550 [10840.662226][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10840.662542][ C2] ? get_stack_info_noinstr+0x18/0x110 [10840.662827][ C2] ? get_stack_info+0x36/0xc0 [10840.663077][ C2] __tcf_classify+0x329/0x7d0 [10840.663328][ C2] tcf_classify+0x283/0x930 [10840.663568][ C2] ? __pfx_tcf_classify+0x10/0x10 [10840.663833][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10840.664157][ C2] tc_run+0x2e4/0x5d0 [10840.664370][ C2] ? __pfx_tc_run+0x10/0x10 [10840.664611][ C2] ? lock_acquire+0x1c1/0x220 [10840.664858][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10840.665128][ C2] __dev_queue_xmit+0x686/0x17e0 [10840.665390][ C2] ? lock_acquire+0x1c1/0x220 [10840.665636][ C2] ? ip_finish_output2+0x786/0x18e0 [10840.665909][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10840.666222][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10840.666506][ C2] ? neigh_hh_output+0x348/0x590 [10840.666766][ C2] ? ip_finish_output2+0x262/0x18e0 [10840.667040][ C2] ip_finish_output2+0x786/0x18e0 [10840.667306][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10840.667658][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10840.667942][ C2] ? rcu_read_lock_held+0xe/0x50 [10840.668203][ C2] ? __ip_finish_output+0x10f/0x770 [10840.668475][ C2] ip_output+0x16b/0x4f0 [10840.668705][ C2] ? __pfx_ip_output+0x10/0x10 [10840.668956][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10840.669245][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10840.669568][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10840.669854][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10840.670117][ C2] ? __alloc_skb+0xd4/0x280 [10840.670354][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10840.670634][ C2] ? tcp_fragment+0x168/0x1040 [10840.670885][ C2] ? rcu_read_lock_held+0xe/0x50 [10840.671146][ C2] ? ip_local_out+0x114/0x3b0 [10840.671393][ C2] __ip_queue_xmit+0x672/0x1910 [10840.671650][ C2] ? __skb_clone+0x57a/0x760 [10840.671893][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10840.672169][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10840.672458][ C2] ? ipv4_dst_check+0xe3/0x170 [10840.672713][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10840.672971][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10840.673284][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10840.673615][ C2] ? tcp_fragment+0xb0e/0x1040 [10840.673866][ C2] tcp_send_loss_probe+0x348/0x830 [10840.674136][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10840.674414][ C2] tcp_write_timer+0x82/0x1d0 [10840.674661][ C2] call_timer_fn+0x173/0x430 [10840.674907][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10840.675178][ C2] ? next_expiry_recalc+0xcd/0x220 [10840.675449][ C2] __run_timers.part.0+0x52d/0x890 [10840.675718][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10840.675997][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10840.676292][ C2] ? lock_acquire+0x1c1/0x220 [10840.676539][ C2] ? clockevents_program_event+0xf6/0x300 [10840.676839][ C2] ? lock_release+0x1d5/0x250 [10840.677086][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10840.677360][ C2] ? ktime_get+0xb3/0x190 [10840.677589][ C2] ? clockevents_program_event+0x1ea/0x300 [10840.677895][ C2] run_timer_softirq+0x72/0x100 [10840.678152][ C2] __do_softirq+0x1b9/0x7ff [10840.678394][ C2] irq_exit_rcu+0x98/0xc0 [10840.678629][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10840.678921][ C2] [10840.679078][ C2] [10840.679232][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10840.679547][ C2] RIP: 0010:default_idle+0xf/0x20 [10840.679813][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10840.680814][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10840.681133][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10840.681552][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10840.681953][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10840.682366][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10840.682777][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10840.683190][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10840.683490][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10840.683760][ C2] default_idle_call+0x69/0xa0 [10840.684015][ C2] cpuidle_idle_call+0x1f6/0x280 [10840.684274][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10840.684569][ C2] ? lock_release+0x1d5/0x250 [10840.684821][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10840.685109][ C2] do_idle+0xfb/0x160 [10840.685320][ C2] cpu_startup_entry+0x55/0x60 [10840.685578][ C2] start_secondary+0x21c/0x2b0 [10840.685829][ C2] ? __pfx_start_secondary+0x10/0x10 [10840.686110][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10840.686441][ C2] [10868.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7931s! [perl:4135] [10868.569698][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10868.570966][ C1] irq event stamp: 209232 [10868.571185][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10868.571715][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10868.572193][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10868.572661][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10868.573123][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10868.573574][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10868.574191][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [10868.574513][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [10868.575483][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10868.575790][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10868.576189][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10868.576586][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10868.576987][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10868.577387][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10868.577785][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10868.578232][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10868.578569][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10868.578971][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10868.579371][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10868.579768][ C1] PKRU: 55555554 [10868.579950][ C1] Call Trace: [10868.580124][ C1] [10868.580273][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10868.580534][ C1] ? __run_hrtimer+0x1c0/0x710 [10868.580778][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10868.581054][ C1] ? __hrtimer_run_queues+0x197/0x270 [10868.581328][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10868.581616][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10868.581882][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10868.582189][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10868.582450][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10868.582761][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10868.583054][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10868.583371][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10868.583662][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [10868.583949][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10868.584241][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10868.584553][ C1] ? get_stack_info+0x36/0xc0 [10868.584791][ C1] ? lock_acquire+0x1c1/0x220 [10868.585033][ C1] ? lock_release+0x1d5/0x250 [10868.585274][ C1] do_raw_spin_lock+0x1ec/0x270 [10868.585526][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10868.585797][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10868.586082][ C1] ? lock_acquire+0x1c1/0x220 [10868.586322][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10868.586563][ C1] _raw_spin_lock_nested+0x65/0x80 [10868.586823][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10868.587060][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10868.587307][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10868.587564][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10868.587846][ C1] ip_local_deliver_finish+0x2ae/0x480 [10868.588125][ C1] ip_local_deliver+0x19d/0x480 [10868.588373][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10868.588653][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10868.588917][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10868.589271][ C1] ? rcu_read_lock_held+0xe/0x50 [10868.589526][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10868.589847][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10868.590111][ C1] ip_rcv+0x564/0x740 [10868.590316][ C1] ? __pfx_ip_rcv+0x10/0x10 [10868.590547][ C1] ? set_track_prepare+0x8a/0xd0 [10868.590799][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10868.591078][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10868.591352][ C1] ? skb_clone+0x10b/0x330 [10868.591580][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10868.591900][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10868.592207][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10868.592491][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10868.592785][ C1] ? __tcf_classify+0x329/0x7d0 [10868.593035][ C1] ? __pfx_ip_rcv+0x10/0x10 [10868.593267][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10868.593567][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10868.593854][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10868.594181][ C1] ? lock_acquire+0x1c1/0x220 [10868.594420][ C1] ? netif_receive_skb_internal+0x84/0x300 [10868.594716][ C1] netif_receive_skb_internal+0xb0/0x300 [10868.595003][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10868.595321][ C1] ? __copy_skb_header+0xaf/0x490 [10868.595579][ C1] ? __skb_clone+0x57a/0x760 [10868.595813][ C1] netif_receive_skb+0x55/0x280 [10868.596063][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10868.596378][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10868.596711][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10868.597010][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10868.597287][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10868.597574][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10868.597887][ C1] ? hlock_class+0x4e/0x130 [10868.598122][ C1] ? get_stack_info_noinstr+0x18/0x110 [10868.598404][ C1] ? get_stack_info_noinstr+0x18/0x110 [10868.598680][ C1] ? __pfx_validate_chain+0x10/0x10 [10868.598946][ C1] ? hlock_class+0x4e/0x130 [10868.599179][ C1] ? mark_lock+0x38/0x3e0 [10868.599399][ C1] ? stack_access_ok+0xda/0x1f0 [10868.599647][ C1] ? __lock_acquire+0xb67/0x1610 [10868.599901][ C1] ? get_stack_info_noinstr+0x18/0x110 [10868.600180][ C1] ? get_stack_info+0x36/0xc0 [10868.600419][ C1] ? stack_access_ok+0xda/0x1f0 [10868.600667][ C1] ? get_reg+0x119/0x190 [10868.600885][ C1] ? unwind_next_frame+0x12af/0x1d10 [10868.601156][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10868.601466][ C1] __tcf_classify+0x329/0x7d0 [10868.601706][ C1] tcf_classify+0x283/0x930 [10868.601939][ C1] ? arch_stack_walk+0xa2/0x100 [10868.602189][ C1] ? __pfx_tcf_classify+0x10/0x10 [10868.602447][ C1] ? get_stack_info+0x36/0xc0 [10868.602689][ C1] tc_run+0x2e4/0x5d0 [10868.602896][ C1] ? __pfx_tc_run+0x10/0x10 [10868.603127][ C1] ? lock_acquire+0x1c1/0x220 [10868.603367][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10868.603631][ C1] __dev_queue_xmit+0x686/0x17e0 [10868.603884][ C1] ? lock_acquire+0x1c1/0x220 [10868.604127][ C1] ? ip_finish_output2+0x786/0x18e0 [10868.604393][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10868.604703][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10868.604975][ C1] ? neigh_hh_output+0x348/0x590 [10868.605229][ C1] ? ip_finish_output2+0x262/0x18e0 [10868.605494][ C1] ip_finish_output2+0x786/0x18e0 [10868.605751][ C1] ? stack_depot_save_flags+0x45/0x550 [10868.606030][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10868.606369][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10868.606645][ C1] ? rcu_read_lock_held+0xe/0x50 [10868.606899][ C1] ? __ip_finish_output+0x10f/0x770 [10868.607165][ C1] ip_output+0x16b/0x4f0 [10868.607380][ C1] ? run_timer_softirq+0x72/0x100 [10868.607638][ C1] ? __pfx_ip_output+0x10/0x10 [10868.607882][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10868.608171][ C1] ? rcu_read_lock_held+0xe/0x50 [10868.608428][ C1] ? ip_local_out+0x114/0x3b0 [10868.608667][ C1] __ip_queue_xmit+0x672/0x1910 [10868.608916][ C1] ? __create_object+0x5e/0xb0 [10868.609161][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10868.609429][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10868.609712][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10868.609985][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10868.610267][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10868.610538][ C1] tcp_delack_timer+0x84/0x240 [10868.610781][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10868.611053][ C1] call_timer_fn+0x173/0x430 [10868.611290][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10868.611551][ C1] ? next_expiry_recalc+0xcd/0x220 [10868.611812][ C1] __run_timers.part.0+0x52d/0x890 [10868.612071][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10868.612348][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10868.612632][ C1] ? lock_acquire+0x1c1/0x220 [10868.612872][ C1] ? clockevents_program_event+0xf6/0x300 [10868.613163][ C1] ? lock_release+0x1d5/0x250 [10868.613403][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10868.613667][ C1] ? ktime_get+0xb3/0x190 [10868.613889][ C1] ? clockevents_program_event+0x1ea/0x300 [10868.614186][ C1] run_timer_softirq+0x72/0x100 [10868.614435][ C1] __do_softirq+0x1b9/0x7ff [10868.614669][ C1] irq_exit_rcu+0x98/0xc0 [10868.614888][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10868.615176][ C1] [10868.615326][ C1] [10868.615476][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10868.615781][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10868.616106][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10868.617074][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10868.617385][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10868.617783][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10868.618185][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10868.618588][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10868.618987][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10868.619391][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10868.619689][ C1] pipe_read+0xa16/0xdf0 [10868.619910][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10868.620192][ C1] ? __pfx_pipe_read+0x10/0x10 [10868.620435][ C1] ? iterate_tty_write+0x299/0x540 [10868.620697][ C1] ? lock_release+0x1d5/0x250 [10868.620936][ C1] vfs_read+0x911/0xc00 [10868.621154][ C1] ? lock_acquire+0x1c1/0x220 [10868.621391][ C1] ? __might_fault+0xc6/0x180 [10868.621633][ C1] ? __pfx_vfs_read+0x10/0x10 [10868.621873][ C1] ? __might_fault+0xc6/0x180 [10868.622114][ C1] ? lock_release+0x1d5/0x250 [10868.622353][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10868.622619][ C1] ? __fget_light+0x54/0x1e0 [10868.622856][ C1] ksys_read+0x17a/0x1e0 [10868.623074][ C1] ? __pfx_ksys_read+0x10/0x10 [10868.623319][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10868.623624][ C1] do_syscall_64+0xc9/0x1e0 [10868.623858][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10868.624158][ C1] RIP: 0033:0x7f08a1ea38b2 [10868.624389][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10868.625359][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10868.625781][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10868.626181][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10868.626580][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10868.626979][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10868.627381][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10868.627782][ C1] [10868.627940][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7931s! [swapper/2:0] [10868.628378][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10868.629648][ C2] irq event stamp: 44114564 [10868.629879][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10868.630418][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10868.630931][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10868.631411][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10868.631886][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10868.632342][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10868.632958][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10868.633284][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10868.634258][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10868.634567][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10868.634967][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10868.635364][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10868.635766][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10868.636167][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10868.636574][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10868.637023][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10868.637354][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10868.637757][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10868.638157][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10868.638562][ C2] PKRU: 55555554 [10868.638744][ C2] Call Trace: [10868.638917][ C2] [10868.639066][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10868.639331][ C2] ? __run_hrtimer+0x1c0/0x710 [10868.639575][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10868.639852][ C2] ? __hrtimer_run_queues+0x197/0x270 [10868.640127][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10868.640417][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10868.640684][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10868.640993][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10868.641256][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10868.641519][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10868.641831][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10868.642127][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10868.642445][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10868.642738][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10868.643031][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10868.643324][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10868.643636][ C2] ? get_stack_info+0x36/0xc0 [10868.643877][ C2] ? lock_acquire+0x1c1/0x220 [10868.644118][ C2] ? lock_release+0x1d5/0x250 [10868.644360][ C2] do_raw_spin_lock+0x1ec/0x270 [10868.644610][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10868.644882][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10868.645173][ C2] ? lock_acquire+0x1c1/0x220 [10868.645410][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10868.645653][ C2] _raw_spin_lock_nested+0x65/0x80 [10868.645913][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10868.646150][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10868.646398][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10868.646656][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10868.646932][ C2] ip_local_deliver_finish+0x2ae/0x480 [10868.647209][ C2] ip_local_deliver+0x19d/0x480 [10868.647458][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10868.647729][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10868.647994][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10868.648350][ C2] ? rcu_read_lock_held+0xe/0x50 [10868.648611][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10868.648929][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10868.649196][ C2] ip_rcv+0x564/0x740 [10868.649400][ C2] ? __pfx_ip_rcv+0x10/0x10 [10868.649632][ C2] ? set_track_prepare+0x8a/0xd0 [10868.649885][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10868.650162][ C2] ? start_secondary+0x21c/0x2b0 [10868.650415][ C2] ? skb_clone+0x10b/0x330 [10868.650641][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10868.650961][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10868.651267][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10868.651547][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10868.651843][ C2] ? __tcf_classify+0x329/0x7d0 [10868.652092][ C2] ? __pfx_ip_rcv+0x10/0x10 [10868.652320][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10868.652620][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10868.652904][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10868.653231][ C2] ? lock_acquire+0x1c1/0x220 [10868.653467][ C2] ? netif_receive_skb_internal+0x84/0x300 [10868.653764][ C2] netif_receive_skb_internal+0xb0/0x300 [10868.654048][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10868.654364][ C2] ? __copy_skb_header+0xaf/0x490 [10868.654623][ C2] ? __skb_clone+0x57a/0x760 [10868.654859][ C2] netif_receive_skb+0x55/0x280 [10868.655108][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10868.655420][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10868.655752][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10868.656050][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10868.656326][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10868.656613][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10868.656924][ C2] ? get_stack_info+0x36/0xc0 [10868.657167][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10868.657432][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10868.657751][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10868.658025][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10868.658302][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10868.658626][ C2] ? kernel_text_address+0x17/0xe0 [10868.658896][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10868.659210][ C2] ? arch_stack_walk+0x8c/0x100 [10868.659459][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10868.659722][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10868.660007][ C2] ? lock_acquire+0x1c1/0x220 [10868.660243][ C2] ? stack_depot_save_flags+0x281/0x550 [10868.660526][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10868.660831][ C2] ? get_stack_info_noinstr+0x18/0x110 [10868.661108][ C2] ? get_stack_info+0x36/0xc0 [10868.661356][ C2] __tcf_classify+0x329/0x7d0 [10868.661596][ C2] tcf_classify+0x283/0x930 [10868.661831][ C2] ? __pfx_tcf_classify+0x10/0x10 [10868.662087][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10868.662401][ C2] tc_run+0x2e4/0x5d0 [10868.662608][ C2] ? __pfx_tc_run+0x10/0x10 [10868.662839][ C2] ? lock_acquire+0x1c1/0x220 [10868.663076][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10868.663339][ C2] __dev_queue_xmit+0x686/0x17e0 [10868.663591][ C2] ? lock_acquire+0x1c1/0x220 [10868.663830][ C2] ? ip_finish_output2+0x786/0x18e0 [10868.664094][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10868.664400][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10868.664671][ C2] ? neigh_hh_output+0x348/0x590 [10868.664925][ C2] ? ip_finish_output2+0x262/0x18e0 [10868.665189][ C2] ip_finish_output2+0x786/0x18e0 [10868.665446][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10868.665785][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10868.666061][ C2] ? rcu_read_lock_held+0xe/0x50 [10868.666315][ C2] ? __ip_finish_output+0x10f/0x770 [10868.666579][ C2] ip_output+0x16b/0x4f0 [10868.666795][ C2] ? __pfx_ip_output+0x10/0x10 [10868.667038][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10868.667314][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10868.667627][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10868.667906][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10868.668156][ C2] ? __alloc_skb+0xd4/0x280 [10868.668386][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10868.668659][ C2] ? tcp_fragment+0x168/0x1040 [10868.668904][ C2] ? rcu_read_lock_held+0xe/0x50 [10868.669155][ C2] ? ip_local_out+0x114/0x3b0 [10868.669396][ C2] __ip_queue_xmit+0x672/0x1910 [10868.669645][ C2] ? __skb_clone+0x57a/0x760 [10868.669878][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10868.670149][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10868.670430][ C2] ? ipv4_dst_check+0xe3/0x170 [10868.670675][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10868.670925][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10868.671224][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10868.671543][ C2] ? tcp_fragment+0xb0e/0x1040 [10868.671787][ C2] tcp_send_loss_probe+0x348/0x830 [10868.672046][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10868.672312][ C2] tcp_write_timer+0x82/0x1d0 [10868.672551][ C2] call_timer_fn+0x173/0x430 [10868.672789][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10868.673051][ C2] ? next_expiry_recalc+0xcd/0x220 [10868.673319][ C2] __run_timers.part.0+0x52d/0x890 [10868.673579][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10868.673847][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10868.674133][ C2] ? lock_acquire+0x1c1/0x220 [10868.674368][ C2] ? clockevents_program_event+0xf6/0x300 [10868.674661][ C2] ? lock_release+0x1d5/0x250 [10868.674900][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10868.675166][ C2] ? ktime_get+0xb3/0x190 [10868.675386][ C2] ? clockevents_program_event+0x1ea/0x300 [10868.675683][ C2] run_timer_softirq+0x72/0x100 [10868.675931][ C2] __do_softirq+0x1b9/0x7ff [10868.676162][ C2] irq_exit_rcu+0x98/0xc0 [10868.676385][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10868.676670][ C2] [10868.676822][ C2] [10868.676972][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10868.677277][ C2] RIP: 0010:default_idle+0xf/0x20 [10868.677534][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10868.678509][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10868.678816][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10868.679213][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10868.679610][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10868.680041][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10868.680441][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10868.680841][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10868.681129][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10868.681391][ C2] default_idle_call+0x69/0xa0 [10868.681637][ C2] cpuidle_idle_call+0x1f6/0x280 [10868.681888][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10868.682168][ C2] ? lock_release+0x1d5/0x250 [10868.682408][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10868.682682][ C2] do_idle+0xfb/0x160 [10868.682888][ C2] cpu_startup_entry+0x55/0x60 [10868.683131][ C2] start_secondary+0x21c/0x2b0 [10868.683376][ C2] ? __pfx_start_secondary+0x10/0x10 [10868.683646][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10868.683958][ C2] [10892.586105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10892.586475][ C1] rcu: 1-....: (8226959 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=1987306 [10892.587035][ C1] rcu: (t=8537699 jiffies g=1882453 q=727 ncpus=4) [10892.587370][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10892.587818][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10892.588440][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10892.588770][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10892.589740][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10892.590053][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10892.590454][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10892.590853][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10892.591253][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10892.591653][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10892.592053][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10892.592501][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10892.592833][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10892.593234][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10892.593635][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10892.594034][ C1] PKRU: 55555554 [10892.594217][ C1] Call Trace: [10892.594389][ C1] [10892.594543][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10892.594818][ C1] ? print_cpu_stall+0x263/0x6a0 [10892.595070][ C1] ? check_cpu_stall+0x284/0x500 [10892.595322][ C1] ? rcu_pending+0x92/0x360 [10892.595555][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10892.595825][ C1] ? update_process_times+0xb9/0x110 [10892.596096][ C1] ? tick_sched_handle+0x67/0x130 [10892.596353][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10892.596639][ C1] ? __run_hrtimer+0x1c0/0x710 [10892.596880][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10892.597194][ C1] ? __hrtimer_run_queues+0x197/0x270 [10892.597466][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10892.597756][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10892.598022][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10892.598337][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10892.598600][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10892.598909][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10892.599205][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10892.599519][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10892.599809][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10892.600104][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10892.600395][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10892.600706][ C1] ? get_stack_info+0x36/0xc0 [10892.600945][ C1] ? lock_acquire+0x1c1/0x220 [10892.601187][ C1] ? lock_release+0x1d5/0x250 [10892.601428][ C1] do_raw_spin_lock+0x1ec/0x270 [10892.601678][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10892.601950][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10892.602236][ C1] ? lock_acquire+0x1c1/0x220 [10892.602474][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10892.602715][ C1] _raw_spin_lock_nested+0x65/0x80 [10892.602976][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10892.603212][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10892.603458][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10892.603716][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10892.603992][ C1] ip_local_deliver_finish+0x2ae/0x480 [10892.604269][ C1] ip_local_deliver+0x19d/0x480 [10892.604516][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10892.604790][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10892.605053][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10892.605402][ C1] ? rcu_read_lock_held+0xe/0x50 [10892.605654][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10892.605974][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10892.606237][ C1] ip_rcv+0x564/0x740 [10892.606441][ C1] ? __pfx_ip_rcv+0x10/0x10 [10892.606670][ C1] ? set_track_prepare+0x8a/0xd0 [10892.606923][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10892.607202][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10892.607475][ C1] ? skb_clone+0x10b/0x330 [10892.607704][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10892.608022][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10892.608335][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10892.608618][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10892.608912][ C1] ? __tcf_classify+0x329/0x7d0 [10892.609162][ C1] ? __pfx_ip_rcv+0x10/0x10 [10892.609392][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10892.609690][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10892.609976][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10892.610301][ C1] ? lock_acquire+0x1c1/0x220 [10892.610538][ C1] ? netif_receive_skb_internal+0x84/0x300 [10892.610834][ C1] netif_receive_skb_internal+0xb0/0x300 [10892.611119][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10892.611434][ C1] ? __copy_skb_header+0xaf/0x490 [10892.611692][ C1] ? __skb_clone+0x57a/0x760 [10892.611925][ C1] netif_receive_skb+0x55/0x280 [10892.612174][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10892.612488][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10892.612819][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10892.613118][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10892.613392][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10892.613679][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10892.613992][ C1] ? hlock_class+0x4e/0x130 [10892.614227][ C1] ? get_stack_info_noinstr+0x18/0x110 [10892.614502][ C1] ? get_stack_info_noinstr+0x18/0x110 [10892.614776][ C1] ? __pfx_validate_chain+0x10/0x10 [10892.615040][ C1] ? hlock_class+0x4e/0x130 [10892.615271][ C1] ? mark_lock+0x38/0x3e0 [10892.615493][ C1] ? stack_access_ok+0xda/0x1f0 [10892.615740][ C1] ? __lock_acquire+0xb67/0x1610 [10892.615994][ C1] ? get_stack_info_noinstr+0x18/0x110 [10892.616272][ C1] ? get_stack_info+0x36/0xc0 [10892.616510][ C1] ? stack_access_ok+0xda/0x1f0 [10892.616757][ C1] ? get_reg+0x119/0x190 [10892.616975][ C1] ? unwind_next_frame+0x12af/0x1d10 [10892.617243][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10892.617553][ C1] __tcf_classify+0x329/0x7d0 [10892.617791][ C1] tcf_classify+0x283/0x930 [10892.618025][ C1] ? arch_stack_walk+0xa2/0x100 [10892.618281][ C1] ? __pfx_tcf_classify+0x10/0x10 [10892.618539][ C1] ? get_stack_info+0x36/0xc0 [10892.618780][ C1] tc_run+0x2e4/0x5d0 [10892.618987][ C1] ? __pfx_tc_run+0x10/0x10 [10892.619217][ C1] ? lock_acquire+0x1c1/0x220 [10892.619456][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10892.619716][ C1] __dev_queue_xmit+0x686/0x17e0 [10892.619968][ C1] ? lock_acquire+0x1c1/0x220 [10892.620207][ C1] ? ip_finish_output2+0x786/0x18e0 [10892.620471][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10892.620775][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10892.621047][ C1] ? neigh_hh_output+0x348/0x590 [10892.621299][ C1] ? ip_finish_output2+0x262/0x18e0 [10892.621563][ C1] ip_finish_output2+0x786/0x18e0 [10892.621818][ C1] ? stack_depot_save_flags+0x45/0x550 [10892.622097][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10892.622436][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10892.622711][ C1] ? rcu_read_lock_held+0xe/0x50 [10892.622964][ C1] ? __ip_finish_output+0x10f/0x770 [10892.623229][ C1] ip_output+0x16b/0x4f0 [10892.623444][ C1] ? run_timer_softirq+0x72/0x100 [10892.623701][ C1] ? __pfx_ip_output+0x10/0x10 [10892.623945][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10892.624235][ C1] ? rcu_read_lock_held+0xe/0x50 [10892.624487][ C1] ? ip_local_out+0x114/0x3b0 [10892.624726][ C1] __ip_queue_xmit+0x672/0x1910 [10892.624974][ C1] ? __create_object+0x5e/0xb0 [10892.625218][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10892.625485][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10892.625766][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10892.626038][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10892.626320][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10892.626591][ C1] tcp_delack_timer+0x84/0x240 [10892.626835][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10892.627107][ C1] call_timer_fn+0x173/0x430 [10892.627345][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10892.627605][ C1] ? next_expiry_recalc+0xcd/0x220 [10892.627865][ C1] __run_timers.part.0+0x52d/0x890 [10892.628126][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10892.628407][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10892.628691][ C1] ? lock_acquire+0x1c1/0x220 [10892.628931][ C1] ? clockevents_program_event+0xf6/0x300 [10892.629221][ C1] ? lock_release+0x1d5/0x250 [10892.629460][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10892.629723][ C1] ? ktime_get+0xb3/0x190 [10892.629945][ C1] ? clockevents_program_event+0x1ea/0x300 [10892.630241][ C1] run_timer_softirq+0x72/0x100 [10892.630489][ C1] __do_softirq+0x1b9/0x7ff [10892.630722][ C1] irq_exit_rcu+0x98/0xc0 [10892.630941][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10892.631231][ C1] [10892.631381][ C1] [10892.631531][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10892.631837][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10892.632162][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10892.633132][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10892.633440][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10892.633841][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10892.634243][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10892.634642][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10892.635039][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10892.635439][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10892.635737][ C1] pipe_read+0xa16/0xdf0 [10892.635956][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10892.636236][ C1] ? __pfx_pipe_read+0x10/0x10 [10892.636479][ C1] ? iterate_tty_write+0x299/0x540 [10892.636741][ C1] ? lock_release+0x1d5/0x250 [10892.636981][ C1] vfs_read+0x911/0xc00 [10892.637197][ C1] ? lock_acquire+0x1c1/0x220 [10892.637434][ C1] ? __might_fault+0xc6/0x180 [10892.637675][ C1] ? __pfx_vfs_read+0x10/0x10 [10892.637921][ C1] ? __might_fault+0xc6/0x180 [10892.638161][ C1] ? lock_release+0x1d5/0x250 [10892.638408][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10892.638673][ C1] ? __fget_light+0x54/0x1e0 [10892.638909][ C1] ksys_read+0x17a/0x1e0 [10892.639127][ C1] ? __pfx_ksys_read+0x10/0x10 [10892.639371][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10892.639675][ C1] do_syscall_64+0xc9/0x1e0 [10892.639909][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10892.640206][ C1] RIP: 0033:0x7f08a1ea38b2 [10892.640436][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10892.641407][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10892.641828][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10892.642227][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10892.642624][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10892.643020][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10892.643421][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10892.643822][ C1] [10892.643978][ C1] Sending NMI from CPU 1 to CPUs 2: [10892.644262][ C2] NMI backtrace for cpu 2 [10892.644270][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10892.644276][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10892.644281][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10892.644287][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10892.644290][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10892.644293][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10892.644295][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10892.644297][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10892.644299][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10892.644301][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10892.644302][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10892.644304][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10892.644308][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10892.644310][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10892.644311][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10892.644312][ C2] PKRU: 55555554 [10892.644313][ C2] Call Trace: [10892.644316][ C2] [10892.644319][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10892.644328][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10892.644334][ C2] ? nmi_handle+0x153/0x420 [10892.644339][ C2] ? default_do_nmi+0x41/0x100 [10892.644342][ C2] ? exc_nmi+0xf3/0x120 [10892.644344][ C2] ? end_repeat_nmi+0xf/0x60 [10892.644349][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10892.644353][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10892.644356][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10892.644359][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10892.644362][ C2] [10892.644363][ C2] [10892.644364][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10892.644367][ C2] ? get_stack_info+0x36/0xc0 [10892.644371][ C2] ? lock_acquire+0x1c1/0x220 [10892.644374][ C2] ? lock_release+0x1d5/0x250 [10892.644378][ C2] do_raw_spin_lock+0x1ec/0x270 [10892.644382][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10892.644385][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10892.644388][ C2] ? lock_acquire+0x1c1/0x220 [10892.644390][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10892.644394][ C2] _raw_spin_lock_nested+0x65/0x80 [10892.644397][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10892.644404][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10892.644406][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10892.644411][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10892.644416][ C2] ip_local_deliver_finish+0x2ae/0x480 [10892.644420][ C2] ip_local_deliver+0x19d/0x480 [10892.644422][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10892.644424][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10892.644427][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10892.644432][ C2] ? rcu_read_lock_held+0xe/0x50 [10892.644436][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10892.644439][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10892.644448][ C2] ip_rcv+0x564/0x740 [10892.644451][ C2] ? __pfx_ip_rcv+0x10/0x10 [10892.644453][ C2] ? set_track_prepare+0x8a/0xd0 [10892.644457][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10892.644460][ C2] ? start_secondary+0x21c/0x2b0 [10892.644464][ C2] ? skb_clone+0x10b/0x330 [10892.644467][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10892.644473][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10892.644478][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10892.644482][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10892.644490][ C2] ? __tcf_classify+0x329/0x7d0 [10892.644494][ C2] ? __pfx_ip_rcv+0x10/0x10 [10892.644496][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10892.644499][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10892.644503][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10892.644507][ C2] ? lock_acquire+0x1c1/0x220 [10892.644509][ C2] ? netif_receive_skb_internal+0x84/0x300 [10892.644513][ C2] netif_receive_skb_internal+0xb0/0x300 [10892.644517][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10892.644521][ C2] ? __copy_skb_header+0xaf/0x490 [10892.644526][ C2] ? __skb_clone+0x57a/0x760 [10892.644528][ C2] netif_receive_skb+0x55/0x280 [10892.644531][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10892.644539][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10892.644545][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10892.644551][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10892.644556][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10892.644566][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10892.644573][ C2] ? get_stack_info+0x36/0xc0 [10892.644578][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10892.644581][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10892.644587][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10892.644589][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10892.644592][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10892.644595][ C2] ? kernel_text_address+0x17/0xe0 [10892.644599][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10892.644605][ C2] ? arch_stack_walk+0x8c/0x100 [10892.644608][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10892.644612][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10892.644615][ C2] ? lock_acquire+0x1c1/0x220 [10892.644617][ C2] ? stack_depot_save_flags+0x281/0x550 [10892.644621][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10892.644625][ C2] ? get_stack_info_noinstr+0x18/0x110 [10892.644628][ C2] ? get_stack_info+0x36/0xc0 [10892.644632][ C2] __tcf_classify+0x329/0x7d0 [10892.644638][ C2] tcf_classify+0x283/0x930 [10892.644642][ C2] ? __pfx_tcf_classify+0x10/0x10 [10892.644645][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10892.644649][ C2] tc_run+0x2e4/0x5d0 [10892.644653][ C2] ? __pfx_tc_run+0x10/0x10 [10892.644656][ C2] ? lock_acquire+0x1c1/0x220 [10892.644658][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10892.644663][ C2] __dev_queue_xmit+0x686/0x17e0 [10892.644667][ C2] ? lock_acquire+0x1c1/0x220 [10892.644669][ C2] ? ip_finish_output2+0x786/0x18e0 [10892.644672][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10892.644675][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10892.644678][ C2] ? neigh_hh_output+0x348/0x590 [10892.644681][ C2] ? ip_finish_output2+0x262/0x18e0 [10892.644685][ C2] ip_finish_output2+0x786/0x18e0 [10892.644688][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10892.644695][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10892.644698][ C2] ? rcu_read_lock_held+0xe/0x50 [10892.644702][ C2] ? __ip_finish_output+0x10f/0x770 [10892.644705][ C2] ip_output+0x16b/0x4f0 [10892.644708][ C2] ? __pfx_ip_output+0x10/0x10 [10892.644711][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10892.644714][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10892.644717][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10892.644721][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10892.644724][ C2] ? __alloc_skb+0xd4/0x280 [10892.644726][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10892.644732][ C2] ? tcp_fragment+0x168/0x1040 [10892.644735][ C2] ? rcu_read_lock_held+0xe/0x50 [10892.644738][ C2] ? ip_local_out+0x114/0x3b0 [10892.644742][ C2] __ip_queue_xmit+0x672/0x1910 [10892.644746][ C2] ? __skb_clone+0x57a/0x760 [10892.644749][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10892.644754][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10892.644757][ C2] ? ipv4_dst_check+0xe3/0x170 [10892.644763][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10892.644769][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10892.644773][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10892.644776][ C2] ? tcp_fragment+0xb0e/0x1040 [10892.644779][ C2] tcp_send_loss_probe+0x348/0x830 [10892.644783][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10892.644785][ C2] tcp_write_timer+0x82/0x1d0 [10892.644789][ C2] call_timer_fn+0x173/0x430 [10892.644793][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10892.644798][ C2] ? next_expiry_recalc+0xcd/0x220 [10892.644802][ C2] __run_timers.part.0+0x52d/0x890 [10892.644805][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10892.644809][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10892.644812][ C2] ? lock_acquire+0x1c1/0x220 [10892.644814][ C2] ? clockevents_program_event+0xf6/0x300 [10892.644818][ C2] ? lock_release+0x1d5/0x250 [10892.644821][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10892.644824][ C2] ? ktime_get+0xb3/0x190 [10892.644827][ C2] ? clockevents_program_event+0x1ea/0x300 [10892.644832][ C2] run_timer_softirq+0x72/0x100 [10892.644835][ C2] __do_softirq+0x1b9/0x7ff [10892.644840][ C2] irq_exit_rcu+0x98/0xc0 [10892.644842][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10892.644845][ C2] [10892.644846][ C2] [10892.644847][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10892.644851][ C2] RIP: 0010:default_idle+0xf/0x20 [10892.644854][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10892.644856][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10892.644859][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10892.644860][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10892.644862][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10892.644863][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10892.644865][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10892.644868][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10892.644872][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10892.644877][ C2] default_idle_call+0x69/0xa0 [10892.644880][ C2] cpuidle_idle_call+0x1f6/0x280 [10892.644883][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10892.644888][ C2] ? lock_release+0x1d5/0x250 [10892.644890][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10892.644895][ C2] do_idle+0xfb/0x160 [10892.644897][ C2] cpu_startup_entry+0x55/0x60 [10892.644900][ C2] start_secondary+0x21c/0x2b0 [10892.644903][ C2] ? __pfx_start_secondary+0x10/0x10 [10892.644907][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10892.644913][ C2] [10920.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 7979s! [perl:4135] [10920.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10920.570964][ C1] irq event stamp: 209232 [10920.571184][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10920.571717][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10920.572197][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10920.572666][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10920.573133][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10920.573582][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10920.574202][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10920.574528][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10920.575505][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10920.575816][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10920.576217][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10920.576620][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10920.577023][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10920.577425][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10920.577825][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10920.578287][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10920.578623][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10920.579026][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10920.579428][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10920.579828][ C1] PKRU: 55555554 [10920.580012][ C1] Call Trace: [10920.580186][ C1] [10920.580334][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10920.580597][ C1] ? __run_hrtimer+0x1c0/0x710 [10920.580843][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10920.581122][ C1] ? __hrtimer_run_queues+0x197/0x270 [10920.581397][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10920.581686][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10920.581951][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10920.582260][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10920.582523][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10920.582833][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10920.583132][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10920.583447][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10920.583738][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10920.584035][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10920.584326][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10920.584639][ C1] ? get_stack_info+0x36/0xc0 [10920.584882][ C1] ? lock_acquire+0x1c1/0x220 [10920.585125][ C1] ? lock_release+0x1d5/0x250 [10920.585365][ C1] do_raw_spin_lock+0x1ec/0x270 [10920.585616][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10920.585888][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10920.586177][ C1] ? lock_acquire+0x1c1/0x220 [10920.586420][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10920.586662][ C1] _raw_spin_lock_nested+0x65/0x80 [10920.586923][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10920.587160][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10920.587410][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10920.587669][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10920.587949][ C1] ip_local_deliver_finish+0x2ae/0x480 [10920.588234][ C1] ip_local_deliver+0x19d/0x480 [10920.588483][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10920.588756][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10920.589054][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10920.589403][ C1] ? rcu_read_lock_held+0xe/0x50 [10920.589656][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10920.589976][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10920.590240][ C1] ip_rcv+0x564/0x740 [10920.590444][ C1] ? __pfx_ip_rcv+0x10/0x10 [10920.590676][ C1] ? set_track_prepare+0x8a/0xd0 [10920.590933][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10920.591209][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10920.591482][ C1] ? skb_clone+0x10b/0x330 [10920.591711][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10920.592031][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10920.592339][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10920.592620][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10920.592914][ C1] ? __tcf_classify+0x329/0x7d0 [10920.593165][ C1] ? __pfx_ip_rcv+0x10/0x10 [10920.593400][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10920.593700][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10920.593984][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10920.594311][ C1] ? lock_acquire+0x1c1/0x220 [10920.594550][ C1] ? netif_receive_skb_internal+0x84/0x300 [10920.594847][ C1] netif_receive_skb_internal+0xb0/0x300 [10920.595133][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10920.595452][ C1] ? __copy_skb_header+0xaf/0x490 [10920.595709][ C1] ? __skb_clone+0x57a/0x760 [10920.595944][ C1] netif_receive_skb+0x55/0x280 [10920.596193][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10920.596506][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10920.596838][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10920.597139][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10920.597413][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10920.597703][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10920.598015][ C1] ? hlock_class+0x4e/0x130 [10920.598260][ C1] ? get_stack_info_noinstr+0x18/0x110 [10920.598536][ C1] ? get_stack_info_noinstr+0x18/0x110 [10920.598813][ C1] ? __pfx_validate_chain+0x10/0x10 [10920.599081][ C1] ? hlock_class+0x4e/0x130 [10920.599312][ C1] ? mark_lock+0x38/0x3e0 [10920.599534][ C1] ? stack_access_ok+0xda/0x1f0 [10920.599783][ C1] ? __lock_acquire+0xb67/0x1610 [10920.600036][ C1] ? get_stack_info_noinstr+0x18/0x110 [10920.600315][ C1] ? get_stack_info+0x36/0xc0 [10920.600557][ C1] ? stack_access_ok+0xda/0x1f0 [10920.600802][ C1] ? get_reg+0x119/0x190 [10920.601019][ C1] ? unwind_next_frame+0x12af/0x1d10 [10920.601288][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10920.601598][ C1] __tcf_classify+0x329/0x7d0 [10920.601841][ C1] tcf_classify+0x283/0x930 [10920.602072][ C1] ? arch_stack_walk+0xa2/0x100 [10920.602322][ C1] ? __pfx_tcf_classify+0x10/0x10 [10920.602579][ C1] ? get_stack_info+0x36/0xc0 [10920.602820][ C1] tc_run+0x2e4/0x5d0 [10920.603024][ C1] ? __pfx_tc_run+0x10/0x10 [10920.603258][ C1] ? lock_acquire+0x1c1/0x220 [10920.603496][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10920.603757][ C1] __dev_queue_xmit+0x686/0x17e0 [10920.604010][ C1] ? lock_acquire+0x1c1/0x220 [10920.604250][ C1] ? ip_finish_output2+0x786/0x18e0 [10920.604514][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10920.604820][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10920.605093][ C1] ? neigh_hh_output+0x348/0x590 [10920.605348][ C1] ? ip_finish_output2+0x262/0x18e0 [10920.605611][ C1] ip_finish_output2+0x786/0x18e0 [10920.605868][ C1] ? stack_depot_save_flags+0x45/0x550 [10920.606150][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10920.606488][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10920.606764][ C1] ? rcu_read_lock_held+0xe/0x50 [10920.607017][ C1] ? __ip_finish_output+0x10f/0x770 [10920.607282][ C1] ip_output+0x16b/0x4f0 [10920.607500][ C1] ? run_timer_softirq+0x72/0x100 [10920.607758][ C1] ? __pfx_ip_output+0x10/0x10 [10920.608001][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10920.608296][ C1] ? rcu_read_lock_held+0xe/0x50 [10920.608548][ C1] ? ip_local_out+0x114/0x3b0 [10920.608790][ C1] __ip_queue_xmit+0x672/0x1910 [10920.609040][ C1] ? __create_object+0x5e/0xb0 [10920.609285][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10920.609552][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10920.609836][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10920.610109][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10920.610391][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10920.610664][ C1] tcp_delack_timer+0x84/0x240 [10920.610907][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10920.611182][ C1] call_timer_fn+0x173/0x430 [10920.611416][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10920.611679][ C1] ? next_expiry_recalc+0xcd/0x220 [10920.611941][ C1] __run_timers.part.0+0x52d/0x890 [10920.612203][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10920.612477][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10920.612761][ C1] ? lock_acquire+0x1c1/0x220 [10920.613001][ C1] ? clockevents_program_event+0xf6/0x300 [10920.613293][ C1] ? lock_release+0x1d5/0x250 [10920.613531][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10920.613795][ C1] ? ktime_get+0xb3/0x190 [10920.614018][ C1] ? clockevents_program_event+0x1ea/0x300 [10920.614316][ C1] run_timer_softirq+0x72/0x100 [10920.614563][ C1] __do_softirq+0x1b9/0x7ff [10920.614798][ C1] irq_exit_rcu+0x98/0xc0 [10920.615019][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10920.615311][ C1] [10920.615461][ C1] [10920.615612][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10920.615915][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10920.616243][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10920.617219][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10920.617526][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10920.617928][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10920.618334][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10920.618732][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10920.619132][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10920.619536][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10920.619831][ C1] pipe_read+0xa16/0xdf0 [10920.620053][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10920.620332][ C1] ? __pfx_pipe_read+0x10/0x10 [10920.620580][ C1] ? iterate_tty_write+0x299/0x540 [10920.620842][ C1] ? lock_release+0x1d5/0x250 [10920.621082][ C1] vfs_read+0x911/0xc00 [10920.621299][ C1] ? lock_acquire+0x1c1/0x220 [10920.621538][ C1] ? __might_fault+0xc6/0x180 [10920.621777][ C1] ? __pfx_vfs_read+0x10/0x10 [10920.622017][ C1] ? __might_fault+0xc6/0x180 [10920.622258][ C1] ? lock_release+0x1d5/0x250 [10920.622498][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10920.622763][ C1] ? __fget_light+0x54/0x1e0 [10920.622998][ C1] ksys_read+0x17a/0x1e0 [10920.623220][ C1] ? __pfx_ksys_read+0x10/0x10 [10920.623464][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10920.623768][ C1] do_syscall_64+0xc9/0x1e0 [10920.624005][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10920.624307][ C1] RIP: 0033:0x7f08a1ea38b2 [10920.624534][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10920.625505][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10920.625931][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10920.626332][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10920.626730][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10920.627133][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10920.627532][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10920.627934][ C1] [10920.628094][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 7979s! [swapper/2:0] [10920.628551][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10920.629845][ C2] irq event stamp: 44114564 [10920.630088][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10920.630644][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10920.631172][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10920.631665][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10920.632151][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10920.632623][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10920.633254][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10920.633588][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10920.634589][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10920.634907][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10920.635317][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10920.635727][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10920.636139][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10920.636550][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10920.636960][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10920.637421][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10920.637763][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10920.638181][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10920.638594][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10920.639005][ C2] PKRU: 55555554 [10920.639193][ C2] Call Trace: [10920.639372][ C2] [10920.639527][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10920.639802][ C2] ? __run_hrtimer+0x1c0/0x710 [10920.640055][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10920.640342][ C2] ? __hrtimer_run_queues+0x197/0x270 [10920.640623][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10920.640924][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10920.641197][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10920.641515][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10920.641785][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10920.642057][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10920.642380][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10920.642684][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10920.643011][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10920.643310][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10920.643614][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10920.643914][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10920.644236][ C2] ? get_stack_info+0x36/0xc0 [10920.644484][ C2] ? lock_acquire+0x1c1/0x220 [10920.644734][ C2] ? lock_release+0x1d5/0x250 [10920.644982][ C2] do_raw_spin_lock+0x1ec/0x270 [10920.645241][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10920.645522][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10920.645817][ C2] ? lock_acquire+0x1c1/0x220 [10920.646064][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10920.646314][ C2] _raw_spin_lock_nested+0x65/0x80 [10920.646583][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10920.646827][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10920.647082][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10920.647349][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10920.647634][ C2] ip_local_deliver_finish+0x2ae/0x480 [10920.647921][ C2] ip_local_deliver+0x19d/0x480 [10920.648186][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10920.648466][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10920.648738][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10920.649098][ C2] ? rcu_read_lock_held+0xe/0x50 [10920.649360][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10920.649691][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10920.649963][ C2] ip_rcv+0x564/0x740 [10920.650175][ C2] ? __pfx_ip_rcv+0x10/0x10 [10920.650413][ C2] ? set_track_prepare+0x8a/0xd0 [10920.650675][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10920.650963][ C2] ? start_secondary+0x21c/0x2b0 [10920.651223][ C2] ? skb_clone+0x10b/0x330 [10920.651458][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10920.651789][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10920.652107][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10920.652397][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10920.652703][ C2] ? __tcf_classify+0x329/0x7d0 [10920.652961][ C2] ? __pfx_ip_rcv+0x10/0x10 [10920.653199][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10920.653510][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10920.653803][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10920.654141][ C2] ? lock_acquire+0x1c1/0x220 [10920.654387][ C2] ? netif_receive_skb_internal+0x84/0x300 [10920.654694][ C2] netif_receive_skb_internal+0xb0/0x300 [10920.654987][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10920.655314][ C2] ? __copy_skb_header+0xaf/0x490 [10920.655581][ C2] ? __skb_clone+0x57a/0x760 [10920.655824][ C2] netif_receive_skb+0x55/0x280 [10920.656082][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10920.656406][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10920.656750][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10920.657058][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10920.657344][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10920.657642][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10920.657965][ C2] ? get_stack_info+0x36/0xc0 [10920.658221][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10920.658494][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10920.658823][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10920.659108][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10920.659394][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10920.659720][ C2] ? kernel_text_address+0x17/0xe0 [10920.659988][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10920.660313][ C2] ? arch_stack_walk+0x8c/0x100 [10920.660570][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10920.660843][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10920.661139][ C2] ? lock_acquire+0x1c1/0x220 [10920.661384][ C2] ? stack_depot_save_flags+0x281/0x550 [10920.661677][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10920.661989][ C2] ? get_stack_info_noinstr+0x18/0x110 [10920.662277][ C2] ? get_stack_info+0x36/0xc0 [10920.662525][ C2] __tcf_classify+0x329/0x7d0 [10920.662774][ C2] tcf_classify+0x283/0x930 [10920.663016][ C2] ? __pfx_tcf_classify+0x10/0x10 [10920.663281][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10920.663604][ C2] tc_run+0x2e4/0x5d0 [10920.663817][ C2] ? __pfx_tc_run+0x10/0x10 [10920.664056][ C2] ? lock_acquire+0x1c1/0x220 [10920.664302][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10920.664571][ C2] __dev_queue_xmit+0x686/0x17e0 [10920.664833][ C2] ? lock_acquire+0x1c1/0x220 [10920.665080][ C2] ? ip_finish_output2+0x786/0x18e0 [10920.665354][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10920.665669][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10920.665949][ C2] ? neigh_hh_output+0x348/0x590 [10920.666210][ C2] ? ip_finish_output2+0x262/0x18e0 [10920.666483][ C2] ip_finish_output2+0x786/0x18e0 [10920.666748][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10920.667095][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10920.667386][ C2] ? rcu_read_lock_held+0xe/0x50 [10920.667652][ C2] ? __ip_finish_output+0x10f/0x770 [10920.667926][ C2] ip_output+0x16b/0x4f0 [10920.668154][ C2] ? __pfx_ip_output+0x10/0x10 [10920.668407][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10920.668692][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10920.669013][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10920.669300][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10920.669559][ C2] ? __alloc_skb+0xd4/0x280 [10920.669798][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10920.670078][ C2] ? tcp_fragment+0x168/0x1040 [10920.670332][ C2] ? rcu_read_lock_held+0xe/0x50 [10920.670592][ C2] ? ip_local_out+0x114/0x3b0 [10920.670841][ C2] __ip_queue_xmit+0x672/0x1910 [10920.671097][ C2] ? __skb_clone+0x57a/0x760 [10920.671339][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10920.671620][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10920.671910][ C2] ? ipv4_dst_check+0xe3/0x170 [10920.672163][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10920.672421][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10920.672733][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10920.673063][ C2] ? tcp_fragment+0xb0e/0x1040 [10920.673316][ C2] tcp_send_loss_probe+0x348/0x830 [10920.673585][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10920.673862][ C2] tcp_write_timer+0x82/0x1d0 [10920.674111][ C2] call_timer_fn+0x173/0x430 [10920.674357][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10920.674627][ C2] ? next_expiry_recalc+0xcd/0x220 [10920.674897][ C2] __run_timers.part.0+0x52d/0x890 [10920.675166][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10920.675444][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10920.675742][ C2] ? lock_acquire+0x1c1/0x220 [10920.675987][ C2] ? clockevents_program_event+0xf6/0x300 [10920.676290][ C2] ? lock_release+0x1d5/0x250 [10920.676536][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10920.676810][ C2] ? ktime_get+0xb3/0x190 [10920.677037][ C2] ? clockevents_program_event+0x1ea/0x300 [10920.677344][ C2] run_timer_softirq+0x72/0x100 [10920.677601][ C2] __do_softirq+0x1b9/0x7ff [10920.677840][ C2] irq_exit_rcu+0x98/0xc0 [10920.678068][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10920.678367][ C2] [10920.678522][ C2] [10920.678680][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10920.678993][ C2] RIP: 0010:default_idle+0xf/0x20 [10920.679258][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10920.680259][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10920.680574][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10920.680986][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10920.681397][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10920.681806][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10920.682218][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10920.682630][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10920.682926][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10920.683198][ C2] default_idle_call+0x69/0xa0 [10920.683449][ C2] cpuidle_idle_call+0x1f6/0x280 [10920.683708][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10920.683995][ C2] ? lock_release+0x1d5/0x250 [10920.684242][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10920.684523][ C2] do_idle+0xfb/0x160 [10920.684734][ C2] cpu_startup_entry+0x55/0x60 [10920.684984][ C2] start_secondary+0x21c/0x2b0 [10920.685235][ C2] ? __pfx_start_secondary+0x10/0x10 [10920.685513][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10920.685835][ C2] [10948.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8005s! [perl:4135] [10948.569696][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10948.570964][ C1] irq event stamp: 209232 [10948.571183][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10948.571713][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10948.572196][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10948.572666][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10948.573131][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10948.573582][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10948.574199][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10948.574526][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10948.575501][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10948.575812][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10948.576214][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10948.576614][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10948.577017][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10948.577419][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10948.577820][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10948.578275][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10948.578609][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10948.579014][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10948.579417][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10948.579817][ C1] PKRU: 55555554 [10948.579999][ C1] Call Trace: [10948.580174][ C1] [10948.580322][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10948.580586][ C1] ? __run_hrtimer+0x1c0/0x710 [10948.580831][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10948.581109][ C1] ? __hrtimer_run_queues+0x197/0x270 [10948.581383][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10948.581675][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10948.581941][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10948.582250][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10948.582513][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10948.582825][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10948.583122][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10948.583438][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10948.583730][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10948.584025][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10948.584318][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10948.584632][ C1] ? get_stack_info+0x36/0xc0 [10948.584873][ C1] ? lock_acquire+0x1c1/0x220 [10948.585116][ C1] ? lock_release+0x1d5/0x250 [10948.585357][ C1] do_raw_spin_lock+0x1ec/0x270 [10948.585609][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10948.585882][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10948.586172][ C1] ? lock_acquire+0x1c1/0x220 [10948.586411][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10948.586653][ C1] _raw_spin_lock_nested+0x65/0x80 [10948.586915][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10948.587153][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10948.587402][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10948.587661][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10948.587941][ C1] ip_local_deliver_finish+0x2ae/0x480 [10948.588224][ C1] ip_local_deliver+0x19d/0x480 [10948.588473][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10948.588745][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10948.589008][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10948.589360][ C1] ? rcu_read_lock_held+0xe/0x50 [10948.589615][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10948.589936][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10948.590201][ C1] ip_rcv+0x564/0x740 [10948.590407][ C1] ? __pfx_ip_rcv+0x10/0x10 [10948.590638][ C1] ? set_track_prepare+0x8a/0xd0 [10948.590892][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10948.591172][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10948.591445][ C1] ? skb_clone+0x10b/0x330 [10948.591674][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10948.591995][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10948.592303][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10948.592589][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10948.592884][ C1] ? __tcf_classify+0x329/0x7d0 [10948.593134][ C1] ? __pfx_ip_rcv+0x10/0x10 [10948.593366][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10948.593665][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10948.593954][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10948.594283][ C1] ? lock_acquire+0x1c1/0x220 [10948.594523][ C1] ? netif_receive_skb_internal+0x84/0x300 [10948.594820][ C1] netif_receive_skb_internal+0xb0/0x300 [10948.595108][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10948.595426][ C1] ? __copy_skb_header+0xaf/0x490 [10948.595685][ C1] ? __skb_clone+0x57a/0x760 [10948.595919][ C1] netif_receive_skb+0x55/0x280 [10948.596169][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10948.596483][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10948.596816][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10948.597118][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10948.597393][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10948.597682][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10948.598001][ C1] ? hlock_class+0x4e/0x130 [10948.598241][ C1] ? get_stack_info_noinstr+0x18/0x110 [10948.598519][ C1] ? get_stack_info_noinstr+0x18/0x110 [10948.598795][ C1] ? __pfx_validate_chain+0x10/0x10 [10948.599062][ C1] ? hlock_class+0x4e/0x130 [10948.599295][ C1] ? mark_lock+0x38/0x3e0 [10948.599517][ C1] ? stack_access_ok+0xda/0x1f0 [10948.599765][ C1] ? __lock_acquire+0xb67/0x1610 [10948.600020][ C1] ? get_stack_info_noinstr+0x18/0x110 [10948.600301][ C1] ? get_stack_info+0x36/0xc0 [10948.600542][ C1] ? stack_access_ok+0xda/0x1f0 [10948.600791][ C1] ? get_reg+0x119/0x190 [10948.601010][ C1] ? unwind_next_frame+0x12af/0x1d10 [10948.601280][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10948.601591][ C1] __tcf_classify+0x329/0x7d0 [10948.601833][ C1] tcf_classify+0x283/0x930 [10948.602066][ C1] ? arch_stack_walk+0xa2/0x100 [10948.602317][ C1] ? __pfx_tcf_classify+0x10/0x10 [10948.602574][ C1] ? get_stack_info+0x36/0xc0 [10948.602817][ C1] tc_run+0x2e4/0x5d0 [10948.603023][ C1] ? __pfx_tc_run+0x10/0x10 [10948.603258][ C1] ? lock_acquire+0x1c1/0x220 [10948.603497][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10948.603760][ C1] __dev_queue_xmit+0x686/0x17e0 [10948.604014][ C1] ? lock_acquire+0x1c1/0x220 [10948.604255][ C1] ? ip_finish_output2+0x786/0x18e0 [10948.604520][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10948.604826][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10948.605098][ C1] ? neigh_hh_output+0x348/0x590 [10948.605354][ C1] ? ip_finish_output2+0x262/0x18e0 [10948.605619][ C1] ip_finish_output2+0x786/0x18e0 [10948.605876][ C1] ? stack_depot_save_flags+0x45/0x550 [10948.606156][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10948.606495][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10948.606770][ C1] ? rcu_read_lock_held+0xe/0x50 [10948.607024][ C1] ? __ip_finish_output+0x10f/0x770 [10948.607291][ C1] ip_output+0x16b/0x4f0 [10948.607507][ C1] ? run_timer_softirq+0x72/0x100 [10948.607765][ C1] ? __pfx_ip_output+0x10/0x10 [10948.608015][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10948.608305][ C1] ? rcu_read_lock_held+0xe/0x50 [10948.608557][ C1] ? ip_local_out+0x114/0x3b0 [10948.608796][ C1] __ip_queue_xmit+0x672/0x1910 [10948.609046][ C1] ? __create_object+0x5e/0xb0 [10948.609292][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10948.609559][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10948.609842][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10948.610117][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10948.610397][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10948.610670][ C1] tcp_delack_timer+0x84/0x240 [10948.610914][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10948.611189][ C1] call_timer_fn+0x173/0x430 [10948.611425][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10948.611687][ C1] ? next_expiry_recalc+0xcd/0x220 [10948.611949][ C1] __run_timers.part.0+0x52d/0x890 [10948.612210][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10948.612486][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10948.612772][ C1] ? lock_acquire+0x1c1/0x220 [10948.613012][ C1] ? clockevents_program_event+0xf6/0x300 [10948.613303][ C1] ? lock_release+0x1d5/0x250 [10948.613544][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10948.613809][ C1] ? ktime_get+0xb3/0x190 [10948.614032][ C1] ? clockevents_program_event+0x1ea/0x300 [10948.614329][ C1] run_timer_softirq+0x72/0x100 [10948.614581][ C1] __do_softirq+0x1b9/0x7ff [10948.614814][ C1] irq_exit_rcu+0x98/0xc0 [10948.615034][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10948.615323][ C1] [10948.615474][ C1] [10948.615623][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10948.615930][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10948.616257][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10948.617232][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10948.617543][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10948.617942][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10948.618353][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10948.618752][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10948.619153][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10948.619554][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10948.619854][ C1] pipe_read+0xa16/0xdf0 [10948.620073][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10948.620356][ C1] ? __pfx_pipe_read+0x10/0x10 [10948.620599][ C1] ? iterate_tty_write+0x299/0x540 [10948.620861][ C1] ? lock_release+0x1d5/0x250 [10948.621100][ C1] vfs_read+0x911/0xc00 [10948.621318][ C1] ? lock_acquire+0x1c1/0x220 [10948.621555][ C1] ? __might_fault+0xc6/0x180 [10948.621797][ C1] ? __pfx_vfs_read+0x10/0x10 [10948.622037][ C1] ? __might_fault+0xc6/0x180 [10948.622279][ C1] ? lock_release+0x1d5/0x250 [10948.622516][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10948.622783][ C1] ? __fget_light+0x54/0x1e0 [10948.623020][ C1] ksys_read+0x17a/0x1e0 [10948.623240][ C1] ? __pfx_ksys_read+0x10/0x10 [10948.623487][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10948.623794][ C1] do_syscall_64+0xc9/0x1e0 [10948.624029][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10948.624329][ C1] RIP: 0033:0x7f08a1ea38b2 [10948.624558][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10948.625531][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10948.625954][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10948.626356][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10948.626754][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10948.627154][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10948.627555][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10948.627957][ C1] [10948.628127][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8005s! [swapper/2:0] [10948.628579][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10948.629912][ C2] irq event stamp: 44114564 [10948.630164][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10948.630728][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10948.631277][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10948.631779][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10948.632276][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10948.632756][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10948.633408][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10948.633752][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10948.634738][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10948.635050][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10948.635462][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10948.635879][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10948.636289][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10948.636698][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10948.637108][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10948.637585][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10948.637924][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10948.638345][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10948.638769][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10948.639186][ C2] PKRU: 55555554 [10948.639373][ C2] Call Trace: [10948.639555][ C2] [10948.639720][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10948.639995][ C2] ? __run_hrtimer+0x1c0/0x710 [10948.640259][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10948.640553][ C2] ? __hrtimer_run_queues+0x197/0x270 [10948.640845][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10948.641144][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10948.641426][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10948.641747][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10948.642034][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10948.642317][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10948.642638][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10948.642942][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10948.643279][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10948.643584][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10948.643893][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10948.644191][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10948.644516][ C2] ? get_stack_info+0x36/0xc0 [10948.644764][ C2] ? lock_acquire+0x1c1/0x220 [10948.645015][ C2] ? lock_release+0x1d5/0x250 [10948.645265][ C2] do_raw_spin_lock+0x1ec/0x270 [10948.645524][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10948.645811][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10948.646101][ C2] ? lock_acquire+0x1c1/0x220 [10948.646349][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10948.646600][ C2] _raw_spin_lock_nested+0x65/0x80 [10948.646874][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10948.647125][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10948.647384][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10948.647658][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10948.647940][ C2] ip_local_deliver_finish+0x2ae/0x480 [10948.648254][ C2] ip_local_deliver+0x19d/0x480 [10948.648510][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10948.648802][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10948.649081][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10948.649453][ C2] ? rcu_read_lock_held+0xe/0x50 [10948.649725][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10948.650055][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10948.650339][ C2] ip_rcv+0x564/0x740 [10948.650548][ C2] ? __pfx_ip_rcv+0x10/0x10 [10948.650786][ C2] ? set_track_prepare+0x8a/0xd0 [10948.651053][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10948.651359][ C2] ? start_secondary+0x21c/0x2b0 [10948.651624][ C2] ? skb_clone+0x10b/0x330 [10948.651870][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10948.652204][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10948.652526][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10948.652818][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10948.653127][ C2] ? __tcf_classify+0x329/0x7d0 [10948.653391][ C2] ? __pfx_ip_rcv+0x10/0x10 [10948.653629][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10948.653935][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10948.654233][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10948.654569][ C2] ? lock_acquire+0x1c1/0x220 [10948.654816][ C2] ? netif_receive_skb_internal+0x84/0x300 [10948.655129][ C2] netif_receive_skb_internal+0xb0/0x300 [10948.655420][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10948.655747][ C2] ? __copy_skb_header+0xaf/0x490 [10948.656012][ C2] ? __skb_clone+0x57a/0x760 [10948.656254][ C2] netif_receive_skb+0x55/0x280 [10948.656515][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10948.656839][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10948.657183][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10948.657491][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10948.657782][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10948.658095][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10948.658414][ C2] ? get_stack_info+0x36/0xc0 [10948.658667][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10948.658939][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10948.659287][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10948.659570][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10948.659864][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10948.660188][ C2] ? kernel_text_address+0x17/0xe0 [10948.660462][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10948.660792][ C2] ? arch_stack_walk+0x8c/0x100 [10948.661057][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10948.661335][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10948.661635][ C2] ? lock_acquire+0x1c1/0x220 [10948.661890][ C2] ? stack_depot_save_flags+0x281/0x550 [10948.662194][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10948.662519][ C2] ? get_stack_info_noinstr+0x18/0x110 [10948.662811][ C2] ? get_stack_info+0x36/0xc0 [10948.663064][ C2] __tcf_classify+0x329/0x7d0 [10948.663328][ C2] tcf_classify+0x283/0x930 [10948.663570][ C2] ? __pfx_tcf_classify+0x10/0x10 [10948.663842][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10948.664168][ C2] tc_run+0x2e4/0x5d0 [10948.664384][ C2] ? __pfx_tc_run+0x10/0x10 [10948.664629][ C2] ? lock_acquire+0x1c1/0x220 [10948.664874][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10948.665152][ C2] __dev_queue_xmit+0x686/0x17e0 [10948.665414][ C2] ? lock_acquire+0x1c1/0x220 [10948.665667][ C2] ? ip_finish_output2+0x786/0x18e0 [10948.665939][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10948.666253][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10948.666536][ C2] ? neigh_hh_output+0x348/0x590 [10948.666791][ C2] ? ip_finish_output2+0x262/0x18e0 [10948.667063][ C2] ip_finish_output2+0x786/0x18e0 [10948.667329][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10948.667698][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10948.667999][ C2] ? rcu_read_lock_held+0xe/0x50 [10948.668257][ C2] ? __ip_finish_output+0x10f/0x770 [10948.668530][ C2] ip_output+0x16b/0x4f0 [10948.668767][ C2] ? __pfx_ip_output+0x10/0x10 [10948.669022][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10948.669313][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10948.669628][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10948.669918][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10948.670185][ C2] ? __alloc_skb+0xd4/0x280 [10948.670429][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10948.670720][ C2] ? tcp_fragment+0x168/0x1040 [10948.670973][ C2] ? rcu_read_lock_held+0xe/0x50 [10948.671244][ C2] ? ip_local_out+0x114/0x3b0 [10948.671498][ C2] __ip_queue_xmit+0x672/0x1910 [10948.671756][ C2] ? __skb_clone+0x57a/0x760 [10948.672005][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10948.672277][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10948.672579][ C2] ? ipv4_dst_check+0xe3/0x170 [10948.672842][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10948.673100][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10948.673413][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10948.673760][ C2] ? tcp_fragment+0xb0e/0x1040 [10948.674022][ C2] tcp_send_loss_probe+0x348/0x830 [10948.674295][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10948.674581][ C2] tcp_write_timer+0x82/0x1d0 [10948.674828][ C2] call_timer_fn+0x173/0x430 [10948.675075][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10948.675350][ C2] ? next_expiry_recalc+0xcd/0x220 [10948.675612][ C2] __run_timers.part.0+0x52d/0x890 [10948.675890][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10948.676164][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10948.676459][ C2] ? lock_acquire+0x1c1/0x220 [10948.676711][ C2] ? clockevents_program_event+0xf6/0x300 [10948.677009][ C2] ? lock_release+0x1d5/0x250 [10948.677257][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10948.677534][ C2] ? ktime_get+0xb3/0x190 [10948.677766][ C2] ? clockevents_program_event+0x1ea/0x300 [10948.678127][ C2] run_timer_softirq+0x72/0x100 [10948.678387][ C2] __do_softirq+0x1b9/0x7ff [10948.678632][ C2] irq_exit_rcu+0x98/0xc0 [10948.678862][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10948.679172][ C2] [10948.679328][ C2] [10948.679487][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10948.679820][ C2] RIP: 0010:default_idle+0xf/0x20 [10948.680094][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10948.681122][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10948.681446][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10948.681874][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10948.682289][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10948.682711][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10948.683139][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10948.683561][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10948.683877][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10948.684151][ C2] default_idle_call+0x69/0xa0 [10948.684413][ C2] cpuidle_idle_call+0x1f6/0x280 [10948.684682][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10948.684971][ C2] ? lock_release+0x1d5/0x250 [10948.685219][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10948.685510][ C2] do_idle+0xfb/0x160 [10948.685721][ C2] cpu_startup_entry+0x55/0x60 [10948.685972][ C2] start_secondary+0x21c/0x2b0 [10948.686225][ C2] ? __pfx_start_secondary+0x10/0x10 [10948.686502][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10948.686830][ C2] [10970.645104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [10970.645475][ C1] rcu: 1-....: (8304845 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2006426 [10970.646044][ C1] rcu: (t=8615758 jiffies g=1882453 q=727 ncpus=4) [10970.646380][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10970.646831][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10970.647448][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10970.647779][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10970.648760][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10970.649067][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10970.649471][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10970.649873][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10970.650283][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10970.650685][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10970.651087][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10970.651536][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10970.651870][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10970.652273][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10970.652674][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10970.653075][ C1] PKRU: 55555554 [10970.653258][ C1] Call Trace: [10970.653429][ C1] [10970.653580][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [10970.653854][ C1] ? print_cpu_stall+0x263/0x6a0 [10970.654107][ C1] ? check_cpu_stall+0x284/0x500 [10970.654360][ C1] ? rcu_pending+0x92/0x360 [10970.654600][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [10970.654870][ C1] ? update_process_times+0xb9/0x110 [10970.655142][ C1] ? tick_sched_handle+0x67/0x130 [10970.655400][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [10970.655686][ C1] ? __run_hrtimer+0x1c0/0x710 [10970.655930][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [10970.656244][ C1] ? __hrtimer_run_queues+0x197/0x270 [10970.656517][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10970.656807][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10970.657073][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10970.657379][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10970.657642][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10970.657961][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10970.658260][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10970.658578][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10970.658868][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10970.659167][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10970.659457][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10970.659769][ C1] ? get_stack_info+0x36/0xc0 [10970.660012][ C1] ? lock_acquire+0x1c1/0x220 [10970.660256][ C1] ? lock_release+0x1d5/0x250 [10970.660497][ C1] do_raw_spin_lock+0x1ec/0x270 [10970.660747][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10970.661023][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10970.661309][ C1] ? lock_acquire+0x1c1/0x220 [10970.661549][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10970.661791][ C1] _raw_spin_lock_nested+0x65/0x80 [10970.662053][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10970.662288][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10970.662537][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10970.662797][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10970.663074][ C1] ip_local_deliver_finish+0x2ae/0x480 [10970.663355][ C1] ip_local_deliver+0x19d/0x480 [10970.663603][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10970.663880][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10970.664145][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10970.664502][ C1] ? rcu_read_lock_held+0xe/0x50 [10970.664759][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10970.665080][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10970.665345][ C1] ip_rcv+0x564/0x740 [10970.665550][ C1] ? __pfx_ip_rcv+0x10/0x10 [10970.665781][ C1] ? set_track_prepare+0x8a/0xd0 [10970.666035][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10970.666311][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10970.666587][ C1] ? skb_clone+0x10b/0x330 [10970.666814][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10970.667134][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10970.667442][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10970.667724][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10970.668030][ C1] ? __tcf_classify+0x329/0x7d0 [10970.668280][ C1] ? __pfx_ip_rcv+0x10/0x10 [10970.668510][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10970.668816][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10970.669100][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10970.669428][ C1] ? lock_acquire+0x1c1/0x220 [10970.669667][ C1] ? netif_receive_skb_internal+0x84/0x300 [10970.669967][ C1] netif_receive_skb_internal+0xb0/0x300 [10970.670254][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10970.670573][ C1] ? __copy_skb_header+0xaf/0x490 [10970.670833][ C1] ? __skb_clone+0x57a/0x760 [10970.671069][ C1] netif_receive_skb+0x55/0x280 [10970.671319][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10970.671633][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10970.671968][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10970.672266][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10970.672542][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10970.672840][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10970.673156][ C1] ? hlock_class+0x4e/0x130 [10970.673387][ C1] ? get_stack_info_noinstr+0x18/0x110 [10970.673666][ C1] ? get_stack_info_noinstr+0x18/0x110 [10970.673943][ C1] ? __pfx_validate_chain+0x10/0x10 [10970.674207][ C1] ? hlock_class+0x4e/0x130 [10970.674443][ C1] ? mark_lock+0x38/0x3e0 [10970.674663][ C1] ? stack_access_ok+0xda/0x1f0 [10970.674912][ C1] ? __lock_acquire+0xb67/0x1610 [10970.675168][ C1] ? get_stack_info_noinstr+0x18/0x110 [10970.675444][ C1] ? get_stack_info+0x36/0xc0 [10970.675686][ C1] ? stack_access_ok+0xda/0x1f0 [10970.675934][ C1] ? get_reg+0x119/0x190 [10970.676151][ C1] ? unwind_next_frame+0x12af/0x1d10 [10970.676421][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10970.676731][ C1] __tcf_classify+0x329/0x7d0 [10970.676975][ C1] tcf_classify+0x283/0x930 [10970.677209][ C1] ? arch_stack_walk+0xa2/0x100 [10970.677459][ C1] ? __pfx_tcf_classify+0x10/0x10 [10970.677716][ C1] ? get_stack_info+0x36/0xc0 [10970.677968][ C1] tc_run+0x2e4/0x5d0 [10970.678177][ C1] ? __pfx_tc_run+0x10/0x10 [10970.678408][ C1] ? lock_acquire+0x1c1/0x220 [10970.678649][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10970.678911][ C1] __dev_queue_xmit+0x686/0x17e0 [10970.679169][ C1] ? lock_acquire+0x1c1/0x220 [10970.679409][ C1] ? ip_finish_output2+0x786/0x18e0 [10970.679674][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10970.679980][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10970.680255][ C1] ? neigh_hh_output+0x348/0x590 [10970.680510][ C1] ? ip_finish_output2+0x262/0x18e0 [10970.680776][ C1] ip_finish_output2+0x786/0x18e0 [10970.681033][ C1] ? stack_depot_save_flags+0x45/0x550 [10970.681312][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10970.681651][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10970.681929][ C1] ? rcu_read_lock_held+0xe/0x50 [10970.682183][ C1] ? __ip_finish_output+0x10f/0x770 [10970.682449][ C1] ip_output+0x16b/0x4f0 [10970.682675][ C1] ? run_timer_softirq+0x72/0x100 [10970.682932][ C1] ? __pfx_ip_output+0x10/0x10 [10970.683177][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10970.683462][ C1] ? rcu_read_lock_held+0xe/0x50 [10970.683714][ C1] ? ip_local_out+0x114/0x3b0 [10970.683954][ C1] __ip_queue_xmit+0x672/0x1910 [10970.684204][ C1] ? __create_object+0x5e/0xb0 [10970.684450][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10970.684717][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10970.684997][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10970.685271][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10970.685554][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10970.685826][ C1] tcp_delack_timer+0x84/0x240 [10970.686080][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10970.686356][ C1] call_timer_fn+0x173/0x430 [10970.686596][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10970.686859][ C1] ? next_expiry_recalc+0xcd/0x220 [10970.687122][ C1] __run_timers.part.0+0x52d/0x890 [10970.687383][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10970.687656][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10970.687953][ C1] ? lock_acquire+0x1c1/0x220 [10970.688192][ C1] ? clockevents_program_event+0xf6/0x300 [10970.688485][ C1] ? lock_release+0x1d5/0x250 [10970.688725][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10970.688990][ C1] ? ktime_get+0xb3/0x190 [10970.689212][ C1] ? clockevents_program_event+0x1ea/0x300 [10970.689511][ C1] run_timer_softirq+0x72/0x100 [10970.689766][ C1] __do_softirq+0x1b9/0x7ff [10970.689997][ C1] irq_exit_rcu+0x98/0xc0 [10970.690222][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10970.690508][ C1] [10970.690661][ C1] [10970.690811][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10970.691117][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10970.691443][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10970.692416][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10970.692727][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10970.693127][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10970.693526][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10970.693926][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10970.694327][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10970.694735][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10970.695033][ C1] pipe_read+0xa16/0xdf0 [10970.695255][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10970.695533][ C1] ? __pfx_pipe_read+0x10/0x10 [10970.695778][ C1] ? iterate_tty_write+0x299/0x540 [10970.696040][ C1] ? lock_release+0x1d5/0x250 [10970.696282][ C1] vfs_read+0x911/0xc00 [10970.696496][ C1] ? lock_acquire+0x1c1/0x220 [10970.696736][ C1] ? __might_fault+0xc6/0x180 [10970.696979][ C1] ? __pfx_vfs_read+0x10/0x10 [10970.697222][ C1] ? __might_fault+0xc6/0x180 [10970.697464][ C1] ? lock_release+0x1d5/0x250 [10970.697705][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10970.697978][ C1] ? __fget_light+0x54/0x1e0 [10970.698216][ C1] ksys_read+0x17a/0x1e0 [10970.698433][ C1] ? __pfx_ksys_read+0x10/0x10 [10970.698678][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10970.698985][ C1] do_syscall_64+0xc9/0x1e0 [10970.699218][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10970.699519][ C1] RIP: 0033:0x7f08a1ea38b2 [10970.699748][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10970.700722][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10970.701143][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10970.701544][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10970.701943][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10970.702342][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10970.702740][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10970.703145][ C1] [10970.703303][ C1] Sending NMI from CPU 1 to CPUs 2: [10970.703578][ C2] NMI backtrace for cpu 2 [10970.703590][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10970.703596][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10970.703599][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10970.703610][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10970.703613][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [10970.703618][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10970.703620][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10970.703622][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [10970.703624][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10970.703626][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10970.703627][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10970.703629][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10970.703633][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10970.703634][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10970.703636][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10970.703637][ C2] PKRU: 55555554 [10970.703638][ C2] Call Trace: [10970.703643][ C2] [10970.703648][ C2] ? nmi_cpu_backtrace+0x112/0x220 [10970.703656][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [10970.703664][ C2] ? nmi_handle+0x153/0x420 [10970.703669][ C2] ? default_do_nmi+0x41/0x100 [10970.703673][ C2] ? exc_nmi+0xf3/0x120 [10970.703676][ C2] ? end_repeat_nmi+0xf/0x60 [10970.703682][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10970.703686][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10970.703689][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10970.703692][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [10970.703695][ C2] [10970.703697][ C2] [10970.703698][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10970.703701][ C2] ? get_stack_info+0x36/0xc0 [10970.703707][ C2] ? lock_acquire+0x1c1/0x220 [10970.703712][ C2] ? lock_release+0x1d5/0x250 [10970.703715][ C2] do_raw_spin_lock+0x1ec/0x270 [10970.703720][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10970.703723][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10970.703726][ C2] ? lock_acquire+0x1c1/0x220 [10970.703728][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10970.703733][ C2] _raw_spin_lock_nested+0x65/0x80 [10970.703736][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10970.703743][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10970.703746][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10970.703751][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10970.703758][ C2] ip_local_deliver_finish+0x2ae/0x480 [10970.703762][ C2] ip_local_deliver+0x19d/0x480 [10970.703765][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10970.703767][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10970.703770][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10970.703777][ C2] ? rcu_read_lock_held+0xe/0x50 [10970.703782][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10970.703785][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10970.703796][ C2] ip_rcv+0x564/0x740 [10970.703799][ C2] ? __pfx_ip_rcv+0x10/0x10 [10970.703801][ C2] ? set_track_prepare+0x8a/0xd0 [10970.703807][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10970.703810][ C2] ? start_secondary+0x21c/0x2b0 [10970.703815][ C2] ? skb_clone+0x10b/0x330 [10970.703819][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10970.703826][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10970.703831][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10970.703836][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10970.703844][ C2] ? __tcf_classify+0x329/0x7d0 [10970.703848][ C2] ? __pfx_ip_rcv+0x10/0x10 [10970.703851][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10970.703854][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10970.703858][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10970.703862][ C2] ? lock_acquire+0x1c1/0x220 [10970.703864][ C2] ? netif_receive_skb_internal+0x84/0x300 [10970.703869][ C2] netif_receive_skb_internal+0xb0/0x300 [10970.703873][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10970.703877][ C2] ? __copy_skb_header+0xaf/0x490 [10970.703883][ C2] ? __skb_clone+0x57a/0x760 [10970.703885][ C2] netif_receive_skb+0x55/0x280 [10970.703888][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10970.703897][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10970.703904][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10970.703911][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10970.703916][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10970.703926][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10970.703934][ C2] ? get_stack_info+0x36/0xc0 [10970.703938][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10970.703943][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10970.703948][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10970.703950][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10970.703954][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10970.703956][ C2] ? kernel_text_address+0x17/0xe0 [10970.703960][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10970.703966][ C2] ? arch_stack_walk+0x8c/0x100 [10970.703971][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10970.703974][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10970.703978][ C2] ? lock_acquire+0x1c1/0x220 [10970.703980][ C2] ? stack_depot_save_flags+0x281/0x550 [10970.703986][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10970.703992][ C2] ? get_stack_info_noinstr+0x18/0x110 [10970.703995][ C2] ? get_stack_info+0x36/0xc0 [10970.703999][ C2] __tcf_classify+0x329/0x7d0 [10970.704005][ C2] tcf_classify+0x283/0x930 [10970.704010][ C2] ? __pfx_tcf_classify+0x10/0x10 [10970.704013][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10970.704017][ C2] tc_run+0x2e4/0x5d0 [10970.704023][ C2] ? __pfx_tc_run+0x10/0x10 [10970.704026][ C2] ? lock_acquire+0x1c1/0x220 [10970.704028][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10970.704032][ C2] __dev_queue_xmit+0x686/0x17e0 [10970.704036][ C2] ? lock_acquire+0x1c1/0x220 [10970.704038][ C2] ? ip_finish_output2+0x786/0x18e0 [10970.704043][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10970.704046][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10970.704048][ C2] ? neigh_hh_output+0x348/0x590 [10970.704052][ C2] ? ip_finish_output2+0x262/0x18e0 [10970.704056][ C2] ip_finish_output2+0x786/0x18e0 [10970.704060][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10970.704068][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10970.704070][ C2] ? rcu_read_lock_held+0xe/0x50 [10970.704074][ C2] ? __ip_finish_output+0x10f/0x770 [10970.704078][ C2] ip_output+0x16b/0x4f0 [10970.704081][ C2] ? __pfx_ip_output+0x10/0x10 [10970.704084][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10970.704087][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10970.704091][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10970.704095][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10970.704098][ C2] ? __alloc_skb+0xd4/0x280 [10970.704100][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10970.704105][ C2] ? tcp_fragment+0x168/0x1040 [10970.704110][ C2] ? rcu_read_lock_held+0xe/0x50 [10970.704112][ C2] ? ip_local_out+0x114/0x3b0 [10970.704116][ C2] __ip_queue_xmit+0x672/0x1910 [10970.704120][ C2] ? __skb_clone+0x57a/0x760 [10970.704123][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10970.704129][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10970.704132][ C2] ? ipv4_dst_check+0xe3/0x170 [10970.704137][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10970.704143][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10970.704147][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10970.704150][ C2] ? tcp_fragment+0xb0e/0x1040 [10970.704154][ C2] tcp_send_loss_probe+0x348/0x830 [10970.704157][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10970.704160][ C2] tcp_write_timer+0x82/0x1d0 [10970.704164][ C2] call_timer_fn+0x173/0x430 [10970.704169][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10970.704174][ C2] ? next_expiry_recalc+0xcd/0x220 [10970.704178][ C2] __run_timers.part.0+0x52d/0x890 [10970.704181][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10970.704185][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10970.704188][ C2] ? lock_acquire+0x1c1/0x220 [10970.704191][ C2] ? clockevents_program_event+0xf6/0x300 [10970.704195][ C2] ? lock_release+0x1d5/0x250 [10970.704197][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10970.704201][ C2] ? ktime_get+0xb3/0x190 [10970.704205][ C2] ? clockevents_program_event+0x1ea/0x300 [10970.704209][ C2] run_timer_softirq+0x72/0x100 [10970.704212][ C2] __do_softirq+0x1b9/0x7ff [10970.704217][ C2] irq_exit_rcu+0x98/0xc0 [10970.704220][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10970.704224][ C2] [10970.704225][ C2] [10970.704226][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10970.704229][ C2] RIP: 0010:default_idle+0xf/0x20 [10970.704233][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10970.704235][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10970.704238][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10970.704239][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10970.704241][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10970.704242][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10970.704244][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10970.704247][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10970.704250][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10970.704255][ C2] default_idle_call+0x69/0xa0 [10970.704259][ C2] cpuidle_idle_call+0x1f6/0x280 [10970.704262][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10970.704266][ C2] ? lock_release+0x1d5/0x250 [10970.704269][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10970.704273][ C2] do_idle+0xfb/0x160 [10970.704276][ C2] cpu_startup_entry+0x55/0x60 [10970.704279][ C2] start_secondary+0x21c/0x2b0 [10970.704282][ C2] ? __pfx_start_secondary+0x10/0x10 [10970.704286][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10970.704292][ C2] [10996.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8050s! [perl:4135] [10996.569706][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10996.570969][ C1] irq event stamp: 209232 [10996.571191][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10996.571719][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [10996.572197][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [10996.572668][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [10996.573137][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [10996.573588][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10996.574205][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [10996.574534][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [10996.575505][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [10996.575815][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [10996.576214][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [10996.576611][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [10996.577012][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [10996.577413][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [10996.577820][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [10996.578290][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10996.578622][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [10996.579023][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10996.579422][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10996.579823][ C1] PKRU: 55555554 [10996.580005][ C1] Call Trace: [10996.580185][ C1] [10996.580335][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [10996.580599][ C1] ? __run_hrtimer+0x1c0/0x710 [10996.580842][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [10996.581122][ C1] ? __hrtimer_run_queues+0x197/0x270 [10996.581395][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [10996.581681][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10996.581948][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10996.582255][ C1] ? hrtimer_interrupt+0x2c3/0x770 [10996.582517][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10996.582826][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [10996.583123][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10996.583439][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10996.583726][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [10996.584022][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [10996.584310][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10996.584622][ C1] ? get_stack_info+0x36/0xc0 [10996.584863][ C1] ? lock_acquire+0x1c1/0x220 [10996.585104][ C1] ? lock_release+0x1d5/0x250 [10996.585344][ C1] do_raw_spin_lock+0x1ec/0x270 [10996.585593][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [10996.585865][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10996.586152][ C1] ? lock_acquire+0x1c1/0x220 [10996.586391][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [10996.586631][ C1] _raw_spin_lock_nested+0x65/0x80 [10996.586892][ C1] tcp_v4_rcv+0x221e/0x2ac0 [10996.587129][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [10996.587376][ C1] ? __pfx_raw_v4_input+0x10/0x10 [10996.587634][ C1] ip_protocol_deliver_rcu+0x93/0x360 [10996.587927][ C1] ip_local_deliver_finish+0x2ae/0x480 [10996.588205][ C1] ip_local_deliver+0x19d/0x480 [10996.588452][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [10996.588726][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [10996.588994][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10996.589347][ C1] ? rcu_read_lock_held+0xe/0x50 [10996.589601][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10996.589921][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10996.590185][ C1] ip_rcv+0x564/0x740 [10996.590389][ C1] ? __pfx_ip_rcv+0x10/0x10 [10996.590623][ C1] ? set_track_prepare+0x8a/0xd0 [10996.590877][ C1] ? __pfx_set_track_prepare+0x10/0x10 [10996.591154][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [10996.591427][ C1] ? skb_clone+0x10b/0x330 [10996.591656][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10996.591977][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10996.592285][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [10996.592568][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [10996.592867][ C1] ? __tcf_classify+0x329/0x7d0 [10996.593116][ C1] ? __pfx_ip_rcv+0x10/0x10 [10996.593348][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [10996.593649][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10996.593935][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10996.594266][ C1] ? lock_acquire+0x1c1/0x220 [10996.594506][ C1] ? netif_receive_skb_internal+0x84/0x300 [10996.594804][ C1] netif_receive_skb_internal+0xb0/0x300 [10996.595090][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10996.595409][ C1] ? __copy_skb_header+0xaf/0x490 [10996.595668][ C1] ? __skb_clone+0x57a/0x760 [10996.595904][ C1] netif_receive_skb+0x55/0x280 [10996.596153][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10996.596467][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10996.596802][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [10996.597103][ C1] tcf_action_exec.part.0+0x112/0x3d0 [10996.597378][ C1] fl_classify+0x4dc/0x650 [cls_flower] [10996.597670][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10996.597992][ C1] ? hlock_class+0x4e/0x130 [10996.598226][ C1] ? get_stack_info_noinstr+0x18/0x110 [10996.598503][ C1] ? get_stack_info_noinstr+0x18/0x110 [10996.598780][ C1] ? __pfx_validate_chain+0x10/0x10 [10996.599044][ C1] ? hlock_class+0x4e/0x130 [10996.599276][ C1] ? mark_lock+0x38/0x3e0 [10996.599497][ C1] ? stack_access_ok+0xda/0x1f0 [10996.599748][ C1] ? __lock_acquire+0xb67/0x1610 [10996.600002][ C1] ? get_stack_info_noinstr+0x18/0x110 [10996.600279][ C1] ? get_stack_info+0x36/0xc0 [10996.600521][ C1] ? stack_access_ok+0xda/0x1f0 [10996.600769][ C1] ? get_reg+0x119/0x190 [10996.600985][ C1] ? unwind_next_frame+0x12af/0x1d10 [10996.601254][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10996.601567][ C1] __tcf_classify+0x329/0x7d0 [10996.601810][ C1] tcf_classify+0x283/0x930 [10996.602041][ C1] ? arch_stack_walk+0xa2/0x100 [10996.602291][ C1] ? __pfx_tcf_classify+0x10/0x10 [10996.602548][ C1] ? get_stack_info+0x36/0xc0 [10996.602790][ C1] tc_run+0x2e4/0x5d0 [10996.602995][ C1] ? __pfx_tc_run+0x10/0x10 [10996.603228][ C1] ? lock_acquire+0x1c1/0x220 [10996.603467][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [10996.603729][ C1] __dev_queue_xmit+0x686/0x17e0 [10996.603983][ C1] ? lock_acquire+0x1c1/0x220 [10996.604220][ C1] ? ip_finish_output2+0x786/0x18e0 [10996.604491][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10996.604795][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [10996.605067][ C1] ? neigh_hh_output+0x348/0x590 [10996.605325][ C1] ? ip_finish_output2+0x262/0x18e0 [10996.605592][ C1] ip_finish_output2+0x786/0x18e0 [10996.605849][ C1] ? stack_depot_save_flags+0x45/0x550 [10996.606128][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10996.606466][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [10996.606742][ C1] ? rcu_read_lock_held+0xe/0x50 [10996.606996][ C1] ? __ip_finish_output+0x10f/0x770 [10996.607262][ C1] ip_output+0x16b/0x4f0 [10996.607480][ C1] ? run_timer_softirq+0x72/0x100 [10996.607738][ C1] ? __pfx_ip_output+0x10/0x10 [10996.607988][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10996.608274][ C1] ? rcu_read_lock_held+0xe/0x50 [10996.608525][ C1] ? ip_local_out+0x114/0x3b0 [10996.608767][ C1] __ip_queue_xmit+0x672/0x1910 [10996.609016][ C1] ? __create_object+0x5e/0xb0 [10996.609260][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [10996.609528][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [10996.609810][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [10996.610081][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [10996.610365][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10996.610649][ C1] tcp_delack_timer+0x84/0x240 [10996.610894][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10996.611168][ C1] call_timer_fn+0x173/0x430 [10996.611405][ C1] ? __pfx_call_timer_fn+0x10/0x10 [10996.611667][ C1] ? next_expiry_recalc+0xcd/0x220 [10996.611930][ C1] __run_timers.part.0+0x52d/0x890 [10996.612191][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [10996.612465][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [10996.612750][ C1] ? lock_acquire+0x1c1/0x220 [10996.612989][ C1] ? clockevents_program_event+0xf6/0x300 [10996.613283][ C1] ? lock_release+0x1d5/0x250 [10996.613521][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10996.613786][ C1] ? ktime_get+0xb3/0x190 [10996.614007][ C1] ? clockevents_program_event+0x1ea/0x300 [10996.614309][ C1] run_timer_softirq+0x72/0x100 [10996.614557][ C1] __do_softirq+0x1b9/0x7ff [10996.614790][ C1] irq_exit_rcu+0x98/0xc0 [10996.615011][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [10996.615297][ C1] [10996.615447][ C1] [10996.615600][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10996.615904][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [10996.616230][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [10996.617203][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [10996.617510][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [10996.617919][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [10996.618317][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [10996.618715][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [10996.619116][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [10996.619518][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [10996.619812][ C1] pipe_read+0xa16/0xdf0 [10996.620035][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [10996.620313][ C1] ? __pfx_pipe_read+0x10/0x10 [10996.620557][ C1] ? iterate_tty_write+0x299/0x540 [10996.620818][ C1] ? lock_release+0x1d5/0x250 [10996.621060][ C1] vfs_read+0x911/0xc00 [10996.621274][ C1] ? lock_acquire+0x1c1/0x220 [10996.621513][ C1] ? __might_fault+0xc6/0x180 [10996.621753][ C1] ? __pfx_vfs_read+0x10/0x10 [10996.621992][ C1] ? __might_fault+0xc6/0x180 [10996.622236][ C1] ? lock_release+0x1d5/0x250 [10996.622476][ C1] ? kvm_clock_get_cycles+0x18/0x30 [10996.622744][ C1] ? __fget_light+0x54/0x1e0 [10996.622982][ C1] ksys_read+0x17a/0x1e0 [10996.623199][ C1] ? __pfx_ksys_read+0x10/0x10 [10996.623445][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [10996.623749][ C1] do_syscall_64+0xc9/0x1e0 [10996.623981][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [10996.624282][ C1] RIP: 0033:0x7f08a1ea38b2 [10996.624508][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [10996.625487][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [10996.625909][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [10996.626309][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [10996.626710][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [10996.627110][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [10996.627510][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [10996.627925][ C1] [10996.628086][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8050s! [swapper/2:0] [10996.628533][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [10996.629812][ C2] irq event stamp: 44114564 [10996.630045][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [10996.630603][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [10996.631144][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [10996.631624][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [10996.632112][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [10996.632583][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [10996.633215][ C2] RIP: 0010:kasan_check_range+0x161/0x1c0 [10996.633516][ C2] Code: 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 a5 <80> 38 00 74 f2 e9 74 ff ff ff b8 01 00 00 00 c3 cc cc cc cc 48 29 [10996.634518][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000286 [10996.634837][ C2] RAX: ffffed100147436b RBX: ffffed100147436c RCX: ffffffff97c7eb80 [10996.635248][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [10996.635661][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [10996.636073][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [10996.636486][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [10996.636898][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [10996.637360][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [10996.637704][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [10996.638126][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [10996.638538][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [10996.638948][ C2] PKRU: 55555554 [10996.639138][ C2] Call Trace: [10996.639317][ C2] [10996.639472][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [10996.639743][ C2] ? __run_hrtimer+0x1c0/0x710 [10996.639994][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [10996.640280][ C2] ? __hrtimer_run_queues+0x197/0x270 [10996.640563][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [10996.640860][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10996.641141][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [10996.641452][ C2] ? hrtimer_interrupt+0x2c3/0x770 [10996.641720][ C2] ? hrtimer_interrupt+0x31a/0x770 [10996.641992][ C2] ? trace_rcu_dyntick+0x10a/0x150 [10996.642263][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [10996.642583][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [10996.642890][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10996.643215][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [10996.643514][ C2] ? kasan_check_range+0x161/0x1c0 [10996.643783][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [10996.644072][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [10996.644395][ C2] ? get_stack_info+0x36/0xc0 [10996.644645][ C2] ? lock_acquire+0x1c1/0x220 [10996.644893][ C2] ? lock_release+0x1d5/0x250 [10996.645151][ C2] do_raw_spin_lock+0x1ec/0x270 [10996.645403][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [10996.645687][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10996.645978][ C2] ? lock_acquire+0x1c1/0x220 [10996.646226][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [10996.646475][ C2] _raw_spin_lock_nested+0x65/0x80 [10996.646744][ C2] tcp_v4_rcv+0x221e/0x2ac0 [10996.646984][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [10996.647240][ C2] ? __pfx_raw_v4_input+0x10/0x10 [10996.647506][ C2] ip_protocol_deliver_rcu+0x93/0x360 [10996.647789][ C2] ip_local_deliver_finish+0x2ae/0x480 [10996.648081][ C2] ip_local_deliver+0x19d/0x480 [10996.648344][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [10996.648624][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [10996.648896][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [10996.649255][ C2] ? rcu_read_lock_held+0xe/0x50 [10996.649516][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [10996.649845][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [10996.650117][ C2] ip_rcv+0x564/0x740 [10996.650328][ C2] ? __pfx_ip_rcv+0x10/0x10 [10996.650566][ C2] ? set_track_prepare+0x8a/0xd0 [10996.650828][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10996.651112][ C2] ? start_secondary+0x21c/0x2b0 [10996.651371][ C2] ? skb_clone+0x10b/0x330 [10996.651607][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [10996.651947][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [10996.652261][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [10996.652553][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [10996.652855][ C2] ? __tcf_classify+0x329/0x7d0 [10996.653115][ C2] ? __pfx_ip_rcv+0x10/0x10 [10996.653354][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [10996.653664][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10996.653957][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [10996.654294][ C2] ? lock_acquire+0x1c1/0x220 [10996.654540][ C2] ? netif_receive_skb_internal+0x84/0x300 [10996.654851][ C2] netif_receive_skb_internal+0xb0/0x300 [10996.655147][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [10996.655474][ C2] ? __copy_skb_header+0xaf/0x490 [10996.655740][ C2] ? __skb_clone+0x57a/0x760 [10996.655983][ C2] netif_receive_skb+0x55/0x280 [10996.656239][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [10996.656564][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [10996.656906][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [10996.657216][ C2] tcf_action_exec.part.0+0x112/0x3d0 [10996.657498][ C2] fl_classify+0x4dc/0x650 [cls_flower] [10996.657808][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [10996.658126][ C2] ? get_stack_info+0x36/0xc0 [10996.658376][ C2] ? unwind_next_frame+0x1cc/0x1d10 [10996.658647][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10996.658976][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10996.659263][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [10996.659548][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [10996.659874][ C2] ? kernel_text_address+0x17/0xe0 [10996.660144][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10996.660469][ C2] ? arch_stack_walk+0x8c/0x100 [10996.660727][ C2] ? do_raw_spin_trylock+0xb9/0x190 [10996.661000][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [10996.661295][ C2] ? lock_acquire+0x1c1/0x220 [10996.661542][ C2] ? stack_depot_save_flags+0x281/0x550 [10996.661833][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10996.662150][ C2] ? get_stack_info_noinstr+0x18/0x110 [10996.662434][ C2] ? get_stack_info+0x36/0xc0 [10996.662684][ C2] __tcf_classify+0x329/0x7d0 [10996.662935][ C2] tcf_classify+0x283/0x930 [10996.663177][ C2] ? __pfx_tcf_classify+0x10/0x10 [10996.663443][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [10996.663765][ C2] tc_run+0x2e4/0x5d0 [10996.663980][ C2] ? __pfx_tc_run+0x10/0x10 [10996.664218][ C2] ? lock_acquire+0x1c1/0x220 [10996.664465][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [10996.664735][ C2] __dev_queue_xmit+0x686/0x17e0 [10996.664996][ C2] ? lock_acquire+0x1c1/0x220 [10996.665244][ C2] ? ip_finish_output2+0x786/0x18e0 [10996.665517][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [10996.665831][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [10996.666113][ C2] ? neigh_hh_output+0x348/0x590 [10996.666377][ C2] ? ip_finish_output2+0x262/0x18e0 [10996.666659][ C2] ip_finish_output2+0x786/0x18e0 [10996.666919][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [10996.667266][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [10996.667549][ C2] ? rcu_read_lock_held+0xe/0x50 [10996.667823][ C2] ? __ip_finish_output+0x10f/0x770 [10996.668096][ C2] ip_output+0x16b/0x4f0 [10996.668322][ C2] ? __pfx_ip_output+0x10/0x10 [10996.668573][ C2] ? __pfx_set_track_prepare+0x10/0x10 [10996.668857][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10996.669180][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [10996.669465][ C2] ? kmalloc_reserve+0x11c/0x1f0 [10996.669722][ C2] ? __alloc_skb+0xd4/0x280 [10996.669967][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [10996.670246][ C2] ? tcp_fragment+0x168/0x1040 [10996.670499][ C2] ? rcu_read_lock_held+0xe/0x50 [10996.670758][ C2] ? ip_local_out+0x114/0x3b0 [10996.671003][ C2] __ip_queue_xmit+0x672/0x1910 [10996.671260][ C2] ? __skb_clone+0x57a/0x760 [10996.671502][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [10996.671777][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [10996.672065][ C2] ? ipv4_dst_check+0xe3/0x170 [10996.672320][ C2] ? __sk_dst_check+0x1a1/0x2b0 [10996.672577][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [10996.672887][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [10996.673224][ C2] ? tcp_fragment+0xb0e/0x1040 [10996.673470][ C2] tcp_send_loss_probe+0x348/0x830 [10996.673739][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10996.674016][ C2] tcp_write_timer+0x82/0x1d0 [10996.674265][ C2] call_timer_fn+0x173/0x430 [10996.674509][ C2] ? __pfx_call_timer_fn+0x10/0x10 [10996.674778][ C2] ? next_expiry_recalc+0xcd/0x220 [10996.675049][ C2] __run_timers.part.0+0x52d/0x890 [10996.675318][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [10996.675597][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [10996.675889][ C2] ? lock_acquire+0x1c1/0x220 [10996.676137][ C2] ? clockevents_program_event+0xf6/0x300 [10996.676436][ C2] ? lock_release+0x1d5/0x250 [10996.676685][ C2] ? kvm_clock_get_cycles+0x18/0x30 [10996.676958][ C2] ? ktime_get+0xb3/0x190 [10996.677188][ C2] ? clockevents_program_event+0x1ea/0x300 [10996.677492][ C2] run_timer_softirq+0x72/0x100 [10996.677748][ C2] __do_softirq+0x1b9/0x7ff [10996.677998][ C2] irq_exit_rcu+0x98/0xc0 [10996.678225][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [10996.678522][ C2] [10996.678676][ C2] [10996.678831][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [10996.679145][ C2] RIP: 0010:default_idle+0xf/0x20 [10996.679411][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [10996.680410][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [10996.680729][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [10996.681138][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [10996.681551][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [10996.681960][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [10996.682371][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [10996.682783][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [10996.683083][ C2] ? cpuidle_idle_call+0x1f6/0x280 [10996.683354][ C2] default_idle_call+0x69/0xa0 [10996.683608][ C2] cpuidle_idle_call+0x1f6/0x280 [10996.683867][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [10996.684154][ C2] ? lock_release+0x1d5/0x250 [10996.684402][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [10996.684684][ C2] do_idle+0xfb/0x160 [10996.684894][ C2] cpu_startup_entry+0x55/0x60 [10996.685146][ C2] start_secondary+0x21c/0x2b0 [10996.685399][ C2] ? __pfx_start_secondary+0x10/0x10 [10996.685675][ C2] secondary_startup_64_no_verify+0x16d/0x17b [10996.685996][ C2] [11024.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8076s! [perl:4135] [11024.569703][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11024.570971][ C1] irq event stamp: 209232 [11024.571191][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11024.571726][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11024.572205][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11024.572677][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11024.573143][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11024.573593][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11024.574208][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11024.574535][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11024.575512][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11024.575820][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11024.576223][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11024.576623][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11024.577023][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11024.577425][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11024.577833][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11024.578282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11024.578616][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11024.579016][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11024.579418][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11024.579818][ C1] PKRU: 55555554 [11024.580000][ C1] Call Trace: [11024.580171][ C1] [11024.580323][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11024.580585][ C1] ? __run_hrtimer+0x1c0/0x710 [11024.580828][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11024.581108][ C1] ? __hrtimer_run_queues+0x197/0x270 [11024.581381][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11024.581671][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11024.581938][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11024.582245][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11024.582511][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11024.582820][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11024.583117][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11024.583434][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11024.583722][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11024.584018][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11024.584309][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11024.584621][ C1] ? get_stack_info+0x36/0xc0 [11024.584863][ C1] ? lock_acquire+0x1c1/0x220 [11024.585105][ C1] ? lock_release+0x1d5/0x250 [11024.585346][ C1] do_raw_spin_lock+0x1ec/0x270 [11024.585596][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11024.585870][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11024.586155][ C1] ? lock_acquire+0x1c1/0x220 [11024.586395][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11024.586637][ C1] _raw_spin_lock_nested+0x65/0x80 [11024.586898][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11024.587133][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11024.587380][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11024.587638][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11024.587924][ C1] ip_local_deliver_finish+0x2ae/0x480 [11024.588204][ C1] ip_local_deliver+0x19d/0x480 [11024.588453][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11024.588724][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11024.588988][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11024.589339][ C1] ? rcu_read_lock_held+0xe/0x50 [11024.589599][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11024.589921][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11024.590186][ C1] ip_rcv+0x564/0x740 [11024.590391][ C1] ? __pfx_ip_rcv+0x10/0x10 [11024.590622][ C1] ? set_track_prepare+0x8a/0xd0 [11024.590876][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11024.591155][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11024.591436][ C1] ? skb_clone+0x10b/0x330 [11024.591664][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11024.591984][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11024.592293][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11024.592586][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11024.592884][ C1] ? __tcf_classify+0x329/0x7d0 [11024.593135][ C1] ? __pfx_ip_rcv+0x10/0x10 [11024.593364][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11024.593666][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11024.593950][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11024.594279][ C1] ? lock_acquire+0x1c1/0x220 [11024.594519][ C1] ? netif_receive_skb_internal+0x84/0x300 [11024.594817][ C1] netif_receive_skb_internal+0xb0/0x300 [11024.595102][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11024.595425][ C1] ? __copy_skb_header+0xaf/0x490 [11024.595683][ C1] ? __skb_clone+0x57a/0x760 [11024.595918][ C1] netif_receive_skb+0x55/0x280 [11024.596170][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11024.596485][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11024.596819][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11024.597119][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11024.597396][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11024.597694][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11024.598008][ C1] ? hlock_class+0x4e/0x130 [11024.598241][ C1] ? get_stack_info_noinstr+0x18/0x110 [11024.598533][ C1] ? get_stack_info_noinstr+0x18/0x110 [11024.598809][ C1] ? __pfx_validate_chain+0x10/0x10 [11024.599073][ C1] ? hlock_class+0x4e/0x130 [11024.599307][ C1] ? mark_lock+0x38/0x3e0 [11024.599526][ C1] ? stack_access_ok+0xda/0x1f0 [11024.599775][ C1] ? __lock_acquire+0xb67/0x1610 [11024.600029][ C1] ? get_stack_info_noinstr+0x18/0x110 [11024.600306][ C1] ? get_stack_info+0x36/0xc0 [11024.600547][ C1] ? stack_access_ok+0xda/0x1f0 [11024.600795][ C1] ? get_reg+0x119/0x190 [11024.601010][ C1] ? unwind_next_frame+0x12af/0x1d10 [11024.601280][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11024.601589][ C1] __tcf_classify+0x329/0x7d0 [11024.601840][ C1] tcf_classify+0x283/0x930 [11024.602072][ C1] ? arch_stack_walk+0xa2/0x100 [11024.602322][ C1] ? __pfx_tcf_classify+0x10/0x10 [11024.602580][ C1] ? get_stack_info+0x36/0xc0 [11024.602820][ C1] tc_run+0x2e4/0x5d0 [11024.603027][ C1] ? __pfx_tc_run+0x10/0x10 [11024.603261][ C1] ? lock_acquire+0x1c1/0x220 [11024.603525][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11024.603787][ C1] __dev_queue_xmit+0x686/0x17e0 [11024.604052][ C1] ? lock_acquire+0x1c1/0x220 [11024.604293][ C1] ? ip_finish_output2+0x786/0x18e0 [11024.604563][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11024.604882][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11024.605157][ C1] ? neigh_hh_output+0x348/0x590 [11024.605429][ C1] ? ip_finish_output2+0x262/0x18e0 [11024.605694][ C1] ip_finish_output2+0x786/0x18e0 [11024.605963][ C1] ? stack_depot_save_flags+0x45/0x550 [11024.606242][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11024.606586][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11024.606880][ C1] ? rcu_read_lock_held+0xe/0x50 [11024.607135][ C1] ? __ip_finish_output+0x10f/0x770 [11024.607416][ C1] ip_output+0x16b/0x4f0 [11024.607631][ C1] ? run_timer_softirq+0x72/0x100 [11024.607910][ C1] ? __pfx_ip_output+0x10/0x10 [11024.608156][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11024.608447][ C1] ? rcu_read_lock_held+0xe/0x50 [11024.608700][ C1] ? ip_local_out+0x114/0x3b0 [11024.608956][ C1] __ip_queue_xmit+0x672/0x1910 [11024.609220][ C1] ? __create_object+0x5e/0xb0 [11024.609470][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11024.609737][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11024.610037][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11024.610316][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11024.610600][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11024.610886][ C1] tcp_delack_timer+0x84/0x240 [11024.611148][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11024.611431][ C1] call_timer_fn+0x173/0x430 [11024.611672][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11024.611944][ C1] ? next_expiry_recalc+0xcd/0x220 [11024.612211][ C1] __run_timers.part.0+0x52d/0x890 [11024.612491][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11024.612779][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11024.613072][ C1] ? lock_acquire+0x1c1/0x220 [11024.613311][ C1] ? clockevents_program_event+0xf6/0x300 [11024.613603][ C1] ? lock_release+0x1d5/0x250 [11024.613844][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11024.614118][ C1] ? ktime_get+0xb3/0x190 [11024.614338][ C1] ? clockevents_program_event+0x1ea/0x300 [11024.614636][ C1] run_timer_softirq+0x72/0x100 [11024.614885][ C1] __do_softirq+0x1b9/0x7ff [11024.615118][ C1] irq_exit_rcu+0x98/0xc0 [11024.615340][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11024.615625][ C1] [11024.615776][ C1] [11024.615926][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11024.616233][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11024.616558][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11024.617528][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11024.617848][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11024.618247][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11024.618653][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11024.619054][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11024.619457][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11024.619859][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11024.620157][ C1] pipe_read+0xa16/0xdf0 [11024.620379][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11024.620656][ C1] ? __pfx_pipe_read+0x10/0x10 [11024.620900][ C1] ? iterate_tty_write+0x299/0x540 [11024.621165][ C1] ? lock_release+0x1d5/0x250 [11024.621407][ C1] vfs_read+0x911/0xc00 [11024.621637][ C1] ? lock_acquire+0x1c1/0x220 [11024.621877][ C1] ? __might_fault+0xc6/0x180 [11024.622139][ C1] ? __pfx_vfs_read+0x10/0x10 [11024.622379][ C1] ? __might_fault+0xc6/0x180 [11024.622636][ C1] ? lock_release+0x1d5/0x250 [11024.622877][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11024.623148][ C1] ? __fget_light+0x54/0x1e0 [11024.623387][ C1] ksys_read+0x17a/0x1e0 [11024.623619][ C1] ? __pfx_ksys_read+0x10/0x10 [11024.623867][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11024.624192][ C1] do_syscall_64+0xc9/0x1e0 [11024.624423][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11024.624724][ C1] RIP: 0033:0x7f08a1ea38b2 [11024.624968][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11024.625954][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11024.626393][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11024.626794][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11024.627209][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11024.627610][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11024.628035][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11024.628467][ C1] [11024.628625][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8076s! [swapper/2:0] [11024.629076][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11024.630385][ C2] irq event stamp: 44114564 [11024.630647][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11024.631188][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11024.631738][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11024.632231][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11024.632741][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11024.633200][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11024.633858][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [11024.634149][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [11024.635170][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [11024.635480][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11024.635889][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11024.636322][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11024.636726][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11024.637162][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11024.637572][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11024.638036][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11024.638402][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11024.638812][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11024.639240][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11024.639652][ C2] PKRU: 55555554 [11024.639835][ C2] Call Trace: [11024.640014][ C2] [11024.640168][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11024.640464][ C2] ? __run_hrtimer+0x1c0/0x710 [11024.640714][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11024.641000][ C2] ? __hrtimer_run_queues+0x197/0x270 [11024.641283][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11024.641603][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11024.641874][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11024.642191][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11024.642462][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11024.642757][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11024.643070][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11024.643377][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11024.643729][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11024.644028][ C2] ? __pfx___kasan_check_read+0x10/0x10 [11024.644317][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [11024.644609][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11024.644954][ C2] ? get_stack_info+0x36/0xc0 [11024.645200][ C2] ? lock_acquire+0x1c1/0x220 [11024.645449][ C2] ? lock_release+0x1d5/0x250 [11024.645697][ C2] do_raw_spin_lock+0x1ec/0x270 [11024.645981][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11024.646257][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11024.646550][ C2] ? lock_acquire+0x1c1/0x220 [11024.646793][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11024.647069][ C2] _raw_spin_lock_nested+0x65/0x80 [11024.647338][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11024.647581][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11024.647845][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11024.648134][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11024.648414][ C2] ip_local_deliver_finish+0x2ae/0x480 [11024.648699][ C2] ip_local_deliver+0x19d/0x480 [11024.648954][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11024.649259][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11024.649529][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11024.649891][ C2] ? rcu_read_lock_held+0xe/0x50 [11024.650154][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11024.650508][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11024.650778][ C2] ip_rcv+0x564/0x740 [11024.650989][ C2] ? __pfx_ip_rcv+0x10/0x10 [11024.651228][ C2] ? set_track_prepare+0x8a/0xd0 [11024.651517][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11024.651797][ C2] ? start_secondary+0x21c/0x2b0 [11024.652055][ C2] ? skb_clone+0x10b/0x330 [11024.652291][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11024.652643][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11024.652951][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11024.653240][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11024.653563][ C2] ? __tcf_classify+0x329/0x7d0 [11024.653823][ C2] ? __pfx_ip_rcv+0x10/0x10 [11024.654060][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11024.654375][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11024.654698][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11024.655026][ C2] ? lock_acquire+0x1c1/0x220 [11024.655271][ C2] ? netif_receive_skb_internal+0x84/0x300 [11024.655578][ C2] netif_receive_skb_internal+0xb0/0x300 [11024.655894][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11024.656221][ C2] ? __copy_skb_header+0xaf/0x490 [11024.656489][ C2] ? __skb_clone+0x57a/0x760 [11024.656732][ C2] netif_receive_skb+0x55/0x280 [11024.657012][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11024.657330][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11024.657681][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11024.658016][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11024.658298][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11024.658594][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11024.658916][ C2] ? get_stack_info+0x36/0xc0 [11024.659192][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11024.659461][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11024.659789][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11024.660071][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11024.660379][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11024.660703][ C2] ? kernel_text_address+0x17/0xe0 [11024.660971][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11024.661325][ C2] ? arch_stack_walk+0x8c/0x100 [11024.661577][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11024.661850][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11024.662145][ C2] ? lock_acquire+0x1c1/0x220 [11024.662415][ C2] ? stack_depot_save_flags+0x281/0x550 [11024.662704][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11024.663018][ C2] ? get_stack_info_noinstr+0x18/0x110 [11024.663304][ C2] ? get_stack_info+0x36/0xc0 [11024.663579][ C2] __tcf_classify+0x329/0x7d0 [11024.663826][ C2] tcf_classify+0x283/0x930 [11024.664068][ C2] ? __pfx_tcf_classify+0x10/0x10 [11024.664333][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11024.664682][ C2] tc_run+0x2e4/0x5d0 [11024.664891][ C2] ? __pfx_tc_run+0x10/0x10 [11024.665130][ C2] ? lock_acquire+0x1c1/0x220 [11024.665375][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11024.665661][ C2] __dev_queue_xmit+0x686/0x17e0 [11024.665925][ C2] ? lock_acquire+0x1c1/0x220 [11024.666173][ C2] ? ip_finish_output2+0x786/0x18e0 [11024.666446][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11024.666784][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11024.667062][ C2] ? neigh_hh_output+0x348/0x590 [11024.667324][ C2] ? ip_finish_output2+0x262/0x18e0 [11024.667596][ C2] ip_finish_output2+0x786/0x18e0 [11024.667897][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11024.668245][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11024.668534][ C2] ? rcu_read_lock_held+0xe/0x50 [11024.668797][ C2] ? __ip_finish_output+0x10f/0x770 [11024.669097][ C2] ip_output+0x16b/0x4f0 [11024.669320][ C2] ? __pfx_ip_output+0x10/0x10 [11024.669572][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11024.669857][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11024.670212][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11024.670498][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11024.670755][ C2] ? __alloc_skb+0xd4/0x280 [11024.670991][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11024.671293][ C2] ? tcp_fragment+0x168/0x1040 [11024.671541][ C2] ? rcu_read_lock_held+0xe/0x50 [11024.671801][ C2] ? ip_local_out+0x114/0x3b0 [11024.672048][ C2] __ip_queue_xmit+0x672/0x1910 [11024.672344][ C2] ? __skb_clone+0x57a/0x760 [11024.672587][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11024.672863][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11024.673156][ C2] ? ipv4_dst_check+0xe3/0x170 [11024.673439][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11024.673694][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11024.674004][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11024.674334][ C2] ? tcp_fragment+0xb0e/0x1040 [11024.674614][ C2] tcp_send_loss_probe+0x348/0x830 [11024.674877][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11024.675153][ C2] tcp_write_timer+0x82/0x1d0 [11024.675402][ C2] call_timer_fn+0x173/0x430 [11024.675675][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11024.675941][ C2] ? next_expiry_recalc+0xcd/0x220 [11024.676211][ C2] __run_timers.part.0+0x52d/0x890 [11024.676480][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11024.676782][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11024.677076][ C2] ? lock_acquire+0x1c1/0x220 [11024.677322][ C2] ? clockevents_program_event+0xf6/0x300 [11024.677624][ C2] ? lock_release+0x1d5/0x250 [11024.677905][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11024.678176][ C2] ? ktime_get+0xb3/0x190 [11024.678403][ C2] ? clockevents_program_event+0x1ea/0x300 [11024.678709][ C2] run_timer_softirq+0x72/0x100 [11024.678990][ C2] __do_softirq+0x1b9/0x7ff [11024.679228][ C2] irq_exit_rcu+0x98/0xc0 [11024.679458][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11024.679754][ C2] [11024.679909][ C2] [11024.680092][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11024.680408][ C2] RIP: 0010:default_idle+0xf/0x20 [11024.680673][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11024.681682][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11024.681993][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11024.682428][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11024.682832][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11024.683260][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11024.683680][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11024.684090][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11024.684414][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11024.684679][ C2] default_idle_call+0x69/0xa0 [11024.684932][ C2] cpuidle_idle_call+0x1f6/0x280 [11024.685192][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11024.685500][ C2] ? lock_release+0x1d5/0x250 [11024.685746][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11024.686025][ C2] do_idle+0xfb/0x160 [11024.686238][ C2] cpu_startup_entry+0x55/0x60 [11024.686487][ C2] start_secondary+0x21c/0x2b0 [11024.686763][ C2] ? __pfx_start_secondary+0x10/0x10 [11024.687035][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11024.687356][ C2] [11048.703104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11048.703477][ C1] rcu: 1-....: (8382730 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2025500 [11048.704038][ C1] rcu: (t=8693816 jiffies g=1882453 q=730 ncpus=4) [11048.704374][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11048.704822][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11048.705435][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11048.705764][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11048.706737][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11048.707045][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11048.707471][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11048.707876][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11048.708277][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11048.708677][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11048.709078][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11048.709528][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11048.709861][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11048.710261][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11048.710661][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11048.711061][ C1] PKRU: 55555554 [11048.711243][ C1] Call Trace: [11048.711413][ C1] [11048.711564][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11048.711837][ C1] ? print_cpu_stall+0x263/0x6a0 [11048.712090][ C1] ? check_cpu_stall+0x284/0x500 [11048.712343][ C1] ? rcu_pending+0x92/0x360 [11048.712573][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11048.712843][ C1] ? update_process_times+0xb9/0x110 [11048.713115][ C1] ? tick_sched_handle+0x67/0x130 [11048.713373][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11048.713657][ C1] ? __run_hrtimer+0x1c0/0x710 [11048.713901][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11048.714216][ C1] ? __hrtimer_run_queues+0x197/0x270 [11048.714489][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11048.714778][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11048.715043][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11048.715350][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11048.715613][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11048.715922][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11048.716220][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11048.716536][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11048.716824][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11048.717121][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11048.717410][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11048.717728][ C1] ? get_stack_info+0x36/0xc0 [11048.717969][ C1] ? lock_acquire+0x1c1/0x220 [11048.718212][ C1] ? lock_release+0x1d5/0x250 [11048.718451][ C1] do_raw_spin_lock+0x1ec/0x270 [11048.718700][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11048.718974][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11048.719259][ C1] ? lock_acquire+0x1c1/0x220 [11048.719499][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11048.719741][ C1] _raw_spin_lock_nested+0x65/0x80 [11048.720001][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11048.720235][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11048.720483][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11048.720741][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11048.721026][ C1] ip_local_deliver_finish+0x2ae/0x480 [11048.721306][ C1] ip_local_deliver+0x19d/0x480 [11048.721554][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11048.721829][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11048.722093][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11048.722441][ C1] ? rcu_read_lock_held+0xe/0x50 [11048.722694][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11048.723017][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11048.723281][ C1] ip_rcv+0x564/0x740 [11048.723488][ C1] ? __pfx_ip_rcv+0x10/0x10 [11048.723718][ C1] ? set_track_prepare+0x8a/0xd0 [11048.723971][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11048.724248][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11048.724523][ C1] ? skb_clone+0x10b/0x330 [11048.724751][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11048.725071][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11048.725397][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11048.725677][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11048.725975][ C1] ? __tcf_classify+0x329/0x7d0 [11048.726226][ C1] ? __pfx_ip_rcv+0x10/0x10 [11048.726455][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11048.726758][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11048.727044][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11048.727371][ C1] ? lock_acquire+0x1c1/0x220 [11048.727622][ C1] ? netif_receive_skb_internal+0x84/0x300 [11048.727919][ C1] netif_receive_skb_internal+0xb0/0x300 [11048.728204][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11048.728523][ C1] ? __copy_skb_header+0xaf/0x490 [11048.728781][ C1] ? __skb_clone+0x57a/0x760 [11048.729016][ C1] netif_receive_skb+0x55/0x280 [11048.729266][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11048.729596][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11048.729927][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11048.730236][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11048.730512][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11048.730800][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11048.731114][ C1] ? hlock_class+0x4e/0x130 [11048.731347][ C1] ? get_stack_info_noinstr+0x18/0x110 [11048.731630][ C1] ? get_stack_info_noinstr+0x18/0x110 [11048.731905][ C1] ? __pfx_validate_chain+0x10/0x10 [11048.732169][ C1] ? hlock_class+0x4e/0x130 [11048.732401][ C1] ? mark_lock+0x38/0x3e0 [11048.732619][ C1] ? stack_access_ok+0xda/0x1f0 [11048.732869][ C1] ? __lock_acquire+0xb67/0x1610 [11048.733124][ C1] ? get_stack_info_noinstr+0x18/0x110 [11048.733401][ C1] ? get_stack_info+0x36/0xc0 [11048.733642][ C1] ? stack_access_ok+0xda/0x1f0 [11048.733888][ C1] ? get_reg+0x119/0x190 [11048.734104][ C1] ? unwind_next_frame+0x12af/0x1d10 [11048.734374][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11048.734681][ C1] __tcf_classify+0x329/0x7d0 [11048.734923][ C1] tcf_classify+0x283/0x930 [11048.735156][ C1] ? arch_stack_walk+0xa2/0x100 [11048.735405][ C1] ? __pfx_tcf_classify+0x10/0x10 [11048.735662][ C1] ? get_stack_info+0x36/0xc0 [11048.735901][ C1] tc_run+0x2e4/0x5d0 [11048.736108][ C1] ? __pfx_tc_run+0x10/0x10 [11048.736339][ C1] ? lock_acquire+0x1c1/0x220 [11048.736578][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11048.736845][ C1] __dev_queue_xmit+0x686/0x17e0 [11048.737098][ C1] ? lock_acquire+0x1c1/0x220 [11048.737338][ C1] ? ip_finish_output2+0x786/0x18e0 [11048.737609][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11048.737916][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11048.738189][ C1] ? neigh_hh_output+0x348/0x590 [11048.738442][ C1] ? ip_finish_output2+0x262/0x18e0 [11048.738707][ C1] ip_finish_output2+0x786/0x18e0 [11048.738963][ C1] ? stack_depot_save_flags+0x45/0x550 [11048.739242][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11048.739580][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11048.739857][ C1] ? rcu_read_lock_held+0xe/0x50 [11048.740110][ C1] ? __ip_finish_output+0x10f/0x770 [11048.740375][ C1] ip_output+0x16b/0x4f0 [11048.740591][ C1] ? run_timer_softirq+0x72/0x100 [11048.740848][ C1] ? __pfx_ip_output+0x10/0x10 [11048.741091][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11048.741378][ C1] ? rcu_read_lock_held+0xe/0x50 [11048.741630][ C1] ? ip_local_out+0x114/0x3b0 [11048.741871][ C1] __ip_queue_xmit+0x672/0x1910 [11048.742120][ C1] ? __create_object+0x5e/0xb0 [11048.742366][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11048.742632][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11048.742913][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11048.743188][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11048.743469][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11048.743740][ C1] tcp_delack_timer+0x84/0x240 [11048.743984][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11048.744255][ C1] call_timer_fn+0x173/0x430 [11048.744493][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11048.744754][ C1] ? next_expiry_recalc+0xcd/0x220 [11048.745015][ C1] __run_timers.part.0+0x52d/0x890 [11048.745276][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11048.745548][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11048.745835][ C1] ? lock_acquire+0x1c1/0x220 [11048.746074][ C1] ? clockevents_program_event+0xf6/0x300 [11048.746364][ C1] ? lock_release+0x1d5/0x250 [11048.746603][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11048.746868][ C1] ? ktime_get+0xb3/0x190 [11048.747088][ C1] ? clockevents_program_event+0x1ea/0x300 [11048.747392][ C1] run_timer_softirq+0x72/0x100 [11048.747649][ C1] __do_softirq+0x1b9/0x7ff [11048.747883][ C1] irq_exit_rcu+0x98/0xc0 [11048.748104][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11048.748389][ C1] [11048.748542][ C1] [11048.748692][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11048.748997][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11048.749327][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11048.750302][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11048.750611][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11048.751010][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11048.751407][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11048.751812][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11048.752212][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11048.752611][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11048.752907][ C1] pipe_read+0xa16/0xdf0 [11048.753127][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11048.753405][ C1] ? __pfx_pipe_read+0x10/0x10 [11048.753647][ C1] ? iterate_tty_write+0x299/0x540 [11048.753908][ C1] ? lock_release+0x1d5/0x250 [11048.754149][ C1] vfs_read+0x911/0xc00 [11048.754362][ C1] ? lock_acquire+0x1c1/0x220 [11048.754600][ C1] ? __might_fault+0xc6/0x180 [11048.754841][ C1] ? __pfx_vfs_read+0x10/0x10 [11048.755081][ C1] ? __might_fault+0xc6/0x180 [11048.755319][ C1] ? lock_release+0x1d5/0x250 [11048.755559][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11048.755823][ C1] ? __fget_light+0x54/0x1e0 [11048.756060][ C1] ksys_read+0x17a/0x1e0 [11048.756277][ C1] ? __pfx_ksys_read+0x10/0x10 [11048.756521][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11048.756827][ C1] do_syscall_64+0xc9/0x1e0 [11048.757060][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11048.757359][ C1] RIP: 0033:0x7f08a1ea38b2 [11048.757594][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11048.758563][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11048.758985][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11048.759385][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11048.759782][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11048.760191][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11048.760588][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11048.760990][ C1] [11048.761152][ C1] Sending NMI from CPU 1 to CPUs 2: [11048.761432][ C2] NMI backtrace for cpu 2 [11048.761445][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11048.761451][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11048.761454][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11048.761465][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11048.761468][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11048.761472][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11048.761474][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11048.761476][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11048.761478][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11048.761480][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11048.761482][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11048.761484][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11048.761487][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11048.761489][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11048.761490][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11048.761492][ C2] PKRU: 55555554 [11048.761493][ C2] Call Trace: [11048.761497][ C2] [11048.761502][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11048.761510][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11048.761517][ C2] ? nmi_handle+0x153/0x420 [11048.761522][ C2] ? default_do_nmi+0x41/0x100 [11048.761526][ C2] ? exc_nmi+0xf3/0x120 [11048.761529][ C2] ? end_repeat_nmi+0xf/0x60 [11048.761536][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11048.761539][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11048.761542][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11048.761545][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11048.761548][ C2] [11048.761549][ C2] [11048.761551][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11048.761554][ C2] ? get_stack_info+0x36/0xc0 [11048.761558][ C2] ? lock_acquire+0x1c1/0x220 [11048.761564][ C2] ? lock_release+0x1d5/0x250 [11048.761567][ C2] do_raw_spin_lock+0x1ec/0x270 [11048.761572][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11048.761574][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11048.761578][ C2] ? lock_acquire+0x1c1/0x220 [11048.761580][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11048.761585][ C2] _raw_spin_lock_nested+0x65/0x80 [11048.761588][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11048.761595][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11048.761598][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11048.761603][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11048.761611][ C2] ip_local_deliver_finish+0x2ae/0x480 [11048.761615][ C2] ip_local_deliver+0x19d/0x480 [11048.761617][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11048.761620][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11048.761622][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11048.761629][ C2] ? rcu_read_lock_held+0xe/0x50 [11048.761635][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11048.761638][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11048.761648][ C2] ip_rcv+0x564/0x740 [11048.761651][ C2] ? __pfx_ip_rcv+0x10/0x10 [11048.761654][ C2] ? set_track_prepare+0x8a/0xd0 [11048.761659][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11048.761662][ C2] ? start_secondary+0x21c/0x2b0 [11048.761668][ C2] ? skb_clone+0x10b/0x330 [11048.761672][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11048.761679][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11048.761684][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11048.761690][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11048.761698][ C2] ? __tcf_classify+0x329/0x7d0 [11048.761702][ C2] ? __pfx_ip_rcv+0x10/0x10 [11048.761705][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11048.761709][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11048.761712][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11048.761716][ C2] ? lock_acquire+0x1c1/0x220 [11048.761719][ C2] ? netif_receive_skb_internal+0x84/0x300 [11048.761723][ C2] netif_receive_skb_internal+0xb0/0x300 [11048.761727][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11048.761731][ C2] ? __copy_skb_header+0xaf/0x490 [11048.761737][ C2] ? __skb_clone+0x57a/0x760 [11048.761739][ C2] netif_receive_skb+0x55/0x280 [11048.761743][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11048.761751][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11048.761758][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11048.761764][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11048.761769][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11048.761779][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11048.761787][ C2] ? get_stack_info+0x36/0xc0 [11048.761791][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11048.761795][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11048.761801][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11048.761803][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11048.761807][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11048.761809][ C2] ? kernel_text_address+0x17/0xe0 [11048.761814][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11048.761819][ C2] ? arch_stack_walk+0x8c/0x100 [11048.761824][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11048.761828][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11048.761831][ C2] ? lock_acquire+0x1c1/0x220 [11048.761833][ C2] ? stack_depot_save_flags+0x281/0x550 [11048.761839][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11048.761845][ C2] ? get_stack_info_noinstr+0x18/0x110 [11048.761847][ C2] ? get_stack_info+0x36/0xc0 [11048.761852][ C2] __tcf_classify+0x329/0x7d0 [11048.761857][ C2] tcf_classify+0x283/0x930 [11048.761862][ C2] ? __pfx_tcf_classify+0x10/0x10 [11048.761865][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11048.761870][ C2] tc_run+0x2e4/0x5d0 [11048.761875][ C2] ? __pfx_tc_run+0x10/0x10 [11048.761878][ C2] ? lock_acquire+0x1c1/0x220 [11048.761881][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11048.761885][ C2] __dev_queue_xmit+0x686/0x17e0 [11048.761889][ C2] ? lock_acquire+0x1c1/0x220 [11048.761892][ C2] ? ip_finish_output2+0x786/0x18e0 [11048.761895][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11048.761899][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11048.761901][ C2] ? neigh_hh_output+0x348/0x590 [11048.761905][ C2] ? ip_finish_output2+0x262/0x18e0 [11048.761909][ C2] ip_finish_output2+0x786/0x18e0 [11048.761912][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11048.761920][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11048.761923][ C2] ? rcu_read_lock_held+0xe/0x50 [11048.761927][ C2] ? __ip_finish_output+0x10f/0x770 [11048.761930][ C2] ip_output+0x16b/0x4f0 [11048.761934][ C2] ? __pfx_ip_output+0x10/0x10 [11048.761936][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11048.761939][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11048.761942][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11048.761946][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11048.761949][ C2] ? __alloc_skb+0xd4/0x280 [11048.761951][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11048.761956][ C2] ? tcp_fragment+0x168/0x1040 [11048.761960][ C2] ? rcu_read_lock_held+0xe/0x50 [11048.761963][ C2] ? ip_local_out+0x114/0x3b0 [11048.761967][ C2] __ip_queue_xmit+0x672/0x1910 [11048.761971][ C2] ? __skb_clone+0x57a/0x760 [11048.761974][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11048.761980][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11048.761983][ C2] ? ipv4_dst_check+0xe3/0x170 [11048.761988][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11048.761994][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11048.761999][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11048.762002][ C2] ? tcp_fragment+0xb0e/0x1040 [11048.762005][ C2] tcp_send_loss_probe+0x348/0x830 [11048.762009][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11048.762012][ C2] tcp_write_timer+0x82/0x1d0 [11048.762016][ C2] call_timer_fn+0x173/0x430 [11048.762021][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11048.762025][ C2] ? next_expiry_recalc+0xcd/0x220 [11048.762030][ C2] __run_timers.part.0+0x52d/0x890 [11048.762033][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11048.762037][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11048.762041][ C2] ? lock_acquire+0x1c1/0x220 [11048.762043][ C2] ? clockevents_program_event+0xf6/0x300 [11048.762049][ C2] ? lock_release+0x1d5/0x250 [11048.762052][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11048.762056][ C2] ? ktime_get+0xb3/0x190 [11048.762061][ C2] ? clockevents_program_event+0x1ea/0x300 [11048.762065][ C2] run_timer_softirq+0x72/0x100 [11048.762069][ C2] __do_softirq+0x1b9/0x7ff [11048.762073][ C2] irq_exit_rcu+0x98/0xc0 [11048.762077][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11048.762080][ C2] [11048.762081][ C2] [11048.762082][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11048.762086][ C2] RIP: 0010:default_idle+0xf/0x20 [11048.762090][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11048.762093][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11048.762095][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11048.762097][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11048.762099][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11048.762101][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11048.762102][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11048.762106][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11048.762109][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11048.762113][ C2] default_idle_call+0x69/0xa0 [11048.762117][ C2] cpuidle_idle_call+0x1f6/0x280 [11048.762120][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11048.762124][ C2] ? lock_release+0x1d5/0x250 [11048.762127][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11048.762131][ C2] do_idle+0xfb/0x160 [11048.762134][ C2] cpu_startup_entry+0x55/0x60 [11048.762136][ C2] start_secondary+0x21c/0x2b0 [11048.762140][ C2] ? __pfx_start_secondary+0x10/0x10 [11048.762144][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11048.762150][ C2] [11076.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8124s! [swapper/2:0] [11076.569726][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11076.570982][ C2] irq event stamp: 44114564 [11076.571213][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11076.571755][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11076.572266][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11076.572742][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11076.573216][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11076.573673][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11076.574283][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11076.574607][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11076.575577][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11076.575885][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11076.576282][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11076.576681][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11076.577078][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11076.577491][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11076.577887][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11076.578333][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11076.578666][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11076.579065][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11076.579462][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11076.579860][ C2] PKRU: 55555554 [11076.580041][ C2] Call Trace: [11076.580214][ C2] [11076.580362][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11076.580624][ C2] ? __run_hrtimer+0x1c0/0x710 [11076.580868][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11076.581144][ C2] ? __hrtimer_run_queues+0x197/0x270 [11076.581417][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11076.581703][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11076.581967][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11076.582276][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11076.582536][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11076.582798][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11076.583108][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11076.583406][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11076.583723][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11076.584012][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11076.584308][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11076.584599][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11076.584910][ C2] ? get_stack_info+0x36/0xc0 [11076.585154][ C2] ? lock_acquire+0x1c1/0x220 [11076.585395][ C2] ? lock_release+0x1d5/0x250 [11076.585632][ C2] do_raw_spin_lock+0x1ec/0x270 [11076.585880][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11076.586152][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11076.586438][ C2] ? lock_acquire+0x1c1/0x220 [11076.586677][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11076.586916][ C2] _raw_spin_lock_nested+0x65/0x80 [11076.587177][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11076.587419][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11076.587667][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11076.587927][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11076.588202][ C2] ip_local_deliver_finish+0x2ae/0x480 [11076.588479][ C2] ip_local_deliver+0x19d/0x480 [11076.588726][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11076.588997][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11076.589261][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11076.589608][ C2] ? rcu_read_lock_held+0xe/0x50 [11076.589861][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11076.590180][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11076.590445][ C2] ip_rcv+0x564/0x740 [11076.590647][ C2] ? __pfx_ip_rcv+0x10/0x10 [11076.590879][ C2] ? set_track_prepare+0x8a/0xd0 [11076.591133][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11076.591407][ C2] ? start_secondary+0x21c/0x2b0 [11076.591656][ C2] ? skb_clone+0x10b/0x330 [11076.591885][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11076.592205][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11076.592509][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11076.592791][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11076.593083][ C2] ? __tcf_classify+0x329/0x7d0 [11076.593333][ C2] ? __pfx_ip_rcv+0x10/0x10 [11076.593563][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11076.593863][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11076.594148][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11076.594472][ C2] ? lock_acquire+0x1c1/0x220 [11076.594711][ C2] ? netif_receive_skb_internal+0x84/0x300 [11076.595004][ C2] netif_receive_skb_internal+0xb0/0x300 [11076.595290][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11076.595607][ C2] ? __copy_skb_header+0xaf/0x490 [11076.595876][ C2] ? __skb_clone+0x57a/0x760 [11076.596109][ C2] netif_receive_skb+0x55/0x280 [11076.596356][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11076.596668][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11076.596999][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11076.597298][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11076.597575][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11076.597863][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11076.598175][ C2] ? get_stack_info+0x36/0xc0 [11076.598416][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11076.598679][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11076.598997][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11076.599273][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11076.599551][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11076.599867][ C2] ? kernel_text_address+0x17/0xe0 [11076.600129][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11076.600441][ C2] ? arch_stack_walk+0x8c/0x100 [11076.600690][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11076.600956][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11076.601240][ C2] ? lock_acquire+0x1c1/0x220 [11076.601480][ C2] ? stack_depot_save_flags+0x281/0x550 [11076.601762][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11076.602067][ C2] ? get_stack_info_noinstr+0x18/0x110 [11076.602343][ C2] ? get_stack_info+0x36/0xc0 [11076.602585][ C2] __tcf_classify+0x329/0x7d0 [11076.602831][ C2] tcf_classify+0x283/0x930 [11076.603062][ C2] ? __pfx_tcf_classify+0x10/0x10 [11076.603319][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11076.603631][ C2] tc_run+0x2e4/0x5d0 [11076.603837][ C2] ? __pfx_tc_run+0x10/0x10 [11076.604067][ C2] ? lock_acquire+0x1c1/0x220 [11076.604306][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11076.604566][ C2] __dev_queue_xmit+0x686/0x17e0 [11076.604819][ C2] ? lock_acquire+0x1c1/0x220 [11076.605058][ C2] ? ip_finish_output2+0x786/0x18e0 [11076.605323][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11076.605626][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11076.605899][ C2] ? neigh_hh_output+0x348/0x590 [11076.606151][ C2] ? ip_finish_output2+0x262/0x18e0 [11076.606415][ C2] ip_finish_output2+0x786/0x18e0 [11076.606673][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11076.607009][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11076.607283][ C2] ? rcu_read_lock_held+0xe/0x50 [11076.607541][ C2] ? __ip_finish_output+0x10f/0x770 [11076.607804][ C2] ip_output+0x16b/0x4f0 [11076.608021][ C2] ? __pfx_ip_output+0x10/0x10 [11076.608262][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11076.608540][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11076.608852][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11076.609128][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11076.609378][ C2] ? __alloc_skb+0xd4/0x280 [11076.609608][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11076.609876][ C2] ? tcp_fragment+0x168/0x1040 [11076.610120][ C2] ? rcu_read_lock_held+0xe/0x50 [11076.610370][ C2] ? ip_local_out+0x114/0x3b0 [11076.610609][ C2] __ip_queue_xmit+0x672/0x1910 [11076.610856][ C2] ? __skb_clone+0x57a/0x760 [11076.611091][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11076.611356][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11076.611636][ C2] ? ipv4_dst_check+0xe3/0x170 [11076.611881][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11076.612131][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11076.612434][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11076.612756][ C2] ? tcp_fragment+0xb0e/0x1040 [11076.612998][ C2] tcp_send_loss_probe+0x348/0x830 [11076.613259][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11076.613527][ C2] tcp_write_timer+0x82/0x1d0 [11076.613766][ C2] call_timer_fn+0x173/0x430 [11076.614004][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11076.614264][ C2] ? next_expiry_recalc+0xcd/0x220 [11076.614524][ C2] __run_timers.part.0+0x52d/0x890 [11076.614783][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11076.615054][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11076.615340][ C2] ? lock_acquire+0x1c1/0x220 [11076.615579][ C2] ? clockevents_program_event+0xf6/0x300 [11076.615869][ C2] ? lock_release+0x1d5/0x250 [11076.616109][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11076.616372][ C2] ? ktime_get+0xb3/0x190 [11076.616594][ C2] ? clockevents_program_event+0x1ea/0x300 [11076.616888][ C2] run_timer_softirq+0x72/0x100 [11076.617137][ C2] __do_softirq+0x1b9/0x7ff [11076.617370][ C2] irq_exit_rcu+0x98/0xc0 [11076.617594][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11076.617881][ C2] [11076.618031][ C2] [11076.618180][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11076.618484][ C2] RIP: 0010:default_idle+0xf/0x20 [11076.618740][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11076.619705][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11076.620015][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11076.620413][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11076.620811][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11076.621210][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11076.621608][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11076.622006][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11076.622297][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11076.622559][ C2] default_idle_call+0x69/0xa0 [11076.622803][ C2] cpuidle_idle_call+0x1f6/0x280 [11076.623054][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11076.623333][ C2] ? lock_release+0x1d5/0x250 [11076.623573][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11076.623847][ C2] do_idle+0xfb/0x160 [11076.624050][ C2] cpu_startup_entry+0x55/0x60 [11076.624295][ C2] start_secondary+0x21c/0x2b0 [11076.624539][ C2] ? __pfx_start_secondary+0x10/0x10 [11076.624808][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11076.625121][ C2] [11076.625277][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8124s! [perl:4135] [11076.625698][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11076.626957][ C1] irq event stamp: 209232 [11076.627179][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11076.627716][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11076.628195][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11076.628667][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11076.629133][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11076.629585][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11076.630201][ C1] RIP: 0010:kasan_check_range+0x77/0x1c0 [11076.630494][ C1] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [11076.631473][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [11076.631785][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11076.632188][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11076.632590][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [11076.632991][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11076.633396][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11076.633797][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11076.634249][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11076.634584][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11076.634989][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11076.635395][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11076.635796][ C1] PKRU: 55555554 [11076.635982][ C1] Call Trace: [11076.636155][ C1] [11076.636306][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11076.636573][ C1] ? __run_hrtimer+0x1c0/0x710 [11076.636819][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11076.637098][ C1] ? __hrtimer_run_queues+0x197/0x270 [11076.637373][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11076.637674][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11076.637942][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11076.638253][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11076.638516][ C1] ? hrtimer_interrupt+0x31a/0x770 [11076.638780][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11076.639092][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11076.639391][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11076.639710][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11076.640004][ C1] ? kasan_check_range+0x77/0x1c0 [11076.640274][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11076.640559][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11076.640875][ C1] ? get_stack_info+0x36/0xc0 [11076.641119][ C1] ? lock_acquire+0x1c1/0x220 [11076.641360][ C1] ? lock_release+0x1d5/0x250 [11076.641608][ C1] do_raw_spin_lock+0x1ec/0x270 [11076.641861][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11076.642137][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11076.642427][ C1] ? lock_acquire+0x1c1/0x220 [11076.642667][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11076.642909][ C1] _raw_spin_lock_nested+0x65/0x80 [11076.643171][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11076.643410][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11076.643659][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11076.643920][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11076.644198][ C1] ip_local_deliver_finish+0x2ae/0x480 [11076.644476][ C1] ip_local_deliver+0x19d/0x480 [11076.644726][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11076.645000][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11076.645270][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11076.645620][ C1] ? rcu_read_lock_held+0xe/0x50 [11076.645876][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11076.646200][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11076.646465][ C1] ip_rcv+0x564/0x740 [11076.646670][ C1] ? __pfx_ip_rcv+0x10/0x10 [11076.646910][ C1] ? set_track_prepare+0x8a/0xd0 [11076.647167][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11076.647455][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11076.647729][ C1] ? skb_clone+0x10b/0x330 [11076.647961][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11076.648283][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11076.648591][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11076.648877][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11076.649174][ C1] ? __tcf_classify+0x329/0x7d0 [11076.649425][ C1] ? __pfx_ip_rcv+0x10/0x10 [11076.649660][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11076.649963][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11076.650254][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11076.650582][ C1] ? lock_acquire+0x1c1/0x220 [11076.650824][ C1] ? netif_receive_skb_internal+0x84/0x300 [11076.651123][ C1] netif_receive_skb_internal+0xb0/0x300 [11076.651413][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11076.651735][ C1] ? __copy_skb_header+0xaf/0x490 [11076.651994][ C1] ? __skb_clone+0x57a/0x760 [11076.652232][ C1] netif_receive_skb+0x55/0x280 [11076.652482][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11076.652798][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11076.653134][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11076.653437][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11076.653714][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11076.654006][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11076.654320][ C1] ? hlock_class+0x4e/0x130 [11076.654555][ C1] ? get_stack_info_noinstr+0x18/0x110 [11076.654833][ C1] ? get_stack_info_noinstr+0x18/0x110 [11076.655113][ C1] ? __pfx_validate_chain+0x10/0x10 [11076.655380][ C1] ? hlock_class+0x4e/0x130 [11076.655611][ C1] ? mark_lock+0x38/0x3e0 [11076.655835][ C1] ? stack_access_ok+0xda/0x1f0 [11076.656087][ C1] ? __lock_acquire+0xb67/0x1610 [11076.656344][ C1] ? get_stack_info_noinstr+0x18/0x110 [11076.656623][ C1] ? get_stack_info+0x36/0xc0 [11076.656868][ C1] ? stack_access_ok+0xda/0x1f0 [11076.657116][ C1] ? get_reg+0x119/0x190 [11076.657334][ C1] ? unwind_next_frame+0x12af/0x1d10 [11076.657608][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11076.657924][ C1] __tcf_classify+0x329/0x7d0 [11076.658170][ C1] tcf_classify+0x283/0x930 [11076.658402][ C1] ? arch_stack_walk+0xa2/0x100 [11076.658653][ C1] ? __pfx_tcf_classify+0x10/0x10 [11076.658912][ C1] ? get_stack_info+0x36/0xc0 [11076.659157][ C1] tc_run+0x2e4/0x5d0 [11076.659364][ C1] ? __pfx_tc_run+0x10/0x10 [11076.659598][ C1] ? lock_acquire+0x1c1/0x220 [11076.659838][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11076.660103][ C1] __dev_queue_xmit+0x686/0x17e0 [11076.660360][ C1] ? lock_acquire+0x1c1/0x220 [11076.660599][ C1] ? ip_finish_output2+0x786/0x18e0 [11076.660867][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11076.661177][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11076.661450][ C1] ? neigh_hh_output+0x348/0x590 [11076.661708][ C1] ? ip_finish_output2+0x262/0x18e0 [11076.661975][ C1] ip_finish_output2+0x786/0x18e0 [11076.662234][ C1] ? stack_depot_save_flags+0x45/0x550 [11076.662519][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11076.662861][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11076.663140][ C1] ? rcu_read_lock_held+0xe/0x50 [11076.663396][ C1] ? __ip_finish_output+0x10f/0x770 [11076.663663][ C1] ip_output+0x16b/0x4f0 [11076.663882][ C1] ? run_timer_softirq+0x72/0x100 [11076.664142][ C1] ? __pfx_ip_output+0x10/0x10 [11076.664387][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11076.664677][ C1] ? rcu_read_lock_held+0xe/0x50 [11076.664931][ C1] ? ip_local_out+0x114/0x3b0 [11076.665175][ C1] __ip_queue_xmit+0x672/0x1910 [11076.665424][ C1] ? __create_object+0x5e/0xb0 [11076.665670][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11076.665940][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11076.666227][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11076.666504][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11076.666794][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11076.667072][ C1] tcp_delack_timer+0x84/0x240 [11076.667320][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11076.667608][ C1] call_timer_fn+0x173/0x430 [11076.667845][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11076.668111][ C1] ? next_expiry_recalc+0xcd/0x220 [11076.668375][ C1] __run_timers.part.0+0x52d/0x890 [11076.668639][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11076.668921][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11076.669208][ C1] ? lock_acquire+0x1c1/0x220 [11076.669449][ C1] ? clockevents_program_event+0xf6/0x300 [11076.669743][ C1] ? lock_release+0x1d5/0x250 [11076.669983][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11076.670262][ C1] ? ktime_get+0xb3/0x190 [11076.670488][ C1] ? clockevents_program_event+0x1ea/0x300 [11076.670787][ C1] run_timer_softirq+0x72/0x100 [11076.671036][ C1] __do_softirq+0x1b9/0x7ff [11076.671274][ C1] irq_exit_rcu+0x98/0xc0 [11076.671496][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11076.671788][ C1] [11076.671938][ C1] [11076.672091][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11076.672399][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11076.672727][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11076.673707][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11076.674017][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11076.674423][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11076.674826][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11076.675228][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11076.675629][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11076.676035][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11076.676333][ C1] pipe_read+0xa16/0xdf0 [11076.676561][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11076.676842][ C1] ? __pfx_pipe_read+0x10/0x10 [11076.677088][ C1] ? iterate_tty_write+0x299/0x540 [11076.677356][ C1] ? lock_release+0x1d5/0x250 [11076.677604][ C1] vfs_read+0x911/0xc00 [11076.677822][ C1] ? lock_acquire+0x1c1/0x220 [11076.678062][ C1] ? __might_fault+0xc6/0x180 [11076.678303][ C1] ? __pfx_vfs_read+0x10/0x10 [11076.678545][ C1] ? __might_fault+0xc6/0x180 [11076.678787][ C1] ? lock_release+0x1d5/0x250 [11076.679028][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11076.679296][ C1] ? __fget_light+0x54/0x1e0 [11076.679534][ C1] ksys_read+0x17a/0x1e0 [11076.679757][ C1] ? __pfx_ksys_read+0x10/0x10 [11076.680003][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11076.680312][ C1] do_syscall_64+0xc9/0x1e0 [11076.680550][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11076.680853][ C1] RIP: 0033:0x7f08a1ea38b2 [11076.681094][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11076.682074][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11076.682506][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11076.682908][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11076.683315][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11076.683719][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11076.684121][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11076.684527][ C1] [11104.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8150s! [perl:4135] [11104.569716][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11104.571012][ C1] irq event stamp: 209232 [11104.571230][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11104.571925][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11104.572596][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11104.573273][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11104.573956][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11104.574625][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11104.575535][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [11104.575956][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [11104.577409][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [11104.577868][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11104.578460][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11104.579056][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11104.579645][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11104.580237][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11104.580828][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11104.581487][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11104.581983][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11104.582577][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11104.583166][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11104.583750][ C1] PKRU: 55555554 [11104.584022][ C1] Call Trace: [11104.584277][ C1] [11104.584499][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11104.584891][ C1] ? __run_hrtimer+0x1c0/0x710 [11104.585254][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11104.585658][ C1] ? __hrtimer_run_queues+0x197/0x270 [11104.586045][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11104.586457][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11104.586846][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11104.587154][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11104.587438][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11104.587749][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11104.588047][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11104.588363][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11104.588659][ C1] ? __pfx___kasan_check_read+0x10/0x10 [11104.588940][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11104.589223][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11104.589540][ C1] ? get_stack_info+0x36/0xc0 [11104.589781][ C1] ? lock_acquire+0x1c1/0x220 [11104.590020][ C1] ? lock_release+0x1d5/0x250 [11104.590260][ C1] do_raw_spin_lock+0x1ec/0x270 [11104.590515][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11104.590790][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11104.591074][ C1] ? lock_acquire+0x1c1/0x220 [11104.591311][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11104.591579][ C1] _raw_spin_lock_nested+0x65/0x80 [11104.591838][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11104.592073][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11104.592320][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11104.592585][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11104.592866][ C1] ip_local_deliver_finish+0x2ae/0x480 [11104.593141][ C1] ip_local_deliver+0x19d/0x480 [11104.593399][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11104.593668][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11104.593931][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11104.594280][ C1] ? rcu_read_lock_held+0xe/0x50 [11104.594541][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11104.594859][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11104.595124][ C1] ip_rcv+0x564/0x740 [11104.595327][ C1] ? __pfx_ip_rcv+0x10/0x10 [11104.595593][ C1] ? set_track_prepare+0x8a/0xd0 [11104.595845][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11104.596122][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11104.596400][ C1] ? skb_clone+0x10b/0x330 [11104.596629][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11104.596948][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11104.597252][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11104.597555][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11104.597846][ C1] ? __tcf_classify+0x329/0x7d0 [11104.598094][ C1] ? __pfx_ip_rcv+0x10/0x10 [11104.598325][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11104.598631][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11104.598917][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11104.599244][ C1] ? lock_acquire+0x1c1/0x220 [11104.599525][ C1] ? netif_receive_skb_internal+0x84/0x300 [11104.599865][ C1] netif_receive_skb_internal+0xb0/0x300 [11104.600257][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11104.600718][ C1] ? __copy_skb_header+0xaf/0x490 [11104.601094][ C1] ? __skb_clone+0x57a/0x760 [11104.601441][ C1] netif_receive_skb+0x55/0x280 [11104.601804][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11104.602268][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11104.602760][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11104.603204][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11104.603611][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11104.604040][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11104.604507][ C1] ? hlock_class+0x4e/0x130 [11104.604855][ C1] ? get_stack_info_noinstr+0x18/0x110 [11104.605264][ C1] ? get_stack_info_noinstr+0x18/0x110 [11104.605673][ C1] ? __pfx_validate_chain+0x10/0x10 [11104.606065][ C1] ? hlock_class+0x4e/0x130 [11104.606412][ C1] ? mark_lock+0x38/0x3e0 [11104.606737][ C1] ? stack_access_ok+0xda/0x1f0 [11104.607108][ C1] ? __lock_acquire+0xb67/0x1610 [11104.607492][ C1] ? get_stack_info_noinstr+0x18/0x110 [11104.607902][ C1] ? get_stack_info+0x36/0xc0 [11104.608259][ C1] ? stack_access_ok+0xda/0x1f0 [11104.608622][ C1] ? get_reg+0x119/0x190 [11104.608946][ C1] ? unwind_next_frame+0x12af/0x1d10 [11104.609341][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11104.609799][ C1] __tcf_classify+0x329/0x7d0 [11104.610159][ C1] tcf_classify+0x283/0x930 [11104.610503][ C1] ? arch_stack_walk+0xa2/0x100 [11104.610872][ C1] ? __pfx_tcf_classify+0x10/0x10 [11104.611254][ C1] ? get_stack_info+0x36/0xc0 [11104.611611][ C1] tc_run+0x2e4/0x5d0 [11104.611922][ C1] ? __pfx_tc_run+0x10/0x10 [11104.612260][ C1] ? lock_acquire+0x1c1/0x220 [11104.612599][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11104.612958][ C1] __dev_queue_xmit+0x686/0x17e0 [11104.613322][ C1] ? lock_acquire+0x1c1/0x220 [11104.613670][ C1] ? ip_finish_output2+0x786/0x18e0 [11104.613953][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11104.614260][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11104.614541][ C1] ? neigh_hh_output+0x348/0x590 [11104.614794][ C1] ? ip_finish_output2+0x262/0x18e0 [11104.615057][ C1] ip_finish_output2+0x786/0x18e0 [11104.615314][ C1] ? stack_depot_save_flags+0x45/0x550 [11104.615601][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11104.615939][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11104.616214][ C1] ? rcu_read_lock_held+0xe/0x50 [11104.616476][ C1] ? __ip_finish_output+0x10f/0x770 [11104.616740][ C1] ip_output+0x16b/0x4f0 [11104.616957][ C1] ? run_timer_softirq+0x72/0x100 [11104.617217][ C1] ? __pfx_ip_output+0x10/0x10 [11104.617476][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11104.617765][ C1] ? rcu_read_lock_held+0xe/0x50 [11104.618017][ C1] ? ip_local_out+0x114/0x3b0 [11104.618259][ C1] __ip_queue_xmit+0x672/0x1910 [11104.618513][ C1] ? __create_object+0x5e/0xb0 [11104.618759][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11104.619027][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11104.619310][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11104.619589][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11104.619870][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11104.620143][ C1] tcp_delack_timer+0x84/0x240 [11104.620393][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11104.620666][ C1] call_timer_fn+0x173/0x430 [11104.620901][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11104.621162][ C1] ? next_expiry_recalc+0xcd/0x220 [11104.621446][ C1] __run_timers.part.0+0x52d/0x890 [11104.621725][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11104.621999][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11104.622283][ C1] ? lock_acquire+0x1c1/0x220 [11104.622528][ C1] ? clockevents_program_event+0xf6/0x300 [11104.622820][ C1] ? lock_release+0x1d5/0x250 [11104.623060][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11104.623327][ C1] ? ktime_get+0xb3/0x190 [11104.623558][ C1] ? clockevents_program_event+0x1ea/0x300 [11104.623854][ C1] run_timer_softirq+0x72/0x100 [11104.624104][ C1] __do_softirq+0x1b9/0x7ff [11104.624340][ C1] irq_exit_rcu+0x98/0xc0 [11104.624567][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11104.624856][ C1] [11104.625006][ C1] [11104.625156][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11104.625502][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11104.625842][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11104.626808][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11104.627119][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11104.627525][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11104.627924][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11104.628322][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11104.628723][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11104.629123][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11104.629421][ C1] pipe_read+0xa16/0xdf0 [11104.629642][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11104.629922][ C1] ? __pfx_pipe_read+0x10/0x10 [11104.630165][ C1] ? iterate_tty_write+0x299/0x540 [11104.630426][ C1] ? lock_release+0x1d5/0x250 [11104.630664][ C1] vfs_read+0x911/0xc00 [11104.630880][ C1] ? lock_acquire+0x1c1/0x220 [11104.631118][ C1] ? __might_fault+0xc6/0x180 [11104.631359][ C1] ? __pfx_vfs_read+0x10/0x10 [11104.631597][ C1] ? __might_fault+0xc6/0x180 [11104.631836][ C1] ? lock_release+0x1d5/0x250 [11104.632074][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11104.632339][ C1] ? __fget_light+0x54/0x1e0 [11104.632575][ C1] ksys_read+0x17a/0x1e0 [11104.632793][ C1] ? __pfx_ksys_read+0x10/0x10 [11104.633041][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11104.633350][ C1] do_syscall_64+0xc9/0x1e0 [11104.633584][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11104.633883][ C1] RIP: 0033:0x7f08a1ea38b2 [11104.634112][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11104.635082][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11104.635507][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11104.635905][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11104.636304][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11104.636702][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11104.637105][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11104.637512][ C1] [11104.637669][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8150s! [swapper/2:0] [11104.638099][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11104.639355][ C2] irq event stamp: 44114564 [11104.639584][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11104.640119][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11104.640630][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11104.641103][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11104.641574][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11104.642030][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11104.642640][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11104.642968][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11104.643942][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11104.644250][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11104.644649][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11104.645048][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11104.645448][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11104.645847][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11104.646248][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11104.646697][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11104.647035][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11104.647452][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11104.647852][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11104.648256][ C2] PKRU: 55555554 [11104.648436][ C2] Call Trace: [11104.648606][ C2] [11104.648755][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11104.649021][ C2] ? __run_hrtimer+0x1c0/0x710 [11104.649264][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11104.649547][ C2] ? __hrtimer_run_queues+0x197/0x270 [11104.649820][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11104.650107][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11104.650376][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11104.650679][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11104.650940][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11104.651206][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11104.651518][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11104.651817][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11104.652132][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11104.652424][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11104.652721][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11104.653009][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11104.653325][ C2] ? get_stack_info+0x36/0xc0 [11104.653568][ C2] ? lock_acquire+0x1c1/0x220 [11104.653810][ C2] ? lock_release+0x1d5/0x250 [11104.654053][ C2] do_raw_spin_lock+0x1ec/0x270 [11104.654301][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11104.654576][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11104.654861][ C2] ? lock_acquire+0x1c1/0x220 [11104.655100][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11104.655341][ C2] _raw_spin_lock_nested+0x65/0x80 [11104.655602][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11104.655835][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11104.656082][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11104.656339][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11104.656615][ C2] ip_local_deliver_finish+0x2ae/0x480 [11104.656895][ C2] ip_local_deliver+0x19d/0x480 [11104.657143][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11104.657421][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11104.657683][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11104.658030][ C2] ? rcu_read_lock_held+0xe/0x50 [11104.658285][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11104.658605][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11104.658867][ C2] ip_rcv+0x564/0x740 [11104.659072][ C2] ? __pfx_ip_rcv+0x10/0x10 [11104.659303][ C2] ? set_track_prepare+0x8a/0xd0 [11104.659556][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11104.659832][ C2] ? start_secondary+0x21c/0x2b0 [11104.660084][ C2] ? skb_clone+0x10b/0x330 [11104.660314][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11104.660634][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11104.660938][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11104.661222][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11104.661515][ C2] ? __tcf_classify+0x329/0x7d0 [11104.661764][ C2] ? __pfx_ip_rcv+0x10/0x10 [11104.661995][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11104.662296][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11104.662581][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11104.662906][ C2] ? lock_acquire+0x1c1/0x220 [11104.663148][ C2] ? netif_receive_skb_internal+0x84/0x300 [11104.663443][ C2] netif_receive_skb_internal+0xb0/0x300 [11104.663730][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11104.664046][ C2] ? __copy_skb_header+0xaf/0x490 [11104.664305][ C2] ? __skb_clone+0x57a/0x760 [11104.664538][ C2] netif_receive_skb+0x55/0x280 [11104.664785][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11104.665100][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11104.665431][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11104.665732][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11104.666006][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11104.666295][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11104.666604][ C2] ? get_stack_info+0x36/0xc0 [11104.666848][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11104.667113][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11104.667437][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11104.667713][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11104.667991][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11104.668307][ C2] ? kernel_text_address+0x17/0xe0 [11104.668567][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11104.668882][ C2] ? arch_stack_walk+0x8c/0x100 [11104.669132][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11104.669397][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11104.669680][ C2] ? lock_acquire+0x1c1/0x220 [11104.669920][ C2] ? stack_depot_save_flags+0x281/0x550 [11104.670200][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11104.670505][ C2] ? get_stack_info_noinstr+0x18/0x110 [11104.670781][ C2] ? get_stack_info+0x36/0xc0 [11104.671022][ C2] __tcf_classify+0x329/0x7d0 [11104.671266][ C2] tcf_classify+0x283/0x930 [11104.671499][ C2] ? __pfx_tcf_classify+0x10/0x10 [11104.671755][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11104.672067][ C2] tc_run+0x2e4/0x5d0 [11104.672274][ C2] ? __pfx_tc_run+0x10/0x10 [11104.672505][ C2] ? lock_acquire+0x1c1/0x220 [11104.672743][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11104.673004][ C2] __dev_queue_xmit+0x686/0x17e0 [11104.673258][ C2] ? lock_acquire+0x1c1/0x220 [11104.673496][ C2] ? ip_finish_output2+0x786/0x18e0 [11104.673761][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11104.674062][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11104.674342][ C2] ? neigh_hh_output+0x348/0x590 [11104.674594][ C2] ? ip_finish_output2+0x262/0x18e0 [11104.674859][ C2] ip_finish_output2+0x786/0x18e0 [11104.675118][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11104.675455][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11104.675730][ C2] ? rcu_read_lock_held+0xe/0x50 [11104.675984][ C2] ? __ip_finish_output+0x10f/0x770 [11104.676248][ C2] ip_output+0x16b/0x4f0 [11104.676467][ C2] ? __pfx_ip_output+0x10/0x10 [11104.676710][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11104.676986][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11104.677311][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11104.677588][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11104.677838][ C2] ? __alloc_skb+0xd4/0x280 [11104.678069][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11104.678340][ C2] ? tcp_fragment+0x168/0x1040 [11104.678584][ C2] ? rcu_read_lock_held+0xe/0x50 [11104.678836][ C2] ? ip_local_out+0x114/0x3b0 [11104.679074][ C2] __ip_queue_xmit+0x672/0x1910 [11104.679323][ C2] ? __skb_clone+0x57a/0x760 [11104.679560][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11104.679826][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11104.680104][ C2] ? ipv4_dst_check+0xe3/0x170 [11104.680351][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11104.680600][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11104.680903][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11104.681223][ C2] ? tcp_fragment+0xb0e/0x1040 [11104.681467][ C2] tcp_send_loss_probe+0x348/0x830 [11104.681727][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11104.681995][ C2] tcp_write_timer+0x82/0x1d0 [11104.682235][ C2] call_timer_fn+0x173/0x430 [11104.682470][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11104.682731][ C2] ? next_expiry_recalc+0xcd/0x220 [11104.682992][ C2] __run_timers.part.0+0x52d/0x890 [11104.683254][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11104.683525][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11104.683808][ C2] ? lock_acquire+0x1c1/0x220 [11104.684047][ C2] ? clockevents_program_event+0xf6/0x300 [11104.684336][ C2] ? lock_release+0x1d5/0x250 [11104.684576][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11104.684841][ C2] ? ktime_get+0xb3/0x190 [11104.685064][ C2] ? clockevents_program_event+0x1ea/0x300 [11104.685359][ C2] run_timer_softirq+0x72/0x100 [11104.685608][ C2] __do_softirq+0x1b9/0x7ff [11104.685842][ C2] irq_exit_rcu+0x98/0xc0 [11104.686062][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11104.686350][ C2] [11104.686500][ C2] [11104.686649][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11104.686955][ C2] RIP: 0010:default_idle+0xf/0x20 [11104.687212][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11104.688187][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11104.688495][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11104.688892][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11104.689292][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11104.689691][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11104.690092][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11104.690492][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11104.690787][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11104.691047][ C2] default_idle_call+0x69/0xa0 [11104.691293][ C2] cpuidle_idle_call+0x1f6/0x280 [11104.691544][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11104.691821][ C2] ? lock_release+0x1d5/0x250 [11104.692060][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11104.692334][ C2] do_idle+0xfb/0x160 [11104.692536][ C2] cpu_startup_entry+0x55/0x60 [11104.692779][ C2] start_secondary+0x21c/0x2b0 [11104.693027][ C2] ? __pfx_start_secondary+0x10/0x10 [11104.693297][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11104.693608][ C2] [11126.761104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11126.761485][ C1] rcu: 1-....: (8460549 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2044884 [11126.762048][ C1] rcu: (t=8771874 jiffies g=1882453 q=730 ncpus=4) [11126.762384][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11126.762831][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11126.763445][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11126.763778][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11126.764749][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11126.765058][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11126.765459][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11126.765857][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11126.766257][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11126.766657][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11126.767057][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11126.767513][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11126.767845][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11126.768245][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11126.768646][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11126.769050][ C1] PKRU: 55555554 [11126.769234][ C1] Call Trace: [11126.769403][ C1] [11126.769556][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11126.769833][ C1] ? print_cpu_stall+0x263/0x6a0 [11126.770087][ C1] ? check_cpu_stall+0x284/0x500 [11126.770340][ C1] ? rcu_pending+0x92/0x360 [11126.770570][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11126.770843][ C1] ? update_process_times+0xb9/0x110 [11126.771121][ C1] ? tick_sched_handle+0x67/0x130 [11126.771379][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11126.771664][ C1] ? __run_hrtimer+0x1c0/0x710 [11126.771911][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11126.772225][ C1] ? __hrtimer_run_queues+0x197/0x270 [11126.772498][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11126.772789][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11126.773055][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11126.773363][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11126.773636][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11126.773951][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11126.774251][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11126.774569][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11126.774858][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11126.775157][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11126.775446][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11126.775758][ C1] ? get_stack_info+0x36/0xc0 [11126.776001][ C1] ? lock_acquire+0x1c1/0x220 [11126.776244][ C1] ? lock_release+0x1d5/0x250 [11126.776485][ C1] do_raw_spin_lock+0x1ec/0x270 [11126.776734][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11126.777014][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11126.777307][ C1] ? lock_acquire+0x1c1/0x220 [11126.777546][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11126.777790][ C1] _raw_spin_lock_nested+0x65/0x80 [11126.778050][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11126.778285][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11126.778534][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11126.778794][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11126.779073][ C1] ip_local_deliver_finish+0x2ae/0x480 [11126.779352][ C1] ip_local_deliver+0x19d/0x480 [11126.779601][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11126.779876][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11126.780149][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11126.780495][ C1] ? rcu_read_lock_held+0xe/0x50 [11126.780749][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11126.781069][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11126.781333][ C1] ip_rcv+0x564/0x740 [11126.781538][ C1] ? __pfx_ip_rcv+0x10/0x10 [11126.781767][ C1] ? set_track_prepare+0x8a/0xd0 [11126.782021][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11126.782297][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11126.782572][ C1] ? skb_clone+0x10b/0x330 [11126.782798][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11126.783118][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11126.783425][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11126.783706][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11126.784002][ C1] ? __tcf_classify+0x329/0x7d0 [11126.784251][ C1] ? __pfx_ip_rcv+0x10/0x10 [11126.784480][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11126.784779][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11126.785064][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11126.785389][ C1] ? lock_acquire+0x1c1/0x220 [11126.785627][ C1] ? netif_receive_skb_internal+0x84/0x300 [11126.785924][ C1] netif_receive_skb_internal+0xb0/0x300 [11126.786208][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11126.786528][ C1] ? __copy_skb_header+0xaf/0x490 [11126.786784][ C1] ? __skb_clone+0x57a/0x760 [11126.787021][ C1] netif_receive_skb+0x55/0x280 [11126.787276][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11126.787588][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11126.787920][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11126.788215][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11126.788492][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11126.788780][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11126.789092][ C1] ? hlock_class+0x4e/0x130 [11126.789326][ C1] ? get_stack_info_noinstr+0x18/0x110 [11126.789604][ C1] ? get_stack_info_noinstr+0x18/0x110 [11126.789878][ C1] ? __pfx_validate_chain+0x10/0x10 [11126.790141][ C1] ? hlock_class+0x4e/0x130 [11126.790373][ C1] ? mark_lock+0x38/0x3e0 [11126.790591][ C1] ? stack_access_ok+0xda/0x1f0 [11126.790840][ C1] ? __lock_acquire+0xb67/0x1610 [11126.791092][ C1] ? get_stack_info_noinstr+0x18/0x110 [11126.791368][ C1] ? get_stack_info+0x36/0xc0 [11126.791609][ C1] ? stack_access_ok+0xda/0x1f0 [11126.791855][ C1] ? get_reg+0x119/0x190 [11126.792070][ C1] ? unwind_next_frame+0x12af/0x1d10 [11126.792340][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11126.792648][ C1] __tcf_classify+0x329/0x7d0 [11126.792891][ C1] tcf_classify+0x283/0x930 [11126.793123][ C1] ? arch_stack_walk+0xa2/0x100 [11126.793373][ C1] ? __pfx_tcf_classify+0x10/0x10 [11126.793629][ C1] ? get_stack_info+0x36/0xc0 [11126.793868][ C1] tc_run+0x2e4/0x5d0 [11126.794076][ C1] ? __pfx_tc_run+0x10/0x10 [11126.794307][ C1] ? lock_acquire+0x1c1/0x220 [11126.794551][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11126.794813][ C1] __dev_queue_xmit+0x686/0x17e0 [11126.795067][ C1] ? lock_acquire+0x1c1/0x220 [11126.795306][ C1] ? ip_finish_output2+0x786/0x18e0 [11126.795571][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11126.795878][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11126.796151][ C1] ? neigh_hh_output+0x348/0x590 [11126.796404][ C1] ? ip_finish_output2+0x262/0x18e0 [11126.796673][ C1] ip_finish_output2+0x786/0x18e0 [11126.796929][ C1] ? stack_depot_save_flags+0x45/0x550 [11126.797217][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11126.797552][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11126.797831][ C1] ? rcu_read_lock_held+0xe/0x50 [11126.798084][ C1] ? __ip_finish_output+0x10f/0x770 [11126.798351][ C1] ip_output+0x16b/0x4f0 [11126.798566][ C1] ? run_timer_softirq+0x72/0x100 [11126.798824][ C1] ? __pfx_ip_output+0x10/0x10 [11126.799067][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11126.799352][ C1] ? rcu_read_lock_held+0xe/0x50 [11126.799604][ C1] ? ip_local_out+0x114/0x3b0 [11126.799845][ C1] __ip_queue_xmit+0x672/0x1910 [11126.800094][ C1] ? __create_object+0x5e/0xb0 [11126.800340][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11126.800607][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11126.800885][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11126.801161][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11126.801443][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11126.801713][ C1] tcp_delack_timer+0x84/0x240 [11126.801957][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11126.802229][ C1] call_timer_fn+0x173/0x430 [11126.802465][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11126.802727][ C1] ? next_expiry_recalc+0xcd/0x220 [11126.802988][ C1] __run_timers.part.0+0x52d/0x890 [11126.803249][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11126.803520][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11126.803808][ C1] ? lock_acquire+0x1c1/0x220 [11126.804046][ C1] ? clockevents_program_event+0xf6/0x300 [11126.804338][ C1] ? lock_release+0x1d5/0x250 [11126.804578][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11126.804842][ C1] ? ktime_get+0xb3/0x190 [11126.805062][ C1] ? clockevents_program_event+0x1ea/0x300 [11126.805360][ C1] run_timer_softirq+0x72/0x100 [11126.805608][ C1] __do_softirq+0x1b9/0x7ff [11126.805841][ C1] irq_exit_rcu+0x98/0xc0 [11126.806063][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11126.806348][ C1] [11126.806500][ C1] [11126.806649][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11126.806955][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11126.807290][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11126.808255][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11126.808565][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11126.808962][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11126.809359][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11126.809758][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11126.810156][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11126.810555][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11126.810857][ C1] pipe_read+0xa16/0xdf0 [11126.811078][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11126.811356][ C1] ? __pfx_pipe_read+0x10/0x10 [11126.811601][ C1] ? iterate_tty_write+0x299/0x540 [11126.811862][ C1] ? lock_release+0x1d5/0x250 [11126.812104][ C1] vfs_read+0x911/0xc00 [11126.812318][ C1] ? lock_acquire+0x1c1/0x220 [11126.812559][ C1] ? __might_fault+0xc6/0x180 [11126.812802][ C1] ? __pfx_vfs_read+0x10/0x10 [11126.813041][ C1] ? __might_fault+0xc6/0x180 [11126.813279][ C1] ? lock_release+0x1d5/0x250 [11126.813520][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11126.813784][ C1] ? __fget_light+0x54/0x1e0 [11126.814023][ C1] ksys_read+0x17a/0x1e0 [11126.814240][ C1] ? __pfx_ksys_read+0x10/0x10 [11126.814486][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11126.814790][ C1] do_syscall_64+0xc9/0x1e0 [11126.815023][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11126.815323][ C1] RIP: 0033:0x7f08a1ea38b2 [11126.815552][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11126.816529][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11126.816950][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11126.817365][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11126.817764][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11126.818163][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11126.818561][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11126.818966][ C1] [11126.819131][ C1] Sending NMI from CPU 1 to CPUs 2: [11126.819413][ C2] NMI backtrace for cpu 2 [11126.819423][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11126.819429][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11126.819431][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11126.819438][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11126.819441][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11126.819445][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11126.819447][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11126.819449][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11126.819451][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11126.819452][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11126.819454][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11126.819456][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11126.819460][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11126.819461][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11126.819463][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11126.819464][ C2] PKRU: 55555554 [11126.819465][ C2] Call Trace: [11126.819468][ C2] [11126.819472][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11126.819479][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11126.819486][ C2] ? nmi_handle+0x153/0x420 [11126.819491][ C2] ? default_do_nmi+0x41/0x100 [11126.819494][ C2] ? exc_nmi+0xf3/0x120 [11126.819496][ C2] ? end_repeat_nmi+0xf/0x60 [11126.819502][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11126.819505][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11126.819508][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11126.819511][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11126.819514][ C2] [11126.819516][ C2] [11126.819517][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11126.819520][ C2] ? get_stack_info+0x36/0xc0 [11126.819524][ C2] ? lock_acquire+0x1c1/0x220 [11126.819528][ C2] ? lock_release+0x1d5/0x250 [11126.819531][ C2] do_raw_spin_lock+0x1ec/0x270 [11126.819536][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11126.819539][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11126.819542][ C2] ? lock_acquire+0x1c1/0x220 [11126.819545][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11126.819549][ C2] _raw_spin_lock_nested+0x65/0x80 [11126.819552][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11126.819559][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11126.819562][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11126.819566][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11126.819572][ C2] ip_local_deliver_finish+0x2ae/0x480 [11126.819576][ C2] ip_local_deliver+0x19d/0x480 [11126.819579][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11126.819581][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11126.819584][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11126.819590][ C2] ? rcu_read_lock_held+0xe/0x50 [11126.819593][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11126.819597][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11126.819606][ C2] ip_rcv+0x564/0x740 [11126.819608][ C2] ? __pfx_ip_rcv+0x10/0x10 [11126.819611][ C2] ? set_track_prepare+0x8a/0xd0 [11126.819615][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11126.819618][ C2] ? start_secondary+0x21c/0x2b0 [11126.819623][ C2] ? skb_clone+0x10b/0x330 [11126.819626][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11126.819632][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11126.819638][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11126.819642][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11126.819650][ C2] ? __tcf_classify+0x329/0x7d0 [11126.819654][ C2] ? __pfx_ip_rcv+0x10/0x10 [11126.819657][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11126.819660][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11126.819664][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11126.819668][ C2] ? lock_acquire+0x1c1/0x220 [11126.819670][ C2] ? netif_receive_skb_internal+0x84/0x300 [11126.819675][ C2] netif_receive_skb_internal+0xb0/0x300 [11126.819679][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11126.819683][ C2] ? __copy_skb_header+0xaf/0x490 [11126.819688][ C2] ? __skb_clone+0x57a/0x760 [11126.819690][ C2] netif_receive_skb+0x55/0x280 [11126.819694][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11126.819701][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11126.819708][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11126.819714][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11126.819719][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11126.819729][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11126.819736][ C2] ? get_stack_info+0x36/0xc0 [11126.819741][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11126.819745][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11126.819751][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11126.819753][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11126.819758][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11126.819760][ C2] ? kernel_text_address+0x17/0xe0 [11126.819764][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11126.819770][ C2] ? arch_stack_walk+0x8c/0x100 [11126.819773][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11126.819777][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11126.819780][ C2] ? lock_acquire+0x1c1/0x220 [11126.819782][ C2] ? stack_depot_save_flags+0x281/0x550 [11126.819787][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11126.819791][ C2] ? get_stack_info_noinstr+0x18/0x110 [11126.819794][ C2] ? get_stack_info+0x36/0xc0 [11126.819798][ C2] __tcf_classify+0x329/0x7d0 [11126.819804][ C2] tcf_classify+0x283/0x930 [11126.819808][ C2] ? __pfx_tcf_classify+0x10/0x10 [11126.819812][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11126.819816][ C2] tc_run+0x2e4/0x5d0 [11126.819820][ C2] ? __pfx_tc_run+0x10/0x10 [11126.819823][ C2] ? lock_acquire+0x1c1/0x220 [11126.819826][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11126.819830][ C2] __dev_queue_xmit+0x686/0x17e0 [11126.819834][ C2] ? lock_acquire+0x1c1/0x220 [11126.819836][ C2] ? ip_finish_output2+0x786/0x18e0 [11126.819840][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11126.819843][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11126.819846][ C2] ? neigh_hh_output+0x348/0x590 [11126.819850][ C2] ? ip_finish_output2+0x262/0x18e0 [11126.819854][ C2] ip_finish_output2+0x786/0x18e0 [11126.819857][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11126.819865][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11126.819868][ C2] ? rcu_read_lock_held+0xe/0x50 [11126.819872][ C2] ? __ip_finish_output+0x10f/0x770 [11126.819875][ C2] ip_output+0x16b/0x4f0 [11126.819879][ C2] ? __pfx_ip_output+0x10/0x10 [11126.819881][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11126.819884][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11126.819888][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11126.819891][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11126.819894][ C2] ? __alloc_skb+0xd4/0x280 [11126.819896][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11126.819901][ C2] ? tcp_fragment+0x168/0x1040 [11126.819904][ C2] ? rcu_read_lock_held+0xe/0x50 [11126.819907][ C2] ? ip_local_out+0x114/0x3b0 [11126.819911][ C2] __ip_queue_xmit+0x672/0x1910 [11126.819915][ C2] ? __skb_clone+0x57a/0x760 [11126.819918][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11126.819923][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11126.819926][ C2] ? ipv4_dst_check+0xe3/0x170 [11126.819931][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11126.819936][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11126.819941][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11126.819944][ C2] ? tcp_fragment+0xb0e/0x1040 [11126.819947][ C2] tcp_send_loss_probe+0x348/0x830 [11126.819951][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11126.819953][ C2] tcp_write_timer+0x82/0x1d0 [11126.819957][ C2] call_timer_fn+0x173/0x430 [11126.819961][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11126.819966][ C2] ? next_expiry_recalc+0xcd/0x220 [11126.819970][ C2] __run_timers.part.0+0x52d/0x890 [11126.819973][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11126.819978][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11126.819981][ C2] ? lock_acquire+0x1c1/0x220 [11126.819983][ C2] ? clockevents_program_event+0xf6/0x300 [11126.819987][ C2] ? lock_release+0x1d5/0x250 [11126.819990][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11126.819993][ C2] ? ktime_get+0xb3/0x190 [11126.819996][ C2] ? clockevents_program_event+0x1ea/0x300 [11126.820000][ C2] run_timer_softirq+0x72/0x100 [11126.820004][ C2] __do_softirq+0x1b9/0x7ff [11126.820008][ C2] irq_exit_rcu+0x98/0xc0 [11126.820011][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11126.820014][ C2] [11126.820015][ C2] [11126.820016][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11126.820019][ C2] RIP: 0010:default_idle+0xf/0x20 [11126.820023][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11126.820025][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11126.820028][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11126.820030][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11126.820031][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11126.820033][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11126.820035][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11126.820038][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11126.820041][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11126.820046][ C2] default_idle_call+0x69/0xa0 [11126.820049][ C2] cpuidle_idle_call+0x1f6/0x280 [11126.820052][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11126.820056][ C2] ? lock_release+0x1d5/0x250 [11126.820059][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11126.820063][ C2] do_idle+0xfb/0x160 [11126.820066][ C2] cpu_startup_entry+0x55/0x60 [11126.820069][ C2] start_secondary+0x21c/0x2b0 [11126.820073][ C2] ? __pfx_start_secondary+0x10/0x10 [11126.820077][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11126.820084][ C2] [11152.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8195s! [perl:4135] [11152.569712][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11152.570977][ C1] irq event stamp: 209232 [11152.571199][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11152.571731][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11152.572211][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11152.572682][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11152.573148][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11152.573598][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11152.574211][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11152.574538][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11152.575512][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11152.575819][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11152.576223][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11152.576622][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11152.577021][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11152.577428][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11152.577830][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11152.578279][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11152.578612][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11152.579011][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11152.579415][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11152.579815][ C1] PKRU: 55555554 [11152.579996][ C1] Call Trace: [11152.580168][ C1] [11152.580319][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11152.580582][ C1] ? __run_hrtimer+0x1c0/0x710 [11152.580826][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11152.581105][ C1] ? __hrtimer_run_queues+0x197/0x270 [11152.581378][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11152.581666][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11152.581934][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11152.582240][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11152.582503][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11152.582812][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11152.583111][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11152.583428][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11152.583716][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11152.584011][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11152.584300][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11152.584613][ C1] ? get_stack_info+0x36/0xc0 [11152.584855][ C1] ? lock_acquire+0x1c1/0x220 [11152.585097][ C1] ? lock_release+0x1d5/0x250 [11152.585337][ C1] do_raw_spin_lock+0x1ec/0x270 [11152.585585][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11152.585859][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11152.586145][ C1] ? lock_acquire+0x1c1/0x220 [11152.586384][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11152.586627][ C1] _raw_spin_lock_nested+0x65/0x80 [11152.586887][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11152.587129][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11152.587377][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11152.587636][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11152.587914][ C1] ip_local_deliver_finish+0x2ae/0x480 [11152.588196][ C1] ip_local_deliver+0x19d/0x480 [11152.588442][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11152.588713][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11152.588977][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11152.589325][ C1] ? rcu_read_lock_held+0xe/0x50 [11152.589579][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11152.589903][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11152.590167][ C1] ip_rcv+0x564/0x740 [11152.590371][ C1] ? __pfx_ip_rcv+0x10/0x10 [11152.590602][ C1] ? set_track_prepare+0x8a/0xd0 [11152.590863][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11152.591140][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11152.591415][ C1] ? skb_clone+0x10b/0x330 [11152.591642][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11152.591962][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11152.592269][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11152.592550][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11152.592846][ C1] ? __tcf_classify+0x329/0x7d0 [11152.593096][ C1] ? __pfx_ip_rcv+0x10/0x10 [11152.593327][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11152.593628][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11152.593916][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11152.594243][ C1] ? lock_acquire+0x1c1/0x220 [11152.594484][ C1] ? netif_receive_skb_internal+0x84/0x300 [11152.594784][ C1] netif_receive_skb_internal+0xb0/0x300 [11152.595070][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11152.595387][ C1] ? __copy_skb_header+0xaf/0x490 [11152.595645][ C1] ? __skb_clone+0x57a/0x760 [11152.595881][ C1] netif_receive_skb+0x55/0x280 [11152.596130][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11152.596442][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11152.596776][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11152.597079][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11152.597355][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11152.597644][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11152.597957][ C1] ? hlock_class+0x4e/0x130 [11152.598189][ C1] ? get_stack_info_noinstr+0x18/0x110 [11152.598467][ C1] ? get_stack_info_noinstr+0x18/0x110 [11152.598742][ C1] ? __pfx_validate_chain+0x10/0x10 [11152.599006][ C1] ? hlock_class+0x4e/0x130 [11152.599239][ C1] ? mark_lock+0x38/0x3e0 [11152.599458][ C1] ? stack_access_ok+0xda/0x1f0 [11152.599708][ C1] ? __lock_acquire+0xb67/0x1610 [11152.599962][ C1] ? get_stack_info_noinstr+0x18/0x110 [11152.600239][ C1] ? get_stack_info+0x36/0xc0 [11152.600480][ C1] ? stack_access_ok+0xda/0x1f0 [11152.600727][ C1] ? get_reg+0x119/0x190 [11152.600943][ C1] ? unwind_next_frame+0x12af/0x1d10 [11152.601212][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11152.601521][ C1] __tcf_classify+0x329/0x7d0 [11152.601764][ C1] tcf_classify+0x283/0x930 [11152.601997][ C1] ? arch_stack_walk+0xa2/0x100 [11152.602246][ C1] ? __pfx_tcf_classify+0x10/0x10 [11152.602503][ C1] ? get_stack_info+0x36/0xc0 [11152.602744][ C1] tc_run+0x2e4/0x5d0 [11152.602951][ C1] ? __pfx_tc_run+0x10/0x10 [11152.603182][ C1] ? lock_acquire+0x1c1/0x220 [11152.603423][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11152.603684][ C1] __dev_queue_xmit+0x686/0x17e0 [11152.603937][ C1] ? lock_acquire+0x1c1/0x220 [11152.604177][ C1] ? ip_finish_output2+0x786/0x18e0 [11152.604443][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11152.604748][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11152.605022][ C1] ? neigh_hh_output+0x348/0x590 [11152.605281][ C1] ? ip_finish_output2+0x262/0x18e0 [11152.605546][ C1] ip_finish_output2+0x786/0x18e0 [11152.605802][ C1] ? stack_depot_save_flags+0x45/0x550 [11152.606081][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11152.606417][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11152.606695][ C1] ? rcu_read_lock_held+0xe/0x50 [11152.606946][ C1] ? __ip_finish_output+0x10f/0x770 [11152.607219][ C1] ip_output+0x16b/0x4f0 [11152.607434][ C1] ? run_timer_softirq+0x72/0x100 [11152.607693][ C1] ? __pfx_ip_output+0x10/0x10 [11152.607936][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11152.608223][ C1] ? rcu_read_lock_held+0xe/0x50 [11152.608475][ C1] ? ip_local_out+0x114/0x3b0 [11152.608717][ C1] __ip_queue_xmit+0x672/0x1910 [11152.608967][ C1] ? __create_object+0x5e/0xb0 [11152.609212][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11152.609484][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11152.609765][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11152.610037][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11152.610322][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11152.610594][ C1] tcp_delack_timer+0x84/0x240 [11152.610839][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11152.611112][ C1] call_timer_fn+0x173/0x430 [11152.611349][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11152.611611][ C1] ? next_expiry_recalc+0xcd/0x220 [11152.611874][ C1] __run_timers.part.0+0x52d/0x890 [11152.612135][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11152.612408][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11152.612694][ C1] ? lock_acquire+0x1c1/0x220 [11152.612930][ C1] ? clockevents_program_event+0xf6/0x300 [11152.613225][ C1] ? lock_release+0x1d5/0x250 [11152.613465][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11152.613730][ C1] ? ktime_get+0xb3/0x190 [11152.613950][ C1] ? clockevents_program_event+0x1ea/0x300 [11152.614250][ C1] run_timer_softirq+0x72/0x100 [11152.614498][ C1] __do_softirq+0x1b9/0x7ff [11152.614730][ C1] irq_exit_rcu+0x98/0xc0 [11152.614953][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11152.615240][ C1] [11152.615392][ C1] [11152.615542][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11152.615848][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11152.616181][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11152.617161][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11152.617470][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11152.617869][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11152.618269][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11152.618667][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11152.619069][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11152.619476][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11152.619773][ C1] pipe_read+0xa16/0xdf0 [11152.619995][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11152.620275][ C1] ? __pfx_pipe_read+0x10/0x10 [11152.620518][ C1] ? iterate_tty_write+0x299/0x540 [11152.620782][ C1] ? lock_release+0x1d5/0x250 [11152.621024][ C1] vfs_read+0x911/0xc00 [11152.621239][ C1] ? lock_acquire+0x1c1/0x220 [11152.621479][ C1] ? __might_fault+0xc6/0x180 [11152.621722][ C1] ? __pfx_vfs_read+0x10/0x10 [11152.621961][ C1] ? __might_fault+0xc6/0x180 [11152.622201][ C1] ? lock_release+0x1d5/0x250 [11152.622443][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11152.622708][ C1] ? __fget_light+0x54/0x1e0 [11152.622948][ C1] ksys_read+0x17a/0x1e0 [11152.623165][ C1] ? __pfx_ksys_read+0x10/0x10 [11152.623410][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11152.623716][ C1] do_syscall_64+0xc9/0x1e0 [11152.623947][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11152.624249][ C1] RIP: 0033:0x7f08a1ea38b2 [11152.624480][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11152.625450][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11152.625871][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11152.626272][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11152.626671][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11152.627073][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11152.627472][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11152.627875][ C1] [11152.628034][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8195s! [swapper/2:0] [11152.628467][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11152.629727][ C2] irq event stamp: 44114564 [11152.629958][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11152.630508][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11152.631022][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11152.631501][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11152.631972][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11152.632433][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11152.633046][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11152.633374][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11152.634358][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11152.634668][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11152.635067][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11152.635475][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11152.635876][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11152.636277][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11152.636677][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11152.637137][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11152.637474][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11152.637876][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11152.638274][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11152.638677][ C2] PKRU: 55555554 [11152.638856][ C2] Call Trace: [11152.639029][ C2] [11152.639177][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11152.639446][ C2] ? __run_hrtimer+0x1c0/0x710 [11152.639689][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11152.639969][ C2] ? __hrtimer_run_queues+0x197/0x270 [11152.640243][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11152.640534][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11152.640802][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11152.641111][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11152.641373][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11152.641635][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11152.641949][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11152.642249][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11152.642564][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11152.642853][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11152.643152][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11152.643441][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11152.643753][ C2] ? get_stack_info+0x36/0xc0 [11152.643995][ C2] ? lock_acquire+0x1c1/0x220 [11152.644246][ C2] ? lock_release+0x1d5/0x250 [11152.644485][ C2] do_raw_spin_lock+0x1ec/0x270 [11152.644736][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11152.645014][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11152.645302][ C2] ? lock_acquire+0x1c1/0x220 [11152.645543][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11152.645785][ C2] _raw_spin_lock_nested+0x65/0x80 [11152.646047][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11152.646284][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11152.646532][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11152.646791][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11152.647077][ C2] ip_local_deliver_finish+0x2ae/0x480 [11152.647358][ C2] ip_local_deliver+0x19d/0x480 [11152.647606][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11152.647879][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11152.648145][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11152.648497][ C2] ? rcu_read_lock_held+0xe/0x50 [11152.648750][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11152.649072][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11152.649337][ C2] ip_rcv+0x564/0x740 [11152.649541][ C2] ? __pfx_ip_rcv+0x10/0x10 [11152.649773][ C2] ? set_track_prepare+0x8a/0xd0 [11152.650028][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11152.650305][ C2] ? start_secondary+0x21c/0x2b0 [11152.650559][ C2] ? skb_clone+0x10b/0x330 [11152.650789][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11152.651111][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11152.651417][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11152.651710][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11152.652004][ C2] ? __tcf_classify+0x329/0x7d0 [11152.652256][ C2] ? __pfx_ip_rcv+0x10/0x10 [11152.652488][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11152.652790][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11152.653085][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11152.653414][ C2] ? lock_acquire+0x1c1/0x220 [11152.653654][ C2] ? netif_receive_skb_internal+0x84/0x300 [11152.653949][ C2] netif_receive_skb_internal+0xb0/0x300 [11152.654240][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11152.654559][ C2] ? __copy_skb_header+0xaf/0x490 [11152.654818][ C2] ? __skb_clone+0x57a/0x760 [11152.655052][ C2] netif_receive_skb+0x55/0x280 [11152.655305][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11152.655629][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11152.655960][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11152.656262][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11152.656538][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11152.656828][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11152.657151][ C2] ? get_stack_info+0x36/0xc0 [11152.657396][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11152.657661][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11152.657981][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11152.658258][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11152.658539][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11152.658855][ C2] ? kernel_text_address+0x17/0xe0 [11152.659117][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11152.659433][ C2] ? arch_stack_walk+0x8c/0x100 [11152.659681][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11152.659955][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11152.660239][ C2] ? lock_acquire+0x1c1/0x220 [11152.660480][ C2] ? stack_depot_save_flags+0x281/0x550 [11152.660761][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11152.661067][ C2] ? get_stack_info_noinstr+0x18/0x110 [11152.661345][ C2] ? get_stack_info+0x36/0xc0 [11152.661587][ C2] __tcf_classify+0x329/0x7d0 [11152.661831][ C2] tcf_classify+0x283/0x930 [11152.662063][ C2] ? __pfx_tcf_classify+0x10/0x10 [11152.662321][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11152.662635][ C2] tc_run+0x2e4/0x5d0 [11152.662841][ C2] ? __pfx_tc_run+0x10/0x10 [11152.663073][ C2] ? lock_acquire+0x1c1/0x220 [11152.663315][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11152.663579][ C2] __dev_queue_xmit+0x686/0x17e0 [11152.663833][ C2] ? lock_acquire+0x1c1/0x220 [11152.664071][ C2] ? ip_finish_output2+0x786/0x18e0 [11152.664339][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11152.664641][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11152.664916][ C2] ? neigh_hh_output+0x348/0x590 [11152.665175][ C2] ? ip_finish_output2+0x262/0x18e0 [11152.665442][ C2] ip_finish_output2+0x786/0x18e0 [11152.665700][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11152.666040][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11152.666321][ C2] ? rcu_read_lock_held+0xe/0x50 [11152.666576][ C2] ? __ip_finish_output+0x10f/0x770 [11152.666841][ C2] ip_output+0x16b/0x4f0 [11152.667067][ C2] ? __pfx_ip_output+0x10/0x10 [11152.667311][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11152.667590][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11152.667904][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11152.668182][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11152.668435][ C2] ? __alloc_skb+0xd4/0x280 [11152.668667][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11152.668939][ C2] ? tcp_fragment+0x168/0x1040 [11152.669183][ C2] ? rcu_read_lock_held+0xe/0x50 [11152.669439][ C2] ? ip_local_out+0x114/0x3b0 [11152.669680][ C2] __ip_queue_xmit+0x672/0x1910 [11152.669929][ C2] ? __skb_clone+0x57a/0x760 [11152.670167][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11152.670435][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11152.670716][ C2] ? ipv4_dst_check+0xe3/0x170 [11152.670961][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11152.671213][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11152.671515][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11152.671836][ C2] ? tcp_fragment+0xb0e/0x1040 [11152.672084][ C2] tcp_send_loss_probe+0x348/0x830 [11152.672347][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11152.672617][ C2] tcp_write_timer+0x82/0x1d0 [11152.672858][ C2] call_timer_fn+0x173/0x430 [11152.673095][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11152.673359][ C2] ? next_expiry_recalc+0xcd/0x220 [11152.673621][ C2] __run_timers.part.0+0x52d/0x890 [11152.673881][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11152.674153][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11152.674438][ C2] ? lock_acquire+0x1c1/0x220 [11152.674678][ C2] ? clockevents_program_event+0xf6/0x300 [11152.674972][ C2] ? lock_release+0x1d5/0x250 [11152.675215][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11152.675483][ C2] ? ktime_get+0xb3/0x190 [11152.675711][ C2] ? clockevents_program_event+0x1ea/0x300 [11152.676007][ C2] run_timer_softirq+0x72/0x100 [11152.676257][ C2] __do_softirq+0x1b9/0x7ff [11152.676497][ C2] irq_exit_rcu+0x98/0xc0 [11152.676717][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11152.677006][ C2] [11152.677167][ C2] [11152.677317][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11152.677623][ C2] RIP: 0010:default_idle+0xf/0x20 [11152.677881][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11152.678853][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11152.679164][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11152.679563][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11152.679961][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11152.680361][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11152.680759][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11152.681159][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11152.681449][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11152.681711][ C2] default_idle_call+0x69/0xa0 [11152.681955][ C2] cpuidle_idle_call+0x1f6/0x280 [11152.682206][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11152.682484][ C2] ? lock_release+0x1d5/0x250 [11152.682723][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11152.683008][ C2] do_idle+0xfb/0x160 [11152.683215][ C2] cpu_startup_entry+0x55/0x60 [11152.683460][ C2] start_secondary+0x21c/0x2b0 [11152.683706][ C2] ? __pfx_start_secondary+0x10/0x10 [11152.683975][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11152.684288][ C2] [11180.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8221s! [perl:4135] [11180.569712][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11180.570973][ C1] irq event stamp: 209232 [11180.571194][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11180.571728][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11180.572206][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11180.572679][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11180.573145][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11180.573595][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11180.574210][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11180.574538][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11180.575514][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11180.575822][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11180.576225][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11180.576624][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11180.577030][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11180.577430][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11180.577833][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11180.578283][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11180.578616][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11180.579018][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11180.579418][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11180.579820][ C1] PKRU: 55555554 [11180.580003][ C1] Call Trace: [11180.580174][ C1] [11180.580325][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11180.580590][ C1] ? __run_hrtimer+0x1c0/0x710 [11180.580834][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11180.581113][ C1] ? __hrtimer_run_queues+0x197/0x270 [11180.581386][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11180.581674][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11180.581943][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11180.582250][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11180.582514][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11180.582825][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11180.583125][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11180.583441][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11180.583729][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11180.584026][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11180.584315][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11180.584629][ C1] ? get_stack_info+0x36/0xc0 [11180.584871][ C1] ? lock_acquire+0x1c1/0x220 [11180.585116][ C1] ? lock_release+0x1d5/0x250 [11180.585356][ C1] do_raw_spin_lock+0x1ec/0x270 [11180.585605][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11180.585881][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11180.586168][ C1] ? lock_acquire+0x1c1/0x220 [11180.586408][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11180.586651][ C1] _raw_spin_lock_nested+0x65/0x80 [11180.586918][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11180.587182][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11180.587435][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11180.587694][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11180.587975][ C1] ip_local_deliver_finish+0x2ae/0x480 [11180.588256][ C1] ip_local_deliver+0x19d/0x480 [11180.588509][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11180.588786][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11180.589050][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11180.589400][ C1] ? rcu_read_lock_held+0xe/0x50 [11180.589657][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11180.589977][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11180.590244][ C1] ip_rcv+0x564/0x740 [11180.590452][ C1] ? __pfx_ip_rcv+0x10/0x10 [11180.590683][ C1] ? set_track_prepare+0x8a/0xd0 [11180.590939][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11180.591216][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11180.591492][ C1] ? skb_clone+0x10b/0x330 [11180.591724][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11180.592046][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11180.592353][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11180.592637][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11180.592934][ C1] ? __tcf_classify+0x329/0x7d0 [11180.593185][ C1] ? __pfx_ip_rcv+0x10/0x10 [11180.593414][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11180.593716][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11180.594002][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11180.594330][ C1] ? lock_acquire+0x1c1/0x220 [11180.594573][ C1] ? netif_receive_skb_internal+0x84/0x300 [11180.594870][ C1] netif_receive_skb_internal+0xb0/0x300 [11180.595157][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11180.595474][ C1] ? __copy_skb_header+0xaf/0x490 [11180.595734][ C1] ? __skb_clone+0x57a/0x760 [11180.595971][ C1] netif_receive_skb+0x55/0x280 [11180.596221][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11180.596534][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11180.596868][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11180.597176][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11180.597453][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11180.597741][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11180.598054][ C1] ? hlock_class+0x4e/0x130 [11180.598288][ C1] ? get_stack_info_noinstr+0x18/0x110 [11180.598566][ C1] ? get_stack_info_noinstr+0x18/0x110 [11180.598842][ C1] ? __pfx_validate_chain+0x10/0x10 [11180.599106][ C1] ? hlock_class+0x4e/0x130 [11180.599339][ C1] ? mark_lock+0x38/0x3e0 [11180.599558][ C1] ? stack_access_ok+0xda/0x1f0 [11180.599808][ C1] ? __lock_acquire+0xb67/0x1610 [11180.600066][ C1] ? get_stack_info_noinstr+0x18/0x110 [11180.600342][ C1] ? get_stack_info+0x36/0xc0 [11180.600584][ C1] ? stack_access_ok+0xda/0x1f0 [11180.600831][ C1] ? get_reg+0x119/0x190 [11180.601046][ C1] ? unwind_next_frame+0x12af/0x1d10 [11180.601317][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11180.601625][ C1] __tcf_classify+0x329/0x7d0 [11180.601868][ C1] tcf_classify+0x283/0x930 [11180.602102][ C1] ? arch_stack_walk+0xa2/0x100 [11180.602353][ C1] ? __pfx_tcf_classify+0x10/0x10 [11180.602610][ C1] ? get_stack_info+0x36/0xc0 [11180.602850][ C1] tc_run+0x2e4/0x5d0 [11180.603059][ C1] ? __pfx_tc_run+0x10/0x10 [11180.603290][ C1] ? lock_acquire+0x1c1/0x220 [11180.603529][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11180.603791][ C1] __dev_queue_xmit+0x686/0x17e0 [11180.604045][ C1] ? lock_acquire+0x1c1/0x220 [11180.604285][ C1] ? ip_finish_output2+0x786/0x18e0 [11180.604551][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11180.604859][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11180.605133][ C1] ? neigh_hh_output+0x348/0x590 [11180.605387][ C1] ? ip_finish_output2+0x262/0x18e0 [11180.605653][ C1] ip_finish_output2+0x786/0x18e0 [11180.605910][ C1] ? stack_depot_save_flags+0x45/0x550 [11180.606190][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11180.606528][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11180.606812][ C1] ? rcu_read_lock_held+0xe/0x50 [11180.607070][ C1] ? __ip_finish_output+0x10f/0x770 [11180.607337][ C1] ip_output+0x16b/0x4f0 [11180.607553][ C1] ? run_timer_softirq+0x72/0x100 [11180.607811][ C1] ? __pfx_ip_output+0x10/0x10 [11180.608056][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11180.608342][ C1] ? rcu_read_lock_held+0xe/0x50 [11180.608595][ C1] ? ip_local_out+0x114/0x3b0 [11180.608839][ C1] __ip_queue_xmit+0x672/0x1910 [11180.609089][ C1] ? __create_object+0x5e/0xb0 [11180.609335][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11180.609606][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11180.609886][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11180.610161][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11180.610444][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11180.610716][ C1] tcp_delack_timer+0x84/0x240 [11180.610960][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11180.611232][ C1] call_timer_fn+0x173/0x430 [11180.611472][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11180.611734][ C1] ? next_expiry_recalc+0xcd/0x220 [11180.611996][ C1] __run_timers.part.0+0x52d/0x890 [11180.612258][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11180.612531][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11180.612817][ C1] ? lock_acquire+0x1c1/0x220 [11180.613056][ C1] ? clockevents_program_event+0xf6/0x300 [11180.613351][ C1] ? lock_release+0x1d5/0x250 [11180.613593][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11180.613858][ C1] ? ktime_get+0xb3/0x190 [11180.614078][ C1] ? clockevents_program_event+0x1ea/0x300 [11180.614376][ C1] run_timer_softirq+0x72/0x100 [11180.614625][ C1] __do_softirq+0x1b9/0x7ff [11180.614858][ C1] irq_exit_rcu+0x98/0xc0 [11180.615079][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11180.615366][ C1] [11180.615518][ C1] [11180.615667][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11180.615974][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11180.616300][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11180.617276][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11180.617586][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11180.617984][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11180.618384][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11180.618784][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11180.619184][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11180.619585][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11180.619884][ C1] pipe_read+0xa16/0xdf0 [11180.620105][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11180.620383][ C1] ? __pfx_pipe_read+0x10/0x10 [11180.620628][ C1] ? iterate_tty_write+0x299/0x540 [11180.620889][ C1] ? lock_release+0x1d5/0x250 [11180.621132][ C1] vfs_read+0x911/0xc00 [11180.621346][ C1] ? lock_acquire+0x1c1/0x220 [11180.621585][ C1] ? __might_fault+0xc6/0x180 [11180.621828][ C1] ? __pfx_vfs_read+0x10/0x10 [11180.622068][ C1] ? __might_fault+0xc6/0x180 [11180.622306][ C1] ? lock_release+0x1d5/0x250 [11180.622547][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11180.622811][ C1] ? __fget_light+0x54/0x1e0 [11180.623051][ C1] ksys_read+0x17a/0x1e0 [11180.623269][ C1] ? __pfx_ksys_read+0x10/0x10 [11180.623514][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11180.623820][ C1] do_syscall_64+0xc9/0x1e0 [11180.624053][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11180.624359][ C1] RIP: 0033:0x7f08a1ea38b2 [11180.624588][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11180.625571][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11180.625992][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11180.626394][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11180.626798][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11180.627204][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11180.627602][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11180.628008][ C1] [11180.628174][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8221s! [swapper/2:0] [11180.628600][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11180.629865][ C2] irq event stamp: 44114564 [11180.630096][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11180.630633][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11180.631147][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11180.631623][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11180.632096][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11180.632560][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11180.633173][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11180.633500][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11180.634477][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11180.634786][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11180.635189][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11180.635592][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11180.635995][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11180.636395][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11180.636799][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11180.637258][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11180.637594][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11180.637996][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11180.638395][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11180.638798][ C2] PKRU: 55555554 [11180.638979][ C2] Call Trace: [11180.639150][ C2] [11180.639298][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11180.639562][ C2] ? __run_hrtimer+0x1c0/0x710 [11180.639803][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11180.640082][ C2] ? __hrtimer_run_queues+0x197/0x270 [11180.640355][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11180.640643][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11180.640910][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11180.641215][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11180.641477][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11180.641743][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11180.642052][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11180.642351][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11180.642667][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11180.642956][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11180.643254][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11180.643543][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11180.643857][ C2] ? get_stack_info+0x36/0xc0 [11180.644099][ C2] ? lock_acquire+0x1c1/0x220 [11180.644342][ C2] ? lock_release+0x1d5/0x250 [11180.644581][ C2] do_raw_spin_lock+0x1ec/0x270 [11180.644828][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11180.645105][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11180.645390][ C2] ? lock_acquire+0x1c1/0x220 [11180.645629][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11180.645872][ C2] _raw_spin_lock_nested+0x65/0x80 [11180.646140][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11180.646375][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11180.646623][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11180.646882][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11180.647163][ C2] ip_local_deliver_finish+0x2ae/0x480 [11180.647444][ C2] ip_local_deliver+0x19d/0x480 [11180.647692][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11180.647964][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11180.648228][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11180.648574][ C2] ? rcu_read_lock_held+0xe/0x50 [11180.648827][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11180.649148][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11180.649412][ C2] ip_rcv+0x564/0x740 [11180.649617][ C2] ? __pfx_ip_rcv+0x10/0x10 [11180.649849][ C2] ? set_track_prepare+0x8a/0xd0 [11180.650105][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11180.650381][ C2] ? start_secondary+0x21c/0x2b0 [11180.650634][ C2] ? skb_clone+0x10b/0x330 [11180.650873][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11180.651195][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11180.651502][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11180.651785][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11180.652078][ C2] ? __tcf_classify+0x329/0x7d0 [11180.652329][ C2] ? __pfx_ip_rcv+0x10/0x10 [11180.652563][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11180.652865][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11180.653153][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11180.653479][ C2] ? lock_acquire+0x1c1/0x220 [11180.653720][ C2] ? netif_receive_skb_internal+0x84/0x300 [11180.654017][ C2] netif_receive_skb_internal+0xb0/0x300 [11180.654304][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11180.654623][ C2] ? __copy_skb_header+0xaf/0x490 [11180.654882][ C2] ? __skb_clone+0x57a/0x760 [11180.655116][ C2] netif_receive_skb+0x55/0x280 [11180.655364][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11180.655677][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11180.656009][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11180.656311][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11180.656586][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11180.656877][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11180.657201][ C2] ? get_stack_info+0x36/0xc0 [11180.657446][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11180.657715][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11180.658035][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11180.658314][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11180.658593][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11180.658909][ C2] ? kernel_text_address+0x17/0xe0 [11180.659173][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11180.659488][ C2] ? arch_stack_walk+0x8c/0x100 [11180.659738][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11180.660005][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11180.660290][ C2] ? lock_acquire+0x1c1/0x220 [11180.660531][ C2] ? stack_depot_save_flags+0x281/0x550 [11180.660813][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11180.661119][ C2] ? get_stack_info_noinstr+0x18/0x110 [11180.661396][ C2] ? get_stack_info+0x36/0xc0 [11180.661640][ C2] __tcf_classify+0x329/0x7d0 [11180.661885][ C2] tcf_classify+0x283/0x930 [11180.662119][ C2] ? __pfx_tcf_classify+0x10/0x10 [11180.662375][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11180.662688][ C2] tc_run+0x2e4/0x5d0 [11180.662896][ C2] ? __pfx_tc_run+0x10/0x10 [11180.663128][ C2] ? lock_acquire+0x1c1/0x220 [11180.663368][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11180.663630][ C2] __dev_queue_xmit+0x686/0x17e0 [11180.663884][ C2] ? lock_acquire+0x1c1/0x220 [11180.664125][ C2] ? ip_finish_output2+0x786/0x18e0 [11180.664392][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11180.664695][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11180.664973][ C2] ? neigh_hh_output+0x348/0x590 [11180.665228][ C2] ? ip_finish_output2+0x262/0x18e0 [11180.665494][ C2] ip_finish_output2+0x786/0x18e0 [11180.665752][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11180.666092][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11180.666369][ C2] ? rcu_read_lock_held+0xe/0x50 [11180.666623][ C2] ? __ip_finish_output+0x10f/0x770 [11180.666888][ C2] ip_output+0x16b/0x4f0 [11180.667118][ C2] ? __pfx_ip_output+0x10/0x10 [11180.667361][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11180.667640][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11180.667955][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11180.668232][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11180.668486][ C2] ? __alloc_skb+0xd4/0x280 [11180.668720][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11180.668991][ C2] ? tcp_fragment+0x168/0x1040 [11180.669236][ C2] ? rcu_read_lock_held+0xe/0x50 [11180.669489][ C2] ? ip_local_out+0x114/0x3b0 [11180.669727][ C2] __ip_queue_xmit+0x672/0x1910 [11180.669976][ C2] ? __skb_clone+0x57a/0x760 [11180.670213][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11180.670481][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11180.670762][ C2] ? ipv4_dst_check+0xe3/0x170 [11180.671007][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11180.671258][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11180.671559][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11180.671881][ C2] ? tcp_fragment+0xb0e/0x1040 [11180.672126][ C2] tcp_send_loss_probe+0x348/0x830 [11180.672387][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11180.672657][ C2] tcp_write_timer+0x82/0x1d0 [11180.672899][ C2] call_timer_fn+0x173/0x430 [11180.673136][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11180.673398][ C2] ? next_expiry_recalc+0xcd/0x220 [11180.673660][ C2] __run_timers.part.0+0x52d/0x890 [11180.673922][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11180.674195][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11180.674479][ C2] ? lock_acquire+0x1c1/0x220 [11180.674720][ C2] ? clockevents_program_event+0xf6/0x300 [11180.675009][ C2] ? lock_release+0x1d5/0x250 [11180.675251][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11180.675518][ C2] ? ktime_get+0xb3/0x190 [11180.675742][ C2] ? clockevents_program_event+0x1ea/0x300 [11180.676037][ C2] run_timer_softirq+0x72/0x100 [11180.676288][ C2] __do_softirq+0x1b9/0x7ff [11180.676523][ C2] irq_exit_rcu+0x98/0xc0 [11180.676743][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11180.677048][ C2] [11180.677199][ C2] [11180.677350][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11180.677654][ C2] RIP: 0010:default_idle+0xf/0x20 [11180.677913][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11180.678886][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11180.679196][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11180.679595][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11180.679998][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11180.680397][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11180.680796][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11180.681205][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11180.681497][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11180.681760][ C2] default_idle_call+0x69/0xa0 [11180.682010][ C2] cpuidle_idle_call+0x1f6/0x280 [11180.682263][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11180.682541][ C2] ? lock_release+0x1d5/0x250 [11180.682783][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11180.683057][ C2] do_idle+0xfb/0x160 [11180.683262][ C2] cpu_startup_entry+0x55/0x60 [11180.683505][ C2] start_secondary+0x21c/0x2b0 [11180.683751][ C2] ? __pfx_start_secondary+0x10/0x10 [11180.684021][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11180.684335][ C2] [11204.819104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11204.819482][ C1] rcu: 1-....: (8538434 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2064271 [11204.820052][ C1] rcu: (t=8849932 jiffies g=1882453 q=730 ncpus=4) [11204.820391][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11204.820844][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11204.821463][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12b/0xb90 [11204.821793][ C1] Code: 24 80 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc 90 e9 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 [11204.822770][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11204.823082][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11204.823483][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11204.823886][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11204.824290][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11204.824691][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11204.825092][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11204.825543][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11204.825879][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11204.826283][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11204.826682][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11204.827089][ C1] PKRU: 55555554 [11204.827272][ C1] Call Trace: [11204.827445][ C1] [11204.827594][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11204.827872][ C1] ? print_cpu_stall+0x263/0x6a0 [11204.828124][ C1] ? check_cpu_stall+0x284/0x500 [11204.828376][ C1] ? rcu_pending+0x92/0x360 [11204.828609][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11204.828880][ C1] ? update_process_times+0xb9/0x110 [11204.829150][ C1] ? tick_sched_handle+0x67/0x130 [11204.829409][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11204.829696][ C1] ? __run_hrtimer+0x1c0/0x710 [11204.829940][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11204.830258][ C1] ? __hrtimer_run_queues+0x197/0x270 [11204.830535][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11204.830823][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11204.831089][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11204.831397][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11204.831660][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11204.831970][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11204.832268][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11204.832584][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11204.832874][ C1] ? queued_spin_lock_slowpath+0x12b/0xb90 [11204.833171][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11204.833460][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11204.833772][ C1] ? get_stack_info+0x36/0xc0 [11204.834017][ C1] ? lock_acquire+0x1c1/0x220 [11204.834258][ C1] ? lock_release+0x1d5/0x250 [11204.834497][ C1] do_raw_spin_lock+0x1ec/0x270 [11204.834747][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11204.835019][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11204.835308][ C1] ? lock_acquire+0x1c1/0x220 [11204.835547][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11204.835788][ C1] _raw_spin_lock_nested+0x65/0x80 [11204.836048][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11204.836284][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11204.836532][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11204.836799][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11204.837077][ C1] ip_local_deliver_finish+0x2ae/0x480 [11204.837356][ C1] ip_local_deliver+0x19d/0x480 [11204.837604][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11204.837883][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11204.838147][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11204.838496][ C1] ? rcu_read_lock_held+0xe/0x50 [11204.838751][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11204.839070][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11204.839335][ C1] ip_rcv+0x564/0x740 [11204.839541][ C1] ? __pfx_ip_rcv+0x10/0x10 [11204.839773][ C1] ? set_track_prepare+0x8a/0xd0 [11204.840028][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11204.840309][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11204.840582][ C1] ? skb_clone+0x10b/0x330 [11204.840813][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11204.841135][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11204.841443][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11204.841728][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11204.842023][ C1] ? __tcf_classify+0x329/0x7d0 [11204.842273][ C1] ? __pfx_ip_rcv+0x10/0x10 [11204.842507][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11204.842808][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11204.843094][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11204.843420][ C1] ? lock_acquire+0x1c1/0x220 [11204.843660][ C1] ? netif_receive_skb_internal+0x84/0x300 [11204.843957][ C1] netif_receive_skb_internal+0xb0/0x300 [11204.844245][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11204.844563][ C1] ? __copy_skb_header+0xaf/0x490 [11204.844825][ C1] ? __skb_clone+0x57a/0x760 [11204.845060][ C1] netif_receive_skb+0x55/0x280 [11204.845309][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11204.845623][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11204.845956][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11204.846262][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11204.846536][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11204.846837][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11204.847149][ C1] ? hlock_class+0x4e/0x130 [11204.847385][ C1] ? get_stack_info_noinstr+0x18/0x110 [11204.847661][ C1] ? get_stack_info_noinstr+0x18/0x110 [11204.847940][ C1] ? __pfx_validate_chain+0x10/0x10 [11204.848205][ C1] ? hlock_class+0x4e/0x130 [11204.848436][ C1] ? mark_lock+0x38/0x3e0 [11204.848659][ C1] ? stack_access_ok+0xda/0x1f0 [11204.848910][ C1] ? __lock_acquire+0xb67/0x1610 [11204.849165][ C1] ? get_stack_info_noinstr+0x18/0x110 [11204.849442][ C1] ? get_stack_info+0x36/0xc0 [11204.849685][ C1] ? stack_access_ok+0xda/0x1f0 [11204.849932][ C1] ? get_reg+0x119/0x190 [11204.850149][ C1] ? unwind_next_frame+0x12af/0x1d10 [11204.850418][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11204.850730][ C1] __tcf_classify+0x329/0x7d0 [11204.850974][ C1] tcf_classify+0x283/0x930 [11204.851204][ C1] ? arch_stack_walk+0xa2/0x100 [11204.851454][ C1] ? __pfx_tcf_classify+0x10/0x10 [11204.851713][ C1] ? get_stack_info+0x36/0xc0 [11204.851960][ C1] tc_run+0x2e4/0x5d0 [11204.852166][ C1] ? __pfx_tc_run+0x10/0x10 [11204.852399][ C1] ? lock_acquire+0x1c1/0x220 [11204.852638][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11204.852900][ C1] __dev_queue_xmit+0x686/0x17e0 [11204.853154][ C1] ? lock_acquire+0x1c1/0x220 [11204.853392][ C1] ? ip_finish_output2+0x786/0x18e0 [11204.853659][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11204.853966][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11204.854238][ C1] ? neigh_hh_output+0x348/0x590 [11204.854491][ C1] ? ip_finish_output2+0x262/0x18e0 [11204.854758][ C1] ip_finish_output2+0x786/0x18e0 [11204.855014][ C1] ? stack_depot_save_flags+0x45/0x550 [11204.855295][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11204.855634][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11204.855910][ C1] ? rcu_read_lock_held+0xe/0x50 [11204.856164][ C1] ? __ip_finish_output+0x10f/0x770 [11204.856429][ C1] ip_output+0x16b/0x4f0 [11204.856648][ C1] ? run_timer_softirq+0x72/0x100 [11204.856914][ C1] ? __pfx_ip_output+0x10/0x10 [11204.857159][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11204.857446][ C1] ? rcu_read_lock_held+0xe/0x50 [11204.857700][ C1] ? ip_local_out+0x114/0x3b0 [11204.857942][ C1] __ip_queue_xmit+0x672/0x1910 [11204.858193][ C1] ? __create_object+0x5e/0xb0 [11204.858437][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11204.858705][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11204.858989][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11204.859262][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11204.859545][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11204.859819][ C1] tcp_delack_timer+0x84/0x240 [11204.860063][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11204.860336][ C1] call_timer_fn+0x173/0x430 [11204.860573][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11204.860836][ C1] ? next_expiry_recalc+0xcd/0x220 [11204.861098][ C1] __run_timers.part.0+0x52d/0x890 [11204.861360][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11204.861633][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11204.861918][ C1] ? lock_acquire+0x1c1/0x220 [11204.862159][ C1] ? clockevents_program_event+0xf6/0x300 [11204.862452][ C1] ? lock_release+0x1d5/0x250 [11204.862689][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11204.862957][ C1] ? ktime_get+0xb3/0x190 [11204.863180][ C1] ? clockevents_program_event+0x1ea/0x300 [11204.863478][ C1] run_timer_softirq+0x72/0x100 [11204.863726][ C1] __do_softirq+0x1b9/0x7ff [11204.863961][ C1] irq_exit_rcu+0x98/0xc0 [11204.864183][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11204.864470][ C1] [11204.864620][ C1] [11204.864773][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11204.865079][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11204.865405][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11204.866380][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11204.866689][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11204.867099][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11204.867499][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11204.867902][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11204.868303][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11204.868706][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11204.869001][ C1] pipe_read+0xa16/0xdf0 [11204.869225][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11204.869503][ C1] ? __pfx_pipe_read+0x10/0x10 [11204.869748][ C1] ? iterate_tty_write+0x299/0x540 [11204.870010][ C1] ? lock_release+0x1d5/0x250 [11204.870252][ C1] vfs_read+0x911/0xc00 [11204.870467][ C1] ? lock_acquire+0x1c1/0x220 [11204.870710][ C1] ? __might_fault+0xc6/0x180 [11204.870951][ C1] ? __pfx_vfs_read+0x10/0x10 [11204.871191][ C1] ? __might_fault+0xc6/0x180 [11204.871433][ C1] ? lock_release+0x1d5/0x250 [11204.871674][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11204.871940][ C1] ? __fget_light+0x54/0x1e0 [11204.872179][ C1] ksys_read+0x17a/0x1e0 [11204.872398][ C1] ? __pfx_ksys_read+0x10/0x10 [11204.872645][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11204.872949][ C1] do_syscall_64+0xc9/0x1e0 [11204.873182][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11204.873484][ C1] RIP: 0033:0x7f08a1ea38b2 [11204.873712][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11204.874687][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11204.875110][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11204.875510][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11204.875910][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11204.876312][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11204.876712][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11204.877121][ C1] [11204.877282][ C1] Sending NMI from CPU 1 to CPUs 2: [11204.877556][ C2] NMI backtrace for cpu 2 [11204.877564][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11204.877570][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11204.877574][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11204.877584][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11204.877590][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11204.877595][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11204.877599][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11204.877603][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11204.877607][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11204.877611][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11204.877615][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11204.877620][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11204.877626][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11204.877628][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11204.877629][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11204.877630][ C2] PKRU: 55555554 [11204.877631][ C2] Call Trace: [11204.877634][ C2] [11204.877637][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11204.877645][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11204.877651][ C2] ? nmi_handle+0x153/0x420 [11204.877656][ C2] ? default_do_nmi+0x41/0x100 [11204.877659][ C2] ? exc_nmi+0xf3/0x120 [11204.877662][ C2] ? end_repeat_nmi+0xf/0x60 [11204.877667][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11204.877670][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11204.877673][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11204.877677][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11204.877679][ C2] [11204.877681][ C2] [11204.877682][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11204.877685][ C2] ? get_stack_info+0x36/0xc0 [11204.877689][ C2] ? lock_acquire+0x1c1/0x220 [11204.877693][ C2] ? lock_release+0x1d5/0x250 [11204.877696][ C2] do_raw_spin_lock+0x1ec/0x270 [11204.877700][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11204.877703][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11204.877706][ C2] ? lock_acquire+0x1c1/0x220 [11204.877708][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11204.877712][ C2] _raw_spin_lock_nested+0x65/0x80 [11204.877715][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11204.877721][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11204.877724][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11204.877729][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11204.877735][ C2] ip_local_deliver_finish+0x2ae/0x480 [11204.877738][ C2] ip_local_deliver+0x19d/0x480 [11204.877741][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11204.877743][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11204.877745][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11204.877751][ C2] ? rcu_read_lock_held+0xe/0x50 [11204.877756][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11204.877759][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11204.877768][ C2] ip_rcv+0x564/0x740 [11204.877771][ C2] ? __pfx_ip_rcv+0x10/0x10 [11204.877774][ C2] ? set_track_prepare+0x8a/0xd0 [11204.877778][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11204.877782][ C2] ? start_secondary+0x21c/0x2b0 [11204.877786][ C2] ? skb_clone+0x10b/0x330 [11204.877789][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11204.877795][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11204.877800][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11204.877804][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11204.877812][ C2] ? __tcf_classify+0x329/0x7d0 [11204.877816][ C2] ? __pfx_ip_rcv+0x10/0x10 [11204.877819][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11204.877823][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11204.877827][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11204.877831][ C2] ? lock_acquire+0x1c1/0x220 [11204.877833][ C2] ? netif_receive_skb_internal+0x84/0x300 [11204.877838][ C2] netif_receive_skb_internal+0xb0/0x300 [11204.877841][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11204.877845][ C2] ? __copy_skb_header+0xaf/0x490 [11204.877849][ C2] ? __skb_clone+0x57a/0x760 [11204.877851][ C2] netif_receive_skb+0x55/0x280 [11204.877854][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11204.877862][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11204.877868][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11204.877875][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11204.877879][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11204.877889][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11204.877896][ C2] ? get_stack_info+0x36/0xc0 [11204.877901][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11204.877904][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11204.877909][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11204.877911][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11204.877915][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11204.877917][ C2] ? kernel_text_address+0x17/0xe0 [11204.877921][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11204.877925][ C2] ? arch_stack_walk+0x8c/0x100 [11204.877928][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11204.877932][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11204.877935][ C2] ? lock_acquire+0x1c1/0x220 [11204.877938][ C2] ? stack_depot_save_flags+0x281/0x550 [11204.877942][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11204.877946][ C2] ? get_stack_info_noinstr+0x18/0x110 [11204.877949][ C2] ? get_stack_info+0x36/0xc0 [11204.877954][ C2] __tcf_classify+0x329/0x7d0 [11204.877959][ C2] tcf_classify+0x283/0x930 [11204.877963][ C2] ? __pfx_tcf_classify+0x10/0x10 [11204.877967][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11204.877971][ C2] tc_run+0x2e4/0x5d0 [11204.877976][ C2] ? __pfx_tc_run+0x10/0x10 [11204.877979][ C2] ? lock_acquire+0x1c1/0x220 [11204.877981][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11204.877985][ C2] __dev_queue_xmit+0x686/0x17e0 [11204.877989][ C2] ? lock_acquire+0x1c1/0x220 [11204.877991][ C2] ? ip_finish_output2+0x786/0x18e0 [11204.877995][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11204.877998][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11204.878001][ C2] ? neigh_hh_output+0x348/0x590 [11204.878004][ C2] ? ip_finish_output2+0x262/0x18e0 [11204.878008][ C2] ip_finish_output2+0x786/0x18e0 [11204.878012][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11204.878019][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11204.878022][ C2] ? rcu_read_lock_held+0xe/0x50 [11204.878026][ C2] ? __ip_finish_output+0x10f/0x770 [11204.878030][ C2] ip_output+0x16b/0x4f0 [11204.878033][ C2] ? __pfx_ip_output+0x10/0x10 [11204.878036][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11204.878039][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11204.878042][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11204.878046][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11204.878049][ C2] ? __alloc_skb+0xd4/0x280 [11204.878051][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11204.878056][ C2] ? tcp_fragment+0x168/0x1040 [11204.878059][ C2] ? rcu_read_lock_held+0xe/0x50 [11204.878062][ C2] ? ip_local_out+0x114/0x3b0 [11204.878066][ C2] __ip_queue_xmit+0x672/0x1910 [11204.878069][ C2] ? __skb_clone+0x57a/0x760 [11204.878072][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11204.878078][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11204.878081][ C2] ? ipv4_dst_check+0xe3/0x170 [11204.878085][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11204.878091][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11204.878095][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11204.878098][ C2] ? tcp_fragment+0xb0e/0x1040 [11204.878101][ C2] tcp_send_loss_probe+0x348/0x830 [11204.878105][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11204.878108][ C2] tcp_write_timer+0x82/0x1d0 [11204.878111][ C2] call_timer_fn+0x173/0x430 [11204.878115][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11204.878120][ C2] ? next_expiry_recalc+0xcd/0x220 [11204.878123][ C2] __run_timers.part.0+0x52d/0x890 [11204.878126][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11204.878131][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11204.878134][ C2] ? lock_acquire+0x1c1/0x220 [11204.878136][ C2] ? clockevents_program_event+0xf6/0x300 [11204.878139][ C2] ? lock_release+0x1d5/0x250 [11204.878142][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11204.878145][ C2] ? ktime_get+0xb3/0x190 [11204.878148][ C2] ? clockevents_program_event+0x1ea/0x300 [11204.878152][ C2] run_timer_softirq+0x72/0x100 [11204.878155][ C2] __do_softirq+0x1b9/0x7ff [11204.878160][ C2] irq_exit_rcu+0x98/0xc0 [11204.878162][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11204.878166][ C2] [11204.878167][ C2] [11204.878168][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11204.878171][ C2] RIP: 0010:default_idle+0xf/0x20 [11204.878175][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11204.878177][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11204.878179][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11204.878181][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11204.878183][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11204.878184][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11204.878186][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11204.878189][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11204.878192][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11204.878196][ C2] default_idle_call+0x69/0xa0 [11204.878199][ C2] cpuidle_idle_call+0x1f6/0x280 [11204.878202][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11204.878206][ C2] ? lock_release+0x1d5/0x250 [11204.878209][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11204.878213][ C2] do_idle+0xfb/0x160 [11204.878215][ C2] cpu_startup_entry+0x55/0x60 [11204.878218][ C2] start_secondary+0x21c/0x2b0 [11204.878221][ C2] ? __pfx_start_secondary+0x10/0x10 [11204.878225][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11204.878232][ C2] [11232.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8270s! [perl:4135] [11232.569709][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11232.570973][ C1] irq event stamp: 209232 [11232.571194][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11232.571730][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11232.572209][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11232.572677][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11232.573146][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11232.573602][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11232.574217][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11232.574542][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11232.575515][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11232.575824][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11232.576224][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11232.576626][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11232.577034][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11232.577435][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11232.577835][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11232.578282][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11232.578618][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11232.579020][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11232.579420][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11232.579821][ C1] PKRU: 55555554 [11232.580002][ C1] Call Trace: [11232.580175][ C1] [11232.580325][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11232.580588][ C1] ? __run_hrtimer+0x1c0/0x710 [11232.580834][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11232.581112][ C1] ? __hrtimer_run_queues+0x197/0x270 [11232.581386][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11232.581673][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11232.581940][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11232.582250][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11232.582512][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11232.582824][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11232.583123][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11232.583440][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11232.583730][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11232.584027][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11232.584317][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11232.584628][ C1] ? get_stack_info+0x36/0xc0 [11232.584871][ C1] ? lock_acquire+0x1c1/0x220 [11232.585112][ C1] ? lock_release+0x1d5/0x250 [11232.585352][ C1] do_raw_spin_lock+0x1ec/0x270 [11232.585603][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11232.585875][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11232.586163][ C1] ? lock_acquire+0x1c1/0x220 [11232.586402][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11232.586649][ C1] _raw_spin_lock_nested+0x65/0x80 [11232.586912][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11232.587149][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11232.587396][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11232.587655][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11232.587935][ C1] ip_local_deliver_finish+0x2ae/0x480 [11232.588214][ C1] ip_local_deliver+0x19d/0x480 [11232.588461][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11232.588735][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11232.589000][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11232.589351][ C1] ? rcu_read_lock_held+0xe/0x50 [11232.589605][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11232.589924][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11232.590189][ C1] ip_rcv+0x564/0x740 [11232.590394][ C1] ? __pfx_ip_rcv+0x10/0x10 [11232.590627][ C1] ? set_track_prepare+0x8a/0xd0 [11232.590885][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11232.591161][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11232.591433][ C1] ? skb_clone+0x10b/0x330 [11232.591664][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11232.591984][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11232.592291][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11232.592573][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11232.592867][ C1] ? __tcf_classify+0x329/0x7d0 [11232.593115][ C1] ? __pfx_ip_rcv+0x10/0x10 [11232.593347][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11232.593648][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11232.593933][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11232.594258][ C1] ? lock_acquire+0x1c1/0x220 [11232.594496][ C1] ? netif_receive_skb_internal+0x84/0x300 [11232.594793][ C1] netif_receive_skb_internal+0xb0/0x300 [11232.595078][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11232.595397][ C1] ? __copy_skb_header+0xaf/0x490 [11232.595657][ C1] ? __skb_clone+0x57a/0x760 [11232.595898][ C1] netif_receive_skb+0x55/0x280 [11232.596146][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11232.596458][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11232.596803][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11232.597102][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11232.597376][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11232.597667][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11232.597978][ C1] ? hlock_class+0x4e/0x130 [11232.598211][ C1] ? get_stack_info_noinstr+0x18/0x110 [11232.598487][ C1] ? get_stack_info_noinstr+0x18/0x110 [11232.598764][ C1] ? __pfx_validate_chain+0x10/0x10 [11232.599028][ C1] ? hlock_class+0x4e/0x130 [11232.599259][ C1] ? mark_lock+0x38/0x3e0 [11232.599479][ C1] ? stack_access_ok+0xda/0x1f0 [11232.599730][ C1] ? __lock_acquire+0xb67/0x1610 [11232.599985][ C1] ? get_stack_info_noinstr+0x18/0x110 [11232.600265][ C1] ? get_stack_info+0x36/0xc0 [11232.600506][ C1] ? stack_access_ok+0xda/0x1f0 [11232.600758][ C1] ? get_reg+0x119/0x190 [11232.600974][ C1] ? unwind_next_frame+0x12af/0x1d10 [11232.601242][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11232.601553][ C1] __tcf_classify+0x329/0x7d0 [11232.601795][ C1] tcf_classify+0x283/0x930 [11232.602026][ C1] ? arch_stack_walk+0xa2/0x100 [11232.602276][ C1] ? __pfx_tcf_classify+0x10/0x10 [11232.602533][ C1] ? get_stack_info+0x36/0xc0 [11232.602775][ C1] tc_run+0x2e4/0x5d0 [11232.602980][ C1] ? __pfx_tc_run+0x10/0x10 [11232.603214][ C1] ? lock_acquire+0x1c1/0x220 [11232.603454][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11232.603715][ C1] __dev_queue_xmit+0x686/0x17e0 [11232.603968][ C1] ? lock_acquire+0x1c1/0x220 [11232.604206][ C1] ? ip_finish_output2+0x786/0x18e0 [11232.604473][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11232.604779][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11232.605051][ C1] ? neigh_hh_output+0x348/0x590 [11232.605304][ C1] ? ip_finish_output2+0x262/0x18e0 [11232.605570][ C1] ip_finish_output2+0x786/0x18e0 [11232.605827][ C1] ? stack_depot_save_flags+0x45/0x550 [11232.606107][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11232.606443][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11232.606726][ C1] ? rcu_read_lock_held+0xe/0x50 [11232.606981][ C1] ? __ip_finish_output+0x10f/0x770 [11232.607247][ C1] ip_output+0x16b/0x4f0 [11232.607466][ C1] ? run_timer_softirq+0x72/0x100 [11232.607724][ C1] ? __pfx_ip_output+0x10/0x10 [11232.607967][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11232.608253][ C1] ? rcu_read_lock_held+0xe/0x50 [11232.608505][ C1] ? ip_local_out+0x114/0x3b0 [11232.608747][ C1] __ip_queue_xmit+0x672/0x1910 [11232.608996][ C1] ? __create_object+0x5e/0xb0 [11232.609240][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11232.609509][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11232.609791][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11232.610062][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11232.610346][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11232.610618][ C1] tcp_delack_timer+0x84/0x240 [11232.610863][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11232.611135][ C1] call_timer_fn+0x173/0x430 [11232.611372][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11232.611634][ C1] ? next_expiry_recalc+0xcd/0x220 [11232.611896][ C1] __run_timers.part.0+0x52d/0x890 [11232.612158][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11232.612432][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11232.612717][ C1] ? lock_acquire+0x1c1/0x220 [11232.612956][ C1] ? clockevents_program_event+0xf6/0x300 [11232.613250][ C1] ? lock_release+0x1d5/0x250 [11232.613488][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11232.613755][ C1] ? ktime_get+0xb3/0x190 [11232.613977][ C1] ? clockevents_program_event+0x1ea/0x300 [11232.614275][ C1] run_timer_softirq+0x72/0x100 [11232.614523][ C1] __do_softirq+0x1b9/0x7ff [11232.614756][ C1] irq_exit_rcu+0x98/0xc0 [11232.614978][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11232.615265][ C1] [11232.615415][ C1] [11232.615569][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11232.615876][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11232.616204][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11232.617186][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11232.617494][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11232.617896][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11232.618297][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11232.618695][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11232.619095][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11232.619500][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11232.619795][ C1] pipe_read+0xa16/0xdf0 [11232.620019][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11232.620299][ C1] ? __pfx_pipe_read+0x10/0x10 [11232.620547][ C1] ? iterate_tty_write+0x299/0x540 [11232.620810][ C1] ? lock_release+0x1d5/0x250 [11232.621051][ C1] vfs_read+0x911/0xc00 [11232.621267][ C1] ? lock_acquire+0x1c1/0x220 [11232.621507][ C1] ? __might_fault+0xc6/0x180 [11232.621749][ C1] ? __pfx_vfs_read+0x10/0x10 [11232.621987][ C1] ? __might_fault+0xc6/0x180 [11232.622229][ C1] ? lock_release+0x1d5/0x250 [11232.622470][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11232.622736][ C1] ? __fget_light+0x54/0x1e0 [11232.622974][ C1] ksys_read+0x17a/0x1e0 [11232.623193][ C1] ? __pfx_ksys_read+0x10/0x10 [11232.623439][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11232.623743][ C1] do_syscall_64+0xc9/0x1e0 [11232.623977][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11232.624278][ C1] RIP: 0033:0x7f08a1ea38b2 [11232.624506][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11232.625479][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11232.625900][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11232.626298][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11232.626713][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11232.627112][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11232.627511][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11232.627913][ C1] [11232.628078][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8270s! [swapper/2:0] [11232.628511][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11232.629780][ C2] irq event stamp: 44114564 [11232.630007][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11232.630550][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11232.631064][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11232.631543][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11232.632013][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11232.632470][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11232.633083][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11232.633408][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11232.634392][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11232.634706][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11232.635101][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11232.635502][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11232.635899][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11232.636297][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11232.636703][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11232.637147][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11232.637481][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11232.637883][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11232.638292][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11232.638693][ C2] PKRU: 55555554 [11232.638875][ C2] Call Trace: [11232.639047][ C2] [11232.639196][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11232.639461][ C2] ? __run_hrtimer+0x1c0/0x710 [11232.639707][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11232.639984][ C2] ? __hrtimer_run_queues+0x197/0x270 [11232.640261][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11232.640548][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11232.640813][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11232.641123][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11232.641385][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11232.641647][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11232.641958][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11232.642256][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11232.642581][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11232.642870][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11232.643166][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11232.643453][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11232.643764][ C2] ? get_stack_info+0x36/0xc0 [11232.644005][ C2] ? lock_acquire+0x1c1/0x220 [11232.644247][ C2] ? lock_release+0x1d5/0x250 [11232.644486][ C2] do_raw_spin_lock+0x1ec/0x270 [11232.644741][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11232.645013][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11232.645302][ C2] ? lock_acquire+0x1c1/0x220 [11232.645541][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11232.645780][ C2] _raw_spin_lock_nested+0x65/0x80 [11232.646044][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11232.646279][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11232.646528][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11232.646796][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11232.647071][ C2] ip_local_deliver_finish+0x2ae/0x480 [11232.647349][ C2] ip_local_deliver+0x19d/0x480 [11232.647596][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11232.647872][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11232.648138][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11232.648486][ C2] ? rcu_read_lock_held+0xe/0x50 [11232.648745][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11232.649065][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11232.649330][ C2] ip_rcv+0x564/0x740 [11232.649535][ C2] ? __pfx_ip_rcv+0x10/0x10 [11232.649767][ C2] ? set_track_prepare+0x8a/0xd0 [11232.650021][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11232.650299][ C2] ? start_secondary+0x21c/0x2b0 [11232.650551][ C2] ? skb_clone+0x10b/0x330 [11232.650779][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11232.651099][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11232.651403][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11232.651685][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11232.651979][ C2] ? __tcf_classify+0x329/0x7d0 [11232.652228][ C2] ? __pfx_ip_rcv+0x10/0x10 [11232.652470][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11232.652770][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11232.653058][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11232.653384][ C2] ? lock_acquire+0x1c1/0x220 [11232.653624][ C2] ? netif_receive_skb_internal+0x84/0x300 [11232.653919][ C2] netif_receive_skb_internal+0xb0/0x300 [11232.654208][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11232.654526][ C2] ? __copy_skb_header+0xaf/0x490 [11232.654785][ C2] ? __skb_clone+0x57a/0x760 [11232.655018][ C2] netif_receive_skb+0x55/0x280 [11232.655268][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11232.655582][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11232.655914][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11232.656216][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11232.656493][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11232.656798][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11232.657110][ C2] ? get_stack_info+0x36/0xc0 [11232.657354][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11232.657619][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11232.657937][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11232.658214][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11232.658494][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11232.658808][ C2] ? kernel_text_address+0x17/0xe0 [11232.659069][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11232.659384][ C2] ? arch_stack_walk+0x8c/0x100 [11232.659632][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11232.659899][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11232.660191][ C2] ? lock_acquire+0x1c1/0x220 [11232.660431][ C2] ? stack_depot_save_flags+0x281/0x550 [11232.660720][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11232.661025][ C2] ? get_stack_info_noinstr+0x18/0x110 [11232.661304][ C2] ? get_stack_info+0x36/0xc0 [11232.661546][ C2] __tcf_classify+0x329/0x7d0 [11232.661791][ C2] tcf_classify+0x283/0x930 [11232.662023][ C2] ? __pfx_tcf_classify+0x10/0x10 [11232.662279][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11232.662591][ C2] tc_run+0x2e4/0x5d0 [11232.662796][ C2] ? __pfx_tc_run+0x10/0x10 [11232.663028][ C2] ? lock_acquire+0x1c1/0x220 [11232.663268][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11232.663529][ C2] __dev_queue_xmit+0x686/0x17e0 [11232.663781][ C2] ? lock_acquire+0x1c1/0x220 [11232.664018][ C2] ? ip_finish_output2+0x786/0x18e0 [11232.664285][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11232.664598][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11232.664874][ C2] ? neigh_hh_output+0x348/0x590 [11232.665137][ C2] ? ip_finish_output2+0x262/0x18e0 [11232.665403][ C2] ip_finish_output2+0x786/0x18e0 [11232.665660][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11232.665998][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11232.666273][ C2] ? rcu_read_lock_held+0xe/0x50 [11232.666526][ C2] ? __ip_finish_output+0x10f/0x770 [11232.666804][ C2] ip_output+0x16b/0x4f0 [11232.667022][ C2] ? __pfx_ip_output+0x10/0x10 [11232.667265][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11232.667544][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11232.667858][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11232.668135][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11232.668387][ C2] ? __alloc_skb+0xd4/0x280 [11232.668617][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11232.668888][ C2] ? tcp_fragment+0x168/0x1040 [11232.669131][ C2] ? rcu_read_lock_held+0xe/0x50 [11232.669397][ C2] ? ip_local_out+0x114/0x3b0 [11232.669636][ C2] __ip_queue_xmit+0x672/0x1910 [11232.669883][ C2] ? __skb_clone+0x57a/0x760 [11232.670119][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11232.670385][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11232.670665][ C2] ? ipv4_dst_check+0xe3/0x170 [11232.670910][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11232.671161][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11232.671462][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11232.671782][ C2] ? tcp_fragment+0xb0e/0x1040 [11232.672027][ C2] tcp_send_loss_probe+0x348/0x830 [11232.672288][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11232.672557][ C2] tcp_write_timer+0x82/0x1d0 [11232.672796][ C2] call_timer_fn+0x173/0x430 [11232.673033][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11232.673293][ C2] ? next_expiry_recalc+0xcd/0x220 [11232.673552][ C2] __run_timers.part.0+0x52d/0x890 [11232.673812][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11232.674081][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11232.674365][ C2] ? lock_acquire+0x1c1/0x220 [11232.674605][ C2] ? clockevents_program_event+0xf6/0x300 [11232.674893][ C2] ? lock_release+0x1d5/0x250 [11232.675132][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11232.675398][ C2] ? ktime_get+0xb3/0x190 [11232.675620][ C2] ? clockevents_program_event+0x1ea/0x300 [11232.675917][ C2] run_timer_softirq+0x72/0x100 [11232.676165][ C2] __do_softirq+0x1b9/0x7ff [11232.676399][ C2] irq_exit_rcu+0x98/0xc0 [11232.676619][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11232.676915][ C2] [11232.677067][ C2] [11232.677217][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11232.677522][ C2] RIP: 0010:default_idle+0xf/0x20 [11232.677779][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11232.678747][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11232.679056][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11232.679455][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11232.679852][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11232.680253][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11232.680662][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11232.681059][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11232.681349][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11232.681608][ C2] default_idle_call+0x69/0xa0 [11232.681851][ C2] cpuidle_idle_call+0x1f6/0x280 [11232.682100][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11232.682378][ C2] ? lock_release+0x1d5/0x250 [11232.682616][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11232.682889][ C2] do_idle+0xfb/0x160 [11232.683092][ C2] cpu_startup_entry+0x55/0x60 [11232.683335][ C2] start_secondary+0x21c/0x2b0 [11232.683578][ C2] ? __pfx_start_secondary+0x10/0x10 [11232.683847][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11232.684159][ C2] [11260.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8296s! [perl:4135] [11260.569710][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11260.570975][ C1] irq event stamp: 209232 [11260.571194][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11260.571731][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11260.572215][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11260.572685][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11260.573151][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11260.573604][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11260.574223][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11260.574551][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11260.575531][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11260.575840][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11260.576244][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11260.576652][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11260.577056][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11260.577459][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11260.577861][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11260.578311][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11260.578644][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11260.579050][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11260.579453][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11260.579855][ C1] PKRU: 55555554 [11260.580038][ C1] Call Trace: [11260.580217][ C1] [11260.580366][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11260.580631][ C1] ? __run_hrtimer+0x1c0/0x710 [11260.580877][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11260.581154][ C1] ? __hrtimer_run_queues+0x197/0x270 [11260.581428][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11260.581719][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11260.581986][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11260.582295][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11260.582562][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11260.582875][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11260.583172][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11260.583491][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11260.583783][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11260.584082][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11260.584375][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11260.584688][ C1] ? get_stack_info+0x36/0xc0 [11260.584930][ C1] ? lock_acquire+0x1c1/0x220 [11260.585174][ C1] ? lock_release+0x1d5/0x250 [11260.585414][ C1] do_raw_spin_lock+0x1ec/0x270 [11260.585666][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11260.585938][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11260.586224][ C1] ? lock_acquire+0x1c1/0x220 [11260.586464][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11260.586717][ C1] _raw_spin_lock_nested+0x65/0x80 [11260.586980][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11260.587217][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11260.587465][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11260.587725][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11260.588007][ C1] ip_local_deliver_finish+0x2ae/0x480 [11260.588286][ C1] ip_local_deliver+0x19d/0x480 [11260.588534][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11260.588806][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11260.589071][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11260.589427][ C1] ? rcu_read_lock_held+0xe/0x50 [11260.589683][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11260.590004][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11260.590271][ C1] ip_rcv+0x564/0x740 [11260.590477][ C1] ? __pfx_ip_rcv+0x10/0x10 [11260.590709][ C1] ? set_track_prepare+0x8a/0xd0 [11260.590964][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11260.591244][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11260.591518][ C1] ? skb_clone+0x10b/0x330 [11260.591749][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11260.592068][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11260.592375][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11260.592661][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11260.592956][ C1] ? __tcf_classify+0x329/0x7d0 [11260.593208][ C1] ? __pfx_ip_rcv+0x10/0x10 [11260.593439][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11260.593739][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11260.594028][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11260.594356][ C1] ? lock_acquire+0x1c1/0x220 [11260.594596][ C1] ? netif_receive_skb_internal+0x84/0x300 [11260.594892][ C1] netif_receive_skb_internal+0xb0/0x300 [11260.595180][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11260.595498][ C1] ? __copy_skb_header+0xaf/0x490 [11260.595758][ C1] ? __skb_clone+0x57a/0x760 [11260.595992][ C1] netif_receive_skb+0x55/0x280 [11260.596243][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11260.596563][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11260.596897][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11260.597199][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11260.597475][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11260.597763][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11260.598076][ C1] ? hlock_class+0x4e/0x130 [11260.598312][ C1] ? get_stack_info_noinstr+0x18/0x110 [11260.598589][ C1] ? get_stack_info_noinstr+0x18/0x110 [11260.598866][ C1] ? __pfx_validate_chain+0x10/0x10 [11260.599132][ C1] ? hlock_class+0x4e/0x130 [11260.599365][ C1] ? mark_lock+0x38/0x3e0 [11260.599587][ C1] ? stack_access_ok+0xda/0x1f0 [11260.599836][ C1] ? __lock_acquire+0xb67/0x1610 [11260.600091][ C1] ? get_stack_info_noinstr+0x18/0x110 [11260.600372][ C1] ? get_stack_info+0x36/0xc0 [11260.600612][ C1] ? stack_access_ok+0xda/0x1f0 [11260.600858][ C1] ? get_reg+0x119/0x190 [11260.601077][ C1] ? unwind_next_frame+0x12af/0x1d10 [11260.601348][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11260.601659][ C1] __tcf_classify+0x329/0x7d0 [11260.601900][ C1] tcf_classify+0x283/0x930 [11260.602134][ C1] ? arch_stack_walk+0xa2/0x100 [11260.602383][ C1] ? __pfx_tcf_classify+0x10/0x10 [11260.602641][ C1] ? get_stack_info+0x36/0xc0 [11260.602883][ C1] tc_run+0x2e4/0x5d0 [11260.603090][ C1] ? __pfx_tc_run+0x10/0x10 [11260.603323][ C1] ? lock_acquire+0x1c1/0x220 [11260.603561][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11260.603823][ C1] __dev_queue_xmit+0x686/0x17e0 [11260.604078][ C1] ? lock_acquire+0x1c1/0x220 [11260.604318][ C1] ? ip_finish_output2+0x786/0x18e0 [11260.604585][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11260.604894][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11260.605167][ C1] ? neigh_hh_output+0x348/0x590 [11260.605421][ C1] ? ip_finish_output2+0x262/0x18e0 [11260.605687][ C1] ip_finish_output2+0x786/0x18e0 [11260.605944][ C1] ? stack_depot_save_flags+0x45/0x550 [11260.606226][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11260.606571][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11260.606847][ C1] ? rcu_read_lock_held+0xe/0x50 [11260.607101][ C1] ? __ip_finish_output+0x10f/0x770 [11260.607371][ C1] ip_output+0x16b/0x4f0 [11260.607589][ C1] ? run_timer_softirq+0x72/0x100 [11260.607847][ C1] ? __pfx_ip_output+0x10/0x10 [11260.608096][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11260.608386][ C1] ? rcu_read_lock_held+0xe/0x50 [11260.608638][ C1] ? ip_local_out+0x114/0x3b0 [11260.608877][ C1] __ip_queue_xmit+0x672/0x1910 [11260.609128][ C1] ? __create_object+0x5e/0xb0 [11260.609374][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11260.609641][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11260.609925][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11260.610200][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11260.610482][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11260.610756][ C1] tcp_delack_timer+0x84/0x240 [11260.611000][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11260.611274][ C1] call_timer_fn+0x173/0x430 [11260.611510][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11260.611771][ C1] ? next_expiry_recalc+0xcd/0x220 [11260.612033][ C1] __run_timers.part.0+0x52d/0x890 [11260.612295][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11260.612571][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11260.612857][ C1] ? lock_acquire+0x1c1/0x220 [11260.613098][ C1] ? clockevents_program_event+0xf6/0x300 [11260.613389][ C1] ? lock_release+0x1d5/0x250 [11260.613630][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11260.613894][ C1] ? ktime_get+0xb3/0x190 [11260.614117][ C1] ? clockevents_program_event+0x1ea/0x300 [11260.614414][ C1] run_timer_softirq+0x72/0x100 [11260.614662][ C1] __do_softirq+0x1b9/0x7ff [11260.614896][ C1] irq_exit_rcu+0x98/0xc0 [11260.615118][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11260.615406][ C1] [11260.615555][ C1] [11260.615705][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11260.616013][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11260.616338][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11260.617322][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11260.617632][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11260.618031][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11260.618433][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11260.618836][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11260.619237][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11260.619641][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11260.619945][ C1] pipe_read+0xa16/0xdf0 [11260.620167][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11260.620451][ C1] ? __pfx_pipe_read+0x10/0x10 [11260.620694][ C1] ? iterate_tty_write+0x299/0x540 [11260.620957][ C1] ? lock_release+0x1d5/0x250 [11260.621199][ C1] vfs_read+0x911/0xc00 [11260.621417][ C1] ? lock_acquire+0x1c1/0x220 [11260.621655][ C1] ? __might_fault+0xc6/0x180 [11260.621897][ C1] ? __pfx_vfs_read+0x10/0x10 [11260.622138][ C1] ? __might_fault+0xc6/0x180 [11260.622379][ C1] ? lock_release+0x1d5/0x250 [11260.622618][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11260.622885][ C1] ? __fget_light+0x54/0x1e0 [11260.623124][ C1] ksys_read+0x17a/0x1e0 [11260.623343][ C1] ? __pfx_ksys_read+0x10/0x10 [11260.623587][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11260.623895][ C1] do_syscall_64+0xc9/0x1e0 [11260.624131][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11260.624431][ C1] RIP: 0033:0x7f08a1ea38b2 [11260.624661][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11260.625634][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11260.626058][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11260.626464][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11260.626871][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11260.627271][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11260.627671][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11260.628074][ C1] [11260.628233][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8296s! [swapper/2:0] [11260.628660][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11260.629913][ C2] irq event stamp: 44114564 [11260.630144][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11260.630680][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11260.631189][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11260.631663][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11260.632134][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11260.632591][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11260.633203][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11260.633529][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11260.634499][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11260.634809][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11260.635211][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11260.635610][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11260.636010][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11260.636410][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11260.636821][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11260.637270][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11260.637603][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11260.638006][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11260.638404][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11260.638805][ C2] PKRU: 55555554 [11260.638986][ C2] Call Trace: [11260.639157][ C2] [11260.639306][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11260.639570][ C2] ? __run_hrtimer+0x1c0/0x710 [11260.639811][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11260.640092][ C2] ? __hrtimer_run_queues+0x197/0x270 [11260.640365][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11260.640651][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11260.640918][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11260.641224][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11260.641485][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11260.641749][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11260.642061][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11260.642364][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11260.642678][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11260.642966][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11260.643263][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11260.643549][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11260.643860][ C2] ? get_stack_info+0x36/0xc0 [11260.644103][ C2] ? lock_acquire+0x1c1/0x220 [11260.644343][ C2] ? lock_release+0x1d5/0x250 [11260.644581][ C2] do_raw_spin_lock+0x1ec/0x270 [11260.644829][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11260.645102][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11260.645386][ C2] ? lock_acquire+0x1c1/0x220 [11260.645625][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11260.645863][ C2] _raw_spin_lock_nested+0x65/0x80 [11260.646123][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11260.646357][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11260.646608][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11260.646865][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11260.647140][ C2] ip_local_deliver_finish+0x2ae/0x480 [11260.647420][ C2] ip_local_deliver+0x19d/0x480 [11260.647666][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11260.647938][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11260.648202][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11260.648546][ C2] ? rcu_read_lock_held+0xe/0x50 [11260.648799][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11260.649119][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11260.649381][ C2] ip_rcv+0x564/0x740 [11260.649585][ C2] ? __pfx_ip_rcv+0x10/0x10 [11260.649817][ C2] ? set_track_prepare+0x8a/0xd0 [11260.650071][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11260.650346][ C2] ? start_secondary+0x21c/0x2b0 [11260.650598][ C2] ? skb_clone+0x10b/0x330 [11260.650827][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11260.651146][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11260.651449][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11260.651731][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11260.652022][ C2] ? __tcf_classify+0x329/0x7d0 [11260.652271][ C2] ? __pfx_ip_rcv+0x10/0x10 [11260.652501][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11260.652799][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11260.653085][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11260.653409][ C2] ? lock_acquire+0x1c1/0x220 [11260.653647][ C2] ? netif_receive_skb_internal+0x84/0x300 [11260.653940][ C2] netif_receive_skb_internal+0xb0/0x300 [11260.654227][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11260.654543][ C2] ? __copy_skb_header+0xaf/0x490 [11260.654800][ C2] ? __skb_clone+0x57a/0x760 [11260.655033][ C2] netif_receive_skb+0x55/0x280 [11260.655281][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11260.655593][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11260.655928][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11260.656228][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11260.656501][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11260.656800][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11260.657109][ C2] ? get_stack_info+0x36/0xc0 [11260.657352][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11260.657614][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11260.657929][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11260.658205][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11260.658482][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11260.658796][ C2] ? kernel_text_address+0x17/0xe0 [11260.659055][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11260.659367][ C2] ? arch_stack_walk+0x8c/0x100 [11260.659613][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11260.659878][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11260.660160][ C2] ? lock_acquire+0x1c1/0x220 [11260.660399][ C2] ? stack_depot_save_flags+0x281/0x550 [11260.660679][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11260.660983][ C2] ? get_stack_info_noinstr+0x18/0x110 [11260.661258][ C2] ? get_stack_info+0x36/0xc0 [11260.661498][ C2] __tcf_classify+0x329/0x7d0 [11260.661742][ C2] tcf_classify+0x283/0x930 [11260.661973][ C2] ? __pfx_tcf_classify+0x10/0x10 [11260.662229][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11260.662540][ C2] tc_run+0x2e4/0x5d0 [11260.662746][ C2] ? __pfx_tc_run+0x10/0x10 [11260.662976][ C2] ? lock_acquire+0x1c1/0x220 [11260.663215][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11260.663476][ C2] __dev_queue_xmit+0x686/0x17e0 [11260.663729][ C2] ? lock_acquire+0x1c1/0x220 [11260.663966][ C2] ? ip_finish_output2+0x786/0x18e0 [11260.664232][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11260.664534][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11260.664807][ C2] ? neigh_hh_output+0x348/0x590 [11260.665059][ C2] ? ip_finish_output2+0x262/0x18e0 [11260.665324][ C2] ip_finish_output2+0x786/0x18e0 [11260.665581][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11260.665921][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11260.666196][ C2] ? rcu_read_lock_held+0xe/0x50 [11260.666450][ C2] ? __ip_finish_output+0x10f/0x770 [11260.666728][ C2] ip_output+0x16b/0x4f0 [11260.666946][ C2] ? __pfx_ip_output+0x10/0x10 [11260.667191][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11260.667467][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11260.667781][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11260.668057][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11260.668309][ C2] ? __alloc_skb+0xd4/0x280 [11260.668539][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11260.668809][ C2] ? tcp_fragment+0x168/0x1040 [11260.669054][ C2] ? rcu_read_lock_held+0xe/0x50 [11260.669307][ C2] ? ip_local_out+0x114/0x3b0 [11260.669545][ C2] __ip_queue_xmit+0x672/0x1910 [11260.669793][ C2] ? __skb_clone+0x57a/0x760 [11260.670029][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11260.670296][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11260.670579][ C2] ? ipv4_dst_check+0xe3/0x170 [11260.670822][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11260.671073][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11260.671375][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11260.671693][ C2] ? tcp_fragment+0xb0e/0x1040 [11260.671937][ C2] tcp_send_loss_probe+0x348/0x830 [11260.672198][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11260.672465][ C2] tcp_write_timer+0x82/0x1d0 [11260.672704][ C2] call_timer_fn+0x173/0x430 [11260.672939][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11260.673199][ C2] ? next_expiry_recalc+0xcd/0x220 [11260.673461][ C2] __run_timers.part.0+0x52d/0x890 [11260.673721][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11260.673991][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11260.674278][ C2] ? lock_acquire+0x1c1/0x220 [11260.674518][ C2] ? clockevents_program_event+0xf6/0x300 [11260.674804][ C2] ? lock_release+0x1d5/0x250 [11260.675046][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11260.675310][ C2] ? ktime_get+0xb3/0x190 [11260.675533][ C2] ? clockevents_program_event+0x1ea/0x300 [11260.675827][ C2] run_timer_softirq+0x72/0x100 [11260.676075][ C2] __do_softirq+0x1b9/0x7ff [11260.676309][ C2] irq_exit_rcu+0x98/0xc0 [11260.676538][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11260.676826][ C2] [11260.676976][ C2] [11260.677127][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11260.677431][ C2] RIP: 0010:default_idle+0xf/0x20 [11260.677689][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11260.678655][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11260.678965][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11260.679361][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11260.679762][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11260.680160][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11260.680556][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11260.680954][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11260.681245][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11260.681505][ C2] default_idle_call+0x69/0xa0 [11260.681748][ C2] cpuidle_idle_call+0x1f6/0x280 [11260.681999][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11260.682275][ C2] ? lock_release+0x1d5/0x250 [11260.682514][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11260.682787][ C2] do_idle+0xfb/0x160 [11260.682989][ C2] cpu_startup_entry+0x55/0x60 [11260.683232][ C2] start_secondary+0x21c/0x2b0 [11260.683475][ C2] ? __pfx_start_secondary+0x10/0x10 [11260.683742][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11260.684053][ C2] [11282.877104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11282.877486][ C1] rcu: 1-....: (8616319 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2083738 [11282.878050][ C1] rcu: (t=8927990 jiffies g=1882453 q=730 ncpus=4) [11282.878387][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11282.878838][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11282.879456][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11282.879789][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11282.880763][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11282.881074][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11282.881475][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11282.881874][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11282.882277][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11282.882679][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11282.883080][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11282.883529][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11282.883860][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11282.884263][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11282.884665][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11282.885065][ C1] PKRU: 55555554 [11282.885249][ C1] Call Trace: [11282.885422][ C1] [11282.885571][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11282.885848][ C1] ? print_cpu_stall+0x263/0x6a0 [11282.886101][ C1] ? check_cpu_stall+0x284/0x500 [11282.886354][ C1] ? rcu_pending+0x92/0x360 [11282.886594][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11282.886864][ C1] ? update_process_times+0xb9/0x110 [11282.887136][ C1] ? tick_sched_handle+0x67/0x130 [11282.887395][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11282.887680][ C1] ? __run_hrtimer+0x1c0/0x710 [11282.887923][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11282.888237][ C1] ? __hrtimer_run_queues+0x197/0x270 [11282.888508][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11282.888800][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11282.889068][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11282.889377][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11282.889641][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11282.889954][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11282.890251][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11282.890570][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11282.890862][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11282.891158][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11282.891449][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11282.891762][ C1] ? get_stack_info+0x36/0xc0 [11282.892003][ C1] ? lock_acquire+0x1c1/0x220 [11282.892247][ C1] ? lock_release+0x1d5/0x250 [11282.892488][ C1] do_raw_spin_lock+0x1ec/0x270 [11282.892739][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11282.893013][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11282.893298][ C1] ? lock_acquire+0x1c1/0x220 [11282.893537][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11282.893780][ C1] _raw_spin_lock_nested+0x65/0x80 [11282.894041][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11282.894278][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11282.894525][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11282.894784][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11282.895065][ C1] ip_local_deliver_finish+0x2ae/0x480 [11282.895343][ C1] ip_local_deliver+0x19d/0x480 [11282.895593][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11282.895870][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11282.896135][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11282.896493][ C1] ? rcu_read_lock_held+0xe/0x50 [11282.896748][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11282.897071][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11282.897336][ C1] ip_rcv+0x564/0x740 [11282.897541][ C1] ? __pfx_ip_rcv+0x10/0x10 [11282.897773][ C1] ? set_track_prepare+0x8a/0xd0 [11282.898027][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11282.898308][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11282.898583][ C1] ? skb_clone+0x10b/0x330 [11282.898812][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11282.899133][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11282.899440][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11282.899725][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11282.900020][ C1] ? __tcf_classify+0x329/0x7d0 [11282.900272][ C1] ? __pfx_ip_rcv+0x10/0x10 [11282.900503][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11282.900803][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11282.901095][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11282.901421][ C1] ? lock_acquire+0x1c1/0x220 [11282.901660][ C1] ? netif_receive_skb_internal+0x84/0x300 [11282.901957][ C1] netif_receive_skb_internal+0xb0/0x300 [11282.902245][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11282.902563][ C1] ? __copy_skb_header+0xaf/0x490 [11282.902823][ C1] ? __skb_clone+0x57a/0x760 [11282.903058][ C1] netif_receive_skb+0x55/0x280 [11282.903308][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11282.903622][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11282.903957][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11282.904257][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11282.904533][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11282.904821][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11282.905134][ C1] ? hlock_class+0x4e/0x130 [11282.905370][ C1] ? get_stack_info_noinstr+0x18/0x110 [11282.905647][ C1] ? get_stack_info_noinstr+0x18/0x110 [11282.905923][ C1] ? __pfx_validate_chain+0x10/0x10 [11282.906190][ C1] ? hlock_class+0x4e/0x130 [11282.906430][ C1] ? mark_lock+0x38/0x3e0 [11282.906651][ C1] ? stack_access_ok+0xda/0x1f0 [11282.906905][ C1] ? __lock_acquire+0xb67/0x1610 [11282.907161][ C1] ? get_stack_info_noinstr+0x18/0x110 [11282.907439][ C1] ? get_stack_info+0x36/0xc0 [11282.907678][ C1] ? stack_access_ok+0xda/0x1f0 [11282.907927][ C1] ? get_reg+0x119/0x190 [11282.908146][ C1] ? unwind_next_frame+0x12af/0x1d10 [11282.908415][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11282.908725][ C1] __tcf_classify+0x329/0x7d0 [11282.908966][ C1] tcf_classify+0x283/0x930 [11282.909201][ C1] ? arch_stack_walk+0xa2/0x100 [11282.909453][ C1] ? __pfx_tcf_classify+0x10/0x10 [11282.909710][ C1] ? get_stack_info+0x36/0xc0 [11282.909952][ C1] tc_run+0x2e4/0x5d0 [11282.910160][ C1] ? __pfx_tc_run+0x10/0x10 [11282.910392][ C1] ? lock_acquire+0x1c1/0x220 [11282.910631][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11282.910892][ C1] __dev_queue_xmit+0x686/0x17e0 [11282.911145][ C1] ? lock_acquire+0x1c1/0x220 [11282.911385][ C1] ? ip_finish_output2+0x786/0x18e0 [11282.911651][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11282.911959][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11282.912231][ C1] ? neigh_hh_output+0x348/0x590 [11282.912485][ C1] ? ip_finish_output2+0x262/0x18e0 [11282.912753][ C1] ip_finish_output2+0x786/0x18e0 [11282.913010][ C1] ? stack_depot_save_flags+0x45/0x550 [11282.913290][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11282.913631][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11282.913907][ C1] ? rcu_read_lock_held+0xe/0x50 [11282.914161][ C1] ? __ip_finish_output+0x10f/0x770 [11282.914426][ C1] ip_output+0x16b/0x4f0 [11282.914647][ C1] ? run_timer_softirq+0x72/0x100 [11282.914908][ C1] ? __pfx_ip_output+0x10/0x10 [11282.915153][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11282.915442][ C1] ? rcu_read_lock_held+0xe/0x50 [11282.915694][ C1] ? ip_local_out+0x114/0x3b0 [11282.915933][ C1] __ip_queue_xmit+0x672/0x1910 [11282.916182][ C1] ? __create_object+0x5e/0xb0 [11282.916435][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11282.916704][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11282.916987][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11282.917262][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11282.917544][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11282.917815][ C1] tcp_delack_timer+0x84/0x240 [11282.918061][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11282.918334][ C1] call_timer_fn+0x173/0x430 [11282.918571][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11282.918834][ C1] ? next_expiry_recalc+0xcd/0x220 [11282.919096][ C1] __run_timers.part.0+0x52d/0x890 [11282.919356][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11282.919633][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11282.919918][ C1] ? lock_acquire+0x1c1/0x220 [11282.920160][ C1] ? clockevents_program_event+0xf6/0x300 [11282.920452][ C1] ? lock_release+0x1d5/0x250 [11282.920693][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11282.920957][ C1] ? ktime_get+0xb3/0x190 [11282.921181][ C1] ? clockevents_program_event+0x1ea/0x300 [11282.921476][ C1] run_timer_softirq+0x72/0x100 [11282.921727][ C1] __do_softirq+0x1b9/0x7ff [11282.921961][ C1] irq_exit_rcu+0x98/0xc0 [11282.922183][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11282.922471][ C1] [11282.922622][ C1] [11282.922772][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11282.923079][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11282.923404][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11282.924380][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11282.924690][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11282.925090][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11282.925492][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11282.925892][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11282.926292][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11282.926699][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11282.926999][ C1] pipe_read+0xa16/0xdf0 [11282.927221][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11282.927503][ C1] ? __pfx_pipe_read+0x10/0x10 [11282.927746][ C1] ? iterate_tty_write+0x299/0x540 [11282.928010][ C1] ? lock_release+0x1d5/0x250 [11282.928251][ C1] vfs_read+0x911/0xc00 [11282.928469][ C1] ? lock_acquire+0x1c1/0x220 [11282.928707][ C1] ? __might_fault+0xc6/0x180 [11282.928951][ C1] ? __pfx_vfs_read+0x10/0x10 [11282.929191][ C1] ? __might_fault+0xc6/0x180 [11282.929433][ C1] ? lock_release+0x1d5/0x250 [11282.929671][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11282.929938][ C1] ? __fget_light+0x54/0x1e0 [11282.930178][ C1] ksys_read+0x17a/0x1e0 [11282.930397][ C1] ? __pfx_ksys_read+0x10/0x10 [11282.930642][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11282.930948][ C1] do_syscall_64+0xc9/0x1e0 [11282.931183][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11282.931483][ C1] RIP: 0033:0x7f08a1ea38b2 [11282.931714][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11282.932687][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11282.933111][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11282.933512][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11282.933911][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11282.934311][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11282.934714][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11282.935117][ C1] [11282.935275][ C1] Sending NMI from CPU 1 to CPUs 2: [11282.935553][ C2] NMI backtrace for cpu 2 [11282.935561][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11282.935568][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11282.935572][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11282.935582][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11282.935588][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11282.935594][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11282.935598][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11282.935602][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11282.935605][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11282.935607][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11282.935609][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11282.935611][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11282.935615][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11282.935616][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11282.935618][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11282.935619][ C2] PKRU: 55555554 [11282.935620][ C2] Call Trace: [11282.935623][ C2] [11282.935626][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11282.935634][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11282.935640][ C2] ? nmi_handle+0x153/0x420 [11282.935645][ C2] ? default_do_nmi+0x41/0x100 [11282.935649][ C2] ? exc_nmi+0xf3/0x120 [11282.935651][ C2] ? end_repeat_nmi+0xf/0x60 [11282.935657][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11282.935660][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11282.935663][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11282.935667][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11282.935669][ C2] [11282.935670][ C2] [11282.935672][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11282.935674][ C2] ? get_stack_info+0x36/0xc0 [11282.935678][ C2] ? lock_acquire+0x1c1/0x220 [11282.935682][ C2] ? lock_release+0x1d5/0x250 [11282.935686][ C2] do_raw_spin_lock+0x1ec/0x270 [11282.935690][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11282.935693][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11282.935696][ C2] ? lock_acquire+0x1c1/0x220 [11282.935698][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11282.935702][ C2] _raw_spin_lock_nested+0x65/0x80 [11282.935706][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11282.935712][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11282.935715][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11282.935719][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11282.935725][ C2] ip_local_deliver_finish+0x2ae/0x480 [11282.935729][ C2] ip_local_deliver+0x19d/0x480 [11282.935731][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11282.935733][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11282.935736][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11282.935741][ C2] ? rcu_read_lock_held+0xe/0x50 [11282.935745][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11282.935748][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11282.935758][ C2] ip_rcv+0x564/0x740 [11282.935760][ C2] ? __pfx_ip_rcv+0x10/0x10 [11282.935763][ C2] ? set_track_prepare+0x8a/0xd0 [11282.935768][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11282.935771][ C2] ? start_secondary+0x21c/0x2b0 [11282.935775][ C2] ? skb_clone+0x10b/0x330 [11282.935779][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11282.935785][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11282.935791][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11282.935794][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11282.935802][ C2] ? __tcf_classify+0x329/0x7d0 [11282.935807][ C2] ? __pfx_ip_rcv+0x10/0x10 [11282.935809][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11282.935812][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11282.935816][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11282.935821][ C2] ? lock_acquire+0x1c1/0x220 [11282.935823][ C2] ? netif_receive_skb_internal+0x84/0x300 [11282.935827][ C2] netif_receive_skb_internal+0xb0/0x300 [11282.935831][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11282.935836][ C2] ? __copy_skb_header+0xaf/0x490 [11282.935840][ C2] ? __skb_clone+0x57a/0x760 [11282.935843][ C2] netif_receive_skb+0x55/0x280 [11282.935846][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11282.935854][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11282.935860][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11282.935867][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11282.935872][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11282.935882][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11282.935889][ C2] ? get_stack_info+0x36/0xc0 [11282.935894][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11282.935897][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11282.935903][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11282.935905][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11282.935909][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11282.935911][ C2] ? kernel_text_address+0x17/0xe0 [11282.935916][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11282.935921][ C2] ? arch_stack_walk+0x8c/0x100 [11282.935925][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11282.935929][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11282.935933][ C2] ? lock_acquire+0x1c1/0x220 [11282.935935][ C2] ? stack_depot_save_flags+0x281/0x550 [11282.935939][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11282.935944][ C2] ? get_stack_info_noinstr+0x18/0x110 [11282.935946][ C2] ? get_stack_info+0x36/0xc0 [11282.935951][ C2] __tcf_classify+0x329/0x7d0 [11282.935956][ C2] tcf_classify+0x283/0x930 [11282.935961][ C2] ? __pfx_tcf_classify+0x10/0x10 [11282.935964][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11282.935969][ C2] tc_run+0x2e4/0x5d0 [11282.935973][ C2] ? __pfx_tc_run+0x10/0x10 [11282.935976][ C2] ? lock_acquire+0x1c1/0x220 [11282.935978][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11282.935982][ C2] __dev_queue_xmit+0x686/0x17e0 [11282.935987][ C2] ? lock_acquire+0x1c1/0x220 [11282.935989][ C2] ? ip_finish_output2+0x786/0x18e0 [11282.935992][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11282.935996][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11282.935998][ C2] ? neigh_hh_output+0x348/0x590 [11282.936002][ C2] ? ip_finish_output2+0x262/0x18e0 [11282.936005][ C2] ip_finish_output2+0x786/0x18e0 [11282.936009][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11282.936017][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11282.936020][ C2] ? rcu_read_lock_held+0xe/0x50 [11282.936024][ C2] ? __ip_finish_output+0x10f/0x770 [11282.936028][ C2] ip_output+0x16b/0x4f0 [11282.936031][ C2] ? __pfx_ip_output+0x10/0x10 [11282.936034][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11282.936037][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11282.936040][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11282.936044][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11282.936047][ C2] ? __alloc_skb+0xd4/0x280 [11282.936049][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11282.936054][ C2] ? tcp_fragment+0x168/0x1040 [11282.936058][ C2] ? rcu_read_lock_held+0xe/0x50 [11282.936061][ C2] ? ip_local_out+0x114/0x3b0 [11282.936065][ C2] __ip_queue_xmit+0x672/0x1910 [11282.936068][ C2] ? __skb_clone+0x57a/0x760 [11282.936071][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11282.936076][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11282.936079][ C2] ? ipv4_dst_check+0xe3/0x170 [11282.936084][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11282.936089][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11282.936094][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11282.936097][ C2] ? tcp_fragment+0xb0e/0x1040 [11282.936100][ C2] tcp_send_loss_probe+0x348/0x830 [11282.936104][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11282.936106][ C2] tcp_write_timer+0x82/0x1d0 [11282.936110][ C2] call_timer_fn+0x173/0x430 [11282.936114][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11282.936119][ C2] ? next_expiry_recalc+0xcd/0x220 [11282.936123][ C2] __run_timers.part.0+0x52d/0x890 [11282.936126][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11282.936131][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11282.936134][ C2] ? lock_acquire+0x1c1/0x220 [11282.936136][ C2] ? clockevents_program_event+0xf6/0x300 [11282.936141][ C2] ? lock_release+0x1d5/0x250 [11282.936144][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11282.936147][ C2] ? ktime_get+0xb3/0x190 [11282.936151][ C2] ? clockevents_program_event+0x1ea/0x300 [11282.936155][ C2] run_timer_softirq+0x72/0x100 [11282.936158][ C2] __do_softirq+0x1b9/0x7ff [11282.936163][ C2] irq_exit_rcu+0x98/0xc0 [11282.936165][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11282.936169][ C2] [11282.936170][ C2] [11282.936171][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11282.936175][ C2] RIP: 0010:default_idle+0xf/0x20 [11282.936178][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11282.936181][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11282.936183][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11282.936185][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11282.936186][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11282.936188][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11282.936190][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11282.936193][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11282.936196][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11282.936201][ C2] default_idle_call+0x69/0xa0 [11282.936204][ C2] cpuidle_idle_call+0x1f6/0x280 [11282.936207][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11282.936211][ C2] ? lock_release+0x1d5/0x250 [11282.936214][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11282.936218][ C2] do_idle+0xfb/0x160 [11282.936220][ C2] cpu_startup_entry+0x55/0x60 [11282.936223][ C2] start_secondary+0x21c/0x2b0 [11282.936226][ C2] ? __pfx_start_secondary+0x10/0x10 [11282.936230][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11282.936237][ C2] [11308.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8340s! [perl:4135] [11308.569717][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11308.570981][ C1] irq event stamp: 209232 [11308.571203][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11308.571754][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11308.572234][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11308.572707][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11308.573176][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11308.573628][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11308.574241][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [11308.574530][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [11308.575506][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [11308.575817][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11308.576217][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11308.576626][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11308.577025][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11308.577427][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11308.577827][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11308.578277][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11308.578610][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11308.579013][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11308.579416][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11308.579820][ C1] PKRU: 55555554 [11308.580003][ C1] Call Trace: [11308.580176][ C1] [11308.580332][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11308.580597][ C1] ? __run_hrtimer+0x1c0/0x710 [11308.580842][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11308.581119][ C1] ? __hrtimer_run_queues+0x197/0x270 [11308.581395][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11308.581683][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11308.581950][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11308.582259][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11308.582521][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11308.582832][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11308.583129][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11308.583445][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11308.583738][ C1] ? __pfx___kasan_check_read+0x10/0x10 [11308.584019][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11308.584303][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11308.584614][ C1] ? get_stack_info+0x36/0xc0 [11308.584855][ C1] ? lock_acquire+0x1c1/0x220 [11308.585097][ C1] ? lock_release+0x1d5/0x250 [11308.585339][ C1] do_raw_spin_lock+0x1ec/0x270 [11308.585589][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11308.585863][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11308.586148][ C1] ? lock_acquire+0x1c1/0x220 [11308.586394][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11308.586636][ C1] _raw_spin_lock_nested+0x65/0x80 [11308.586898][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11308.587134][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11308.587380][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11308.587638][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11308.587921][ C1] ip_local_deliver_finish+0x2ae/0x480 [11308.588199][ C1] ip_local_deliver+0x19d/0x480 [11308.588447][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11308.588719][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11308.588983][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11308.589333][ C1] ? rcu_read_lock_held+0xe/0x50 [11308.589586][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11308.589908][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11308.590172][ C1] ip_rcv+0x564/0x740 [11308.590377][ C1] ? __pfx_ip_rcv+0x10/0x10 [11308.590606][ C1] ? set_track_prepare+0x8a/0xd0 [11308.590860][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11308.591139][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11308.591413][ C1] ? skb_clone+0x10b/0x330 [11308.591640][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11308.591960][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11308.592269][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11308.592552][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11308.592848][ C1] ? __tcf_classify+0x329/0x7d0 [11308.593098][ C1] ? __pfx_ip_rcv+0x10/0x10 [11308.593330][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11308.593630][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11308.593916][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11308.594242][ C1] ? lock_acquire+0x1c1/0x220 [11308.594480][ C1] ? netif_receive_skb_internal+0x84/0x300 [11308.594778][ C1] netif_receive_skb_internal+0xb0/0x300 [11308.595065][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11308.595382][ C1] ? __copy_skb_header+0xaf/0x490 [11308.595642][ C1] ? __skb_clone+0x57a/0x760 [11308.595878][ C1] netif_receive_skb+0x55/0x280 [11308.596129][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11308.596460][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11308.596793][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11308.597093][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11308.597372][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11308.597660][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11308.597972][ C1] ? hlock_class+0x4e/0x130 [11308.598208][ C1] ? get_stack_info_noinstr+0x18/0x110 [11308.598485][ C1] ? get_stack_info_noinstr+0x18/0x110 [11308.598760][ C1] ? __pfx_validate_chain+0x10/0x10 [11308.599022][ C1] ? hlock_class+0x4e/0x130 [11308.599257][ C1] ? mark_lock+0x38/0x3e0 [11308.599475][ C1] ? stack_access_ok+0xda/0x1f0 [11308.599726][ C1] ? __lock_acquire+0xb67/0x1610 [11308.599980][ C1] ? get_stack_info_noinstr+0x18/0x110 [11308.600257][ C1] ? get_stack_info+0x36/0xc0 [11308.600497][ C1] ? stack_access_ok+0xda/0x1f0 [11308.600745][ C1] ? get_reg+0x119/0x190 [11308.600962][ C1] ? unwind_next_frame+0x12af/0x1d10 [11308.601231][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11308.601540][ C1] __tcf_classify+0x329/0x7d0 [11308.601782][ C1] tcf_classify+0x283/0x930 [11308.602015][ C1] ? arch_stack_walk+0xa2/0x100 [11308.602265][ C1] ? __pfx_tcf_classify+0x10/0x10 [11308.602522][ C1] ? get_stack_info+0x36/0xc0 [11308.602762][ C1] tc_run+0x2e4/0x5d0 [11308.602969][ C1] ? __pfx_tc_run+0x10/0x10 [11308.603199][ C1] ? lock_acquire+0x1c1/0x220 [11308.603440][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11308.603700][ C1] __dev_queue_xmit+0x686/0x17e0 [11308.603954][ C1] ? lock_acquire+0x1c1/0x220 [11308.604195][ C1] ? ip_finish_output2+0x786/0x18e0 [11308.604460][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11308.604769][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11308.605041][ C1] ? neigh_hh_output+0x348/0x590 [11308.605296][ C1] ? ip_finish_output2+0x262/0x18e0 [11308.605561][ C1] ip_finish_output2+0x786/0x18e0 [11308.605818][ C1] ? stack_depot_save_flags+0x45/0x550 [11308.606098][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11308.606444][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11308.606722][ C1] ? rcu_read_lock_held+0xe/0x50 [11308.606977][ C1] ? __ip_finish_output+0x10f/0x770 [11308.607244][ C1] ip_output+0x16b/0x4f0 [11308.607461][ C1] ? run_timer_softirq+0x72/0x100 [11308.607719][ C1] ? __pfx_ip_output+0x10/0x10 [11308.607963][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11308.608250][ C1] ? rcu_read_lock_held+0xe/0x50 [11308.608503][ C1] ? ip_local_out+0x114/0x3b0 [11308.608744][ C1] __ip_queue_xmit+0x672/0x1910 [11308.608993][ C1] ? __create_object+0x5e/0xb0 [11308.609240][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11308.609508][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11308.609789][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11308.610065][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11308.610349][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11308.610621][ C1] tcp_delack_timer+0x84/0x240 [11308.610865][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11308.611138][ C1] call_timer_fn+0x173/0x430 [11308.611376][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11308.611638][ C1] ? next_expiry_recalc+0xcd/0x220 [11308.611900][ C1] __run_timers.part.0+0x52d/0x890 [11308.612161][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11308.612436][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11308.612723][ C1] ? lock_acquire+0x1c1/0x220 [11308.612963][ C1] ? clockevents_program_event+0xf6/0x300 [11308.613254][ C1] ? lock_release+0x1d5/0x250 [11308.613495][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11308.613759][ C1] ? ktime_get+0xb3/0x190 [11308.613980][ C1] ? clockevents_program_event+0x1ea/0x300 [11308.614279][ C1] run_timer_softirq+0x72/0x100 [11308.614528][ C1] __do_softirq+0x1b9/0x7ff [11308.614763][ C1] irq_exit_rcu+0x98/0xc0 [11308.614984][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11308.615273][ C1] [11308.615425][ C1] [11308.615575][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11308.615886][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11308.616213][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11308.617195][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11308.617506][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11308.617905][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11308.618306][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11308.618706][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11308.619106][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11308.619508][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11308.619807][ C1] pipe_read+0xa16/0xdf0 [11308.620028][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11308.620309][ C1] ? __pfx_pipe_read+0x10/0x10 [11308.620552][ C1] ? iterate_tty_write+0x299/0x540 [11308.620815][ C1] ? lock_release+0x1d5/0x250 [11308.621058][ C1] vfs_read+0x911/0xc00 [11308.621274][ C1] ? lock_acquire+0x1c1/0x220 [11308.621513][ C1] ? __might_fault+0xc6/0x180 [11308.621755][ C1] ? __pfx_vfs_read+0x10/0x10 [11308.621996][ C1] ? __might_fault+0xc6/0x180 [11308.622239][ C1] ? lock_release+0x1d5/0x250 [11308.622479][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11308.622744][ C1] ? __fget_light+0x54/0x1e0 [11308.622984][ C1] ksys_read+0x17a/0x1e0 [11308.623202][ C1] ? __pfx_ksys_read+0x10/0x10 [11308.623448][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11308.623754][ C1] do_syscall_64+0xc9/0x1e0 [11308.623988][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11308.624289][ C1] RIP: 0033:0x7f08a1ea38b2 [11308.624528][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11308.625505][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11308.625928][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11308.626336][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11308.626734][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11308.627134][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11308.627536][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11308.627940][ C1] [11308.628098][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8340s! [swapper/2:0] [11308.628530][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11308.629783][ C2] irq event stamp: 44114564 [11308.630010][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11308.630549][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11308.631131][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11308.631753][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11308.632324][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11308.632901][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11308.633748][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11308.634198][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11308.635526][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11308.635939][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11308.636489][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11308.637044][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11308.637595][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11308.638144][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11308.638690][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11308.639308][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11308.639744][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11308.640286][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11308.640790][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11308.641306][ C2] PKRU: 55555554 [11308.641553][ C2] Call Trace: [11308.641742][ C2] [11308.641889][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11308.642154][ C2] ? __run_hrtimer+0x1c0/0x710 [11308.642397][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11308.642679][ C2] ? __hrtimer_run_queues+0x197/0x270 [11308.643022][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11308.643310][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11308.643574][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11308.643925][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11308.644270][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11308.644590][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11308.644929][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11308.645307][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11308.645723][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11308.646122][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11308.646512][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11308.646895][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11308.647324][ C2] ? get_stack_info+0x36/0xc0 [11308.647652][ C2] ? lock_acquire+0x1c1/0x220 [11308.647983][ C2] ? lock_release+0x1d5/0x250 [11308.648311][ C2] do_raw_spin_lock+0x1ec/0x270 [11308.648652][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11308.649027][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11308.649418][ C2] ? lock_acquire+0x1c1/0x220 [11308.649745][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11308.650068][ C2] _raw_spin_lock_nested+0x65/0x80 [11308.650429][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11308.650755][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11308.651095][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11308.651450][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11308.651828][ C2] ip_local_deliver_finish+0x2ae/0x480 [11308.652186][ C2] ip_local_deliver+0x19d/0x480 [11308.652524][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11308.652877][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11308.653239][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11308.653695][ C2] ? rcu_read_lock_held+0xe/0x50 [11308.654046][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11308.654456][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11308.654804][ C2] ip_rcv+0x564/0x740 [11308.655068][ C2] ? __pfx_ip_rcv+0x10/0x10 [11308.655388][ C2] ? set_track_prepare+0x8a/0xd0 [11308.655661][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11308.655949][ C2] ? start_secondary+0x21c/0x2b0 [11308.656201][ C2] ? skb_clone+0x10b/0x330 [11308.656461][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11308.656778][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11308.657084][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11308.657370][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11308.657662][ C2] ? __tcf_classify+0x329/0x7d0 [11308.657910][ C2] ? __pfx_ip_rcv+0x10/0x10 [11308.658141][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11308.658441][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11308.658728][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11308.659052][ C2] ? lock_acquire+0x1c1/0x220 [11308.659292][ C2] ? netif_receive_skb_internal+0x84/0x300 [11308.659591][ C2] netif_receive_skb_internal+0xb0/0x300 [11308.659876][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11308.660193][ C2] ? __copy_skb_header+0xaf/0x490 [11308.660449][ C2] ? __skb_clone+0x57a/0x760 [11308.660681][ C2] netif_receive_skb+0x55/0x280 [11308.660929][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11308.661241][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11308.661572][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11308.661872][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11308.662147][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11308.662435][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11308.662747][ C2] ? get_stack_info+0x36/0xc0 [11308.662990][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11308.663255][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11308.663572][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11308.663846][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11308.664123][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11308.664437][ C2] ? kernel_text_address+0x17/0xe0 [11308.664698][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11308.665010][ C2] ? arch_stack_walk+0x8c/0x100 [11308.665257][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11308.665521][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11308.665835][ C2] ? lock_acquire+0x1c1/0x220 [11308.666142][ C2] ? stack_depot_save_flags+0x281/0x550 [11308.666548][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11308.666869][ C2] ? get_stack_info_noinstr+0x18/0x110 [11308.667234][ C2] ? get_stack_info+0x36/0xc0 [11308.667536][ C2] __tcf_classify+0x329/0x7d0 [11308.667851][ C2] tcf_classify+0x283/0x930 [11308.668174][ C2] ? __pfx_tcf_classify+0x10/0x10 [11308.668525][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11308.668954][ C2] tc_run+0x2e4/0x5d0 [11308.669232][ C2] ? __pfx_tc_run+0x10/0x10 [11308.669554][ C2] ? lock_acquire+0x1c1/0x220 [11308.669880][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11308.670242][ C2] __dev_queue_xmit+0x686/0x17e0 [11308.670587][ C2] ? lock_acquire+0x1c1/0x220 [11308.670914][ C2] ? ip_finish_output2+0x786/0x18e0 [11308.671284][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11308.671696][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11308.672073][ C2] ? neigh_hh_output+0x348/0x590 [11308.672429][ C2] ? ip_finish_output2+0x262/0x18e0 [11308.672793][ C2] ip_finish_output2+0x786/0x18e0 [11308.673144][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11308.673606][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11308.673981][ C2] ? rcu_read_lock_held+0xe/0x50 [11308.674304][ C2] ? __ip_finish_output+0x10f/0x770 [11308.674670][ C2] ip_output+0x16b/0x4f0 [11308.674947][ C2] ? __pfx_ip_output+0x10/0x10 [11308.675285][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11308.675630][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11308.676050][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11308.676359][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11308.676612][ C2] ? __alloc_skb+0xd4/0x280 [11308.676840][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11308.677112][ C2] ? tcp_fragment+0x168/0x1040 [11308.677416][ C2] ? rcu_read_lock_held+0xe/0x50 [11308.677684][ C2] ? ip_local_out+0x114/0x3b0 [11308.677925][ C2] __ip_queue_xmit+0x672/0x1910 [11308.678174][ C2] ? __skb_clone+0x57a/0x760 [11308.678435][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11308.678759][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11308.679128][ C2] ? ipv4_dst_check+0xe3/0x170 [11308.679397][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11308.679657][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11308.680039][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11308.680464][ C2] ? tcp_fragment+0xb0e/0x1040 [11308.680786][ C2] tcp_send_loss_probe+0x348/0x830 [11308.681138][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11308.681498][ C2] tcp_write_timer+0x82/0x1d0 [11308.681814][ C2] call_timer_fn+0x173/0x430 [11308.682134][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11308.682488][ C2] ? next_expiry_recalc+0xcd/0x220 [11308.682837][ C2] __run_timers.part.0+0x52d/0x890 [11308.683185][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11308.683546][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11308.683928][ C2] ? lock_acquire+0x1c1/0x220 [11308.684252][ C2] ? clockevents_program_event+0xf6/0x300 [11308.684637][ C2] ? lock_release+0x1d5/0x250 [11308.684965][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11308.685320][ C2] ? ktime_get+0xb3/0x190 [11308.685612][ C2] ? clockevents_program_event+0x1ea/0x300 [11308.686007][ C2] run_timer_softirq+0x72/0x100 [11308.686346][ C2] __do_softirq+0x1b9/0x7ff [11308.686657][ C2] irq_exit_rcu+0x98/0xc0 [11308.686940][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11308.687316][ C2] [11308.687520][ C2] [11308.687698][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11308.688110][ C2] RIP: 0010:default_idle+0xf/0x20 [11308.688437][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11308.689658][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11308.690072][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11308.690597][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11308.691040][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11308.691453][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11308.691873][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11308.692273][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11308.692563][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11308.692824][ C2] default_idle_call+0x69/0xa0 [11308.693066][ C2] cpuidle_idle_call+0x1f6/0x280 [11308.693317][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11308.693597][ C2] ? lock_release+0x1d5/0x250 [11308.693836][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11308.694112][ C2] do_idle+0xfb/0x160 [11308.694316][ C2] cpu_startup_entry+0x55/0x60 [11308.694560][ C2] start_secondary+0x21c/0x2b0 [11308.694803][ C2] ? __pfx_start_secondary+0x10/0x10 [11308.695072][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11308.695389][ C2] [11336.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8367s! [perl:4135] [11336.569713][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11336.570977][ C1] irq event stamp: 209232 [11336.571196][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11336.571728][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11336.572222][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11336.572702][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11336.573182][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11336.573654][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11336.574282][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11336.574619][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11336.575618][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11336.575940][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11336.576364][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11336.576775][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11336.577190][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11336.577605][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11336.578012][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11336.578471][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11336.578815][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11336.579228][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11336.579641][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11336.580051][ C1] PKRU: 55555554 [11336.580234][ C1] Call Trace: [11336.580421][ C1] [11336.580571][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11336.580849][ C1] ? __run_hrtimer+0x1c0/0x710 [11336.581096][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11336.581386][ C1] ? __hrtimer_run_queues+0x197/0x270 [11336.581669][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11336.581959][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11336.582240][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11336.582554][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11336.582825][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11336.583137][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11336.583433][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11336.583750][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11336.584042][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11336.584346][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11336.584643][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11336.584956][ C1] ? get_stack_info+0x36/0xc0 [11336.585197][ C1] ? lock_acquire+0x1c1/0x220 [11336.585442][ C1] ? lock_release+0x1d5/0x250 [11336.585692][ C1] do_raw_spin_lock+0x1ec/0x270 [11336.585943][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11336.586244][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11336.586540][ C1] ? lock_acquire+0x1c1/0x220 [11336.586782][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11336.587026][ C1] _raw_spin_lock_nested+0x65/0x80 [11336.587303][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11336.587538][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11336.587798][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11336.588058][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11336.588344][ C1] ip_local_deliver_finish+0x2ae/0x480 [11336.588634][ C1] ip_local_deliver+0x19d/0x480 [11336.588890][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11336.589168][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11336.589442][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11336.589805][ C1] ? rcu_read_lock_held+0xe/0x50 [11336.590062][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11336.590394][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11336.590671][ C1] ip_rcv+0x564/0x740 [11336.590877][ C1] ? __pfx_ip_rcv+0x10/0x10 [11336.591116][ C1] ? set_track_prepare+0x8a/0xd0 [11336.591386][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11336.591667][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11336.591951][ C1] ? skb_clone+0x10b/0x330 [11336.592187][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11336.592515][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11336.592833][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11336.593130][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11336.593432][ C1] ? __tcf_classify+0x329/0x7d0 [11336.593688][ C1] ? __pfx_ip_rcv+0x10/0x10 [11336.593926][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11336.594234][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11336.594534][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11336.594861][ C1] ? lock_acquire+0x1c1/0x220 [11336.595100][ C1] ? netif_receive_skb_internal+0x84/0x300 [11336.595399][ C1] netif_receive_skb_internal+0xb0/0x300 [11336.595685][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11336.596004][ C1] ? __copy_skb_header+0xaf/0x490 [11336.596276][ C1] ? __skb_clone+0x57a/0x760 [11336.596510][ C1] netif_receive_skb+0x55/0x280 [11336.596770][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11336.597091][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11336.597436][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11336.597736][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11336.598012][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11336.598311][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11336.598632][ C1] ? hlock_class+0x4e/0x130 [11336.598870][ C1] ? get_stack_info_noinstr+0x18/0x110 [11336.599154][ C1] ? get_stack_info_noinstr+0x18/0x110 [11336.599442][ C1] ? __pfx_validate_chain+0x10/0x10 [11336.599707][ C1] ? hlock_class+0x4e/0x130 [11336.599950][ C1] ? mark_lock+0x38/0x3e0 [11336.600171][ C1] ? stack_access_ok+0xda/0x1f0 [11336.600425][ C1] ? __lock_acquire+0xb67/0x1610 [11336.600687][ C1] ? get_stack_info_noinstr+0x18/0x110 [11336.600968][ C1] ? get_stack_info+0x36/0xc0 [11336.601216][ C1] ? stack_access_ok+0xda/0x1f0 [11336.601477][ C1] ? get_reg+0x119/0x190 [11336.601696][ C1] ? unwind_next_frame+0x12af/0x1d10 [11336.601975][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11336.602287][ C1] __tcf_classify+0x329/0x7d0 [11336.602540][ C1] tcf_classify+0x283/0x930 [11336.602775][ C1] ? arch_stack_walk+0xa2/0x100 [11336.603037][ C1] ? __pfx_tcf_classify+0x10/0x10 [11336.603344][ C1] ? get_stack_info+0x36/0xc0 [11336.603703][ C1] tc_run+0x2e4/0x5d0 [11336.603990][ C1] ? __pfx_tc_run+0x10/0x10 [11336.604245][ C1] ? lock_acquire+0x1c1/0x220 [11336.604482][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11336.604743][ C1] __dev_queue_xmit+0x686/0x17e0 [11336.604997][ C1] ? lock_acquire+0x1c1/0x220 [11336.605235][ C1] ? ip_finish_output2+0x786/0x18e0 [11336.605499][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11336.605807][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11336.606078][ C1] ? neigh_hh_output+0x348/0x590 [11336.606340][ C1] ? ip_finish_output2+0x262/0x18e0 [11336.606606][ C1] ip_finish_output2+0x786/0x18e0 [11336.606862][ C1] ? stack_depot_save_flags+0x45/0x550 [11336.607142][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11336.607482][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11336.607758][ C1] ? rcu_read_lock_held+0xe/0x50 [11336.608012][ C1] ? __ip_finish_output+0x10f/0x770 [11336.608277][ C1] ip_output+0x16b/0x4f0 [11336.608493][ C1] ? run_timer_softirq+0x72/0x100 [11336.608752][ C1] ? __pfx_ip_output+0x10/0x10 [11336.608996][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11336.609285][ C1] ? rcu_read_lock_held+0xe/0x50 [11336.609536][ C1] ? ip_local_out+0x114/0x3b0 [11336.609775][ C1] __ip_queue_xmit+0x672/0x1910 [11336.610023][ C1] ? __create_object+0x5e/0xb0 [11336.610268][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11336.610536][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11336.610818][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11336.611092][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11336.611375][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11336.611646][ C1] tcp_delack_timer+0x84/0x240 [11336.611891][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11336.612164][ C1] call_timer_fn+0x173/0x430 [11336.612402][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11336.612663][ C1] ? next_expiry_recalc+0xcd/0x220 [11336.612940][ C1] __run_timers.part.0+0x52d/0x890 [11336.613202][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11336.613490][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11336.613781][ C1] ? lock_acquire+0x1c1/0x220 [11336.614028][ C1] ? clockevents_program_event+0xf6/0x300 [11336.614332][ C1] ? lock_release+0x1d5/0x250 [11336.614573][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11336.614855][ C1] ? ktime_get+0xb3/0x190 [11336.615079][ C1] ? clockevents_program_event+0x1ea/0x300 [11336.615392][ C1] run_timer_softirq+0x72/0x100 [11336.615648][ C1] __do_softirq+0x1b9/0x7ff [11336.615889][ C1] irq_exit_rcu+0x98/0xc0 [11336.616115][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11336.616424][ C1] [11336.616576][ C1] [11336.616732][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11336.617045][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11336.617386][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11336.618387][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11336.618701][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11336.619111][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11336.619529][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11336.619940][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11336.620340][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11336.620752][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11336.621063][ C1] pipe_read+0xa16/0xdf0 [11336.621285][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11336.621580][ C1] ? __pfx_pipe_read+0x10/0x10 [11336.621822][ C1] ? iterate_tty_write+0x299/0x540 [11336.622095][ C1] ? lock_release+0x1d5/0x250 [11336.622335][ C1] vfs_read+0x911/0xc00 [11336.622562][ C1] ? lock_acquire+0x1c1/0x220 [11336.622806][ C1] ? __might_fault+0xc6/0x180 [11336.623052][ C1] ? __pfx_vfs_read+0x10/0x10 [11336.623301][ C1] ? __might_fault+0xc6/0x180 [11336.623547][ C1] ? lock_release+0x1d5/0x250 [11336.623787][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11336.624063][ C1] ? __fget_light+0x54/0x1e0 [11336.624304][ C1] ksys_read+0x17a/0x1e0 [11336.624530][ C1] ? __pfx_ksys_read+0x10/0x10 [11336.624773][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11336.625085][ C1] do_syscall_64+0xc9/0x1e0 [11336.625324][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11336.625624][ C1] RIP: 0033:0x7f08a1ea38b2 [11336.625861][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11336.626864][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11336.627294][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11336.627707][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11336.628115][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11336.628518][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11336.628931][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11336.629339][ C1] [11336.629503][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8367s! [swapper/2:0] [11336.629933][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11336.631217][ C2] irq event stamp: 44114564 [11336.631445][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11336.631983][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11336.632534][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11336.633032][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11336.633583][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11336.634068][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11336.634746][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11336.635080][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11336.636113][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11336.636463][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11336.636879][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11336.637316][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11336.637735][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11336.638172][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11336.638602][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11336.639071][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11336.639430][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11336.639853][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11336.640295][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11336.640713][ C2] PKRU: 55555554 [11336.640904][ C2] Call Trace: [11336.641089][ C2] [11336.641248][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11336.641535][ C2] ? __run_hrtimer+0x1c0/0x710 [11336.641801][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11336.642097][ C2] ? __hrtimer_run_queues+0x197/0x270 [11336.642407][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11336.642714][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11336.642999][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11336.643347][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11336.643616][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11336.643899][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11336.644249][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11336.644581][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11336.644922][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11336.645261][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11336.645560][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11336.645849][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11336.646201][ C2] ? get_stack_info+0x36/0xc0 [11336.646459][ C2] ? lock_acquire+0x1c1/0x220 [11336.646718][ C2] ? lock_release+0x1d5/0x250 [11336.646974][ C2] do_raw_spin_lock+0x1ec/0x270 [11336.647242][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11336.647513][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11336.647801][ C2] ? lock_acquire+0x1c1/0x220 [11336.648040][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11336.648292][ C2] _raw_spin_lock_nested+0x65/0x80 [11336.648551][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11336.648788][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11336.649037][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11336.649350][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11336.649625][ C2] ip_local_deliver_finish+0x2ae/0x480 [11336.649901][ C2] ip_local_deliver+0x19d/0x480 [11336.650151][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11336.650435][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11336.650700][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11336.651047][ C2] ? rcu_read_lock_held+0xe/0x50 [11336.651312][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11336.651632][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11336.651895][ C2] ip_rcv+0x564/0x740 [11336.652098][ C2] ? __pfx_ip_rcv+0x10/0x10 [11336.652339][ C2] ? set_track_prepare+0x8a/0xd0 [11336.652593][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11336.652868][ C2] ? start_secondary+0x21c/0x2b0 [11336.653120][ C2] ? skb_clone+0x10b/0x330 [11336.653442][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11336.653790][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11336.654095][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11336.654390][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11336.654684][ C2] ? __tcf_classify+0x329/0x7d0 [11336.654934][ C2] ? __pfx_ip_rcv+0x10/0x10 [11336.655167][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11336.655499][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11336.655805][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11336.656157][ C2] ? lock_acquire+0x1c1/0x220 [11336.656412][ C2] ? netif_receive_skb_internal+0x84/0x300 [11336.656727][ C2] netif_receive_skb_internal+0xb0/0x300 [11336.657030][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11336.657357][ C2] ? __copy_skb_header+0xaf/0x490 [11336.657634][ C2] ? __skb_clone+0x57a/0x760 [11336.657881][ C2] netif_receive_skb+0x55/0x280 [11336.658136][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11336.658500][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11336.658851][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11336.659169][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11336.659475][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11336.659781][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11336.660124][ C2] ? get_stack_info+0x36/0xc0 [11336.660408][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11336.660684][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11336.661029][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11336.661338][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11336.661621][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11336.661956][ C2] ? kernel_text_address+0x17/0xe0 [11336.662252][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11336.662595][ C2] ? arch_stack_walk+0x8c/0x100 [11336.662864][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11336.663140][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11336.663448][ C2] ? lock_acquire+0x1c1/0x220 [11336.663705][ C2] ? stack_depot_save_flags+0x281/0x550 [11336.664006][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11336.664356][ C2] ? get_stack_info_noinstr+0x18/0x110 [11336.664647][ C2] ? get_stack_info+0x36/0xc0 [11336.664896][ C2] __tcf_classify+0x329/0x7d0 [11336.665166][ C2] tcf_classify+0x283/0x930 [11336.665439][ C2] ? __pfx_tcf_classify+0x10/0x10 [11336.665699][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11336.666030][ C2] tc_run+0x2e4/0x5d0 [11336.666290][ C2] ? __pfx_tc_run+0x10/0x10 [11336.666541][ C2] ? lock_acquire+0x1c1/0x220 [11336.666788][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11336.667067][ C2] __dev_queue_xmit+0x686/0x17e0 [11336.667334][ C2] ? lock_acquire+0x1c1/0x220 [11336.667571][ C2] ? ip_finish_output2+0x786/0x18e0 [11336.667862][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11336.668188][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11336.668492][ C2] ? neigh_hh_output+0x348/0x590 [11336.668772][ C2] ? ip_finish_output2+0x262/0x18e0 [11336.669038][ C2] ip_finish_output2+0x786/0x18e0 [11336.669364][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11336.669704][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11336.669999][ C2] ? rcu_read_lock_held+0xe/0x50 [11336.670263][ C2] ? __ip_finish_output+0x10f/0x770 [11336.670526][ C2] ip_output+0x16b/0x4f0 [11336.670751][ C2] ? __pfx_ip_output+0x10/0x10 [11336.670993][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11336.671290][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11336.671609][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11336.671886][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11336.672146][ C2] ? __alloc_skb+0xd4/0x280 [11336.672384][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11336.672662][ C2] ? tcp_fragment+0x168/0x1040 [11336.672904][ C2] ? rcu_read_lock_held+0xe/0x50 [11336.673162][ C2] ? ip_local_out+0x114/0x3b0 [11336.673463][ C2] __ip_queue_xmit+0x672/0x1910 [11336.673711][ C2] ? __skb_clone+0x57a/0x760 [11336.673953][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11336.674235][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11336.674515][ C2] ? ipv4_dst_check+0xe3/0x170 [11336.674760][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11336.675010][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11336.675335][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11336.675666][ C2] ? tcp_fragment+0xb0e/0x1040 [11336.675929][ C2] tcp_send_loss_probe+0x348/0x830 [11336.676242][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11336.676532][ C2] tcp_write_timer+0x82/0x1d0 [11336.676788][ C2] call_timer_fn+0x173/0x430 [11336.677028][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11336.677381][ C2] ? next_expiry_recalc+0xcd/0x220 [11336.677685][ C2] __run_timers.part.0+0x52d/0x890 [11336.677944][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11336.678228][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11336.678514][ C2] ? lock_acquire+0x1c1/0x220 [11336.678772][ C2] ? clockevents_program_event+0xf6/0x300 [11336.679069][ C2] ? lock_release+0x1d5/0x250 [11336.679336][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11336.679605][ C2] ? ktime_get+0xb3/0x190 [11336.679824][ C2] ? clockevents_program_event+0x1ea/0x300 [11336.680121][ C2] run_timer_softirq+0x72/0x100 [11336.680380][ C2] __do_softirq+0x1b9/0x7ff [11336.680612][ C2] irq_exit_rcu+0x98/0xc0 [11336.680836][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11336.681123][ C2] [11336.681291][ C2] [11336.681440][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11336.681746][ C2] RIP: 0010:default_idle+0xf/0x20 [11336.682006][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11336.682982][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11336.683310][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11336.683709][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11336.684107][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11336.684514][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11336.684912][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11336.685322][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11336.685618][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11336.685884][ C2] default_idle_call+0x69/0xa0 [11336.686133][ C2] cpuidle_idle_call+0x1f6/0x280 [11336.686412][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11336.686718][ C2] ? lock_release+0x1d5/0x250 [11336.686954][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11336.687289][ C2] do_idle+0xfb/0x160 [11336.687495][ C2] cpu_startup_entry+0x55/0x60 [11336.687757][ C2] start_secondary+0x21c/0x2b0 [11336.688023][ C2] ? __pfx_start_secondary+0x10/0x10 [11336.688307][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11336.688643][ C2] [11360.935104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11360.935486][ C1] rcu: 1-....: (8694202 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2103138 [11360.936056][ C1] rcu: (t=9006048 jiffies g=1882453 q=730 ncpus=4) [11360.936395][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11360.936846][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11360.937465][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11360.937821][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11360.938847][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11360.939164][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11360.939594][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11360.940024][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11360.940432][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11360.940852][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11360.941298][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11360.941769][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11360.942104][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11360.942507][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11360.942911][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11360.943312][ C1] PKRU: 55555554 [11360.943496][ C1] Call Trace: [11360.943668][ C1] [11360.943820][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11360.944097][ C1] ? print_cpu_stall+0x263/0x6a0 [11360.944351][ C1] ? check_cpu_stall+0x284/0x500 [11360.944604][ C1] ? rcu_pending+0x92/0x360 [11360.944835][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11360.945108][ C1] ? update_process_times+0xb9/0x110 [11360.945381][ C1] ? tick_sched_handle+0x67/0x130 [11360.945641][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11360.945927][ C1] ? __run_hrtimer+0x1c0/0x710 [11360.946178][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11360.946492][ C1] ? __hrtimer_run_queues+0x197/0x270 [11360.946765][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11360.947057][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11360.947325][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11360.947634][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11360.947904][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11360.948227][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11360.948529][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11360.948868][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11360.949176][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11360.949479][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11360.949796][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11360.950125][ C1] ? get_stack_info+0x36/0xc0 [11360.950369][ C1] ? lock_acquire+0x1c1/0x220 [11360.950629][ C1] ? lock_release+0x1d5/0x250 [11360.950877][ C1] do_raw_spin_lock+0x1ec/0x270 [11360.951142][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11360.951435][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11360.951720][ C1] ? lock_acquire+0x1c1/0x220 [11360.951983][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11360.952227][ C1] _raw_spin_lock_nested+0x65/0x80 [11360.952489][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11360.952726][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11360.952973][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11360.953232][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11360.953514][ C1] ip_local_deliver_finish+0x2ae/0x480 [11360.953792][ C1] ip_local_deliver+0x19d/0x480 [11360.954040][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11360.954320][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11360.954585][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11360.954934][ C1] ? rcu_read_lock_held+0xe/0x50 [11360.955188][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11360.955509][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11360.955774][ C1] ip_rcv+0x564/0x740 [11360.955980][ C1] ? __pfx_ip_rcv+0x10/0x10 [11360.956217][ C1] ? set_track_prepare+0x8a/0xd0 [11360.956473][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11360.956752][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11360.957026][ C1] ? skb_clone+0x10b/0x330 [11360.957256][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11360.957576][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11360.957885][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11360.958170][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11360.958466][ C1] ? __tcf_classify+0x329/0x7d0 [11360.958717][ C1] ? __pfx_ip_rcv+0x10/0x10 [11360.958949][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11360.959250][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11360.959536][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11360.959863][ C1] ? lock_acquire+0x1c1/0x220 [11360.960099][ C1] ? netif_receive_skb_internal+0x84/0x300 [11360.960398][ C1] netif_receive_skb_internal+0xb0/0x300 [11360.960684][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11360.961001][ C1] ? __copy_skb_header+0xaf/0x490 [11360.961266][ C1] ? __skb_clone+0x57a/0x760 [11360.961503][ C1] netif_receive_skb+0x55/0x280 [11360.961779][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11360.962094][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11360.962427][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11360.962726][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11360.963018][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11360.963327][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11360.963657][ C1] ? hlock_class+0x4e/0x130 [11360.963893][ C1] ? get_stack_info_noinstr+0x18/0x110 [11360.964184][ C1] ? get_stack_info_noinstr+0x18/0x110 [11360.964475][ C1] ? __pfx_validate_chain+0x10/0x10 [11360.964770][ C1] ? hlock_class+0x4e/0x130 [11360.965003][ C1] ? mark_lock+0x38/0x3e0 [11360.965222][ C1] ? stack_access_ok+0xda/0x1f0 [11360.965473][ C1] ? __lock_acquire+0xb67/0x1610 [11360.965726][ C1] ? get_stack_info_noinstr+0x18/0x110 [11360.966004][ C1] ? get_stack_info+0x36/0xc0 [11360.966254][ C1] ? stack_access_ok+0xda/0x1f0 [11360.966503][ C1] ? get_reg+0x119/0x190 [11360.966723][ C1] ? unwind_next_frame+0x12af/0x1d10 [11360.966993][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11360.967304][ C1] __tcf_classify+0x329/0x7d0 [11360.967546][ C1] tcf_classify+0x283/0x930 [11360.967780][ C1] ? arch_stack_walk+0xa2/0x100 [11360.968032][ C1] ? __pfx_tcf_classify+0x10/0x10 [11360.968289][ C1] ? get_stack_info+0x36/0xc0 [11360.968531][ C1] tc_run+0x2e4/0x5d0 [11360.968740][ C1] ? __pfx_tc_run+0x10/0x10 [11360.968970][ C1] ? lock_acquire+0x1c1/0x220 [11360.969211][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11360.969472][ C1] __dev_queue_xmit+0x686/0x17e0 [11360.969726][ C1] ? lock_acquire+0x1c1/0x220 [11360.969966][ C1] ? ip_finish_output2+0x786/0x18e0 [11360.970232][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11360.970539][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11360.970812][ C1] ? neigh_hh_output+0x348/0x590 [11360.971066][ C1] ? ip_finish_output2+0x262/0x18e0 [11360.971331][ C1] ip_finish_output2+0x786/0x18e0 [11360.971589][ C1] ? stack_depot_save_flags+0x45/0x550 [11360.971868][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11360.972223][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11360.972512][ C1] ? rcu_read_lock_held+0xe/0x50 [11360.972768][ C1] ? __ip_finish_output+0x10f/0x770 [11360.973045][ C1] ip_output+0x16b/0x4f0 [11360.973282][ C1] ? run_timer_softirq+0x72/0x100 [11360.973549][ C1] ? __pfx_ip_output+0x10/0x10 [11360.973792][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11360.974079][ C1] ? rcu_read_lock_held+0xe/0x50 [11360.974350][ C1] ? ip_local_out+0x114/0x3b0 [11360.974606][ C1] __ip_queue_xmit+0x672/0x1910 [11360.974861][ C1] ? __create_object+0x5e/0xb0 [11360.975123][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11360.975400][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11360.975695][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11360.975987][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11360.976318][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11360.976608][ C1] tcp_delack_timer+0x84/0x240 [11360.976861][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11360.977143][ C1] call_timer_fn+0x173/0x430 [11360.977406][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11360.977670][ C1] ? next_expiry_recalc+0xcd/0x220 [11360.977932][ C1] __run_timers.part.0+0x52d/0x890 [11360.978193][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11360.978468][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11360.978776][ C1] ? lock_acquire+0x1c1/0x220 [11360.979030][ C1] ? clockevents_program_event+0xf6/0x300 [11360.979339][ C1] ? lock_release+0x1d5/0x250 [11360.979579][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11360.979877][ C1] ? ktime_get+0xb3/0x190 [11360.980111][ C1] ? clockevents_program_event+0x1ea/0x300 [11360.980422][ C1] run_timer_softirq+0x72/0x100 [11360.980671][ C1] __do_softirq+0x1b9/0x7ff [11360.980917][ C1] irq_exit_rcu+0x98/0xc0 [11360.981150][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11360.981440][ C1] [11360.981615][ C1] [11360.981765][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11360.982081][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11360.982409][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11360.983400][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11360.983728][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11360.984127][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11360.984547][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11360.984947][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11360.985349][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11360.985750][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11360.986055][ C1] pipe_read+0xa16/0xdf0 [11360.986279][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11360.986578][ C1] ? __pfx_pipe_read+0x10/0x10 [11360.986836][ C1] ? iterate_tty_write+0x299/0x540 [11360.987108][ C1] ? lock_release+0x1d5/0x250 [11360.987382][ C1] vfs_read+0x911/0xc00 [11360.987635][ C1] ? lock_acquire+0x1c1/0x220 [11360.987876][ C1] ? __might_fault+0xc6/0x180 [11360.988137][ C1] ? __pfx_vfs_read+0x10/0x10 [11360.988389][ C1] ? __might_fault+0xc6/0x180 [11360.988627][ C1] ? lock_release+0x1d5/0x250 [11360.988880][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11360.989162][ C1] ? __fget_light+0x54/0x1e0 [11360.989425][ C1] ksys_read+0x17a/0x1e0 [11360.989649][ C1] ? __pfx_ksys_read+0x10/0x10 [11360.989895][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11360.990203][ C1] do_syscall_64+0xc9/0x1e0 [11360.990439][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11360.990757][ C1] RIP: 0033:0x7f08a1ea38b2 [11360.990989][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11360.991988][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11360.992412][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11360.992844][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11360.993257][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11360.993679][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11360.994139][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11360.994557][ C1] [11360.994733][ C1] Sending NMI from CPU 1 to CPUs 2: [11360.995009][ C2] NMI backtrace for cpu 2 [11360.995025][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11360.995033][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11360.995038][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11360.995048][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11360.995054][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11360.995060][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11360.995064][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11360.995067][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11360.995069][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11360.995070][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11360.995072][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11360.995074][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11360.995078][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11360.995079][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11360.995081][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11360.995082][ C2] PKRU: 55555554 [11360.995083][ C2] Call Trace: [11360.995086][ C2] [11360.995089][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11360.995097][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11360.995103][ C2] ? nmi_handle+0x153/0x420 [11360.995109][ C2] ? default_do_nmi+0x41/0x100 [11360.995112][ C2] ? exc_nmi+0xf3/0x120 [11360.995115][ C2] ? end_repeat_nmi+0xf/0x60 [11360.995120][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11360.995123][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11360.995126][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11360.995130][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11360.995133][ C2] [11360.995134][ C2] [11360.995136][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11360.995139][ C2] ? get_stack_info+0x36/0xc0 [11360.995143][ C2] ? lock_acquire+0x1c1/0x220 [11360.995147][ C2] ? lock_release+0x1d5/0x250 [11360.995150][ C2] do_raw_spin_lock+0x1ec/0x270 [11360.995154][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11360.995157][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11360.995161][ C2] ? lock_acquire+0x1c1/0x220 [11360.995163][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11360.995168][ C2] _raw_spin_lock_nested+0x65/0x80 [11360.995171][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11360.995178][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11360.995181][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11360.995186][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11360.995193][ C2] ip_local_deliver_finish+0x2ae/0x480 [11360.995196][ C2] ip_local_deliver+0x19d/0x480 [11360.995198][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11360.995200][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11360.995203][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11360.995209][ C2] ? rcu_read_lock_held+0xe/0x50 [11360.995214][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11360.995217][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11360.995227][ C2] ip_rcv+0x564/0x740 [11360.995230][ C2] ? __pfx_ip_rcv+0x10/0x10 [11360.995232][ C2] ? set_track_prepare+0x8a/0xd0 [11360.995238][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11360.995241][ C2] ? start_secondary+0x21c/0x2b0 [11360.995246][ C2] ? skb_clone+0x10b/0x330 [11360.995250][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11360.995257][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11360.995262][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11360.995268][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11360.995276][ C2] ? __tcf_classify+0x329/0x7d0 [11360.995281][ C2] ? __pfx_ip_rcv+0x10/0x10 [11360.995283][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11360.995287][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11360.995290][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11360.995295][ C2] ? lock_acquire+0x1c1/0x220 [11360.995297][ C2] ? netif_receive_skb_internal+0x84/0x300 [11360.995301][ C2] netif_receive_skb_internal+0xb0/0x300 [11360.995305][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11360.995309][ C2] ? __copy_skb_header+0xaf/0x490 [11360.995315][ C2] ? __skb_clone+0x57a/0x760 [11360.995318][ C2] netif_receive_skb+0x55/0x280 [11360.995321][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11360.995329][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11360.995336][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11360.995343][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11360.995348][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11360.995359][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11360.995366][ C2] ? get_stack_info+0x36/0xc0 [11360.995371][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11360.995374][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11360.995381][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11360.995383][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11360.995387][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11360.995390][ C2] ? kernel_text_address+0x17/0xe0 [11360.995394][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11360.995400][ C2] ? arch_stack_walk+0x8c/0x100 [11360.995405][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11360.995408][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11360.995411][ C2] ? lock_acquire+0x1c1/0x220 [11360.995413][ C2] ? stack_depot_save_flags+0x281/0x550 [11360.995419][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11360.995423][ C2] ? get_stack_info_noinstr+0x18/0x110 [11360.995426][ C2] ? get_stack_info+0x36/0xc0 [11360.995430][ C2] __tcf_classify+0x329/0x7d0 [11360.995435][ C2] tcf_classify+0x283/0x930 [11360.995440][ C2] ? __pfx_tcf_classify+0x10/0x10 [11360.995443][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11360.995448][ C2] tc_run+0x2e4/0x5d0 [11360.995453][ C2] ? __pfx_tc_run+0x10/0x10 [11360.995456][ C2] ? lock_acquire+0x1c1/0x220 [11360.995458][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11360.995462][ C2] __dev_queue_xmit+0x686/0x17e0 [11360.995466][ C2] ? lock_acquire+0x1c1/0x220 [11360.995469][ C2] ? ip_finish_output2+0x786/0x18e0 [11360.995473][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11360.995476][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11360.995479][ C2] ? neigh_hh_output+0x348/0x590 [11360.995482][ C2] ? ip_finish_output2+0x262/0x18e0 [11360.995486][ C2] ip_finish_output2+0x786/0x18e0 [11360.995489][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11360.995497][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11360.995499][ C2] ? rcu_read_lock_held+0xe/0x50 [11360.995503][ C2] ? __ip_finish_output+0x10f/0x770 [11360.995507][ C2] ip_output+0x16b/0x4f0 [11360.995510][ C2] ? __pfx_ip_output+0x10/0x10 [11360.995513][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11360.995516][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11360.995519][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11360.995523][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11360.995525][ C2] ? __alloc_skb+0xd4/0x280 [11360.995528][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11360.995533][ C2] ? tcp_fragment+0x168/0x1040 [11360.995536][ C2] ? rcu_read_lock_held+0xe/0x50 [11360.995539][ C2] ? ip_local_out+0x114/0x3b0 [11360.995542][ C2] __ip_queue_xmit+0x672/0x1910 [11360.995546][ C2] ? __skb_clone+0x57a/0x760 [11360.995549][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11360.995554][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11360.995557][ C2] ? ipv4_dst_check+0xe3/0x170 [11360.995562][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11360.995568][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11360.995573][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11360.995576][ C2] ? tcp_fragment+0xb0e/0x1040 [11360.995579][ C2] tcp_send_loss_probe+0x348/0x830 [11360.995583][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11360.995585][ C2] tcp_write_timer+0x82/0x1d0 [11360.995589][ C2] call_timer_fn+0x173/0x430 [11360.995593][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11360.995598][ C2] ? next_expiry_recalc+0xcd/0x220 [11360.995602][ C2] __run_timers.part.0+0x52d/0x890 [11360.995605][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11360.995610][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11360.995613][ C2] ? lock_acquire+0x1c1/0x220 [11360.995615][ C2] ? clockevents_program_event+0xf6/0x300 [11360.995619][ C2] ? lock_release+0x1d5/0x250 [11360.995622][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11360.995625][ C2] ? ktime_get+0xb3/0x190 [11360.995629][ C2] ? clockevents_program_event+0x1ea/0x300 [11360.995634][ C2] run_timer_softirq+0x72/0x100 [11360.995637][ C2] __do_softirq+0x1b9/0x7ff [11360.995642][ C2] irq_exit_rcu+0x98/0xc0 [11360.995645][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11360.995649][ C2] [11360.995650][ C2] [11360.995651][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11360.995654][ C2] RIP: 0010:default_idle+0xf/0x20 [11360.995659][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11360.995661][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11360.995664][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11360.995666][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11360.995668][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11360.995669][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11360.995671][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11360.995674][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11360.995677][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11360.995682][ C2] default_idle_call+0x69/0xa0 [11360.995686][ C2] cpuidle_idle_call+0x1f6/0x280 [11360.995688][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11360.995693][ C2] ? lock_release+0x1d5/0x250 [11360.995695][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11360.995700][ C2] do_idle+0xfb/0x160 [11360.995702][ C2] cpu_startup_entry+0x55/0x60 [11360.995705][ C2] start_secondary+0x21c/0x2b0 [11360.995708][ C2] ? __pfx_start_secondary+0x10/0x10 [11360.995713][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11360.995719][ C2] [11388.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8415s! [perl:4135] [11388.569894][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11388.571726][ C1] irq event stamp: 209232 [11388.572046][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11388.572815][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11388.573506][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11388.574188][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11388.574859][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11388.575511][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11388.576395][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11388.576873][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11388.578269][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11388.578713][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11388.579294][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11388.579875][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11388.580455][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11388.581034][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11388.581615][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11388.582263][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11388.582748][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11388.583315][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11388.583887][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11388.584306][ C1] PKRU: 55555554 [11388.584483][ C1] Call Trace: [11388.584653][ C1] [11388.584801][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11388.585059][ C1] ? __run_hrtimer+0x1c0/0x710 [11388.585312][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11388.585585][ C1] ? __hrtimer_run_queues+0x197/0x270 [11388.585850][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11388.586167][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11388.586427][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11388.586724][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11388.586981][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11388.587290][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11388.587581][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11388.587891][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11388.588180][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11388.588470][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11388.588751][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11388.589055][ C1] ? get_stack_info+0x36/0xc0 [11388.589307][ C1] ? lock_acquire+0x1c1/0x220 [11388.589543][ C1] ? lock_release+0x1d5/0x250 [11388.589775][ C1] do_raw_spin_lock+0x1ec/0x270 [11388.590018][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11388.590354][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11388.590729][ C1] ? lock_acquire+0x1c1/0x220 [11388.591073][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11388.591421][ C1] _raw_spin_lock_nested+0x65/0x80 [11388.591796][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11388.592137][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11388.592496][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11388.592871][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11388.593273][ C1] ip_local_deliver_finish+0x2ae/0x480 [11388.593677][ C1] ip_local_deliver+0x19d/0x480 [11388.594037][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11388.594428][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11388.594809][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11388.595309][ C1] ? rcu_read_lock_held+0xe/0x50 [11388.595678][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11388.596148][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11388.596531][ C1] ip_rcv+0x564/0x740 [11388.596827][ C1] ? __pfx_ip_rcv+0x10/0x10 [11388.597161][ C1] ? set_track_prepare+0x8a/0xd0 [11388.597526][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11388.597925][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11388.598316][ C1] ? skb_clone+0x10b/0x330 [11388.598644][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11388.599106][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11388.599549][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11388.599955][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11388.600383][ C1] ? __tcf_classify+0x329/0x7d0 [11388.600744][ C1] ? __pfx_ip_rcv+0x10/0x10 [11388.601077][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11388.601514][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11388.601929][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11388.602399][ C1] ? lock_acquire+0x1c1/0x220 [11388.602745][ C1] ? netif_receive_skb_internal+0x84/0x300 [11388.603158][ C1] netif_receive_skb_internal+0xb0/0x300 [11388.603558][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11388.604016][ C1] ? __copy_skb_header+0xaf/0x490 [11388.604280][ C1] ? __skb_clone+0x57a/0x760 [11388.604509][ C1] netif_receive_skb+0x55/0x280 [11388.604753][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11388.605060][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11388.605396][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11388.605685][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11388.605966][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11388.606266][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11388.606570][ C1] ? hlock_class+0x4e/0x130 [11388.606797][ C1] ? get_stack_info_noinstr+0x18/0x110 [11388.607073][ C1] ? get_stack_info_noinstr+0x18/0x110 [11388.607358][ C1] ? __pfx_validate_chain+0x10/0x10 [11388.607615][ C1] ? hlock_class+0x4e/0x130 [11388.607840][ C1] ? mark_lock+0x38/0x3e0 [11388.608053][ C1] ? stack_access_ok+0xda/0x1f0 [11388.608303][ C1] ? __lock_acquire+0xb67/0x1610 [11388.608549][ C1] ? get_stack_info_noinstr+0x18/0x110 [11388.608818][ C1] ? get_stack_info+0x36/0xc0 [11388.609054][ C1] ? stack_access_ok+0xda/0x1f0 [11388.609302][ C1] ? get_reg+0x119/0x190 [11388.609510][ C1] ? unwind_next_frame+0x12af/0x1d10 [11388.609771][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11388.610080][ C1] __tcf_classify+0x329/0x7d0 [11388.610322][ C1] tcf_classify+0x283/0x930 [11388.610549][ C1] ? arch_stack_walk+0xa2/0x100 [11388.610790][ C1] ? __pfx_tcf_classify+0x10/0x10 [11388.611040][ C1] ? get_stack_info+0x36/0xc0 [11388.611326][ C1] tc_run+0x2e4/0x5d0 [11388.611527][ C1] ? __pfx_tc_run+0x10/0x10 [11388.611752][ C1] ? lock_acquire+0x1c1/0x220 [11388.611985][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11388.612245][ C1] __dev_queue_xmit+0x686/0x17e0 [11388.612492][ C1] ? lock_acquire+0x1c1/0x220 [11388.612724][ C1] ? ip_finish_output2+0x786/0x18e0 [11388.612982][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11388.613279][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11388.613545][ C1] ? neigh_hh_output+0x348/0x590 [11388.613790][ C1] ? ip_finish_output2+0x262/0x18e0 [11388.614048][ C1] ip_finish_output2+0x786/0x18e0 [11388.614314][ C1] ? stack_depot_save_flags+0x45/0x550 [11388.614584][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11388.614913][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11388.615184][ C1] ? rcu_read_lock_held+0xe/0x50 [11388.615431][ C1] ? __ip_finish_output+0x10f/0x770 [11388.615690][ C1] ip_output+0x16b/0x4f0 [11388.615913][ C1] ? run_timer_softirq+0x72/0x100 [11388.616163][ C1] ? __pfx_ip_output+0x10/0x10 [11388.616401][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11388.616682][ C1] ? rcu_read_lock_held+0xe/0x50 [11388.616927][ C1] ? ip_local_out+0x114/0x3b0 [11388.617162][ C1] __ip_queue_xmit+0x672/0x1910 [11388.617404][ C1] ? __create_object+0x5e/0xb0 [11388.617642][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11388.617903][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11388.618190][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11388.618456][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11388.618732][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11388.618997][ C1] tcp_delack_timer+0x84/0x240 [11388.619236][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11388.619501][ C1] call_timer_fn+0x173/0x430 [11388.619732][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11388.619987][ C1] ? next_expiry_recalc+0xcd/0x220 [11388.620242][ C1] __run_timers.part.0+0x52d/0x890 [11388.620495][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11388.620761][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11388.621039][ C1] ? lock_acquire+0x1c1/0x220 [11388.621271][ C1] ? clockevents_program_event+0xf6/0x300 [11388.621557][ C1] ? lock_release+0x1d5/0x250 [11388.621790][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11388.622049][ C1] ? ktime_get+0xb3/0x190 [11388.622277][ C1] ? clockevents_program_event+0x1ea/0x300 [11388.622567][ C1] run_timer_softirq+0x72/0x100 [11388.622810][ C1] __do_softirq+0x1b9/0x7ff [11388.623036][ C1] irq_exit_rcu+0x98/0xc0 [11388.623260][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11388.623538][ C1] [11388.623687][ C1] [11388.623833][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11388.624146][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11388.624463][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11388.625416][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11388.625718][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11388.626136][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11388.626523][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11388.626911][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11388.627308][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11388.627698][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11388.627987][ C1] pipe_read+0xa16/0xdf0 [11388.628211][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11388.628483][ C1] ? __pfx_pipe_read+0x10/0x10 [11388.628721][ C1] ? iterate_tty_write+0x299/0x540 [11388.628977][ C1] ? lock_release+0x1d5/0x250 [11388.629217][ C1] vfs_read+0x911/0xc00 [11388.629426][ C1] ? lock_acquire+0x1c1/0x220 [11388.629659][ C1] ? __might_fault+0xc6/0x180 [11388.629894][ C1] ? __pfx_vfs_read+0x10/0x10 [11388.630136][ C1] ? __might_fault+0xc6/0x180 [11388.630372][ C1] ? lock_release+0x1d5/0x250 [11388.630606][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11388.630864][ C1] ? __fget_light+0x54/0x1e0 [11388.631106][ C1] ksys_read+0x17a/0x1e0 [11388.631317][ C1] ? __pfx_ksys_read+0x10/0x10 [11388.631555][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11388.631852][ C1] do_syscall_64+0xc9/0x1e0 [11388.632077][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11388.632378][ C1] RIP: 0033:0x7f08a1ea38b2 [11388.632600][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11388.633546][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11388.633954][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11388.634343][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11388.634730][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11388.635117][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11388.635503][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11388.635903][ C1] [11388.636060][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8415s! [swapper/2:0] [11388.636507][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11388.637766][ C2] irq event stamp: 44114564 [11388.637994][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11388.638538][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11388.639050][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11388.639528][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11388.640000][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11388.640462][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11388.641074][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11388.641400][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11388.642371][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11388.642680][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11388.643078][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11388.643481][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11388.643879][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11388.644279][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11388.644677][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11388.645124][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11388.645458][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11388.645859][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11388.646268][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11388.646665][ C2] PKRU: 55555554 [11388.646846][ C2] Call Trace: [11388.647018][ C2] [11388.647169][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11388.647431][ C2] ? __run_hrtimer+0x1c0/0x710 [11388.647676][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11388.647953][ C2] ? __hrtimer_run_queues+0x197/0x270 [11388.648227][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11388.648513][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11388.648778][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11388.649087][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11388.649349][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11388.649613][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11388.649922][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11388.650220][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11388.650536][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11388.650825][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11388.651122][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11388.651409][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11388.651722][ C2] ? get_stack_info+0x36/0xc0 [11388.651965][ C2] ? lock_acquire+0x1c1/0x220 [11388.652207][ C2] ? lock_release+0x1d5/0x250 [11388.652446][ C2] do_raw_spin_lock+0x1ec/0x270 [11388.652696][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11388.652969][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11388.653255][ C2] ? lock_acquire+0x1c1/0x220 [11388.653495][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11388.653734][ C2] _raw_spin_lock_nested+0x65/0x80 [11388.653996][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11388.654233][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11388.654485][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11388.654744][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11388.655020][ C2] ip_local_deliver_finish+0x2ae/0x480 [11388.655298][ C2] ip_local_deliver+0x19d/0x480 [11388.655544][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11388.655818][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11388.656091][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11388.656438][ C2] ? rcu_read_lock_held+0xe/0x50 [11388.656693][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11388.657014][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11388.657278][ C2] ip_rcv+0x564/0x740 [11388.657481][ C2] ? __pfx_ip_rcv+0x10/0x10 [11388.657713][ C2] ? set_track_prepare+0x8a/0xd0 [11388.657967][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11388.658242][ C2] ? start_secondary+0x21c/0x2b0 [11388.658494][ C2] ? skb_clone+0x10b/0x330 [11388.658724][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11388.659044][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11388.659349][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11388.659634][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11388.659927][ C2] ? __tcf_classify+0x329/0x7d0 [11388.660178][ C2] ? __pfx_ip_rcv+0x10/0x10 [11388.660409][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11388.660707][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11388.660993][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11388.661319][ C2] ? lock_acquire+0x1c1/0x220 [11388.661559][ C2] ? netif_receive_skb_internal+0x84/0x300 [11388.661854][ C2] netif_receive_skb_internal+0xb0/0x300 [11388.662142][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11388.662460][ C2] ? __copy_skb_header+0xaf/0x490 [11388.662718][ C2] ? __skb_clone+0x57a/0x760 [11388.662950][ C2] netif_receive_skb+0x55/0x280 [11388.663199][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11388.663512][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11388.663844][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11388.664145][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11388.664418][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11388.664706][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11388.665020][ C2] ? get_stack_info+0x36/0xc0 [11388.665266][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11388.665531][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11388.665850][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11388.666132][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11388.666410][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11388.666724][ C2] ? kernel_text_address+0x17/0xe0 [11388.666986][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11388.667299][ C2] ? arch_stack_walk+0x8c/0x100 [11388.667548][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11388.667815][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11388.668100][ C2] ? lock_acquire+0x1c1/0x220 [11388.668340][ C2] ? stack_depot_save_flags+0x281/0x550 [11388.668622][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11388.668929][ C2] ? get_stack_info_noinstr+0x18/0x110 [11388.669205][ C2] ? get_stack_info+0x36/0xc0 [11388.669448][ C2] __tcf_classify+0x329/0x7d0 [11388.669689][ C2] tcf_classify+0x283/0x930 [11388.669921][ C2] ? __pfx_tcf_classify+0x10/0x10 [11388.670179][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11388.670493][ C2] tc_run+0x2e4/0x5d0 [11388.670699][ C2] ? __pfx_tc_run+0x10/0x10 [11388.670931][ C2] ? lock_acquire+0x1c1/0x220 [11388.671173][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11388.671434][ C2] __dev_queue_xmit+0x686/0x17e0 [11388.671688][ C2] ? lock_acquire+0x1c1/0x220 [11388.671926][ C2] ? ip_finish_output2+0x786/0x18e0 [11388.672192][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11388.672494][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11388.672769][ C2] ? neigh_hh_output+0x348/0x590 [11388.673021][ C2] ? ip_finish_output2+0x262/0x18e0 [11388.673287][ C2] ip_finish_output2+0x786/0x18e0 [11388.673544][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11388.673882][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11388.674158][ C2] ? rcu_read_lock_held+0xe/0x50 [11388.674412][ C2] ? __ip_finish_output+0x10f/0x770 [11388.674677][ C2] ip_output+0x16b/0x4f0 [11388.674895][ C2] ? __pfx_ip_output+0x10/0x10 [11388.675138][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11388.675417][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11388.675728][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11388.676043][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11388.676297][ C2] ? __alloc_skb+0xd4/0x280 [11388.676526][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11388.676798][ C2] ? tcp_fragment+0x168/0x1040 [11388.677041][ C2] ? rcu_read_lock_held+0xe/0x50 [11388.677292][ C2] ? ip_local_out+0x114/0x3b0 [11388.677534][ C2] __ip_queue_xmit+0x672/0x1910 [11388.677783][ C2] ? __skb_clone+0x57a/0x760 [11388.678020][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11388.678288][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11388.678568][ C2] ? ipv4_dst_check+0xe3/0x170 [11388.678813][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11388.679063][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11388.679366][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11388.679686][ C2] ? tcp_fragment+0xb0e/0x1040 [11388.679928][ C2] tcp_send_loss_probe+0x348/0x830 [11388.680191][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11388.680460][ C2] tcp_write_timer+0x82/0x1d0 [11388.680699][ C2] call_timer_fn+0x173/0x430 [11388.680938][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11388.681200][ C2] ? next_expiry_recalc+0xcd/0x220 [11388.681461][ C2] __run_timers.part.0+0x52d/0x890 [11388.681722][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11388.681992][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11388.682277][ C2] ? lock_acquire+0x1c1/0x220 [11388.682517][ C2] ? clockevents_program_event+0xf6/0x300 [11388.682808][ C2] ? lock_release+0x1d5/0x250 [11388.683048][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11388.683313][ C2] ? ktime_get+0xb3/0x190 [11388.683534][ C2] ? clockevents_program_event+0x1ea/0x300 [11388.683830][ C2] run_timer_softirq+0x72/0x100 [11388.684079][ C2] __do_softirq+0x1b9/0x7ff [11388.684313][ C2] irq_exit_rcu+0x98/0xc0 [11388.684534][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11388.684820][ C2] [11388.684972][ C2] [11388.685122][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11388.685427][ C2] RIP: 0010:default_idle+0xf/0x20 [11388.685685][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11388.686661][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11388.686968][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11388.687366][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11388.687767][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11388.688169][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11388.688567][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11388.688967][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11388.689257][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11388.689519][ C2] default_idle_call+0x69/0xa0 [11388.689761][ C2] cpuidle_idle_call+0x1f6/0x280 [11388.690012][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11388.690292][ C2] ? lock_release+0x1d5/0x250 [11388.690529][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11388.690803][ C2] do_idle+0xfb/0x160 [11388.691006][ C2] cpu_startup_entry+0x55/0x60 [11388.691251][ C2] start_secondary+0x21c/0x2b0 [11388.691495][ C2] ? __pfx_start_secondary+0x10/0x10 [11388.691767][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11388.692077][ C2] [11416.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8441s! [perl:4135] [11416.569714][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11416.570981][ C1] irq event stamp: 209232 [11416.571206][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11416.571740][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11416.572220][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11416.572691][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11416.573157][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11416.573610][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11416.574225][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11416.574551][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11416.575529][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11416.575846][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11416.576258][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11416.576659][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11416.577059][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11416.577459][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11416.577862][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11416.578310][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11416.578644][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11416.579045][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11416.579444][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11416.579846][ C1] PKRU: 55555554 [11416.580027][ C1] Call Trace: [11416.580200][ C1] [11416.580351][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11416.580616][ C1] ? __run_hrtimer+0x1c0/0x710 [11416.580859][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11416.581141][ C1] ? __hrtimer_run_queues+0x197/0x270 [11416.581414][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11416.581702][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11416.581971][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11416.582278][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11416.582541][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11416.582852][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11416.583156][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11416.583474][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11416.583763][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11416.584060][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11416.584349][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11416.584662][ C1] ? get_stack_info+0x36/0xc0 [11416.584906][ C1] ? lock_acquire+0x1c1/0x220 [11416.585150][ C1] ? lock_release+0x1d5/0x250 [11416.585390][ C1] do_raw_spin_lock+0x1ec/0x270 [11416.585640][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11416.585925][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11416.586210][ C1] ? lock_acquire+0x1c1/0x220 [11416.586450][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11416.586693][ C1] _raw_spin_lock_nested+0x65/0x80 [11416.586954][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11416.587190][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11416.587438][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11416.587698][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11416.587977][ C1] ip_local_deliver_finish+0x2ae/0x480 [11416.588259][ C1] ip_local_deliver+0x19d/0x480 [11416.588507][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11416.588780][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11416.589045][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11416.589395][ C1] ? rcu_read_lock_held+0xe/0x50 [11416.589649][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11416.589971][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11416.590235][ C1] ip_rcv+0x564/0x740 [11416.590440][ C1] ? __pfx_ip_rcv+0x10/0x10 [11416.590672][ C1] ? set_track_prepare+0x8a/0xd0 [11416.590927][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11416.591205][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11416.591481][ C1] ? skb_clone+0x10b/0x330 [11416.591709][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11416.592029][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11416.592337][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11416.592620][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11416.592916][ C1] ? __tcf_classify+0x329/0x7d0 [11416.593167][ C1] ? __pfx_ip_rcv+0x10/0x10 [11416.593396][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11416.593698][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11416.593982][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11416.594310][ C1] ? lock_acquire+0x1c1/0x220 [11416.594550][ C1] ? netif_receive_skb_internal+0x84/0x300 [11416.594848][ C1] netif_receive_skb_internal+0xb0/0x300 [11416.595136][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11416.595454][ C1] ? __copy_skb_header+0xaf/0x490 [11416.595714][ C1] ? __skb_clone+0x57a/0x760 [11416.595959][ C1] netif_receive_skb+0x55/0x280 [11416.596210][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11416.596523][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11416.596857][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11416.597156][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11416.597437][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11416.597727][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11416.598041][ C1] ? hlock_class+0x4e/0x130 [11416.598276][ C1] ? get_stack_info_noinstr+0x18/0x110 [11416.598555][ C1] ? get_stack_info_noinstr+0x18/0x110 [11416.598832][ C1] ? __pfx_validate_chain+0x10/0x10 [11416.599097][ C1] ? hlock_class+0x4e/0x130 [11416.599330][ C1] ? mark_lock+0x38/0x3e0 [11416.599550][ C1] ? stack_access_ok+0xda/0x1f0 [11416.599801][ C1] ? __lock_acquire+0xb67/0x1610 [11416.600056][ C1] ? get_stack_info_noinstr+0x18/0x110 [11416.600334][ C1] ? get_stack_info+0x36/0xc0 [11416.600575][ C1] ? stack_access_ok+0xda/0x1f0 [11416.600824][ C1] ? get_reg+0x119/0x190 [11416.601040][ C1] ? unwind_next_frame+0x12af/0x1d10 [11416.601310][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11416.601620][ C1] __tcf_classify+0x329/0x7d0 [11416.601864][ C1] tcf_classify+0x283/0x930 [11416.602098][ C1] ? arch_stack_walk+0xa2/0x100 [11416.602348][ C1] ? __pfx_tcf_classify+0x10/0x10 [11416.602605][ C1] ? get_stack_info+0x36/0xc0 [11416.602846][ C1] tc_run+0x2e4/0x5d0 [11416.603058][ C1] ? __pfx_tc_run+0x10/0x10 [11416.603292][ C1] ? lock_acquire+0x1c1/0x220 [11416.603533][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11416.603795][ C1] __dev_queue_xmit+0x686/0x17e0 [11416.604050][ C1] ? lock_acquire+0x1c1/0x220 [11416.604290][ C1] ? ip_finish_output2+0x786/0x18e0 [11416.604556][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11416.604863][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11416.605138][ C1] ? neigh_hh_output+0x348/0x590 [11416.605392][ C1] ? ip_finish_output2+0x262/0x18e0 [11416.605658][ C1] ip_finish_output2+0x786/0x18e0 [11416.605923][ C1] ? stack_depot_save_flags+0x45/0x550 [11416.606204][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11416.606542][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11416.606828][ C1] ? rcu_read_lock_held+0xe/0x50 [11416.607081][ C1] ? __ip_finish_output+0x10f/0x770 [11416.607349][ C1] ip_output+0x16b/0x4f0 [11416.607565][ C1] ? run_timer_softirq+0x72/0x100 [11416.607824][ C1] ? __pfx_ip_output+0x10/0x10 [11416.608069][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11416.608356][ C1] ? rcu_read_lock_held+0xe/0x50 [11416.608608][ C1] ? ip_local_out+0x114/0x3b0 [11416.608850][ C1] __ip_queue_xmit+0x672/0x1910 [11416.609100][ C1] ? __create_object+0x5e/0xb0 [11416.609345][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11416.609612][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11416.609893][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11416.610167][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11416.610452][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11416.610725][ C1] tcp_delack_timer+0x84/0x240 [11416.610969][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11416.611242][ C1] call_timer_fn+0x173/0x430 [11416.611479][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11416.611742][ C1] ? next_expiry_recalc+0xcd/0x220 [11416.612005][ C1] __run_timers.part.0+0x52d/0x890 [11416.612266][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11416.612539][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11416.612825][ C1] ? lock_acquire+0x1c1/0x220 [11416.613062][ C1] ? clockevents_program_event+0xf6/0x300 [11416.613358][ C1] ? lock_release+0x1d5/0x250 [11416.613598][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11416.613863][ C1] ? ktime_get+0xb3/0x190 [11416.614084][ C1] ? clockevents_program_event+0x1ea/0x300 [11416.614382][ C1] run_timer_softirq+0x72/0x100 [11416.614631][ C1] __do_softirq+0x1b9/0x7ff [11416.614863][ C1] irq_exit_rcu+0x98/0xc0 [11416.615086][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11416.615373][ C1] [11416.615524][ C1] [11416.615674][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11416.615985][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11416.616311][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11416.617286][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11416.617597][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11416.617997][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11416.618397][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11416.618796][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11416.619197][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11416.619598][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11416.619895][ C1] pipe_read+0xa16/0xdf0 [11416.620117][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11416.620395][ C1] ? __pfx_pipe_read+0x10/0x10 [11416.620639][ C1] ? iterate_tty_write+0x299/0x540 [11416.620902][ C1] ? lock_release+0x1d5/0x250 [11416.621144][ C1] vfs_read+0x911/0xc00 [11416.621364][ C1] ? lock_acquire+0x1c1/0x220 [11416.621604][ C1] ? __might_fault+0xc6/0x180 [11416.621845][ C1] ? __pfx_vfs_read+0x10/0x10 [11416.622084][ C1] ? __might_fault+0xc6/0x180 [11416.622324][ C1] ? lock_release+0x1d5/0x250 [11416.622566][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11416.622832][ C1] ? __fget_light+0x54/0x1e0 [11416.623072][ C1] ksys_read+0x17a/0x1e0 [11416.623290][ C1] ? __pfx_ksys_read+0x10/0x10 [11416.623535][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11416.623842][ C1] do_syscall_64+0xc9/0x1e0 [11416.624074][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11416.624378][ C1] RIP: 0033:0x7f08a1ea38b2 [11416.624609][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11416.625585][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11416.626017][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11416.626421][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11416.626823][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11416.627224][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11416.627624][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11416.628028][ C1] [11416.628188][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8441s! [swapper/2:0] [11416.628617][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11416.629874][ C2] irq event stamp: 44114564 [11416.630103][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11416.630638][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11416.631152][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11416.631635][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11416.632106][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11416.632564][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11416.633183][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11416.633512][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11416.634488][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11416.634799][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11416.635199][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11416.635604][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11416.636014][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11416.636414][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11416.636814][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11416.637269][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11416.637600][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11416.638004][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11416.638405][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11416.638803][ C2] PKRU: 55555554 [11416.638986][ C2] Call Trace: [11416.639159][ C2] [11416.639309][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11416.639573][ C2] ? __run_hrtimer+0x1c0/0x710 [11416.639818][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11416.640094][ C2] ? __hrtimer_run_queues+0x197/0x270 [11416.640370][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11416.640660][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11416.640925][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11416.641233][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11416.641495][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11416.641759][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11416.642079][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11416.642377][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11416.642690][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11416.642984][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11416.643280][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11416.643569][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11416.643881][ C2] ? get_stack_info+0x36/0xc0 [11416.644124][ C2] ? lock_acquire+0x1c1/0x220 [11416.644363][ C2] ? lock_release+0x1d5/0x250 [11416.644604][ C2] do_raw_spin_lock+0x1ec/0x270 [11416.644854][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11416.645127][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11416.645417][ C2] ? lock_acquire+0x1c1/0x220 [11416.645654][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11416.645903][ C2] _raw_spin_lock_nested+0x65/0x80 [11416.646166][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11416.646403][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11416.646652][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11416.646912][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11416.647188][ C2] ip_local_deliver_finish+0x2ae/0x480 [11416.647469][ C2] ip_local_deliver+0x19d/0x480 [11416.647718][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11416.647990][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11416.648256][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11416.648602][ C2] ? rcu_read_lock_held+0xe/0x50 [11416.648855][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11416.649183][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11416.649445][ C2] ip_rcv+0x564/0x740 [11416.649649][ C2] ? __pfx_ip_rcv+0x10/0x10 [11416.649881][ C2] ? set_track_prepare+0x8a/0xd0 [11416.650136][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11416.650412][ C2] ? start_secondary+0x21c/0x2b0 [11416.650664][ C2] ? skb_clone+0x10b/0x330 [11416.650891][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11416.651209][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11416.651517][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11416.651797][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11416.652092][ C2] ? __tcf_classify+0x329/0x7d0 [11416.652341][ C2] ? __pfx_ip_rcv+0x10/0x10 [11416.652575][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11416.652874][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11416.653161][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11416.653487][ C2] ? lock_acquire+0x1c1/0x220 [11416.653726][ C2] ? netif_receive_skb_internal+0x84/0x300 [11416.654023][ C2] netif_receive_skb_internal+0xb0/0x300 [11416.654310][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11416.654628][ C2] ? __copy_skb_header+0xaf/0x490 [11416.654884][ C2] ? __skb_clone+0x57a/0x760 [11416.655120][ C2] netif_receive_skb+0x55/0x280 [11416.655368][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11416.655681][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11416.656027][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11416.656328][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11416.656604][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11416.656893][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11416.657206][ C2] ? get_stack_info+0x36/0xc0 [11416.657451][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11416.657718][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11416.658039][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11416.658318][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11416.658596][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11416.658912][ C2] ? kernel_text_address+0x17/0xe0 [11416.659175][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11416.659489][ C2] ? arch_stack_walk+0x8c/0x100 [11416.659739][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11416.660002][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11416.660290][ C2] ? lock_acquire+0x1c1/0x220 [11416.660530][ C2] ? stack_depot_save_flags+0x281/0x550 [11416.660811][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11416.661118][ C2] ? get_stack_info_noinstr+0x18/0x110 [11416.661395][ C2] ? get_stack_info+0x36/0xc0 [11416.661638][ C2] __tcf_classify+0x329/0x7d0 [11416.661894][ C2] tcf_classify+0x283/0x930 [11416.662127][ C2] ? __pfx_tcf_classify+0x10/0x10 [11416.662381][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11416.662697][ C2] tc_run+0x2e4/0x5d0 [11416.662901][ C2] ? __pfx_tc_run+0x10/0x10 [11416.663133][ C2] ? lock_acquire+0x1c1/0x220 [11416.663372][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11416.663632][ C2] __dev_queue_xmit+0x686/0x17e0 [11416.663884][ C2] ? lock_acquire+0x1c1/0x220 [11416.664120][ C2] ? ip_finish_output2+0x786/0x18e0 [11416.664384][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11416.664688][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11416.664959][ C2] ? neigh_hh_output+0x348/0x590 [11416.665210][ C2] ? ip_finish_output2+0x262/0x18e0 [11416.665475][ C2] ip_finish_output2+0x786/0x18e0 [11416.665732][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11416.666092][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11416.666368][ C2] ? rcu_read_lock_held+0xe/0x50 [11416.666623][ C2] ? __ip_finish_output+0x10f/0x770 [11416.666887][ C2] ip_output+0x16b/0x4f0 [11416.667104][ C2] ? __pfx_ip_output+0x10/0x10 [11416.667346][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11416.667626][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11416.667943][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11416.668222][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11416.668474][ C2] ? __alloc_skb+0xd4/0x280 [11416.668703][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11416.668976][ C2] ? tcp_fragment+0x168/0x1040 [11416.669219][ C2] ? rcu_read_lock_held+0xe/0x50 [11416.669480][ C2] ? ip_local_out+0x114/0x3b0 [11416.669721][ C2] __ip_queue_xmit+0x672/0x1910 [11416.669973][ C2] ? __skb_clone+0x57a/0x760 [11416.670210][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11416.670475][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11416.670753][ C2] ? ipv4_dst_check+0xe3/0x170 [11416.670998][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11416.671249][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11416.671548][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11416.671867][ C2] ? tcp_fragment+0xb0e/0x1040 [11416.672110][ C2] tcp_send_loss_probe+0x348/0x830 [11416.672368][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11416.672637][ C2] tcp_write_timer+0x82/0x1d0 [11416.672875][ C2] call_timer_fn+0x173/0x430 [11416.673113][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11416.673379][ C2] ? next_expiry_recalc+0xcd/0x220 [11416.673638][ C2] __run_timers.part.0+0x52d/0x890 [11416.673897][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11416.674165][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11416.674451][ C2] ? lock_acquire+0x1c1/0x220 [11416.674694][ C2] ? clockevents_program_event+0xf6/0x300 [11416.674983][ C2] ? lock_release+0x1d5/0x250 [11416.675223][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11416.675489][ C2] ? ktime_get+0xb3/0x190 [11416.675708][ C2] ? clockevents_program_event+0x1ea/0x300 [11416.676012][ C2] run_timer_softirq+0x72/0x100 [11416.676261][ C2] __do_softirq+0x1b9/0x7ff [11416.676494][ C2] irq_exit_rcu+0x98/0xc0 [11416.676714][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11416.676999][ C2] [11416.677152][ C2] [11416.677301][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11416.677606][ C2] RIP: 0010:default_idle+0xf/0x20 [11416.677863][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11416.678829][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11416.679138][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11416.679535][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11416.679931][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11416.680330][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11416.680727][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11416.681125][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11416.681414][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11416.681676][ C2] default_idle_call+0x69/0xa0 [11416.681920][ C2] cpuidle_idle_call+0x1f6/0x280 [11416.682170][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11416.682450][ C2] ? lock_release+0x1d5/0x250 [11416.682687][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11416.682962][ C2] do_idle+0xfb/0x160 [11416.683166][ C2] cpu_startup_entry+0x55/0x60 [11416.683417][ C2] start_secondary+0x21c/0x2b0 [11416.683661][ C2] ? __pfx_start_secondary+0x10/0x10 [11416.683930][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11416.684243][ C2] [11438.998104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11438.998485][ C1] rcu: 1-....: (8772083 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2122536 [11438.999046][ C1] rcu: (t=9084111 jiffies g=1882453 q=730 ncpus=4) [11438.999384][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11438.999835][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11439.000449][ C1] RIP: 0010:kasan_check_range+0x10f/0x1c0 [11439.000746][ C1] Code: 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff 5b b8 01 00 00 00 5d 41 5c cc cc cc cc 41 bc 08 00 00 00 45 29 dc 49 8d 14 2c eb 0c 48 83 [11439.001719][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000246 [11439.002028][ C1] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11439.002430][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11439.002830][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11439.003231][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11439.003634][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11439.004033][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11439.004482][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11439.004815][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11439.005216][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11439.005619][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11439.006028][ C1] PKRU: 55555554 [11439.006211][ C1] Call Trace: [11439.006383][ C1] [11439.006536][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11439.006810][ C1] ? print_cpu_stall+0x263/0x6a0 [11439.007063][ C1] ? check_cpu_stall+0x284/0x500 [11439.007316][ C1] ? rcu_pending+0x92/0x360 [11439.007547][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11439.007820][ C1] ? update_process_times+0xb9/0x110 [11439.008091][ C1] ? tick_sched_handle+0x67/0x130 [11439.008350][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11439.008634][ C1] ? __run_hrtimer+0x1c0/0x710 [11439.008878][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11439.009192][ C1] ? __hrtimer_run_queues+0x197/0x270 [11439.009465][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11439.009759][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11439.010026][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11439.010334][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11439.010597][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11439.010908][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11439.011207][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11439.011525][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11439.011816][ C1] ? kasan_check_range+0x10f/0x1c0 [11439.012077][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11439.012360][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11439.012674][ C1] ? get_stack_info+0x36/0xc0 [11439.012917][ C1] ? lock_acquire+0x1c1/0x220 [11439.013160][ C1] ? lock_release+0x1d5/0x250 [11439.013402][ C1] do_raw_spin_lock+0x1ec/0x270 [11439.013655][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11439.013928][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11439.014216][ C1] ? lock_acquire+0x1c1/0x220 [11439.014455][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11439.014699][ C1] _raw_spin_lock_nested+0x65/0x80 [11439.014960][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11439.015197][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11439.015446][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11439.015714][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11439.015993][ C1] ip_local_deliver_finish+0x2ae/0x480 [11439.016272][ C1] ip_local_deliver+0x19d/0x480 [11439.016520][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11439.016795][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11439.017062][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11439.017416][ C1] ? rcu_read_lock_held+0xe/0x50 [11439.017672][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11439.017994][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11439.018261][ C1] ip_rcv+0x564/0x740 [11439.018466][ C1] ? __pfx_ip_rcv+0x10/0x10 [11439.018699][ C1] ? set_track_prepare+0x8a/0xd0 [11439.018954][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11439.019233][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11439.019506][ C1] ? skb_clone+0x10b/0x330 [11439.019737][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11439.020060][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11439.020367][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11439.020655][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11439.020949][ C1] ? __tcf_classify+0x329/0x7d0 [11439.021201][ C1] ? __pfx_ip_rcv+0x10/0x10 [11439.021433][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11439.021734][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11439.022028][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11439.022356][ C1] ? lock_acquire+0x1c1/0x220 [11439.022597][ C1] ? netif_receive_skb_internal+0x84/0x300 [11439.022893][ C1] netif_receive_skb_internal+0xb0/0x300 [11439.023182][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11439.023502][ C1] ? __copy_skb_header+0xaf/0x490 [11439.023764][ C1] ? __skb_clone+0x57a/0x760 [11439.023997][ C1] netif_receive_skb+0x55/0x280 [11439.024248][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11439.024562][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11439.024896][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11439.025198][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11439.025473][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11439.025769][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11439.026088][ C1] ? hlock_class+0x4e/0x130 [11439.026324][ C1] ? get_stack_info_noinstr+0x18/0x110 [11439.026601][ C1] ? get_stack_info_noinstr+0x18/0x110 [11439.026878][ C1] ? __pfx_validate_chain+0x10/0x10 [11439.027145][ C1] ? hlock_class+0x4e/0x130 [11439.027376][ C1] ? mark_lock+0x38/0x3e0 [11439.027598][ C1] ? stack_access_ok+0xda/0x1f0 [11439.027847][ C1] ? __lock_acquire+0xb67/0x1610 [11439.028103][ C1] ? get_stack_info_noinstr+0x18/0x110 [11439.028384][ C1] ? get_stack_info+0x36/0xc0 [11439.028625][ C1] ? stack_access_ok+0xda/0x1f0 [11439.028871][ C1] ? get_reg+0x119/0x190 [11439.029091][ C1] ? unwind_next_frame+0x12af/0x1d10 [11439.029361][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11439.029673][ C1] __tcf_classify+0x329/0x7d0 [11439.029916][ C1] tcf_classify+0x283/0x930 [11439.030154][ C1] ? arch_stack_walk+0xa2/0x100 [11439.030405][ C1] ? __pfx_tcf_classify+0x10/0x10 [11439.030662][ C1] ? get_stack_info+0x36/0xc0 [11439.030905][ C1] tc_run+0x2e4/0x5d0 [11439.031113][ C1] ? __pfx_tc_run+0x10/0x10 [11439.031347][ C1] ? lock_acquire+0x1c1/0x220 [11439.031585][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11439.031848][ C1] __dev_queue_xmit+0x686/0x17e0 [11439.032107][ C1] ? lock_acquire+0x1c1/0x220 [11439.032348][ C1] ? ip_finish_output2+0x786/0x18e0 [11439.032614][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11439.032923][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11439.033197][ C1] ? neigh_hh_output+0x348/0x590 [11439.033450][ C1] ? ip_finish_output2+0x262/0x18e0 [11439.033715][ C1] ip_finish_output2+0x786/0x18e0 [11439.033972][ C1] ? stack_depot_save_flags+0x45/0x550 [11439.034255][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11439.034595][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11439.034872][ C1] ? rcu_read_lock_held+0xe/0x50 [11439.035127][ C1] ? __ip_finish_output+0x10f/0x770 [11439.035394][ C1] ip_output+0x16b/0x4f0 [11439.035611][ C1] ? run_timer_softirq+0x72/0x100 [11439.035875][ C1] ? __pfx_ip_output+0x10/0x10 [11439.036119][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11439.036410][ C1] ? rcu_read_lock_held+0xe/0x50 [11439.036663][ C1] ? ip_local_out+0x114/0x3b0 [11439.036904][ C1] __ip_queue_xmit+0x672/0x1910 [11439.037153][ C1] ? __create_object+0x5e/0xb0 [11439.037399][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11439.037666][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11439.037951][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11439.038227][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11439.038509][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11439.038783][ C1] tcp_delack_timer+0x84/0x240 [11439.039027][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11439.039303][ C1] call_timer_fn+0x173/0x430 [11439.039539][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11439.039801][ C1] ? next_expiry_recalc+0xcd/0x220 [11439.040064][ C1] __run_timers.part.0+0x52d/0x890 [11439.040327][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11439.040604][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11439.040890][ C1] ? lock_acquire+0x1c1/0x220 [11439.041131][ C1] ? clockevents_program_event+0xf6/0x300 [11439.041424][ C1] ? lock_release+0x1d5/0x250 [11439.041665][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11439.041931][ C1] ? ktime_get+0xb3/0x190 [11439.042157][ C1] ? clockevents_program_event+0x1ea/0x300 [11439.042453][ C1] run_timer_softirq+0x72/0x100 [11439.042704][ C1] __do_softirq+0x1b9/0x7ff [11439.042938][ C1] irq_exit_rcu+0x98/0xc0 [11439.043160][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11439.043449][ C1] [11439.043600][ C1] [11439.043750][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11439.044056][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11439.044381][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11439.045355][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11439.045673][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11439.046073][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11439.046474][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11439.046872][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11439.047273][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11439.047676][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11439.047974][ C1] pipe_read+0xa16/0xdf0 [11439.048197][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11439.048478][ C1] ? __pfx_pipe_read+0x10/0x10 [11439.048723][ C1] ? iterate_tty_write+0x299/0x540 [11439.048986][ C1] ? lock_release+0x1d5/0x250 [11439.049226][ C1] vfs_read+0x911/0xc00 [11439.049445][ C1] ? lock_acquire+0x1c1/0x220 [11439.049684][ C1] ? __might_fault+0xc6/0x180 [11439.049926][ C1] ? __pfx_vfs_read+0x10/0x10 [11439.050167][ C1] ? __might_fault+0xc6/0x180 [11439.050408][ C1] ? lock_release+0x1d5/0x250 [11439.050647][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11439.050913][ C1] ? __fget_light+0x54/0x1e0 [11439.051150][ C1] ksys_read+0x17a/0x1e0 [11439.051370][ C1] ? __pfx_ksys_read+0x10/0x10 [11439.051613][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11439.051918][ C1] do_syscall_64+0xc9/0x1e0 [11439.052153][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11439.052454][ C1] RIP: 0033:0x7f08a1ea38b2 [11439.052683][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11439.053654][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11439.054077][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11439.054479][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11439.054879][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11439.055280][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11439.055685][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11439.056089][ C1] [11439.056248][ C1] Sending NMI from CPU 1 to CPUs 2: [11439.056527][ C2] NMI backtrace for cpu 2 [11439.056543][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11439.056550][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11439.056555][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11439.056564][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11439.056570][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11439.056576][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11439.056580][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11439.056584][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11439.056588][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11439.056592][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11439.056596][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11439.056601][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11439.056607][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11439.056611][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11439.056613][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11439.056615][ C2] PKRU: 55555554 [11439.056616][ C2] Call Trace: [11439.056620][ C2] [11439.056623][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11439.056631][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11439.056637][ C2] ? nmi_handle+0x153/0x420 [11439.056642][ C2] ? default_do_nmi+0x41/0x100 [11439.056645][ C2] ? exc_nmi+0xf3/0x120 [11439.056647][ C2] ? end_repeat_nmi+0xf/0x60 [11439.056653][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11439.056656][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11439.056659][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11439.056663][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11439.056666][ C2] [11439.056667][ C2] [11439.056669][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11439.056671][ C2] ? get_stack_info+0x36/0xc0 [11439.056675][ C2] ? lock_acquire+0x1c1/0x220 [11439.056679][ C2] ? lock_release+0x1d5/0x250 [11439.056682][ C2] do_raw_spin_lock+0x1ec/0x270 [11439.056686][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11439.056689][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11439.056693][ C2] ? lock_acquire+0x1c1/0x220 [11439.056695][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11439.056699][ C2] _raw_spin_lock_nested+0x65/0x80 [11439.056702][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11439.056709][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11439.056711][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11439.056716][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11439.056722][ C2] ip_local_deliver_finish+0x2ae/0x480 [11439.056725][ C2] ip_local_deliver+0x19d/0x480 [11439.056728][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11439.056729][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11439.056732][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11439.056737][ C2] ? rcu_read_lock_held+0xe/0x50 [11439.056741][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11439.056744][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11439.056753][ C2] ip_rcv+0x564/0x740 [11439.056756][ C2] ? __pfx_ip_rcv+0x10/0x10 [11439.056759][ C2] ? set_track_prepare+0x8a/0xd0 [11439.056763][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11439.056767][ C2] ? start_secondary+0x21c/0x2b0 [11439.056771][ C2] ? skb_clone+0x10b/0x330 [11439.056775][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11439.056781][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11439.056787][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11439.056791][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11439.056799][ C2] ? __tcf_classify+0x329/0x7d0 [11439.056803][ C2] ? __pfx_ip_rcv+0x10/0x10 [11439.056805][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11439.056809][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11439.056812][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11439.056817][ C2] ? lock_acquire+0x1c1/0x220 [11439.056819][ C2] ? netif_receive_skb_internal+0x84/0x300 [11439.056823][ C2] netif_receive_skb_internal+0xb0/0x300 [11439.056827][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11439.056831][ C2] ? __copy_skb_header+0xaf/0x490 [11439.056836][ C2] ? __skb_clone+0x57a/0x760 [11439.056838][ C2] netif_receive_skb+0x55/0x280 [11439.056842][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11439.056849][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11439.056855][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11439.056862][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11439.056867][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11439.056877][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11439.056884][ C2] ? get_stack_info+0x36/0xc0 [11439.056889][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11439.056892][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11439.056897][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11439.056900][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11439.056904][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11439.056906][ C2] ? kernel_text_address+0x17/0xe0 [11439.056910][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11439.056916][ C2] ? arch_stack_walk+0x8c/0x100 [11439.056919][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11439.056922][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11439.056926][ C2] ? lock_acquire+0x1c1/0x220 [11439.056928][ C2] ? stack_depot_save_flags+0x281/0x550 [11439.056933][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11439.056937][ C2] ? get_stack_info_noinstr+0x18/0x110 [11439.056940][ C2] ? get_stack_info+0x36/0xc0 [11439.056945][ C2] __tcf_classify+0x329/0x7d0 [11439.056950][ C2] tcf_classify+0x283/0x930 [11439.056955][ C2] ? __pfx_tcf_classify+0x10/0x10 [11439.056959][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11439.056963][ C2] tc_run+0x2e4/0x5d0 [11439.056968][ C2] ? __pfx_tc_run+0x10/0x10 [11439.056971][ C2] ? lock_acquire+0x1c1/0x220 [11439.056973][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11439.056977][ C2] __dev_queue_xmit+0x686/0x17e0 [11439.056982][ C2] ? lock_acquire+0x1c1/0x220 [11439.056984][ C2] ? ip_finish_output2+0x786/0x18e0 [11439.056988][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11439.056991][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11439.056993][ C2] ? neigh_hh_output+0x348/0x590 [11439.056997][ C2] ? ip_finish_output2+0x262/0x18e0 [11439.057001][ C2] ip_finish_output2+0x786/0x18e0 [11439.057005][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11439.057012][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11439.057015][ C2] ? rcu_read_lock_held+0xe/0x50 [11439.057019][ C2] ? __ip_finish_output+0x10f/0x770 [11439.057022][ C2] ip_output+0x16b/0x4f0 [11439.057026][ C2] ? __pfx_ip_output+0x10/0x10 [11439.057028][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11439.057032][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11439.057035][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11439.057039][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11439.057042][ C2] ? __alloc_skb+0xd4/0x280 [11439.057044][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11439.057050][ C2] ? tcp_fragment+0x168/0x1040 [11439.057053][ C2] ? rcu_read_lock_held+0xe/0x50 [11439.057056][ C2] ? ip_local_out+0x114/0x3b0 [11439.057060][ C2] __ip_queue_xmit+0x672/0x1910 [11439.057065][ C2] ? __skb_clone+0x57a/0x760 [11439.057068][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11439.057074][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11439.057077][ C2] ? ipv4_dst_check+0xe3/0x170 [11439.057081][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11439.057087][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11439.057092][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11439.057095][ C2] ? tcp_fragment+0xb0e/0x1040 [11439.057098][ C2] tcp_send_loss_probe+0x348/0x830 [11439.057102][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11439.057105][ C2] tcp_write_timer+0x82/0x1d0 [11439.057108][ C2] call_timer_fn+0x173/0x430 [11439.057112][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11439.057117][ C2] ? next_expiry_recalc+0xcd/0x220 [11439.057121][ C2] __run_timers.part.0+0x52d/0x890 [11439.057124][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11439.057128][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11439.057132][ C2] ? lock_acquire+0x1c1/0x220 [11439.057134][ C2] ? clockevents_program_event+0xf6/0x300 [11439.057138][ C2] ? lock_release+0x1d5/0x250 [11439.057141][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11439.057145][ C2] ? ktime_get+0xb3/0x190 [11439.057148][ C2] ? clockevents_program_event+0x1ea/0x300 [11439.057152][ C2] run_timer_softirq+0x72/0x100 [11439.057156][ C2] __do_softirq+0x1b9/0x7ff [11439.057161][ C2] irq_exit_rcu+0x98/0xc0 [11439.057163][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11439.057167][ C2] [11439.057168][ C2] [11439.057169][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11439.057173][ C2] RIP: 0010:default_idle+0xf/0x20 [11439.057176][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11439.057179][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11439.057182][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11439.057184][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11439.057186][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11439.057188][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11439.057189][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11439.057193][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11439.057196][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11439.057200][ C2] default_idle_call+0x69/0xa0 [11439.057203][ C2] cpuidle_idle_call+0x1f6/0x280 [11439.057206][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11439.057210][ C2] ? lock_release+0x1d5/0x250 [11439.057213][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11439.057217][ C2] do_idle+0xfb/0x160 [11439.057219][ C2] cpu_startup_entry+0x55/0x60 [11439.057222][ C2] start_secondary+0x21c/0x2b0 [11439.057225][ C2] ? __pfx_start_secondary+0x10/0x10 [11439.057230][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11439.057236][ C2] [11464.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8486s! [perl:4135] [11464.569916][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11464.571795][ C1] irq event stamp: 209232 [11464.572125][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11464.572926][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11464.573654][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11464.574359][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11464.575058][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11464.575749][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11464.576669][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [11464.577153][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [11464.578613][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11464.579067][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11464.579646][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11464.580155][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11464.580560][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11464.580965][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11464.581363][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11464.581815][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11464.582147][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11464.582547][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11464.582955][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11464.583354][ C1] PKRU: 55555554 [11464.583537][ C1] Call Trace: [11464.583709][ C1] [11464.583886][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11464.584152][ C1] ? __run_hrtimer+0x1c0/0x710 [11464.584398][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11464.584675][ C1] ? __hrtimer_run_queues+0x197/0x270 [11464.584953][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11464.585243][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11464.585522][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11464.585837][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11464.586099][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11464.586411][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11464.586706][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11464.587035][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11464.587328][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [11464.587616][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11464.587913][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11464.588223][ C1] ? get_stack_info+0x36/0xc0 [11464.588465][ C1] ? lock_acquire+0x1c1/0x220 [11464.588707][ C1] ? lock_release+0x1d5/0x250 [11464.588989][ C1] do_raw_spin_lock+0x1ec/0x270 [11464.589243][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11464.589515][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11464.589798][ C1] ? lock_acquire+0x1c1/0x220 [11464.590037][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11464.590279][ C1] _raw_spin_lock_nested+0x65/0x80 [11464.590539][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11464.590773][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11464.591017][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11464.591275][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11464.591554][ C1] ip_local_deliver_finish+0x2ae/0x480 [11464.591830][ C1] ip_local_deliver+0x19d/0x480 [11464.592077][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11464.592349][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11464.592612][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11464.592961][ C1] ? rcu_read_lock_held+0xe/0x50 [11464.593215][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11464.593534][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11464.593796][ C1] ip_rcv+0x564/0x740 [11464.594000][ C1] ? __pfx_ip_rcv+0x10/0x10 [11464.594231][ C1] ? set_track_prepare+0x8a/0xd0 [11464.594484][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11464.594761][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11464.595033][ C1] ? skb_clone+0x10b/0x330 [11464.595261][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11464.595591][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11464.595901][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11464.596186][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11464.596480][ C1] ? __tcf_classify+0x329/0x7d0 [11464.596735][ C1] ? __pfx_ip_rcv+0x10/0x10 [11464.596965][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11464.597266][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11464.597551][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11464.597876][ C1] ? lock_acquire+0x1c1/0x220 [11464.598113][ C1] ? netif_receive_skb_internal+0x84/0x300 [11464.598411][ C1] netif_receive_skb_internal+0xb0/0x300 [11464.598697][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11464.599011][ C1] ? __copy_skb_header+0xaf/0x490 [11464.599270][ C1] ? __skb_clone+0x57a/0x760 [11464.599506][ C1] netif_receive_skb+0x55/0x280 [11464.599755][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11464.600070][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11464.600402][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11464.600700][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11464.600979][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11464.601266][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11464.601578][ C1] ? hlock_class+0x4e/0x130 [11464.601812][ C1] ? get_stack_info_noinstr+0x18/0x110 [11464.602088][ C1] ? get_stack_info_noinstr+0x18/0x110 [11464.602364][ C1] ? __pfx_validate_chain+0x10/0x10 [11464.602625][ C1] ? hlock_class+0x4e/0x130 [11464.602856][ C1] ? mark_lock+0x38/0x3e0 [11464.603075][ C1] ? stack_access_ok+0xda/0x1f0 [11464.603326][ C1] ? __lock_acquire+0xb67/0x1610 [11464.603580][ C1] ? get_stack_info_noinstr+0x18/0x110 [11464.603856][ C1] ? get_stack_info+0x36/0xc0 [11464.604094][ C1] ? stack_access_ok+0xda/0x1f0 [11464.604341][ C1] ? get_reg+0x119/0x190 [11464.604558][ C1] ? unwind_next_frame+0x12af/0x1d10 [11464.604825][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11464.605136][ C1] __tcf_classify+0x329/0x7d0 [11464.605376][ C1] tcf_classify+0x283/0x930 [11464.605615][ C1] ? arch_stack_walk+0xa2/0x100 [11464.605865][ C1] ? __pfx_tcf_classify+0x10/0x10 [11464.606122][ C1] ? get_stack_info+0x36/0xc0 [11464.606361][ C1] tc_run+0x2e4/0x5d0 [11464.606567][ C1] ? __pfx_tc_run+0x10/0x10 [11464.606796][ C1] ? lock_acquire+0x1c1/0x220 [11464.607034][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11464.607296][ C1] __dev_queue_xmit+0x686/0x17e0 [11464.607548][ C1] ? lock_acquire+0x1c1/0x220 [11464.607795][ C1] ? ip_finish_output2+0x786/0x18e0 [11464.608059][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11464.608367][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11464.608639][ C1] ? neigh_hh_output+0x348/0x590 [11464.608891][ C1] ? ip_finish_output2+0x262/0x18e0 [11464.609155][ C1] ip_finish_output2+0x786/0x18e0 [11464.609411][ C1] ? stack_depot_save_flags+0x45/0x550 [11464.609689][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11464.610027][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11464.610303][ C1] ? rcu_read_lock_held+0xe/0x50 [11464.610556][ C1] ? __ip_finish_output+0x10f/0x770 [11464.610820][ C1] ip_output+0x16b/0x4f0 [11464.611035][ C1] ? run_timer_softirq+0x72/0x100 [11464.611293][ C1] ? __pfx_ip_output+0x10/0x10 [11464.611535][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11464.611820][ C1] ? rcu_read_lock_held+0xe/0x50 [11464.612069][ C1] ? ip_local_out+0x114/0x3b0 [11464.612308][ C1] __ip_queue_xmit+0x672/0x1910 [11464.612556][ C1] ? __create_object+0x5e/0xb0 [11464.612800][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11464.613066][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11464.613346][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11464.613620][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11464.613901][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11464.614172][ C1] tcp_delack_timer+0x84/0x240 [11464.614417][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11464.614686][ C1] call_timer_fn+0x173/0x430 [11464.614922][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11464.615184][ C1] ? next_expiry_recalc+0xcd/0x220 [11464.615444][ C1] __run_timers.part.0+0x52d/0x890 [11464.615713][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11464.615986][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11464.616271][ C1] ? lock_acquire+0x1c1/0x220 [11464.616509][ C1] ? clockevents_program_event+0xf6/0x300 [11464.616800][ C1] ? lock_release+0x1d5/0x250 [11464.617039][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11464.617304][ C1] ? ktime_get+0xb3/0x190 [11464.617525][ C1] ? clockevents_program_event+0x1ea/0x300 [11464.617821][ C1] run_timer_softirq+0x72/0x100 [11464.618069][ C1] __do_softirq+0x1b9/0x7ff [11464.618303][ C1] irq_exit_rcu+0x98/0xc0 [11464.618524][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11464.618809][ C1] [11464.618960][ C1] [11464.619110][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11464.619414][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11464.619740][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11464.620710][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11464.621018][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11464.621416][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11464.621813][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11464.622213][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11464.622610][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11464.623009][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11464.623306][ C1] pipe_read+0xa16/0xdf0 [11464.623526][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11464.623804][ C1] ? __pfx_pipe_read+0x10/0x10 [11464.624046][ C1] ? iterate_tty_write+0x299/0x540 [11464.624307][ C1] ? lock_release+0x1d5/0x250 [11464.624549][ C1] vfs_read+0x911/0xc00 [11464.624763][ C1] ? lock_acquire+0x1c1/0x220 [11464.625006][ C1] ? __might_fault+0xc6/0x180 [11464.625249][ C1] ? __pfx_vfs_read+0x10/0x10 [11464.625489][ C1] ? __might_fault+0xc6/0x180 [11464.625736][ C1] ? lock_release+0x1d5/0x250 [11464.625976][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11464.626240][ C1] ? __fget_light+0x54/0x1e0 [11464.626479][ C1] ksys_read+0x17a/0x1e0 [11464.626697][ C1] ? __pfx_ksys_read+0x10/0x10 [11464.626944][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11464.627249][ C1] do_syscall_64+0xc9/0x1e0 [11464.627483][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11464.627781][ C1] RIP: 0033:0x7f08a1ea38b2 [11464.628010][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11464.628981][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11464.629403][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11464.629804][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11464.630202][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11464.630686][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11464.631204][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11464.631784][ C1] [11464.632010][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8486s! [swapper/2:0] [11464.632438][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11464.633698][ C2] irq event stamp: 44114564 [11464.633930][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11464.634468][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11464.634983][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11464.635462][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11464.635949][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11464.636408][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11464.637023][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11464.637351][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11464.638330][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11464.638641][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11464.639045][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11464.639447][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11464.639847][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11464.640251][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11464.640651][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11464.641103][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11464.641438][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11464.641843][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11464.642248][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11464.642650][ C2] PKRU: 55555554 [11464.642834][ C2] Call Trace: [11464.643004][ C2] [11464.643154][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11464.643418][ C2] ? __run_hrtimer+0x1c0/0x710 [11464.643662][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11464.643940][ C2] ? __hrtimer_run_queues+0x197/0x270 [11464.644218][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11464.644508][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11464.644775][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11464.645083][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11464.645345][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11464.645617][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11464.645929][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11464.646224][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11464.646541][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11464.646832][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11464.647127][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11464.647418][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11464.647731][ C2] ? get_stack_info+0x36/0xc0 [11464.647971][ C2] ? lock_acquire+0x1c1/0x220 [11464.648214][ C2] ? lock_release+0x1d5/0x250 [11464.648455][ C2] do_raw_spin_lock+0x1ec/0x270 [11464.648704][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11464.648977][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11464.649261][ C2] ? lock_acquire+0x1c1/0x220 [11464.649501][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11464.649743][ C2] _raw_spin_lock_nested+0x65/0x80 [11464.650005][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11464.650242][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11464.650487][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11464.650746][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11464.651029][ C2] ip_local_deliver_finish+0x2ae/0x480 [11464.651306][ C2] ip_local_deliver+0x19d/0x480 [11464.651555][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11464.651826][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11464.652088][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11464.652442][ C2] ? rcu_read_lock_held+0xe/0x50 [11464.652699][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11464.653021][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11464.653285][ C2] ip_rcv+0x564/0x740 [11464.653490][ C2] ? __pfx_ip_rcv+0x10/0x10 [11464.653720][ C2] ? set_track_prepare+0x8a/0xd0 [11464.653976][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11464.654256][ C2] ? start_secondary+0x21c/0x2b0 [11464.654508][ C2] ? skb_clone+0x10b/0x330 [11464.654735][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11464.655055][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11464.655362][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11464.655654][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11464.655951][ C2] ? __tcf_classify+0x329/0x7d0 [11464.656202][ C2] ? __pfx_ip_rcv+0x10/0x10 [11464.656431][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11464.656731][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11464.657025][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11464.657351][ C2] ? lock_acquire+0x1c1/0x220 [11464.657592][ C2] ? netif_receive_skb_internal+0x84/0x300 [11464.657889][ C2] netif_receive_skb_internal+0xb0/0x300 [11464.658175][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11464.658492][ C2] ? __copy_skb_header+0xaf/0x490 [11464.658750][ C2] ? __skb_clone+0x57a/0x760 [11464.658986][ C2] netif_receive_skb+0x55/0x280 [11464.659235][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11464.659547][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11464.659879][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11464.660177][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11464.660452][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11464.660741][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11464.661054][ C2] ? get_stack_info+0x36/0xc0 [11464.661295][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11464.661561][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11464.661879][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11464.662157][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11464.662433][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11464.662749][ C2] ? kernel_text_address+0x17/0xe0 [11464.663010][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11464.663325][ C2] ? arch_stack_walk+0x8c/0x100 [11464.663575][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11464.663839][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11464.664125][ C2] ? lock_acquire+0x1c1/0x220 [11464.664363][ C2] ? stack_depot_save_flags+0x281/0x550 [11464.664648][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11464.664952][ C2] ? get_stack_info_noinstr+0x18/0x110 [11464.665231][ C2] ? get_stack_info+0x36/0xc0 [11464.665470][ C2] __tcf_classify+0x329/0x7d0 [11464.665721][ C2] tcf_classify+0x283/0x930 [11464.665956][ C2] ? __pfx_tcf_classify+0x10/0x10 [11464.666213][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11464.666527][ C2] tc_run+0x2e4/0x5d0 [11464.666732][ C2] ? __pfx_tc_run+0x10/0x10 [11464.666963][ C2] ? lock_acquire+0x1c1/0x220 [11464.667201][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11464.667461][ C2] __dev_queue_xmit+0x686/0x17e0 [11464.667719][ C2] ? lock_acquire+0x1c1/0x220 [11464.667960][ C2] ? ip_finish_output2+0x786/0x18e0 [11464.668225][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11464.668530][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11464.668802][ C2] ? neigh_hh_output+0x348/0x590 [11464.669055][ C2] ? ip_finish_output2+0x262/0x18e0 [11464.669320][ C2] ip_finish_output2+0x786/0x18e0 [11464.669577][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11464.669913][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11464.670192][ C2] ? rcu_read_lock_held+0xe/0x50 [11464.670445][ C2] ? __ip_finish_output+0x10f/0x770 [11464.670710][ C2] ip_output+0x16b/0x4f0 [11464.670926][ C2] ? __pfx_ip_output+0x10/0x10 [11464.671170][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11464.671445][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11464.671758][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11464.672034][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11464.672287][ C2] ? __alloc_skb+0xd4/0x280 [11464.672519][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11464.672790][ C2] ? tcp_fragment+0x168/0x1040 [11464.673035][ C2] ? rcu_read_lock_held+0xe/0x50 [11464.673289][ C2] ? ip_local_out+0x114/0x3b0 [11464.673530][ C2] __ip_queue_xmit+0x672/0x1910 [11464.673778][ C2] ? __skb_clone+0x57a/0x760 [11464.674012][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11464.674282][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11464.674566][ C2] ? ipv4_dst_check+0xe3/0x170 [11464.674809][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11464.675058][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11464.675362][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11464.675688][ C2] ? tcp_fragment+0xb0e/0x1040 [11464.675932][ C2] tcp_send_loss_probe+0x348/0x830 [11464.676194][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11464.676461][ C2] tcp_write_timer+0x82/0x1d0 [11464.676702][ C2] call_timer_fn+0x173/0x430 [11464.676940][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11464.677208][ C2] ? next_expiry_recalc+0xcd/0x220 [11464.677470][ C2] __run_timers.part.0+0x52d/0x890 [11464.677731][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11464.678000][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11464.678284][ C2] ? lock_acquire+0x1c1/0x220 [11464.678524][ C2] ? clockevents_program_event+0xf6/0x300 [11464.678818][ C2] ? lock_release+0x1d5/0x250 [11464.679055][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11464.679321][ C2] ? ktime_get+0xb3/0x190 [11464.679543][ C2] ? clockevents_program_event+0x1ea/0x300 [11464.679840][ C2] run_timer_softirq+0x72/0x100 [11464.680087][ C2] __do_softirq+0x1b9/0x7ff [11464.680323][ C2] irq_exit_rcu+0x98/0xc0 [11464.680543][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11464.680830][ C2] [11464.680979][ C2] [11464.681132][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11464.681437][ C2] RIP: 0010:default_idle+0xf/0x20 [11464.681696][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11464.682667][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11464.682975][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11464.683377][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11464.683776][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11464.684175][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11464.684572][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11464.684976][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11464.685266][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11464.685536][ C2] default_idle_call+0x69/0xa0 [11464.685781][ C2] cpuidle_idle_call+0x1f6/0x280 [11464.686033][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11464.686311][ C2] ? lock_release+0x1d5/0x250 [11464.686553][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11464.686826][ C2] do_idle+0xfb/0x160 [11464.687029][ C2] cpu_startup_entry+0x55/0x60 [11464.687273][ C2] start_secondary+0x21c/0x2b0 [11464.687517][ C2] ? __pfx_start_secondary+0x10/0x10 [11464.687786][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11464.688097][ C2] [11492.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8512s! [perl:4135] [11492.569714][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11492.570975][ C1] irq event stamp: 209232 [11492.571194][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11492.571729][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11492.572208][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11492.572677][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11492.573144][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11492.573595][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11492.574210][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11492.574536][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11492.575514][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11492.575824][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11492.576223][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11492.576627][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11492.577028][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11492.577427][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11492.577826][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11492.578275][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11492.578609][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11492.579011][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11492.579411][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11492.579811][ C1] PKRU: 55555554 [11492.579992][ C1] Call Trace: [11492.580166][ C1] [11492.580317][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11492.580580][ C1] ? __run_hrtimer+0x1c0/0x710 [11492.580828][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11492.581106][ C1] ? __hrtimer_run_queues+0x197/0x270 [11492.581382][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11492.581670][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11492.581937][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11492.582247][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11492.582509][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11492.582820][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11492.583118][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11492.583435][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11492.583725][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11492.584022][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11492.584311][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11492.584624][ C1] ? get_stack_info+0x36/0xc0 [11492.584868][ C1] ? lock_acquire+0x1c1/0x220 [11492.585110][ C1] ? lock_release+0x1d5/0x250 [11492.585350][ C1] do_raw_spin_lock+0x1ec/0x270 [11492.585608][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11492.585881][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11492.586169][ C1] ? lock_acquire+0x1c1/0x220 [11492.586409][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11492.586650][ C1] _raw_spin_lock_nested+0x65/0x80 [11492.586913][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11492.587149][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11492.587399][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11492.587659][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11492.587939][ C1] ip_local_deliver_finish+0x2ae/0x480 [11492.588218][ C1] ip_local_deliver+0x19d/0x480 [11492.588468][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11492.588744][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11492.589009][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11492.589359][ C1] ? rcu_read_lock_held+0xe/0x50 [11492.589615][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11492.589936][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11492.590202][ C1] ip_rcv+0x564/0x740 [11492.590407][ C1] ? __pfx_ip_rcv+0x10/0x10 [11492.590640][ C1] ? set_track_prepare+0x8a/0xd0 [11492.590896][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11492.591173][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11492.591448][ C1] ? skb_clone+0x10b/0x330 [11492.591680][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11492.592003][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11492.592312][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11492.592596][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11492.592892][ C1] ? __tcf_classify+0x329/0x7d0 [11492.593142][ C1] ? __pfx_ip_rcv+0x10/0x10 [11492.593376][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11492.593679][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11492.593965][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11492.594292][ C1] ? lock_acquire+0x1c1/0x220 [11492.594532][ C1] ? netif_receive_skb_internal+0x84/0x300 [11492.594831][ C1] netif_receive_skb_internal+0xb0/0x300 [11492.595121][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11492.595447][ C1] ? __copy_skb_header+0xaf/0x490 [11492.595708][ C1] ? __skb_clone+0x57a/0x760 [11492.595945][ C1] netif_receive_skb+0x55/0x280 [11492.596194][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11492.596507][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11492.596843][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11492.597144][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11492.597421][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11492.597712][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11492.598025][ C1] ? hlock_class+0x4e/0x130 [11492.598261][ C1] ? get_stack_info_noinstr+0x18/0x110 [11492.598538][ C1] ? get_stack_info_noinstr+0x18/0x110 [11492.598817][ C1] ? __pfx_validate_chain+0x10/0x10 [11492.599081][ C1] ? hlock_class+0x4e/0x130 [11492.599313][ C1] ? mark_lock+0x38/0x3e0 [11492.599535][ C1] ? stack_access_ok+0xda/0x1f0 [11492.599786][ C1] ? __lock_acquire+0xb67/0x1610 [11492.600042][ C1] ? get_stack_info_noinstr+0x18/0x110 [11492.600320][ C1] ? get_stack_info+0x36/0xc0 [11492.600562][ C1] ? stack_access_ok+0xda/0x1f0 [11492.600811][ C1] ? get_reg+0x119/0x190 [11492.601028][ C1] ? unwind_next_frame+0x12af/0x1d10 [11492.601297][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11492.601607][ C1] __tcf_classify+0x329/0x7d0 [11492.601851][ C1] tcf_classify+0x283/0x930 [11492.602084][ C1] ? arch_stack_walk+0xa2/0x100 [11492.602334][ C1] ? __pfx_tcf_classify+0x10/0x10 [11492.602592][ C1] ? get_stack_info+0x36/0xc0 [11492.602835][ C1] tc_run+0x2e4/0x5d0 [11492.603041][ C1] ? __pfx_tc_run+0x10/0x10 [11492.603275][ C1] ? lock_acquire+0x1c1/0x220 [11492.603517][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11492.603781][ C1] __dev_queue_xmit+0x686/0x17e0 [11492.604036][ C1] ? lock_acquire+0x1c1/0x220 [11492.604274][ C1] ? ip_finish_output2+0x786/0x18e0 [11492.604546][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11492.604858][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11492.605132][ C1] ? neigh_hh_output+0x348/0x590 [11492.605390][ C1] ? ip_finish_output2+0x262/0x18e0 [11492.605658][ C1] ip_finish_output2+0x786/0x18e0 [11492.605915][ C1] ? stack_depot_save_flags+0x45/0x550 [11492.606197][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11492.606537][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11492.606812][ C1] ? rcu_read_lock_held+0xe/0x50 [11492.607067][ C1] ? __ip_finish_output+0x10f/0x770 [11492.607334][ C1] ip_output+0x16b/0x4f0 [11492.607554][ C1] ? run_timer_softirq+0x72/0x100 [11492.607813][ C1] ? __pfx_ip_output+0x10/0x10 [11492.608058][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11492.608345][ C1] ? rcu_read_lock_held+0xe/0x50 [11492.608598][ C1] ? ip_local_out+0x114/0x3b0 [11492.608841][ C1] __ip_queue_xmit+0x672/0x1910 [11492.609092][ C1] ? __create_object+0x5e/0xb0 [11492.609336][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11492.609606][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11492.609890][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11492.610165][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11492.610450][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11492.610723][ C1] tcp_delack_timer+0x84/0x240 [11492.610969][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11492.611243][ C1] call_timer_fn+0x173/0x430 [11492.611481][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11492.611744][ C1] ? next_expiry_recalc+0xcd/0x220 [11492.612008][ C1] __run_timers.part.0+0x52d/0x890 [11492.612270][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11492.612545][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11492.612836][ C1] ? lock_acquire+0x1c1/0x220 [11492.613076][ C1] ? clockevents_program_event+0xf6/0x300 [11492.613371][ C1] ? lock_release+0x1d5/0x250 [11492.613611][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11492.613878][ C1] ? ktime_get+0xb3/0x190 [11492.614098][ C1] ? clockevents_program_event+0x1ea/0x300 [11492.614397][ C1] run_timer_softirq+0x72/0x100 [11492.614646][ C1] __do_softirq+0x1b9/0x7ff [11492.614885][ C1] irq_exit_rcu+0x98/0xc0 [11492.615109][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11492.615402][ C1] [11492.615552][ C1] [11492.615706][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11492.616012][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11492.616341][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11492.617320][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11492.617634][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11492.618037][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11492.618438][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11492.618839][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11492.619241][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11492.619647][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11492.619943][ C1] pipe_read+0xa16/0xdf0 [11492.620169][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11492.620449][ C1] ? __pfx_pipe_read+0x10/0x10 [11492.620694][ C1] ? iterate_tty_write+0x299/0x540 [11492.620958][ C1] ? lock_release+0x1d5/0x250 [11492.621202][ C1] vfs_read+0x911/0xc00 [11492.621418][ C1] ? lock_acquire+0x1c1/0x220 [11492.621660][ C1] ? __might_fault+0xc6/0x180 [11492.621903][ C1] ? __pfx_vfs_read+0x10/0x10 [11492.622143][ C1] ? __might_fault+0xc6/0x180 [11492.622385][ C1] ? lock_release+0x1d5/0x250 [11492.622627][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11492.622894][ C1] ? __fget_light+0x54/0x1e0 [11492.623135][ C1] ksys_read+0x17a/0x1e0 [11492.623353][ C1] ? __pfx_ksys_read+0x10/0x10 [11492.623600][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11492.623907][ C1] do_syscall_64+0xc9/0x1e0 [11492.624142][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11492.624444][ C1] RIP: 0033:0x7f08a1ea38b2 [11492.624673][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11492.625662][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11492.626086][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11492.626488][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11492.626890][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11492.627293][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11492.627693][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11492.628097][ C1] [11492.628258][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8512s! [swapper/2:0] [11492.628688][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11492.629980][ C2] irq event stamp: 44114564 [11492.630210][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11492.630750][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11492.631268][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11492.631747][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11492.632222][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11492.632684][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11492.633300][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [11492.633589][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [11492.634563][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [11492.634873][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11492.635279][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11492.635687][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11492.636088][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11492.636491][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11492.636891][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11492.637341][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11492.637675][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11492.638076][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11492.638484][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11492.638885][ C2] PKRU: 55555554 [11492.639068][ C2] Call Trace: [11492.639239][ C2] [11492.639391][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11492.639655][ C2] ? __run_hrtimer+0x1c0/0x710 [11492.639900][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11492.640178][ C2] ? __hrtimer_run_queues+0x197/0x270 [11492.640452][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11492.640744][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11492.641012][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11492.641323][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11492.641587][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11492.641852][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11492.642164][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11492.642463][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11492.642781][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11492.643075][ C2] ? __pfx___kasan_check_read+0x10/0x10 [11492.643360][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [11492.643641][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11492.643954][ C2] ? get_stack_info+0x36/0xc0 [11492.644197][ C2] ? lock_acquire+0x1c1/0x220 [11492.644439][ C2] ? lock_release+0x1d5/0x250 [11492.644678][ C2] do_raw_spin_lock+0x1ec/0x270 [11492.644929][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11492.645203][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11492.645498][ C2] ? lock_acquire+0x1c1/0x220 [11492.645770][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11492.646009][ C2] _raw_spin_lock_nested+0x65/0x80 [11492.646273][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11492.646508][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11492.646757][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11492.647015][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11492.647290][ C2] ip_local_deliver_finish+0x2ae/0x480 [11492.647569][ C2] ip_local_deliver+0x19d/0x480 [11492.647815][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11492.648090][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11492.648353][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11492.648700][ C2] ? rcu_read_lock_held+0xe/0x50 [11492.648953][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11492.649272][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11492.649535][ C2] ip_rcv+0x564/0x740 [11492.649738][ C2] ? __pfx_ip_rcv+0x10/0x10 [11492.649970][ C2] ? set_track_prepare+0x8a/0xd0 [11492.650225][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11492.650502][ C2] ? start_secondary+0x21c/0x2b0 [11492.650761][ C2] ? skb_clone+0x10b/0x330 [11492.650989][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11492.651309][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11492.651614][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11492.651899][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11492.652192][ C2] ? __tcf_classify+0x329/0x7d0 [11492.652441][ C2] ? __pfx_ip_rcv+0x10/0x10 [11492.652672][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11492.652971][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11492.653259][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11492.653586][ C2] ? lock_acquire+0x1c1/0x220 [11492.653827][ C2] ? netif_receive_skb_internal+0x84/0x300 [11492.654123][ C2] netif_receive_skb_internal+0xb0/0x300 [11492.654409][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11492.654727][ C2] ? __copy_skb_header+0xaf/0x490 [11492.654985][ C2] ? __skb_clone+0x57a/0x760 [11492.655219][ C2] netif_receive_skb+0x55/0x280 [11492.655476][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11492.655791][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11492.656123][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11492.656424][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11492.656699][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11492.656987][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11492.657301][ C2] ? get_stack_info+0x36/0xc0 [11492.657543][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11492.657808][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11492.658125][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11492.658403][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11492.658684][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11492.658999][ C2] ? kernel_text_address+0x17/0xe0 [11492.659261][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11492.659575][ C2] ? arch_stack_walk+0x8c/0x100 [11492.659822][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11492.660089][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11492.660374][ C2] ? lock_acquire+0x1c1/0x220 [11492.660614][ C2] ? stack_depot_save_flags+0x281/0x550 [11492.660895][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11492.661201][ C2] ? get_stack_info_noinstr+0x18/0x110 [11492.661477][ C2] ? get_stack_info+0x36/0xc0 [11492.661719][ C2] __tcf_classify+0x329/0x7d0 [11492.661962][ C2] tcf_classify+0x283/0x930 [11492.662194][ C2] ? __pfx_tcf_classify+0x10/0x10 [11492.662450][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11492.662783][ C2] tc_run+0x2e4/0x5d0 [11492.662988][ C2] ? __pfx_tc_run+0x10/0x10 [11492.663273][ C2] ? lock_acquire+0x1c1/0x220 [11492.663616][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11492.663983][ C2] __dev_queue_xmit+0x686/0x17e0 [11492.664344][ C2] ? lock_acquire+0x1c1/0x220 [11492.664699][ C2] ? ip_finish_output2+0x786/0x18e0 [11492.665098][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11492.665566][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11492.665979][ C2] ? neigh_hh_output+0x348/0x590 [11492.666362][ C2] ? ip_finish_output2+0x262/0x18e0 [11492.666762][ C2] ip_finish_output2+0x786/0x18e0 [11492.667153][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11492.667667][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11492.668085][ C2] ? rcu_read_lock_held+0xe/0x50 [11492.668469][ C2] ? __ip_finish_output+0x10f/0x770 [11492.668870][ C2] ip_output+0x16b/0x4f0 [11492.669200][ C2] ? __pfx_ip_output+0x10/0x10 [11492.669567][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11492.669987][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11492.670460][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11492.670879][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11492.671260][ C2] ? __alloc_skb+0xd4/0x280 [11492.671608][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11492.672018][ C2] ? tcp_fragment+0x168/0x1040 [11492.672386][ C2] ? rcu_read_lock_held+0xe/0x50 [11492.672766][ C2] ? ip_local_out+0x114/0x3b0 [11492.673128][ C2] __ip_queue_xmit+0x672/0x1910 [11492.673504][ C2] ? __skb_clone+0x57a/0x760 [11492.673861][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11492.674264][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11492.674681][ C2] ? ipv4_dst_check+0xe3/0x170 [11492.675044][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11492.675412][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11492.675849][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11492.676188][ C2] ? tcp_fragment+0xb0e/0x1040 [11492.676440][ C2] tcp_send_loss_probe+0x348/0x830 [11492.676702][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11492.676971][ C2] tcp_write_timer+0x82/0x1d0 [11492.677210][ C2] call_timer_fn+0x173/0x430 [11492.677455][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11492.677716][ C2] ? next_expiry_recalc+0xcd/0x220 [11492.677975][ C2] __run_timers.part.0+0x52d/0x890 [11492.678234][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11492.678509][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11492.678794][ C2] ? lock_acquire+0x1c1/0x220 [11492.679033][ C2] ? clockevents_program_event+0xf6/0x300 [11492.679322][ C2] ? lock_release+0x1d5/0x250 [11492.679567][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11492.679834][ C2] ? ktime_get+0xb3/0x190 [11492.680056][ C2] ? clockevents_program_event+0x1ea/0x300 [11492.680353][ C2] run_timer_softirq+0x72/0x100 [11492.680625][ C2] __do_softirq+0x1b9/0x7ff [11492.680860][ C2] irq_exit_rcu+0x98/0xc0 [11492.681080][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11492.681371][ C2] [11492.681527][ C2] [11492.681677][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11492.681983][ C2] RIP: 0010:default_idle+0xf/0x20 [11492.682241][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11492.683211][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11492.683526][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11492.683923][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11492.684321][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11492.684737][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11492.685133][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11492.685551][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11492.685841][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11492.686102][ C2] default_idle_call+0x69/0xa0 [11492.686345][ C2] cpuidle_idle_call+0x1f6/0x280 [11492.686603][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11492.686882][ C2] ? lock_release+0x1d5/0x250 [11492.687121][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11492.687402][ C2] do_idle+0xfb/0x160 [11492.687605][ C2] cpu_startup_entry+0x55/0x60 [11492.687848][ C2] start_secondary+0x21c/0x2b0 [11492.688092][ C2] ? __pfx_start_secondary+0x10/0x10 [11492.688362][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11492.688749][ C2] [11517.056104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11517.056482][ C1] rcu: 1-....: (8849964 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2141960 [11517.057047][ C1] rcu: (t=9162169 jiffies g=1882453 q=730 ncpus=4) [11517.057387][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11517.057836][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11517.058454][ C1] RIP: 0010:kasan_check_range+0x158/0x1c0 [11517.058751][ C1] Code: 11 80 38 00 74 ef 4d 8d 1c 2c 48 89 c2 48 85 c0 75 b0 48 89 da 4c 89 d8 4c 29 da e9 49 ff ff ff 48 85 d2 74 b3 48 01 ea eb 09 <48> 83 c0 01 48 39 d0 74 a5 80 38 00 74 f2 e9 74 ff ff ff b8 01 00 [11517.059726][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000246 [11517.060037][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [11517.060438][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11517.060840][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [11517.061241][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11517.061641][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11517.062040][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11517.062495][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11517.062830][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11517.063235][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11517.063635][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11517.064035][ C1] PKRU: 55555554 [11517.064218][ C1] Call Trace: [11517.064392][ C1] [11517.064542][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11517.064818][ C1] ? print_cpu_stall+0x263/0x6a0 [11517.065071][ C1] ? check_cpu_stall+0x284/0x500 [11517.065332][ C1] ? rcu_pending+0x92/0x360 [11517.065565][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11517.065836][ C1] ? update_process_times+0xb9/0x110 [11517.066107][ C1] ? tick_sched_handle+0x67/0x130 [11517.066367][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11517.066655][ C1] ? __run_hrtimer+0x1c0/0x710 [11517.066902][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11517.067216][ C1] ? __hrtimer_run_queues+0x197/0x270 [11517.067490][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11517.067777][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11517.068044][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11517.068354][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11517.068615][ C1] ? hrtimer_interrupt+0x31a/0x770 [11517.068876][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11517.069188][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11517.069486][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11517.069804][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11517.070096][ C1] ? kasan_check_range+0x158/0x1c0 [11517.070358][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11517.070640][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11517.070952][ C1] ? get_stack_info+0x36/0xc0 [11517.071196][ C1] ? lock_acquire+0x1c1/0x220 [11517.071440][ C1] ? lock_release+0x1d5/0x250 [11517.071681][ C1] do_raw_spin_lock+0x1ec/0x270 [11517.071930][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11517.072205][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11517.072490][ C1] ? lock_acquire+0x1c1/0x220 [11517.072730][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11517.072973][ C1] _raw_spin_lock_nested+0x65/0x80 [11517.073235][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11517.073470][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11517.073718][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11517.073978][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11517.074258][ C1] ip_local_deliver_finish+0x2ae/0x480 [11517.074537][ C1] ip_local_deliver+0x19d/0x480 [11517.074791][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11517.075064][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11517.075336][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11517.075686][ C1] ? rcu_read_lock_held+0xe/0x50 [11517.075943][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11517.076265][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11517.076529][ C1] ip_rcv+0x564/0x740 [11517.076735][ C1] ? __pfx_ip_rcv+0x10/0x10 [11517.076967][ C1] ? set_track_prepare+0x8a/0xd0 [11517.077223][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11517.077499][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11517.077776][ C1] ? skb_clone+0x10b/0x330 [11517.078004][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11517.078324][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11517.078633][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11517.078917][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11517.079216][ C1] ? __tcf_classify+0x329/0x7d0 [11517.079467][ C1] ? __pfx_ip_rcv+0x10/0x10 [11517.079697][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11517.079999][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11517.080285][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11517.080612][ C1] ? lock_acquire+0x1c1/0x220 [11517.080851][ C1] ? netif_receive_skb_internal+0x84/0x300 [11517.081151][ C1] netif_receive_skb_internal+0xb0/0x300 [11517.081436][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11517.081754][ C1] ? __copy_skb_header+0xaf/0x490 [11517.082012][ C1] ? __skb_clone+0x57a/0x760 [11517.082248][ C1] netif_receive_skb+0x55/0x280 [11517.082499][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11517.082812][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11517.083146][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11517.083445][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11517.083722][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11517.084010][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11517.084325][ C1] ? hlock_class+0x4e/0x130 [11517.084557][ C1] ? get_stack_info_noinstr+0x18/0x110 [11517.084836][ C1] ? get_stack_info_noinstr+0x18/0x110 [11517.085114][ C1] ? __pfx_validate_chain+0x10/0x10 [11517.085385][ C1] ? hlock_class+0x4e/0x130 [11517.085618][ C1] ? mark_lock+0x38/0x3e0 [11517.085839][ C1] ? stack_access_ok+0xda/0x1f0 [11517.086090][ C1] ? __lock_acquire+0xb67/0x1610 [11517.086345][ C1] ? get_stack_info_noinstr+0x18/0x110 [11517.086622][ C1] ? get_stack_info+0x36/0xc0 [11517.086864][ C1] ? stack_access_ok+0xda/0x1f0 [11517.087113][ C1] ? get_reg+0x119/0x190 [11517.087329][ C1] ? unwind_next_frame+0x12af/0x1d10 [11517.087600][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11517.087909][ C1] __tcf_classify+0x329/0x7d0 [11517.088152][ C1] tcf_classify+0x283/0x930 [11517.088386][ C1] ? arch_stack_walk+0xa2/0x100 [11517.088637][ C1] ? __pfx_tcf_classify+0x10/0x10 [11517.088896][ C1] ? get_stack_info+0x36/0xc0 [11517.089137][ C1] tc_run+0x2e4/0x5d0 [11517.089346][ C1] ? __pfx_tc_run+0x10/0x10 [11517.089576][ C1] ? lock_acquire+0x1c1/0x220 [11517.089817][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11517.090078][ C1] __dev_queue_xmit+0x686/0x17e0 [11517.090333][ C1] ? lock_acquire+0x1c1/0x220 [11517.090573][ C1] ? ip_finish_output2+0x786/0x18e0 [11517.090840][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11517.091147][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11517.091420][ C1] ? neigh_hh_output+0x348/0x590 [11517.091674][ C1] ? ip_finish_output2+0x262/0x18e0 [11517.091939][ C1] ip_finish_output2+0x786/0x18e0 [11517.092196][ C1] ? stack_depot_save_flags+0x45/0x550 [11517.092476][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11517.092812][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11517.093092][ C1] ? rcu_read_lock_held+0xe/0x50 [11517.093346][ C1] ? __ip_finish_output+0x10f/0x770 [11517.093612][ C1] ip_output+0x16b/0x4f0 [11517.093829][ C1] ? run_timer_softirq+0x72/0x100 [11517.094087][ C1] ? __pfx_ip_output+0x10/0x10 [11517.094331][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11517.094617][ C1] ? rcu_read_lock_held+0xe/0x50 [11517.094870][ C1] ? ip_local_out+0x114/0x3b0 [11517.095113][ C1] __ip_queue_xmit+0x672/0x1910 [11517.095371][ C1] ? __create_object+0x5e/0xb0 [11517.095617][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11517.095885][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11517.096167][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11517.096442][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11517.096724][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11517.096997][ C1] tcp_delack_timer+0x84/0x240 [11517.097242][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11517.097514][ C1] call_timer_fn+0x173/0x430 [11517.097751][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11517.098014][ C1] ? next_expiry_recalc+0xcd/0x220 [11517.098277][ C1] __run_timers.part.0+0x52d/0x890 [11517.098538][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11517.098812][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11517.099100][ C1] ? lock_acquire+0x1c1/0x220 [11517.099339][ C1] ? clockevents_program_event+0xf6/0x300 [11517.099632][ C1] ? lock_release+0x1d5/0x250 [11517.099873][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11517.100140][ C1] ? ktime_get+0xb3/0x190 [11517.100360][ C1] ? clockevents_program_event+0x1ea/0x300 [11517.100660][ C1] run_timer_softirq+0x72/0x100 [11517.100909][ C1] __do_softirq+0x1b9/0x7ff [11517.101142][ C1] irq_exit_rcu+0x98/0xc0 [11517.101365][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11517.101656][ C1] [11517.101809][ C1] [11517.101959][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11517.102271][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11517.102602][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11517.103578][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11517.103888][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11517.104290][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11517.104689][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11517.105092][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11517.105500][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11517.105903][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11517.106203][ C1] pipe_read+0xa16/0xdf0 [11517.106424][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11517.106703][ C1] ? __pfx_pipe_read+0x10/0x10 [11517.106948][ C1] ? iterate_tty_write+0x299/0x540 [11517.107211][ C1] ? lock_release+0x1d5/0x250 [11517.107454][ C1] vfs_read+0x911/0xc00 [11517.107669][ C1] ? lock_acquire+0x1c1/0x220 [11517.107910][ C1] ? __might_fault+0xc6/0x180 [11517.108152][ C1] ? __pfx_vfs_read+0x10/0x10 [11517.108393][ C1] ? __might_fault+0xc6/0x180 [11517.108633][ C1] ? lock_release+0x1d5/0x250 [11517.108874][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11517.109140][ C1] ? __fget_light+0x54/0x1e0 [11517.109380][ C1] ksys_read+0x17a/0x1e0 [11517.109597][ C1] ? __pfx_ksys_read+0x10/0x10 [11517.109843][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11517.110150][ C1] do_syscall_64+0xc9/0x1e0 [11517.110384][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11517.110685][ C1] RIP: 0033:0x7f08a1ea38b2 [11517.110915][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11517.111890][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11517.112313][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11517.112715][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11517.113117][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11517.113517][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11517.113915][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11517.114322][ C1] [11517.114479][ C1] Sending NMI from CPU 1 to CPUs 2: [11517.114756][ C2] NMI backtrace for cpu 2 [11517.114764][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11517.114771][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11517.114776][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [11517.114787][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [11517.114793][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11517.114799][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11517.114803][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11517.114807][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11517.114811][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11517.114815][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11517.114819][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11517.114824][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11517.114830][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11517.114834][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11517.114837][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11517.114841][ C2] PKRU: 55555554 [11517.114843][ C2] Call Trace: [11517.114847][ C2] [11517.114852][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11517.114866][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11517.114875][ C2] ? nmi_handle+0x153/0x420 [11517.114886][ C2] ? default_do_nmi+0x41/0x100 [11517.114892][ C2] ? exc_nmi+0xf3/0x120 [11517.114898][ C2] ? end_repeat_nmi+0xf/0x60 [11517.114911][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11517.114919][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [11517.114927][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [11517.114936][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [11517.114943][ C2] [11517.114946][ C2] [11517.114949][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11517.114955][ C2] ? get_stack_info+0x36/0xc0 [11517.114964][ C2] ? lock_acquire+0x1c1/0x220 [11517.114972][ C2] ? lock_release+0x1d5/0x250 [11517.114981][ C2] do_raw_spin_lock+0x1ec/0x270 [11517.114990][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11517.114998][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11517.115006][ C2] ? lock_acquire+0x1c1/0x220 [11517.115012][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11517.115021][ C2] _raw_spin_lock_nested+0x65/0x80 [11517.115028][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11517.115045][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11517.115051][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11517.115063][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11517.115074][ C2] ip_local_deliver_finish+0x2ae/0x480 [11517.115082][ C2] ip_local_deliver+0x19d/0x480 [11517.115089][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11517.115094][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11517.115100][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11517.115111][ C2] ? rcu_read_lock_held+0xe/0x50 [11517.115119][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11517.115125][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11517.115134][ C2] ip_rcv+0x564/0x740 [11517.115138][ C2] ? __pfx_ip_rcv+0x10/0x10 [11517.115141][ C2] ? set_track_prepare+0x8a/0xd0 [11517.115145][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11517.115148][ C2] ? start_secondary+0x21c/0x2b0 [11517.115152][ C2] ? skb_clone+0x10b/0x330 [11517.115155][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11517.115161][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11517.115167][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11517.115171][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11517.115179][ C2] ? __tcf_classify+0x329/0x7d0 [11517.115183][ C2] ? __pfx_ip_rcv+0x10/0x10 [11517.115186][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11517.115190][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11517.115193][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11517.115198][ C2] ? lock_acquire+0x1c1/0x220 [11517.115200][ C2] ? netif_receive_skb_internal+0x84/0x300 [11517.115204][ C2] netif_receive_skb_internal+0xb0/0x300 [11517.115208][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11517.115213][ C2] ? __copy_skb_header+0xaf/0x490 [11517.115217][ C2] ? __skb_clone+0x57a/0x760 [11517.115219][ C2] netif_receive_skb+0x55/0x280 [11517.115223][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11517.115230][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11517.115248][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11517.115255][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11517.115259][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11517.115270][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11517.115277][ C2] ? get_stack_info+0x36/0xc0 [11517.115282][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11517.115285][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11517.115291][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11517.115294][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11517.115298][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11517.115300][ C2] ? kernel_text_address+0x17/0xe0 [11517.115304][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11517.115310][ C2] ? arch_stack_walk+0x8c/0x100 [11517.115314][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11517.115317][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11517.115321][ C2] ? lock_acquire+0x1c1/0x220 [11517.115323][ C2] ? stack_depot_save_flags+0x281/0x550 [11517.115328][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11517.115332][ C2] ? get_stack_info_noinstr+0x18/0x110 [11517.115335][ C2] ? get_stack_info+0x36/0xc0 [11517.115339][ C2] __tcf_classify+0x329/0x7d0 [11517.115345][ C2] tcf_classify+0x283/0x930 [11517.115349][ C2] ? __pfx_tcf_classify+0x10/0x10 [11517.115352][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11517.115357][ C2] tc_run+0x2e4/0x5d0 [11517.115361][ C2] ? __pfx_tc_run+0x10/0x10 [11517.115364][ C2] ? lock_acquire+0x1c1/0x220 [11517.115367][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11517.115371][ C2] __dev_queue_xmit+0x686/0x17e0 [11517.115375][ C2] ? lock_acquire+0x1c1/0x220 [11517.115378][ C2] ? ip_finish_output2+0x786/0x18e0 [11517.115381][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11517.115384][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11517.115387][ C2] ? neigh_hh_output+0x348/0x590 [11517.115391][ C2] ? ip_finish_output2+0x262/0x18e0 [11517.115394][ C2] ip_finish_output2+0x786/0x18e0 [11517.115398][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11517.115405][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11517.115408][ C2] ? rcu_read_lock_held+0xe/0x50 [11517.115412][ C2] ? __ip_finish_output+0x10f/0x770 [11517.115416][ C2] ip_output+0x16b/0x4f0 [11517.115419][ C2] ? __pfx_ip_output+0x10/0x10 [11517.115422][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11517.115425][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11517.115428][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11517.115432][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11517.115435][ C2] ? __alloc_skb+0xd4/0x280 [11517.115437][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11517.115443][ C2] ? tcp_fragment+0x168/0x1040 [11517.115446][ C2] ? rcu_read_lock_held+0xe/0x50 [11517.115449][ C2] ? ip_local_out+0x114/0x3b0 [11517.115452][ C2] __ip_queue_xmit+0x672/0x1910 [11517.115456][ C2] ? __skb_clone+0x57a/0x760 [11517.115459][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11517.115465][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11517.115468][ C2] ? ipv4_dst_check+0xe3/0x170 [11517.115472][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11517.115478][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11517.115483][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11517.115486][ C2] ? tcp_fragment+0xb0e/0x1040 [11517.115489][ C2] tcp_send_loss_probe+0x348/0x830 [11517.115493][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11517.115495][ C2] tcp_write_timer+0x82/0x1d0 [11517.115499][ C2] call_timer_fn+0x173/0x430 [11517.115504][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11517.115508][ C2] ? next_expiry_recalc+0xcd/0x220 [11517.115513][ C2] __run_timers.part.0+0x52d/0x890 [11517.115516][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11517.115520][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11517.115523][ C2] ? lock_acquire+0x1c1/0x220 [11517.115526][ C2] ? clockevents_program_event+0xf6/0x300 [11517.115529][ C2] ? lock_release+0x1d5/0x250 [11517.115532][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11517.115535][ C2] ? ktime_get+0xb3/0x190 [11517.115538][ C2] ? clockevents_program_event+0x1ea/0x300 [11517.115542][ C2] run_timer_softirq+0x72/0x100 [11517.115546][ C2] __do_softirq+0x1b9/0x7ff [11517.115550][ C2] irq_exit_rcu+0x98/0xc0 [11517.115553][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11517.115556][ C2] [11517.115557][ C2] [11517.115558][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11517.115561][ C2] RIP: 0010:default_idle+0xf/0x20 [11517.115565][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11517.115568][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11517.115570][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11517.115573][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11517.115574][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11517.115576][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11517.115578][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11517.115581][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11517.115584][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11517.115589][ C2] default_idle_call+0x69/0xa0 [11517.115592][ C2] cpuidle_idle_call+0x1f6/0x280 [11517.115595][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11517.115600][ C2] ? lock_release+0x1d5/0x250 [11517.115602][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11517.115606][ C2] do_idle+0xfb/0x160 [11517.115609][ C2] cpu_startup_entry+0x55/0x60 [11517.115611][ C2] start_secondary+0x21c/0x2b0 [11517.115615][ C2] ? __pfx_start_secondary+0x10/0x10 [11517.115619][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11517.115625][ C2] [11544.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8560s! [perl:4135] [11544.569713][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11544.570976][ C1] irq event stamp: 209232 [11544.571195][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11544.571733][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11544.572215][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11544.572685][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11544.573150][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11544.573601][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11544.574218][ C1] RIP: 0010:kasan_check_range+0x77/0x1c0 [11544.574507][ C1] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [11544.575493][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [11544.575802][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11544.576205][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11544.576605][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [11544.577007][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11544.577407][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11544.577810][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11544.578258][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11544.578593][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11544.578995][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11544.579395][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11544.579799][ C1] PKRU: 55555554 [11544.579980][ C1] Call Trace: [11544.580152][ C1] [11544.580303][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11544.580568][ C1] ? __run_hrtimer+0x1c0/0x710 [11544.580812][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11544.581092][ C1] ? __hrtimer_run_queues+0x197/0x270 [11544.581366][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11544.581654][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11544.581923][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11544.582230][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11544.582490][ C1] ? hrtimer_interrupt+0x31a/0x770 [11544.582753][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11544.583065][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11544.583364][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11544.583684][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11544.583973][ C1] ? kasan_check_range+0x77/0x1c0 [11544.584231][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11544.584516][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11544.584828][ C1] ? get_stack_info+0x36/0xc0 [11544.585069][ C1] ? lock_acquire+0x1c1/0x220 [11544.585320][ C1] ? lock_release+0x1d5/0x250 [11544.585562][ C1] do_raw_spin_lock+0x1ec/0x270 [11544.585813][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11544.586086][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11544.586371][ C1] ? lock_acquire+0x1c1/0x220 [11544.586611][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11544.586854][ C1] _raw_spin_lock_nested+0x65/0x80 [11544.587116][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11544.587351][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11544.587598][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11544.587858][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11544.588141][ C1] ip_local_deliver_finish+0x2ae/0x480 [11544.588419][ C1] ip_local_deliver+0x19d/0x480 [11544.588667][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11544.588938][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11544.589202][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11544.589553][ C1] ? rcu_read_lock_held+0xe/0x50 [11544.589808][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11544.590129][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11544.590392][ C1] ip_rcv+0x564/0x740 [11544.590598][ C1] ? __pfx_ip_rcv+0x10/0x10 [11544.590827][ C1] ? set_track_prepare+0x8a/0xd0 [11544.591083][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11544.591362][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11544.591636][ C1] ? skb_clone+0x10b/0x330 [11544.591865][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11544.592184][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11544.592492][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11544.592776][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11544.593072][ C1] ? __tcf_classify+0x329/0x7d0 [11544.593323][ C1] ? __pfx_ip_rcv+0x10/0x10 [11544.593554][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11544.593854][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11544.594141][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11544.594468][ C1] ? lock_acquire+0x1c1/0x220 [11544.594705][ C1] ? netif_receive_skb_internal+0x84/0x300 [11544.595003][ C1] netif_receive_skb_internal+0xb0/0x300 [11544.595296][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11544.595613][ C1] ? __copy_skb_header+0xaf/0x490 [11544.595873][ C1] ? __skb_clone+0x57a/0x760 [11544.596109][ C1] netif_receive_skb+0x55/0x280 [11544.596358][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11544.596673][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11544.597007][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11544.597306][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11544.597582][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11544.597869][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11544.598183][ C1] ? hlock_class+0x4e/0x130 [11544.598419][ C1] ? get_stack_info_noinstr+0x18/0x110 [11544.598695][ C1] ? get_stack_info_noinstr+0x18/0x110 [11544.598971][ C1] ? __pfx_validate_chain+0x10/0x10 [11544.599235][ C1] ? hlock_class+0x4e/0x130 [11544.599468][ C1] ? mark_lock+0x38/0x3e0 [11544.599686][ C1] ? stack_access_ok+0xda/0x1f0 [11544.599938][ C1] ? __lock_acquire+0xb67/0x1610 [11544.600193][ C1] ? get_stack_info_noinstr+0x18/0x110 [11544.600470][ C1] ? get_stack_info+0x36/0xc0 [11544.600709][ C1] ? stack_access_ok+0xda/0x1f0 [11544.600957][ C1] ? get_reg+0x119/0x190 [11544.601174][ C1] ? unwind_next_frame+0x12af/0x1d10 [11544.601444][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11544.601753][ C1] __tcf_classify+0x329/0x7d0 [11544.601995][ C1] tcf_classify+0x283/0x930 [11544.602230][ C1] ? arch_stack_walk+0xa2/0x100 [11544.602481][ C1] ? __pfx_tcf_classify+0x10/0x10 [11544.602738][ C1] ? get_stack_info+0x36/0xc0 [11544.602980][ C1] tc_run+0x2e4/0x5d0 [11544.603187][ C1] ? __pfx_tc_run+0x10/0x10 [11544.603417][ C1] ? lock_acquire+0x1c1/0x220 [11544.603657][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11544.603919][ C1] __dev_queue_xmit+0x686/0x17e0 [11544.604173][ C1] ? lock_acquire+0x1c1/0x220 [11544.604413][ C1] ? ip_finish_output2+0x786/0x18e0 [11544.604678][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11544.604988][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11544.605271][ C1] ? neigh_hh_output+0x348/0x590 [11544.605525][ C1] ? ip_finish_output2+0x262/0x18e0 [11544.605789][ C1] ip_finish_output2+0x786/0x18e0 [11544.606046][ C1] ? stack_depot_save_flags+0x45/0x550 [11544.606326][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11544.606666][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11544.606944][ C1] ? rcu_read_lock_held+0xe/0x50 [11544.607198][ C1] ? __ip_finish_output+0x10f/0x770 [11544.607464][ C1] ip_output+0x16b/0x4f0 [11544.607681][ C1] ? run_timer_softirq+0x72/0x100 [11544.607940][ C1] ? __pfx_ip_output+0x10/0x10 [11544.608185][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11544.608477][ C1] ? rcu_read_lock_held+0xe/0x50 [11544.608730][ C1] ? ip_local_out+0x114/0x3b0 [11544.608971][ C1] __ip_queue_xmit+0x672/0x1910 [11544.609220][ C1] ? __create_object+0x5e/0xb0 [11544.609467][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11544.609735][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11544.610019][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11544.610294][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11544.610578][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11544.610851][ C1] tcp_delack_timer+0x84/0x240 [11544.611102][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11544.611375][ C1] call_timer_fn+0x173/0x430 [11544.611614][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11544.611877][ C1] ? next_expiry_recalc+0xcd/0x220 [11544.612140][ C1] __run_timers.part.0+0x52d/0x890 [11544.612402][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11544.612677][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11544.612965][ C1] ? lock_acquire+0x1c1/0x220 [11544.613208][ C1] ? clockevents_program_event+0xf6/0x300 [11544.613500][ C1] ? lock_release+0x1d5/0x250 [11544.613741][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11544.614005][ C1] ? ktime_get+0xb3/0x190 [11544.614228][ C1] ? clockevents_program_event+0x1ea/0x300 [11544.614527][ C1] run_timer_softirq+0x72/0x100 [11544.614777][ C1] __do_softirq+0x1b9/0x7ff [11544.615012][ C1] irq_exit_rcu+0x98/0xc0 [11544.615240][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11544.615528][ C1] [11544.615681][ C1] [11544.615831][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11544.616137][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11544.616465][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11544.617443][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11544.617754][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11544.618154][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11544.618555][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11544.618957][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11544.619358][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11544.619760][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11544.620059][ C1] pipe_read+0xa16/0xdf0 [11544.620280][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11544.620563][ C1] ? __pfx_pipe_read+0x10/0x10 [11544.620807][ C1] ? iterate_tty_write+0x299/0x540 [11544.621069][ C1] ? lock_release+0x1d5/0x250 [11544.621312][ C1] vfs_read+0x911/0xc00 [11544.621529][ C1] ? lock_acquire+0x1c1/0x220 [11544.621768][ C1] ? __might_fault+0xc6/0x180 [11544.622010][ C1] ? __pfx_vfs_read+0x10/0x10 [11544.622251][ C1] ? __might_fault+0xc6/0x180 [11544.622491][ C1] ? lock_release+0x1d5/0x250 [11544.622732][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11544.622997][ C1] ? __fget_light+0x54/0x1e0 [11544.623237][ C1] ksys_read+0x17a/0x1e0 [11544.623454][ C1] ? __pfx_ksys_read+0x10/0x10 [11544.623701][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11544.624007][ C1] do_syscall_64+0xc9/0x1e0 [11544.624241][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11544.624541][ C1] RIP: 0033:0x7f08a1ea38b2 [11544.624772][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11544.625750][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11544.626174][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11544.626575][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11544.626974][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11544.627374][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11544.627774][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11544.628179][ C1] [11544.628337][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8560s! [swapper/2:0] [11544.628767][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11544.630021][ C2] irq event stamp: 44114564 [11544.630252][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11544.630791][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11544.631304][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11544.631781][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11544.632251][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11544.632708][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11544.633321][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11544.633647][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11544.634617][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11544.634927][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11544.635336][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11544.635736][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11544.636134][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11544.636536][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11544.636937][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11544.637385][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11544.637719][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11544.638120][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11544.638525][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11544.638952][ C2] PKRU: 55555554 [11544.639137][ C2] Call Trace: [11544.639307][ C2] [11544.639457][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11544.639724][ C2] ? __run_hrtimer+0x1c0/0x710 [11544.639969][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11544.640247][ C2] ? __hrtimer_run_queues+0x197/0x270 [11544.640519][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11544.640810][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11544.641074][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11544.641381][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11544.641643][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11544.641906][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11544.642215][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11544.642511][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11544.642826][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11544.643118][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11544.643418][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11544.643711][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11544.644021][ C2] ? get_stack_info+0x36/0xc0 [11544.644262][ C2] ? lock_acquire+0x1c1/0x220 [11544.644502][ C2] ? lock_release+0x1d5/0x250 [11544.644747][ C2] do_raw_spin_lock+0x1ec/0x270 [11544.644997][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11544.645279][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11544.645567][ C2] ? lock_acquire+0x1c1/0x220 [11544.645806][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11544.646047][ C2] _raw_spin_lock_nested+0x65/0x80 [11544.646308][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11544.646543][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11544.646790][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11544.647048][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11544.647331][ C2] ip_local_deliver_finish+0x2ae/0x480 [11544.647608][ C2] ip_local_deliver+0x19d/0x480 [11544.647858][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11544.648128][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11544.648391][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11544.648739][ C2] ? rcu_read_lock_held+0xe/0x50 [11544.648992][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11544.649313][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11544.649574][ C2] ip_rcv+0x564/0x740 [11544.649778][ C2] ? __pfx_ip_rcv+0x10/0x10 [11544.650007][ C2] ? set_track_prepare+0x8a/0xd0 [11544.650260][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11544.650538][ C2] ? start_secondary+0x21c/0x2b0 [11544.650789][ C2] ? skb_clone+0x10b/0x330 [11544.651016][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11544.651336][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11544.651642][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11544.651923][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11544.652219][ C2] ? __tcf_classify+0x329/0x7d0 [11544.652483][ C2] ? __pfx_ip_rcv+0x10/0x10 [11544.652720][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11544.653021][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11544.653305][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11544.653630][ C2] ? lock_acquire+0x1c1/0x220 [11544.653869][ C2] ? netif_receive_skb_internal+0x84/0x300 [11544.654166][ C2] netif_receive_skb_internal+0xb0/0x300 [11544.654450][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11544.654767][ C2] ? __copy_skb_header+0xaf/0x490 [11544.655024][ C2] ? __skb_clone+0x57a/0x760 [11544.655268][ C2] netif_receive_skb+0x55/0x280 [11544.655516][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11544.655827][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11544.656160][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11544.656458][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11544.656733][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11544.657023][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11544.657334][ C2] ? get_stack_info+0x36/0xc0 [11544.657574][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11544.657840][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11544.658157][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11544.658434][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11544.658711][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11544.659025][ C2] ? kernel_text_address+0x17/0xe0 [11544.659286][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11544.659600][ C2] ? arch_stack_walk+0x8c/0x100 [11544.659849][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11544.660114][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11544.660397][ C2] ? lock_acquire+0x1c1/0x220 [11544.660636][ C2] ? stack_depot_save_flags+0x281/0x550 [11544.660917][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11544.661220][ C2] ? get_stack_info_noinstr+0x18/0x110 [11544.661498][ C2] ? get_stack_info+0x36/0xc0 [11544.661738][ C2] __tcf_classify+0x329/0x7d0 [11544.661981][ C2] tcf_classify+0x283/0x930 [11544.662214][ C2] ? __pfx_tcf_classify+0x10/0x10 [11544.662469][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11544.662781][ C2] tc_run+0x2e4/0x5d0 [11544.662986][ C2] ? __pfx_tc_run+0x10/0x10 [11544.663213][ C2] ? lock_acquire+0x1c1/0x220 [11544.663457][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11544.663718][ C2] __dev_queue_xmit+0x686/0x17e0 [11544.663972][ C2] ? lock_acquire+0x1c1/0x220 [11544.664211][ C2] ? ip_finish_output2+0x786/0x18e0 [11544.664474][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11544.664778][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11544.665047][ C2] ? neigh_hh_output+0x348/0x590 [11544.665307][ C2] ? ip_finish_output2+0x262/0x18e0 [11544.665570][ C2] ip_finish_output2+0x786/0x18e0 [11544.665826][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11544.666163][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11544.666439][ C2] ? rcu_read_lock_held+0xe/0x50 [11544.666695][ C2] ? __ip_finish_output+0x10f/0x770 [11544.666961][ C2] ip_output+0x16b/0x4f0 [11544.667177][ C2] ? __pfx_ip_output+0x10/0x10 [11544.667419][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11544.667696][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11544.668008][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11544.668283][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11544.668533][ C2] ? __alloc_skb+0xd4/0x280 [11544.668764][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11544.669032][ C2] ? tcp_fragment+0x168/0x1040 [11544.669275][ C2] ? rcu_read_lock_held+0xe/0x50 [11544.669547][ C2] ? ip_local_out+0x114/0x3b0 [11544.669787][ C2] __ip_queue_xmit+0x672/0x1910 [11544.670036][ C2] ? __skb_clone+0x57a/0x760 [11544.670360][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11544.670707][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11544.671121][ C2] ? ipv4_dst_check+0xe3/0x170 [11544.671478][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11544.671849][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11544.672306][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11544.672789][ C2] ? tcp_fragment+0xb0e/0x1040 [11544.673163][ C2] tcp_send_loss_probe+0x348/0x830 [11544.673562][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11544.673968][ C2] tcp_write_timer+0x82/0x1d0 [11544.674332][ C2] call_timer_fn+0x173/0x430 [11544.674692][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11544.675093][ C2] ? next_expiry_recalc+0xcd/0x220 [11544.675503][ C2] __run_timers.part.0+0x52d/0x890 [11544.675903][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11544.676313][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11544.676746][ C2] ? lock_acquire+0x1c1/0x220 [11544.677109][ C2] ? clockevents_program_event+0xf6/0x300 [11544.677551][ C2] ? lock_release+0x1d5/0x250 [11544.677910][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11544.678309][ C2] ? ktime_get+0xb3/0x190 [11544.678644][ C2] ? clockevents_program_event+0x1ea/0x300 [11544.679094][ C2] run_timer_softirq+0x72/0x100 [11544.679470][ C2] __do_softirq+0x1b9/0x7ff [11544.679824][ C2] irq_exit_rcu+0x98/0xc0 [11544.680159][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11544.680590][ C2] [11544.680817][ C2] [11544.681045][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11544.681507][ C2] RIP: 0010:default_idle+0xf/0x20 [11544.681884][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11544.683176][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11544.683512][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11544.683911][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11544.684315][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11544.684709][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11544.685115][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11544.685522][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11544.685816][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11544.686077][ C2] default_idle_call+0x69/0xa0 [11544.686327][ C2] cpuidle_idle_call+0x1f6/0x280 [11544.686577][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11544.686853][ C2] ? lock_release+0x1d5/0x250 [11544.687092][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11544.687399][ C2] do_idle+0xfb/0x160 [11544.687603][ C2] cpu_startup_entry+0x55/0x60 [11544.687844][ C2] start_secondary+0x21c/0x2b0 [11544.688087][ C2] ? __pfx_start_secondary+0x10/0x10 [11544.688363][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11544.688677][ C2] [11572.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8586s! [perl:4135] [11572.569737][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11572.571019][ C1] irq event stamp: 209232 [11572.571238][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11572.571783][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11572.572275][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11572.572745][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11572.573221][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11572.573672][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11572.574297][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11572.574624][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11572.575625][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11572.575936][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11572.576339][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11572.576745][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11572.577145][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11572.577547][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11572.577949][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11572.578401][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11572.578743][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11572.579148][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11572.579550][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11572.579959][ C1] PKRU: 55555554 [11572.580144][ C1] Call Trace: [11572.580318][ C1] [11572.580468][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11572.580734][ C1] ? __run_hrtimer+0x1c0/0x710 [11572.580987][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11572.581270][ C1] ? __hrtimer_run_queues+0x197/0x270 [11572.581556][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11572.581845][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11572.582112][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11572.582424][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11572.582686][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11572.583003][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11572.583314][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11572.583636][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11572.583928][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11572.584232][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11572.584529][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11572.584844][ C1] ? get_stack_info+0x36/0xc0 [11572.585099][ C1] ? lock_acquire+0x1c1/0x220 [11572.585342][ C1] ? lock_release+0x1d5/0x250 [11572.585583][ C1] do_raw_spin_lock+0x1ec/0x270 [11572.585841][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11572.586114][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11572.586403][ C1] ? lock_acquire+0x1c1/0x220 [11572.586649][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11572.586891][ C1] _raw_spin_lock_nested+0x65/0x80 [11572.587153][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11572.587392][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11572.587641][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11572.587901][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11572.588187][ C1] ip_local_deliver_finish+0x2ae/0x480 [11572.588465][ C1] ip_local_deliver+0x19d/0x480 [11572.588719][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11572.588993][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11572.589268][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11572.589619][ C1] ? rcu_read_lock_held+0xe/0x50 [11572.589876][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11572.590198][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11572.590464][ C1] ip_rcv+0x564/0x740 [11572.590670][ C1] ? __pfx_ip_rcv+0x10/0x10 [11572.590903][ C1] ? set_track_prepare+0x8a/0xd0 [11572.591167][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11572.591445][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11572.591724][ C1] ? skb_clone+0x10b/0x330 [11572.591955][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11572.592279][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11572.592585][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11572.592873][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11572.593173][ C1] ? __tcf_classify+0x329/0x7d0 [11572.593438][ C1] ? __pfx_ip_rcv+0x10/0x10 [11572.593674][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11572.593980][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11572.594266][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11572.594599][ C1] ? lock_acquire+0x1c1/0x220 [11572.594843][ C1] ? netif_receive_skb_internal+0x84/0x300 [11572.595149][ C1] netif_receive_skb_internal+0xb0/0x300 [11572.595438][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11572.595761][ C1] ? __copy_skb_header+0xaf/0x490 [11572.596022][ C1] ? __skb_clone+0x57a/0x760 [11572.596267][ C1] netif_receive_skb+0x55/0x280 [11572.596521][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11572.596843][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11572.597177][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11572.597485][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11572.597761][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11572.598060][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11572.598374][ C1] ? hlock_class+0x4e/0x130 [11572.598612][ C1] ? get_stack_info_noinstr+0x18/0x110 [11572.598895][ C1] ? get_stack_info_noinstr+0x18/0x110 [11572.599177][ C1] ? __pfx_validate_chain+0x10/0x10 [11572.599448][ C1] ? hlock_class+0x4e/0x130 [11572.599686][ C1] ? mark_lock+0x38/0x3e0 [11572.599909][ C1] ? stack_access_ok+0xda/0x1f0 [11572.600165][ C1] ? __lock_acquire+0xb67/0x1610 [11572.600422][ C1] ? get_stack_info_noinstr+0x18/0x110 [11572.600707][ C1] ? get_stack_info+0x36/0xc0 [11572.600950][ C1] ? stack_access_ok+0xda/0x1f0 [11572.601206][ C1] ? get_reg+0x119/0x190 [11572.601424][ C1] ? unwind_next_frame+0x12af/0x1d10 [11572.601702][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11572.602015][ C1] __tcf_classify+0x329/0x7d0 [11572.602267][ C1] tcf_classify+0x283/0x930 [11572.602506][ C1] ? arch_stack_walk+0xa2/0x100 [11572.602759][ C1] ? __pfx_tcf_classify+0x10/0x10 [11572.603017][ C1] ? get_stack_info+0x36/0xc0 [11572.603261][ C1] tc_run+0x2e4/0x5d0 [11572.603469][ C1] ? __pfx_tc_run+0x10/0x10 [11572.603703][ C1] ? lock_acquire+0x1c1/0x220 [11572.603950][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11572.604213][ C1] __dev_queue_xmit+0x686/0x17e0 [11572.604473][ C1] ? lock_acquire+0x1c1/0x220 [11572.604712][ C1] ? ip_finish_output2+0x786/0x18e0 [11572.604986][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11572.605305][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11572.605580][ C1] ? neigh_hh_output+0x348/0x590 [11572.605836][ C1] ? ip_finish_output2+0x262/0x18e0 [11572.606105][ C1] ip_finish_output2+0x786/0x18e0 [11572.606363][ C1] ? stack_depot_save_flags+0x45/0x550 [11572.606651][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11572.606992][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11572.607270][ C1] ? rcu_read_lock_held+0xe/0x50 [11572.607531][ C1] ? __ip_finish_output+0x10f/0x770 [11572.607805][ C1] ip_output+0x16b/0x4f0 [11572.608025][ C1] ? run_timer_softirq+0x72/0x100 [11572.608291][ C1] ? __pfx_ip_output+0x10/0x10 [11572.608537][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11572.608827][ C1] ? rcu_read_lock_held+0xe/0x50 [11572.609082][ C1] ? ip_local_out+0x114/0x3b0 [11572.609330][ C1] __ip_queue_xmit+0x672/0x1910 [11572.609581][ C1] ? __create_object+0x5e/0xb0 [11572.609828][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11572.610104][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11572.610390][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11572.610666][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11572.610952][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11572.611230][ C1] tcp_delack_timer+0x84/0x240 [11572.611476][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11572.611752][ C1] call_timer_fn+0x173/0x430 [11572.611991][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11572.612258][ C1] ? next_expiry_recalc+0xcd/0x220 [11572.612523][ C1] __run_timers.part.0+0x52d/0x890 [11572.612794][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11572.613071][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11572.613358][ C1] ? lock_acquire+0x1c1/0x220 [11572.613600][ C1] ? clockevents_program_event+0xf6/0x300 [11572.613903][ C1] ? lock_release+0x1d5/0x250 [11572.614143][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11572.614411][ C1] ? ktime_get+0xb3/0x190 [11572.614637][ C1] ? clockevents_program_event+0x1ea/0x300 [11572.614937][ C1] run_timer_softirq+0x72/0x100 [11572.615199][ C1] __do_softirq+0x1b9/0x7ff [11572.615436][ C1] irq_exit_rcu+0x98/0xc0 [11572.615659][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11572.615955][ C1] [11572.616106][ C1] [11572.616267][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11572.616574][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11572.616906][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11572.617897][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11572.618208][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11572.618615][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11572.619025][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11572.619426][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11572.619827][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11572.620239][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11572.620537][ C1] pipe_read+0xa16/0xdf0 [11572.620763][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11572.621051][ C1] ? __pfx_pipe_read+0x10/0x10 [11572.621299][ C1] ? iterate_tty_write+0x299/0x540 [11572.621565][ C1] ? lock_release+0x1d5/0x250 [11572.621815][ C1] vfs_read+0x911/0xc00 [11572.622032][ C1] ? lock_acquire+0x1c1/0x220 [11572.622282][ C1] ? __might_fault+0xc6/0x180 [11572.622524][ C1] ? __pfx_vfs_read+0x10/0x10 [11572.622767][ C1] ? __might_fault+0xc6/0x180 [11572.623010][ C1] ? lock_release+0x1d5/0x250 [11572.623261][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11572.623529][ C1] ? __fget_light+0x54/0x1e0 [11572.623769][ C1] ksys_read+0x17a/0x1e0 [11572.623996][ C1] ? __pfx_ksys_read+0x10/0x10 [11572.624253][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11572.624559][ C1] do_syscall_64+0xc9/0x1e0 [11572.624797][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11572.625116][ C1] RIP: 0033:0x7f08a1ea38b2 [11572.625346][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11572.626331][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11572.626770][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11572.627174][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11572.627577][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11572.627987][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11572.628391][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11572.628802][ C1] [11572.628964][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8586s! [swapper/2:0] [11572.629396][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11572.630656][ C2] irq event stamp: 44114564 [11572.630885][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11572.631424][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11572.631940][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11572.632420][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11572.632893][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11572.633354][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11572.633974][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11572.634303][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11572.635286][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11572.635596][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11572.635996][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11572.636397][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11572.636800][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11572.637201][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11572.637600][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11572.638051][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11572.638386][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11572.638790][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11572.639189][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11572.639588][ C2] PKRU: 55555554 [11572.639769][ C2] Call Trace: [11572.639942][ C2] [11572.640091][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11572.640370][ C2] ? __run_hrtimer+0x1c0/0x710 [11572.640615][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11572.640891][ C2] ? __hrtimer_run_queues+0x197/0x270 [11572.641169][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11572.641458][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11572.641723][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11572.642033][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11572.642296][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11572.642561][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11572.642874][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11572.643174][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11572.643490][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11572.643783][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11572.644081][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11572.644373][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11572.644685][ C2] ? get_stack_info+0x36/0xc0 [11572.644929][ C2] ? lock_acquire+0x1c1/0x220 [11572.645176][ C2] ? lock_release+0x1d5/0x250 [11572.645418][ C2] do_raw_spin_lock+0x1ec/0x270 [11572.645668][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11572.645941][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11572.646230][ C2] ? lock_acquire+0x1c1/0x220 [11572.646469][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11572.646712][ C2] _raw_spin_lock_nested+0x65/0x80 [11572.646973][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11572.647211][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11572.647460][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11572.647721][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11572.647997][ C2] ip_local_deliver_finish+0x2ae/0x480 [11572.648276][ C2] ip_local_deliver+0x19d/0x480 [11572.648524][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11572.648796][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11572.649062][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11572.649411][ C2] ? rcu_read_lock_held+0xe/0x50 [11572.649666][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11572.649988][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11572.650258][ C2] ip_rcv+0x564/0x740 [11572.650462][ C2] ? __pfx_ip_rcv+0x10/0x10 [11572.650695][ C2] ? set_track_prepare+0x8a/0xd0 [11572.650950][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11572.651227][ C2] ? start_secondary+0x21c/0x2b0 [11572.651480][ C2] ? skb_clone+0x10b/0x330 [11572.651707][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11572.652027][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11572.652336][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11572.652619][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11572.652914][ C2] ? __tcf_classify+0x329/0x7d0 [11572.653167][ C2] ? __pfx_ip_rcv+0x10/0x10 [11572.653396][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11572.653695][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11572.653983][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11572.654310][ C2] ? lock_acquire+0x1c1/0x220 [11572.654548][ C2] ? netif_receive_skb_internal+0x84/0x300 [11572.654845][ C2] netif_receive_skb_internal+0xb0/0x300 [11572.655139][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11572.655458][ C2] ? __copy_skb_header+0xaf/0x490 [11572.655719][ C2] ? __skb_clone+0x57a/0x760 [11572.655954][ C2] netif_receive_skb+0x55/0x280 [11572.656204][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11572.656518][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11572.656850][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11572.657151][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11572.657426][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11572.657717][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11572.658029][ C2] ? get_stack_info+0x36/0xc0 [11572.658272][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11572.658536][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11572.658854][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11572.659129][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11572.659406][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11572.659721][ C2] ? kernel_text_address+0x17/0xe0 [11572.659983][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11572.660296][ C2] ? arch_stack_walk+0x8c/0x100 [11572.660547][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11572.660810][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11572.661097][ C2] ? lock_acquire+0x1c1/0x220 [11572.661337][ C2] ? stack_depot_save_flags+0x281/0x550 [11572.661620][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11572.661925][ C2] ? get_stack_info_noinstr+0x18/0x110 [11572.662204][ C2] ? get_stack_info+0x36/0xc0 [11572.662447][ C2] __tcf_classify+0x329/0x7d0 [11572.662688][ C2] tcf_classify+0x283/0x930 [11572.662920][ C2] ? __pfx_tcf_classify+0x10/0x10 [11572.663176][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11572.663489][ C2] tc_run+0x2e4/0x5d0 [11572.663694][ C2] ? __pfx_tc_run+0x10/0x10 [11572.663926][ C2] ? lock_acquire+0x1c1/0x220 [11572.664164][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11572.664425][ C2] __dev_queue_xmit+0x686/0x17e0 [11572.664678][ C2] ? lock_acquire+0x1c1/0x220 [11572.664915][ C2] ? ip_finish_output2+0x786/0x18e0 [11572.665186][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11572.665491][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11572.665762][ C2] ? neigh_hh_output+0x348/0x590 [11572.666014][ C2] ? ip_finish_output2+0x262/0x18e0 [11572.666281][ C2] ip_finish_output2+0x786/0x18e0 [11572.666538][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11572.666878][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11572.667153][ C2] ? rcu_read_lock_held+0xe/0x50 [11572.667407][ C2] ? __ip_finish_output+0x10f/0x770 [11572.667671][ C2] ip_output+0x16b/0x4f0 [11572.667887][ C2] ? __pfx_ip_output+0x10/0x10 [11572.668132][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11572.668413][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11572.668726][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11572.669006][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11572.669258][ C2] ? __alloc_skb+0xd4/0x280 [11572.669487][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11572.669757][ C2] ? tcp_fragment+0x168/0x1040 [11572.670001][ C2] ? rcu_read_lock_held+0xe/0x50 [11572.670252][ C2] ? ip_local_out+0x114/0x3b0 [11572.670507][ C2] __ip_queue_xmit+0x672/0x1910 [11572.670757][ C2] ? __skb_clone+0x57a/0x760 [11572.670994][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11572.671263][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11572.671544][ C2] ? ipv4_dst_check+0xe3/0x170 [11572.671791][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11572.672043][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11572.672344][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11572.672665][ C2] ? tcp_fragment+0xb0e/0x1040 [11572.672910][ C2] tcp_send_loss_probe+0x348/0x830 [11572.673172][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11572.673442][ C2] tcp_write_timer+0x82/0x1d0 [11572.673683][ C2] call_timer_fn+0x173/0x430 [11572.673922][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11572.674186][ C2] ? next_expiry_recalc+0xcd/0x220 [11572.674448][ C2] __run_timers.part.0+0x52d/0x890 [11572.674709][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11572.674989][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11572.675277][ C2] ? lock_acquire+0x1c1/0x220 [11572.675516][ C2] ? clockevents_program_event+0xf6/0x300 [11572.675808][ C2] ? lock_release+0x1d5/0x250 [11572.676049][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11572.676316][ C2] ? ktime_get+0xb3/0x190 [11572.676539][ C2] ? clockevents_program_event+0x1ea/0x300 [11572.676838][ C2] run_timer_softirq+0x72/0x100 [11572.677088][ C2] __do_softirq+0x1b9/0x7ff [11572.677321][ C2] irq_exit_rcu+0x98/0xc0 [11572.677547][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11572.677832][ C2] [11572.677986][ C2] [11572.678136][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11572.678443][ C2] RIP: 0010:default_idle+0xf/0x20 [11572.678702][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11572.679675][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11572.679986][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11572.680387][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11572.680793][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11572.681193][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11572.681595][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11572.681996][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11572.682286][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11572.682549][ C2] default_idle_call+0x69/0xa0 [11572.682793][ C2] cpuidle_idle_call+0x1f6/0x280 [11572.683046][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11572.683327][ C2] ? lock_release+0x1d5/0x250 [11572.683566][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11572.683842][ C2] do_idle+0xfb/0x160 [11572.684047][ C2] cpu_startup_entry+0x55/0x60 [11572.684293][ C2] start_secondary+0x21c/0x2b0 [11572.684536][ C2] ? __pfx_start_secondary+0x10/0x10 [11572.684808][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11572.685125][ C2] [11595.114104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11595.114487][ C1] rcu: 1-....: (8927848 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2161378 [11595.115061][ C1] rcu: (t=9240227 jiffies g=1882453 q=730 ncpus=4) [11595.115399][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11595.115856][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11595.116474][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [11595.116764][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [11595.117751][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [11595.118064][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11595.118466][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11595.118867][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11595.119269][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11595.119673][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11595.120077][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11595.120534][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11595.120868][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11595.121272][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11595.121677][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11595.122083][ C1] PKRU: 55555554 [11595.122268][ C1] Call Trace: [11595.122443][ C1] [11595.122595][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11595.122872][ C1] ? print_cpu_stall+0x263/0x6a0 [11595.123127][ C1] ? check_cpu_stall+0x284/0x500 [11595.123381][ C1] ? rcu_pending+0x92/0x360 [11595.123615][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11595.123887][ C1] ? update_process_times+0xb9/0x110 [11595.124160][ C1] ? tick_sched_handle+0x67/0x130 [11595.124421][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11595.124707][ C1] ? __run_hrtimer+0x1c0/0x710 [11595.124961][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11595.125277][ C1] ? __hrtimer_run_queues+0x197/0x270 [11595.125550][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11595.125842][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11595.126109][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11595.126419][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11595.126684][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11595.126996][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11595.127296][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11595.127615][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11595.127908][ C1] ? __pfx___kasan_check_read+0x10/0x10 [11595.128192][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11595.128475][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11595.128788][ C1] ? get_stack_info+0x36/0xc0 [11595.129031][ C1] ? lock_acquire+0x1c1/0x220 [11595.129282][ C1] ? lock_release+0x1d5/0x250 [11595.129522][ C1] do_raw_spin_lock+0x1ec/0x270 [11595.129772][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11595.130048][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11595.130336][ C1] ? lock_acquire+0x1c1/0x220 [11595.130578][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11595.130820][ C1] _raw_spin_lock_nested+0x65/0x80 [11595.131083][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11595.131319][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11595.131568][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11595.131827][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11595.132106][ C1] ip_local_deliver_finish+0x2ae/0x480 [11595.132387][ C1] ip_local_deliver+0x19d/0x480 [11595.132635][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11595.132914][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11595.133180][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11595.133531][ C1] ? rcu_read_lock_held+0xe/0x50 [11595.133786][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11595.134108][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11595.134372][ C1] ip_rcv+0x564/0x740 [11595.134577][ C1] ? __pfx_ip_rcv+0x10/0x10 [11595.134812][ C1] ? set_track_prepare+0x8a/0xd0 [11595.135076][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11595.135356][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11595.135632][ C1] ? skb_clone+0x10b/0x330 [11595.135862][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11595.136186][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11595.136494][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11595.136786][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11595.137084][ C1] ? __tcf_classify+0x329/0x7d0 [11595.137336][ C1] ? __pfx_ip_rcv+0x10/0x10 [11595.137568][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11595.137871][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11595.138157][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11595.138485][ C1] ? lock_acquire+0x1c1/0x220 [11595.138727][ C1] ? netif_receive_skb_internal+0x84/0x300 [11595.139026][ C1] netif_receive_skb_internal+0xb0/0x300 [11595.139312][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11595.139632][ C1] ? __copy_skb_header+0xaf/0x490 [11595.139892][ C1] ? __skb_clone+0x57a/0x760 [11595.140130][ C1] netif_receive_skb+0x55/0x280 [11595.140380][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11595.140699][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11595.141035][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11595.141336][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11595.141612][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11595.141904][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11595.142219][ C1] ? hlock_class+0x4e/0x130 [11595.142453][ C1] ? get_stack_info_noinstr+0x18/0x110 [11595.142731][ C1] ? get_stack_info_noinstr+0x18/0x110 [11595.143010][ C1] ? __pfx_validate_chain+0x10/0x10 [11595.143275][ C1] ? hlock_class+0x4e/0x130 [11595.143509][ C1] ? mark_lock+0x38/0x3e0 [11595.143729][ C1] ? stack_access_ok+0xda/0x1f0 [11595.143980][ C1] ? __lock_acquire+0xb67/0x1610 [11595.144237][ C1] ? get_stack_info_noinstr+0x18/0x110 [11595.144515][ C1] ? get_stack_info+0x36/0xc0 [11595.144758][ C1] ? stack_access_ok+0xda/0x1f0 [11595.145014][ C1] ? get_reg+0x119/0x190 [11595.145232][ C1] ? unwind_next_frame+0x12af/0x1d10 [11595.145501][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11595.145814][ C1] __tcf_classify+0x329/0x7d0 [11595.146058][ C1] tcf_classify+0x283/0x930 [11595.146293][ C1] ? arch_stack_walk+0xa2/0x100 [11595.146544][ C1] ? __pfx_tcf_classify+0x10/0x10 [11595.146802][ C1] ? get_stack_info+0x36/0xc0 [11595.147045][ C1] tc_run+0x2e4/0x5d0 [11595.147252][ C1] ? __pfx_tc_run+0x10/0x10 [11595.147486][ C1] ? lock_acquire+0x1c1/0x220 [11595.147727][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11595.147990][ C1] __dev_queue_xmit+0x686/0x17e0 [11595.148246][ C1] ? lock_acquire+0x1c1/0x220 [11595.148486][ C1] ? ip_finish_output2+0x786/0x18e0 [11595.148754][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11595.149062][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11595.149340][ C1] ? neigh_hh_output+0x348/0x590 [11595.149595][ C1] ? ip_finish_output2+0x262/0x18e0 [11595.149862][ C1] ip_finish_output2+0x786/0x18e0 [11595.150121][ C1] ? stack_depot_save_flags+0x45/0x550 [11595.150402][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11595.150740][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11595.151019][ C1] ? rcu_read_lock_held+0xe/0x50 [11595.151275][ C1] ? __ip_finish_output+0x10f/0x770 [11595.151543][ C1] ip_output+0x16b/0x4f0 [11595.151761][ C1] ? run_timer_softirq+0x72/0x100 [11595.152019][ C1] ? __pfx_ip_output+0x10/0x10 [11595.152265][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11595.152553][ C1] ? rcu_read_lock_held+0xe/0x50 [11595.152806][ C1] ? ip_local_out+0x114/0x3b0 [11595.153048][ C1] __ip_queue_xmit+0x672/0x1910 [11595.153300][ C1] ? __create_object+0x5e/0xb0 [11595.153545][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11595.153815][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11595.154098][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11595.154373][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11595.154661][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11595.154945][ C1] tcp_delack_timer+0x84/0x240 [11595.155192][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11595.155465][ C1] call_timer_fn+0x173/0x430 [11595.155704][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11595.155968][ C1] ? next_expiry_recalc+0xcd/0x220 [11595.156231][ C1] __run_timers.part.0+0x52d/0x890 [11595.156494][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11595.156769][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11595.157057][ C1] ? lock_acquire+0x1c1/0x220 [11595.157296][ C1] ? clockevents_program_event+0xf6/0x300 [11595.157593][ C1] ? lock_release+0x1d5/0x250 [11595.157833][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11595.158100][ C1] ? ktime_get+0xb3/0x190 [11595.158322][ C1] ? clockevents_program_event+0x1ea/0x300 [11595.158621][ C1] run_timer_softirq+0x72/0x100 [11595.158871][ C1] __do_softirq+0x1b9/0x7ff [11595.159103][ C1] irq_exit_rcu+0x98/0xc0 [11595.159328][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11595.159615][ C1] [11595.159767][ C1] [11595.159918][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11595.160227][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11595.160555][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11595.161532][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11595.161843][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11595.162245][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11595.162646][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11595.163046][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11595.163451][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11595.163854][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11595.164153][ C1] pipe_read+0xa16/0xdf0 [11595.164376][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11595.164657][ C1] ? __pfx_pipe_read+0x10/0x10 [11595.164908][ C1] ? iterate_tty_write+0x299/0x540 [11595.165172][ C1] ? lock_release+0x1d5/0x250 [11595.165414][ C1] vfs_read+0x911/0xc00 [11595.165672][ C1] ? lock_acquire+0x1c1/0x220 [11595.166022][ C1] ? __might_fault+0xc6/0x180 [11595.166384][ C1] ? __pfx_vfs_read+0x10/0x10 [11595.166720][ C1] ? __might_fault+0xc6/0x180 [11595.167048][ C1] ? lock_release+0x1d5/0x250 [11595.167354][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11595.167750][ C1] ? __fget_light+0x54/0x1e0 [11595.168094][ C1] ksys_read+0x17a/0x1e0 [11595.168415][ C1] ? __pfx_ksys_read+0x10/0x10 [11595.168776][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11595.169233][ C1] do_syscall_64+0xc9/0x1e0 [11595.169579][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11595.170031][ C1] RIP: 0033:0x7f08a1ea38b2 [11595.170366][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11595.171796][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11595.172415][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11595.172986][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11595.173554][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11595.174118][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11595.174677][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11595.175258][ C1] [11595.175483][ C1] Sending NMI from CPU 1 to CPUs 2: [11595.175868][ C2] NMI backtrace for cpu 2 [11595.175876][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11595.175883][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11595.175888][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11595.175898][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11595.175901][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11595.175904][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11595.175906][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11595.175908][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11595.175910][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11595.175912][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11595.175914][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11595.175916][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11595.175920][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11595.175922][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11595.175923][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11595.175925][ C2] PKRU: 55555554 [11595.175926][ C2] Call Trace: [11595.175929][ C2] [11595.175932][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11595.175940][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11595.175946][ C2] ? nmi_handle+0x153/0x420 [11595.175952][ C2] ? default_do_nmi+0x41/0x100 [11595.175955][ C2] ? exc_nmi+0xf3/0x120 [11595.175958][ C2] ? end_repeat_nmi+0xf/0x60 [11595.175963][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11595.175967][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11595.175970][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11595.175973][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11595.175976][ C2] [11595.175977][ C2] [11595.175979][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11595.175982][ C2] ? get_stack_info+0x36/0xc0 [11595.175987][ C2] ? lock_acquire+0x1c1/0x220 [11595.175992][ C2] ? lock_release+0x1d5/0x250 [11595.175995][ C2] do_raw_spin_lock+0x1ec/0x270 [11595.176000][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11595.176003][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11595.176006][ C2] ? lock_acquire+0x1c1/0x220 [11595.176009][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11595.176014][ C2] _raw_spin_lock_nested+0x65/0x80 [11595.176017][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11595.176024][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11595.176027][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11595.176032][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11595.176040][ C2] ip_local_deliver_finish+0x2ae/0x480 [11595.176044][ C2] ip_local_deliver+0x19d/0x480 [11595.176047][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11595.176049][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11595.176052][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11595.176060][ C2] ? rcu_read_lock_held+0xe/0x50 [11595.176066][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11595.176069][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11595.176080][ C2] ip_rcv+0x564/0x740 [11595.176083][ C2] ? __pfx_ip_rcv+0x10/0x10 [11595.176085][ C2] ? set_track_prepare+0x8a/0xd0 [11595.176091][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11595.176094][ C2] ? start_secondary+0x21c/0x2b0 [11595.176099][ C2] ? skb_clone+0x10b/0x330 [11595.176103][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11595.176109][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11595.176115][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11595.176120][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11595.176129][ C2] ? __tcf_classify+0x329/0x7d0 [11595.176133][ C2] ? __pfx_ip_rcv+0x10/0x10 [11595.176135][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11595.176139][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11595.176143][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11595.176147][ C2] ? lock_acquire+0x1c1/0x220 [11595.176150][ C2] ? netif_receive_skb_internal+0x84/0x300 [11595.176154][ C2] netif_receive_skb_internal+0xb0/0x300 [11595.176158][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11595.176162][ C2] ? __copy_skb_header+0xaf/0x490 [11595.176168][ C2] ? __skb_clone+0x57a/0x760 [11595.176171][ C2] netif_receive_skb+0x55/0x280 [11595.176174][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11595.176182][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11595.176189][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11595.176196][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11595.176201][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11595.176211][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11595.176218][ C2] ? get_stack_info+0x36/0xc0 [11595.176223][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11595.176226][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11595.176232][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11595.176235][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11595.176238][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11595.176241][ C2] ? kernel_text_address+0x17/0xe0 [11595.176246][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11595.176251][ C2] ? arch_stack_walk+0x8c/0x100 [11595.176258][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11595.176263][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11595.176268][ C2] ? lock_acquire+0x1c1/0x220 [11595.176272][ C2] ? stack_depot_save_flags+0x281/0x550 [11595.176278][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11595.176283][ C2] ? get_stack_info_noinstr+0x18/0x110 [11595.176286][ C2] ? get_stack_info+0x36/0xc0 [11595.176290][ C2] __tcf_classify+0x329/0x7d0 [11595.176296][ C2] tcf_classify+0x283/0x930 [11595.176301][ C2] ? __pfx_tcf_classify+0x10/0x10 [11595.176304][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11595.176308][ C2] tc_run+0x2e4/0x5d0 [11595.176313][ C2] ? __pfx_tc_run+0x10/0x10 [11595.176316][ C2] ? lock_acquire+0x1c1/0x220 [11595.176319][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11595.176322][ C2] __dev_queue_xmit+0x686/0x17e0 [11595.176327][ C2] ? lock_acquire+0x1c1/0x220 [11595.176329][ C2] ? ip_finish_output2+0x786/0x18e0 [11595.176333][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11595.176336][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11595.176339][ C2] ? neigh_hh_output+0x348/0x590 [11595.176343][ C2] ? ip_finish_output2+0x262/0x18e0 [11595.176347][ C2] ip_finish_output2+0x786/0x18e0 [11595.176350][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11595.176358][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11595.176361][ C2] ? rcu_read_lock_held+0xe/0x50 [11595.176365][ C2] ? __ip_finish_output+0x10f/0x770 [11595.176368][ C2] ip_output+0x16b/0x4f0 [11595.176372][ C2] ? __pfx_ip_output+0x10/0x10 [11595.176374][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11595.176377][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11595.176381][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11595.176385][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11595.176387][ C2] ? __alloc_skb+0xd4/0x280 [11595.176390][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11595.176396][ C2] ? tcp_fragment+0x168/0x1040 [11595.176399][ C2] ? rcu_read_lock_held+0xe/0x50 [11595.176402][ C2] ? ip_local_out+0x114/0x3b0 [11595.176406][ C2] __ip_queue_xmit+0x672/0x1910 [11595.176410][ C2] ? __skb_clone+0x57a/0x760 [11595.176413][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11595.176420][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11595.176423][ C2] ? ipv4_dst_check+0xe3/0x170 [11595.176428][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11595.176434][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11595.176439][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11595.176442][ C2] ? tcp_fragment+0xb0e/0x1040 [11595.176446][ C2] tcp_send_loss_probe+0x348/0x830 [11595.176449][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11595.176452][ C2] tcp_write_timer+0x82/0x1d0 [11595.176456][ C2] call_timer_fn+0x173/0x430 [11595.176461][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11595.176466][ C2] ? next_expiry_recalc+0xcd/0x220 [11595.176470][ C2] __run_timers.part.0+0x52d/0x890 [11595.176473][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11595.176478][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11595.176481][ C2] ? lock_acquire+0x1c1/0x220 [11595.176483][ C2] ? clockevents_program_event+0xf6/0x300 [11595.176489][ C2] ? lock_release+0x1d5/0x250 [11595.176492][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11595.176495][ C2] ? ktime_get+0xb3/0x190 [11595.176500][ C2] ? clockevents_program_event+0x1ea/0x300 [11595.176504][ C2] run_timer_softirq+0x72/0x100 [11595.176507][ C2] __do_softirq+0x1b9/0x7ff [11595.176512][ C2] irq_exit_rcu+0x98/0xc0 [11595.176515][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11595.176520][ C2] [11595.176521][ C2] [11595.176522][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11595.176525][ C2] RIP: 0010:default_idle+0xf/0x20 [11595.176530][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11595.176532][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11595.176535][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11595.176537][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11595.176539][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11595.176540][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11595.176542][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11595.176545][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11595.176549][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11595.176553][ C2] default_idle_call+0x69/0xa0 [11595.176556][ C2] cpuidle_idle_call+0x1f6/0x280 [11595.176559][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11595.176563][ C2] ? lock_release+0x1d5/0x250 [11595.176565][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11595.176569][ C2] do_idle+0xfb/0x160 [11595.176572][ C2] cpu_startup_entry+0x55/0x60 [11595.176574][ C2] start_secondary+0x21c/0x2b0 [11595.176578][ C2] ? __pfx_start_secondary+0x10/0x10 [11595.176582][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11595.176588][ C2] [11620.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8631s! [perl:4135] [11620.569713][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11620.570973][ C1] irq event stamp: 209232 [11620.571191][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11620.571723][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11620.572205][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11620.572674][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11620.573138][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11620.573588][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11620.574209][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11620.574536][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11620.575517][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11620.575826][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11620.576226][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11620.576625][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11620.577024][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11620.577425][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11620.577826][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11620.578273][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11620.578605][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11620.579008][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11620.579410][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11620.579810][ C1] PKRU: 55555554 [11620.579991][ C1] Call Trace: [11620.580165][ C1] [11620.580315][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11620.580577][ C1] ? __run_hrtimer+0x1c0/0x710 [11620.580823][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11620.581099][ C1] ? __hrtimer_run_queues+0x197/0x270 [11620.581372][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11620.581664][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11620.581931][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11620.582240][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11620.582503][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11620.582815][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11620.583111][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11620.583428][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11620.583720][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11620.584014][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11620.584306][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11620.584617][ C1] ? get_stack_info+0x36/0xc0 [11620.584869][ C1] ? lock_acquire+0x1c1/0x220 [11620.585112][ C1] ? lock_release+0x1d5/0x250 [11620.585353][ C1] do_raw_spin_lock+0x1ec/0x270 [11620.585602][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11620.585874][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11620.586165][ C1] ? lock_acquire+0x1c1/0x220 [11620.586404][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11620.586646][ C1] _raw_spin_lock_nested+0x65/0x80 [11620.586907][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11620.587143][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11620.587390][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11620.587649][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11620.587930][ C1] ip_local_deliver_finish+0x2ae/0x480 [11620.588208][ C1] ip_local_deliver+0x19d/0x480 [11620.588456][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11620.588726][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11620.588990][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11620.589347][ C1] ? rcu_read_lock_held+0xe/0x50 [11620.589601][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11620.589921][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11620.590186][ C1] ip_rcv+0x564/0x740 [11620.590392][ C1] ? __pfx_ip_rcv+0x10/0x10 [11620.590622][ C1] ? set_track_prepare+0x8a/0xd0 [11620.590876][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11620.591156][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11620.591428][ C1] ? skb_clone+0x10b/0x330 [11620.591657][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11620.591977][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11620.592283][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11620.592565][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11620.592859][ C1] ? __tcf_classify+0x329/0x7d0 [11620.593110][ C1] ? __pfx_ip_rcv+0x10/0x10 [11620.593342][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11620.593641][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11620.593928][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11620.594255][ C1] ? lock_acquire+0x1c1/0x220 [11620.594493][ C1] ? netif_receive_skb_internal+0x84/0x300 [11620.594793][ C1] netif_receive_skb_internal+0xb0/0x300 [11620.595079][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11620.595397][ C1] ? __copy_skb_header+0xaf/0x490 [11620.595656][ C1] ? __skb_clone+0x57a/0x760 [11620.595890][ C1] netif_receive_skb+0x55/0x280 [11620.596140][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11620.596454][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11620.596786][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11620.597086][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11620.597361][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11620.597649][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11620.597962][ C1] ? hlock_class+0x4e/0x130 [11620.598198][ C1] ? get_stack_info_noinstr+0x18/0x110 [11620.598474][ C1] ? get_stack_info_noinstr+0x18/0x110 [11620.598749][ C1] ? __pfx_validate_chain+0x10/0x10 [11620.599013][ C1] ? hlock_class+0x4e/0x130 [11620.599246][ C1] ? mark_lock+0x38/0x3e0 [11620.599466][ C1] ? stack_access_ok+0xda/0x1f0 [11620.599714][ C1] ? __lock_acquire+0xb67/0x1610 [11620.599970][ C1] ? get_stack_info_noinstr+0x18/0x110 [11620.600248][ C1] ? get_stack_info+0x36/0xc0 [11620.600487][ C1] ? stack_access_ok+0xda/0x1f0 [11620.600734][ C1] ? get_reg+0x119/0x190 [11620.600953][ C1] ? unwind_next_frame+0x12af/0x1d10 [11620.601223][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11620.601532][ C1] __tcf_classify+0x329/0x7d0 [11620.601773][ C1] tcf_classify+0x283/0x930 [11620.602007][ C1] ? arch_stack_walk+0xa2/0x100 [11620.602258][ C1] ? __pfx_tcf_classify+0x10/0x10 [11620.602516][ C1] ? get_stack_info+0x36/0xc0 [11620.602757][ C1] tc_run+0x2e4/0x5d0 [11620.602963][ C1] ? __pfx_tc_run+0x10/0x10 [11620.603194][ C1] ? lock_acquire+0x1c1/0x220 [11620.603434][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11620.603694][ C1] __dev_queue_xmit+0x686/0x17e0 [11620.603952][ C1] ? lock_acquire+0x1c1/0x220 [11620.604193][ C1] ? ip_finish_output2+0x786/0x18e0 [11620.604459][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11620.604777][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11620.605049][ C1] ? neigh_hh_output+0x348/0x590 [11620.605303][ C1] ? ip_finish_output2+0x262/0x18e0 [11620.605569][ C1] ip_finish_output2+0x786/0x18e0 [11620.605825][ C1] ? stack_depot_save_flags+0x45/0x550 [11620.606103][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11620.606443][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11620.606726][ C1] ? rcu_read_lock_held+0xe/0x50 [11620.606978][ C1] ? __ip_finish_output+0x10f/0x770 [11620.607243][ C1] ip_output+0x16b/0x4f0 [11620.607459][ C1] ? run_timer_softirq+0x72/0x100 [11620.607717][ C1] ? __pfx_ip_output+0x10/0x10 [11620.607961][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11620.608248][ C1] ? rcu_read_lock_held+0xe/0x50 [11620.608499][ C1] ? ip_local_out+0x114/0x3b0 [11620.608738][ C1] __ip_queue_xmit+0x672/0x1910 [11620.608987][ C1] ? __create_object+0x5e/0xb0 [11620.609232][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11620.609500][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11620.609781][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11620.610056][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11620.610338][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11620.610609][ C1] tcp_delack_timer+0x84/0x240 [11620.610854][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11620.611125][ C1] call_timer_fn+0x173/0x430 [11620.611363][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11620.611625][ C1] ? next_expiry_recalc+0xcd/0x220 [11620.611886][ C1] __run_timers.part.0+0x52d/0x890 [11620.612147][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11620.612422][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11620.612707][ C1] ? lock_acquire+0x1c1/0x220 [11620.612946][ C1] ? clockevents_program_event+0xf6/0x300 [11620.613241][ C1] ? lock_release+0x1d5/0x250 [11620.613481][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11620.613744][ C1] ? ktime_get+0xb3/0x190 [11620.613965][ C1] ? clockevents_program_event+0x1ea/0x300 [11620.614263][ C1] run_timer_softirq+0x72/0x100 [11620.614511][ C1] __do_softirq+0x1b9/0x7ff [11620.614751][ C1] irq_exit_rcu+0x98/0xc0 [11620.614973][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11620.615259][ C1] [11620.615410][ C1] [11620.615559][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11620.615864][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11620.616192][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11620.617164][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11620.617471][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11620.617870][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11620.618271][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11620.618670][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11620.619069][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11620.619470][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11620.619768][ C1] pipe_read+0xa16/0xdf0 [11620.619988][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11620.620270][ C1] ? __pfx_pipe_read+0x10/0x10 [11620.620512][ C1] ? iterate_tty_write+0x299/0x540 [11620.620780][ C1] ? lock_release+0x1d5/0x250 [11620.621021][ C1] vfs_read+0x911/0xc00 [11620.621236][ C1] ? lock_acquire+0x1c1/0x220 [11620.621473][ C1] ? __might_fault+0xc6/0x180 [11620.621716][ C1] ? __pfx_vfs_read+0x10/0x10 [11620.621956][ C1] ? __might_fault+0xc6/0x180 [11620.622196][ C1] ? lock_release+0x1d5/0x250 [11620.622435][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11620.622699][ C1] ? __fget_light+0x54/0x1e0 [11620.622939][ C1] ksys_read+0x17a/0x1e0 [11620.623157][ C1] ? __pfx_ksys_read+0x10/0x10 [11620.623402][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11620.623707][ C1] do_syscall_64+0xc9/0x1e0 [11620.623941][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11620.624239][ C1] RIP: 0033:0x7f08a1ea38b2 [11620.624470][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11620.625446][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11620.625869][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11620.626270][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11620.626668][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11620.627066][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11620.627468][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11620.627871][ C1] [11620.628028][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8631s! [swapper/2:0] [11620.628459][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11620.629714][ C2] irq event stamp: 44114564 [11620.629944][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11620.630484][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11620.630999][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11620.631478][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11620.631952][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11620.632412][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11620.633024][ C2] RIP: 0010:kasan_check_range+0x4/0x1c0 [11620.633311][ C2] Code: 6a 00 5b 5d 41 5c 41 5d c3 cc cc cc cc 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 <48> 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 [11620.634286][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000246 [11620.634595][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11620.635006][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11620.635407][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11620.635804][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11620.636206][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11620.636608][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11620.637055][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11620.637389][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11620.637789][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11620.638193][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11620.638593][ C2] PKRU: 55555554 [11620.638775][ C2] Call Trace: [11620.638945][ C2] [11620.639095][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11620.639360][ C2] ? __run_hrtimer+0x1c0/0x710 [11620.639604][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11620.639880][ C2] ? __hrtimer_run_queues+0x197/0x270 [11620.640153][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11620.640443][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11620.640708][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11620.641014][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11620.641278][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11620.641541][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11620.641850][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11620.642145][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11620.642460][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11620.642749][ C2] ? kasan_check_range+0x4/0x1c0 [11620.643001][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [11620.643284][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11620.643595][ C2] ? get_stack_info+0x36/0xc0 [11620.643835][ C2] ? lock_acquire+0x1c1/0x220 [11620.644076][ C2] ? lock_release+0x1d5/0x250 [11620.644316][ C2] do_raw_spin_lock+0x1ec/0x270 [11620.644566][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11620.644844][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11620.645130][ C2] ? lock_acquire+0x1c1/0x220 [11620.645368][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11620.645610][ C2] _raw_spin_lock_nested+0x65/0x80 [11620.645870][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11620.646109][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11620.646356][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11620.646613][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11620.646887][ C2] ip_local_deliver_finish+0x2ae/0x480 [11620.647164][ C2] ip_local_deliver+0x19d/0x480 [11620.647411][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11620.647681][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11620.647944][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11620.648292][ C2] ? rcu_read_lock_held+0xe/0x50 [11620.648544][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11620.648864][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11620.649126][ C2] ip_rcv+0x564/0x740 [11620.649331][ C2] ? __pfx_ip_rcv+0x10/0x10 [11620.649560][ C2] ? set_track_prepare+0x8a/0xd0 [11620.649813][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11620.650090][ C2] ? start_secondary+0x21c/0x2b0 [11620.650342][ C2] ? skb_clone+0x10b/0x330 [11620.650566][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11620.650885][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11620.651190][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11620.651471][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11620.651767][ C2] ? __tcf_classify+0x329/0x7d0 [11620.652016][ C2] ? __pfx_ip_rcv+0x10/0x10 [11620.652246][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11620.652547][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11620.652832][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11620.653159][ C2] ? lock_acquire+0x1c1/0x220 [11620.653396][ C2] ? netif_receive_skb_internal+0x84/0x300 [11620.653695][ C2] netif_receive_skb_internal+0xb0/0x300 [11620.653979][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11620.654296][ C2] ? __copy_skb_header+0xaf/0x490 [11620.654552][ C2] ? __skb_clone+0x57a/0x760 [11620.654797][ C2] netif_receive_skb+0x55/0x280 [11620.655052][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11620.655366][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11620.655701][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11620.655997][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11620.656276][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11620.656564][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11620.656877][ C2] ? get_stack_info+0x36/0xc0 [11620.657120][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11620.657385][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11620.657702][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11620.657977][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11620.658252][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11620.658567][ C2] ? kernel_text_address+0x17/0xe0 [11620.658826][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11620.659141][ C2] ? arch_stack_walk+0x8c/0x100 [11620.659388][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11620.659653][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11620.659938][ C2] ? lock_acquire+0x1c1/0x220 [11620.660175][ C2] ? stack_depot_save_flags+0x281/0x550 [11620.660458][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11620.660760][ C2] ? get_stack_info_noinstr+0x18/0x110 [11620.661038][ C2] ? get_stack_info+0x36/0xc0 [11620.661279][ C2] __tcf_classify+0x329/0x7d0 [11620.661520][ C2] tcf_classify+0x283/0x930 [11620.661753][ C2] ? __pfx_tcf_classify+0x10/0x10 [11620.662008][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11620.662322][ C2] tc_run+0x2e4/0x5d0 [11620.662527][ C2] ? __pfx_tc_run+0x10/0x10 [11620.662758][ C2] ? lock_acquire+0x1c1/0x220 [11620.662994][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11620.663256][ C2] __dev_queue_xmit+0x686/0x17e0 [11620.663509][ C2] ? lock_acquire+0x1c1/0x220 [11620.663748][ C2] ? ip_finish_output2+0x786/0x18e0 [11620.664011][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11620.664316][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11620.664586][ C2] ? neigh_hh_output+0x348/0x590 [11620.664843][ C2] ? ip_finish_output2+0x262/0x18e0 [11620.665107][ C2] ip_finish_output2+0x786/0x18e0 [11620.665365][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11620.665709][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11620.665985][ C2] ? rcu_read_lock_held+0xe/0x50 [11620.666240][ C2] ? __ip_finish_output+0x10f/0x770 [11620.666504][ C2] ip_output+0x16b/0x4f0 [11620.666719][ C2] ? __pfx_ip_output+0x10/0x10 [11620.666962][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11620.667240][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11620.667554][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11620.667831][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11620.668082][ C2] ? __alloc_skb+0xd4/0x280 [11620.668313][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11620.668583][ C2] ? tcp_fragment+0x168/0x1040 [11620.668827][ C2] ? rcu_read_lock_held+0xe/0x50 [11620.669079][ C2] ? ip_local_out+0x114/0x3b0 [11620.669320][ C2] __ip_queue_xmit+0x672/0x1910 [11620.669567][ C2] ? __skb_clone+0x57a/0x760 [11620.669800][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11620.670067][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11620.670350][ C2] ? ipv4_dst_check+0xe3/0x170 [11620.670596][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11620.670844][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11620.671142][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11620.671461][ C2] ? tcp_fragment+0xb0e/0x1040 [11620.671708][ C2] tcp_send_loss_probe+0x348/0x830 [11620.671967][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11620.672234][ C2] tcp_write_timer+0x82/0x1d0 [11620.672474][ C2] call_timer_fn+0x173/0x430 [11620.672711][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11620.672972][ C2] ? next_expiry_recalc+0xcd/0x220 [11620.673234][ C2] __run_timers.part.0+0x52d/0x890 [11620.673493][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11620.673762][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11620.674046][ C2] ? lock_acquire+0x1c1/0x220 [11620.674285][ C2] ? clockevents_program_event+0xf6/0x300 [11620.674574][ C2] ? lock_release+0x1d5/0x250 [11620.674820][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11620.675087][ C2] ? ktime_get+0xb3/0x190 [11620.675308][ C2] ? clockevents_program_event+0x1ea/0x300 [11620.675605][ C2] run_timer_softirq+0x72/0x100 [11620.675853][ C2] __do_softirq+0x1b9/0x7ff [11620.676084][ C2] irq_exit_rcu+0x98/0xc0 [11620.676306][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11620.676591][ C2] [11620.676742][ C2] [11620.676893][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11620.677198][ C2] RIP: 0010:default_idle+0xf/0x20 [11620.677459][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11620.678426][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11620.678735][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11620.679135][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11620.679532][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11620.679928][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11620.680325][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11620.680726][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11620.681013][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11620.681274][ C2] default_idle_call+0x69/0xa0 [11620.681518][ C2] cpuidle_idle_call+0x1f6/0x280 [11620.681769][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11620.682044][ C2] ? lock_release+0x1d5/0x250 [11620.682283][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11620.682555][ C2] do_idle+0xfb/0x160 [11620.682762][ C2] cpu_startup_entry+0x55/0x60 [11620.683002][ C2] start_secondary+0x21c/0x2b0 [11620.683247][ C2] ? __pfx_start_secondary+0x10/0x10 [11620.683514][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11620.683825][ C2] [11648.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8657s! [perl:4135] [11648.569709][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11648.570978][ C1] irq event stamp: 209232 [11648.571199][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11648.571735][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11648.572222][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11648.572695][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11648.573165][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11648.573620][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11648.574238][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11648.574568][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11648.575555][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11648.575868][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11648.576270][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11648.576675][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11648.577077][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11648.577479][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11648.577882][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11648.578333][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11648.578669][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11648.579075][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11648.579477][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11648.579878][ C1] PKRU: 55555554 [11648.580063][ C1] Call Trace: [11648.580238][ C1] [11648.580389][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11648.580654][ C1] ? __run_hrtimer+0x1c0/0x710 [11648.580902][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11648.581180][ C1] ? __hrtimer_run_queues+0x197/0x270 [11648.581456][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11648.581745][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11648.582016][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11648.582330][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11648.582594][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11648.582906][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11648.583205][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11648.583522][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11648.583815][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11648.584113][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11648.584405][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11648.584723][ C1] ? get_stack_info+0x36/0xc0 [11648.584968][ C1] ? lock_acquire+0x1c1/0x220 [11648.585210][ C1] ? lock_release+0x1d5/0x250 [11648.585451][ C1] do_raw_spin_lock+0x1ec/0x270 [11648.585702][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11648.585977][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11648.586266][ C1] ? lock_acquire+0x1c1/0x220 [11648.586505][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11648.586747][ C1] _raw_spin_lock_nested+0x65/0x80 [11648.587009][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11648.587248][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11648.587498][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11648.587758][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11648.588044][ C1] ip_local_deliver_finish+0x2ae/0x480 [11648.588323][ C1] ip_local_deliver+0x19d/0x480 [11648.588572][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11648.588846][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11648.589113][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11648.589468][ C1] ? rcu_read_lock_held+0xe/0x50 [11648.589725][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11648.590046][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11648.590311][ C1] ip_rcv+0x564/0x740 [11648.590516][ C1] ? __pfx_ip_rcv+0x10/0x10 [11648.590749][ C1] ? set_track_prepare+0x8a/0xd0 [11648.591005][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11648.591283][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11648.591558][ C1] ? skb_clone+0x10b/0x330 [11648.591789][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11648.592111][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11648.592418][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11648.592704][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11648.592999][ C1] ? __tcf_classify+0x329/0x7d0 [11648.593250][ C1] ? __pfx_ip_rcv+0x10/0x10 [11648.593483][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11648.593785][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11648.594071][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11648.594399][ C1] ? lock_acquire+0x1c1/0x220 [11648.594645][ C1] ? netif_receive_skb_internal+0x84/0x300 [11648.594942][ C1] netif_receive_skb_internal+0xb0/0x300 [11648.595230][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11648.595549][ C1] ? __copy_skb_header+0xaf/0x490 [11648.595809][ C1] ? __skb_clone+0x57a/0x760 [11648.596044][ C1] netif_receive_skb+0x55/0x280 [11648.596294][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11648.596609][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11648.596942][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11648.597245][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11648.597520][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11648.597811][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11648.598125][ C1] ? hlock_class+0x4e/0x130 [11648.598360][ C1] ? get_stack_info_noinstr+0x18/0x110 [11648.598636][ C1] ? get_stack_info_noinstr+0x18/0x110 [11648.598916][ C1] ? __pfx_validate_chain+0x10/0x10 [11648.599181][ C1] ? hlock_class+0x4e/0x130 [11648.599412][ C1] ? mark_lock+0x38/0x3e0 [11648.599635][ C1] ? stack_access_ok+0xda/0x1f0 [11648.599885][ C1] ? __lock_acquire+0xb67/0x1610 [11648.600141][ C1] ? get_stack_info_noinstr+0x18/0x110 [11648.600417][ C1] ? get_stack_info+0x36/0xc0 [11648.600660][ C1] ? stack_access_ok+0xda/0x1f0 [11648.600908][ C1] ? get_reg+0x119/0x190 [11648.601125][ C1] ? unwind_next_frame+0x12af/0x1d10 [11648.601393][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11648.601705][ C1] __tcf_classify+0x329/0x7d0 [11648.601950][ C1] tcf_classify+0x283/0x930 [11648.602181][ C1] ? arch_stack_walk+0xa2/0x100 [11648.602431][ C1] ? __pfx_tcf_classify+0x10/0x10 [11648.602688][ C1] ? get_stack_info+0x36/0xc0 [11648.602931][ C1] tc_run+0x2e4/0x5d0 [11648.603137][ C1] ? __pfx_tc_run+0x10/0x10 [11648.603370][ C1] ? lock_acquire+0x1c1/0x220 [11648.603610][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11648.603872][ C1] __dev_queue_xmit+0x686/0x17e0 [11648.604127][ C1] ? lock_acquire+0x1c1/0x220 [11648.604365][ C1] ? ip_finish_output2+0x786/0x18e0 [11648.604640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11648.604947][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11648.605220][ C1] ? neigh_hh_output+0x348/0x590 [11648.605474][ C1] ? ip_finish_output2+0x262/0x18e0 [11648.605742][ C1] ip_finish_output2+0x786/0x18e0 [11648.605999][ C1] ? stack_depot_save_flags+0x45/0x550 [11648.606281][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11648.606619][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11648.606896][ C1] ? rcu_read_lock_held+0xe/0x50 [11648.607153][ C1] ? __ip_finish_output+0x10f/0x770 [11648.607418][ C1] ip_output+0x16b/0x4f0 [11648.607638][ C1] ? run_timer_softirq+0x72/0x100 [11648.607896][ C1] ? __pfx_ip_output+0x10/0x10 [11648.608141][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11648.608428][ C1] ? rcu_read_lock_held+0xe/0x50 [11648.608683][ C1] ? ip_local_out+0x114/0x3b0 [11648.608927][ C1] __ip_queue_xmit+0x672/0x1910 [11648.609177][ C1] ? __create_object+0x5e/0xb0 [11648.609421][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11648.609691][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11648.609975][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11648.610249][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11648.610533][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11648.610808][ C1] tcp_delack_timer+0x84/0x240 [11648.611053][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11648.611326][ C1] call_timer_fn+0x173/0x430 [11648.611563][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11648.611825][ C1] ? next_expiry_recalc+0xcd/0x220 [11648.612088][ C1] __run_timers.part.0+0x52d/0x890 [11648.612351][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11648.612625][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11648.612910][ C1] ? lock_acquire+0x1c1/0x220 [11648.613152][ C1] ? clockevents_program_event+0xf6/0x300 [11648.613446][ C1] ? lock_release+0x1d5/0x250 [11648.613684][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11648.613952][ C1] ? ktime_get+0xb3/0x190 [11648.614175][ C1] ? clockevents_program_event+0x1ea/0x300 [11648.614474][ C1] run_timer_softirq+0x72/0x100 [11648.614730][ C1] __do_softirq+0x1b9/0x7ff [11648.614965][ C1] irq_exit_rcu+0x98/0xc0 [11648.615188][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11648.615476][ C1] [11648.615626][ C1] [11648.615780][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11648.616085][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11648.616413][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11648.617392][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11648.617702][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11648.618105][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11648.618506][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11648.618910][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11648.619312][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11648.619716][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11648.620012][ C1] pipe_read+0xa16/0xdf0 [11648.620238][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11648.620518][ C1] ? __pfx_pipe_read+0x10/0x10 [11648.620764][ C1] ? iterate_tty_write+0x299/0x540 [11648.621027][ C1] ? lock_release+0x1d5/0x250 [11648.621270][ C1] vfs_read+0x911/0xc00 [11648.621485][ C1] ? lock_acquire+0x1c1/0x220 [11648.621726][ C1] ? __might_fault+0xc6/0x180 [11648.621967][ C1] ? __pfx_vfs_read+0x10/0x10 [11648.622208][ C1] ? __might_fault+0xc6/0x180 [11648.622449][ C1] ? lock_release+0x1d5/0x250 [11648.622691][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11648.622957][ C1] ? __fget_light+0x54/0x1e0 [11648.623196][ C1] ksys_read+0x17a/0x1e0 [11648.623415][ C1] ? __pfx_ksys_read+0x10/0x10 [11648.623661][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11648.623966][ C1] do_syscall_64+0xc9/0x1e0 [11648.624202][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11648.624508][ C1] RIP: 0033:0x7f08a1ea38b2 [11648.624744][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11648.625720][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11648.626146][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11648.626545][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11648.626946][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11648.627346][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11648.627747][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11648.628155][ C1] [11648.628315][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8657s! [swapper/2:0] [11648.628736][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11648.630000][ C2] irq event stamp: 44114564 [11648.630231][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11648.630768][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11648.631281][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11648.631759][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11648.632231][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11648.632691][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11648.633309][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11648.633637][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11648.634623][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11648.634930][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11648.635332][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11648.635733][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11648.636136][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11648.636536][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11648.636939][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11648.637388][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11648.637722][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11648.638135][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11648.638537][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11648.638939][ C2] PKRU: 55555554 [11648.639122][ C2] Call Trace: [11648.639291][ C2] [11648.639442][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11648.639707][ C2] ? __run_hrtimer+0x1c0/0x710 [11648.639953][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11648.640232][ C2] ? __hrtimer_run_queues+0x197/0x270 [11648.640506][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11648.640796][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11648.641062][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11648.641369][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11648.641631][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11648.641896][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11648.642206][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11648.642504][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11648.642820][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11648.643112][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11648.643408][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11648.643700][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11648.644011][ C2] ? get_stack_info+0x36/0xc0 [11648.644253][ C2] ? lock_acquire+0x1c1/0x220 [11648.644495][ C2] ? lock_release+0x1d5/0x250 [11648.644747][ C2] do_raw_spin_lock+0x1ec/0x270 [11648.644996][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11648.645270][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11648.645555][ C2] ? lock_acquire+0x1c1/0x220 [11648.645796][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11648.646038][ C2] _raw_spin_lock_nested+0x65/0x80 [11648.646305][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11648.646539][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11648.646788][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11648.647048][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11648.647326][ C2] ip_local_deliver_finish+0x2ae/0x480 [11648.647604][ C2] ip_local_deliver+0x19d/0x480 [11648.647854][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11648.648126][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11648.648390][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11648.648738][ C2] ? rcu_read_lock_held+0xe/0x50 [11648.648992][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11648.649316][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11648.649578][ C2] ip_rcv+0x564/0x740 [11648.649788][ C2] ? __pfx_ip_rcv+0x10/0x10 [11648.650019][ C2] ? set_track_prepare+0x8a/0xd0 [11648.650281][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11648.650558][ C2] ? start_secondary+0x21c/0x2b0 [11648.650809][ C2] ? skb_clone+0x10b/0x330 [11648.651037][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11648.651357][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11648.651667][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11648.651949][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11648.652244][ C2] ? __tcf_classify+0x329/0x7d0 [11648.652493][ C2] ? __pfx_ip_rcv+0x10/0x10 [11648.652723][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11648.653025][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11648.653310][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11648.653636][ C2] ? lock_acquire+0x1c1/0x220 [11648.653876][ C2] ? netif_receive_skb_internal+0x84/0x300 [11648.654179][ C2] netif_receive_skb_internal+0xb0/0x300 [11648.654463][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11648.654792][ C2] ? __copy_skb_header+0xaf/0x490 [11648.655061][ C2] ? __skb_clone+0x57a/0x760 [11648.655298][ C2] netif_receive_skb+0x55/0x280 [11648.655548][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11648.655861][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11648.656196][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11648.656495][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11648.656771][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11648.657060][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11648.657373][ C2] ? get_stack_info+0x36/0xc0 [11648.657614][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11648.657880][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11648.658198][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11648.658475][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11648.658751][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11648.659074][ C2] ? kernel_text_address+0x17/0xe0 [11648.659335][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11648.659648][ C2] ? arch_stack_walk+0x8c/0x100 [11648.659898][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11648.660162][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11648.660444][ C2] ? lock_acquire+0x1c1/0x220 [11648.660683][ C2] ? stack_depot_save_flags+0x281/0x550 [11648.660963][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11648.661267][ C2] ? get_stack_info_noinstr+0x18/0x110 [11648.661545][ C2] ? get_stack_info+0x36/0xc0 [11648.661784][ C2] __tcf_classify+0x329/0x7d0 [11648.662026][ C2] tcf_classify+0x283/0x930 [11648.662260][ C2] ? __pfx_tcf_classify+0x10/0x10 [11648.662515][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11648.662827][ C2] tc_run+0x2e4/0x5d0 [11648.663032][ C2] ? __pfx_tc_run+0x10/0x10 [11648.663261][ C2] ? lock_acquire+0x1c1/0x220 [11648.663500][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11648.663760][ C2] __dev_queue_xmit+0x686/0x17e0 [11648.664012][ C2] ? lock_acquire+0x1c1/0x220 [11648.664251][ C2] ? ip_finish_output2+0x786/0x18e0 [11648.664515][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11648.664828][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11648.665099][ C2] ? neigh_hh_output+0x348/0x590 [11648.665351][ C2] ? ip_finish_output2+0x262/0x18e0 [11648.665614][ C2] ip_finish_output2+0x786/0x18e0 [11648.665871][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11648.666207][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11648.666483][ C2] ? rcu_read_lock_held+0xe/0x50 [11648.666737][ C2] ? __ip_finish_output+0x10f/0x770 [11648.667002][ C2] ip_output+0x16b/0x4f0 [11648.667217][ C2] ? __pfx_ip_output+0x10/0x10 [11648.667459][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11648.667737][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11648.668050][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11648.668326][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11648.668576][ C2] ? __alloc_skb+0xd4/0x280 [11648.668807][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11648.669074][ C2] ? tcp_fragment+0x168/0x1040 [11648.669319][ C2] ? rcu_read_lock_held+0xe/0x50 [11648.669569][ C2] ? ip_local_out+0x114/0x3b0 [11648.669808][ C2] __ip_queue_xmit+0x672/0x1910 [11648.670059][ C2] ? __skb_clone+0x57a/0x760 [11648.670295][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11648.670561][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11648.670843][ C2] ? ipv4_dst_check+0xe3/0x170 [11648.671087][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11648.671336][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11648.671639][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11648.671959][ C2] ? tcp_fragment+0xb0e/0x1040 [11648.672204][ C2] tcp_send_loss_probe+0x348/0x830 [11648.672464][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11648.672732][ C2] tcp_write_timer+0x82/0x1d0 [11648.672973][ C2] call_timer_fn+0x173/0x430 [11648.673211][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11648.673472][ C2] ? next_expiry_recalc+0xcd/0x220 [11648.673734][ C2] __run_timers.part.0+0x52d/0x890 [11648.673993][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11648.674272][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11648.674553][ C2] ? lock_acquire+0x1c1/0x220 [11648.674798][ C2] ? clockevents_program_event+0xf6/0x300 [11648.675087][ C2] ? lock_release+0x1d5/0x250 [11648.675325][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11648.675591][ C2] ? ktime_get+0xb3/0x190 [11648.675817][ C2] ? clockevents_program_event+0x1ea/0x300 [11648.676113][ C2] run_timer_softirq+0x72/0x100 [11648.676360][ C2] __do_softirq+0x1b9/0x7ff [11648.676595][ C2] irq_exit_rcu+0x98/0xc0 [11648.676817][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11648.677104][ C2] [11648.677254][ C2] [11648.677405][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11648.677706][ C2] RIP: 0010:default_idle+0xf/0x20 [11648.677974][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11648.678943][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11648.679252][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11648.679652][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11648.680051][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11648.680450][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11648.680847][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11648.681251][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11648.681551][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11648.681814][ C2] default_idle_call+0x69/0xa0 [11648.682059][ C2] cpuidle_idle_call+0x1f6/0x280 [11648.682313][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11648.682590][ C2] ? lock_release+0x1d5/0x250 [11648.682831][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11648.683104][ C2] do_idle+0xfb/0x160 [11648.683307][ C2] cpu_startup_entry+0x55/0x60 [11648.683552][ C2] start_secondary+0x21c/0x2b0 [11648.683796][ C2] ? __pfx_start_secondary+0x10/0x10 [11648.684065][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11648.684378][ C2] [11673.177105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11673.177486][ C1] rcu: 1-....: (9005735 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2180821 [11673.178047][ C1] rcu: (t=9318290 jiffies g=1882453 q=730 ncpus=4) [11673.178382][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11673.178831][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11673.179447][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11673.179780][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11673.180752][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11673.181060][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11673.181462][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11673.181859][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11673.182259][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11673.182660][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11673.183061][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11673.183508][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11673.183841][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11673.184240][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11673.184646][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11673.185046][ C1] PKRU: 55555554 [11673.185228][ C1] Call Trace: [11673.185398][ C1] [11673.185551][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11673.185826][ C1] ? print_cpu_stall+0x263/0x6a0 [11673.186079][ C1] ? check_cpu_stall+0x284/0x500 [11673.186332][ C1] ? rcu_pending+0x92/0x360 [11673.186561][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11673.186834][ C1] ? update_process_times+0xb9/0x110 [11673.187105][ C1] ? tick_sched_handle+0x67/0x130 [11673.187367][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11673.187651][ C1] ? __run_hrtimer+0x1c0/0x710 [11673.187894][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11673.188208][ C1] ? __hrtimer_run_queues+0x197/0x270 [11673.188480][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11673.188771][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11673.189039][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11673.189346][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11673.189609][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11673.189917][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11673.190217][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11673.190534][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11673.190823][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11673.191121][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11673.191410][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11673.191721][ C1] ? get_stack_info+0x36/0xc0 [11673.191964][ C1] ? lock_acquire+0x1c1/0x220 [11673.192207][ C1] ? lock_release+0x1d5/0x250 [11673.192447][ C1] do_raw_spin_lock+0x1ec/0x270 [11673.192696][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11673.192970][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11673.193254][ C1] ? lock_acquire+0x1c1/0x220 [11673.193493][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11673.193736][ C1] _raw_spin_lock_nested+0x65/0x80 [11673.193998][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11673.194231][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11673.194485][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11673.194744][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11673.195027][ C1] ip_local_deliver_finish+0x2ae/0x480 [11673.195305][ C1] ip_local_deliver+0x19d/0x480 [11673.195554][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11673.195830][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11673.196093][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11673.196447][ C1] ? rcu_read_lock_held+0xe/0x50 [11673.196701][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11673.197020][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11673.197283][ C1] ip_rcv+0x564/0x740 [11673.197490][ C1] ? __pfx_ip_rcv+0x10/0x10 [11673.197720][ C1] ? set_track_prepare+0x8a/0xd0 [11673.197974][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11673.198250][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11673.198525][ C1] ? skb_clone+0x10b/0x330 [11673.198752][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11673.199072][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11673.199379][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11673.199662][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11673.199958][ C1] ? __tcf_classify+0x329/0x7d0 [11673.200209][ C1] ? __pfx_ip_rcv+0x10/0x10 [11673.200438][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11673.200739][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11673.201024][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11673.201351][ C1] ? lock_acquire+0x1c1/0x220 [11673.201588][ C1] ? netif_receive_skb_internal+0x84/0x300 [11673.201886][ C1] netif_receive_skb_internal+0xb0/0x300 [11673.202171][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11673.202489][ C1] ? __copy_skb_header+0xaf/0x490 [11673.202748][ C1] ? __skb_clone+0x57a/0x760 [11673.202983][ C1] netif_receive_skb+0x55/0x280 [11673.203232][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11673.203546][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11673.203879][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11673.204176][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11673.204464][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11673.204753][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11673.205066][ C1] ? hlock_class+0x4e/0x130 [11673.205299][ C1] ? get_stack_info_noinstr+0x18/0x110 [11673.205575][ C1] ? get_stack_info_noinstr+0x18/0x110 [11673.205850][ C1] ? __pfx_validate_chain+0x10/0x10 [11673.206114][ C1] ? hlock_class+0x4e/0x130 [11673.206347][ C1] ? mark_lock+0x38/0x3e0 [11673.206566][ C1] ? stack_access_ok+0xda/0x1f0 [11673.206816][ C1] ? __lock_acquire+0xb67/0x1610 [11673.207069][ C1] ? get_stack_info_noinstr+0x18/0x110 [11673.207347][ C1] ? get_stack_info+0x36/0xc0 [11673.207587][ C1] ? stack_access_ok+0xda/0x1f0 [11673.207833][ C1] ? get_reg+0x119/0x190 [11673.208049][ C1] ? unwind_next_frame+0x12af/0x1d10 [11673.208318][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11673.208626][ C1] __tcf_classify+0x329/0x7d0 [11673.208868][ C1] tcf_classify+0x283/0x930 [11673.209100][ C1] ? arch_stack_walk+0xa2/0x100 [11673.209350][ C1] ? __pfx_tcf_classify+0x10/0x10 [11673.209607][ C1] ? get_stack_info+0x36/0xc0 [11673.209847][ C1] tc_run+0x2e4/0x5d0 [11673.210054][ C1] ? __pfx_tc_run+0x10/0x10 [11673.210283][ C1] ? lock_acquire+0x1c1/0x220 [11673.210523][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11673.210783][ C1] __dev_queue_xmit+0x686/0x17e0 [11673.211036][ C1] ? lock_acquire+0x1c1/0x220 [11673.211275][ C1] ? ip_finish_output2+0x786/0x18e0 [11673.211541][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11673.211848][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11673.212121][ C1] ? neigh_hh_output+0x348/0x590 [11673.212374][ C1] ? ip_finish_output2+0x262/0x18e0 [11673.212639][ C1] ip_finish_output2+0x786/0x18e0 [11673.212895][ C1] ? stack_depot_save_flags+0x45/0x550 [11673.213174][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11673.213512][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11673.213795][ C1] ? rcu_read_lock_held+0xe/0x50 [11673.214048][ C1] ? __ip_finish_output+0x10f/0x770 [11673.214313][ C1] ip_output+0x16b/0x4f0 [11673.214537][ C1] ? run_timer_softirq+0x72/0x100 [11673.214794][ C1] ? __pfx_ip_output+0x10/0x10 [11673.215038][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11673.215325][ C1] ? rcu_read_lock_held+0xe/0x50 [11673.215575][ C1] ? ip_local_out+0x114/0x3b0 [11673.215817][ C1] __ip_queue_xmit+0x672/0x1910 [11673.216065][ C1] ? __create_object+0x5e/0xb0 [11673.216310][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11673.216577][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11673.216857][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11673.217133][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11673.217414][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11673.217684][ C1] tcp_delack_timer+0x84/0x240 [11673.217928][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11673.218200][ C1] call_timer_fn+0x173/0x430 [11673.218443][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11673.218704][ C1] ? next_expiry_recalc+0xcd/0x220 [11673.218965][ C1] __run_timers.part.0+0x52d/0x890 [11673.219225][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11673.219497][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11673.219784][ C1] ? lock_acquire+0x1c1/0x220 [11673.220023][ C1] ? clockevents_program_event+0xf6/0x300 [11673.220314][ C1] ? lock_release+0x1d5/0x250 [11673.220554][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11673.220818][ C1] ? ktime_get+0xb3/0x190 [11673.221038][ C1] ? clockevents_program_event+0x1ea/0x300 [11673.221336][ C1] run_timer_softirq+0x72/0x100 [11673.221585][ C1] __do_softirq+0x1b9/0x7ff [11673.221818][ C1] irq_exit_rcu+0x98/0xc0 [11673.222039][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11673.222324][ C1] [11673.222477][ C1] [11673.222626][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11673.222931][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11673.223256][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11673.224222][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11673.224554][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11673.224954][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11673.225355][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11673.225756][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11673.226156][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11673.226558][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11673.226857][ C1] pipe_read+0xa16/0xdf0 [11673.227078][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11673.227358][ C1] ? __pfx_pipe_read+0x10/0x10 [11673.227602][ C1] ? iterate_tty_write+0x299/0x540 [11673.227865][ C1] ? lock_release+0x1d5/0x250 [11673.228107][ C1] vfs_read+0x911/0xc00 [11673.228324][ C1] ? lock_acquire+0x1c1/0x220 [11673.228562][ C1] ? __might_fault+0xc6/0x180 [11673.228805][ C1] ? __pfx_vfs_read+0x10/0x10 [11673.229046][ C1] ? __might_fault+0xc6/0x180 [11673.229285][ C1] ? lock_release+0x1d5/0x250 [11673.229526][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11673.229790][ C1] ? __fget_light+0x54/0x1e0 [11673.230029][ C1] ksys_read+0x17a/0x1e0 [11673.230247][ C1] ? __pfx_ksys_read+0x10/0x10 [11673.230494][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11673.230803][ C1] do_syscall_64+0xc9/0x1e0 [11673.231037][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11673.231336][ C1] RIP: 0033:0x7f08a1ea38b2 [11673.231566][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11673.232540][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11673.232962][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11673.233363][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11673.233762][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11673.234160][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11673.234565][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11673.234970][ C1] [11673.235127][ C1] Sending NMI from CPU 1 to CPUs 2: [11673.235403][ C2] NMI backtrace for cpu 2 [11673.235411][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11673.235416][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11673.235419][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11673.235427][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11673.235430][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11673.235433][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11673.235436][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11673.235437][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11673.235439][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11673.235441][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11673.235443][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11673.235445][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11673.235449][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11673.235451][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11673.235453][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11673.235454][ C2] PKRU: 55555554 [11673.235456][ C2] Call Trace: [11673.235459][ C2] [11673.235462][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11673.235471][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11673.235477][ C2] ? nmi_handle+0x153/0x420 [11673.235482][ C2] ? default_do_nmi+0x41/0x100 [11673.235485][ C2] ? exc_nmi+0xf3/0x120 [11673.235487][ C2] ? end_repeat_nmi+0xf/0x60 [11673.235493][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11673.235496][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11673.235500][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11673.235503][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11673.235506][ C2] [11673.235507][ C2] [11673.235509][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11673.235512][ C2] ? get_stack_info+0x36/0xc0 [11673.235516][ C2] ? lock_acquire+0x1c1/0x220 [11673.235520][ C2] ? lock_release+0x1d5/0x250 [11673.235523][ C2] do_raw_spin_lock+0x1ec/0x270 [11673.235527][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11673.235530][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11673.235533][ C2] ? lock_acquire+0x1c1/0x220 [11673.235536][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11673.235540][ C2] _raw_spin_lock_nested+0x65/0x80 [11673.235543][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11673.235549][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11673.235552][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11673.235557][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11673.235563][ C2] ip_local_deliver_finish+0x2ae/0x480 [11673.235566][ C2] ip_local_deliver+0x19d/0x480 [11673.235569][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11673.235571][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11673.235574][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11673.235580][ C2] ? rcu_read_lock_held+0xe/0x50 [11673.235584][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11673.235587][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11673.235596][ C2] ip_rcv+0x564/0x740 [11673.235599][ C2] ? __pfx_ip_rcv+0x10/0x10 [11673.235602][ C2] ? set_track_prepare+0x8a/0xd0 [11673.235606][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11673.235609][ C2] ? start_secondary+0x21c/0x2b0 [11673.235614][ C2] ? skb_clone+0x10b/0x330 [11673.235617][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11673.235623][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11673.235629][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11673.235633][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11673.235641][ C2] ? __tcf_classify+0x329/0x7d0 [11673.235645][ C2] ? __pfx_ip_rcv+0x10/0x10 [11673.235648][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11673.235652][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11673.235655][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11673.235659][ C2] ? lock_acquire+0x1c1/0x220 [11673.235662][ C2] ? netif_receive_skb_internal+0x84/0x300 [11673.235666][ C2] netif_receive_skb_internal+0xb0/0x300 [11673.235670][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11673.235674][ C2] ? __copy_skb_header+0xaf/0x490 [11673.235679][ C2] ? __skb_clone+0x57a/0x760 [11673.235681][ C2] netif_receive_skb+0x55/0x280 [11673.235685][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11673.235693][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11673.235699][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11673.235706][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11673.235710][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11673.235721][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11673.235728][ C2] ? get_stack_info+0x36/0xc0 [11673.235733][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11673.235736][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11673.235741][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11673.235744][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11673.235747][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11673.235750][ C2] ? kernel_text_address+0x17/0xe0 [11673.235755][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11673.235760][ C2] ? arch_stack_walk+0x8c/0x100 [11673.235764][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11673.235767][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11673.235771][ C2] ? lock_acquire+0x1c1/0x220 [11673.235773][ C2] ? stack_depot_save_flags+0x281/0x550 [11673.235777][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11673.235782][ C2] ? get_stack_info_noinstr+0x18/0x110 [11673.235785][ C2] ? get_stack_info+0x36/0xc0 [11673.235790][ C2] __tcf_classify+0x329/0x7d0 [11673.235795][ C2] tcf_classify+0x283/0x930 [11673.235800][ C2] ? __pfx_tcf_classify+0x10/0x10 [11673.235803][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11673.235807][ C2] tc_run+0x2e4/0x5d0 [11673.235812][ C2] ? __pfx_tc_run+0x10/0x10 [11673.235815][ C2] ? lock_acquire+0x1c1/0x220 [11673.235818][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11673.235822][ C2] __dev_queue_xmit+0x686/0x17e0 [11673.235826][ C2] ? lock_acquire+0x1c1/0x220 [11673.235829][ C2] ? ip_finish_output2+0x786/0x18e0 [11673.235832][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11673.235835][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11673.235838][ C2] ? neigh_hh_output+0x348/0x590 [11673.235842][ C2] ? ip_finish_output2+0x262/0x18e0 [11673.235845][ C2] ip_finish_output2+0x786/0x18e0 [11673.235849][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11673.235856][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11673.235859][ C2] ? rcu_read_lock_held+0xe/0x50 [11673.235863][ C2] ? __ip_finish_output+0x10f/0x770 [11673.235866][ C2] ip_output+0x16b/0x4f0 [11673.235870][ C2] ? __pfx_ip_output+0x10/0x10 [11673.235872][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11673.235875][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11673.235878][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11673.235882][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11673.235885][ C2] ? __alloc_skb+0xd4/0x280 [11673.235887][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11673.235892][ C2] ? tcp_fragment+0x168/0x1040 [11673.235896][ C2] ? rcu_read_lock_held+0xe/0x50 [11673.235898][ C2] ? ip_local_out+0x114/0x3b0 [11673.235902][ C2] __ip_queue_xmit+0x672/0x1910 [11673.235906][ C2] ? __skb_clone+0x57a/0x760 [11673.235908][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11673.235914][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11673.235918][ C2] ? ipv4_dst_check+0xe3/0x170 [11673.235923][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11673.235928][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11673.235933][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11673.235936][ C2] ? tcp_fragment+0xb0e/0x1040 [11673.235940][ C2] tcp_send_loss_probe+0x348/0x830 [11673.235943][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11673.235946][ C2] tcp_write_timer+0x82/0x1d0 [11673.235950][ C2] call_timer_fn+0x173/0x430 [11673.235954][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11673.235959][ C2] ? next_expiry_recalc+0xcd/0x220 [11673.235963][ C2] __run_timers.part.0+0x52d/0x890 [11673.235966][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11673.235970][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11673.235974][ C2] ? lock_acquire+0x1c1/0x220 [11673.235976][ C2] ? clockevents_program_event+0xf6/0x300 [11673.235980][ C2] ? lock_release+0x1d5/0x250 [11673.235983][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11673.235987][ C2] ? ktime_get+0xb3/0x190 [11673.235990][ C2] ? clockevents_program_event+0x1ea/0x300 [11673.235995][ C2] run_timer_softirq+0x72/0x100 [11673.235998][ C2] __do_softirq+0x1b9/0x7ff [11673.236003][ C2] irq_exit_rcu+0x98/0xc0 [11673.236005][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11673.236009][ C2] [11673.236010][ C2] [11673.236011][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11673.236015][ C2] RIP: 0010:default_idle+0xf/0x20 [11673.236018][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11673.236021][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11673.236024][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11673.236026][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11673.236028][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11673.236029][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11673.236031][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11673.236034][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11673.236037][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11673.236042][ C2] default_idle_call+0x69/0xa0 [11673.236046][ C2] cpuidle_idle_call+0x1f6/0x280 [11673.236048][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11673.236054][ C2] ? lock_release+0x1d5/0x250 [11673.236056][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11673.236060][ C2] do_idle+0xfb/0x160 [11673.236063][ C2] cpu_startup_entry+0x55/0x60 [11673.236066][ C2] start_secondary+0x21c/0x2b0 [11673.236069][ C2] ? __pfx_start_secondary+0x10/0x10 [11673.236073][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11673.236080][ C2] [11700.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8706s! [swapper/2:0] [11700.569719][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11700.570984][ C2] irq event stamp: 44114564 [11700.571216][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11700.571754][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11700.572268][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11700.572747][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11700.573220][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11700.573676][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11700.574289][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11700.574622][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11700.575597][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11700.575905][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11700.576305][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11700.576703][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11700.577101][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11700.577500][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11700.577899][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11700.578346][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11700.578677][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11700.579077][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11700.579477][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11700.579876][ C2] PKRU: 55555554 [11700.580057][ C2] Call Trace: [11700.580234][ C2] [11700.580384][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11700.580647][ C2] ? __run_hrtimer+0x1c0/0x710 [11700.580892][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11700.581168][ C2] ? __hrtimer_run_queues+0x197/0x270 [11700.581440][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11700.581730][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11700.581995][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11700.582302][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11700.582562][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11700.582824][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11700.583135][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11700.583431][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11700.583747][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11700.584037][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11700.584338][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11700.584627][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11700.584939][ C2] ? get_stack_info+0x36/0xc0 [11700.585179][ C2] ? lock_acquire+0x1c1/0x220 [11700.585421][ C2] ? lock_release+0x1d5/0x250 [11700.585661][ C2] do_raw_spin_lock+0x1ec/0x270 [11700.585911][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11700.586183][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11700.586468][ C2] ? lock_acquire+0x1c1/0x220 [11700.586706][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11700.586948][ C2] _raw_spin_lock_nested+0x65/0x80 [11700.587208][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11700.587444][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11700.587690][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11700.587950][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11700.588227][ C2] ip_local_deliver_finish+0x2ae/0x480 [11700.588503][ C2] ip_local_deliver+0x19d/0x480 [11700.588750][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11700.589020][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11700.589283][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11700.589632][ C2] ? rcu_read_lock_held+0xe/0x50 [11700.589887][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11700.590206][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11700.590470][ C2] ip_rcv+0x564/0x740 [11700.590673][ C2] ? __pfx_ip_rcv+0x10/0x10 [11700.590907][ C2] ? set_track_prepare+0x8a/0xd0 [11700.591161][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11700.591439][ C2] ? start_secondary+0x21c/0x2b0 [11700.591690][ C2] ? skb_clone+0x10b/0x330 [11700.591916][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11700.592235][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11700.592540][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11700.592820][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11700.593116][ C2] ? __tcf_classify+0x329/0x7d0 [11700.593365][ C2] ? __pfx_ip_rcv+0x10/0x10 [11700.593593][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11700.593893][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11700.594177][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11700.594513][ C2] ? lock_acquire+0x1c1/0x220 [11700.594751][ C2] ? netif_receive_skb_internal+0x84/0x300 [11700.595048][ C2] netif_receive_skb_internal+0xb0/0x300 [11700.595333][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11700.595650][ C2] ? __copy_skb_header+0xaf/0x490 [11700.595907][ C2] ? __skb_clone+0x57a/0x760 [11700.596142][ C2] netif_receive_skb+0x55/0x280 [11700.596391][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11700.596703][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11700.597035][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11700.597332][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11700.597608][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11700.597895][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11700.598208][ C2] ? get_stack_info+0x36/0xc0 [11700.598448][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11700.598713][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11700.599031][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11700.599307][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11700.599583][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11700.599896][ C2] ? kernel_text_address+0x17/0xe0 [11700.600157][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11700.600469][ C2] ? arch_stack_walk+0x8c/0x100 [11700.600718][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11700.600982][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11700.601267][ C2] ? lock_acquire+0x1c1/0x220 [11700.601504][ C2] ? stack_depot_save_flags+0x281/0x550 [11700.601787][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11700.602091][ C2] ? get_stack_info_noinstr+0x18/0x110 [11700.602369][ C2] ? get_stack_info+0x36/0xc0 [11700.602608][ C2] __tcf_classify+0x329/0x7d0 [11700.602849][ C2] tcf_classify+0x283/0x930 [11700.603083][ C2] ? __pfx_tcf_classify+0x10/0x10 [11700.603339][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11700.603653][ C2] tc_run+0x2e4/0x5d0 [11700.603859][ C2] ? __pfx_tc_run+0x10/0x10 [11700.604093][ C2] ? lock_acquire+0x1c1/0x220 [11700.604338][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11700.604598][ C2] __dev_queue_xmit+0x686/0x17e0 [11700.604850][ C2] ? lock_acquire+0x1c1/0x220 [11700.605089][ C2] ? ip_finish_output2+0x786/0x18e0 [11700.605352][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11700.605655][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11700.605926][ C2] ? neigh_hh_output+0x348/0x590 [11700.606179][ C2] ? ip_finish_output2+0x262/0x18e0 [11700.606441][ C2] ip_finish_output2+0x786/0x18e0 [11700.606697][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11700.607033][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11700.607312][ C2] ? rcu_read_lock_held+0xe/0x50 [11700.607564][ C2] ? __ip_finish_output+0x10f/0x770 [11700.607830][ C2] ip_output+0x16b/0x4f0 [11700.608045][ C2] ? __pfx_ip_output+0x10/0x10 [11700.608289][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11700.608564][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11700.608876][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11700.609154][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11700.609405][ C2] ? __alloc_skb+0xd4/0x280 [11700.609636][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11700.609906][ C2] ? tcp_fragment+0x168/0x1040 [11700.610151][ C2] ? rcu_read_lock_held+0xe/0x50 [11700.610403][ C2] ? ip_local_out+0x114/0x3b0 [11700.610643][ C2] __ip_queue_xmit+0x672/0x1910 [11700.610895][ C2] ? __skb_clone+0x57a/0x760 [11700.611130][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11700.611395][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11700.611678][ C2] ? ipv4_dst_check+0xe3/0x170 [11700.611923][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11700.612172][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11700.612473][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11700.612792][ C2] ? tcp_fragment+0xb0e/0x1040 [11700.613035][ C2] tcp_send_loss_probe+0x348/0x830 [11700.613296][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11700.613564][ C2] tcp_write_timer+0x82/0x1d0 [11700.613805][ C2] call_timer_fn+0x173/0x430 [11700.614043][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11700.614305][ C2] ? next_expiry_recalc+0xcd/0x220 [11700.614571][ C2] __run_timers.part.0+0x52d/0x890 [11700.614830][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11700.615099][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11700.615384][ C2] ? lock_acquire+0x1c1/0x220 [11700.615622][ C2] ? clockevents_program_event+0xf6/0x300 [11700.615914][ C2] ? lock_release+0x1d5/0x250 [11700.616153][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11700.616418][ C2] ? ktime_get+0xb3/0x190 [11700.616637][ C2] ? clockevents_program_event+0x1ea/0x300 [11700.616937][ C2] run_timer_softirq+0x72/0x100 [11700.617185][ C2] __do_softirq+0x1b9/0x7ff [11700.617417][ C2] irq_exit_rcu+0x98/0xc0 [11700.617639][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11700.617924][ C2] [11700.618072][ C2] [11700.618226][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11700.618529][ C2] RIP: 0010:default_idle+0xf/0x20 [11700.618787][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11700.619756][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11700.620064][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11700.620465][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11700.620861][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11700.621258][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11700.621656][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11700.622057][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11700.622345][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11700.622604][ C2] default_idle_call+0x69/0xa0 [11700.622848][ C2] cpuidle_idle_call+0x1f6/0x280 [11700.623099][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11700.623375][ C2] ? lock_release+0x1d5/0x250 [11700.623615][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11700.623887][ C2] do_idle+0xfb/0x160 [11700.624091][ C2] cpu_startup_entry+0x55/0x60 [11700.624337][ C2] start_secondary+0x21c/0x2b0 [11700.624581][ C2] ? __pfx_start_secondary+0x10/0x10 [11700.624849][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11700.625161][ C2] [11700.625320][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8706s! [perl:4135] [11700.625738][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11700.626992][ C1] irq event stamp: 209232 [11700.627213][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11700.627743][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11700.628221][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11700.628692][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11700.629158][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11700.629609][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11700.630222][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11700.630549][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11700.631526][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11700.631836][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11700.632241][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11700.632641][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11700.633039][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11700.633440][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11700.633842][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11700.634293][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11700.634631][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11700.635032][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11700.635433][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11700.635837][ C1] PKRU: 55555554 [11700.636018][ C1] Call Trace: [11700.636190][ C1] [11700.636339][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11700.636604][ C1] ? __run_hrtimer+0x1c0/0x710 [11700.636845][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11700.637127][ C1] ? __hrtimer_run_queues+0x197/0x270 [11700.637400][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11700.637688][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11700.637957][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11700.638264][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11700.638528][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11700.638839][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11700.639141][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11700.639458][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11700.639748][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11700.640045][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11700.640333][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11700.640646][ C1] ? get_stack_info+0x36/0xc0 [11700.640888][ C1] ? lock_acquire+0x1c1/0x220 [11700.641131][ C1] ? lock_release+0x1d5/0x250 [11700.641370][ C1] do_raw_spin_lock+0x1ec/0x270 [11700.641619][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11700.641894][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11700.642180][ C1] ? lock_acquire+0x1c1/0x220 [11700.642421][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11700.642661][ C1] _raw_spin_lock_nested+0x65/0x80 [11700.642923][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11700.643157][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11700.643404][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11700.643662][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11700.643937][ C1] ip_local_deliver_finish+0x2ae/0x480 [11700.644218][ C1] ip_local_deliver+0x19d/0x480 [11700.644485][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11700.644759][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11700.645023][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11700.645371][ C1] ? rcu_read_lock_held+0xe/0x50 [11700.645623][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11700.645943][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11700.646206][ C1] ip_rcv+0x564/0x740 [11700.646410][ C1] ? __pfx_ip_rcv+0x10/0x10 [11700.646642][ C1] ? set_track_prepare+0x8a/0xd0 [11700.646896][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11700.647173][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11700.647446][ C1] ? skb_clone+0x10b/0x330 [11700.647674][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11700.647994][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11700.648302][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11700.648588][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11700.648883][ C1] ? __tcf_classify+0x329/0x7d0 [11700.649132][ C1] ? __pfx_ip_rcv+0x10/0x10 [11700.649364][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11700.649666][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11700.649951][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11700.650278][ C1] ? lock_acquire+0x1c1/0x220 [11700.650518][ C1] ? netif_receive_skb_internal+0x84/0x300 [11700.650816][ C1] netif_receive_skb_internal+0xb0/0x300 [11700.651103][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11700.651422][ C1] ? __copy_skb_header+0xaf/0x490 [11700.651680][ C1] ? __skb_clone+0x57a/0x760 [11700.651917][ C1] netif_receive_skb+0x55/0x280 [11700.652166][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11700.652478][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11700.652812][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11700.653111][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11700.653388][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11700.653680][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11700.653993][ C1] ? hlock_class+0x4e/0x130 [11700.654225][ C1] ? get_stack_info_noinstr+0x18/0x110 [11700.654521][ C1] ? get_stack_info_noinstr+0x18/0x110 [11700.654799][ C1] ? __pfx_validate_chain+0x10/0x10 [11700.655064][ C1] ? hlock_class+0x4e/0x130 [11700.655297][ C1] ? mark_lock+0x38/0x3e0 [11700.655518][ C1] ? stack_access_ok+0xda/0x1f0 [11700.655769][ C1] ? __lock_acquire+0xb67/0x1610 [11700.656025][ C1] ? get_stack_info_noinstr+0x18/0x110 [11700.656301][ C1] ? get_stack_info+0x36/0xc0 [11700.656545][ C1] ? stack_access_ok+0xda/0x1f0 [11700.656794][ C1] ? get_reg+0x119/0x190 [11700.657010][ C1] ? unwind_next_frame+0x12af/0x1d10 [11700.657279][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11700.657592][ C1] __tcf_classify+0x329/0x7d0 [11700.657837][ C1] tcf_classify+0x283/0x930 [11700.658070][ C1] ? arch_stack_walk+0xa2/0x100 [11700.658319][ C1] ? __pfx_tcf_classify+0x10/0x10 [11700.658578][ C1] ? get_stack_info+0x36/0xc0 [11700.658821][ C1] tc_run+0x2e4/0x5d0 [11700.659027][ C1] ? __pfx_tc_run+0x10/0x10 [11700.659262][ C1] ? lock_acquire+0x1c1/0x220 [11700.659503][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11700.659767][ C1] __dev_queue_xmit+0x686/0x17e0 [11700.660022][ C1] ? lock_acquire+0x1c1/0x220 [11700.660261][ C1] ? ip_finish_output2+0x786/0x18e0 [11700.660528][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11700.660834][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11700.661109][ C1] ? neigh_hh_output+0x348/0x590 [11700.661363][ C1] ? ip_finish_output2+0x262/0x18e0 [11700.661630][ C1] ip_finish_output2+0x786/0x18e0 [11700.661888][ C1] ? stack_depot_save_flags+0x45/0x550 [11700.662168][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11700.662509][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11700.662787][ C1] ? rcu_read_lock_held+0xe/0x50 [11700.663040][ C1] ? __ip_finish_output+0x10f/0x770 [11700.663310][ C1] ip_output+0x16b/0x4f0 [11700.663527][ C1] ? run_timer_softirq+0x72/0x100 [11700.663786][ C1] ? __pfx_ip_output+0x10/0x10 [11700.664031][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11700.664319][ C1] ? rcu_read_lock_held+0xe/0x50 [11700.664582][ C1] ? ip_local_out+0x114/0x3b0 [11700.664823][ C1] __ip_queue_xmit+0x672/0x1910 [11700.665073][ C1] ? __create_object+0x5e/0xb0 [11700.665320][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11700.665590][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11700.665872][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11700.666144][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11700.666430][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11700.666708][ C1] tcp_delack_timer+0x84/0x240 [11700.666953][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11700.667226][ C1] call_timer_fn+0x173/0x430 [11700.667465][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11700.667728][ C1] ? next_expiry_recalc+0xcd/0x220 [11700.667990][ C1] __run_timers.part.0+0x52d/0x890 [11700.668251][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11700.668525][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11700.668815][ C1] ? lock_acquire+0x1c1/0x220 [11700.669053][ C1] ? clockevents_program_event+0xf6/0x300 [11700.669347][ C1] ? lock_release+0x1d5/0x250 [11700.669586][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11700.669853][ C1] ? ktime_get+0xb3/0x190 [11700.670074][ C1] ? clockevents_program_event+0x1ea/0x300 [11700.670372][ C1] run_timer_softirq+0x72/0x100 [11700.670622][ C1] __do_softirq+0x1b9/0x7ff [11700.670854][ C1] irq_exit_rcu+0x98/0xc0 [11700.671078][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11700.671365][ C1] [11700.671516][ C1] [11700.671668][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11700.671976][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11700.672303][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11700.673276][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11700.673586][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11700.673986][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11700.674390][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11700.674789][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11700.675192][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11700.675594][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11700.675891][ C1] pipe_read+0xa16/0xdf0 [11700.676113][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11700.676392][ C1] ? __pfx_pipe_read+0x10/0x10 [11700.676636][ C1] ? iterate_tty_write+0x299/0x540 [11700.676899][ C1] ? lock_release+0x1d5/0x250 [11700.677141][ C1] vfs_read+0x911/0xc00 [11700.677356][ C1] ? lock_acquire+0x1c1/0x220 [11700.677596][ C1] ? __might_fault+0xc6/0x180 [11700.677838][ C1] ? __pfx_vfs_read+0x10/0x10 [11700.678074][ C1] ? __might_fault+0xc6/0x180 [11700.678316][ C1] ? lock_release+0x1d5/0x250 [11700.678557][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11700.678825][ C1] ? __fget_light+0x54/0x1e0 [11700.679065][ C1] ksys_read+0x17a/0x1e0 [11700.679283][ C1] ? __pfx_ksys_read+0x10/0x10 [11700.679528][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11700.679840][ C1] do_syscall_64+0xc9/0x1e0 [11700.680073][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11700.680376][ C1] RIP: 0033:0x7f08a1ea38b2 [11700.680605][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11700.681581][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11700.682001][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11700.682404][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11700.682806][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11700.683208][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11700.683607][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11700.684012][ C1] [11728.569270][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8732s! [swapper/2:0] [11728.569704][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11728.570960][ C2] irq event stamp: 44114564 [11728.571190][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11728.571726][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11728.572240][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11728.572716][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11728.573187][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11728.573641][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11728.574261][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11728.574586][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11728.575553][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11728.575860][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11728.576258][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11728.576655][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11728.577052][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11728.577452][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11728.577850][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11728.578296][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11728.578627][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11728.579025][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11728.579430][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11728.579828][ C2] PKRU: 55555554 [11728.580010][ C2] Call Trace: [11728.580180][ C2] [11728.580330][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11728.580593][ C2] ? __run_hrtimer+0x1c0/0x710 [11728.580838][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11728.581114][ C2] ? __hrtimer_run_queues+0x197/0x270 [11728.581386][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11728.581675][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11728.581941][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11728.582247][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11728.582512][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11728.582773][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11728.583082][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11728.583378][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11728.583694][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11728.583983][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11728.584283][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11728.584572][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11728.584883][ C2] ? get_stack_info+0x36/0xc0 [11728.585123][ C2] ? lock_acquire+0x1c1/0x220 [11728.585366][ C2] ? lock_release+0x1d5/0x250 [11728.585606][ C2] do_raw_spin_lock+0x1ec/0x270 [11728.585855][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11728.586127][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11728.586410][ C2] ? lock_acquire+0x1c1/0x220 [11728.586648][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11728.586890][ C2] _raw_spin_lock_nested+0x65/0x80 [11728.587151][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11728.587385][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11728.587630][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11728.587890][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11728.588171][ C2] ip_local_deliver_finish+0x2ae/0x480 [11728.588448][ C2] ip_local_deliver+0x19d/0x480 [11728.588704][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11728.588975][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11728.589238][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11728.589589][ C2] ? rcu_read_lock_held+0xe/0x50 [11728.589843][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11728.590165][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11728.590429][ C2] ip_rcv+0x564/0x740 [11728.590634][ C2] ? __pfx_ip_rcv+0x10/0x10 [11728.590863][ C2] ? set_track_prepare+0x8a/0xd0 [11728.591118][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11728.591396][ C2] ? start_secondary+0x21c/0x2b0 [11728.591647][ C2] ? skb_clone+0x10b/0x330 [11728.591875][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11728.592196][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11728.592505][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11728.592788][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11728.593084][ C2] ? __tcf_classify+0x329/0x7d0 [11728.593333][ C2] ? __pfx_ip_rcv+0x10/0x10 [11728.593563][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11728.593865][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11728.594150][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11728.594484][ C2] ? lock_acquire+0x1c1/0x220 [11728.594724][ C2] ? netif_receive_skb_internal+0x84/0x300 [11728.595021][ C2] netif_receive_skb_internal+0xb0/0x300 [11728.595307][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11728.595624][ C2] ? __copy_skb_header+0xaf/0x490 [11728.595888][ C2] ? __skb_clone+0x57a/0x760 [11728.596125][ C2] netif_receive_skb+0x55/0x280 [11728.596374][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11728.596687][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11728.597021][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11728.597319][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11728.597599][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11728.597890][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11728.598203][ C2] ? get_stack_info+0x36/0xc0 [11728.598443][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11728.598710][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11728.599028][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11728.599306][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11728.599583][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11728.599898][ C2] ? kernel_text_address+0x17/0xe0 [11728.600160][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11728.600475][ C2] ? arch_stack_walk+0x8c/0x100 [11728.600726][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11728.600994][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11728.601279][ C2] ? lock_acquire+0x1c1/0x220 [11728.601519][ C2] ? stack_depot_save_flags+0x281/0x550 [11728.601804][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11728.602109][ C2] ? get_stack_info_noinstr+0x18/0x110 [11728.602387][ C2] ? get_stack_info+0x36/0xc0 [11728.602628][ C2] __tcf_classify+0x329/0x7d0 [11728.602871][ C2] tcf_classify+0x283/0x930 [11728.603105][ C2] ? __pfx_tcf_classify+0x10/0x10 [11728.603361][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11728.603674][ C2] tc_run+0x2e4/0x5d0 [11728.603882][ C2] ? __pfx_tc_run+0x10/0x10 [11728.604112][ C2] ? lock_acquire+0x1c1/0x220 [11728.604358][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11728.604619][ C2] __dev_queue_xmit+0x686/0x17e0 [11728.604873][ C2] ? lock_acquire+0x1c1/0x220 [11728.605113][ C2] ? ip_finish_output2+0x786/0x18e0 [11728.605378][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11728.605682][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11728.605953][ C2] ? neigh_hh_output+0x348/0x590 [11728.606206][ C2] ? ip_finish_output2+0x262/0x18e0 [11728.606471][ C2] ip_finish_output2+0x786/0x18e0 [11728.606728][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11728.607064][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11728.607343][ C2] ? rcu_read_lock_held+0xe/0x50 [11728.607596][ C2] ? __ip_finish_output+0x10f/0x770 [11728.607862][ C2] ip_output+0x16b/0x4f0 [11728.608079][ C2] ? __pfx_ip_output+0x10/0x10 [11728.608324][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11728.608601][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11728.608914][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11728.609190][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11728.609442][ C2] ? __alloc_skb+0xd4/0x280 [11728.609674][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11728.609945][ C2] ? tcp_fragment+0x168/0x1040 [11728.610190][ C2] ? rcu_read_lock_held+0xe/0x50 [11728.610443][ C2] ? ip_local_out+0x114/0x3b0 [11728.610684][ C2] __ip_queue_xmit+0x672/0x1910 [11728.610932][ C2] ? __skb_clone+0x57a/0x760 [11728.611167][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11728.611433][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11728.611721][ C2] ? ipv4_dst_check+0xe3/0x170 [11728.611966][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11728.612216][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11728.612519][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11728.612839][ C2] ? tcp_fragment+0xb0e/0x1040 [11728.613084][ C2] tcp_send_loss_probe+0x348/0x830 [11728.613345][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11728.613613][ C2] tcp_write_timer+0x82/0x1d0 [11728.613854][ C2] call_timer_fn+0x173/0x430 [11728.614090][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11728.614360][ C2] ? next_expiry_recalc+0xcd/0x220 [11728.614621][ C2] __run_timers.part.0+0x52d/0x890 [11728.614882][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11728.615152][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11728.615436][ C2] ? lock_acquire+0x1c1/0x220 [11728.615675][ C2] ? clockevents_program_event+0xf6/0x300 [11728.615969][ C2] ? lock_release+0x1d5/0x250 [11728.616207][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11728.616473][ C2] ? ktime_get+0xb3/0x190 [11728.616695][ C2] ? clockevents_program_event+0x1ea/0x300 [11728.616992][ C2] run_timer_softirq+0x72/0x100 [11728.617244][ C2] __do_softirq+0x1b9/0x7ff [11728.617477][ C2] irq_exit_rcu+0x98/0xc0 [11728.617699][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11728.617986][ C2] [11728.618136][ C2] [11728.618290][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11728.618595][ C2] RIP: 0010:default_idle+0xf/0x20 [11728.618852][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11728.619824][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11728.620132][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11728.620533][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11728.620933][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11728.621331][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11728.621730][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11728.622133][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11728.622421][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11728.622681][ C2] default_idle_call+0x69/0xa0 [11728.622927][ C2] cpuidle_idle_call+0x1f6/0x280 [11728.623177][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11728.623456][ C2] ? lock_release+0x1d5/0x250 [11728.623700][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11728.623972][ C2] do_idle+0xfb/0x160 [11728.624177][ C2] cpu_startup_entry+0x55/0x60 [11728.624426][ C2] start_secondary+0x21c/0x2b0 [11728.624671][ C2] ? __pfx_start_secondary+0x10/0x10 [11728.624940][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11728.625252][ C2] [11728.625412][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8732s! [perl:4135] [11728.625832][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11728.627092][ C1] irq event stamp: 209232 [11728.627312][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11728.627843][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11728.628322][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11728.628795][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11728.629260][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11728.629712][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11728.630325][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11728.630652][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11728.631631][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11728.631941][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11728.632345][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11728.632748][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11728.633149][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11728.633549][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11728.633952][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11728.634409][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11728.634744][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11728.635148][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11728.635549][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11728.635954][ C1] PKRU: 55555554 [11728.636136][ C1] Call Trace: [11728.636307][ C1] [11728.636456][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11728.636722][ C1] ? __run_hrtimer+0x1c0/0x710 [11728.636966][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11728.637248][ C1] ? __hrtimer_run_queues+0x197/0x270 [11728.637521][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11728.637810][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11728.638079][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11728.638387][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11728.638649][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11728.638961][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11728.639261][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11728.639577][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11728.639867][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11728.640166][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11728.640455][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11728.640767][ C1] ? get_stack_info+0x36/0xc0 [11728.641009][ C1] ? lock_acquire+0x1c1/0x220 [11728.641251][ C1] ? lock_release+0x1d5/0x250 [11728.641489][ C1] do_raw_spin_lock+0x1ec/0x270 [11728.641741][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11728.642015][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11728.642303][ C1] ? lock_acquire+0x1c1/0x220 [11728.642544][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11728.642786][ C1] _raw_spin_lock_nested+0x65/0x80 [11728.643050][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11728.643286][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11728.643535][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11728.643794][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11728.644069][ C1] ip_local_deliver_finish+0x2ae/0x480 [11728.644362][ C1] ip_local_deliver+0x19d/0x480 [11728.644611][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11728.644885][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11728.645151][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11728.645497][ C1] ? rcu_read_lock_held+0xe/0x50 [11728.645751][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11728.646072][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11728.646335][ C1] ip_rcv+0x564/0x740 [11728.646539][ C1] ? __pfx_ip_rcv+0x10/0x10 [11728.646772][ C1] ? set_track_prepare+0x8a/0xd0 [11728.647026][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11728.647302][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11728.647575][ C1] ? skb_clone+0x10b/0x330 [11728.647803][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11728.648123][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11728.648431][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11728.648712][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11728.649007][ C1] ? __tcf_classify+0x329/0x7d0 [11728.649256][ C1] ? __pfx_ip_rcv+0x10/0x10 [11728.649487][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11728.649788][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11728.650074][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11728.650399][ C1] ? lock_acquire+0x1c1/0x220 [11728.650639][ C1] ? netif_receive_skb_internal+0x84/0x300 [11728.650936][ C1] netif_receive_skb_internal+0xb0/0x300 [11728.651221][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11728.651539][ C1] ? __copy_skb_header+0xaf/0x490 [11728.651798][ C1] ? __skb_clone+0x57a/0x760 [11728.652034][ C1] netif_receive_skb+0x55/0x280 [11728.652285][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11728.652599][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11728.652934][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11728.653235][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11728.653511][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11728.653801][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11728.654113][ C1] ? hlock_class+0x4e/0x130 [11728.654353][ C1] ? get_stack_info_noinstr+0x18/0x110 [11728.654631][ C1] ? get_stack_info_noinstr+0x18/0x110 [11728.654908][ C1] ? __pfx_validate_chain+0x10/0x10 [11728.655172][ C1] ? hlock_class+0x4e/0x130 [11728.655403][ C1] ? mark_lock+0x38/0x3e0 [11728.655622][ C1] ? stack_access_ok+0xda/0x1f0 [11728.655873][ C1] ? __lock_acquire+0xb67/0x1610 [11728.656128][ C1] ? get_stack_info_noinstr+0x18/0x110 [11728.656404][ C1] ? get_stack_info+0x36/0xc0 [11728.656647][ C1] ? stack_access_ok+0xda/0x1f0 [11728.656894][ C1] ? get_reg+0x119/0x190 [11728.657110][ C1] ? unwind_next_frame+0x12af/0x1d10 [11728.657381][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11728.657695][ C1] __tcf_classify+0x329/0x7d0 [11728.657942][ C1] tcf_classify+0x283/0x930 [11728.658175][ C1] ? arch_stack_walk+0xa2/0x100 [11728.658425][ C1] ? __pfx_tcf_classify+0x10/0x10 [11728.658683][ C1] ? get_stack_info+0x36/0xc0 [11728.658926][ C1] tc_run+0x2e4/0x5d0 [11728.659132][ C1] ? __pfx_tc_run+0x10/0x10 [11728.659367][ C1] ? lock_acquire+0x1c1/0x220 [11728.659608][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11728.659872][ C1] __dev_queue_xmit+0x686/0x17e0 [11728.660128][ C1] ? lock_acquire+0x1c1/0x220 [11728.660365][ C1] ? ip_finish_output2+0x786/0x18e0 [11728.660634][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11728.660941][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11728.661215][ C1] ? neigh_hh_output+0x348/0x590 [11728.661470][ C1] ? ip_finish_output2+0x262/0x18e0 [11728.661737][ C1] ip_finish_output2+0x786/0x18e0 [11728.661994][ C1] ? stack_depot_save_flags+0x45/0x550 [11728.662274][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11728.662614][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11728.662890][ C1] ? rcu_read_lock_held+0xe/0x50 [11728.663148][ C1] ? __ip_finish_output+0x10f/0x770 [11728.663415][ C1] ip_output+0x16b/0x4f0 [11728.663639][ C1] ? run_timer_softirq+0x72/0x100 [11728.663899][ C1] ? __pfx_ip_output+0x10/0x10 [11728.664144][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11728.664438][ C1] ? rcu_read_lock_held+0xe/0x50 [11728.664691][ C1] ? ip_local_out+0x114/0x3b0 [11728.664934][ C1] __ip_queue_xmit+0x672/0x1910 [11728.665183][ C1] ? __create_object+0x5e/0xb0 [11728.665428][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11728.665698][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11728.665986][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11728.666260][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11728.666544][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11728.666818][ C1] tcp_delack_timer+0x84/0x240 [11728.667064][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11728.667338][ C1] call_timer_fn+0x173/0x430 [11728.667576][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11728.667839][ C1] ? next_expiry_recalc+0xcd/0x220 [11728.668102][ C1] __run_timers.part.0+0x52d/0x890 [11728.668364][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11728.668640][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11728.668925][ C1] ? lock_acquire+0x1c1/0x220 [11728.669165][ C1] ? clockevents_program_event+0xf6/0x300 [11728.669457][ C1] ? lock_release+0x1d5/0x250 [11728.669697][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11728.669965][ C1] ? ktime_get+0xb3/0x190 [11728.670188][ C1] ? clockevents_program_event+0x1ea/0x300 [11728.670486][ C1] run_timer_softirq+0x72/0x100 [11728.670735][ C1] __do_softirq+0x1b9/0x7ff [11728.670969][ C1] irq_exit_rcu+0x98/0xc0 [11728.671193][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11728.671481][ C1] [11728.671631][ C1] [11728.671785][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11728.672090][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11728.672418][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11728.673395][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11728.673705][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11728.674108][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11728.674518][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11728.674916][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11728.675318][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11728.675723][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11728.676019][ C1] pipe_read+0xa16/0xdf0 [11728.676244][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11728.676523][ C1] ? __pfx_pipe_read+0x10/0x10 [11728.676767][ C1] ? iterate_tty_write+0x299/0x540 [11728.677030][ C1] ? lock_release+0x1d5/0x250 [11728.677272][ C1] vfs_read+0x911/0xc00 [11728.677487][ C1] ? lock_acquire+0x1c1/0x220 [11728.677728][ C1] ? __might_fault+0xc6/0x180 [11728.677968][ C1] ? __pfx_vfs_read+0x10/0x10 [11728.678207][ C1] ? __might_fault+0xc6/0x180 [11728.678448][ C1] ? lock_release+0x1d5/0x250 [11728.678690][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11728.678956][ C1] ? __fget_light+0x54/0x1e0 [11728.679195][ C1] ksys_read+0x17a/0x1e0 [11728.679414][ C1] ? __pfx_ksys_read+0x10/0x10 [11728.679660][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11728.679966][ C1] do_syscall_64+0xc9/0x1e0 [11728.680201][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11728.680503][ C1] RIP: 0033:0x7f08a1ea38b2 [11728.680731][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11728.681708][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11728.682133][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11728.682531][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11728.682933][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11728.683334][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11728.683734][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11728.684137][ C1] [11751.235105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11751.235487][ C1] rcu: 1-....: (9083507 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2200278 [11751.236048][ C1] rcu: (t=9396348 jiffies g=1882453 q=730 ncpus=4) [11751.236387][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11751.236838][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11751.237451][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11751.237780][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11751.238755][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11751.239066][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11751.239466][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11751.239869][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11751.240269][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11751.240670][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11751.241069][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11751.241519][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11751.241856][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11751.242259][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11751.242660][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11751.243061][ C1] PKRU: 55555554 [11751.243244][ C1] Call Trace: [11751.243418][ C1] [11751.243572][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11751.243846][ C1] ? print_cpu_stall+0x263/0x6a0 [11751.244105][ C1] ? check_cpu_stall+0x284/0x500 [11751.244358][ C1] ? rcu_pending+0x92/0x360 [11751.244591][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11751.244862][ C1] ? update_process_times+0xb9/0x110 [11751.245134][ C1] ? tick_sched_handle+0x67/0x130 [11751.245393][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11751.245681][ C1] ? __run_hrtimer+0x1c0/0x710 [11751.245926][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11751.246239][ C1] ? __hrtimer_run_queues+0x197/0x270 [11751.246514][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11751.246803][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11751.247070][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11751.247380][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11751.247642][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11751.247954][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11751.248252][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11751.248569][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11751.248860][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11751.249157][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11751.249446][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11751.249759][ C1] ? get_stack_info+0x36/0xc0 [11751.250003][ C1] ? lock_acquire+0x1c1/0x220 [11751.250245][ C1] ? lock_release+0x1d5/0x250 [11751.250486][ C1] do_raw_spin_lock+0x1ec/0x270 [11751.250736][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11751.251008][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11751.251297][ C1] ? lock_acquire+0x1c1/0x220 [11751.251537][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11751.251777][ C1] _raw_spin_lock_nested+0x65/0x80 [11751.252039][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11751.252276][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11751.252525][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11751.252784][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11751.253062][ C1] ip_local_deliver_finish+0x2ae/0x480 [11751.253341][ C1] ip_local_deliver+0x19d/0x480 [11751.253589][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11751.253867][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11751.254140][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11751.254489][ C1] ? rcu_read_lock_held+0xe/0x50 [11751.254743][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11751.255065][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11751.255329][ C1] ip_rcv+0x564/0x740 [11751.255535][ C1] ? __pfx_ip_rcv+0x10/0x10 [11751.255768][ C1] ? set_track_prepare+0x8a/0xd0 [11751.256026][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11751.256304][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11751.256577][ C1] ? skb_clone+0x10b/0x330 [11751.256809][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11751.257132][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11751.257440][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11751.257723][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11751.258019][ C1] ? __tcf_classify+0x329/0x7d0 [11751.258269][ C1] ? __pfx_ip_rcv+0x10/0x10 [11751.258502][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11751.258804][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11751.259090][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11751.259417][ C1] ? lock_acquire+0x1c1/0x220 [11751.259658][ C1] ? netif_receive_skb_internal+0x84/0x300 [11751.259957][ C1] netif_receive_skb_internal+0xb0/0x300 [11751.260245][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11751.260564][ C1] ? __copy_skb_header+0xaf/0x490 [11751.260825][ C1] ? __skb_clone+0x57a/0x760 [11751.261062][ C1] netif_receive_skb+0x55/0x280 [11751.261311][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11751.261627][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11751.261961][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11751.262264][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11751.262540][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11751.262831][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11751.263144][ C1] ? hlock_class+0x4e/0x130 [11751.263380][ C1] ? get_stack_info_noinstr+0x18/0x110 [11751.263656][ C1] ? get_stack_info_noinstr+0x18/0x110 [11751.263936][ C1] ? __pfx_validate_chain+0x10/0x10 [11751.264208][ C1] ? hlock_class+0x4e/0x130 [11751.264440][ C1] ? mark_lock+0x38/0x3e0 [11751.264662][ C1] ? stack_access_ok+0xda/0x1f0 [11751.264913][ C1] ? __lock_acquire+0xb67/0x1610 [11751.265169][ C1] ? get_stack_info_noinstr+0x18/0x110 [11751.265446][ C1] ? get_stack_info+0x36/0xc0 [11751.265689][ C1] ? stack_access_ok+0xda/0x1f0 [11751.265938][ C1] ? get_reg+0x119/0x190 [11751.266155][ C1] ? unwind_next_frame+0x12af/0x1d10 [11751.266423][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11751.266735][ C1] __tcf_classify+0x329/0x7d0 [11751.266979][ C1] tcf_classify+0x283/0x930 [11751.267212][ C1] ? arch_stack_walk+0xa2/0x100 [11751.267463][ C1] ? __pfx_tcf_classify+0x10/0x10 [11751.267721][ C1] ? get_stack_info+0x36/0xc0 [11751.267964][ C1] tc_run+0x2e4/0x5d0 [11751.268171][ C1] ? __pfx_tc_run+0x10/0x10 [11751.268405][ C1] ? lock_acquire+0x1c1/0x220 [11751.268644][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11751.268907][ C1] __dev_queue_xmit+0x686/0x17e0 [11751.269163][ C1] ? lock_acquire+0x1c1/0x220 [11751.269400][ C1] ? ip_finish_output2+0x786/0x18e0 [11751.269669][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11751.269978][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11751.270254][ C1] ? neigh_hh_output+0x348/0x590 [11751.270507][ C1] ? ip_finish_output2+0x262/0x18e0 [11751.270777][ C1] ip_finish_output2+0x786/0x18e0 [11751.271034][ C1] ? stack_depot_save_flags+0x45/0x550 [11751.271317][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11751.271656][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11751.271933][ C1] ? rcu_read_lock_held+0xe/0x50 [11751.272189][ C1] ? __ip_finish_output+0x10f/0x770 [11751.272455][ C1] ip_output+0x16b/0x4f0 [11751.272676][ C1] ? run_timer_softirq+0x72/0x100 [11751.272936][ C1] ? __pfx_ip_output+0x10/0x10 [11751.273181][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11751.273470][ C1] ? rcu_read_lock_held+0xe/0x50 [11751.273724][ C1] ? ip_local_out+0x114/0x3b0 [11751.273968][ C1] __ip_queue_xmit+0x672/0x1910 [11751.274226][ C1] ? __create_object+0x5e/0xb0 [11751.274470][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11751.274741][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11751.275025][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11751.275300][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11751.275584][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11751.275859][ C1] tcp_delack_timer+0x84/0x240 [11751.276110][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11751.276385][ C1] call_timer_fn+0x173/0x430 [11751.276622][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11751.276887][ C1] ? next_expiry_recalc+0xcd/0x220 [11751.277151][ C1] __run_timers.part.0+0x52d/0x890 [11751.277413][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11751.277688][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11751.277974][ C1] ? lock_acquire+0x1c1/0x220 [11751.278216][ C1] ? clockevents_program_event+0xf6/0x300 [11751.278512][ C1] ? lock_release+0x1d5/0x250 [11751.278751][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11751.279019][ C1] ? ktime_get+0xb3/0x190 [11751.279242][ C1] ? clockevents_program_event+0x1ea/0x300 [11751.279541][ C1] run_timer_softirq+0x72/0x100 [11751.279789][ C1] __do_softirq+0x1b9/0x7ff [11751.280024][ C1] irq_exit_rcu+0x98/0xc0 [11751.280248][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11751.280538][ C1] [11751.280688][ C1] [11751.280841][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11751.281148][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11751.281476][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11751.282464][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11751.282773][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11751.283177][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11751.283578][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11751.283977][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11751.284387][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11751.284792][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11751.285090][ C1] pipe_read+0xa16/0xdf0 [11751.285316][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11751.285596][ C1] ? __pfx_pipe_read+0x10/0x10 [11751.285842][ C1] ? iterate_tty_write+0x299/0x540 [11751.286105][ C1] ? lock_release+0x1d5/0x250 [11751.286348][ C1] vfs_read+0x911/0xc00 [11751.286565][ C1] ? lock_acquire+0x1c1/0x220 [11751.286805][ C1] ? __might_fault+0xc6/0x180 [11751.287046][ C1] ? __pfx_vfs_read+0x10/0x10 [11751.287288][ C1] ? __might_fault+0xc6/0x180 [11751.287528][ C1] ? lock_release+0x1d5/0x250 [11751.287770][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11751.288037][ C1] ? __fget_light+0x54/0x1e0 [11751.288277][ C1] ksys_read+0x17a/0x1e0 [11751.288496][ C1] ? __pfx_ksys_read+0x10/0x10 [11751.288742][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11751.289047][ C1] do_syscall_64+0xc9/0x1e0 [11751.289282][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11751.289585][ C1] RIP: 0033:0x7f08a1ea38b2 [11751.289814][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11751.290797][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11751.291222][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11751.291622][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11751.292026][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11751.292430][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11751.292831][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11751.293235][ C1] [11751.293396][ C1] Sending NMI from CPU 1 to CPUs 2: [11751.293673][ C2] NMI backtrace for cpu 2 [11751.293682][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11751.293689][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11751.293692][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11751.293699][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11751.293702][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11751.293705][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11751.293707][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11751.293709][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11751.293710][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11751.293712][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11751.293714][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11751.293716][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11751.293719][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11751.293721][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11751.293723][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11751.293724][ C2] PKRU: 55555554 [11751.293725][ C2] Call Trace: [11751.293728][ C2] [11751.293731][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11751.293739][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11751.293745][ C2] ? nmi_handle+0x153/0x420 [11751.293750][ C2] ? default_do_nmi+0x41/0x100 [11751.293753][ C2] ? exc_nmi+0xf3/0x120 [11751.293756][ C2] ? end_repeat_nmi+0xf/0x60 [11751.293761][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11751.293764][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11751.293768][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11751.293771][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11751.293774][ C2] [11751.293775][ C2] [11751.293777][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11751.293780][ C2] ? get_stack_info+0x36/0xc0 [11751.293783][ C2] ? lock_acquire+0x1c1/0x220 [11751.293787][ C2] ? lock_release+0x1d5/0x250 [11751.293791][ C2] do_raw_spin_lock+0x1ec/0x270 [11751.293794][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11751.293797][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11751.293801][ C2] ? lock_acquire+0x1c1/0x220 [11751.293803][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11751.293807][ C2] _raw_spin_lock_nested+0x65/0x80 [11751.293810][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11751.293816][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11751.293818][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11751.293823][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11751.293828][ C2] ip_local_deliver_finish+0x2ae/0x480 [11751.293832][ C2] ip_local_deliver+0x19d/0x480 [11751.293834][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11751.293836][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11751.293839][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11751.293844][ C2] ? rcu_read_lock_held+0xe/0x50 [11751.293848][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11751.293851][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11751.293860][ C2] ip_rcv+0x564/0x740 [11751.293863][ C2] ? __pfx_ip_rcv+0x10/0x10 [11751.293865][ C2] ? set_track_prepare+0x8a/0xd0 [11751.293870][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11751.293873][ C2] ? start_secondary+0x21c/0x2b0 [11751.293877][ C2] ? skb_clone+0x10b/0x330 [11751.293880][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11751.293886][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11751.293891][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11751.293895][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11751.293903][ C2] ? __tcf_classify+0x329/0x7d0 [11751.293907][ C2] ? __pfx_ip_rcv+0x10/0x10 [11751.293909][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11751.293913][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11751.293917][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11751.293921][ C2] ? lock_acquire+0x1c1/0x220 [11751.293924][ C2] ? netif_receive_skb_internal+0x84/0x300 [11751.293928][ C2] netif_receive_skb_internal+0xb0/0x300 [11751.293931][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11751.293935][ C2] ? __copy_skb_header+0xaf/0x490 [11751.293940][ C2] ? __skb_clone+0x57a/0x760 [11751.293943][ C2] netif_receive_skb+0x55/0x280 [11751.293946][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11751.293953][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11751.293960][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11751.293967][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11751.293971][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11751.293982][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11751.293989][ C2] ? get_stack_info+0x36/0xc0 [11751.293993][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11751.293997][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11751.294001][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11751.294003][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11751.294007][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11751.294010][ C2] ? kernel_text_address+0x17/0xe0 [11751.294013][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11751.294017][ C2] ? arch_stack_walk+0x8c/0x100 [11751.294021][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11751.294024][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11751.294027][ C2] ? lock_acquire+0x1c1/0x220 [11751.294029][ C2] ? stack_depot_save_flags+0x281/0x550 [11751.294033][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11751.294038][ C2] ? get_stack_info_noinstr+0x18/0x110 [11751.294041][ C2] ? get_stack_info+0x36/0xc0 [11751.294045][ C2] __tcf_classify+0x329/0x7d0 [11751.294050][ C2] tcf_classify+0x283/0x930 [11751.294054][ C2] ? __pfx_tcf_classify+0x10/0x10 [11751.294057][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11751.294061][ C2] tc_run+0x2e4/0x5d0 [11751.294065][ C2] ? __pfx_tc_run+0x10/0x10 [11751.294068][ C2] ? lock_acquire+0x1c1/0x220 [11751.294078][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11751.294082][ C2] __dev_queue_xmit+0x686/0x17e0 [11751.294086][ C2] ? lock_acquire+0x1c1/0x220 [11751.294089][ C2] ? ip_finish_output2+0x786/0x18e0 [11751.294092][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11751.294095][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11751.294098][ C2] ? neigh_hh_output+0x348/0x590 [11751.294102][ C2] ? ip_finish_output2+0x262/0x18e0 [11751.294106][ C2] ip_finish_output2+0x786/0x18e0 [11751.294109][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11751.294117][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11751.294119][ C2] ? rcu_read_lock_held+0xe/0x50 [11751.294123][ C2] ? __ip_finish_output+0x10f/0x770 [11751.294127][ C2] ip_output+0x16b/0x4f0 [11751.294130][ C2] ? __pfx_ip_output+0x10/0x10 [11751.294133][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11751.294136][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11751.294139][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11751.294142][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11751.294144][ C2] ? __alloc_skb+0xd4/0x280 [11751.294147][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11751.294151][ C2] ? tcp_fragment+0x168/0x1040 [11751.294154][ C2] ? rcu_read_lock_held+0xe/0x50 [11751.294157][ C2] ? ip_local_out+0x114/0x3b0 [11751.294161][ C2] __ip_queue_xmit+0x672/0x1910 [11751.294164][ C2] ? __skb_clone+0x57a/0x760 [11751.294167][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11751.294172][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11751.294175][ C2] ? ipv4_dst_check+0xe3/0x170 [11751.294179][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11751.294184][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11751.294188][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11751.294191][ C2] ? tcp_fragment+0xb0e/0x1040 [11751.294195][ C2] tcp_send_loss_probe+0x348/0x830 [11751.294198][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11751.294201][ C2] tcp_write_timer+0x82/0x1d0 [11751.294204][ C2] call_timer_fn+0x173/0x430 [11751.294208][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11751.294213][ C2] ? next_expiry_recalc+0xcd/0x220 [11751.294217][ C2] __run_timers.part.0+0x52d/0x890 [11751.294220][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11751.294225][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11751.294228][ C2] ? lock_acquire+0x1c1/0x220 [11751.294230][ C2] ? clockevents_program_event+0xf6/0x300 [11751.294234][ C2] ? lock_release+0x1d5/0x250 [11751.294237][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11751.294240][ C2] ? ktime_get+0xb3/0x190 [11751.294244][ C2] ? clockevents_program_event+0x1ea/0x300 [11751.294248][ C2] run_timer_softirq+0x72/0x100 [11751.294251][ C2] __do_softirq+0x1b9/0x7ff [11751.294256][ C2] irq_exit_rcu+0x98/0xc0 [11751.294258][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11751.294262][ C2] [11751.294263][ C2] [11751.294264][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11751.294267][ C2] RIP: 0010:default_idle+0xf/0x20 [11751.294271][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11751.294274][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11751.294276][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11751.294278][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11751.294279][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11751.294281][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11751.294282][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11751.294286][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11751.294289][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11751.294293][ C2] default_idle_call+0x69/0xa0 [11751.294296][ C2] cpuidle_idle_call+0x1f6/0x280 [11751.294299][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11751.294303][ C2] ? lock_release+0x1d5/0x250 [11751.294305][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11751.294309][ C2] do_idle+0xfb/0x160 [11751.294312][ C2] cpu_startup_entry+0x55/0x60 [11751.294314][ C2] start_secondary+0x21c/0x2b0 [11751.294318][ C2] ? __pfx_start_secondary+0x10/0x10 [11751.294322][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11751.294328][ C2] [11776.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8776s! [perl:4135] [11776.569715][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11776.570978][ C1] irq event stamp: 209232 [11776.571197][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11776.571730][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11776.572213][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11776.572684][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11776.573153][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11776.573604][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11776.574230][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11776.574557][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11776.575530][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11776.575846][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11776.576247][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11776.576647][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11776.577051][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11776.577455][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11776.577855][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11776.578305][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11776.578639][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11776.579048][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11776.579449][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11776.579848][ C1] PKRU: 55555554 [11776.580031][ C1] Call Trace: [11776.580206][ C1] [11776.580355][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11776.580619][ C1] ? __run_hrtimer+0x1c0/0x710 [11776.580865][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11776.581143][ C1] ? __hrtimer_run_queues+0x197/0x270 [11776.581417][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11776.581708][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11776.581974][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11776.582284][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11776.582547][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11776.582858][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11776.583154][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11776.583478][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11776.583770][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11776.584073][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11776.584363][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11776.584676][ C1] ? get_stack_info+0x36/0xc0 [11776.584919][ C1] ? lock_acquire+0x1c1/0x220 [11776.585161][ C1] ? lock_release+0x1d5/0x250 [11776.585402][ C1] do_raw_spin_lock+0x1ec/0x270 [11776.585653][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11776.585925][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11776.586214][ C1] ? lock_acquire+0x1c1/0x220 [11776.586451][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11776.586696][ C1] _raw_spin_lock_nested+0x65/0x80 [11776.586958][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11776.587196][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11776.587445][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11776.587705][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11776.587982][ C1] ip_local_deliver_finish+0x2ae/0x480 [11776.588264][ C1] ip_local_deliver+0x19d/0x480 [11776.588513][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11776.588786][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11776.589052][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11776.589405][ C1] ? rcu_read_lock_held+0xe/0x50 [11776.589661][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11776.589984][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11776.590250][ C1] ip_rcv+0x564/0x740 [11776.590455][ C1] ? __pfx_ip_rcv+0x10/0x10 [11776.590688][ C1] ? set_track_prepare+0x8a/0xd0 [11776.590943][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11776.591221][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11776.591496][ C1] ? skb_clone+0x10b/0x330 [11776.591727][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11776.592049][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11776.592354][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11776.592642][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11776.592936][ C1] ? __tcf_classify+0x329/0x7d0 [11776.593186][ C1] ? __pfx_ip_rcv+0x10/0x10 [11776.593419][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11776.593720][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11776.594014][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11776.594342][ C1] ? lock_acquire+0x1c1/0x220 [11776.594584][ C1] ? netif_receive_skb_internal+0x84/0x300 [11776.594885][ C1] netif_receive_skb_internal+0xb0/0x300 [11776.595175][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11776.595495][ C1] ? __copy_skb_header+0xaf/0x490 [11776.595755][ C1] ? __skb_clone+0x57a/0x760 [11776.595989][ C1] netif_receive_skb+0x55/0x280 [11776.596240][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11776.596556][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11776.596890][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11776.597192][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11776.597466][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11776.597756][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11776.598069][ C1] ? hlock_class+0x4e/0x130 [11776.598305][ C1] ? get_stack_info_noinstr+0x18/0x110 [11776.598581][ C1] ? get_stack_info_noinstr+0x18/0x110 [11776.598859][ C1] ? __pfx_validate_chain+0x10/0x10 [11776.599124][ C1] ? hlock_class+0x4e/0x130 [11776.599355][ C1] ? mark_lock+0x38/0x3e0 [11776.599578][ C1] ? stack_access_ok+0xda/0x1f0 [11776.599830][ C1] ? __lock_acquire+0xb67/0x1610 [11776.600097][ C1] ? get_stack_info_noinstr+0x18/0x110 [11776.600378][ C1] ? get_stack_info+0x36/0xc0 [11776.600621][ C1] ? stack_access_ok+0xda/0x1f0 [11776.600869][ C1] ? get_reg+0x119/0x190 [11776.601089][ C1] ? unwind_next_frame+0x12af/0x1d10 [11776.601360][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11776.601672][ C1] __tcf_classify+0x329/0x7d0 [11776.601917][ C1] tcf_classify+0x283/0x930 [11776.602151][ C1] ? arch_stack_walk+0xa2/0x100 [11776.602402][ C1] ? __pfx_tcf_classify+0x10/0x10 [11776.602661][ C1] ? get_stack_info+0x36/0xc0 [11776.602904][ C1] tc_run+0x2e4/0x5d0 [11776.603113][ C1] ? __pfx_tc_run+0x10/0x10 [11776.603347][ C1] ? lock_acquire+0x1c1/0x220 [11776.603585][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11776.603850][ C1] __dev_queue_xmit+0x686/0x17e0 [11776.604113][ C1] ? lock_acquire+0x1c1/0x220 [11776.604355][ C1] ? ip_finish_output2+0x786/0x18e0 [11776.604621][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11776.604931][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11776.605206][ C1] ? neigh_hh_output+0x348/0x590 [11776.605460][ C1] ? ip_finish_output2+0x262/0x18e0 [11776.605726][ C1] ip_finish_output2+0x786/0x18e0 [11776.605984][ C1] ? stack_depot_save_flags+0x45/0x550 [11776.606269][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11776.606610][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11776.606888][ C1] ? rcu_read_lock_held+0xe/0x50 [11776.607144][ C1] ? __ip_finish_output+0x10f/0x770 [11776.607410][ C1] ip_output+0x16b/0x4f0 [11776.607629][ C1] ? run_timer_softirq+0x72/0x100 [11776.607889][ C1] ? __pfx_ip_output+0x10/0x10 [11776.608133][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11776.608424][ C1] ? rcu_read_lock_held+0xe/0x50 [11776.608679][ C1] ? ip_local_out+0x114/0x3b0 [11776.608920][ C1] __ip_queue_xmit+0x672/0x1910 [11776.609169][ C1] ? __create_object+0x5e/0xb0 [11776.609417][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11776.609685][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11776.609971][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11776.610247][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11776.610530][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11776.610806][ C1] tcp_delack_timer+0x84/0x240 [11776.611050][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11776.611328][ C1] call_timer_fn+0x173/0x430 [11776.611564][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11776.611828][ C1] ? next_expiry_recalc+0xcd/0x220 [11776.612093][ C1] __run_timers.part.0+0x52d/0x890 [11776.612356][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11776.612632][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11776.612918][ C1] ? lock_acquire+0x1c1/0x220 [11776.613160][ C1] ? clockevents_program_event+0xf6/0x300 [11776.613454][ C1] ? lock_release+0x1d5/0x250 [11776.613696][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11776.613965][ C1] ? ktime_get+0xb3/0x190 [11776.614191][ C1] ? clockevents_program_event+0x1ea/0x300 [11776.614488][ C1] run_timer_softirq+0x72/0x100 [11776.614738][ C1] __do_softirq+0x1b9/0x7ff [11776.614974][ C1] irq_exit_rcu+0x98/0xc0 [11776.615196][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11776.615486][ C1] [11776.615636][ C1] [11776.615788][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11776.616095][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11776.616424][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11776.617407][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11776.617718][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11776.618120][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11776.618525][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11776.618926][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11776.619328][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11776.619733][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11776.620030][ C1] pipe_read+0xa16/0xdf0 [11776.620254][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11776.620537][ C1] ? __pfx_pipe_read+0x10/0x10 [11776.620783][ C1] ? iterate_tty_write+0x299/0x540 [11776.621047][ C1] ? lock_release+0x1d5/0x250 [11776.621288][ C1] vfs_read+0x911/0xc00 [11776.621507][ C1] ? lock_acquire+0x1c1/0x220 [11776.621752][ C1] ? __might_fault+0xc6/0x180 [11776.621994][ C1] ? __pfx_vfs_read+0x10/0x10 [11776.622238][ C1] ? __might_fault+0xc6/0x180 [11776.622480][ C1] ? lock_release+0x1d5/0x250 [11776.622723][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11776.622990][ C1] ? __fget_light+0x54/0x1e0 [11776.623228][ C1] ksys_read+0x17a/0x1e0 [11776.623449][ C1] ? __pfx_ksys_read+0x10/0x10 [11776.623694][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11776.624009][ C1] do_syscall_64+0xc9/0x1e0 [11776.624247][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11776.624549][ C1] RIP: 0033:0x7f08a1ea38b2 [11776.624777][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11776.625756][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11776.626182][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11776.626583][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11776.626983][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11776.627386][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11776.627786][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11776.628191][ C1] [11776.628351][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8776s! [swapper/2:0] [11776.628783][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11776.630041][ C2] irq event stamp: 44114564 [11776.630275][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11776.630812][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11776.631325][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11776.631802][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11776.632274][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11776.632731][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11776.633346][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11776.633673][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11776.634660][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11776.634969][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11776.635374][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11776.635774][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11776.636175][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11776.636577][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11776.636979][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11776.637428][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11776.637761][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11776.638163][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11776.638565][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11776.638965][ C2] PKRU: 55555554 [11776.639149][ C2] Call Trace: [11776.639317][ C2] [11776.639468][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11776.639732][ C2] ? __run_hrtimer+0x1c0/0x710 [11776.639975][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11776.640252][ C2] ? __hrtimer_run_queues+0x197/0x270 [11776.640525][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11776.640815][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11776.641080][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11776.641386][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11776.641648][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11776.641913][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11776.642223][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11776.642519][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11776.642835][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11776.643125][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11776.643423][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11776.643713][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11776.644030][ C2] ? get_stack_info+0x36/0xc0 [11776.644274][ C2] ? lock_acquire+0x1c1/0x220 [11776.644516][ C2] ? lock_release+0x1d5/0x250 [11776.644757][ C2] do_raw_spin_lock+0x1ec/0x270 [11776.645006][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11776.645281][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11776.645566][ C2] ? lock_acquire+0x1c1/0x220 [11776.645807][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11776.646050][ C2] _raw_spin_lock_nested+0x65/0x80 [11776.646313][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11776.646547][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11776.646796][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11776.647055][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11776.647332][ C2] ip_local_deliver_finish+0x2ae/0x480 [11776.647611][ C2] ip_local_deliver+0x19d/0x480 [11776.647860][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11776.648131][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11776.648394][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11776.648743][ C2] ? rcu_read_lock_held+0xe/0x50 [11776.648994][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11776.649316][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11776.649580][ C2] ip_rcv+0x564/0x740 [11776.649786][ C2] ? __pfx_ip_rcv+0x10/0x10 [11776.650017][ C2] ? set_track_prepare+0x8a/0xd0 [11776.650272][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11776.650549][ C2] ? start_secondary+0x21c/0x2b0 [11776.650799][ C2] ? skb_clone+0x10b/0x330 [11776.651029][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11776.651348][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11776.651654][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11776.651935][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11776.652228][ C2] ? __tcf_classify+0x329/0x7d0 [11776.652475][ C2] ? __pfx_ip_rcv+0x10/0x10 [11776.652708][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11776.653008][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11776.653294][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11776.653619][ C2] ? lock_acquire+0x1c1/0x220 [11776.653858][ C2] ? netif_receive_skb_internal+0x84/0x300 [11776.654160][ C2] netif_receive_skb_internal+0xb0/0x300 [11776.654444][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11776.654761][ C2] ? __copy_skb_header+0xaf/0x490 [11776.655018][ C2] ? __skb_clone+0x57a/0x760 [11776.655256][ C2] netif_receive_skb+0x55/0x280 [11776.655503][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11776.655816][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11776.656151][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11776.656451][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11776.656725][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11776.657015][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11776.657328][ C2] ? get_stack_info+0x36/0xc0 [11776.657568][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11776.657833][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11776.658152][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11776.658430][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11776.658706][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11776.659022][ C2] ? kernel_text_address+0x17/0xe0 [11776.659283][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11776.659600][ C2] ? arch_stack_walk+0x8c/0x100 [11776.659850][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11776.660115][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11776.660399][ C2] ? lock_acquire+0x1c1/0x220 [11776.660639][ C2] ? stack_depot_save_flags+0x281/0x550 [11776.660920][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11776.661227][ C2] ? get_stack_info_noinstr+0x18/0x110 [11776.661504][ C2] ? get_stack_info+0x36/0xc0 [11776.661746][ C2] __tcf_classify+0x329/0x7d0 [11776.661989][ C2] tcf_classify+0x283/0x930 [11776.662226][ C2] ? __pfx_tcf_classify+0x10/0x10 [11776.662482][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11776.662794][ C2] tc_run+0x2e4/0x5d0 [11776.663001][ C2] ? __pfx_tc_run+0x10/0x10 [11776.663232][ C2] ? lock_acquire+0x1c1/0x220 [11776.663472][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11776.663733][ C2] __dev_queue_xmit+0x686/0x17e0 [11776.663993][ C2] ? lock_acquire+0x1c1/0x220 [11776.664234][ C2] ? ip_finish_output2+0x786/0x18e0 [11776.664498][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11776.664804][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11776.665075][ C2] ? neigh_hh_output+0x348/0x590 [11776.665329][ C2] ? ip_finish_output2+0x262/0x18e0 [11776.665594][ C2] ip_finish_output2+0x786/0x18e0 [11776.665851][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11776.666189][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11776.666464][ C2] ? rcu_read_lock_held+0xe/0x50 [11776.666717][ C2] ? __ip_finish_output+0x10f/0x770 [11776.666984][ C2] ip_output+0x16b/0x4f0 [11776.667202][ C2] ? __pfx_ip_output+0x10/0x10 [11776.667447][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11776.667725][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11776.668041][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11776.668319][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11776.668571][ C2] ? __alloc_skb+0xd4/0x280 [11776.668803][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11776.669074][ C2] ? tcp_fragment+0x168/0x1040 [11776.669320][ C2] ? rcu_read_lock_held+0xe/0x50 [11776.669574][ C2] ? ip_local_out+0x114/0x3b0 [11776.669813][ C2] __ip_queue_xmit+0x672/0x1910 [11776.670061][ C2] ? __skb_clone+0x57a/0x760 [11776.670298][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11776.670564][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11776.670845][ C2] ? ipv4_dst_check+0xe3/0x170 [11776.671089][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11776.671340][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11776.671642][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11776.671961][ C2] ? tcp_fragment+0xb0e/0x1040 [11776.672206][ C2] tcp_send_loss_probe+0x348/0x830 [11776.672466][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11776.672734][ C2] tcp_write_timer+0x82/0x1d0 [11776.672974][ C2] call_timer_fn+0x173/0x430 [11776.673211][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11776.673473][ C2] ? next_expiry_recalc+0xcd/0x220 [11776.673739][ C2] __run_timers.part.0+0x52d/0x890 [11776.674009][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11776.674281][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11776.674563][ C2] ? lock_acquire+0x1c1/0x220 [11776.674803][ C2] ? clockevents_program_event+0xf6/0x300 [11776.675094][ C2] ? lock_release+0x1d5/0x250 [11776.675333][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11776.675597][ C2] ? ktime_get+0xb3/0x190 [11776.675820][ C2] ? clockevents_program_event+0x1ea/0x300 [11776.676115][ C2] run_timer_softirq+0x72/0x100 [11776.676364][ C2] __do_softirq+0x1b9/0x7ff [11776.676599][ C2] irq_exit_rcu+0x98/0xc0 [11776.676818][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11776.677111][ C2] [11776.677261][ C2] [11776.677411][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11776.677715][ C2] RIP: 0010:default_idle+0xf/0x20 [11776.677973][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11776.678944][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11776.679254][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11776.679653][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11776.680054][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11776.680453][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11776.680851][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11776.681251][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11776.681541][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11776.681802][ C2] default_idle_call+0x69/0xa0 [11776.682046][ C2] cpuidle_idle_call+0x1f6/0x280 [11776.682299][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11776.682576][ C2] ? lock_release+0x1d5/0x250 [11776.682816][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11776.683090][ C2] do_idle+0xfb/0x160 [11776.683293][ C2] cpu_startup_entry+0x55/0x60 [11776.683535][ C2] start_secondary+0x21c/0x2b0 [11776.683780][ C2] ? __pfx_start_secondary+0x10/0x10 [11776.684054][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11776.684366][ C2] [11804.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8802s! [swapper/2:0] [11804.569711][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11804.570968][ C2] irq event stamp: 44114564 [11804.571196][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11804.571735][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11804.572247][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11804.572724][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11804.573195][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11804.573653][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11804.574273][ C2] RIP: 0010:__kasan_check_read+0x8/0x20 [11804.574556][ C2] Code: 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 8b 0c 24 <89> f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f [11804.575529][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [11804.575835][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11804.576238][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11804.576637][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11804.577034][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11804.577433][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11804.577834][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11804.578282][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11804.578620][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11804.579019][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11804.579417][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11804.579819][ C2] PKRU: 55555554 [11804.580000][ C2] Call Trace: [11804.580171][ C2] [11804.580321][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11804.580583][ C2] ? __run_hrtimer+0x1c0/0x710 [11804.580824][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11804.581103][ C2] ? __hrtimer_run_queues+0x197/0x270 [11804.581377][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11804.581664][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11804.581931][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11804.582236][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11804.582496][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11804.582761][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11804.583069][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11804.583367][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11804.583683][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11804.583985][ C2] ? __kasan_check_read+0x8/0x20 [11804.584238][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [11804.584520][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11804.584831][ C2] ? get_stack_info+0x36/0xc0 [11804.585073][ C2] ? lock_acquire+0x1c1/0x220 [11804.585318][ C2] ? lock_release+0x1d5/0x250 [11804.585558][ C2] do_raw_spin_lock+0x1ec/0x270 [11804.585807][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11804.586079][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11804.586363][ C2] ? lock_acquire+0x1c1/0x220 [11804.586603][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11804.586849][ C2] _raw_spin_lock_nested+0x65/0x80 [11804.587107][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11804.587342][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11804.587589][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11804.587850][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11804.588127][ C2] ip_local_deliver_finish+0x2ae/0x480 [11804.588404][ C2] ip_local_deliver+0x19d/0x480 [11804.588651][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11804.588922][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11804.589185][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11804.589532][ C2] ? rcu_read_lock_held+0xe/0x50 [11804.589786][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11804.590106][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11804.590369][ C2] ip_rcv+0x564/0x740 [11804.590574][ C2] ? __pfx_ip_rcv+0x10/0x10 [11804.590803][ C2] ? set_track_prepare+0x8a/0xd0 [11804.591056][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11804.591333][ C2] ? start_secondary+0x21c/0x2b0 [11804.591584][ C2] ? skb_clone+0x10b/0x330 [11804.591811][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11804.592130][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11804.592437][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11804.592717][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11804.593016][ C2] ? __tcf_classify+0x329/0x7d0 [11804.593264][ C2] ? __pfx_ip_rcv+0x10/0x10 [11804.593494][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11804.593801][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11804.594084][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11804.594408][ C2] ? lock_acquire+0x1c1/0x220 [11804.594648][ C2] ? netif_receive_skb_internal+0x84/0x300 [11804.594943][ C2] netif_receive_skb_internal+0xb0/0x300 [11804.595227][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11804.595542][ C2] ? __copy_skb_header+0xaf/0x490 [11804.595803][ C2] ? __skb_clone+0x57a/0x760 [11804.596037][ C2] netif_receive_skb+0x55/0x280 [11804.596285][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11804.596596][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11804.596928][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11804.597225][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11804.597498][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11804.597787][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11804.598099][ C2] ? get_stack_info+0x36/0xc0 [11804.598338][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11804.598605][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11804.598923][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11804.599201][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11804.599476][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11804.599790][ C2] ? kernel_text_address+0x17/0xe0 [11804.600050][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11804.600364][ C2] ? arch_stack_walk+0x8c/0x100 [11804.600613][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11804.600876][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11804.601160][ C2] ? lock_acquire+0x1c1/0x220 [11804.601399][ C2] ? stack_depot_save_flags+0x281/0x550 [11804.601681][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11804.601986][ C2] ? get_stack_info_noinstr+0x18/0x110 [11804.602264][ C2] ? get_stack_info+0x36/0xc0 [11804.602503][ C2] __tcf_classify+0x329/0x7d0 [11804.602747][ C2] tcf_classify+0x283/0x930 [11804.602980][ C2] ? __pfx_tcf_classify+0x10/0x10 [11804.603237][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11804.603549][ C2] tc_run+0x2e4/0x5d0 [11804.603754][ C2] ? __pfx_tc_run+0x10/0x10 [11804.603991][ C2] ? lock_acquire+0x1c1/0x220 [11804.604232][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11804.604491][ C2] __dev_queue_xmit+0x686/0x17e0 [11804.604744][ C2] ? lock_acquire+0x1c1/0x220 [11804.604982][ C2] ? ip_finish_output2+0x786/0x18e0 [11804.605247][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11804.605549][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11804.605820][ C2] ? neigh_hh_output+0x348/0x590 [11804.606070][ C2] ? ip_finish_output2+0x262/0x18e0 [11804.606334][ C2] ip_finish_output2+0x786/0x18e0 [11804.606590][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11804.606926][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11804.607203][ C2] ? rcu_read_lock_held+0xe/0x50 [11804.607455][ C2] ? __ip_finish_output+0x10f/0x770 [11804.607725][ C2] ip_output+0x16b/0x4f0 [11804.607941][ C2] ? __pfx_ip_output+0x10/0x10 [11804.608185][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11804.608460][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11804.608772][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11804.609047][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11804.609299][ C2] ? __alloc_skb+0xd4/0x280 [11804.609530][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11804.609800][ C2] ? tcp_fragment+0x168/0x1040 [11804.610044][ C2] ? rcu_read_lock_held+0xe/0x50 [11804.610297][ C2] ? ip_local_out+0x114/0x3b0 [11804.610537][ C2] __ip_queue_xmit+0x672/0x1910 [11804.610783][ C2] ? __skb_clone+0x57a/0x760 [11804.611018][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11804.611284][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11804.611567][ C2] ? ipv4_dst_check+0xe3/0x170 [11804.611810][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11804.612059][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11804.612362][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11804.612681][ C2] ? tcp_fragment+0xb0e/0x1040 [11804.612926][ C2] tcp_send_loss_probe+0x348/0x830 [11804.613186][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11804.613454][ C2] tcp_write_timer+0x82/0x1d0 [11804.613694][ C2] call_timer_fn+0x173/0x430 [11804.613935][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11804.614198][ C2] ? next_expiry_recalc+0xcd/0x220 [11804.614464][ C2] __run_timers.part.0+0x52d/0x890 [11804.614725][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11804.614993][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11804.615276][ C2] ? lock_acquire+0x1c1/0x220 [11804.615515][ C2] ? clockevents_program_event+0xf6/0x300 [11804.615807][ C2] ? lock_release+0x1d5/0x250 [11804.616043][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11804.616309][ C2] ? ktime_get+0xb3/0x190 [11804.616531][ C2] ? clockevents_program_event+0x1ea/0x300 [11804.616826][ C2] run_timer_softirq+0x72/0x100 [11804.617072][ C2] __do_softirq+0x1b9/0x7ff [11804.617308][ C2] irq_exit_rcu+0x98/0xc0 [11804.617528][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11804.617815][ C2] [11804.617963][ C2] [11804.618115][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11804.618417][ C2] RIP: 0010:default_idle+0xf/0x20 [11804.618673][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11804.619644][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11804.619951][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11804.620352][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11804.620751][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11804.621148][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11804.621545][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11804.621949][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11804.622237][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11804.622498][ C2] default_idle_call+0x69/0xa0 [11804.622742][ C2] cpuidle_idle_call+0x1f6/0x280 [11804.622993][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11804.623270][ C2] ? lock_release+0x1d5/0x250 [11804.623508][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11804.623780][ C2] do_idle+0xfb/0x160 [11804.623987][ C2] cpu_startup_entry+0x55/0x60 [11804.624232][ C2] start_secondary+0x21c/0x2b0 [11804.624476][ C2] ? __pfx_start_secondary+0x10/0x10 [11804.624744][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11804.625054][ C2] [11804.625213][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8802s! [perl:4135] [11804.625633][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11804.626910][ C1] irq event stamp: 209232 [11804.627139][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11804.627680][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11804.628168][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11804.628642][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11804.629117][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11804.629571][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11804.630193][ C1] RIP: 0010:kasan_check_range+0x84/0x1c0 [11804.630487][ C1] Code: 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 48 89 e8 49 8d 59 01 48 89 da 48 29 ea <48> 83 fa 10 0f 8e c0 00 00 00 41 89 eb 41 83 e3 07 75 7d 48 85 d2 [11804.631479][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000202 [11804.631798][ C1] RAX: ffffed10014741c3 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [11804.632206][ C1] RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11804.632613][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [11804.633026][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11804.633444][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11804.633864][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11804.634332][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11804.634672][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11804.635087][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11804.635499][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11804.635910][ C1] PKRU: 55555554 [11804.636094][ C1] Call Trace: [11804.636272][ C1] [11804.636423][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11804.636691][ C1] ? __run_hrtimer+0x1c0/0x710 [11804.636936][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11804.637223][ C1] ? __hrtimer_run_queues+0x197/0x270 [11804.637498][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11804.637797][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11804.638065][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11804.638388][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11804.638651][ C1] ? hrtimer_interrupt+0x31a/0x770 [11804.638915][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11804.639229][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11804.639527][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11804.639850][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11804.640144][ C1] ? kasan_check_range+0x84/0x1c0 [11804.640407][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [11804.640691][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11804.641005][ C1] ? get_stack_info+0x36/0xc0 [11804.641258][ C1] ? lock_acquire+0x1c1/0x220 [11804.641499][ C1] ? lock_release+0x1d5/0x250 [11804.641747][ C1] do_raw_spin_lock+0x1ec/0x270 [11804.641999][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11804.642285][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11804.642578][ C1] ? lock_acquire+0x1c1/0x220 [11804.642820][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11804.643065][ C1] _raw_spin_lock_nested+0x65/0x80 [11804.643332][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11804.643571][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11804.643842][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11804.644108][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11804.644392][ C1] ip_local_deliver_finish+0x2ae/0x480 [11804.644677][ C1] ip_local_deliver+0x19d/0x480 [11804.644938][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11804.645212][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11804.645492][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11804.645848][ C1] ? rcu_read_lock_held+0xe/0x50 [11804.646110][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11804.646439][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11804.646711][ C1] ip_rcv+0x564/0x740 [11804.646922][ C1] ? __pfx_ip_rcv+0x10/0x10 [11804.647162][ C1] ? set_track_prepare+0x8a/0xd0 [11804.647422][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11804.647706][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11804.647988][ C1] ? skb_clone+0x10b/0x330 [11804.648227][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11804.648548][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11804.648857][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11804.649142][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11804.649437][ C1] ? __tcf_classify+0x329/0x7d0 [11804.649695][ C1] ? __pfx_ip_rcv+0x10/0x10 [11804.649934][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11804.650237][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11804.650526][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11804.650858][ C1] ? lock_acquire+0x1c1/0x220 [11804.651105][ C1] ? netif_receive_skb_internal+0x84/0x300 [11804.651403][ C1] netif_receive_skb_internal+0xb0/0x300 [11804.651696][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11804.652017][ C1] ? __copy_skb_header+0xaf/0x490 [11804.652278][ C1] ? __skb_clone+0x57a/0x760 [11804.652513][ C1] netif_receive_skb+0x55/0x280 [11804.652766][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11804.653086][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11804.653419][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11804.653724][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11804.654018][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11804.654314][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11804.654632][ C1] ? hlock_class+0x4e/0x130 [11804.654868][ C1] ? get_stack_info_noinstr+0x18/0x110 [11804.655151][ C1] ? get_stack_info_noinstr+0x18/0x110 [11804.655434][ C1] ? __pfx_validate_chain+0x10/0x10 [11804.655705][ C1] ? hlock_class+0x4e/0x130 [11804.655940][ C1] ? mark_lock+0x38/0x3e0 [11804.656168][ C1] ? stack_access_ok+0xda/0x1f0 [11804.656424][ C1] ? __lock_acquire+0xb67/0x1610 [11804.656683][ C1] ? get_stack_info_noinstr+0x18/0x110 [11804.656968][ C1] ? get_stack_info+0x36/0xc0 [11804.657219][ C1] ? stack_access_ok+0xda/0x1f0 [11804.657473][ C1] ? get_reg+0x119/0x190 [11804.657701][ C1] ? unwind_next_frame+0x12af/0x1d10 [11804.657975][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11804.658292][ C1] __tcf_classify+0x329/0x7d0 [11804.658540][ C1] tcf_classify+0x283/0x930 [11804.658778][ C1] ? arch_stack_walk+0xa2/0x100 [11804.659033][ C1] ? __pfx_tcf_classify+0x10/0x10 [11804.659301][ C1] ? get_stack_info+0x36/0xc0 [11804.659551][ C1] tc_run+0x2e4/0x5d0 [11804.659764][ C1] ? __pfx_tc_run+0x10/0x10 [11804.660004][ C1] ? lock_acquire+0x1c1/0x220 [11804.660242][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11804.660507][ C1] __dev_queue_xmit+0x686/0x17e0 [11804.660761][ C1] ? lock_acquire+0x1c1/0x220 [11804.661009][ C1] ? ip_finish_output2+0x786/0x18e0 [11804.661277][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11804.661591][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11804.661864][ C1] ? neigh_hh_output+0x348/0x590 [11804.662120][ C1] ? ip_finish_output2+0x262/0x18e0 [11804.662387][ C1] ip_finish_output2+0x786/0x18e0 [11804.662653][ C1] ? stack_depot_save_flags+0x45/0x550 [11804.662937][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11804.663281][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11804.663562][ C1] ? rcu_read_lock_held+0xe/0x50 [11804.663825][ C1] ? __ip_finish_output+0x10f/0x770 [11804.664107][ C1] ip_output+0x16b/0x4f0 [11804.664326][ C1] ? run_timer_softirq+0x72/0x100 [11804.664586][ C1] ? __pfx_ip_output+0x10/0x10 [11804.664828][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11804.665131][ C1] ? rcu_read_lock_held+0xe/0x50 [11804.665393][ C1] ? ip_local_out+0x114/0x3b0 [11804.665633][ C1] __ip_queue_xmit+0x672/0x1910 [11804.665883][ C1] ? __create_object+0x5e/0xb0 [11804.666134][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11804.666410][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11804.666701][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11804.666979][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11804.667267][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11804.667548][ C1] tcp_delack_timer+0x84/0x240 [11804.667796][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11804.668082][ C1] call_timer_fn+0x173/0x430 [11804.668318][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11804.668594][ C1] ? next_expiry_recalc+0xcd/0x220 [11804.668864][ C1] __run_timers.part.0+0x52d/0x890 [11804.669135][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11804.669419][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11804.669709][ C1] ? lock_acquire+0x1c1/0x220 [11804.669954][ C1] ? clockevents_program_event+0xf6/0x300 [11804.670252][ C1] ? lock_release+0x1d5/0x250 [11804.670499][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11804.670773][ C1] ? ktime_get+0xb3/0x190 [11804.671004][ C1] ? clockevents_program_event+0x1ea/0x300 [11804.671303][ C1] run_timer_softirq+0x72/0x100 [11804.671554][ C1] __do_softirq+0x1b9/0x7ff [11804.671790][ C1] irq_exit_rcu+0x98/0xc0 [11804.672014][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11804.672306][ C1] [11804.672464][ C1] [11804.672616][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11804.672927][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11804.673257][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11804.674239][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11804.674552][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11804.674958][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11804.675359][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11804.675763][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11804.676163][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11804.676578][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11804.676885][ C1] pipe_read+0xa16/0xdf0 [11804.677108][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11804.677388][ C1] ? __pfx_pipe_read+0x10/0x10 [11804.677642][ C1] ? iterate_tty_write+0x299/0x540 [11804.677908][ C1] ? lock_release+0x1d5/0x250 [11804.678156][ C1] vfs_read+0x911/0xc00 [11804.678378][ C1] ? lock_acquire+0x1c1/0x220 [11804.678624][ C1] ? __might_fault+0xc6/0x180 [11804.678868][ C1] ? __pfx_vfs_read+0x10/0x10 [11804.679118][ C1] ? __might_fault+0xc6/0x180 [11804.679361][ C1] ? lock_release+0x1d5/0x250 [11804.679613][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11804.679891][ C1] ? __fget_light+0x54/0x1e0 [11804.680136][ C1] ksys_read+0x17a/0x1e0 [11804.680364][ C1] ? __pfx_ksys_read+0x10/0x10 [11804.680613][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11804.680930][ C1] do_syscall_64+0xc9/0x1e0 [11804.681172][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11804.681481][ C1] RIP: 0033:0x7f08a1ea38b2 [11804.681716][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11804.682696][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11804.683128][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11804.683532][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11804.683978][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11804.684389][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11804.684790][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11804.685195][ C1] [11829.293105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11829.293485][ C1] rcu: 1-....: (9161334 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2219653 [11829.294066][ C1] rcu: (t=9474406 jiffies g=1882453 q=730 ncpus=4) [11829.294403][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11829.294856][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11829.295477][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11829.295811][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11829.296789][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11829.297101][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11829.297504][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11829.297906][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11829.298309][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11829.298712][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11829.299115][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11829.299567][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11829.299903][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11829.300306][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11829.300710][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11829.301112][ C1] PKRU: 55555554 [11829.301296][ C1] Call Trace: [11829.301468][ C1] [11829.301620][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11829.301896][ C1] ? print_cpu_stall+0x263/0x6a0 [11829.302152][ C1] ? check_cpu_stall+0x284/0x500 [11829.302407][ C1] ? rcu_pending+0x92/0x360 [11829.302639][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11829.302911][ C1] ? update_process_times+0xb9/0x110 [11829.303185][ C1] ? tick_sched_handle+0x67/0x130 [11829.303445][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11829.303737][ C1] ? __run_hrtimer+0x1c0/0x710 [11829.303982][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11829.304297][ C1] ? __hrtimer_run_queues+0x197/0x270 [11829.304571][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11829.304863][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11829.305133][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11829.305442][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11829.305706][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11829.306019][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11829.306319][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11829.306636][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11829.306927][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11829.307225][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11829.307516][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11829.307828][ C1] ? get_stack_info+0x36/0xc0 [11829.308071][ C1] ? lock_acquire+0x1c1/0x220 [11829.308315][ C1] ? lock_release+0x1d5/0x250 [11829.308558][ C1] do_raw_spin_lock+0x1ec/0x270 [11829.308809][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11829.309082][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11829.309368][ C1] ? lock_acquire+0x1c1/0x220 [11829.309609][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11829.309853][ C1] _raw_spin_lock_nested+0x65/0x80 [11829.310116][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11829.310352][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11829.310600][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11829.310860][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11829.311142][ C1] ip_local_deliver_finish+0x2ae/0x480 [11829.311421][ C1] ip_local_deliver+0x19d/0x480 [11829.311672][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11829.311948][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11829.312213][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11829.312564][ C1] ? rcu_read_lock_held+0xe/0x50 [11829.312817][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11829.313139][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11829.313404][ C1] ip_rcv+0x564/0x740 [11829.313611][ C1] ? __pfx_ip_rcv+0x10/0x10 [11829.313851][ C1] ? set_track_prepare+0x8a/0xd0 [11829.314107][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11829.314386][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11829.314661][ C1] ? skb_clone+0x10b/0x330 [11829.314896][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11829.315219][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11829.315527][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11829.315811][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11829.316107][ C1] ? __tcf_classify+0x329/0x7d0 [11829.316360][ C1] ? __pfx_ip_rcv+0x10/0x10 [11829.316591][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11829.316891][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11829.317179][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11829.317506][ C1] ? lock_acquire+0x1c1/0x220 [11829.317745][ C1] ? netif_receive_skb_internal+0x84/0x300 [11829.318042][ C1] netif_receive_skb_internal+0xb0/0x300 [11829.318330][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11829.318648][ C1] ? __copy_skb_header+0xaf/0x490 [11829.318908][ C1] ? __skb_clone+0x57a/0x760 [11829.319145][ C1] netif_receive_skb+0x55/0x280 [11829.319393][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11829.319709][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11829.320043][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11829.320346][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11829.320622][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11829.320910][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11829.321225][ C1] ? hlock_class+0x4e/0x130 [11829.321461][ C1] ? get_stack_info_noinstr+0x18/0x110 [11829.321738][ C1] ? get_stack_info_noinstr+0x18/0x110 [11829.322014][ C1] ? __pfx_validate_chain+0x10/0x10 [11829.322279][ C1] ? hlock_class+0x4e/0x130 [11829.322513][ C1] ? mark_lock+0x38/0x3e0 [11829.322733][ C1] ? stack_access_ok+0xda/0x1f0 [11829.322984][ C1] ? __lock_acquire+0xb67/0x1610 [11829.323238][ C1] ? get_stack_info_noinstr+0x18/0x110 [11829.323517][ C1] ? get_stack_info+0x36/0xc0 [11829.323762][ C1] ? stack_access_ok+0xda/0x1f0 [11829.324011][ C1] ? get_reg+0x119/0x190 [11829.324229][ C1] ? unwind_next_frame+0x12af/0x1d10 [11829.324499][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11829.324809][ C1] __tcf_classify+0x329/0x7d0 [11829.325050][ C1] tcf_classify+0x283/0x930 [11829.325285][ C1] ? arch_stack_walk+0xa2/0x100 [11829.325536][ C1] ? __pfx_tcf_classify+0x10/0x10 [11829.325794][ C1] ? get_stack_info+0x36/0xc0 [11829.326036][ C1] tc_run+0x2e4/0x5d0 [11829.326244][ C1] ? __pfx_tc_run+0x10/0x10 [11829.326474][ C1] ? lock_acquire+0x1c1/0x220 [11829.326716][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11829.326977][ C1] __dev_queue_xmit+0x686/0x17e0 [11829.327232][ C1] ? lock_acquire+0x1c1/0x220 [11829.327472][ C1] ? ip_finish_output2+0x786/0x18e0 [11829.327739][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11829.328048][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11829.328322][ C1] ? neigh_hh_output+0x348/0x590 [11829.328578][ C1] ? ip_finish_output2+0x262/0x18e0 [11829.328844][ C1] ip_finish_output2+0x786/0x18e0 [11829.329101][ C1] ? stack_depot_save_flags+0x45/0x550 [11829.329381][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11829.329722][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11829.329999][ C1] ? rcu_read_lock_held+0xe/0x50 [11829.330254][ C1] ? __ip_finish_output+0x10f/0x770 [11829.330520][ C1] ip_output+0x16b/0x4f0 [11829.330736][ C1] ? run_timer_softirq+0x72/0x100 [11829.330993][ C1] ? __pfx_ip_output+0x10/0x10 [11829.331243][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11829.331531][ C1] ? rcu_read_lock_held+0xe/0x50 [11829.331783][ C1] ? ip_local_out+0x114/0x3b0 [11829.332025][ C1] __ip_queue_xmit+0x672/0x1910 [11829.332275][ C1] ? __create_object+0x5e/0xb0 [11829.332520][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11829.332789][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11829.333073][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11829.333350][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11829.333633][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11829.333911][ C1] tcp_delack_timer+0x84/0x240 [11829.334157][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11829.334429][ C1] call_timer_fn+0x173/0x430 [11829.334668][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11829.334931][ C1] ? next_expiry_recalc+0xcd/0x220 [11829.335198][ C1] __run_timers.part.0+0x52d/0x890 [11829.335459][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11829.335735][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11829.336022][ C1] ? lock_acquire+0x1c1/0x220 [11829.336264][ C1] ? clockevents_program_event+0xf6/0x300 [11829.336556][ C1] ? lock_release+0x1d5/0x250 [11829.336802][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11829.337068][ C1] ? ktime_get+0xb3/0x190 [11829.337291][ C1] ? clockevents_program_event+0x1ea/0x300 [11829.337588][ C1] run_timer_softirq+0x72/0x100 [11829.337838][ C1] __do_softirq+0x1b9/0x7ff [11829.338073][ C1] irq_exit_rcu+0x98/0xc0 [11829.338295][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11829.338583][ C1] [11829.338734][ C1] [11829.338885][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11829.339193][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11829.339519][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11829.340497][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11829.340807][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11829.341208][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11829.341611][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11829.342014][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11829.342416][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11829.342818][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11829.343122][ C1] pipe_read+0xa16/0xdf0 [11829.343343][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11829.343624][ C1] ? __pfx_pipe_read+0x10/0x10 [11829.343873][ C1] ? iterate_tty_write+0x299/0x540 [11829.344138][ C1] ? lock_release+0x1d5/0x250 [11829.344379][ C1] vfs_read+0x911/0xc00 [11829.344596][ C1] ? lock_acquire+0x1c1/0x220 [11829.344836][ C1] ? __might_fault+0xc6/0x180 [11829.345078][ C1] ? __pfx_vfs_read+0x10/0x10 [11829.345320][ C1] ? __might_fault+0xc6/0x180 [11829.345561][ C1] ? lock_release+0x1d5/0x250 [11829.345800][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11829.346065][ C1] ? __fget_light+0x54/0x1e0 [11829.346306][ C1] ksys_read+0x17a/0x1e0 [11829.346525][ C1] ? __pfx_ksys_read+0x10/0x10 [11829.346770][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11829.347077][ C1] do_syscall_64+0xc9/0x1e0 [11829.347313][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11829.347613][ C1] RIP: 0033:0x7f08a1ea38b2 [11829.347845][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11829.348821][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11829.349246][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11829.349648][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11829.350048][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11829.350447][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11829.350849][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11829.351254][ C1] [11829.351410][ C1] Sending NMI from CPU 1 to CPUs 2: [11829.351689][ C2] NMI backtrace for cpu 2 [11829.351696][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11829.351703][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11829.351708][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11829.351718][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11829.351724][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11829.351729][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11829.351733][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11829.351738][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11829.351742][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11829.351746][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11829.351750][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11829.351755][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11829.351761][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11829.351764][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11829.351768][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11829.351771][ C2] PKRU: 55555554 [11829.351773][ C2] Call Trace: [11829.351777][ C2] [11829.351782][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11829.351795][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11829.351805][ C2] ? nmi_handle+0x153/0x420 [11829.351816][ C2] ? default_do_nmi+0x41/0x100 [11829.351822][ C2] ? exc_nmi+0xf3/0x120 [11829.351828][ C2] ? end_repeat_nmi+0xf/0x60 [11829.351840][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11829.351848][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11829.351856][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11829.351865][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11829.351873][ C2] [11829.351875][ C2] [11829.351878][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11829.351885][ C2] ? get_stack_info+0x36/0xc0 [11829.351894][ C2] ? lock_acquire+0x1c1/0x220 [11829.351902][ C2] ? lock_release+0x1d5/0x250 [11829.351911][ C2] do_raw_spin_lock+0x1ec/0x270 [11829.351920][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11829.351926][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11829.351935][ C2] ? lock_acquire+0x1c1/0x220 [11829.351941][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11829.351950][ C2] _raw_spin_lock_nested+0x65/0x80 [11829.351956][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11829.351974][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11829.351980][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11829.351992][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11829.352003][ C2] ip_local_deliver_finish+0x2ae/0x480 [11829.352011][ C2] ip_local_deliver+0x19d/0x480 [11829.352017][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11829.352022][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11829.352028][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11829.352040][ C2] ? rcu_read_lock_held+0xe/0x50 [11829.352047][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11829.352055][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11829.352076][ C2] ip_rcv+0x564/0x740 [11829.352082][ C2] ? __pfx_ip_rcv+0x10/0x10 [11829.352089][ C2] ? set_track_prepare+0x8a/0xd0 [11829.352098][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11829.352105][ C2] ? start_secondary+0x21c/0x2b0 [11829.352112][ C2] ? skb_clone+0x10b/0x330 [11829.352118][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11829.352133][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11829.352147][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11829.352154][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11829.352175][ C2] ? __tcf_classify+0x329/0x7d0 [11829.352184][ C2] ? __pfx_ip_rcv+0x10/0x10 [11829.352189][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11829.352197][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11829.352205][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11829.352216][ C2] ? lock_acquire+0x1c1/0x220 [11829.352222][ C2] ? netif_receive_skb_internal+0x84/0x300 [11829.352233][ C2] netif_receive_skb_internal+0xb0/0x300 [11829.352242][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11829.352252][ C2] ? __copy_skb_header+0xaf/0x490 [11829.352262][ C2] ? __skb_clone+0x57a/0x760 [11829.352268][ C2] netif_receive_skb+0x55/0x280 [11829.352276][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11829.352294][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11829.352312][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11829.352330][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11829.352342][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11829.352369][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11829.352388][ C2] ? get_stack_info+0x36/0xc0 [11829.352401][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11829.352407][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11829.352418][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11829.352422][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11829.352426][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11829.352429][ C2] ? kernel_text_address+0x17/0xe0 [11829.352434][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11829.352440][ C2] ? arch_stack_walk+0x8c/0x100 [11829.352443][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11829.352447][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11829.352450][ C2] ? lock_acquire+0x1c1/0x220 [11829.352453][ C2] ? stack_depot_save_flags+0x281/0x550 [11829.352457][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11829.352462][ C2] ? get_stack_info_noinstr+0x18/0x110 [11829.352465][ C2] ? get_stack_info+0x36/0xc0 [11829.352469][ C2] __tcf_classify+0x329/0x7d0 [11829.352475][ C2] tcf_classify+0x283/0x930 [11829.352480][ C2] ? __pfx_tcf_classify+0x10/0x10 [11829.352483][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11829.352487][ C2] tc_run+0x2e4/0x5d0 [11829.352491][ C2] ? __pfx_tc_run+0x10/0x10 [11829.352494][ C2] ? lock_acquire+0x1c1/0x220 [11829.352496][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11829.352500][ C2] __dev_queue_xmit+0x686/0x17e0 [11829.352505][ C2] ? lock_acquire+0x1c1/0x220 [11829.352507][ C2] ? ip_finish_output2+0x786/0x18e0 [11829.352510][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11829.352513][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11829.352516][ C2] ? neigh_hh_output+0x348/0x590 [11829.352519][ C2] ? ip_finish_output2+0x262/0x18e0 [11829.352523][ C2] ip_finish_output2+0x786/0x18e0 [11829.352527][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11829.352534][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11829.352537][ C2] ? rcu_read_lock_held+0xe/0x50 [11829.352541][ C2] ? __ip_finish_output+0x10f/0x770 [11829.352545][ C2] ip_output+0x16b/0x4f0 [11829.352548][ C2] ? __pfx_ip_output+0x10/0x10 [11829.352550][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11829.352553][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11829.352556][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11829.352560][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11829.352563][ C2] ? __alloc_skb+0xd4/0x280 [11829.352565][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11829.352571][ C2] ? tcp_fragment+0x168/0x1040 [11829.352574][ C2] ? rcu_read_lock_held+0xe/0x50 [11829.352577][ C2] ? ip_local_out+0x114/0x3b0 [11829.352580][ C2] __ip_queue_xmit+0x672/0x1910 [11829.352584][ C2] ? __skb_clone+0x57a/0x760 [11829.352587][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11829.352593][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11829.352596][ C2] ? ipv4_dst_check+0xe3/0x170 [11829.352600][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11829.352606][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11829.352611][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11829.352614][ C2] ? tcp_fragment+0xb0e/0x1040 [11829.352617][ C2] tcp_send_loss_probe+0x348/0x830 [11829.352621][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11829.352624][ C2] tcp_write_timer+0x82/0x1d0 [11829.352628][ C2] call_timer_fn+0x173/0x430 [11829.352632][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11829.352636][ C2] ? next_expiry_recalc+0xcd/0x220 [11829.352640][ C2] __run_timers.part.0+0x52d/0x890 [11829.352643][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11829.352647][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11829.352650][ C2] ? lock_acquire+0x1c1/0x220 [11829.352652][ C2] ? clockevents_program_event+0xf6/0x300 [11829.352656][ C2] ? lock_release+0x1d5/0x250 [11829.352659][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11829.352662][ C2] ? ktime_get+0xb3/0x190 [11829.352665][ C2] ? clockevents_program_event+0x1ea/0x300 [11829.352669][ C2] run_timer_softirq+0x72/0x100 [11829.352673][ C2] __do_softirq+0x1b9/0x7ff [11829.352677][ C2] irq_exit_rcu+0x98/0xc0 [11829.352679][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11829.352683][ C2] [11829.352684][ C2] [11829.352685][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11829.352688][ C2] RIP: 0010:default_idle+0xf/0x20 [11829.352692][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11829.352695][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11829.352697][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11829.352699][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11829.352701][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11829.352703][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11829.352704][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11829.352707][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11829.352710][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11829.352715][ C2] default_idle_call+0x69/0xa0 [11829.352719][ C2] cpuidle_idle_call+0x1f6/0x280 [11829.352721][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11829.352726][ C2] ? lock_release+0x1d5/0x250 [11829.352728][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11829.352732][ C2] do_idle+0xfb/0x160 [11829.352735][ C2] cpu_startup_entry+0x55/0x60 [11829.352738][ C2] start_secondary+0x21c/0x2b0 [11829.352741][ C2] ? __pfx_start_secondary+0x10/0x10 [11829.352745][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11829.352751][ C2] [11856.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8851s! [perl:4135] [11856.569728][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11856.571039][ C1] irq event stamp: 209232 [11856.571265][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11856.571818][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11856.572313][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11856.572796][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11856.573276][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11856.573744][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11856.574368][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11856.574704][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11856.575705][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11856.576025][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11856.576438][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11856.576852][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11856.577263][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11856.577676][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11856.578089][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11856.578550][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11856.578895][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11856.579310][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11856.579721][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11856.580133][ C1] PKRU: 55555554 [11856.580321][ C1] Call Trace: [11856.580501][ C1] [11856.580655][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11856.580928][ C1] ? __run_hrtimer+0x1c0/0x710 [11856.581182][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11856.581469][ C1] ? __hrtimer_run_queues+0x197/0x270 [11856.581752][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11856.582049][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11856.582324][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11856.582641][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11856.582912][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11856.583232][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11856.583543][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11856.583869][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11856.584169][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11856.584475][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11856.584773][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11856.585095][ C1] ? get_stack_info+0x36/0xc0 [11856.585347][ C1] ? lock_acquire+0x1c1/0x220 [11856.585596][ C1] ? lock_release+0x1d5/0x250 [11856.585843][ C1] do_raw_spin_lock+0x1ec/0x270 [11856.586101][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11856.586382][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11856.586679][ C1] ? lock_acquire+0x1c1/0x220 [11856.586924][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11856.587174][ C1] _raw_spin_lock_nested+0x65/0x80 [11856.587455][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11856.587697][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11856.587954][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11856.588226][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11856.588516][ C1] ip_local_deliver_finish+0x2ae/0x480 [11856.588799][ C1] ip_local_deliver+0x19d/0x480 [11856.589058][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11856.589341][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11856.589615][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11856.589979][ C1] ? rcu_read_lock_held+0xe/0x50 [11856.590243][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11856.590575][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11856.590849][ C1] ip_rcv+0x564/0x740 [11856.591060][ C1] ? __pfx_ip_rcv+0x10/0x10 [11856.591304][ C1] ? set_track_prepare+0x8a/0xd0 [11856.591568][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11856.591853][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11856.592136][ C1] ? skb_clone+0x10b/0x330 [11856.592375][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11856.592709][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11856.593025][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11856.593320][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11856.593629][ C1] ? __tcf_classify+0x329/0x7d0 [11856.593889][ C1] ? __pfx_ip_rcv+0x10/0x10 [11856.594129][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11856.594442][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11856.594736][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11856.595075][ C1] ? lock_acquire+0x1c1/0x220 [11856.595324][ C1] ? netif_receive_skb_internal+0x84/0x300 [11856.595630][ C1] netif_receive_skb_internal+0xb0/0x300 [11856.595928][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11856.596257][ C1] ? __copy_skb_header+0xaf/0x490 [11856.596526][ C1] ? __skb_clone+0x57a/0x760 [11856.596769][ C1] netif_receive_skb+0x55/0x280 [11856.597025][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11856.597352][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11856.597696][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11856.598007][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11856.598292][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11856.598596][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11856.598918][ C1] ? hlock_class+0x4e/0x130 [11856.599163][ C1] ? get_stack_info_noinstr+0x18/0x110 [11856.599449][ C1] ? get_stack_info_noinstr+0x18/0x110 [11856.599737][ C1] ? __pfx_validate_chain+0x10/0x10 [11856.600010][ C1] ? hlock_class+0x4e/0x130 [11856.600248][ C1] ? mark_lock+0x38/0x3e0 [11856.600479][ C1] ? stack_access_ok+0xda/0x1f0 [11856.600738][ C1] ? __lock_acquire+0xb67/0x1610 [11856.601001][ C1] ? get_stack_info_noinstr+0x18/0x110 [11856.601291][ C1] ? get_stack_info+0x36/0xc0 [11856.601541][ C1] ? stack_access_ok+0xda/0x1f0 [11856.601797][ C1] ? get_reg+0x119/0x190 [11856.602020][ C1] ? unwind_next_frame+0x12af/0x1d10 [11856.602298][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11856.602620][ C1] __tcf_classify+0x329/0x7d0 [11856.602871][ C1] tcf_classify+0x283/0x930 [11856.603110][ C1] ? arch_stack_walk+0xa2/0x100 [11856.603370][ C1] ? __pfx_tcf_classify+0x10/0x10 [11856.603642][ C1] ? get_stack_info+0x36/0xc0 [11856.603892][ C1] tc_run+0x2e4/0x5d0 [11856.604107][ C1] ? __pfx_tc_run+0x10/0x10 [11856.604348][ C1] ? lock_acquire+0x1c1/0x220 [11856.604595][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11856.604866][ C1] __dev_queue_xmit+0x686/0x17e0 [11856.605128][ C1] ? lock_acquire+0x1c1/0x220 [11856.605375][ C1] ? ip_finish_output2+0x786/0x18e0 [11856.605649][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11856.605969][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11856.606252][ C1] ? neigh_hh_output+0x348/0x590 [11856.606514][ C1] ? ip_finish_output2+0x262/0x18e0 [11856.606790][ C1] ip_finish_output2+0x786/0x18e0 [11856.607057][ C1] ? stack_depot_save_flags+0x45/0x550 [11856.607348][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11856.607698][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11856.607985][ C1] ? rcu_read_lock_held+0xe/0x50 [11856.608248][ C1] ? __ip_finish_output+0x10f/0x770 [11856.608522][ C1] ip_output+0x16b/0x4f0 [11856.608749][ C1] ? run_timer_softirq+0x72/0x100 [11856.609016][ C1] ? __pfx_ip_output+0x10/0x10 [11856.609269][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11856.609566][ C1] ? rcu_read_lock_held+0xe/0x50 [11856.609830][ C1] ? ip_local_out+0x114/0x3b0 [11856.610080][ C1] __ip_queue_xmit+0x672/0x1910 [11856.610337][ C1] ? __create_object+0x5e/0xb0 [11856.610590][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11856.610869][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11856.611162][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11856.611445][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11856.611737][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11856.612022][ C1] tcp_delack_timer+0x84/0x240 [11856.612274][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11856.612557][ C1] call_timer_fn+0x173/0x430 [11856.612801][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11856.613074][ C1] ? next_expiry_recalc+0xcd/0x220 [11856.613345][ C1] __run_timers.part.0+0x52d/0x890 [11856.613621][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11856.613905][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11856.614199][ C1] ? lock_acquire+0x1c1/0x220 [11856.614448][ C1] ? clockevents_program_event+0xf6/0x300 [11856.614749][ C1] ? lock_release+0x1d5/0x250 [11856.614996][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11856.615271][ C1] ? ktime_get+0xb3/0x190 [11856.615503][ C1] ? clockevents_program_event+0x1ea/0x300 [11856.615811][ C1] run_timer_softirq+0x72/0x100 [11856.616067][ C1] __do_softirq+0x1b9/0x7ff [11856.616311][ C1] irq_exit_rcu+0x98/0xc0 [11856.616541][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11856.616841][ C1] [11856.616995][ C1] [11856.617154][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11856.617480][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11856.617813][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11856.618822][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11856.619139][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11856.619554][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11856.619966][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11856.620378][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11856.620789][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11856.621208][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11856.621514][ C1] pipe_read+0xa16/0xdf0 [11856.621745][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11856.622034][ C1] ? __pfx_pipe_read+0x10/0x10 [11856.622288][ C1] ? iterate_tty_write+0x299/0x540 [11856.622559][ C1] ? lock_release+0x1d5/0x250 [11856.622808][ C1] vfs_read+0x911/0xc00 [11856.623031][ C1] ? lock_acquire+0x1c1/0x220 [11856.623280][ C1] ? __might_fault+0xc6/0x180 [11856.623540][ C1] ? __pfx_vfs_read+0x10/0x10 [11856.623789][ C1] ? __might_fault+0xc6/0x180 [11856.624037][ C1] ? lock_release+0x1d5/0x250 [11856.624287][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11856.624562][ C1] ? __fget_light+0x54/0x1e0 [11856.624808][ C1] ksys_read+0x17a/0x1e0 [11856.625035][ C1] ? __pfx_ksys_read+0x10/0x10 [11856.625288][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11856.625602][ C1] do_syscall_64+0xc9/0x1e0 [11856.625844][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11856.626156][ C1] RIP: 0033:0x7f08a1ea38b2 [11856.626392][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11856.627396][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11856.627833][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11856.628249][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11856.628661][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11856.629073][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11856.629485][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11856.629900][ C1] [11856.630065][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8851s! [swapper/2:0] [11856.630494][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11856.631744][ C2] irq event stamp: 44114564 [11856.631973][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11856.632511][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11856.633020][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11856.633497][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11856.633971][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11856.634426][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11856.635041][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [11856.635324][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [11856.636292][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [11856.636601][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11856.636997][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11856.637396][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11856.637794][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11856.638190][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11856.638586][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11856.639033][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11856.639366][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11856.639767][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11856.640165][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11856.640561][ C2] PKRU: 55555554 [11856.640743][ C2] Call Trace: [11856.640914][ C2] [11856.641061][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11856.641323][ C2] ? __run_hrtimer+0x1c0/0x710 [11856.641566][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11856.641843][ C2] ? __hrtimer_run_queues+0x197/0x270 [11856.642117][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11856.642403][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11856.642667][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11856.642973][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11856.643235][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11856.643498][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11856.643815][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11856.644116][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11856.644430][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11856.644720][ C2] ? __pfx___kasan_check_read+0x10/0x10 [11856.645000][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [11856.645284][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11856.645596][ C2] ? get_stack_info+0x36/0xc0 [11856.645836][ C2] ? lock_acquire+0x1c1/0x220 [11856.646077][ C2] ? lock_release+0x1d5/0x250 [11856.646317][ C2] do_raw_spin_lock+0x1ec/0x270 [11856.646571][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11856.646842][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11856.647126][ C2] ? lock_acquire+0x1c1/0x220 [11856.647366][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11856.647607][ C2] _raw_spin_lock_nested+0x65/0x80 [11856.647867][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11856.648102][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11856.648348][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11856.648605][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11856.648881][ C2] ip_local_deliver_finish+0x2ae/0x480 [11856.649158][ C2] ip_local_deliver+0x19d/0x480 [11856.649408][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11856.649678][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11856.649940][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11856.650290][ C2] ? rcu_read_lock_held+0xe/0x50 [11856.650543][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11856.650864][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11856.651126][ C2] ip_rcv+0x564/0x740 [11856.651330][ C2] ? __pfx_ip_rcv+0x10/0x10 [11856.651559][ C2] ? set_track_prepare+0x8a/0xd0 [11856.651811][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11856.652088][ C2] ? start_secondary+0x21c/0x2b0 [11856.652340][ C2] ? skb_clone+0x10b/0x330 [11856.652565][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11856.652888][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11856.653195][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11856.653473][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11856.653775][ C2] ? __tcf_classify+0x329/0x7d0 [11856.654024][ C2] ? __pfx_ip_rcv+0x10/0x10 [11856.654253][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11856.654554][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11856.654837][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11856.655164][ C2] ? lock_acquire+0x1c1/0x220 [11856.655401][ C2] ? netif_receive_skb_internal+0x84/0x300 [11856.655699][ C2] netif_receive_skb_internal+0xb0/0x300 [11856.655983][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11856.656303][ C2] ? __copy_skb_header+0xaf/0x490 [11856.656564][ C2] ? __skb_clone+0x57a/0x760 [11856.656799][ C2] netif_receive_skb+0x55/0x280 [11856.657046][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11856.657359][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11856.657691][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11856.657987][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11856.658263][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11856.658551][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11856.658863][ C2] ? get_stack_info+0x36/0xc0 [11856.659104][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11856.659370][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11856.659687][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11856.659962][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11856.660237][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11856.660551][ C2] ? kernel_text_address+0x17/0xe0 [11856.660810][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11856.661123][ C2] ? arch_stack_walk+0x8c/0x100 [11856.661371][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11856.661636][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11856.661920][ C2] ? lock_acquire+0x1c1/0x220 [11856.662158][ C2] ? stack_depot_save_flags+0x281/0x550 [11856.662441][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11856.662742][ C2] ? get_stack_info_noinstr+0x18/0x110 [11856.663020][ C2] ? get_stack_info+0x36/0xc0 [11856.663261][ C2] __tcf_classify+0x329/0x7d0 [11856.663503][ C2] tcf_classify+0x283/0x930 [11856.663743][ C2] ? __pfx_tcf_classify+0x10/0x10 [11856.663999][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11856.664312][ C2] tc_run+0x2e4/0x5d0 [11856.664516][ C2] ? __pfx_tc_run+0x10/0x10 [11856.664746][ C2] ? lock_acquire+0x1c1/0x220 [11856.664983][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11856.665244][ C2] __dev_queue_xmit+0x686/0x17e0 [11856.665495][ C2] ? lock_acquire+0x1c1/0x220 [11856.665734][ C2] ? ip_finish_output2+0x786/0x18e0 [11856.665998][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11856.666302][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11856.666572][ C2] ? neigh_hh_output+0x348/0x590 [11856.666825][ C2] ? ip_finish_output2+0x262/0x18e0 [11856.667089][ C2] ip_finish_output2+0x786/0x18e0 [11856.667345][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11856.667681][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11856.667958][ C2] ? rcu_read_lock_held+0xe/0x50 [11856.668211][ C2] ? __ip_finish_output+0x10f/0x770 [11856.668475][ C2] ip_output+0x16b/0x4f0 [11856.668690][ C2] ? __pfx_ip_output+0x10/0x10 [11856.668933][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11856.669211][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11856.669524][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11856.669800][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11856.670050][ C2] ? __alloc_skb+0xd4/0x280 [11856.670284][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11856.670554][ C2] ? tcp_fragment+0x168/0x1040 [11856.670798][ C2] ? rcu_read_lock_held+0xe/0x50 [11856.671051][ C2] ? ip_local_out+0x114/0x3b0 [11856.671291][ C2] __ip_queue_xmit+0x672/0x1910 [11856.671539][ C2] ? __skb_clone+0x57a/0x760 [11856.671772][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11856.672038][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11856.672320][ C2] ? ipv4_dst_check+0xe3/0x170 [11856.672565][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11856.672813][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11856.673114][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11856.673433][ C2] ? tcp_fragment+0xb0e/0x1040 [11856.673682][ C2] tcp_send_loss_probe+0x348/0x830 [11856.673943][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11856.674211][ C2] tcp_write_timer+0x82/0x1d0 [11856.674450][ C2] call_timer_fn+0x173/0x430 [11856.674688][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11856.674949][ C2] ? next_expiry_recalc+0xcd/0x220 [11856.675210][ C2] __run_timers.part.0+0x52d/0x890 [11856.675469][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11856.675738][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11856.676020][ C2] ? lock_acquire+0x1c1/0x220 [11856.676260][ C2] ? clockevents_program_event+0xf6/0x300 [11856.676550][ C2] ? lock_release+0x1d5/0x250 [11856.676788][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11856.677053][ C2] ? ktime_get+0xb3/0x190 [11856.677274][ C2] ? clockevents_program_event+0x1ea/0x300 [11856.677570][ C2] run_timer_softirq+0x72/0x100 [11856.677817][ C2] __do_softirq+0x1b9/0x7ff [11856.678050][ C2] irq_exit_rcu+0x98/0xc0 [11856.678271][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11856.678557][ C2] [11856.678706][ C2] [11856.678858][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11856.679161][ C2] RIP: 0010:default_idle+0xf/0x20 [11856.679418][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11856.680387][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11856.680695][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11856.681095][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11856.681492][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11856.681887][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11856.682289][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11856.682691][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11856.682979][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11856.683240][ C2] default_idle_call+0x69/0xa0 [11856.683484][ C2] cpuidle_idle_call+0x1f6/0x280 [11856.683738][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11856.684013][ C2] ? lock_release+0x1d5/0x250 [11856.684253][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11856.684525][ C2] do_idle+0xfb/0x160 [11856.684729][ C2] cpu_startup_entry+0x55/0x60 [11856.684971][ C2] start_secondary+0x21c/0x2b0 [11856.685215][ C2] ? __pfx_start_secondary+0x10/0x10 [11856.685486][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11856.685796][ C2] [11884.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8877s! [perl:4135] [11884.569725][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11884.571022][ C1] irq event stamp: 209232 [11884.571250][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11884.571800][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11884.572295][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11884.572780][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11884.573262][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11884.573741][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11884.574375][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11884.574713][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11884.575717][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11884.576037][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11884.576452][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11884.576865][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11884.577278][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11884.577691][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11884.578104][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11884.578570][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11884.578917][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11884.579333][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11884.579746][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11884.580163][ C1] PKRU: 55555554 [11884.580350][ C1] Call Trace: [11884.580530][ C1] [11884.580685][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11884.580959][ C1] ? __run_hrtimer+0x1c0/0x710 [11884.581213][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11884.581502][ C1] ? __hrtimer_run_queues+0x197/0x270 [11884.581784][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11884.582082][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11884.582359][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11884.582676][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11884.582948][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11884.583270][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11884.583585][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11884.583914][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11884.584214][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11884.584521][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11884.584819][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11884.585142][ C1] ? get_stack_info+0x36/0xc0 [11884.585395][ C1] ? lock_acquire+0x1c1/0x220 [11884.585644][ C1] ? lock_release+0x1d5/0x250 [11884.585891][ C1] do_raw_spin_lock+0x1ec/0x270 [11884.586150][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11884.586432][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11884.586729][ C1] ? lock_acquire+0x1c1/0x220 [11884.586977][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11884.587226][ C1] _raw_spin_lock_nested+0x65/0x80 [11884.587498][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11884.587743][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11884.588001][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11884.588270][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11884.588560][ C1] ip_local_deliver_finish+0x2ae/0x480 [11884.588849][ C1] ip_local_deliver+0x19d/0x480 [11884.589105][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11884.589391][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11884.589665][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11884.590026][ C1] ? rcu_read_lock_held+0xe/0x50 [11884.590291][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11884.590623][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11884.590893][ C1] ip_rcv+0x564/0x740 [11884.591105][ C1] ? __pfx_ip_rcv+0x10/0x10 [11884.591347][ C1] ? set_track_prepare+0x8a/0xd0 [11884.591611][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11884.591898][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11884.592182][ C1] ? skb_clone+0x10b/0x330 [11884.592421][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11884.592752][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11884.593070][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11884.593363][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11884.593674][ C1] ? __tcf_classify+0x329/0x7d0 [11884.593931][ C1] ? __pfx_ip_rcv+0x10/0x10 [11884.594174][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11884.594485][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11884.594781][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11884.595119][ C1] ? lock_acquire+0x1c1/0x220 [11884.595367][ C1] ? netif_receive_skb_internal+0x84/0x300 [11884.595676][ C1] netif_receive_skb_internal+0xb0/0x300 [11884.595971][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11884.596301][ C1] ? __copy_skb_header+0xaf/0x490 [11884.596568][ C1] ? __skb_clone+0x57a/0x760 [11884.596813][ C1] netif_receive_skb+0x55/0x280 [11884.597070][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11884.597394][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11884.597739][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11884.598050][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11884.598335][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11884.598636][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11884.598959][ C1] ? hlock_class+0x4e/0x130 [11884.599202][ C1] ? get_stack_info_noinstr+0x18/0x110 [11884.599489][ C1] ? get_stack_info_noinstr+0x18/0x110 [11884.599777][ C1] ? __pfx_validate_chain+0x10/0x10 [11884.600050][ C1] ? hlock_class+0x4e/0x130 [11884.600291][ C1] ? mark_lock+0x38/0x3e0 [11884.600518][ C1] ? stack_access_ok+0xda/0x1f0 [11884.600777][ C1] ? __lock_acquire+0xb67/0x1610 [11884.601041][ C1] ? get_stack_info_noinstr+0x18/0x110 [11884.601327][ C1] ? get_stack_info+0x36/0xc0 [11884.601578][ C1] ? stack_access_ok+0xda/0x1f0 [11884.601835][ C1] ? get_reg+0x119/0x190 [11884.602059][ C1] ? unwind_next_frame+0x12af/0x1d10 [11884.602336][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11884.602661][ C1] __tcf_classify+0x329/0x7d0 [11884.602912][ C1] tcf_classify+0x283/0x930 [11884.603153][ C1] ? arch_stack_walk+0xa2/0x100 [11884.603421][ C1] ? __pfx_tcf_classify+0x10/0x10 [11884.603687][ C1] ? get_stack_info+0x36/0xc0 [11884.603937][ C1] tc_run+0x2e4/0x5d0 [11884.604151][ C1] ? __pfx_tc_run+0x10/0x10 [11884.604392][ C1] ? lock_acquire+0x1c1/0x220 [11884.604640][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11884.604911][ C1] __dev_queue_xmit+0x686/0x17e0 [11884.605175][ C1] ? lock_acquire+0x1c1/0x220 [11884.605420][ C1] ? ip_finish_output2+0x786/0x18e0 [11884.605695][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11884.606011][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11884.606295][ C1] ? neigh_hh_output+0x348/0x590 [11884.606558][ C1] ? ip_finish_output2+0x262/0x18e0 [11884.606833][ C1] ip_finish_output2+0x786/0x18e0 [11884.607098][ C1] ? stack_depot_save_flags+0x45/0x550 [11884.607389][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11884.607737][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11884.608024][ C1] ? rcu_read_lock_held+0xe/0x50 [11884.608288][ C1] ? __ip_finish_output+0x10f/0x770 [11884.608563][ C1] ip_output+0x16b/0x4f0 [11884.608789][ C1] ? run_timer_softirq+0x72/0x100 [11884.609056][ C1] ? __pfx_ip_output+0x10/0x10 [11884.609310][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11884.609606][ C1] ? rcu_read_lock_held+0xe/0x50 [11884.609867][ C1] ? ip_local_out+0x114/0x3b0 [11884.610119][ C1] __ip_queue_xmit+0x672/0x1910 [11884.610377][ C1] ? __create_object+0x5e/0xb0 [11884.610629][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11884.610908][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11884.611200][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11884.611482][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11884.611775][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11884.612057][ C1] tcp_delack_timer+0x84/0x240 [11884.612312][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11884.612593][ C1] call_timer_fn+0x173/0x430 [11884.612839][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11884.613111][ C1] ? next_expiry_recalc+0xcd/0x220 [11884.613389][ C1] __run_timers.part.0+0x52d/0x890 [11884.613659][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11884.613944][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11884.614241][ C1] ? lock_acquire+0x1c1/0x220 [11884.614488][ C1] ? clockevents_program_event+0xf6/0x300 [11884.614793][ C1] ? lock_release+0x1d5/0x250 [11884.615042][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11884.615320][ C1] ? ktime_get+0xb3/0x190 [11884.615550][ C1] ? clockevents_program_event+0x1ea/0x300 [11884.615857][ C1] run_timer_softirq+0x72/0x100 [11884.616114][ C1] __do_softirq+0x1b9/0x7ff [11884.616357][ C1] irq_exit_rcu+0x98/0xc0 [11884.616587][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11884.616885][ C1] [11884.617040][ C1] [11884.617200][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11884.617515][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11884.617853][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11884.618859][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11884.619178][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11884.619592][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11884.620004][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11884.620417][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11884.620830][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11884.621248][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11884.621554][ C1] pipe_read+0xa16/0xdf0 [11884.621787][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11884.622075][ C1] ? __pfx_pipe_read+0x10/0x10 [11884.622329][ C1] ? iterate_tty_write+0x299/0x540 [11884.622600][ C1] ? lock_release+0x1d5/0x250 [11884.622850][ C1] vfs_read+0x911/0xc00 [11884.623073][ C1] ? lock_acquire+0x1c1/0x220 [11884.623322][ C1] ? __might_fault+0xc6/0x180 [11884.623578][ C1] ? __pfx_vfs_read+0x10/0x10 [11884.623825][ C1] ? __might_fault+0xc6/0x180 [11884.624074][ C1] ? lock_release+0x1d5/0x250 [11884.624324][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11884.624598][ C1] ? __fget_light+0x54/0x1e0 [11884.624845][ C1] ksys_read+0x17a/0x1e0 [11884.625070][ C1] ? __pfx_ksys_read+0x10/0x10 [11884.625325][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11884.625640][ C1] do_syscall_64+0xc9/0x1e0 [11884.625881][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11884.626192][ C1] RIP: 0033:0x7f08a1ea38b2 [11884.626427][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11884.627448][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11884.627884][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11884.628297][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11884.628711][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11884.629125][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11884.629537][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11884.629953][ C1] [11884.630119][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8877s! [swapper/2:0] [11884.630540][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11884.631791][ C2] irq event stamp: 44114564 [11884.632021][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11884.632555][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11884.633066][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11884.633549][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11884.634023][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11884.634479][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11884.635089][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11884.635415][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11884.636384][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11884.636689][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11884.637089][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11884.637488][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11884.637885][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11884.638283][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11884.638683][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11884.639130][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11884.639461][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11884.639859][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11884.640256][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11884.640655][ C2] PKRU: 55555554 [11884.640841][ C2] Call Trace: [11884.641009][ C2] [11884.641159][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11884.641421][ C2] ? __run_hrtimer+0x1c0/0x710 [11884.641663][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11884.641941][ C2] ? __hrtimer_run_queues+0x197/0x270 [11884.642214][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11884.642508][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11884.642773][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11884.643076][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11884.643338][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11884.643606][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11884.643915][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11884.644214][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11884.644529][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11884.644816][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11884.645113][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11884.645402][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11884.645712][ C2] ? get_stack_info+0x36/0xc0 [11884.645958][ C2] ? lock_acquire+0x1c1/0x220 [11884.646201][ C2] ? lock_release+0x1d5/0x250 [11884.646441][ C2] do_raw_spin_lock+0x1ec/0x270 [11884.646689][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11884.646964][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11884.647249][ C2] ? lock_acquire+0x1c1/0x220 [11884.647488][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11884.647731][ C2] _raw_spin_lock_nested+0x65/0x80 [11884.647994][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11884.648229][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11884.648477][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11884.648736][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11884.649012][ C2] ip_local_deliver_finish+0x2ae/0x480 [11884.649294][ C2] ip_local_deliver+0x19d/0x480 [11884.649544][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11884.649816][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11884.650082][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11884.650430][ C2] ? rcu_read_lock_held+0xe/0x50 [11884.650684][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11884.651005][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11884.651269][ C2] ip_rcv+0x564/0x740 [11884.651474][ C2] ? __pfx_ip_rcv+0x10/0x10 [11884.651705][ C2] ? set_track_prepare+0x8a/0xd0 [11884.651958][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11884.652235][ C2] ? start_secondary+0x21c/0x2b0 [11884.652487][ C2] ? skb_clone+0x10b/0x330 [11884.652717][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11884.653038][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11884.653346][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11884.653633][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11884.653927][ C2] ? __tcf_classify+0x329/0x7d0 [11884.654178][ C2] ? __pfx_ip_rcv+0x10/0x10 [11884.654411][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11884.654712][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11884.654998][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11884.655325][ C2] ? lock_acquire+0x1c1/0x220 [11884.655565][ C2] ? netif_receive_skb_internal+0x84/0x300 [11884.655862][ C2] netif_receive_skb_internal+0xb0/0x300 [11884.656149][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11884.656467][ C2] ? __copy_skb_header+0xaf/0x490 [11884.656726][ C2] ? __skb_clone+0x57a/0x760 [11884.656961][ C2] netif_receive_skb+0x55/0x280 [11884.657210][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11884.657521][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11884.657854][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11884.658156][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11884.658431][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11884.658722][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11884.659034][ C2] ? get_stack_info+0x36/0xc0 [11884.659278][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11884.659543][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11884.659862][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11884.660141][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11884.660419][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11884.660737][ C2] ? kernel_text_address+0x17/0xe0 [11884.661000][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11884.661315][ C2] ? arch_stack_walk+0x8c/0x100 [11884.661563][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11884.661829][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11884.662114][ C2] ? lock_acquire+0x1c1/0x220 [11884.662353][ C2] ? stack_depot_save_flags+0x281/0x550 [11884.662635][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11884.662942][ C2] ? get_stack_info_noinstr+0x18/0x110 [11884.663219][ C2] ? get_stack_info+0x36/0xc0 [11884.663467][ C2] __tcf_classify+0x329/0x7d0 [11884.663710][ C2] tcf_classify+0x283/0x930 [11884.663943][ C2] ? __pfx_tcf_classify+0x10/0x10 [11884.664200][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11884.664511][ C2] tc_run+0x2e4/0x5d0 [11884.664720][ C2] ? __pfx_tc_run+0x10/0x10 [11884.664950][ C2] ? lock_acquire+0x1c1/0x220 [11884.665191][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11884.665453][ C2] __dev_queue_xmit+0x686/0x17e0 [11884.665707][ C2] ? lock_acquire+0x1c1/0x220 [11884.665947][ C2] ? ip_finish_output2+0x786/0x18e0 [11884.666213][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11884.666517][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11884.666790][ C2] ? neigh_hh_output+0x348/0x590 [11884.667044][ C2] ? ip_finish_output2+0x262/0x18e0 [11884.667310][ C2] ip_finish_output2+0x786/0x18e0 [11884.667568][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11884.667906][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11884.668182][ C2] ? rcu_read_lock_held+0xe/0x50 [11884.668437][ C2] ? __ip_finish_output+0x10f/0x770 [11884.668703][ C2] ip_output+0x16b/0x4f0 [11884.668924][ C2] ? __pfx_ip_output+0x10/0x10 [11884.669168][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11884.669446][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11884.669762][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11884.670039][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11884.670292][ C2] ? __alloc_skb+0xd4/0x280 [11884.670524][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11884.670794][ C2] ? tcp_fragment+0x168/0x1040 [11884.671038][ C2] ? rcu_read_lock_held+0xe/0x50 [11884.671292][ C2] ? ip_local_out+0x114/0x3b0 [11884.671530][ C2] __ip_queue_xmit+0x672/0x1910 [11884.671780][ C2] ? __skb_clone+0x57a/0x760 [11884.672017][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11884.672284][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11884.672565][ C2] ? ipv4_dst_check+0xe3/0x170 [11884.672810][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11884.673062][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11884.673366][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11884.673694][ C2] ? tcp_fragment+0xb0e/0x1040 [11884.673939][ C2] tcp_send_loss_probe+0x348/0x830 [11884.674200][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11884.674469][ C2] tcp_write_timer+0x82/0x1d0 [11884.674709][ C2] call_timer_fn+0x173/0x430 [11884.674945][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11884.675207][ C2] ? next_expiry_recalc+0xcd/0x220 [11884.675470][ C2] __run_timers.part.0+0x52d/0x890 [11884.675730][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11884.676001][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11884.676285][ C2] ? lock_acquire+0x1c1/0x220 [11884.676526][ C2] ? clockevents_program_event+0xf6/0x300 [11884.676814][ C2] ? lock_release+0x1d5/0x250 [11884.677056][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11884.677322][ C2] ? ktime_get+0xb3/0x190 [11884.677546][ C2] ? clockevents_program_event+0x1ea/0x300 [11884.677842][ C2] run_timer_softirq+0x72/0x100 [11884.678091][ C2] __do_softirq+0x1b9/0x7ff [11884.678328][ C2] irq_exit_rcu+0x98/0xc0 [11884.678548][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11884.678837][ C2] [11884.678986][ C2] [11884.679138][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11884.679443][ C2] RIP: 0010:default_idle+0xf/0x20 [11884.679700][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11884.680669][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11884.680982][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11884.681380][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11884.681781][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11884.682181][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11884.682579][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11884.682978][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11884.683271][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11884.683537][ C2] default_idle_call+0x69/0xa0 [11884.683782][ C2] cpuidle_idle_call+0x1f6/0x280 [11884.684035][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11884.684312][ C2] ? lock_release+0x1d5/0x250 [11884.684552][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11884.684826][ C2] do_idle+0xfb/0x160 [11884.685030][ C2] cpu_startup_entry+0x55/0x60 [11884.685273][ C2] start_secondary+0x21c/0x2b0 [11884.685518][ C2] ? __pfx_start_secondary+0x10/0x10 [11884.685787][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11884.686099][ C2] [11907.356107][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11907.356728][ C1] rcu: 1-....: (9239219 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2238958 [11907.357693][ C1] rcu: (t=9552469 jiffies g=1882453 q=730 ncpus=4) [11907.358264][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11907.358822][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11907.359597][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11907.359976][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11907.361170][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11907.361489][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11907.361902][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11907.362316][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11907.362728][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11907.363144][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11907.363571][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11907.364032][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11907.364393][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11907.364806][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11907.365224][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11907.365642][ C1] PKRU: 55555554 [11907.365832][ C1] Call Trace: [11907.366010][ C1] [11907.366168][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11907.366453][ C1] ? print_cpu_stall+0x263/0x6a0 [11907.366716][ C1] ? check_cpu_stall+0x284/0x500 [11907.366978][ C1] ? rcu_pending+0x92/0x360 [11907.367218][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11907.367503][ C1] ? update_process_times+0xb9/0x110 [11907.367784][ C1] ? tick_sched_handle+0x67/0x130 [11907.368051][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11907.368363][ C1] ? __run_hrtimer+0x1c0/0x710 [11907.368613][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11907.368937][ C1] ? __hrtimer_run_queues+0x197/0x270 [11907.369220][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11907.369521][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11907.369797][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11907.370116][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11907.370400][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11907.370719][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11907.371029][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11907.371361][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11907.371664][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11907.371973][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11907.372275][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11907.372598][ C1] ? get_stack_info+0x36/0xc0 [11907.372850][ C1] ? lock_acquire+0x1c1/0x220 [11907.373100][ C1] ? lock_release+0x1d5/0x250 [11907.373360][ C1] do_raw_spin_lock+0x1ec/0x270 [11907.373615][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11907.373899][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11907.374194][ C1] ? lock_acquire+0x1c1/0x220 [11907.374459][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11907.374712][ C1] _raw_spin_lock_nested+0x65/0x80 [11907.374984][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11907.375230][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11907.375487][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11907.375877][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11907.376215][ C1] ip_local_deliver_finish+0x2ae/0x480 [11907.376517][ C1] ip_local_deliver+0x19d/0x480 [11907.376884][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11907.377353][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11907.377664][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11907.378136][ C1] ? rcu_read_lock_held+0xe/0x50 [11907.378568][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11907.379112][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11907.379560][ C1] ip_rcv+0x564/0x740 [11907.379912][ C1] ? __pfx_ip_rcv+0x10/0x10 [11907.380305][ C1] ? set_track_prepare+0x8a/0xd0 [11907.380735][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11907.381208][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11907.381672][ C1] ? skb_clone+0x10b/0x330 [11907.382061][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11907.382604][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11907.383127][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11907.383619][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11907.384124][ C1] ? __tcf_classify+0x329/0x7d0 [11907.384550][ C1] ? __pfx_ip_rcv+0x10/0x10 [11907.384923][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11907.385233][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11907.385530][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11907.385866][ C1] ? lock_acquire+0x1c1/0x220 [11907.386111][ C1] ? netif_receive_skb_internal+0x84/0x300 [11907.386419][ C1] netif_receive_skb_internal+0xb0/0x300 [11907.386714][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11907.387042][ C1] ? __copy_skb_header+0xaf/0x490 [11907.387309][ C1] ? __skb_clone+0x57a/0x760 [11907.387553][ C1] netif_receive_skb+0x55/0x280 [11907.387812][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11907.388136][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11907.388495][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11907.388801][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11907.389087][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11907.389390][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11907.389715][ C1] ? hlock_class+0x4e/0x130 [11907.389959][ C1] ? get_stack_info_noinstr+0x18/0x110 [11907.390246][ C1] ? get_stack_info_noinstr+0x18/0x110 [11907.390532][ C1] ? __pfx_validate_chain+0x10/0x10 [11907.390806][ C1] ? hlock_class+0x4e/0x130 [11907.391047][ C1] ? mark_lock+0x38/0x3e0 [11907.391274][ C1] ? stack_access_ok+0xda/0x1f0 [11907.391535][ C1] ? __lock_acquire+0xb67/0x1610 [11907.391799][ C1] ? get_stack_info_noinstr+0x18/0x110 [11907.392086][ C1] ? get_stack_info+0x36/0xc0 [11907.392351][ C1] ? stack_access_ok+0xda/0x1f0 [11907.392604][ C1] ? get_reg+0x119/0x190 [11907.392828][ C1] ? unwind_next_frame+0x12af/0x1d10 [11907.393106][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11907.393436][ C1] __tcf_classify+0x329/0x7d0 [11907.393685][ C1] tcf_classify+0x283/0x930 [11907.393927][ C1] ? arch_stack_walk+0xa2/0x100 [11907.394185][ C1] ? __pfx_tcf_classify+0x10/0x10 [11907.394451][ C1] ? get_stack_info+0x36/0xc0 [11907.394700][ C1] tc_run+0x2e4/0x5d0 [11907.394915][ C1] ? __pfx_tc_run+0x10/0x10 [11907.395152][ C1] ? lock_acquire+0x1c1/0x220 [11907.395401][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11907.395672][ C1] __dev_queue_xmit+0x686/0x17e0 [11907.395934][ C1] ? lock_acquire+0x1c1/0x220 [11907.396182][ C1] ? ip_finish_output2+0x786/0x18e0 [11907.396456][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11907.396774][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11907.397056][ C1] ? neigh_hh_output+0x348/0x590 [11907.397318][ C1] ? ip_finish_output2+0x262/0x18e0 [11907.397592][ C1] ip_finish_output2+0x786/0x18e0 [11907.397856][ C1] ? stack_depot_save_flags+0x45/0x550 [11907.398145][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11907.398495][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11907.398781][ C1] ? rcu_read_lock_held+0xe/0x50 [11907.399044][ C1] ? __ip_finish_output+0x10f/0x770 [11907.399317][ C1] ip_output+0x16b/0x4f0 [11907.399541][ C1] ? run_timer_softirq+0x72/0x100 [11907.399808][ C1] ? __pfx_ip_output+0x10/0x10 [11907.400060][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11907.400358][ C1] ? rcu_read_lock_held+0xe/0x50 [11907.400618][ C1] ? ip_local_out+0x114/0x3b0 [11907.400867][ C1] __ip_queue_xmit+0x672/0x1910 [11907.401125][ C1] ? __create_object+0x5e/0xb0 [11907.401379][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11907.401655][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11907.401946][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11907.402230][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11907.402522][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11907.402803][ C1] tcp_delack_timer+0x84/0x240 [11907.403055][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11907.403342][ C1] call_timer_fn+0x173/0x430 [11907.403588][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11907.403859][ C1] ? next_expiry_recalc+0xcd/0x220 [11907.404129][ C1] __run_timers.part.0+0x52d/0x890 [11907.404398][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11907.404682][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11907.404977][ C1] ? lock_acquire+0x1c1/0x220 [11907.405225][ C1] ? clockevents_program_event+0xf6/0x300 [11907.405526][ C1] ? lock_release+0x1d5/0x250 [11907.405775][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11907.406050][ C1] ? ktime_get+0xb3/0x190 [11907.406280][ C1] ? clockevents_program_event+0x1ea/0x300 [11907.406586][ C1] run_timer_softirq+0x72/0x100 [11907.406843][ C1] __do_softirq+0x1b9/0x7ff [11907.407086][ C1] irq_exit_rcu+0x98/0xc0 [11907.407314][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11907.407613][ C1] [11907.407771][ C1] [11907.407926][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11907.408242][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11907.408577][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11907.409582][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11907.409901][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11907.410312][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11907.410725][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11907.411139][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11907.411550][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11907.411963][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11907.412272][ C1] pipe_read+0xa16/0xdf0 [11907.412500][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11907.412790][ C1] ? __pfx_pipe_read+0x10/0x10 [11907.413040][ C1] ? iterate_tty_write+0x299/0x540 [11907.413316][ C1] ? lock_release+0x1d5/0x250 [11907.413565][ C1] vfs_read+0x911/0xc00 [11907.413788][ C1] ? lock_acquire+0x1c1/0x220 [11907.414034][ C1] ? __might_fault+0xc6/0x180 [11907.414283][ C1] ? __pfx_vfs_read+0x10/0x10 [11907.414532][ C1] ? __might_fault+0xc6/0x180 [11907.414778][ C1] ? lock_release+0x1d5/0x250 [11907.415026][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11907.415298][ C1] ? __fget_light+0x54/0x1e0 [11907.415546][ C1] ksys_read+0x17a/0x1e0 [11907.415771][ C1] ? __pfx_ksys_read+0x10/0x10 [11907.416023][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11907.416338][ C1] do_syscall_64+0xc9/0x1e0 [11907.416582][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11907.416891][ C1] RIP: 0033:0x7f08a1ea38b2 [11907.417130][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11907.418133][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11907.418570][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11907.418982][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11907.419394][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11907.419805][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11907.420221][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11907.420637][ C1] [11907.420799][ C1] Sending NMI from CPU 1 to CPUs 2: [11907.421082][ C2] NMI backtrace for cpu 2 [11907.421090][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11907.421096][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11907.421100][ C2] RIP: 0010:kasan_check_range+0x12/0x1c0 [11907.421112][ C2] Code: 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 <44> 0f b6 c2 48 01 f0 55 53 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff [11907.421117][ C2] RSP: 0018:ffffc9000021fa88 EFLAGS: 00000202 [11907.421123][ C2] RAX: ffff88800a3a1b58 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11907.421127][ C2] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11907.421130][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11907.421133][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11907.421135][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11907.421137][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11907.421139][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11907.421143][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11907.421144][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11907.421146][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11907.421147][ C2] PKRU: 55555554 [11907.421149][ C2] Call Trace: [11907.421151][ C2] [11907.421153][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11907.421162][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11907.421168][ C2] ? nmi_handle+0x153/0x420 [11907.421173][ C2] ? default_do_nmi+0x41/0x100 [11907.421177][ C2] ? exc_nmi+0xf3/0x120 [11907.421179][ C2] ? end_repeat_nmi+0xf/0x60 [11907.421185][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11907.421189][ C2] ? kasan_check_range+0x12/0x1c0 [11907.421193][ C2] ? kasan_check_range+0x12/0x1c0 [11907.421196][ C2] ? kasan_check_range+0x12/0x1c0 [11907.421199][ C2] [11907.421200][ C2] [11907.421201][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [11907.421205][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11907.421207][ C2] ? get_stack_info+0x36/0xc0 [11907.421212][ C2] ? lock_acquire+0x1c1/0x220 [11907.421215][ C2] ? lock_release+0x1d5/0x250 [11907.421219][ C2] do_raw_spin_lock+0x1ec/0x270 [11907.421223][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11907.421226][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11907.421229][ C2] ? lock_acquire+0x1c1/0x220 [11907.421231][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11907.421235][ C2] _raw_spin_lock_nested+0x65/0x80 [11907.421239][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11907.421246][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11907.421248][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11907.421253][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11907.421259][ C2] ip_local_deliver_finish+0x2ae/0x480 [11907.421263][ C2] ip_local_deliver+0x19d/0x480 [11907.421265][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11907.421267][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11907.421270][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11907.421276][ C2] ? rcu_read_lock_held+0xe/0x50 [11907.421280][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11907.421283][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11907.421293][ C2] ip_rcv+0x564/0x740 [11907.421296][ C2] ? __pfx_ip_rcv+0x10/0x10 [11907.421298][ C2] ? set_track_prepare+0x8a/0xd0 [11907.421303][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11907.421306][ C2] ? start_secondary+0x21c/0x2b0 [11907.421311][ C2] ? skb_clone+0x10b/0x330 [11907.421315][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11907.421322][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11907.421327][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11907.421332][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11907.421340][ C2] ? __tcf_classify+0x329/0x7d0 [11907.421344][ C2] ? __pfx_ip_rcv+0x10/0x10 [11907.421347][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11907.421351][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11907.421354][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11907.421358][ C2] ? lock_acquire+0x1c1/0x220 [11907.421361][ C2] ? netif_receive_skb_internal+0x84/0x300 [11907.421365][ C2] netif_receive_skb_internal+0xb0/0x300 [11907.421369][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11907.421373][ C2] ? __copy_skb_header+0xaf/0x490 [11907.421379][ C2] ? __skb_clone+0x57a/0x760 [11907.421382][ C2] netif_receive_skb+0x55/0x280 [11907.421385][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11907.421393][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11907.421399][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11907.421406][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11907.421411][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11907.421422][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11907.421429][ C2] ? get_stack_info+0x36/0xc0 [11907.421434][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11907.421437][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11907.421442][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11907.421444][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11907.421448][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11907.421451][ C2] ? kernel_text_address+0x17/0xe0 [11907.421454][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11907.421459][ C2] ? arch_stack_walk+0x8c/0x100 [11907.421463][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11907.421466][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11907.421470][ C2] ? lock_acquire+0x1c1/0x220 [11907.421472][ C2] ? stack_depot_save_flags+0x281/0x550 [11907.421476][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11907.421481][ C2] ? get_stack_info_noinstr+0x18/0x110 [11907.421484][ C2] ? get_stack_info+0x36/0xc0 [11907.421489][ C2] __tcf_classify+0x329/0x7d0 [11907.421494][ C2] tcf_classify+0x283/0x930 [11907.421499][ C2] ? __pfx_tcf_classify+0x10/0x10 [11907.421502][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11907.421506][ C2] tc_run+0x2e4/0x5d0 [11907.421511][ C2] ? __pfx_tc_run+0x10/0x10 [11907.421514][ C2] ? lock_acquire+0x1c1/0x220 [11907.421516][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11907.421520][ C2] __dev_queue_xmit+0x686/0x17e0 [11907.421524][ C2] ? lock_acquire+0x1c1/0x220 [11907.421527][ C2] ? ip_finish_output2+0x786/0x18e0 [11907.421530][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11907.421534][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11907.421537][ C2] ? neigh_hh_output+0x348/0x590 [11907.421540][ C2] ? ip_finish_output2+0x262/0x18e0 [11907.421544][ C2] ip_finish_output2+0x786/0x18e0 [11907.421548][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11907.421555][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11907.421558][ C2] ? rcu_read_lock_held+0xe/0x50 [11907.421562][ C2] ? __ip_finish_output+0x10f/0x770 [11907.421566][ C2] ip_output+0x16b/0x4f0 [11907.421569][ C2] ? __pfx_ip_output+0x10/0x10 [11907.421571][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11907.421574][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11907.421578][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11907.421581][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11907.421583][ C2] ? __alloc_skb+0xd4/0x280 [11907.421586][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11907.421590][ C2] ? tcp_fragment+0x168/0x1040 [11907.421594][ C2] ? rcu_read_lock_held+0xe/0x50 [11907.421596][ C2] ? ip_local_out+0x114/0x3b0 [11907.421600][ C2] __ip_queue_xmit+0x672/0x1910 [11907.421604][ C2] ? __skb_clone+0x57a/0x760 [11907.421606][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11907.421612][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11907.421615][ C2] ? ipv4_dst_check+0xe3/0x170 [11907.421620][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11907.421624][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11907.421628][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11907.421631][ C2] ? tcp_fragment+0xb0e/0x1040 [11907.421635][ C2] tcp_send_loss_probe+0x348/0x830 [11907.421638][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11907.421641][ C2] tcp_write_timer+0x82/0x1d0 [11907.421644][ C2] call_timer_fn+0x173/0x430 [11907.421648][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11907.421652][ C2] ? next_expiry_recalc+0xcd/0x220 [11907.421657][ C2] __run_timers.part.0+0x52d/0x890 [11907.421660][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11907.421664][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11907.421667][ C2] ? lock_acquire+0x1c1/0x220 [11907.421670][ C2] ? clockevents_program_event+0xf6/0x300 [11907.421675][ C2] ? lock_release+0x1d5/0x250 [11907.421677][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11907.421681][ C2] ? ktime_get+0xb3/0x190 [11907.421684][ C2] ? clockevents_program_event+0x1ea/0x300 [11907.421689][ C2] run_timer_softirq+0x72/0x100 [11907.421692][ C2] __do_softirq+0x1b9/0x7ff [11907.421697][ C2] irq_exit_rcu+0x98/0xc0 [11907.421699][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11907.421703][ C2] [11907.421704][ C2] [11907.421705][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11907.421708][ C2] RIP: 0010:default_idle+0xf/0x20 [11907.421711][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11907.421714][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11907.421716][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11907.421717][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11907.421719][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11907.421721][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11907.421723][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11907.421726][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11907.421729][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11907.421733][ C2] default_idle_call+0x69/0xa0 [11907.421736][ C2] cpuidle_idle_call+0x1f6/0x280 [11907.421739][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11907.421744][ C2] ? lock_release+0x1d5/0x250 [11907.421746][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11907.421750][ C2] do_idle+0xfb/0x160 [11907.421753][ C2] cpu_startup_entry+0x55/0x60 [11907.421755][ C2] start_secondary+0x21c/0x2b0 [11907.421758][ C2] ? __pfx_start_secondary+0x10/0x10 [11907.421762][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11907.421768][ C2] [11932.569272][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8922s! [perl:4135] [11932.569725][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11932.571041][ C1] irq event stamp: 209232 [11932.571270][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11932.571821][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11932.572316][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11932.572803][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11932.573291][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11932.573755][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11932.574388][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11932.574726][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11932.575733][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11932.576051][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11932.576469][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11932.576883][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11932.577296][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11932.577707][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11932.578122][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11932.578585][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11932.578928][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11932.579343][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11932.579756][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11932.580171][ C1] PKRU: 55555554 [11932.580359][ C1] Call Trace: [11932.580537][ C1] [11932.580694][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11932.580966][ C1] ? __run_hrtimer+0x1c0/0x710 [11932.581220][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11932.581507][ C1] ? __hrtimer_run_queues+0x197/0x270 [11932.581789][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11932.582087][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11932.582365][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11932.582680][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11932.582952][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11932.583280][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11932.583588][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11932.583916][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11932.584216][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [11932.584522][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11932.584820][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11932.585144][ C1] ? get_stack_info+0x36/0xc0 [11932.585395][ C1] ? lock_acquire+0x1c1/0x220 [11932.585646][ C1] ? lock_release+0x1d5/0x250 [11932.585894][ C1] do_raw_spin_lock+0x1ec/0x270 [11932.586152][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11932.586436][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11932.586730][ C1] ? lock_acquire+0x1c1/0x220 [11932.586977][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11932.587228][ C1] _raw_spin_lock_nested+0x65/0x80 [11932.587499][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11932.587740][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11932.587995][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11932.588264][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11932.588551][ C1] ip_local_deliver_finish+0x2ae/0x480 [11932.588841][ C1] ip_local_deliver+0x19d/0x480 [11932.589096][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11932.589379][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11932.589657][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11932.590018][ C1] ? rcu_read_lock_held+0xe/0x50 [11932.590283][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11932.590616][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11932.590897][ C1] ip_rcv+0x564/0x740 [11932.591112][ C1] ? __pfx_ip_rcv+0x10/0x10 [11932.591351][ C1] ? set_track_prepare+0x8a/0xd0 [11932.591616][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11932.591902][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11932.592187][ C1] ? skb_clone+0x10b/0x330 [11932.592422][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11932.592754][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11932.593070][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11932.593371][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11932.593678][ C1] ? __tcf_classify+0x329/0x7d0 [11932.593936][ C1] ? __pfx_ip_rcv+0x10/0x10 [11932.594174][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11932.594486][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11932.594782][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11932.595119][ C1] ? lock_acquire+0x1c1/0x220 [11932.595365][ C1] ? netif_receive_skb_internal+0x84/0x300 [11932.595673][ C1] netif_receive_skb_internal+0xb0/0x300 [11932.595967][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11932.596298][ C1] ? __copy_skb_header+0xaf/0x490 [11932.596565][ C1] ? __skb_clone+0x57a/0x760 [11932.596808][ C1] netif_receive_skb+0x55/0x280 [11932.597067][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11932.597392][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11932.597736][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11932.598044][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11932.598331][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11932.598629][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11932.598952][ C1] ? hlock_class+0x4e/0x130 [11932.599195][ C1] ? get_stack_info_noinstr+0x18/0x110 [11932.599482][ C1] ? get_stack_info_noinstr+0x18/0x110 [11932.599767][ C1] ? __pfx_validate_chain+0x10/0x10 [11932.600039][ C1] ? hlock_class+0x4e/0x130 [11932.600280][ C1] ? mark_lock+0x38/0x3e0 [11932.600505][ C1] ? stack_access_ok+0xda/0x1f0 [11932.600767][ C1] ? __lock_acquire+0xb67/0x1610 [11932.601030][ C1] ? get_stack_info_noinstr+0x18/0x110 [11932.601315][ C1] ? get_stack_info+0x36/0xc0 [11932.601565][ C1] ? stack_access_ok+0xda/0x1f0 [11932.601820][ C1] ? get_reg+0x119/0x190 [11932.602042][ C1] ? unwind_next_frame+0x12af/0x1d10 [11932.602322][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11932.602640][ C1] __tcf_classify+0x329/0x7d0 [11932.602892][ C1] tcf_classify+0x283/0x930 [11932.603140][ C1] ? arch_stack_walk+0xa2/0x100 [11932.603399][ C1] ? __pfx_tcf_classify+0x10/0x10 [11932.603664][ C1] ? get_stack_info+0x36/0xc0 [11932.603911][ C1] tc_run+0x2e4/0x5d0 [11932.604127][ C1] ? __pfx_tc_run+0x10/0x10 [11932.604367][ C1] ? lock_acquire+0x1c1/0x220 [11932.604617][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11932.604887][ C1] __dev_queue_xmit+0x686/0x17e0 [11932.605149][ C1] ? lock_acquire+0x1c1/0x220 [11932.605397][ C1] ? ip_finish_output2+0x786/0x18e0 [11932.605671][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11932.605988][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11932.606270][ C1] ? neigh_hh_output+0x348/0x590 [11932.606531][ C1] ? ip_finish_output2+0x262/0x18e0 [11932.606804][ C1] ip_finish_output2+0x786/0x18e0 [11932.607069][ C1] ? stack_depot_save_flags+0x45/0x550 [11932.607357][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11932.607704][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11932.607992][ C1] ? rcu_read_lock_held+0xe/0x50 [11932.608255][ C1] ? __ip_finish_output+0x10f/0x770 [11932.608529][ C1] ip_output+0x16b/0x4f0 [11932.608752][ C1] ? run_timer_softirq+0x72/0x100 [11932.609018][ C1] ? __pfx_ip_output+0x10/0x10 [11932.609270][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11932.609565][ C1] ? rcu_read_lock_held+0xe/0x50 [11932.609826][ C1] ? ip_local_out+0x114/0x3b0 [11932.610075][ C1] __ip_queue_xmit+0x672/0x1910 [11932.610333][ C1] ? __create_object+0x5e/0xb0 [11932.610587][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11932.610863][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11932.611153][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11932.611436][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11932.611729][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11932.612009][ C1] tcp_delack_timer+0x84/0x240 [11932.612263][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11932.612543][ C1] call_timer_fn+0x173/0x430 [11932.612788][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11932.613059][ C1] ? next_expiry_recalc+0xcd/0x220 [11932.613340][ C1] __run_timers.part.0+0x52d/0x890 [11932.613610][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11932.613892][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11932.614189][ C1] ? lock_acquire+0x1c1/0x220 [11932.614436][ C1] ? clockevents_program_event+0xf6/0x300 [11932.614736][ C1] ? lock_release+0x1d5/0x250 [11932.614984][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11932.615258][ C1] ? ktime_get+0xb3/0x190 [11932.615485][ C1] ? clockevents_program_event+0x1ea/0x300 [11932.615794][ C1] run_timer_softirq+0x72/0x100 [11932.616051][ C1] __do_softirq+0x1b9/0x7ff [11932.616293][ C1] irq_exit_rcu+0x98/0xc0 [11932.616523][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11932.616818][ C1] [11932.616976][ C1] [11932.617132][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11932.617447][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11932.617783][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11932.618784][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11932.619104][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11932.619517][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11932.619928][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11932.620343][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11932.620755][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11932.621171][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11932.621477][ C1] pipe_read+0xa16/0xdf0 [11932.621705][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11932.621992][ C1] ? __pfx_pipe_read+0x10/0x10 [11932.622246][ C1] ? iterate_tty_write+0x299/0x540 [11932.622516][ C1] ? lock_release+0x1d5/0x250 [11932.622766][ C1] vfs_read+0x911/0xc00 [11932.622987][ C1] ? lock_acquire+0x1c1/0x220 [11932.623244][ C1] ? __might_fault+0xc6/0x180 [11932.623494][ C1] ? __pfx_vfs_read+0x10/0x10 [11932.623742][ C1] ? __might_fault+0xc6/0x180 [11932.623988][ C1] ? lock_release+0x1d5/0x250 [11932.624239][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11932.624512][ C1] ? __fget_light+0x54/0x1e0 [11932.624758][ C1] ksys_read+0x17a/0x1e0 [11932.624982][ C1] ? __pfx_ksys_read+0x10/0x10 [11932.625236][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11932.625552][ C1] do_syscall_64+0xc9/0x1e0 [11932.625794][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11932.626105][ C1] RIP: 0033:0x7f08a1ea38b2 [11932.626342][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11932.627346][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11932.627780][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11932.628195][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11932.628612][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11932.629023][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11932.629436][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11932.629853][ C1] [11932.630016][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8922s! [swapper/2:0] [11932.630445][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11932.631697][ C2] irq event stamp: 44114564 [11932.631927][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11932.632469][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11932.632979][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11932.633466][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11932.633939][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11932.634398][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11932.635012][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11932.635340][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11932.636312][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11932.636621][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11932.637025][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11932.637429][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11932.637830][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11932.638233][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11932.638640][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11932.639090][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11932.639425][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11932.639826][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11932.640232][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11932.640632][ C2] PKRU: 55555554 [11932.640815][ C2] Call Trace: [11932.640983][ C2] [11932.641134][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11932.641399][ C2] ? __run_hrtimer+0x1c0/0x710 [11932.641646][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11932.641924][ C2] ? __hrtimer_run_queues+0x197/0x270 [11932.642197][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11932.642486][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11932.642752][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11932.643057][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11932.643331][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11932.643595][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11932.643903][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11932.644200][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11932.644517][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11932.644809][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11932.645105][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11932.645395][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11932.645706][ C2] ? get_stack_info+0x36/0xc0 [11932.645947][ C2] ? lock_acquire+0x1c1/0x220 [11932.646190][ C2] ? lock_release+0x1d5/0x250 [11932.646430][ C2] do_raw_spin_lock+0x1ec/0x270 [11932.646681][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11932.646953][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11932.647238][ C2] ? lock_acquire+0x1c1/0x220 [11932.647479][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11932.647721][ C2] _raw_spin_lock_nested+0x65/0x80 [11932.647982][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11932.648217][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11932.648463][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11932.648721][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11932.648998][ C2] ip_local_deliver_finish+0x2ae/0x480 [11932.649276][ C2] ip_local_deliver+0x19d/0x480 [11932.649524][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11932.649794][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11932.650057][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11932.650404][ C2] ? rcu_read_lock_held+0xe/0x50 [11932.650656][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11932.650977][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11932.651241][ C2] ip_rcv+0x564/0x740 [11932.651446][ C2] ? __pfx_ip_rcv+0x10/0x10 [11932.651676][ C2] ? set_track_prepare+0x8a/0xd0 [11932.651929][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11932.652207][ C2] ? start_secondary+0x21c/0x2b0 [11932.652459][ C2] ? skb_clone+0x10b/0x330 [11932.652686][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11932.653005][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11932.653324][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11932.653604][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11932.653899][ C2] ? __tcf_classify+0x329/0x7d0 [11932.654147][ C2] ? __pfx_ip_rcv+0x10/0x10 [11932.654378][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11932.654679][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11932.654964][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11932.655290][ C2] ? lock_acquire+0x1c1/0x220 [11932.655529][ C2] ? netif_receive_skb_internal+0x84/0x300 [11932.655826][ C2] netif_receive_skb_internal+0xb0/0x300 [11932.656112][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11932.656429][ C2] ? __copy_skb_header+0xaf/0x490 [11932.656686][ C2] ? __skb_clone+0x57a/0x760 [11932.656922][ C2] netif_receive_skb+0x55/0x280 [11932.657172][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11932.657482][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11932.657816][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11932.658116][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11932.658390][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11932.658680][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11932.658992][ C2] ? get_stack_info+0x36/0xc0 [11932.659234][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11932.659500][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11932.659818][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11932.660096][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11932.660373][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11932.660688][ C2] ? kernel_text_address+0x17/0xe0 [11932.660949][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11932.661265][ C2] ? arch_stack_walk+0x8c/0x100 [11932.661513][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11932.661779][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11932.662063][ C2] ? lock_acquire+0x1c1/0x220 [11932.662303][ C2] ? stack_depot_save_flags+0x281/0x550 [11932.662585][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11932.662888][ C2] ? get_stack_info_noinstr+0x18/0x110 [11932.663176][ C2] ? get_stack_info+0x36/0xc0 [11932.663417][ C2] __tcf_classify+0x329/0x7d0 [11932.663661][ C2] tcf_classify+0x283/0x930 [11932.663894][ C2] ? __pfx_tcf_classify+0x10/0x10 [11932.664152][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11932.664464][ C2] tc_run+0x2e4/0x5d0 [11932.664669][ C2] ? __pfx_tc_run+0x10/0x10 [11932.664897][ C2] ? lock_acquire+0x1c1/0x220 [11932.665137][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11932.665398][ C2] __dev_queue_xmit+0x686/0x17e0 [11932.665650][ C2] ? lock_acquire+0x1c1/0x220 [11932.665890][ C2] ? ip_finish_output2+0x786/0x18e0 [11932.666155][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11932.666459][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11932.666729][ C2] ? neigh_hh_output+0x348/0x590 [11932.666981][ C2] ? ip_finish_output2+0x262/0x18e0 [11932.667247][ C2] ip_finish_output2+0x786/0x18e0 [11932.667504][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11932.667840][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11932.668117][ C2] ? rcu_read_lock_held+0xe/0x50 [11932.668371][ C2] ? __ip_finish_output+0x10f/0x770 [11932.668635][ C2] ip_output+0x16b/0x4f0 [11932.668849][ C2] ? __pfx_ip_output+0x10/0x10 [11932.669093][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11932.669371][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11932.669683][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11932.669958][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11932.670211][ C2] ? __alloc_skb+0xd4/0x280 [11932.670441][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11932.670711][ C2] ? tcp_fragment+0x168/0x1040 [11932.670955][ C2] ? rcu_read_lock_held+0xe/0x50 [11932.671208][ C2] ? ip_local_out+0x114/0x3b0 [11932.671448][ C2] __ip_queue_xmit+0x672/0x1910 [11932.671694][ C2] ? __skb_clone+0x57a/0x760 [11932.671927][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11932.672194][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11932.672476][ C2] ? ipv4_dst_check+0xe3/0x170 [11932.672718][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11932.672965][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11932.673277][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11932.673596][ C2] ? tcp_fragment+0xb0e/0x1040 [11932.673840][ C2] tcp_send_loss_probe+0x348/0x830 [11932.674100][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11932.674369][ C2] tcp_write_timer+0x82/0x1d0 [11932.674609][ C2] call_timer_fn+0x173/0x430 [11932.674846][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11932.675107][ C2] ? next_expiry_recalc+0xcd/0x220 [11932.675368][ C2] __run_timers.part.0+0x52d/0x890 [11932.675628][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11932.675897][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11932.676182][ C2] ? lock_acquire+0x1c1/0x220 [11932.676421][ C2] ? clockevents_program_event+0xf6/0x300 [11932.676711][ C2] ? lock_release+0x1d5/0x250 [11932.676948][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11932.677215][ C2] ? ktime_get+0xb3/0x190 [11932.677437][ C2] ? clockevents_program_event+0x1ea/0x300 [11932.677733][ C2] run_timer_softirq+0x72/0x100 [11932.677979][ C2] __do_softirq+0x1b9/0x7ff [11932.678213][ C2] irq_exit_rcu+0x98/0xc0 [11932.678433][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11932.678721][ C2] [11932.678869][ C2] [11932.679021][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11932.679324][ C2] RIP: 0010:default_idle+0xf/0x20 [11932.679584][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11932.680558][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11932.680865][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11932.681265][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11932.681664][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11932.682062][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11932.682461][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11932.682863][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11932.683158][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11932.683418][ C2] default_idle_call+0x69/0xa0 [11932.683661][ C2] cpuidle_idle_call+0x1f6/0x280 [11932.683912][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11932.684190][ C2] ? lock_release+0x1d5/0x250 [11932.684429][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11932.684702][ C2] do_idle+0xfb/0x160 [11932.684906][ C2] cpu_startup_entry+0x55/0x60 [11932.685149][ C2] start_secondary+0x21c/0x2b0 [11932.685393][ C2] ? __pfx_start_secondary+0x10/0x10 [11932.685661][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11932.685971][ C2] [11960.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8948s! [swapper/2:0] [11960.569713][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11960.570970][ C2] irq event stamp: 44114564 [11960.571201][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11960.571738][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [11960.572247][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [11960.572722][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [11960.573212][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11960.573668][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11960.574278][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11960.574604][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11960.575576][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11960.575881][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11960.576281][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11960.576679][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11960.577077][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11960.577478][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11960.577879][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11960.578326][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11960.578661][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11960.579060][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11960.579458][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11960.579863][ C2] PKRU: 55555554 [11960.580044][ C2] Call Trace: [11960.580215][ C2] [11960.580365][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [11960.580629][ C2] ? __run_hrtimer+0x1c0/0x710 [11960.580872][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [11960.581154][ C2] ? __hrtimer_run_queues+0x197/0x270 [11960.581430][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [11960.581718][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11960.581986][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11960.582291][ C2] ? hrtimer_interrupt+0x2c3/0x770 [11960.582553][ C2] ? trace_rcu_dyntick+0x10a/0x150 [11960.582814][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11960.583132][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [11960.583430][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11960.583745][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11960.584033][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11960.584331][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11960.584619][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11960.584929][ C2] ? get_stack_info+0x36/0xc0 [11960.585173][ C2] ? lock_acquire+0x1c1/0x220 [11960.585415][ C2] ? lock_release+0x1d5/0x250 [11960.585654][ C2] do_raw_spin_lock+0x1ec/0x270 [11960.585902][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11960.586175][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11960.586458][ C2] ? lock_acquire+0x1c1/0x220 [11960.586698][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11960.586940][ C2] _raw_spin_lock_nested+0x65/0x80 [11960.587201][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11960.587434][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11960.587681][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11960.587942][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11960.588219][ C2] ip_local_deliver_finish+0x2ae/0x480 [11960.588497][ C2] ip_local_deliver+0x19d/0x480 [11960.588743][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11960.589014][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11960.589278][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11960.589625][ C2] ? rcu_read_lock_held+0xe/0x50 [11960.589878][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11960.590198][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11960.590462][ C2] ip_rcv+0x564/0x740 [11960.590667][ C2] ? __pfx_ip_rcv+0x10/0x10 [11960.590897][ C2] ? set_track_prepare+0x8a/0xd0 [11960.591152][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11960.591426][ C2] ? start_secondary+0x21c/0x2b0 [11960.591679][ C2] ? skb_clone+0x10b/0x330 [11960.591908][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11960.592228][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11960.592534][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11960.592814][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11960.593115][ C2] ? __tcf_classify+0x329/0x7d0 [11960.593362][ C2] ? __pfx_ip_rcv+0x10/0x10 [11960.593593][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11960.593893][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11960.594177][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11960.594500][ C2] ? lock_acquire+0x1c1/0x220 [11960.594739][ C2] ? netif_receive_skb_internal+0x84/0x300 [11960.595035][ C2] netif_receive_skb_internal+0xb0/0x300 [11960.595322][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11960.595638][ C2] ? __copy_skb_header+0xaf/0x490 [11960.595897][ C2] ? __skb_clone+0x57a/0x760 [11960.596132][ C2] netif_receive_skb+0x55/0x280 [11960.596380][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11960.596691][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11960.597024][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11960.597322][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11960.597596][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11960.597886][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11960.598196][ C2] ? get_stack_info+0x36/0xc0 [11960.598436][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11960.598700][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11960.599018][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11960.599295][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11960.599572][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11960.599887][ C2] ? kernel_text_address+0x17/0xe0 [11960.600148][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11960.600463][ C2] ? arch_stack_walk+0x8c/0x100 [11960.600712][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11960.600975][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11960.601259][ C2] ? lock_acquire+0x1c1/0x220 [11960.601498][ C2] ? stack_depot_save_flags+0x281/0x550 [11960.601779][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11960.602086][ C2] ? get_stack_info_noinstr+0x18/0x110 [11960.602362][ C2] ? get_stack_info+0x36/0xc0 [11960.602601][ C2] __tcf_classify+0x329/0x7d0 [11960.602844][ C2] tcf_classify+0x283/0x930 [11960.603085][ C2] ? __pfx_tcf_classify+0x10/0x10 [11960.603341][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11960.603653][ C2] tc_run+0x2e4/0x5d0 [11960.603862][ C2] ? __pfx_tc_run+0x10/0x10 [11960.604090][ C2] ? lock_acquire+0x1c1/0x220 [11960.604330][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11960.604590][ C2] __dev_queue_xmit+0x686/0x17e0 [11960.604843][ C2] ? lock_acquire+0x1c1/0x220 [11960.605083][ C2] ? ip_finish_output2+0x786/0x18e0 [11960.605347][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11960.605650][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11960.605921][ C2] ? neigh_hh_output+0x348/0x590 [11960.606174][ C2] ? ip_finish_output2+0x262/0x18e0 [11960.606439][ C2] ip_finish_output2+0x786/0x18e0 [11960.606696][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11960.607031][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11960.607306][ C2] ? rcu_read_lock_held+0xe/0x50 [11960.607557][ C2] ? __ip_finish_output+0x10f/0x770 [11960.607823][ C2] ip_output+0x16b/0x4f0 [11960.608040][ C2] ? __pfx_ip_output+0x10/0x10 [11960.608283][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11960.608559][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11960.608871][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11960.609148][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11960.609399][ C2] ? __alloc_skb+0xd4/0x280 [11960.609630][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11960.609900][ C2] ? tcp_fragment+0x168/0x1040 [11960.610145][ C2] ? rcu_read_lock_held+0xe/0x50 [11960.610397][ C2] ? ip_local_out+0x114/0x3b0 [11960.610635][ C2] __ip_queue_xmit+0x672/0x1910 [11960.610882][ C2] ? __skb_clone+0x57a/0x760 [11960.611117][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11960.611385][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11960.611665][ C2] ? ipv4_dst_check+0xe3/0x170 [11960.611908][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11960.612158][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11960.612460][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11960.612780][ C2] ? tcp_fragment+0xb0e/0x1040 [11960.613030][ C2] tcp_send_loss_probe+0x348/0x830 [11960.613291][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11960.613563][ C2] tcp_write_timer+0x82/0x1d0 [11960.613804][ C2] call_timer_fn+0x173/0x430 [11960.614039][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11960.614303][ C2] ? next_expiry_recalc+0xcd/0x220 [11960.614565][ C2] __run_timers.part.0+0x52d/0x890 [11960.614826][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11960.615096][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11960.615379][ C2] ? lock_acquire+0x1c1/0x220 [11960.615618][ C2] ? clockevents_program_event+0xf6/0x300 [11960.615909][ C2] ? lock_release+0x1d5/0x250 [11960.616149][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11960.616415][ C2] ? ktime_get+0xb3/0x190 [11960.616637][ C2] ? clockevents_program_event+0x1ea/0x300 [11960.616931][ C2] run_timer_softirq+0x72/0x100 [11960.617180][ C2] __do_softirq+0x1b9/0x7ff [11960.617414][ C2] irq_exit_rcu+0x98/0xc0 [11960.617633][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11960.617921][ C2] [11960.618070][ C2] [11960.618221][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11960.618523][ C2] RIP: 0010:default_idle+0xf/0x20 [11960.618780][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11960.619746][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11960.620055][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11960.620454][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11960.620854][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11960.621251][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11960.621647][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11960.622047][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11960.622337][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11960.622598][ C2] default_idle_call+0x69/0xa0 [11960.622842][ C2] cpuidle_idle_call+0x1f6/0x280 [11960.623107][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11960.623383][ C2] ? lock_release+0x1d5/0x250 [11960.623623][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11960.623895][ C2] do_idle+0xfb/0x160 [11960.624098][ C2] cpu_startup_entry+0x55/0x60 [11960.624341][ C2] start_secondary+0x21c/0x2b0 [11960.624586][ C2] ? __pfx_start_secondary+0x10/0x10 [11960.624853][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11960.625166][ C2] [11960.625323][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8948s! [perl:4135] [11960.625753][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [11960.627052][ C1] irq event stamp: 209232 [11960.627280][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [11960.627830][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [11960.628336][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [11960.628825][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [11960.629307][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11960.629776][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11960.630433][ C1] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [11960.630766][ C1] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [11960.631776][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [11960.632100][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11960.632517][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11960.632932][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11960.633358][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11960.633774][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11960.634189][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11960.634654][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11960.635001][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11960.635424][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11960.635843][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11960.636260][ C1] PKRU: 55555554 [11960.636450][ C1] Call Trace: [11960.636630][ C1] [11960.636785][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [11960.637060][ C1] ? __run_hrtimer+0x1c0/0x710 [11960.637316][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [11960.637605][ C1] ? __hrtimer_run_queues+0x197/0x270 [11960.637892][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11960.638195][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11960.638471][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11960.638789][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11960.639063][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11960.639386][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11960.639694][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11960.640021][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11960.640324][ C1] ? queued_spin_lock_slowpath+0xa3/0xb90 [11960.640624][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11960.640926][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11960.641253][ C1] ? get_stack_info+0x36/0xc0 [11960.641505][ C1] ? lock_acquire+0x1c1/0x220 [11960.641755][ C1] ? lock_release+0x1d5/0x250 [11960.642006][ C1] do_raw_spin_lock+0x1ec/0x270 [11960.642266][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11960.642550][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11960.642846][ C1] ? lock_acquire+0x1c1/0x220 [11960.643125][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11960.643375][ C1] _raw_spin_lock_nested+0x65/0x80 [11960.643649][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11960.643892][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11960.644150][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11960.644417][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11960.644706][ C1] ip_local_deliver_finish+0x2ae/0x480 [11960.644993][ C1] ip_local_deliver+0x19d/0x480 [11960.645250][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11960.645531][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11960.645804][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11960.646165][ C1] ? rcu_read_lock_held+0xe/0x50 [11960.646426][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11960.646757][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11960.647029][ C1] ip_rcv+0x564/0x740 [11960.647243][ C1] ? __pfx_ip_rcv+0x10/0x10 [11960.647481][ C1] ? set_track_prepare+0x8a/0xd0 [11960.647743][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11960.648030][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11960.648317][ C1] ? skb_clone+0x10b/0x330 [11960.648550][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11960.648880][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11960.649199][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11960.649490][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11960.649797][ C1] ? __tcf_classify+0x329/0x7d0 [11960.650056][ C1] ? __pfx_ip_rcv+0x10/0x10 [11960.650293][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11960.650606][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11960.650902][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11960.651241][ C1] ? lock_acquire+0x1c1/0x220 [11960.651487][ C1] ? netif_receive_skb_internal+0x84/0x300 [11960.651795][ C1] netif_receive_skb_internal+0xb0/0x300 [11960.652090][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11960.652419][ C1] ? __copy_skb_header+0xaf/0x490 [11960.652685][ C1] ? __skb_clone+0x57a/0x760 [11960.652929][ C1] netif_receive_skb+0x55/0x280 [11960.653195][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11960.653518][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11960.653862][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11960.654172][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11960.654459][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11960.654757][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11960.655081][ C1] ? hlock_class+0x4e/0x130 [11960.655322][ C1] ? get_stack_info_noinstr+0x18/0x110 [11960.655609][ C1] ? get_stack_info_noinstr+0x18/0x110 [11960.655895][ C1] ? __pfx_validate_chain+0x10/0x10 [11960.656169][ C1] ? hlock_class+0x4e/0x130 [11960.656409][ C1] ? mark_lock+0x38/0x3e0 [11960.656635][ C1] ? stack_access_ok+0xda/0x1f0 [11960.656894][ C1] ? __lock_acquire+0xb67/0x1610 [11960.657157][ C1] ? get_stack_info_noinstr+0x18/0x110 [11960.657444][ C1] ? get_stack_info+0x36/0xc0 [11960.657694][ C1] ? stack_access_ok+0xda/0x1f0 [11960.657949][ C1] ? get_reg+0x119/0x190 [11960.658174][ C1] ? unwind_next_frame+0x12af/0x1d10 [11960.658452][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11960.658772][ C1] __tcf_classify+0x329/0x7d0 [11960.659024][ C1] tcf_classify+0x283/0x930 [11960.659266][ C1] ? arch_stack_walk+0xa2/0x100 [11960.659524][ C1] ? __pfx_tcf_classify+0x10/0x10 [11960.659790][ C1] ? get_stack_info+0x36/0xc0 [11960.660038][ C1] tc_run+0x2e4/0x5d0 [11960.660253][ C1] ? __pfx_tc_run+0x10/0x10 [11960.660511][ C1] ? lock_acquire+0x1c1/0x220 [11960.660756][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11960.661030][ C1] __dev_queue_xmit+0x686/0x17e0 [11960.661294][ C1] ? lock_acquire+0x1c1/0x220 [11960.661543][ C1] ? ip_finish_output2+0x786/0x18e0 [11960.661818][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11960.662141][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11960.662417][ C1] ? neigh_hh_output+0x348/0x590 [11960.662678][ C1] ? ip_finish_output2+0x262/0x18e0 [11960.662952][ C1] ip_finish_output2+0x786/0x18e0 [11960.663224][ C1] ? stack_depot_save_flags+0x45/0x550 [11960.663512][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11960.663863][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11960.664151][ C1] ? rcu_read_lock_held+0xe/0x50 [11960.664414][ C1] ? __ip_finish_output+0x10f/0x770 [11960.664689][ C1] ip_output+0x16b/0x4f0 [11960.664913][ C1] ? run_timer_softirq+0x72/0x100 [11960.665179][ C1] ? __pfx_ip_output+0x10/0x10 [11960.665431][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11960.665728][ C1] ? rcu_read_lock_held+0xe/0x50 [11960.665988][ C1] ? ip_local_out+0x114/0x3b0 [11960.666239][ C1] __ip_queue_xmit+0x672/0x1910 [11960.666497][ C1] ? __create_object+0x5e/0xb0 [11960.666753][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11960.667030][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11960.667322][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11960.667607][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11960.667898][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11960.668179][ C1] tcp_delack_timer+0x84/0x240 [11960.668433][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11960.668713][ C1] call_timer_fn+0x173/0x430 [11960.668960][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11960.669231][ C1] ? next_expiry_recalc+0xcd/0x220 [11960.669502][ C1] __run_timers.part.0+0x52d/0x890 [11960.669773][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11960.670055][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11960.670353][ C1] ? lock_acquire+0x1c1/0x220 [11960.670601][ C1] ? clockevents_program_event+0xf6/0x300 [11960.670902][ C1] ? lock_release+0x1d5/0x250 [11960.671176][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11960.671446][ C1] ? ktime_get+0xb3/0x190 [11960.671674][ C1] ? clockevents_program_event+0x1ea/0x300 [11960.671983][ C1] run_timer_softirq+0x72/0x100 [11960.672241][ C1] __do_softirq+0x1b9/0x7ff [11960.672486][ C1] irq_exit_rcu+0x98/0xc0 [11960.672715][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11960.673022][ C1] [11960.673182][ C1] [11960.673337][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11960.673654][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11960.673990][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11960.674997][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11960.675318][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11960.675730][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11960.676143][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11960.676558][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11960.676969][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11960.677383][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11960.677691][ C1] pipe_read+0xa16/0xdf0 [11960.677919][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11960.678208][ C1] ? __pfx_pipe_read+0x10/0x10 [11960.678460][ C1] ? iterate_tty_write+0x299/0x540 [11960.678735][ C1] ? lock_release+0x1d5/0x250 [11960.678985][ C1] vfs_read+0x911/0xc00 [11960.679208][ C1] ? lock_acquire+0x1c1/0x220 [11960.679456][ C1] ? __might_fault+0xc6/0x180 [11960.679707][ C1] ? __pfx_vfs_read+0x10/0x10 [11960.679954][ C1] ? __might_fault+0xc6/0x180 [11960.680201][ C1] ? lock_release+0x1d5/0x250 [11960.680450][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11960.680722][ C1] ? __fget_light+0x54/0x1e0 [11960.680969][ C1] ksys_read+0x17a/0x1e0 [11960.681193][ C1] ? __pfx_ksys_read+0x10/0x10 [11960.681447][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11960.681763][ C1] do_syscall_64+0xc9/0x1e0 [11960.682004][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11960.682314][ C1] RIP: 0033:0x7f08a1ea38b2 [11960.682551][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11960.683563][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11960.684001][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11960.684416][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11960.684826][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11960.685237][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11960.685649][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11960.686065][ C1] [11985.424105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [11985.424488][ C1] rcu: 1-....: (9317048 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2258109 [11985.425052][ C1] rcu: (t=9630537 jiffies g=1882453 q=730 ncpus=4) [11985.425388][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [11985.425838][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11985.426465][ C1] RIP: 0010:queued_spin_lock_slowpath+0xc2/0xb90 [11985.426795][ C1] Code: 41 83 e4 07 49 01 c5 41 83 c4 03 be 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c 08 84 c0 0f 85 42 09 00 00 <8b> 5d 00 85 db 75 62 be 04 00 00 00 48 89 ef e8 ca 35 0c fe 89 d8 [11985.427769][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000246 [11985.428080][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11985.428482][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [11985.428882][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [11985.429286][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [11985.429688][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [11985.430088][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [11985.430536][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11985.430869][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [11985.431273][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11985.431674][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11985.432073][ C1] PKRU: 55555554 [11985.432257][ C1] Call Trace: [11985.432430][ C1] [11985.432586][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [11985.432868][ C1] ? print_cpu_stall+0x263/0x6a0 [11985.433122][ C1] ? check_cpu_stall+0x284/0x500 [11985.433375][ C1] ? rcu_pending+0x92/0x360 [11985.433608][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [11985.433879][ C1] ? update_process_times+0xb9/0x110 [11985.434152][ C1] ? tick_sched_handle+0x67/0x130 [11985.434411][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [11985.434698][ C1] ? __run_hrtimer+0x1c0/0x710 [11985.434940][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [11985.435254][ C1] ? __hrtimer_run_queues+0x197/0x270 [11985.435529][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [11985.435819][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11985.436086][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [11985.436394][ C1] ? hrtimer_interrupt+0x2c3/0x770 [11985.436658][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [11985.436971][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [11985.437269][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11985.437587][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11985.437878][ C1] ? queued_spin_lock_slowpath+0xc2/0xb90 [11985.438167][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [11985.438459][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11985.438778][ C1] ? get_stack_info+0x36/0xc0 [11985.439020][ C1] ? lock_acquire+0x1c1/0x220 [11985.439264][ C1] ? lock_release+0x1d5/0x250 [11985.439506][ C1] do_raw_spin_lock+0x1ec/0x270 [11985.439757][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [11985.440030][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11985.440317][ C1] ? lock_acquire+0x1c1/0x220 [11985.440557][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [11985.440801][ C1] _raw_spin_lock_nested+0x65/0x80 [11985.441063][ C1] tcp_v4_rcv+0x221e/0x2ac0 [11985.441299][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [11985.441546][ C1] ? __pfx_raw_v4_input+0x10/0x10 [11985.441805][ C1] ip_protocol_deliver_rcu+0x93/0x360 [11985.442085][ C1] ip_local_deliver_finish+0x2ae/0x480 [11985.442363][ C1] ip_local_deliver+0x19d/0x480 [11985.442612][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [11985.442903][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [11985.443168][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11985.443521][ C1] ? rcu_read_lock_held+0xe/0x50 [11985.443776][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11985.444099][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11985.444364][ C1] ip_rcv+0x564/0x740 [11985.444569][ C1] ? __pfx_ip_rcv+0x10/0x10 [11985.444801][ C1] ? set_track_prepare+0x8a/0xd0 [11985.445055][ C1] ? __pfx_set_track_prepare+0x10/0x10 [11985.445335][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [11985.445609][ C1] ? skb_clone+0x10b/0x330 [11985.445839][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11985.446160][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11985.446467][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [11985.446753][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [11985.447048][ C1] ? __tcf_classify+0x329/0x7d0 [11985.447300][ C1] ? __pfx_ip_rcv+0x10/0x10 [11985.447532][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [11985.447835][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11985.448122][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11985.448448][ C1] ? lock_acquire+0x1c1/0x220 [11985.448687][ C1] ? netif_receive_skb_internal+0x84/0x300 [11985.448984][ C1] netif_receive_skb_internal+0xb0/0x300 [11985.449271][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11985.449589][ C1] ? __copy_skb_header+0xaf/0x490 [11985.449850][ C1] ? __skb_clone+0x57a/0x760 [11985.450085][ C1] netif_receive_skb+0x55/0x280 [11985.450333][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11985.450648][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11985.450981][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [11985.451282][ C1] tcf_action_exec.part.0+0x112/0x3d0 [11985.451557][ C1] fl_classify+0x4dc/0x650 [cls_flower] [11985.451846][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11985.452160][ C1] ? hlock_class+0x4e/0x130 [11985.452396][ C1] ? get_stack_info_noinstr+0x18/0x110 [11985.452677][ C1] ? get_stack_info_noinstr+0x18/0x110 [11985.452960][ C1] ? __pfx_validate_chain+0x10/0x10 [11985.453226][ C1] ? hlock_class+0x4e/0x130 [11985.453458][ C1] ? mark_lock+0x38/0x3e0 [11985.453679][ C1] ? stack_access_ok+0xda/0x1f0 [11985.453927][ C1] ? __lock_acquire+0xb67/0x1610 [11985.454183][ C1] ? get_stack_info_noinstr+0x18/0x110 [11985.454463][ C1] ? get_stack_info+0x36/0xc0 [11985.454703][ C1] ? stack_access_ok+0xda/0x1f0 [11985.454951][ C1] ? get_reg+0x119/0x190 [11985.455170][ C1] ? unwind_next_frame+0x12af/0x1d10 [11985.455439][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11985.455750][ C1] __tcf_classify+0x329/0x7d0 [11985.455991][ C1] tcf_classify+0x283/0x930 [11985.456237][ C1] ? arch_stack_walk+0xa2/0x100 [11985.456488][ C1] ? __pfx_tcf_classify+0x10/0x10 [11985.456744][ C1] ? get_stack_info+0x36/0xc0 [11985.456990][ C1] tc_run+0x2e4/0x5d0 [11985.457197][ C1] ? __pfx_tc_run+0x10/0x10 [11985.457431][ C1] ? lock_acquire+0x1c1/0x220 [11985.457670][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [11985.457931][ C1] __dev_queue_xmit+0x686/0x17e0 [11985.458185][ C1] ? lock_acquire+0x1c1/0x220 [11985.458425][ C1] ? ip_finish_output2+0x786/0x18e0 [11985.458691][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11985.458999][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [11985.459272][ C1] ? neigh_hh_output+0x348/0x590 [11985.459526][ C1] ? ip_finish_output2+0x262/0x18e0 [11985.459791][ C1] ip_finish_output2+0x786/0x18e0 [11985.460048][ C1] ? stack_depot_save_flags+0x45/0x550 [11985.460327][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11985.460668][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [11985.460944][ C1] ? rcu_read_lock_held+0xe/0x50 [11985.461197][ C1] ? __ip_finish_output+0x10f/0x770 [11985.461463][ C1] ip_output+0x16b/0x4f0 [11985.461679][ C1] ? run_timer_softirq+0x72/0x100 [11985.461936][ C1] ? __pfx_ip_output+0x10/0x10 [11985.462180][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11985.462468][ C1] ? rcu_read_lock_held+0xe/0x50 [11985.462720][ C1] ? ip_local_out+0x114/0x3b0 [11985.462964][ C1] __ip_queue_xmit+0x672/0x1910 [11985.463214][ C1] ? __create_object+0x5e/0xb0 [11985.463458][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [11985.463727][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [11985.464008][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [11985.464284][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [11985.464566][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11985.464837][ C1] tcp_delack_timer+0x84/0x240 [11985.465082][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11985.465354][ C1] call_timer_fn+0x173/0x430 [11985.465592][ C1] ? __pfx_call_timer_fn+0x10/0x10 [11985.465854][ C1] ? next_expiry_recalc+0xcd/0x220 [11985.466114][ C1] __run_timers.part.0+0x52d/0x890 [11985.466375][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [11985.466650][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [11985.466935][ C1] ? lock_acquire+0x1c1/0x220 [11985.467175][ C1] ? clockevents_program_event+0xf6/0x300 [11985.467465][ C1] ? lock_release+0x1d5/0x250 [11985.467706][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11985.467970][ C1] ? ktime_get+0xb3/0x190 [11985.468192][ C1] ? clockevents_program_event+0x1ea/0x300 [11985.468490][ C1] run_timer_softirq+0x72/0x100 [11985.468739][ C1] __do_softirq+0x1b9/0x7ff [11985.468974][ C1] irq_exit_rcu+0x98/0xc0 [11985.469195][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [11985.469482][ C1] [11985.469633][ C1] [11985.469783][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11985.470089][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [11985.470415][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [11985.471388][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [11985.471698][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [11985.472097][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [11985.472498][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [11985.472905][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [11985.473305][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [11985.473706][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [11985.474004][ C1] pipe_read+0xa16/0xdf0 [11985.474225][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [11985.474507][ C1] ? __pfx_pipe_read+0x10/0x10 [11985.474749][ C1] ? iterate_tty_write+0x299/0x540 [11985.475013][ C1] ? lock_release+0x1d5/0x250 [11985.475254][ C1] vfs_read+0x911/0xc00 [11985.475470][ C1] ? lock_acquire+0x1c1/0x220 [11985.475708][ C1] ? __might_fault+0xc6/0x180 [11985.475952][ C1] ? __pfx_vfs_read+0x10/0x10 [11985.476193][ C1] ? __might_fault+0xc6/0x180 [11985.476432][ C1] ? lock_release+0x1d5/0x250 [11985.476671][ C1] ? kvm_clock_get_cycles+0x18/0x30 [11985.476935][ C1] ? __fget_light+0x54/0x1e0 [11985.477175][ C1] ksys_read+0x17a/0x1e0 [11985.477393][ C1] ? __pfx_ksys_read+0x10/0x10 [11985.477638][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [11985.477942][ C1] do_syscall_64+0xc9/0x1e0 [11985.478177][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [11985.478476][ C1] RIP: 0033:0x7f08a1ea38b2 [11985.478709][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [11985.479682][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [11985.480107][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [11985.480508][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [11985.480907][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [11985.481306][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [11985.481706][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [11985.482109][ C1] [11985.482266][ C1] Sending NMI from CPU 1 to CPUs 2: [11985.482547][ C2] NMI backtrace for cpu 2 [11985.482554][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [11985.482561][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [11985.482565][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [11985.482575][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [11985.482581][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [11985.482584][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [11985.482586][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [11985.482588][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [11985.482589][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [11985.482591][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [11985.482593][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [11985.482595][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [11985.482598][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [11985.482600][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [11985.482601][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [11985.482603][ C2] PKRU: 55555554 [11985.482604][ C2] Call Trace: [11985.482606][ C2] [11985.482609][ C2] ? nmi_cpu_backtrace+0x112/0x220 [11985.482617][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [11985.482623][ C2] ? nmi_handle+0x153/0x420 [11985.482629][ C2] ? default_do_nmi+0x41/0x100 [11985.482632][ C2] ? exc_nmi+0xf3/0x120 [11985.482635][ C2] ? end_repeat_nmi+0xf/0x60 [11985.482640][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [11985.482643][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11985.482647][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11985.482650][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [11985.482653][ C2] [11985.482654][ C2] [11985.482656][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [11985.482659][ C2] ? get_stack_info+0x36/0xc0 [11985.482663][ C2] ? lock_acquire+0x1c1/0x220 [11985.482667][ C2] ? lock_release+0x1d5/0x250 [11985.482670][ C2] do_raw_spin_lock+0x1ec/0x270 [11985.482674][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [11985.482677][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11985.482680][ C2] ? lock_acquire+0x1c1/0x220 [11985.482682][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [11985.482686][ C2] _raw_spin_lock_nested+0x65/0x80 [11985.482690][ C2] tcp_v4_rcv+0x221e/0x2ac0 [11985.482696][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [11985.482698][ C2] ? __pfx_raw_v4_input+0x10/0x10 [11985.482703][ C2] ip_protocol_deliver_rcu+0x93/0x360 [11985.482709][ C2] ip_local_deliver_finish+0x2ae/0x480 [11985.482712][ C2] ip_local_deliver+0x19d/0x480 [11985.482715][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [11985.482717][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [11985.482720][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [11985.482725][ C2] ? rcu_read_lock_held+0xe/0x50 [11985.482729][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [11985.482732][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [11985.482741][ C2] ip_rcv+0x564/0x740 [11985.482744][ C2] ? __pfx_ip_rcv+0x10/0x10 [11985.482747][ C2] ? set_track_prepare+0x8a/0xd0 [11985.482751][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11985.482754][ C2] ? start_secondary+0x21c/0x2b0 [11985.482758][ C2] ? skb_clone+0x10b/0x330 [11985.482762][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [11985.482768][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [11985.482774][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [11985.482778][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [11985.482786][ C2] ? __tcf_classify+0x329/0x7d0 [11985.482789][ C2] ? __pfx_ip_rcv+0x10/0x10 [11985.482792][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [11985.482796][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11985.482799][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [11985.482804][ C2] ? lock_acquire+0x1c1/0x220 [11985.482806][ C2] ? netif_receive_skb_internal+0x84/0x300 [11985.482810][ C2] netif_receive_skb_internal+0xb0/0x300 [11985.482814][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [11985.482818][ C2] ? __copy_skb_header+0xaf/0x490 [11985.482823][ C2] ? __skb_clone+0x57a/0x760 [11985.482826][ C2] netif_receive_skb+0x55/0x280 [11985.482830][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [11985.482837][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [11985.482852][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [11985.482859][ C2] tcf_action_exec.part.0+0x112/0x3d0 [11985.482864][ C2] fl_classify+0x4dc/0x650 [cls_flower] [11985.482874][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [11985.482882][ C2] ? get_stack_info+0x36/0xc0 [11985.482887][ C2] ? unwind_next_frame+0x1cc/0x1d10 [11985.482890][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11985.482895][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11985.482898][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [11985.482901][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [11985.482903][ C2] ? kernel_text_address+0x17/0xe0 [11985.482906][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11985.482911][ C2] ? arch_stack_walk+0x8c/0x100 [11985.482915][ C2] ? do_raw_spin_trylock+0xb9/0x190 [11985.482918][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [11985.482922][ C2] ? lock_acquire+0x1c1/0x220 [11985.482924][ C2] ? stack_depot_save_flags+0x281/0x550 [11985.482928][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11985.482933][ C2] ? get_stack_info_noinstr+0x18/0x110 [11985.482936][ C2] ? get_stack_info+0x36/0xc0 [11985.482941][ C2] __tcf_classify+0x329/0x7d0 [11985.482946][ C2] tcf_classify+0x283/0x930 [11985.482950][ C2] ? __pfx_tcf_classify+0x10/0x10 [11985.482953][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [11985.482958][ C2] tc_run+0x2e4/0x5d0 [11985.482961][ C2] ? __pfx_tc_run+0x10/0x10 [11985.482964][ C2] ? lock_acquire+0x1c1/0x220 [11985.482966][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [11985.482971][ C2] __dev_queue_xmit+0x686/0x17e0 [11985.482975][ C2] ? lock_acquire+0x1c1/0x220 [11985.482977][ C2] ? ip_finish_output2+0x786/0x18e0 [11985.482981][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [11985.482984][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [11985.482987][ C2] ? neigh_hh_output+0x348/0x590 [11985.482990][ C2] ? ip_finish_output2+0x262/0x18e0 [11985.482994][ C2] ip_finish_output2+0x786/0x18e0 [11985.482997][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [11985.483005][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [11985.483008][ C2] ? rcu_read_lock_held+0xe/0x50 [11985.483012][ C2] ? __ip_finish_output+0x10f/0x770 [11985.483015][ C2] ip_output+0x16b/0x4f0 [11985.483018][ C2] ? __pfx_ip_output+0x10/0x10 [11985.483021][ C2] ? __pfx_set_track_prepare+0x10/0x10 [11985.483024][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11985.483028][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [11985.483031][ C2] ? kmalloc_reserve+0x11c/0x1f0 [11985.483033][ C2] ? __alloc_skb+0xd4/0x280 [11985.483036][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [11985.483041][ C2] ? tcp_fragment+0x168/0x1040 [11985.483044][ C2] ? rcu_read_lock_held+0xe/0x50 [11985.483047][ C2] ? ip_local_out+0x114/0x3b0 [11985.483050][ C2] __ip_queue_xmit+0x672/0x1910 [11985.483054][ C2] ? __skb_clone+0x57a/0x760 [11985.483057][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [11985.483062][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [11985.483065][ C2] ? ipv4_dst_check+0xe3/0x170 [11985.483069][ C2] ? __sk_dst_check+0x1a1/0x2b0 [11985.483074][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [11985.483078][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [11985.483081][ C2] ? tcp_fragment+0xb0e/0x1040 [11985.483085][ C2] tcp_send_loss_probe+0x348/0x830 [11985.483088][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11985.483090][ C2] tcp_write_timer+0x82/0x1d0 [11985.483093][ C2] call_timer_fn+0x173/0x430 [11985.483097][ C2] ? __pfx_call_timer_fn+0x10/0x10 [11985.483102][ C2] ? next_expiry_recalc+0xcd/0x220 [11985.483106][ C2] __run_timers.part.0+0x52d/0x890 [11985.483109][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [11985.483113][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [11985.483116][ C2] ? lock_acquire+0x1c1/0x220 [11985.483119][ C2] ? clockevents_program_event+0xf6/0x300 [11985.483123][ C2] ? lock_release+0x1d5/0x250 [11985.483126][ C2] ? kvm_clock_get_cycles+0x18/0x30 [11985.483129][ C2] ? ktime_get+0xb3/0x190 [11985.483132][ C2] ? clockevents_program_event+0x1ea/0x300 [11985.483137][ C2] run_timer_softirq+0x72/0x100 [11985.483140][ C2] __do_softirq+0x1b9/0x7ff [11985.483145][ C2] irq_exit_rcu+0x98/0xc0 [11985.483147][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [11985.483151][ C2] [11985.483151][ C2] [11985.483152][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [11985.483156][ C2] RIP: 0010:default_idle+0xf/0x20 [11985.483159][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [11985.483162][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [11985.483164][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [11985.483165][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [11985.483167][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [11985.483169][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [11985.483170][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [11985.483173][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [11985.483177][ C2] ? cpuidle_idle_call+0x1f6/0x280 [11985.483180][ C2] default_idle_call+0x69/0xa0 [11985.483183][ C2] cpuidle_idle_call+0x1f6/0x280 [11985.483187][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [11985.483191][ C2] ? lock_release+0x1d5/0x250 [11985.483193][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [11985.483197][ C2] do_idle+0xfb/0x160 [11985.483200][ C2] cpu_startup_entry+0x55/0x60 [11985.483202][ C2] start_secondary+0x21c/0x2b0 [11985.483205][ C2] ? __pfx_start_secondary+0x10/0x10 [11985.483209][ C2] secondary_startup_64_no_verify+0x16d/0x17b [11985.483215][ C2] [12012.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 8996s! [perl:4135] [12012.569707][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12012.570962][ C1] irq event stamp: 209232 [12012.571183][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12012.571716][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12012.572194][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12012.572665][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12012.573137][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12012.573586][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12012.574200][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12012.574527][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12012.575500][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12012.575807][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12012.576211][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12012.576609][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12012.577010][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12012.577410][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12012.577812][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12012.578261][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12012.578595][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12012.578997][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12012.579398][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12012.579800][ C1] PKRU: 55555554 [12012.579982][ C1] Call Trace: [12012.580153][ C1] [12012.580304][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12012.580567][ C1] ? __run_hrtimer+0x1c0/0x710 [12012.580812][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12012.581090][ C1] ? __hrtimer_run_queues+0x197/0x270 [12012.581365][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12012.581654][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12012.581920][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12012.582226][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12012.582490][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12012.582810][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12012.583108][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12012.583429][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12012.583718][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12012.584016][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12012.584304][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12012.584618][ C1] ? get_stack_info+0x36/0xc0 [12012.584860][ C1] ? lock_acquire+0x1c1/0x220 [12012.585103][ C1] ? lock_release+0x1d5/0x250 [12012.585343][ C1] do_raw_spin_lock+0x1ec/0x270 [12012.585592][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12012.585869][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12012.586155][ C1] ? lock_acquire+0x1c1/0x220 [12012.586395][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12012.586637][ C1] _raw_spin_lock_nested+0x65/0x80 [12012.586898][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12012.587132][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12012.587381][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12012.587641][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12012.587916][ C1] ip_local_deliver_finish+0x2ae/0x480 [12012.588197][ C1] ip_local_deliver+0x19d/0x480 [12012.588446][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12012.588719][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12012.588984][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12012.589334][ C1] ? rcu_read_lock_held+0xe/0x50 [12012.589588][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12012.589909][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12012.590174][ C1] ip_rcv+0x564/0x740 [12012.590380][ C1] ? __pfx_ip_rcv+0x10/0x10 [12012.590612][ C1] ? set_track_prepare+0x8a/0xd0 [12012.590867][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12012.591145][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12012.591424][ C1] ? skb_clone+0x10b/0x330 [12012.591651][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12012.591972][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12012.592280][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12012.592561][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12012.592869][ C1] ? __tcf_classify+0x329/0x7d0 [12012.593119][ C1] ? __pfx_ip_rcv+0x10/0x10 [12012.593350][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12012.593651][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12012.593936][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12012.594265][ C1] ? lock_acquire+0x1c1/0x220 [12012.594506][ C1] ? netif_receive_skb_internal+0x84/0x300 [12012.594805][ C1] netif_receive_skb_internal+0xb0/0x300 [12012.595090][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12012.595409][ C1] ? __copy_skb_header+0xaf/0x490 [12012.595668][ C1] ? __skb_clone+0x57a/0x760 [12012.595904][ C1] netif_receive_skb+0x55/0x280 [12012.596154][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12012.596468][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12012.596807][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12012.597105][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12012.597382][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12012.597672][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12012.597985][ C1] ? hlock_class+0x4e/0x130 [12012.598219][ C1] ? get_stack_info_noinstr+0x18/0x110 [12012.598497][ C1] ? get_stack_info_noinstr+0x18/0x110 [12012.598773][ C1] ? __pfx_validate_chain+0x10/0x10 [12012.599038][ C1] ? hlock_class+0x4e/0x130 [12012.599271][ C1] ? mark_lock+0x38/0x3e0 [12012.599491][ C1] ? stack_access_ok+0xda/0x1f0 [12012.599740][ C1] ? __lock_acquire+0xb67/0x1610 [12012.599995][ C1] ? get_stack_info_noinstr+0x18/0x110 [12012.600272][ C1] ? get_stack_info+0x36/0xc0 [12012.600514][ C1] ? stack_access_ok+0xda/0x1f0 [12012.600764][ C1] ? get_reg+0x119/0x190 [12012.600980][ C1] ? unwind_next_frame+0x12af/0x1d10 [12012.601249][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12012.601559][ C1] __tcf_classify+0x329/0x7d0 [12012.601801][ C1] tcf_classify+0x283/0x930 [12012.602035][ C1] ? arch_stack_walk+0xa2/0x100 [12012.602285][ C1] ? __pfx_tcf_classify+0x10/0x10 [12012.602542][ C1] ? get_stack_info+0x36/0xc0 [12012.602792][ C1] tc_run+0x2e4/0x5d0 [12012.602999][ C1] ? __pfx_tc_run+0x10/0x10 [12012.603234][ C1] ? lock_acquire+0x1c1/0x220 [12012.603477][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12012.603738][ C1] __dev_queue_xmit+0x686/0x17e0 [12012.603992][ C1] ? lock_acquire+0x1c1/0x220 [12012.604232][ C1] ? ip_finish_output2+0x786/0x18e0 [12012.604498][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12012.604804][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12012.605078][ C1] ? neigh_hh_output+0x348/0x590 [12012.605332][ C1] ? ip_finish_output2+0x262/0x18e0 [12012.605598][ C1] ip_finish_output2+0x786/0x18e0 [12012.605856][ C1] ? stack_depot_save_flags+0x45/0x550 [12012.606134][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12012.606471][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12012.606755][ C1] ? rcu_read_lock_held+0xe/0x50 [12012.607009][ C1] ? __ip_finish_output+0x10f/0x770 [12012.607275][ C1] ip_output+0x16b/0x4f0 [12012.607492][ C1] ? run_timer_softirq+0x72/0x100 [12012.607749][ C1] ? __pfx_ip_output+0x10/0x10 [12012.607994][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12012.608280][ C1] ? rcu_read_lock_held+0xe/0x50 [12012.608532][ C1] ? ip_local_out+0x114/0x3b0 [12012.608774][ C1] __ip_queue_xmit+0x672/0x1910 [12012.609023][ C1] ? __create_object+0x5e/0xb0 [12012.609268][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12012.609536][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12012.609818][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12012.610094][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12012.610382][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12012.610655][ C1] tcp_delack_timer+0x84/0x240 [12012.610901][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12012.611174][ C1] call_timer_fn+0x173/0x430 [12012.611411][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12012.611673][ C1] ? next_expiry_recalc+0xcd/0x220 [12012.611936][ C1] __run_timers.part.0+0x52d/0x890 [12012.612197][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12012.612471][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12012.612766][ C1] ? lock_acquire+0x1c1/0x220 [12012.613003][ C1] ? clockevents_program_event+0xf6/0x300 [12012.613297][ C1] ? lock_release+0x1d5/0x250 [12012.613538][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12012.613805][ C1] ? ktime_get+0xb3/0x190 [12012.614025][ C1] ? clockevents_program_event+0x1ea/0x300 [12012.614325][ C1] run_timer_softirq+0x72/0x100 [12012.614575][ C1] __do_softirq+0x1b9/0x7ff [12012.614807][ C1] irq_exit_rcu+0x98/0xc0 [12012.615030][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12012.615316][ C1] [12012.615471][ C1] [12012.615621][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12012.615930][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12012.616256][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12012.617231][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12012.617539][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12012.617939][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12012.618338][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12012.618738][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12012.619139][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12012.619541][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12012.619839][ C1] pipe_read+0xa16/0xdf0 [12012.620060][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12012.620340][ C1] ? __pfx_pipe_read+0x10/0x10 [12012.620584][ C1] ? iterate_tty_write+0x299/0x540 [12012.620846][ C1] ? lock_release+0x1d5/0x250 [12012.621088][ C1] vfs_read+0x911/0xc00 [12012.621304][ C1] ? lock_acquire+0x1c1/0x220 [12012.621543][ C1] ? __might_fault+0xc6/0x180 [12012.621786][ C1] ? __pfx_vfs_read+0x10/0x10 [12012.622025][ C1] ? __might_fault+0xc6/0x180 [12012.622265][ C1] ? lock_release+0x1d5/0x250 [12012.622506][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12012.622777][ C1] ? __fget_light+0x54/0x1e0 [12012.623017][ C1] ksys_read+0x17a/0x1e0 [12012.623235][ C1] ? __pfx_ksys_read+0x10/0x10 [12012.623480][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12012.623786][ C1] do_syscall_64+0xc9/0x1e0 [12012.624018][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12012.624320][ C1] RIP: 0033:0x7f08a1ea38b2 [12012.624550][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12012.625522][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12012.625943][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12012.626344][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12012.626745][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12012.627145][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12012.627543][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12012.627947][ C1] [12012.628106][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 8996s! [swapper/2:0] [12012.628548][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12012.629809][ C2] irq event stamp: 44114564 [12012.630040][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12012.630577][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12012.631090][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12012.631571][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12012.632043][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12012.632500][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12012.633122][ C2] RIP: 0010:kasan_check_range+0x106/0x1c0 [12012.633413][ C2] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [12012.634384][ C2] RSP: 0018:ffffc9000021fa78 EFLAGS: 00000246 [12012.634695][ C2] RAX: ffffed100147436c RBX: ffffed100147436c RCX: ffffffff97c7eb80 [12012.635095][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12012.635496][ C2] RBP: ffffed100147436b R08: 0000000000000000 R09: ffffed100147436b [12012.635893][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12012.636292][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12012.636692][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12012.637140][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12012.637474][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12012.637873][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12012.638272][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12012.638671][ C2] PKRU: 55555554 [12012.638852][ C2] Call Trace: [12012.639025][ C2] [12012.639174][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12012.639437][ C2] ? __run_hrtimer+0x1c0/0x710 [12012.639680][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12012.639957][ C2] ? __hrtimer_run_queues+0x197/0x270 [12012.640230][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12012.640516][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12012.640782][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12012.641087][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12012.641345][ C2] ? hrtimer_interrupt+0x31a/0x770 [12012.641605][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12012.641866][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12012.642179][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12012.642476][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12012.642801][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12012.643088][ C2] ? kasan_check_range+0x106/0x1c0 [12012.643349][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [12012.643631][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12012.643940][ C2] ? get_stack_info+0x36/0xc0 [12012.644180][ C2] ? lock_acquire+0x1c1/0x220 [12012.644422][ C2] ? lock_release+0x1d5/0x250 [12012.644661][ C2] do_raw_spin_lock+0x1ec/0x270 [12012.644910][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12012.645183][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12012.645466][ C2] ? lock_acquire+0x1c1/0x220 [12012.645704][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12012.645946][ C2] _raw_spin_lock_nested+0x65/0x80 [12012.646206][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12012.646440][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12012.646685][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12012.646942][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12012.647221][ C2] ip_local_deliver_finish+0x2ae/0x480 [12012.647496][ C2] ip_local_deliver+0x19d/0x480 [12012.647743][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12012.648014][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12012.648277][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12012.648625][ C2] ? rcu_read_lock_held+0xe/0x50 [12012.648879][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12012.649199][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12012.649461][ C2] ip_rcv+0x564/0x740 [12012.649666][ C2] ? __pfx_ip_rcv+0x10/0x10 [12012.649894][ C2] ? set_track_prepare+0x8a/0xd0 [12012.650149][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12012.650426][ C2] ? start_secondary+0x21c/0x2b0 [12012.650678][ C2] ? skb_clone+0x10b/0x330 [12012.650904][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12012.651224][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12012.651531][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12012.651811][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12012.652107][ C2] ? __tcf_classify+0x329/0x7d0 [12012.652356][ C2] ? __pfx_ip_rcv+0x10/0x10 [12012.652585][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12012.652897][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12012.653183][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12012.653507][ C2] ? lock_acquire+0x1c1/0x220 [12012.653746][ C2] ? netif_receive_skb_internal+0x84/0x300 [12012.654044][ C2] netif_receive_skb_internal+0xb0/0x300 [12012.654328][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12012.654646][ C2] ? __copy_skb_header+0xaf/0x490 [12012.654902][ C2] ? __skb_clone+0x57a/0x760 [12012.655137][ C2] netif_receive_skb+0x55/0x280 [12012.655385][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12012.655694][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12012.656026][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12012.656325][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12012.656598][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12012.656887][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12012.657200][ C2] ? get_stack_info+0x36/0xc0 [12012.657438][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12012.657704][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12012.658021][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12012.658299][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12012.658575][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12012.658889][ C2] ? kernel_text_address+0x17/0xe0 [12012.659150][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12012.659464][ C2] ? arch_stack_walk+0x8c/0x100 [12012.659715][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12012.659978][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12012.660262][ C2] ? lock_acquire+0x1c1/0x220 [12012.660502][ C2] ? stack_depot_save_flags+0x281/0x550 [12012.660783][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12012.661087][ C2] ? get_stack_info_noinstr+0x18/0x110 [12012.661365][ C2] ? get_stack_info+0x36/0xc0 [12012.661603][ C2] __tcf_classify+0x329/0x7d0 [12012.661844][ C2] tcf_classify+0x283/0x930 [12012.662077][ C2] ? __pfx_tcf_classify+0x10/0x10 [12012.662333][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12012.662645][ C2] tc_run+0x2e4/0x5d0 [12012.662858][ C2] ? __pfx_tc_run+0x10/0x10 [12012.663087][ C2] ? lock_acquire+0x1c1/0x220 [12012.663326][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12012.663586][ C2] __dev_queue_xmit+0x686/0x17e0 [12012.663838][ C2] ? lock_acquire+0x1c1/0x220 [12012.664076][ C2] ? ip_finish_output2+0x786/0x18e0 [12012.664341][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12012.664645][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12012.664915][ C2] ? neigh_hh_output+0x348/0x590 [12012.665168][ C2] ? ip_finish_output2+0x262/0x18e0 [12012.665432][ C2] ip_finish_output2+0x786/0x18e0 [12012.665688][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12012.666024][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12012.666301][ C2] ? rcu_read_lock_held+0xe/0x50 [12012.666553][ C2] ? __ip_finish_output+0x10f/0x770 [12012.666817][ C2] ip_output+0x16b/0x4f0 [12012.667033][ C2] ? __pfx_ip_output+0x10/0x10 [12012.667277][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12012.667552][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12012.667864][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12012.668140][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12012.668390][ C2] ? __alloc_skb+0xd4/0x280 [12012.668622][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12012.668891][ C2] ? tcp_fragment+0x168/0x1040 [12012.669136][ C2] ? rcu_read_lock_held+0xe/0x50 [12012.669388][ C2] ? ip_local_out+0x114/0x3b0 [12012.669628][ C2] __ip_queue_xmit+0x672/0x1910 [12012.669874][ C2] ? __skb_clone+0x57a/0x760 [12012.670109][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12012.670374][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12012.670656][ C2] ? ipv4_dst_check+0xe3/0x170 [12012.670900][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12012.671149][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12012.671450][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12012.671770][ C2] ? tcp_fragment+0xb0e/0x1040 [12012.672015][ C2] tcp_send_loss_probe+0x348/0x830 [12012.672276][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12012.672544][ C2] tcp_write_timer+0x82/0x1d0 [12012.672793][ C2] call_timer_fn+0x173/0x430 [12012.673030][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12012.673293][ C2] ? next_expiry_recalc+0xcd/0x220 [12012.673559][ C2] __run_timers.part.0+0x52d/0x890 [12012.673819][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12012.674088][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12012.674373][ C2] ? lock_acquire+0x1c1/0x220 [12012.674612][ C2] ? clockevents_program_event+0xf6/0x300 [12012.674904][ C2] ? lock_release+0x1d5/0x250 [12012.675141][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12012.675406][ C2] ? ktime_get+0xb3/0x190 [12012.675628][ C2] ? clockevents_program_event+0x1ea/0x300 [12012.675923][ C2] run_timer_softirq+0x72/0x100 [12012.676171][ C2] __do_softirq+0x1b9/0x7ff [12012.676405][ C2] irq_exit_rcu+0x98/0xc0 [12012.676623][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12012.676910][ C2] [12012.677059][ C2] [12012.677212][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12012.677514][ C2] RIP: 0010:default_idle+0xf/0x20 [12012.677773][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12012.678741][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12012.679046][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12012.679448][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12012.679845][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12012.680244][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12012.680641][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12012.681046][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12012.681335][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12012.681596][ C2] default_idle_call+0x69/0xa0 [12012.681840][ C2] cpuidle_idle_call+0x1f6/0x280 [12012.682092][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12012.682369][ C2] ? lock_release+0x1d5/0x250 [12012.682607][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12012.682888][ C2] do_idle+0xfb/0x160 [12012.683090][ C2] cpu_startup_entry+0x55/0x60 [12012.683334][ C2] start_secondary+0x21c/0x2b0 [12012.683578][ C2] ? __pfx_start_secondary+0x10/0x10 [12012.683847][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12012.684158][ C2] [12040.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9022s! [swapper/2:0] [12040.569701][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12040.570957][ C2] irq event stamp: 44114564 [12040.571188][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12040.571721][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12040.572230][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12040.572715][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12040.573185][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12040.573641][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12040.574254][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12040.574578][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12040.575548][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12040.575855][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12040.576254][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12040.576651][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12040.577050][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12040.577449][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12040.577849][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12040.578295][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12040.578625][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12040.579024][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12040.579425][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12040.579822][ C2] PKRU: 55555554 [12040.580005][ C2] Call Trace: [12040.580177][ C2] [12040.580325][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12040.580587][ C2] ? __run_hrtimer+0x1c0/0x710 [12040.580831][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12040.581106][ C2] ? __hrtimer_run_queues+0x197/0x270 [12040.581376][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12040.581666][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12040.581930][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12040.582237][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12040.582497][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12040.582768][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12040.583077][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12040.583370][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12040.583684][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12040.583974][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12040.584267][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12040.584557][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12040.584868][ C2] ? get_stack_info+0x36/0xc0 [12040.585108][ C2] ? lock_acquire+0x1c1/0x220 [12040.585348][ C2] ? lock_release+0x1d5/0x250 [12040.585588][ C2] do_raw_spin_lock+0x1ec/0x270 [12040.585837][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12040.586108][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12040.586393][ C2] ? lock_acquire+0x1c1/0x220 [12040.586630][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12040.586871][ C2] _raw_spin_lock_nested+0x65/0x80 [12040.587131][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12040.587366][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12040.587613][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12040.587874][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12040.588149][ C2] ip_local_deliver_finish+0x2ae/0x480 [12040.588427][ C2] ip_local_deliver+0x19d/0x480 [12040.588674][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12040.588944][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12040.589207][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12040.589558][ C2] ? rcu_read_lock_held+0xe/0x50 [12040.589811][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12040.590131][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12040.590394][ C2] ip_rcv+0x564/0x740 [12040.590598][ C2] ? __pfx_ip_rcv+0x10/0x10 [12040.590828][ C2] ? set_track_prepare+0x8a/0xd0 [12040.591083][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12040.591360][ C2] ? start_secondary+0x21c/0x2b0 [12040.591611][ C2] ? skb_clone+0x10b/0x330 [12040.591838][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12040.592158][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12040.592463][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12040.592751][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12040.593047][ C2] ? __tcf_classify+0x329/0x7d0 [12040.593297][ C2] ? __pfx_ip_rcv+0x10/0x10 [12040.593525][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12040.593825][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12040.594109][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12040.594434][ C2] ? lock_acquire+0x1c1/0x220 [12040.594671][ C2] ? netif_receive_skb_internal+0x84/0x300 [12040.594970][ C2] netif_receive_skb_internal+0xb0/0x300 [12040.595254][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12040.595570][ C2] ? __copy_skb_header+0xaf/0x490 [12040.595828][ C2] ? __skb_clone+0x57a/0x760 [12040.596063][ C2] netif_receive_skb+0x55/0x280 [12040.596312][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12040.596624][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12040.596957][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12040.597254][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12040.597531][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12040.597818][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12040.598131][ C2] ? get_stack_info+0x36/0xc0 [12040.598372][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12040.598638][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12040.598955][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12040.599231][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12040.599506][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12040.599822][ C2] ? kernel_text_address+0x17/0xe0 [12040.600082][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12040.600395][ C2] ? arch_stack_walk+0x8c/0x100 [12040.600648][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12040.600911][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12040.601197][ C2] ? lock_acquire+0x1c1/0x220 [12040.601433][ C2] ? stack_depot_save_flags+0x281/0x550 [12040.601718][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12040.602021][ C2] ? get_stack_info_noinstr+0x18/0x110 [12040.602300][ C2] ? get_stack_info+0x36/0xc0 [12040.602539][ C2] __tcf_classify+0x329/0x7d0 [12040.602788][ C2] tcf_classify+0x283/0x930 [12040.603022][ C2] ? __pfx_tcf_classify+0x10/0x10 [12040.603278][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12040.603597][ C2] tc_run+0x2e4/0x5d0 [12040.603804][ C2] ? __pfx_tc_run+0x10/0x10 [12040.604035][ C2] ? lock_acquire+0x1c1/0x220 [12040.604273][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12040.604535][ C2] __dev_queue_xmit+0x686/0x17e0 [12040.604787][ C2] ? lock_acquire+0x1c1/0x220 [12040.605026][ C2] ? ip_finish_output2+0x786/0x18e0 [12040.605290][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12040.605594][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12040.605865][ C2] ? neigh_hh_output+0x348/0x590 [12040.606118][ C2] ? ip_finish_output2+0x262/0x18e0 [12040.606382][ C2] ip_finish_output2+0x786/0x18e0 [12040.606637][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12040.606975][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12040.607252][ C2] ? rcu_read_lock_held+0xe/0x50 [12040.607505][ C2] ? __ip_finish_output+0x10f/0x770 [12040.607768][ C2] ip_output+0x16b/0x4f0 [12040.607985][ C2] ? __pfx_ip_output+0x10/0x10 [12040.608228][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12040.608503][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12040.608814][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12040.609093][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12040.609348][ C2] ? __alloc_skb+0xd4/0x280 [12040.609578][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12040.609846][ C2] ? tcp_fragment+0x168/0x1040 [12040.610091][ C2] ? rcu_read_lock_held+0xe/0x50 [12040.610342][ C2] ? ip_local_out+0x114/0x3b0 [12040.610583][ C2] __ip_queue_xmit+0x672/0x1910 [12040.610831][ C2] ? __skb_clone+0x57a/0x760 [12040.611065][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12040.611333][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12040.611615][ C2] ? ipv4_dst_check+0xe3/0x170 [12040.611860][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12040.612109][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12040.612408][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12040.612738][ C2] ? tcp_fragment+0xb0e/0x1040 [12040.612982][ C2] tcp_send_loss_probe+0x348/0x830 [12040.613241][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12040.613507][ C2] tcp_write_timer+0x82/0x1d0 [12040.613748][ C2] call_timer_fn+0x173/0x430 [12040.613987][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12040.614249][ C2] ? next_expiry_recalc+0xcd/0x220 [12040.614510][ C2] __run_timers.part.0+0x52d/0x890 [12040.614771][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12040.615039][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12040.615328][ C2] ? lock_acquire+0x1c1/0x220 [12040.615565][ C2] ? clockevents_program_event+0xf6/0x300 [12040.615858][ C2] ? lock_release+0x1d5/0x250 [12040.616097][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12040.616362][ C2] ? ktime_get+0xb3/0x190 [12040.616581][ C2] ? clockevents_program_event+0x1ea/0x300 [12040.616877][ C2] run_timer_softirq+0x72/0x100 [12040.617125][ C2] __do_softirq+0x1b9/0x7ff [12040.617355][ C2] irq_exit_rcu+0x98/0xc0 [12040.617577][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12040.617860][ C2] [12040.618010][ C2] [12040.618162][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12040.618466][ C2] RIP: 0010:default_idle+0xf/0x20 [12040.618722][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12040.619689][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12040.619996][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12040.620395][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12040.620792][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12040.621190][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12040.621589][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12040.621988][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12040.622276][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12040.622536][ C2] default_idle_call+0x69/0xa0 [12040.622788][ C2] cpuidle_idle_call+0x1f6/0x280 [12040.623040][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12040.623317][ C2] ? lock_release+0x1d5/0x250 [12040.623555][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12040.623828][ C2] do_idle+0xfb/0x160 [12040.624032][ C2] cpu_startup_entry+0x55/0x60 [12040.624275][ C2] start_secondary+0x21c/0x2b0 [12040.624518][ C2] ? __pfx_start_secondary+0x10/0x10 [12040.624788][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12040.625098][ C2] [12040.625258][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9022s! [perl:4135] [12040.625686][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12040.626943][ C1] irq event stamp: 209232 [12040.627168][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12040.627699][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12040.628176][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12040.628649][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12040.629113][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12040.629562][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12040.630175][ C1] RIP: 0010:kasan_check_range+0x106/0x1c0 [12040.630469][ C1] Code: 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 0f 84 4c ff ff ff 41 83 e2 07 49 39 d1 0f 85 34 ff ff ff 45 3a 11 0f 8d 2b ff ff ff <5b> b8 01 00 00 00 5d 41 5c c3 cc cc cc cc 41 bc 08 00 00 00 45 29 [12040.631446][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000246 [12040.631755][ C1] RAX: ffffed10014741c4 RBX: ffffed10014741c4 RCX: ffffffff97c7eb80 [12040.632155][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12040.632554][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [12040.632966][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12040.633365][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12040.633764][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12040.634216][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12040.634548][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12040.634955][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12040.635356][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12040.635756][ C1] PKRU: 55555554 [12040.635938][ C1] Call Trace: [12040.636111][ C1] [12040.636260][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12040.636522][ C1] ? __run_hrtimer+0x1c0/0x710 [12040.636767][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12040.637043][ C1] ? __hrtimer_run_queues+0x197/0x270 [12040.637322][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12040.637611][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12040.637879][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12040.638187][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12040.638454][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12040.638765][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12040.639059][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12040.639376][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12040.639667][ C1] ? kasan_check_range+0x106/0x1c0 [12040.639927][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [12040.640209][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12040.640521][ C1] ? get_stack_info+0x36/0xc0 [12040.640763][ C1] ? lock_acquire+0x1c1/0x220 [12040.641005][ C1] ? lock_release+0x1d5/0x250 [12040.641244][ C1] do_raw_spin_lock+0x1ec/0x270 [12040.641493][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12040.641766][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12040.642052][ C1] ? lock_acquire+0x1c1/0x220 [12040.642292][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12040.642532][ C1] _raw_spin_lock_nested+0x65/0x80 [12040.642799][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12040.643035][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12040.643284][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12040.643542][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12040.643819][ C1] ip_local_deliver_finish+0x2ae/0x480 [12040.644098][ C1] ip_local_deliver+0x19d/0x480 [12040.644345][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12040.644619][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12040.644883][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12040.645231][ C1] ? rcu_read_lock_held+0xe/0x50 [12040.645485][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12040.645808][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12040.646071][ C1] ip_rcv+0x564/0x740 [12040.646275][ C1] ? __pfx_ip_rcv+0x10/0x10 [12040.646507][ C1] ? set_track_prepare+0x8a/0xd0 [12040.646761][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12040.647037][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12040.647310][ C1] ? skb_clone+0x10b/0x330 [12040.647541][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12040.647861][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12040.648168][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12040.648450][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12040.648745][ C1] ? __tcf_classify+0x329/0x7d0 [12040.648993][ C1] ? __pfx_ip_rcv+0x10/0x10 [12040.649227][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12040.649528][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12040.649812][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12040.650138][ C1] ? lock_acquire+0x1c1/0x220 [12040.650377][ C1] ? netif_receive_skb_internal+0x84/0x300 [12040.650674][ C1] netif_receive_skb_internal+0xb0/0x300 [12040.650960][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12040.651282][ C1] ? __copy_skb_header+0xaf/0x490 [12040.651540][ C1] ? __skb_clone+0x57a/0x760 [12040.651776][ C1] netif_receive_skb+0x55/0x280 [12040.652024][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12040.652337][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12040.652675][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12040.652975][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12040.653252][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12040.653542][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12040.653855][ C1] ? hlock_class+0x4e/0x130 [12040.654088][ C1] ? get_stack_info_noinstr+0x18/0x110 [12040.654365][ C1] ? get_stack_info_noinstr+0x18/0x110 [12040.654644][ C1] ? __pfx_validate_chain+0x10/0x10 [12040.654908][ C1] ? hlock_class+0x4e/0x130 [12040.655139][ C1] ? mark_lock+0x38/0x3e0 [12040.655360][ C1] ? stack_access_ok+0xda/0x1f0 [12040.655610][ C1] ? __lock_acquire+0xb67/0x1610 [12040.655866][ C1] ? get_stack_info_noinstr+0x18/0x110 [12040.656142][ C1] ? get_stack_info+0x36/0xc0 [12040.656384][ C1] ? stack_access_ok+0xda/0x1f0 [12040.656631][ C1] ? get_reg+0x119/0x190 [12040.656846][ C1] ? unwind_next_frame+0x12af/0x1d10 [12040.657115][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12040.657428][ C1] __tcf_classify+0x329/0x7d0 [12040.657672][ C1] tcf_classify+0x283/0x930 [12040.657903][ C1] ? arch_stack_walk+0xa2/0x100 [12040.658153][ C1] ? __pfx_tcf_classify+0x10/0x10 [12040.658410][ C1] ? get_stack_info+0x36/0xc0 [12040.658651][ C1] tc_run+0x2e4/0x5d0 [12040.658857][ C1] ? __pfx_tc_run+0x10/0x10 [12040.659090][ C1] ? lock_acquire+0x1c1/0x220 [12040.659330][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12040.659592][ C1] __dev_queue_xmit+0x686/0x17e0 [12040.659846][ C1] ? lock_acquire+0x1c1/0x220 [12040.660083][ C1] ? ip_finish_output2+0x786/0x18e0 [12040.660350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12040.660655][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12040.660928][ C1] ? neigh_hh_output+0x348/0x590 [12040.661182][ C1] ? ip_finish_output2+0x262/0x18e0 [12040.661449][ C1] ip_finish_output2+0x786/0x18e0 [12040.661706][ C1] ? stack_depot_save_flags+0x45/0x550 [12040.661985][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12040.662323][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12040.662609][ C1] ? rcu_read_lock_held+0xe/0x50 [12040.662865][ C1] ? __ip_finish_output+0x10f/0x770 [12040.663132][ C1] ip_output+0x16b/0x4f0 [12040.663351][ C1] ? run_timer_softirq+0x72/0x100 [12040.663610][ C1] ? __pfx_ip_output+0x10/0x10 [12040.663855][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12040.664142][ C1] ? rcu_read_lock_held+0xe/0x50 [12040.664396][ C1] ? ip_local_out+0x114/0x3b0 [12040.664639][ C1] __ip_queue_xmit+0x672/0x1910 [12040.664889][ C1] ? __create_object+0x5e/0xb0 [12040.665133][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12040.665407][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12040.665690][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12040.665963][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12040.666248][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12040.666522][ C1] tcp_delack_timer+0x84/0x240 [12040.666767][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12040.667039][ C1] call_timer_fn+0x173/0x430 [12040.667278][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12040.667540][ C1] ? next_expiry_recalc+0xcd/0x220 [12040.667803][ C1] __run_timers.part.0+0x52d/0x890 [12040.668065][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12040.668340][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12040.668627][ C1] ? lock_acquire+0x1c1/0x220 [12040.668866][ C1] ? clockevents_program_event+0xf6/0x300 [12040.669162][ C1] ? lock_release+0x1d5/0x250 [12040.669401][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12040.669668][ C1] ? ktime_get+0xb3/0x190 [12040.669890][ C1] ? clockevents_program_event+0x1ea/0x300 [12040.670188][ C1] run_timer_softirq+0x72/0x100 [12040.670437][ C1] __do_softirq+0x1b9/0x7ff [12040.670672][ C1] irq_exit_rcu+0x98/0xc0 [12040.670894][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12040.671180][ C1] [12040.671330][ C1] [12040.671483][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12040.671788][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12040.672114][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12040.673092][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12040.673402][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12040.673804][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12040.674206][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12040.674605][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12040.675006][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12040.675410][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12040.675711][ C1] pipe_read+0xa16/0xdf0 [12040.675934][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12040.676214][ C1] ? __pfx_pipe_read+0x10/0x10 [12040.676459][ C1] ? iterate_tty_write+0x299/0x540 [12040.676722][ C1] ? lock_release+0x1d5/0x250 [12040.676964][ C1] vfs_read+0x911/0xc00 [12040.677178][ C1] ? lock_acquire+0x1c1/0x220 [12040.677419][ C1] ? __might_fault+0xc6/0x180 [12040.677659][ C1] ? __pfx_vfs_read+0x10/0x10 [12040.677898][ C1] ? __might_fault+0xc6/0x180 [12040.678140][ C1] ? lock_release+0x1d5/0x250 [12040.678382][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12040.678647][ C1] ? __fget_light+0x54/0x1e0 [12040.678885][ C1] ksys_read+0x17a/0x1e0 [12040.679103][ C1] ? __pfx_ksys_read+0x10/0x10 [12040.679350][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12040.679655][ C1] do_syscall_64+0xc9/0x1e0 [12040.679888][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12040.680190][ C1] RIP: 0033:0x7f08a1ea38b2 [12040.680418][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12040.681396][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12040.681820][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12040.682221][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12040.682632][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12040.683032][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12040.683433][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12040.683836][ C1] [12063.482104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [12063.482483][ C1] rcu: 1-....: (9394877 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2277291 [12063.483046][ C1] rcu: (t=9708595 jiffies g=1882453 q=730 ncpus=4) [12063.483381][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12063.483831][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12063.484449][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12063.484779][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12063.485751][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12063.486061][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12063.486463][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12063.486862][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12063.487266][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12063.487669][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12063.488069][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12063.488518][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12063.488852][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12063.489257][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12063.489658][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12063.490058][ C1] PKRU: 55555554 [12063.490242][ C1] Call Trace: [12063.490415][ C1] [12063.490564][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [12063.490839][ C1] ? print_cpu_stall+0x263/0x6a0 [12063.491094][ C1] ? check_cpu_stall+0x284/0x500 [12063.491347][ C1] ? rcu_pending+0x92/0x360 [12063.491580][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [12063.491851][ C1] ? update_process_times+0xb9/0x110 [12063.492121][ C1] ? tick_sched_handle+0x67/0x130 [12063.492379][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [12063.492676][ C1] ? __run_hrtimer+0x1c0/0x710 [12063.492918][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [12063.493235][ C1] ? __hrtimer_run_queues+0x197/0x270 [12063.493508][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12063.493798][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12063.494064][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12063.494372][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12063.494636][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12063.494947][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12063.495243][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12063.495560][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12063.495850][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12063.496145][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12063.496437][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12063.496750][ C1] ? get_stack_info+0x36/0xc0 [12063.496990][ C1] ? lock_acquire+0x1c1/0x220 [12063.497233][ C1] ? lock_release+0x1d5/0x250 [12063.497474][ C1] do_raw_spin_lock+0x1ec/0x270 [12063.497724][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12063.497995][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12063.498282][ C1] ? lock_acquire+0x1c1/0x220 [12063.498520][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12063.498763][ C1] _raw_spin_lock_nested+0x65/0x80 [12063.499023][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12063.499261][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12063.499508][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12063.499767][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12063.500044][ C1] ip_local_deliver_finish+0x2ae/0x480 [12063.500322][ C1] ip_local_deliver+0x19d/0x480 [12063.500570][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12063.500845][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12063.501109][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12063.501461][ C1] ? rcu_read_lock_held+0xe/0x50 [12063.501715][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12063.502036][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12063.502301][ C1] ip_rcv+0x564/0x740 [12063.502522][ C1] ? __pfx_ip_rcv+0x10/0x10 [12063.502752][ C1] ? set_track_prepare+0x8a/0xd0 [12063.503006][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12063.503285][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12063.503557][ C1] ? skb_clone+0x10b/0x330 [12063.503787][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12063.504106][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12063.504412][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12063.504697][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12063.504990][ C1] ? __tcf_classify+0x329/0x7d0 [12063.505240][ C1] ? __pfx_ip_rcv+0x10/0x10 [12063.505472][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12063.505771][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12063.506059][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12063.506385][ C1] ? lock_acquire+0x1c1/0x220 [12063.506623][ C1] ? netif_receive_skb_internal+0x84/0x300 [12063.506918][ C1] netif_receive_skb_internal+0xb0/0x300 [12063.507206][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12063.507524][ C1] ? __copy_skb_header+0xaf/0x490 [12063.507783][ C1] ? __skb_clone+0x57a/0x760 [12063.508017][ C1] netif_receive_skb+0x55/0x280 [12063.508266][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12063.508580][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12063.508913][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12063.509213][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12063.509489][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12063.509777][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12063.510090][ C1] ? hlock_class+0x4e/0x130 [12063.510326][ C1] ? get_stack_info_noinstr+0x18/0x110 [12063.510603][ C1] ? get_stack_info_noinstr+0x18/0x110 [12063.510877][ C1] ? __pfx_validate_chain+0x10/0x10 [12063.511143][ C1] ? hlock_class+0x4e/0x130 [12063.511373][ C1] ? mark_lock+0x38/0x3e0 [12063.511595][ C1] ? stack_access_ok+0xda/0x1f0 [12063.511842][ C1] ? __lock_acquire+0xb67/0x1610 [12063.512096][ C1] ? get_stack_info_noinstr+0x18/0x110 [12063.512375][ C1] ? get_stack_info+0x36/0xc0 [12063.512625][ C1] ? stack_access_ok+0xda/0x1f0 [12063.512871][ C1] ? get_reg+0x119/0x190 [12063.513090][ C1] ? unwind_next_frame+0x12af/0x1d10 [12063.513359][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12063.513671][ C1] __tcf_classify+0x329/0x7d0 [12063.513913][ C1] tcf_classify+0x283/0x930 [12063.514148][ C1] ? arch_stack_walk+0xa2/0x100 [12063.514399][ C1] ? __pfx_tcf_classify+0x10/0x10 [12063.514656][ C1] ? get_stack_info+0x36/0xc0 [12063.514900][ C1] tc_run+0x2e4/0x5d0 [12063.515106][ C1] ? __pfx_tc_run+0x10/0x10 [12063.515338][ C1] ? lock_acquire+0x1c1/0x220 [12063.515577][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12063.515839][ C1] __dev_queue_xmit+0x686/0x17e0 [12063.516094][ C1] ? lock_acquire+0x1c1/0x220 [12063.516335][ C1] ? ip_finish_output2+0x786/0x18e0 [12063.516600][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12063.516908][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12063.517181][ C1] ? neigh_hh_output+0x348/0x590 [12063.517435][ C1] ? ip_finish_output2+0x262/0x18e0 [12063.517701][ C1] ip_finish_output2+0x786/0x18e0 [12063.517958][ C1] ? stack_depot_save_flags+0x45/0x550 [12063.518238][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12063.518580][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12063.518857][ C1] ? rcu_read_lock_held+0xe/0x50 [12063.519112][ C1] ? __ip_finish_output+0x10f/0x770 [12063.519379][ C1] ip_output+0x16b/0x4f0 [12063.519597][ C1] ? run_timer_softirq+0x72/0x100 [12063.519856][ C1] ? __pfx_ip_output+0x10/0x10 [12063.520101][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12063.520392][ C1] ? rcu_read_lock_held+0xe/0x50 [12063.520645][ C1] ? ip_local_out+0x114/0x3b0 [12063.520885][ C1] __ip_queue_xmit+0x672/0x1910 [12063.521137][ C1] ? __create_object+0x5e/0xb0 [12063.521384][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12063.521654][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12063.521939][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12063.522215][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12063.522519][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12063.522796][ C1] tcp_delack_timer+0x84/0x240 [12063.523041][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12063.523316][ C1] call_timer_fn+0x173/0x430 [12063.523553][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12063.523815][ C1] ? next_expiry_recalc+0xcd/0x220 [12063.524077][ C1] __run_timers.part.0+0x52d/0x890 [12063.524340][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12063.524618][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12063.524904][ C1] ? lock_acquire+0x1c1/0x220 [12063.525146][ C1] ? clockevents_program_event+0xf6/0x300 [12063.525438][ C1] ? lock_release+0x1d5/0x250 [12063.525680][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12063.525946][ C1] ? ktime_get+0xb3/0x190 [12063.526171][ C1] ? clockevents_program_event+0x1ea/0x300 [12063.526467][ C1] run_timer_softirq+0x72/0x100 [12063.526718][ C1] __do_softirq+0x1b9/0x7ff [12063.526954][ C1] irq_exit_rcu+0x98/0xc0 [12063.527176][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12063.527464][ C1] [12063.527615][ C1] [12063.527765][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12063.528074][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12063.528400][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12063.529379][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12063.529690][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12063.530091][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12063.530496][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12063.530897][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12063.531298][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12063.531699][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12063.531998][ C1] pipe_read+0xa16/0xdf0 [12063.532221][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12063.532512][ C1] ? __pfx_pipe_read+0x10/0x10 [12063.532756][ C1] ? iterate_tty_write+0x299/0x540 [12063.533021][ C1] ? lock_release+0x1d5/0x250 [12063.533262][ C1] vfs_read+0x911/0xc00 [12063.533480][ C1] ? lock_acquire+0x1c1/0x220 [12063.533718][ C1] ? __might_fault+0xc6/0x180 [12063.533962][ C1] ? __pfx_vfs_read+0x10/0x10 [12063.534204][ C1] ? __might_fault+0xc6/0x180 [12063.534446][ C1] ? lock_release+0x1d5/0x250 [12063.534686][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12063.534954][ C1] ? __fget_light+0x54/0x1e0 [12063.535193][ C1] ksys_read+0x17a/0x1e0 [12063.535414][ C1] ? __pfx_ksys_read+0x10/0x10 [12063.535658][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12063.535966][ C1] do_syscall_64+0xc9/0x1e0 [12063.536202][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12063.536504][ C1] RIP: 0033:0x7f08a1ea38b2 [12063.536734][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12063.537714][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12063.538141][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12063.538543][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12063.538945][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12063.539349][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12063.539757][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12063.540163][ C1] [12063.540322][ C1] Sending NMI from CPU 1 to CPUs 2: [12063.540601][ C2] NMI backtrace for cpu 2 [12063.540610][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12063.540617][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12063.540623][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12063.540633][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12063.540637][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12063.540641][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12063.540643][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12063.540645][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12063.540646][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12063.540648][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12063.540650][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12063.540652][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12063.540655][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12063.540657][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12063.540658][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12063.540660][ C2] PKRU: 55555554 [12063.540661][ C2] Call Trace: [12063.540665][ C2] [12063.540669][ C2] ? nmi_cpu_backtrace+0x112/0x220 [12063.540677][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [12063.540684][ C2] ? nmi_handle+0x153/0x420 [12063.540689][ C2] ? default_do_nmi+0x41/0x100 [12063.540693][ C2] ? exc_nmi+0xf3/0x120 [12063.540696][ C2] ? end_repeat_nmi+0xf/0x60 [12063.540703][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12063.540707][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12063.540710][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12063.540713][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12063.540716][ C2] [12063.540717][ C2] [12063.540719][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12063.540721][ C2] ? get_stack_info+0x36/0xc0 [12063.540726][ C2] ? lock_acquire+0x1c1/0x220 [12063.540731][ C2] ? lock_release+0x1d5/0x250 [12063.540735][ C2] do_raw_spin_lock+0x1ec/0x270 [12063.540739][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12063.540742][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12063.540746][ C2] ? lock_acquire+0x1c1/0x220 [12063.540748][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12063.540753][ C2] _raw_spin_lock_nested+0x65/0x80 [12063.540756][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12063.540763][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12063.540765][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12063.540770][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12063.540778][ C2] ip_local_deliver_finish+0x2ae/0x480 [12063.540781][ C2] ip_local_deliver+0x19d/0x480 [12063.540783][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12063.540786][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12063.540788][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12063.540796][ C2] ? rcu_read_lock_held+0xe/0x50 [12063.540801][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12063.540804][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12063.540815][ C2] ip_rcv+0x564/0x740 [12063.540817][ C2] ? __pfx_ip_rcv+0x10/0x10 [12063.540820][ C2] ? set_track_prepare+0x8a/0xd0 [12063.540825][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12063.540828][ C2] ? start_secondary+0x21c/0x2b0 [12063.540833][ C2] ? skb_clone+0x10b/0x330 [12063.540838][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12063.540844][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12063.540849][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12063.540856][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12063.540864][ C2] ? __tcf_classify+0x329/0x7d0 [12063.540869][ C2] ? __pfx_ip_rcv+0x10/0x10 [12063.540871][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12063.540875][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12063.540878][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12063.540883][ C2] ? lock_acquire+0x1c1/0x220 [12063.540885][ C2] ? netif_receive_skb_internal+0x84/0x300 [12063.540889][ C2] netif_receive_skb_internal+0xb0/0x300 [12063.540893][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12063.540897][ C2] ? __copy_skb_header+0xaf/0x490 [12063.540903][ C2] ? __skb_clone+0x57a/0x760 [12063.540906][ C2] netif_receive_skb+0x55/0x280 [12063.540909][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12063.540917][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12063.540924][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12063.540931][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12063.540935][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12063.540946][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12063.540953][ C2] ? get_stack_info+0x36/0xc0 [12063.540958][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12063.540961][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12063.540967][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12063.540969][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12063.540973][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12063.540975][ C2] ? kernel_text_address+0x17/0xe0 [12063.540980][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12063.540986][ C2] ? arch_stack_walk+0x8c/0x100 [12063.540991][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12063.540994][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12063.540997][ C2] ? lock_acquire+0x1c1/0x220 [12063.541000][ C2] ? stack_depot_save_flags+0x281/0x550 [12063.541005][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12063.541011][ C2] ? get_stack_info_noinstr+0x18/0x110 [12063.541014][ C2] ? get_stack_info+0x36/0xc0 [12063.541019][ C2] __tcf_classify+0x329/0x7d0 [12063.541024][ C2] tcf_classify+0x283/0x930 [12063.541028][ C2] ? __pfx_tcf_classify+0x10/0x10 [12063.541031][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12063.541036][ C2] tc_run+0x2e4/0x5d0 [12063.541040][ C2] ? __pfx_tc_run+0x10/0x10 [12063.541044][ C2] ? lock_acquire+0x1c1/0x220 [12063.541046][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12063.541050][ C2] __dev_queue_xmit+0x686/0x17e0 [12063.541054][ C2] ? lock_acquire+0x1c1/0x220 [12063.541057][ C2] ? ip_finish_output2+0x786/0x18e0 [12063.541060][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12063.541064][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12063.541066][ C2] ? neigh_hh_output+0x348/0x590 [12063.541070][ C2] ? ip_finish_output2+0x262/0x18e0 [12063.541074][ C2] ip_finish_output2+0x786/0x18e0 [12063.541078][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12063.541086][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12063.541089][ C2] ? rcu_read_lock_held+0xe/0x50 [12063.541092][ C2] ? __ip_finish_output+0x10f/0x770 [12063.541096][ C2] ip_output+0x16b/0x4f0 [12063.541099][ C2] ? __pfx_ip_output+0x10/0x10 [12063.541102][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12063.541105][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12063.541108][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12063.541112][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12063.541115][ C2] ? __alloc_skb+0xd4/0x280 [12063.541117][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12063.541123][ C2] ? tcp_fragment+0x168/0x1040 [12063.541126][ C2] ? rcu_read_lock_held+0xe/0x50 [12063.541129][ C2] ? ip_local_out+0x114/0x3b0 [12063.541133][ C2] __ip_queue_xmit+0x672/0x1910 [12063.541137][ C2] ? __skb_clone+0x57a/0x760 [12063.541140][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12063.541146][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12063.541149][ C2] ? ipv4_dst_check+0xe3/0x170 [12063.541153][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12063.541159][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12063.541164][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12063.541167][ C2] ? tcp_fragment+0xb0e/0x1040 [12063.541170][ C2] tcp_send_loss_probe+0x348/0x830 [12063.541174][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12063.541177][ C2] tcp_write_timer+0x82/0x1d0 [12063.541180][ C2] call_timer_fn+0x173/0x430 [12063.541186][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12063.541191][ C2] ? next_expiry_recalc+0xcd/0x220 [12063.541195][ C2] __run_timers.part.0+0x52d/0x890 [12063.541198][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12063.541202][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12063.541205][ C2] ? lock_acquire+0x1c1/0x220 [12063.541207][ C2] ? clockevents_program_event+0xf6/0x300 [12063.541214][ C2] ? lock_release+0x1d5/0x250 [12063.541216][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12063.541221][ C2] ? ktime_get+0xb3/0x190 [12063.541225][ C2] ? clockevents_program_event+0x1ea/0x300 [12063.541229][ C2] run_timer_softirq+0x72/0x100 [12063.541232][ C2] __do_softirq+0x1b9/0x7ff [12063.541237][ C2] irq_exit_rcu+0x98/0xc0 [12063.541240][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12063.541245][ C2] [12063.541245][ C2] [12063.541246][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12063.541250][ C2] RIP: 0010:default_idle+0xf/0x20 [12063.541253][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12063.541256][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12063.541258][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12063.541260][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12063.541262][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12063.541263][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12063.541265][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12063.541268][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12063.541271][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12063.541276][ C2] default_idle_call+0x69/0xa0 [12063.541279][ C2] cpuidle_idle_call+0x1f6/0x280 [12063.541282][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12063.541286][ C2] ? lock_release+0x1d5/0x250 [12063.541289][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12063.541294][ C2] do_idle+0xfb/0x160 [12063.541296][ C2] cpu_startup_entry+0x55/0x60 [12063.541299][ C2] start_secondary+0x21c/0x2b0 [12063.541302][ C2] ? __pfx_start_secondary+0x10/0x10 [12063.541306][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12063.541312][ C2] [12088.569271][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9067s! [perl:4135] [12088.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12088.570957][ C1] irq event stamp: 209232 [12088.571177][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12088.571705][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12088.572184][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12088.572657][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12088.573119][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12088.573568][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12088.574187][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12088.574513][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12088.575486][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12088.575795][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12088.576196][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12088.576596][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12088.576996][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12088.577399][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12088.577799][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12088.578246][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12088.578579][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12088.578980][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12088.579383][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12088.579782][ C1] PKRU: 55555554 [12088.579964][ C1] Call Trace: [12088.580137][ C1] [12088.580286][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12088.580549][ C1] ? __run_hrtimer+0x1c0/0x710 [12088.580794][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12088.581071][ C1] ? __hrtimer_run_queues+0x197/0x270 [12088.581344][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12088.581634][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12088.581900][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12088.582209][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12088.582476][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12088.582787][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12088.583083][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12088.583399][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12088.583690][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12088.583986][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12088.584278][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12088.584591][ C1] ? get_stack_info+0x36/0xc0 [12088.584831][ C1] ? lock_acquire+0x1c1/0x220 [12088.585072][ C1] ? lock_release+0x1d5/0x250 [12088.585314][ C1] do_raw_spin_lock+0x1ec/0x270 [12088.585565][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12088.585837][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12088.586122][ C1] ? lock_acquire+0x1c1/0x220 [12088.586363][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12088.586604][ C1] _raw_spin_lock_nested+0x65/0x80 [12088.586868][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12088.587103][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12088.587351][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12088.587610][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12088.587891][ C1] ip_local_deliver_finish+0x2ae/0x480 [12088.588167][ C1] ip_local_deliver+0x19d/0x480 [12088.588416][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12088.588688][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12088.588951][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12088.589302][ C1] ? rcu_read_lock_held+0xe/0x50 [12088.589555][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12088.589875][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12088.590139][ C1] ip_rcv+0x564/0x740 [12088.590346][ C1] ? __pfx_ip_rcv+0x10/0x10 [12088.590575][ C1] ? set_track_prepare+0x8a/0xd0 [12088.590828][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12088.591107][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12088.591380][ C1] ? skb_clone+0x10b/0x330 [12088.591607][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12088.591925][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12088.592233][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12088.592524][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12088.592820][ C1] ? __tcf_classify+0x329/0x7d0 [12088.593070][ C1] ? __pfx_ip_rcv+0x10/0x10 [12088.593301][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12088.593601][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12088.593887][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12088.594214][ C1] ? lock_acquire+0x1c1/0x220 [12088.594453][ C1] ? netif_receive_skb_internal+0x84/0x300 [12088.594750][ C1] netif_receive_skb_internal+0xb0/0x300 [12088.595035][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12088.595353][ C1] ? __copy_skb_header+0xaf/0x490 [12088.595612][ C1] ? __skb_clone+0x57a/0x760 [12088.595847][ C1] netif_receive_skb+0x55/0x280 [12088.596095][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12088.596410][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12088.596741][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12088.597041][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12088.597317][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12088.597604][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12088.597917][ C1] ? hlock_class+0x4e/0x130 [12088.598152][ C1] ? get_stack_info_noinstr+0x18/0x110 [12088.598428][ C1] ? get_stack_info_noinstr+0x18/0x110 [12088.598704][ C1] ? __pfx_validate_chain+0x10/0x10 [12088.598967][ C1] ? hlock_class+0x4e/0x130 [12088.599201][ C1] ? mark_lock+0x38/0x3e0 [12088.599421][ C1] ? stack_access_ok+0xda/0x1f0 [12088.599670][ C1] ? __lock_acquire+0xb67/0x1610 [12088.599924][ C1] ? get_stack_info_noinstr+0x18/0x110 [12088.600203][ C1] ? get_stack_info+0x36/0xc0 [12088.600442][ C1] ? stack_access_ok+0xda/0x1f0 [12088.600691][ C1] ? get_reg+0x119/0x190 [12088.600908][ C1] ? unwind_next_frame+0x12af/0x1d10 [12088.601178][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12088.601487][ C1] __tcf_classify+0x329/0x7d0 [12088.601728][ C1] tcf_classify+0x283/0x930 [12088.601962][ C1] ? arch_stack_walk+0xa2/0x100 [12088.602213][ C1] ? __pfx_tcf_classify+0x10/0x10 [12088.602479][ C1] ? get_stack_info+0x36/0xc0 [12088.602720][ C1] tc_run+0x2e4/0x5d0 [12088.602927][ C1] ? __pfx_tc_run+0x10/0x10 [12088.603158][ C1] ? lock_acquire+0x1c1/0x220 [12088.603398][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12088.603659][ C1] __dev_queue_xmit+0x686/0x17e0 [12088.603913][ C1] ? lock_acquire+0x1c1/0x220 [12088.604153][ C1] ? ip_finish_output2+0x786/0x18e0 [12088.604417][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12088.604723][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12088.604995][ C1] ? neigh_hh_output+0x348/0x590 [12088.605248][ C1] ? ip_finish_output2+0x262/0x18e0 [12088.605514][ C1] ip_finish_output2+0x786/0x18e0 [12088.605770][ C1] ? stack_depot_save_flags+0x45/0x550 [12088.606047][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12088.606388][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12088.606666][ C1] ? rcu_read_lock_held+0xe/0x50 [12088.606920][ C1] ? __ip_finish_output+0x10f/0x770 [12088.607186][ C1] ip_output+0x16b/0x4f0 [12088.607402][ C1] ? run_timer_softirq+0x72/0x100 [12088.607664][ C1] ? __pfx_ip_output+0x10/0x10 [12088.607907][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12088.608196][ C1] ? rcu_read_lock_held+0xe/0x50 [12088.608448][ C1] ? ip_local_out+0x114/0x3b0 [12088.608688][ C1] __ip_queue_xmit+0x672/0x1910 [12088.608937][ C1] ? __create_object+0x5e/0xb0 [12088.609184][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12088.609450][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12088.609733][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12088.610008][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12088.610291][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12088.610562][ C1] tcp_delack_timer+0x84/0x240 [12088.610808][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12088.611079][ C1] call_timer_fn+0x173/0x430 [12088.611317][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12088.611580][ C1] ? next_expiry_recalc+0xcd/0x220 [12088.611841][ C1] __run_timers.part.0+0x52d/0x890 [12088.612102][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12088.612384][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12088.612670][ C1] ? lock_acquire+0x1c1/0x220 [12088.612909][ C1] ? clockevents_program_event+0xf6/0x300 [12088.613201][ C1] ? lock_release+0x1d5/0x250 [12088.613442][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12088.613706][ C1] ? ktime_get+0xb3/0x190 [12088.613927][ C1] ? clockevents_program_event+0x1ea/0x300 [12088.614225][ C1] run_timer_softirq+0x72/0x100 [12088.614473][ C1] __do_softirq+0x1b9/0x7ff [12088.614707][ C1] irq_exit_rcu+0x98/0xc0 [12088.614927][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12088.615213][ C1] [12088.615364][ C1] [12088.615514][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12088.615820][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12088.616144][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12088.617117][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12088.617424][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12088.617823][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12088.618224][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12088.618624][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12088.619022][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12088.619423][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12088.619722][ C1] pipe_read+0xa16/0xdf0 [12088.619943][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12088.620225][ C1] ? __pfx_pipe_read+0x10/0x10 [12088.620466][ C1] ? iterate_tty_write+0x299/0x540 [12088.620730][ C1] ? lock_release+0x1d5/0x250 [12088.620971][ C1] vfs_read+0x911/0xc00 [12088.621186][ C1] ? lock_acquire+0x1c1/0x220 [12088.621424][ C1] ? __might_fault+0xc6/0x180 [12088.621666][ C1] ? __pfx_vfs_read+0x10/0x10 [12088.621906][ C1] ? __might_fault+0xc6/0x180 [12088.622147][ C1] ? lock_release+0x1d5/0x250 [12088.622394][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12088.622659][ C1] ? __fget_light+0x54/0x1e0 [12088.622898][ C1] ksys_read+0x17a/0x1e0 [12088.623116][ C1] ? __pfx_ksys_read+0x10/0x10 [12088.623360][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12088.623666][ C1] do_syscall_64+0xc9/0x1e0 [12088.623900][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12088.624199][ C1] RIP: 0033:0x7f08a1ea38b2 [12088.624429][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12088.625404][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12088.625826][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12088.626227][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12088.626626][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12088.627024][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12088.627426][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12088.627829][ C1] [12088.627987][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9067s! [swapper/2:0] [12088.628431][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12088.629687][ C2] irq event stamp: 44114564 [12088.629914][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12088.630455][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12088.630966][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12088.631444][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12088.631913][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12088.632377][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12088.632988][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12088.633314][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12088.634285][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12088.634594][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12088.634991][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12088.635396][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12088.635793][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12088.636192][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12088.636590][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12088.637037][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12088.637371][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12088.637771][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12088.638169][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12088.638567][ C2] PKRU: 55555554 [12088.638750][ C2] Call Trace: [12088.638922][ C2] [12088.639071][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12088.639334][ C2] ? __run_hrtimer+0x1c0/0x710 [12088.639579][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12088.639856][ C2] ? __hrtimer_run_queues+0x197/0x270 [12088.640130][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12088.640417][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12088.640682][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12088.640987][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12088.641249][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12088.641510][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12088.641822][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12088.642119][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12088.642439][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12088.642728][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12088.643024][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12088.643313][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12088.643624][ C2] ? get_stack_info+0x36/0xc0 [12088.643866][ C2] ? lock_acquire+0x1c1/0x220 [12088.644106][ C2] ? lock_release+0x1d5/0x250 [12088.644344][ C2] do_raw_spin_lock+0x1ec/0x270 [12088.644593][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12088.644863][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12088.645151][ C2] ? lock_acquire+0x1c1/0x220 [12088.645389][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12088.645628][ C2] _raw_spin_lock_nested+0x65/0x80 [12088.645887][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12088.646125][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12088.646371][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12088.646628][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12088.646903][ C2] ip_local_deliver_finish+0x2ae/0x480 [12088.647180][ C2] ip_local_deliver+0x19d/0x480 [12088.647425][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12088.647698][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12088.647962][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12088.648309][ C2] ? rcu_read_lock_held+0xe/0x50 [12088.648562][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12088.648881][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12088.649144][ C2] ip_rcv+0x564/0x740 [12088.649347][ C2] ? __pfx_ip_rcv+0x10/0x10 [12088.649578][ C2] ? set_track_prepare+0x8a/0xd0 [12088.649832][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12088.650107][ C2] ? start_secondary+0x21c/0x2b0 [12088.650359][ C2] ? skb_clone+0x10b/0x330 [12088.650587][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12088.650904][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12088.651209][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12088.651491][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12088.651783][ C2] ? __tcf_classify+0x329/0x7d0 [12088.652032][ C2] ? __pfx_ip_rcv+0x10/0x10 [12088.652263][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12088.652564][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12088.652849][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12088.653175][ C2] ? lock_acquire+0x1c1/0x220 [12088.653413][ C2] ? netif_receive_skb_internal+0x84/0x300 [12088.653707][ C2] netif_receive_skb_internal+0xb0/0x300 [12088.653993][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12088.654309][ C2] ? __copy_skb_header+0xaf/0x490 [12088.654567][ C2] ? __skb_clone+0x57a/0x760 [12088.654800][ C2] netif_receive_skb+0x55/0x280 [12088.655048][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12088.655362][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12088.655692][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12088.655990][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12088.656263][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12088.656550][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12088.656861][ C2] ? get_stack_info+0x36/0xc0 [12088.657102][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12088.657366][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12088.657683][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12088.657958][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12088.658236][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12088.658550][ C2] ? kernel_text_address+0x17/0xe0 [12088.658810][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12088.659124][ C2] ? arch_stack_walk+0x8c/0x100 [12088.659371][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12088.659635][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12088.659920][ C2] ? lock_acquire+0x1c1/0x220 [12088.660159][ C2] ? stack_depot_save_flags+0x281/0x550 [12088.660441][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12088.660747][ C2] ? get_stack_info_noinstr+0x18/0x110 [12088.661025][ C2] ? get_stack_info+0x36/0xc0 [12088.661268][ C2] __tcf_classify+0x329/0x7d0 [12088.661509][ C2] tcf_classify+0x283/0x930 [12088.661741][ C2] ? __pfx_tcf_classify+0x10/0x10 [12088.661996][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12088.662309][ C2] tc_run+0x2e4/0x5d0 [12088.662520][ C2] ? __pfx_tc_run+0x10/0x10 [12088.662751][ C2] ? lock_acquire+0x1c1/0x220 [12088.662990][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12088.663251][ C2] __dev_queue_xmit+0x686/0x17e0 [12088.663504][ C2] ? lock_acquire+0x1c1/0x220 [12088.663740][ C2] ? ip_finish_output2+0x786/0x18e0 [12088.664004][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12088.664307][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12088.664579][ C2] ? neigh_hh_output+0x348/0x590 [12088.664830][ C2] ? ip_finish_output2+0x262/0x18e0 [12088.665096][ C2] ip_finish_output2+0x786/0x18e0 [12088.665353][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12088.665689][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12088.665963][ C2] ? rcu_read_lock_held+0xe/0x50 [12088.666215][ C2] ? __ip_finish_output+0x10f/0x770 [12088.666479][ C2] ip_output+0x16b/0x4f0 [12088.666696][ C2] ? __pfx_ip_output+0x10/0x10 [12088.666939][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12088.667217][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12088.667528][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12088.667805][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12088.668054][ C2] ? __alloc_skb+0xd4/0x280 [12088.668283][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12088.668555][ C2] ? tcp_fragment+0x168/0x1040 [12088.668796][ C2] ? rcu_read_lock_held+0xe/0x50 [12088.669046][ C2] ? ip_local_out+0x114/0x3b0 [12088.669288][ C2] __ip_queue_xmit+0x672/0x1910 [12088.669536][ C2] ? __skb_clone+0x57a/0x760 [12088.669771][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12088.670037][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12088.670317][ C2] ? ipv4_dst_check+0xe3/0x170 [12088.670562][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12088.670812][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12088.671113][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12088.671431][ C2] ? tcp_fragment+0xb0e/0x1040 [12088.671673][ C2] tcp_send_loss_probe+0x348/0x830 [12088.671933][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12088.672203][ C2] tcp_write_timer+0x82/0x1d0 [12088.672446][ C2] call_timer_fn+0x173/0x430 [12088.672685][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12088.672945][ C2] ? next_expiry_recalc+0xcd/0x220 [12088.673210][ C2] __run_timers.part.0+0x52d/0x890 [12088.673468][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12088.673735][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12088.674021][ C2] ? lock_acquire+0x1c1/0x220 [12088.674261][ C2] ? clockevents_program_event+0xf6/0x300 [12088.674551][ C2] ? lock_release+0x1d5/0x250 [12088.674790][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12088.675054][ C2] ? ktime_get+0xb3/0x190 [12088.675273][ C2] ? clockevents_program_event+0x1ea/0x300 [12088.675570][ C2] run_timer_softirq+0x72/0x100 [12088.675819][ C2] __do_softirq+0x1b9/0x7ff [12088.676051][ C2] irq_exit_rcu+0x98/0xc0 [12088.676271][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12088.676556][ C2] [12088.676708][ C2] [12088.676856][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12088.677162][ C2] RIP: 0010:default_idle+0xf/0x20 [12088.677419][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12088.678387][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12088.678694][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12088.679091][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12088.679488][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12088.679888][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12088.680286][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12088.680686][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12088.680976][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12088.681237][ C2] default_idle_call+0x69/0xa0 [12088.681479][ C2] cpuidle_idle_call+0x1f6/0x280 [12088.681729][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12088.682007][ C2] ? lock_release+0x1d5/0x250 [12088.682245][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12088.682528][ C2] do_idle+0xfb/0x160 [12088.682731][ C2] cpu_startup_entry+0x55/0x60 [12088.682974][ C2] start_secondary+0x21c/0x2b0 [12088.683218][ C2] ? __pfx_start_secondary+0x10/0x10 [12088.683488][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12088.683797][ C2] [12116.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9093s! [swapper/2:0] [12116.569707][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12116.570962][ C2] irq event stamp: 44114564 [12116.571192][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12116.571727][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12116.572245][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12116.572719][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12116.573195][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12116.573653][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12116.574266][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12116.574597][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12116.575566][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12116.575874][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12116.576272][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12116.576669][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12116.577066][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12116.577467][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12116.577866][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12116.578312][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12116.578643][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12116.579042][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12116.579443][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12116.579842][ C2] PKRU: 55555554 [12116.580023][ C2] Call Trace: [12116.580198][ C2] [12116.580348][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12116.580610][ C2] ? __run_hrtimer+0x1c0/0x710 [12116.580853][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12116.581129][ C2] ? __hrtimer_run_queues+0x197/0x270 [12116.581400][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12116.581689][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12116.581953][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12116.582263][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12116.582524][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12116.582791][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12116.583100][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12116.583394][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12116.583708][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12116.584000][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12116.584294][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12116.584583][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12116.584893][ C2] ? get_stack_info+0x36/0xc0 [12116.585133][ C2] ? lock_acquire+0x1c1/0x220 [12116.585374][ C2] ? lock_release+0x1d5/0x250 [12116.585612][ C2] do_raw_spin_lock+0x1ec/0x270 [12116.585861][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12116.586133][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12116.586415][ C2] ? lock_acquire+0x1c1/0x220 [12116.586654][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12116.586895][ C2] _raw_spin_lock_nested+0x65/0x80 [12116.587154][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12116.587388][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12116.587634][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12116.587895][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12116.588172][ C2] ip_local_deliver_finish+0x2ae/0x480 [12116.588449][ C2] ip_local_deliver+0x19d/0x480 [12116.588696][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12116.588967][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12116.589230][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12116.589581][ C2] ? rcu_read_lock_held+0xe/0x50 [12116.589834][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12116.590155][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12116.590418][ C2] ip_rcv+0x564/0x740 [12116.590623][ C2] ? __pfx_ip_rcv+0x10/0x10 [12116.590852][ C2] ? set_track_prepare+0x8a/0xd0 [12116.591106][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12116.591384][ C2] ? start_secondary+0x21c/0x2b0 [12116.591634][ C2] ? skb_clone+0x10b/0x330 [12116.591862][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12116.592181][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12116.592491][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12116.592778][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12116.593073][ C2] ? __tcf_classify+0x329/0x7d0 [12116.593321][ C2] ? __pfx_ip_rcv+0x10/0x10 [12116.593550][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12116.593851][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12116.594134][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12116.594458][ C2] ? lock_acquire+0x1c1/0x220 [12116.594697][ C2] ? netif_receive_skb_internal+0x84/0x300 [12116.594994][ C2] netif_receive_skb_internal+0xb0/0x300 [12116.595278][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12116.595593][ C2] ? __copy_skb_header+0xaf/0x490 [12116.595851][ C2] ? __skb_clone+0x57a/0x760 [12116.596085][ C2] netif_receive_skb+0x55/0x280 [12116.596333][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12116.596644][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12116.596976][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12116.597272][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12116.597548][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12116.597835][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12116.598147][ C2] ? get_stack_info+0x36/0xc0 [12116.598387][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12116.598652][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12116.598968][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12116.599245][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12116.599520][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12116.599834][ C2] ? kernel_text_address+0x17/0xe0 [12116.600094][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12116.600407][ C2] ? arch_stack_walk+0x8c/0x100 [12116.600657][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12116.600920][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12116.601204][ C2] ? lock_acquire+0x1c1/0x220 [12116.601442][ C2] ? stack_depot_save_flags+0x281/0x550 [12116.601726][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12116.602030][ C2] ? get_stack_info_noinstr+0x18/0x110 [12116.602317][ C2] ? get_stack_info+0x36/0xc0 [12116.602560][ C2] __tcf_classify+0x329/0x7d0 [12116.602802][ C2] tcf_classify+0x283/0x930 [12116.603035][ C2] ? __pfx_tcf_classify+0x10/0x10 [12116.603296][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12116.603610][ C2] tc_run+0x2e4/0x5d0 [12116.603815][ C2] ? __pfx_tc_run+0x10/0x10 [12116.604044][ C2] ? lock_acquire+0x1c1/0x220 [12116.604282][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12116.604541][ C2] __dev_queue_xmit+0x686/0x17e0 [12116.604793][ C2] ? lock_acquire+0x1c1/0x220 [12116.605032][ C2] ? ip_finish_output2+0x786/0x18e0 [12116.605296][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12116.605599][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12116.605869][ C2] ? neigh_hh_output+0x348/0x590 [12116.606122][ C2] ? ip_finish_output2+0x262/0x18e0 [12116.606385][ C2] ip_finish_output2+0x786/0x18e0 [12116.606642][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12116.606977][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12116.607254][ C2] ? rcu_read_lock_held+0xe/0x50 [12116.607506][ C2] ? __ip_finish_output+0x10f/0x770 [12116.607770][ C2] ip_output+0x16b/0x4f0 [12116.607985][ C2] ? __pfx_ip_output+0x10/0x10 [12116.608228][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12116.608502][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12116.608814][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12116.609090][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12116.609341][ C2] ? __alloc_skb+0xd4/0x280 [12116.609572][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12116.609843][ C2] ? tcp_fragment+0x168/0x1040 [12116.610088][ C2] ? rcu_read_lock_held+0xe/0x50 [12116.610339][ C2] ? ip_local_out+0x114/0x3b0 [12116.610580][ C2] __ip_queue_xmit+0x672/0x1910 [12116.610827][ C2] ? __skb_clone+0x57a/0x760 [12116.611061][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12116.611328][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12116.611611][ C2] ? ipv4_dst_check+0xe3/0x170 [12116.611854][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12116.612103][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12116.612414][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12116.612732][ C2] ? tcp_fragment+0xb0e/0x1040 [12116.612976][ C2] tcp_send_loss_probe+0x348/0x830 [12116.613235][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12116.613505][ C2] tcp_write_timer+0x82/0x1d0 [12116.613745][ C2] call_timer_fn+0x173/0x430 [12116.613985][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12116.614247][ C2] ? next_expiry_recalc+0xcd/0x220 [12116.614508][ C2] __run_timers.part.0+0x52d/0x890 [12116.614769][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12116.615037][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12116.615321][ C2] ? lock_acquire+0x1c1/0x220 [12116.615560][ C2] ? clockevents_program_event+0xf6/0x300 [12116.615853][ C2] ? lock_release+0x1d5/0x250 [12116.616089][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12116.616356][ C2] ? ktime_get+0xb3/0x190 [12116.616580][ C2] ? clockevents_program_event+0x1ea/0x300 [12116.616876][ C2] run_timer_softirq+0x72/0x100 [12116.617123][ C2] __do_softirq+0x1b9/0x7ff [12116.617357][ C2] irq_exit_rcu+0x98/0xc0 [12116.617578][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12116.617863][ C2] [12116.618019][ C2] [12116.618172][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12116.618475][ C2] RIP: 0010:default_idle+0xf/0x20 [12116.618737][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12116.619707][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12116.620014][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12116.620416][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12116.620814][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12116.621211][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12116.621608][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12116.622010][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12116.622306][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12116.622566][ C2] default_idle_call+0x69/0xa0 [12116.622810][ C2] cpuidle_idle_call+0x1f6/0x280 [12116.623061][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12116.623339][ C2] ? lock_release+0x1d5/0x250 [12116.623579][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12116.623850][ C2] do_idle+0xfb/0x160 [12116.624055][ C2] cpu_startup_entry+0x55/0x60 [12116.624298][ C2] start_secondary+0x21c/0x2b0 [12116.624542][ C2] ? __pfx_start_secondary+0x10/0x10 [12116.624810][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12116.625122][ C2] [12116.625280][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9093s! [perl:4135] [12116.625716][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12116.626981][ C1] irq event stamp: 209232 [12116.627202][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12116.627733][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12116.628213][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12116.628687][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12116.629153][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12116.629603][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12116.630222][ C1] RIP: 0010:__kasan_check_read+0x0/0x20 [12116.630507][ C1] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [12116.631483][ C1] RSP: 0018:ffffc900001c7b70 EFLAGS: 00000202 [12116.631793][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12116.632204][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12116.632604][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12116.633006][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12116.633408][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12116.633808][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12116.634263][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12116.634596][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12116.634998][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12116.635400][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12116.635800][ C1] PKRU: 55555554 [12116.635984][ C1] Call Trace: [12116.636157][ C1] [12116.636307][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12116.636569][ C1] ? __run_hrtimer+0x1c0/0x710 [12116.636819][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12116.637095][ C1] ? __hrtimer_run_queues+0x197/0x270 [12116.637369][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12116.637661][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12116.637927][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12116.638236][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12116.638500][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12116.638809][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12116.639107][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12116.639424][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12116.639715][ C1] ? __pfx___kasan_check_read+0x10/0x10 [12116.639998][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [12116.640281][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12116.640593][ C1] ? get_stack_info+0x36/0xc0 [12116.640836][ C1] ? lock_acquire+0x1c1/0x220 [12116.641078][ C1] ? lock_release+0x1d5/0x250 [12116.641319][ C1] do_raw_spin_lock+0x1ec/0x270 [12116.641567][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12116.641842][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12116.642128][ C1] ? lock_acquire+0x1c1/0x220 [12116.642376][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12116.642619][ C1] _raw_spin_lock_nested+0x65/0x80 [12116.642880][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12116.643115][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12116.643363][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12116.643621][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12116.643896][ C1] ip_local_deliver_finish+0x2ae/0x480 [12116.644179][ C1] ip_local_deliver+0x19d/0x480 [12116.644427][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12116.644698][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12116.644963][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12116.645312][ C1] ? rcu_read_lock_held+0xe/0x50 [12116.645566][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12116.645886][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12116.646153][ C1] ip_rcv+0x564/0x740 [12116.646358][ C1] ? __pfx_ip_rcv+0x10/0x10 [12116.646589][ C1] ? set_track_prepare+0x8a/0xd0 [12116.646842][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12116.647120][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12116.647395][ C1] ? skb_clone+0x10b/0x330 [12116.647623][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12116.647943][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12116.648251][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12116.648531][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12116.648828][ C1] ? __tcf_classify+0x329/0x7d0 [12116.649078][ C1] ? __pfx_ip_rcv+0x10/0x10 [12116.649309][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12116.649610][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12116.649894][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12116.650220][ C1] ? lock_acquire+0x1c1/0x220 [12116.650460][ C1] ? netif_receive_skb_internal+0x84/0x300 [12116.650759][ C1] netif_receive_skb_internal+0xb0/0x300 [12116.651043][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12116.651362][ C1] ? __copy_skb_header+0xaf/0x490 [12116.651620][ C1] ? __skb_clone+0x57a/0x760 [12116.651861][ C1] netif_receive_skb+0x55/0x280 [12116.652111][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12116.652432][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12116.652766][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12116.653067][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12116.653346][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12116.653635][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12116.653949][ C1] ? hlock_class+0x4e/0x130 [12116.654182][ C1] ? get_stack_info_noinstr+0x18/0x110 [12116.654460][ C1] ? get_stack_info_noinstr+0x18/0x110 [12116.654736][ C1] ? __pfx_validate_chain+0x10/0x10 [12116.655001][ C1] ? hlock_class+0x4e/0x130 [12116.655234][ C1] ? mark_lock+0x38/0x3e0 [12116.655454][ C1] ? stack_access_ok+0xda/0x1f0 [12116.655705][ C1] ? __lock_acquire+0xb67/0x1610 [12116.655959][ C1] ? get_stack_info_noinstr+0x18/0x110 [12116.656236][ C1] ? get_stack_info+0x36/0xc0 [12116.656478][ C1] ? stack_access_ok+0xda/0x1f0 [12116.656726][ C1] ? get_reg+0x119/0x190 [12116.656941][ C1] ? unwind_next_frame+0x12af/0x1d10 [12116.657213][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12116.657522][ C1] __tcf_classify+0x329/0x7d0 [12116.657765][ C1] tcf_classify+0x283/0x930 [12116.657998][ C1] ? arch_stack_walk+0xa2/0x100 [12116.658246][ C1] ? __pfx_tcf_classify+0x10/0x10 [12116.658503][ C1] ? get_stack_info+0x36/0xc0 [12116.658744][ C1] tc_run+0x2e4/0x5d0 [12116.658951][ C1] ? __pfx_tc_run+0x10/0x10 [12116.659185][ C1] ? lock_acquire+0x1c1/0x220 [12116.659424][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12116.659686][ C1] __dev_queue_xmit+0x686/0x17e0 [12116.659939][ C1] ? lock_acquire+0x1c1/0x220 [12116.660180][ C1] ? ip_finish_output2+0x786/0x18e0 [12116.660445][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12116.660749][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12116.661023][ C1] ? neigh_hh_output+0x348/0x590 [12116.661277][ C1] ? ip_finish_output2+0x262/0x18e0 [12116.661543][ C1] ip_finish_output2+0x786/0x18e0 [12116.661800][ C1] ? stack_depot_save_flags+0x45/0x550 [12116.662078][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12116.662422][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12116.662700][ C1] ? rcu_read_lock_held+0xe/0x50 [12116.662953][ C1] ? __ip_finish_output+0x10f/0x770 [12116.663220][ C1] ip_output+0x16b/0x4f0 [12116.663436][ C1] ? run_timer_softirq+0x72/0x100 [12116.663694][ C1] ? __pfx_ip_output+0x10/0x10 [12116.663938][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12116.664225][ C1] ? rcu_read_lock_held+0xe/0x50 [12116.664477][ C1] ? ip_local_out+0x114/0x3b0 [12116.664718][ C1] __ip_queue_xmit+0x672/0x1910 [12116.664968][ C1] ? __create_object+0x5e/0xb0 [12116.665213][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12116.665481][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12116.665762][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12116.666034][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12116.666319][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12116.666592][ C1] tcp_delack_timer+0x84/0x240 [12116.666841][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12116.667113][ C1] call_timer_fn+0x173/0x430 [12116.667351][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12116.667614][ C1] ? next_expiry_recalc+0xcd/0x220 [12116.667875][ C1] __run_timers.part.0+0x52d/0x890 [12116.668138][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12116.668412][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12116.668698][ C1] ? lock_acquire+0x1c1/0x220 [12116.668935][ C1] ? clockevents_program_event+0xf6/0x300 [12116.669231][ C1] ? lock_release+0x1d5/0x250 [12116.669471][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12116.669735][ C1] ? ktime_get+0xb3/0x190 [12116.669956][ C1] ? clockevents_program_event+0x1ea/0x300 [12116.670255][ C1] run_timer_softirq+0x72/0x100 [12116.670505][ C1] __do_softirq+0x1b9/0x7ff [12116.670737][ C1] irq_exit_rcu+0x98/0xc0 [12116.670960][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12116.671246][ C1] [12116.671398][ C1] [12116.671548][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12116.671854][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12116.672180][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12116.673156][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12116.673465][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12116.673865][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12116.674264][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12116.674663][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12116.675063][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12116.675466][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12116.675763][ C1] pipe_read+0xa16/0xdf0 [12116.675984][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12116.676264][ C1] ? __pfx_pipe_read+0x10/0x10 [12116.676510][ C1] ? iterate_tty_write+0x299/0x540 [12116.676772][ C1] ? lock_release+0x1d5/0x250 [12116.677013][ C1] vfs_read+0x911/0xc00 [12116.677228][ C1] ? lock_acquire+0x1c1/0x220 [12116.677468][ C1] ? __might_fault+0xc6/0x180 [12116.677709][ C1] ? __pfx_vfs_read+0x10/0x10 [12116.677947][ C1] ? __might_fault+0xc6/0x180 [12116.678189][ C1] ? lock_release+0x1d5/0x250 [12116.678430][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12116.678695][ C1] ? __fget_light+0x54/0x1e0 [12116.678933][ C1] ksys_read+0x17a/0x1e0 [12116.679151][ C1] ? __pfx_ksys_read+0x10/0x10 [12116.679397][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12116.679706][ C1] do_syscall_64+0xc9/0x1e0 [12116.679937][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12116.680239][ C1] RIP: 0033:0x7f08a1ea38b2 [12116.680469][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12116.681440][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12116.681861][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12116.682267][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12116.682667][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12116.683065][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12116.683465][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12116.683867][ C1] [12141.540103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [12141.540478][ C1] rcu: 1-....: (9472707 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2296180 [12141.541039][ C1] rcu: (t=9786653 jiffies g=1882453 q=730 ncpus=4) [12141.541375][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12141.541825][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12141.542445][ C1] RIP: 0010:kasan_check_range+0x1a/0x1c0 [12141.542735][ C1] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 48 85 f6 0f 84 5e 01 00 00 48 89 f8 41 54 44 0f b6 c2 48 01 f0 55 <53> 72 14 eb 26 cc cc cc 48 b8 ff ff ff ff ff ff ff fe 48 39 c7 77 [12141.543711][ C1] RSP: 0018:ffffc900001c7b60 EFLAGS: 00000282 [12141.544019][ C1] RAX: ffff88800a3a0e1c RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12141.544421][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12141.544821][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12141.545220][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12141.545621][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12141.546022][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12141.546471][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12141.546805][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12141.547206][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12141.547607][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12141.548008][ C1] PKRU: 55555554 [12141.548191][ C1] Call Trace: [12141.548361][ C1] [12141.548512][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [12141.548786][ C1] ? print_cpu_stall+0x263/0x6a0 [12141.549038][ C1] ? check_cpu_stall+0x284/0x500 [12141.549292][ C1] ? rcu_pending+0x92/0x360 [12141.549521][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [12141.549792][ C1] ? update_process_times+0xb9/0x110 [12141.550063][ C1] ? tick_sched_handle+0x67/0x130 [12141.550321][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [12141.550606][ C1] ? __run_hrtimer+0x1c0/0x710 [12141.550849][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [12141.551163][ C1] ? __hrtimer_run_queues+0x197/0x270 [12141.551436][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12141.551725][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12141.551992][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12141.552302][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12141.552565][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12141.552875][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12141.553174][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12141.553491][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12141.553781][ C1] ? kasan_check_range+0x1a/0x1c0 [12141.554037][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [12141.554321][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12141.554634][ C1] ? get_stack_info+0x36/0xc0 [12141.554874][ C1] ? lock_acquire+0x1c1/0x220 [12141.555116][ C1] ? lock_release+0x1d5/0x250 [12141.555357][ C1] do_raw_spin_lock+0x1ec/0x270 [12141.555608][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12141.555879][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12141.556163][ C1] ? lock_acquire+0x1c1/0x220 [12141.556404][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12141.556646][ C1] _raw_spin_lock_nested+0x65/0x80 [12141.556907][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12141.557143][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12141.557390][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12141.557648][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12141.557926][ C1] ip_local_deliver_finish+0x2ae/0x480 [12141.558204][ C1] ip_local_deliver+0x19d/0x480 [12141.558453][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12141.558728][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12141.558992][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12141.559341][ C1] ? rcu_read_lock_held+0xe/0x50 [12141.559595][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12141.559916][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12141.560179][ C1] ip_rcv+0x564/0x740 [12141.560384][ C1] ? __pfx_ip_rcv+0x10/0x10 [12141.560614][ C1] ? set_track_prepare+0x8a/0xd0 [12141.560868][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12141.561145][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12141.561418][ C1] ? skb_clone+0x10b/0x330 [12141.561646][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12141.561964][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12141.562278][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12141.562562][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12141.562857][ C1] ? __tcf_classify+0x329/0x7d0 [12141.563107][ C1] ? __pfx_ip_rcv+0x10/0x10 [12141.563337][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12141.563637][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12141.563923][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12141.564249][ C1] ? lock_acquire+0x1c1/0x220 [12141.564487][ C1] ? netif_receive_skb_internal+0x84/0x300 [12141.564783][ C1] netif_receive_skb_internal+0xb0/0x300 [12141.565072][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12141.565389][ C1] ? __copy_skb_header+0xaf/0x490 [12141.565648][ C1] ? __skb_clone+0x57a/0x760 [12141.565883][ C1] netif_receive_skb+0x55/0x280 [12141.566132][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12141.566446][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12141.566779][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12141.567079][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12141.567354][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12141.567641][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12141.567954][ C1] ? hlock_class+0x4e/0x130 [12141.568189][ C1] ? get_stack_info_noinstr+0x18/0x110 [12141.568465][ C1] ? get_stack_info_noinstr+0x18/0x110 [12141.568740][ C1] ? __pfx_validate_chain+0x10/0x10 [12141.569004][ C1] ? hlock_class+0x4e/0x130 [12141.569237][ C1] ? mark_lock+0x38/0x3e0 [12141.569456][ C1] ? stack_access_ok+0xda/0x1f0 [12141.569705][ C1] ? __lock_acquire+0xb67/0x1610 [12141.569958][ C1] ? get_stack_info_noinstr+0x18/0x110 [12141.570240][ C1] ? get_stack_info+0x36/0xc0 [12141.570478][ C1] ? stack_access_ok+0xda/0x1f0 [12141.570726][ C1] ? get_reg+0x119/0x190 [12141.570942][ C1] ? unwind_next_frame+0x12af/0x1d10 [12141.571212][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12141.571521][ C1] __tcf_classify+0x329/0x7d0 [12141.571761][ C1] tcf_classify+0x283/0x930 [12141.571995][ C1] ? arch_stack_walk+0xa2/0x100 [12141.572249][ C1] ? __pfx_tcf_classify+0x10/0x10 [12141.572506][ C1] ? get_stack_info+0x36/0xc0 [12141.572749][ C1] tc_run+0x2e4/0x5d0 [12141.572954][ C1] ? __pfx_tc_run+0x10/0x10 [12141.573184][ C1] ? lock_acquire+0x1c1/0x220 [12141.573424][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12141.573685][ C1] __dev_queue_xmit+0x686/0x17e0 [12141.573939][ C1] ? lock_acquire+0x1c1/0x220 [12141.574179][ C1] ? ip_finish_output2+0x786/0x18e0 [12141.574444][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12141.574750][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12141.575022][ C1] ? neigh_hh_output+0x348/0x590 [12141.575276][ C1] ? ip_finish_output2+0x262/0x18e0 [12141.575541][ C1] ip_finish_output2+0x786/0x18e0 [12141.575797][ C1] ? stack_depot_save_flags+0x45/0x550 [12141.576075][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12141.576417][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12141.576694][ C1] ? rcu_read_lock_held+0xe/0x50 [12141.576948][ C1] ? __ip_finish_output+0x10f/0x770 [12141.577213][ C1] ip_output+0x16b/0x4f0 [12141.577428][ C1] ? run_timer_softirq+0x72/0x100 [12141.577685][ C1] ? __pfx_ip_output+0x10/0x10 [12141.577929][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12141.578217][ C1] ? rcu_read_lock_held+0xe/0x50 [12141.578467][ C1] ? ip_local_out+0x114/0x3b0 [12141.578708][ C1] __ip_queue_xmit+0x672/0x1910 [12141.578957][ C1] ? __create_object+0x5e/0xb0 [12141.579202][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12141.579468][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12141.579750][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12141.580024][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12141.580309][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12141.580580][ C1] tcp_delack_timer+0x84/0x240 [12141.580825][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12141.581096][ C1] call_timer_fn+0x173/0x430 [12141.581334][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12141.581596][ C1] ? next_expiry_recalc+0xcd/0x220 [12141.581858][ C1] __run_timers.part.0+0x52d/0x890 [12141.582123][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12141.582398][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12141.582684][ C1] ? lock_acquire+0x1c1/0x220 [12141.582924][ C1] ? clockevents_program_event+0xf6/0x300 [12141.583213][ C1] ? lock_release+0x1d5/0x250 [12141.583454][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12141.583718][ C1] ? ktime_get+0xb3/0x190 [12141.583939][ C1] ? clockevents_program_event+0x1ea/0x300 [12141.584235][ C1] run_timer_softirq+0x72/0x100 [12141.584484][ C1] __do_softirq+0x1b9/0x7ff [12141.584717][ C1] irq_exit_rcu+0x98/0xc0 [12141.584938][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12141.585224][ C1] [12141.585375][ C1] [12141.585527][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12141.585834][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12141.586159][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12141.587132][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12141.587442][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12141.587840][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12141.588239][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12141.588643][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12141.589042][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12141.589443][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12141.589742][ C1] pipe_read+0xa16/0xdf0 [12141.589961][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12141.590241][ C1] ? __pfx_pipe_read+0x10/0x10 [12141.590483][ C1] ? iterate_tty_write+0x299/0x540 [12141.590747][ C1] ? lock_release+0x1d5/0x250 [12141.590988][ C1] vfs_read+0x911/0xc00 [12141.591203][ C1] ? lock_acquire+0x1c1/0x220 [12141.591441][ C1] ? __might_fault+0xc6/0x180 [12141.591683][ C1] ? __pfx_vfs_read+0x10/0x10 [12141.591923][ C1] ? __might_fault+0xc6/0x180 [12141.592169][ C1] ? lock_release+0x1d5/0x250 [12141.592409][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12141.592673][ C1] ? __fget_light+0x54/0x1e0 [12141.592912][ C1] ksys_read+0x17a/0x1e0 [12141.593130][ C1] ? __pfx_ksys_read+0x10/0x10 [12141.593374][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12141.593680][ C1] do_syscall_64+0xc9/0x1e0 [12141.593915][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12141.594213][ C1] RIP: 0033:0x7f08a1ea38b2 [12141.594443][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12141.595414][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12141.595835][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12141.596236][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12141.596635][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12141.597033][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12141.597435][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12141.597838][ C1] [12141.598002][ C1] Sending NMI from CPU 1 to CPUs 2: [12141.598288][ C2] NMI backtrace for cpu 2 [12141.598300][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12141.598308][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12141.598312][ C2] RIP: 0010:queued_spin_lock_slowpath+0xa3/0xb90 [12141.598323][ C2] Code: 0f 1f 44 00 00 49 89 fd 49 89 fc 41 be 01 00 00 00 48 b8 00 00 00 00 00 fc ff df 49 c1 ed 03 41 83 e4 07 49 01 c5 41 83 c4 03 04 00 00 00 48 89 ef e8 c0 35 0c fe 41 0f b6 45 00 41 38 c4 7c [12141.598329][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12141.598335][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12141.598340][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12141.598344][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12141.598346][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12141.598348][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12141.598350][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12141.598352][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12141.598355][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12141.598357][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12141.598359][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12141.598360][ C2] PKRU: 55555554 [12141.598361][ C2] Call Trace: [12141.598365][ C2] [12141.598369][ C2] ? nmi_cpu_backtrace+0x112/0x220 [12141.598376][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [12141.598382][ C2] ? nmi_handle+0x153/0x420 [12141.598388][ C2] ? default_do_nmi+0x41/0x100 [12141.598391][ C2] ? exc_nmi+0xf3/0x120 [12141.598394][ C2] ? end_repeat_nmi+0xf/0x60 [12141.598400][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12141.598404][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [12141.598407][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [12141.598410][ C2] ? queued_spin_lock_slowpath+0xa3/0xb90 [12141.598413][ C2] [12141.598414][ C2] [12141.598416][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12141.598418][ C2] ? get_stack_info+0x36/0xc0 [12141.598423][ C2] ? lock_acquire+0x1c1/0x220 [12141.598427][ C2] ? lock_release+0x1d5/0x250 [12141.598430][ C2] do_raw_spin_lock+0x1ec/0x270 [12141.598434][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12141.598437][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12141.598441][ C2] ? lock_acquire+0x1c1/0x220 [12141.598443][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12141.598447][ C2] _raw_spin_lock_nested+0x65/0x80 [12141.598450][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12141.598456][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12141.598459][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12141.598464][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12141.598470][ C2] ip_local_deliver_finish+0x2ae/0x480 [12141.598473][ C2] ip_local_deliver+0x19d/0x480 [12141.598476][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12141.598478][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12141.598480][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12141.598487][ C2] ? rcu_read_lock_held+0xe/0x50 [12141.598492][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12141.598495][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12141.598504][ C2] ip_rcv+0x564/0x740 [12141.598507][ C2] ? __pfx_ip_rcv+0x10/0x10 [12141.598510][ C2] ? set_track_prepare+0x8a/0xd0 [12141.598515][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12141.598518][ C2] ? start_secondary+0x21c/0x2b0 [12141.598521][ C2] ? skb_clone+0x10b/0x330 [12141.598526][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12141.598532][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12141.598537][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12141.598541][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12141.598549][ C2] ? __tcf_classify+0x329/0x7d0 [12141.598553][ C2] ? __pfx_ip_rcv+0x10/0x10 [12141.598555][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12141.598559][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12141.598562][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12141.598566][ C2] ? lock_acquire+0x1c1/0x220 [12141.598569][ C2] ? netif_receive_skb_internal+0x84/0x300 [12141.598573][ C2] netif_receive_skb_internal+0xb0/0x300 [12141.598576][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12141.598580][ C2] ? __copy_skb_header+0xaf/0x490 [12141.598585][ C2] ? __skb_clone+0x57a/0x760 [12141.598588][ C2] netif_receive_skb+0x55/0x280 [12141.598592][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12141.598600][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12141.598606][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12141.598613][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12141.598617][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12141.598628][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12141.598635][ C2] ? get_stack_info+0x36/0xc0 [12141.598640][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12141.598643][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12141.598647][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12141.598649][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12141.598653][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12141.598655][ C2] ? kernel_text_address+0x17/0xe0 [12141.598659][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12141.598664][ C2] ? arch_stack_walk+0x8c/0x100 [12141.598668][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12141.598672][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12141.598675][ C2] ? lock_acquire+0x1c1/0x220 [12141.598678][ C2] ? stack_depot_save_flags+0x281/0x550 [12141.598682][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12141.598687][ C2] ? get_stack_info_noinstr+0x18/0x110 [12141.598690][ C2] ? get_stack_info+0x36/0xc0 [12141.598694][ C2] __tcf_classify+0x329/0x7d0 [12141.598700][ C2] tcf_classify+0x283/0x930 [12141.598704][ C2] ? __pfx_tcf_classify+0x10/0x10 [12141.598707][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12141.598712][ C2] tc_run+0x2e4/0x5d0 [12141.598716][ C2] ? __pfx_tc_run+0x10/0x10 [12141.598719][ C2] ? lock_acquire+0x1c1/0x220 [12141.598721][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12141.598725][ C2] __dev_queue_xmit+0x686/0x17e0 [12141.598729][ C2] ? lock_acquire+0x1c1/0x220 [12141.598732][ C2] ? ip_finish_output2+0x786/0x18e0 [12141.598735][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12141.598738][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12141.598741][ C2] ? neigh_hh_output+0x348/0x590 [12141.598745][ C2] ? ip_finish_output2+0x262/0x18e0 [12141.598749][ C2] ip_finish_output2+0x786/0x18e0 [12141.598752][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12141.598760][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12141.598763][ C2] ? rcu_read_lock_held+0xe/0x50 [12141.598767][ C2] ? __ip_finish_output+0x10f/0x770 [12141.598770][ C2] ip_output+0x16b/0x4f0 [12141.598773][ C2] ? __pfx_ip_output+0x10/0x10 [12141.598776][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12141.598779][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12141.598782][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12141.598786][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12141.598789][ C2] ? __alloc_skb+0xd4/0x280 [12141.598791][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12141.598796][ C2] ? tcp_fragment+0x168/0x1040 [12141.598799][ C2] ? rcu_read_lock_held+0xe/0x50 [12141.598802][ C2] ? ip_local_out+0x114/0x3b0 [12141.598806][ C2] __ip_queue_xmit+0x672/0x1910 [12141.598809][ C2] ? __skb_clone+0x57a/0x760 [12141.598812][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12141.598817][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12141.598820][ C2] ? ipv4_dst_check+0xe3/0x170 [12141.598825][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12141.598830][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12141.598834][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12141.598837][ C2] ? tcp_fragment+0xb0e/0x1040 [12141.598840][ C2] tcp_send_loss_probe+0x348/0x830 [12141.598844][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12141.598846][ C2] tcp_write_timer+0x82/0x1d0 [12141.598850][ C2] call_timer_fn+0x173/0x430 [12141.598854][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12141.598859][ C2] ? next_expiry_recalc+0xcd/0x220 [12141.598863][ C2] __run_timers.part.0+0x52d/0x890 [12141.598866][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12141.598870][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12141.598874][ C2] ? lock_acquire+0x1c1/0x220 [12141.598876][ C2] ? clockevents_program_event+0xf6/0x300 [12141.598881][ C2] ? lock_release+0x1d5/0x250 [12141.598884][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12141.598888][ C2] ? ktime_get+0xb3/0x190 [12141.598891][ C2] ? clockevents_program_event+0x1ea/0x300 [12141.598896][ C2] run_timer_softirq+0x72/0x100 [12141.598899][ C2] __do_softirq+0x1b9/0x7ff [12141.598904][ C2] irq_exit_rcu+0x98/0xc0 [12141.598907][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12141.598911][ C2] [12141.598912][ C2] [12141.598913][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12141.598916][ C2] RIP: 0010:default_idle+0xf/0x20 [12141.598920][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12141.598923][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12141.598925][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12141.598927][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12141.598928][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12141.598930][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12141.598932][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12141.598935][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12141.598938][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12141.598942][ C2] default_idle_call+0x69/0xa0 [12141.598945][ C2] cpuidle_idle_call+0x1f6/0x280 [12141.598948][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12141.598952][ C2] ? lock_release+0x1d5/0x250 [12141.598955][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12141.598959][ C2] do_idle+0xfb/0x160 [12141.598961][ C2] cpu_startup_entry+0x55/0x60 [12141.598964][ C2] start_secondary+0x21c/0x2b0 [12141.598968][ C2] ? __pfx_start_secondary+0x10/0x10 [12141.598972][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12141.598978][ C2] [12168.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9141s! [perl:4135] [12168.569692][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12168.570959][ C1] irq event stamp: 209232 [12168.571181][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12168.571715][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12168.572202][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12168.572672][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12168.573136][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12168.573584][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12168.574195][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12168.574521][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12168.575493][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12168.575799][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12168.576205][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12168.576605][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12168.577003][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12168.577400][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12168.577802][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12168.578250][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12168.578583][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12168.578984][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12168.579382][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12168.579783][ C1] PKRU: 55555554 [12168.579965][ C1] Call Trace: [12168.580135][ C1] [12168.580285][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12168.580548][ C1] ? __run_hrtimer+0x1c0/0x710 [12168.580790][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12168.581068][ C1] ? __hrtimer_run_queues+0x197/0x270 [12168.581341][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12168.581630][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12168.581896][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12168.582207][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12168.582470][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12168.582779][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12168.583077][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12168.583394][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12168.583683][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12168.583980][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12168.584268][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12168.584581][ C1] ? get_stack_info+0x36/0xc0 [12168.584824][ C1] ? lock_acquire+0x1c1/0x220 [12168.585067][ C1] ? lock_release+0x1d5/0x250 [12168.585307][ C1] do_raw_spin_lock+0x1ec/0x270 [12168.585554][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12168.585829][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12168.586114][ C1] ? lock_acquire+0x1c1/0x220 [12168.586354][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12168.586595][ C1] _raw_spin_lock_nested+0x65/0x80 [12168.586855][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12168.587089][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12168.587337][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12168.587595][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12168.587872][ C1] ip_local_deliver_finish+0x2ae/0x480 [12168.588154][ C1] ip_local_deliver+0x19d/0x480 [12168.588403][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12168.588676][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12168.588940][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12168.589290][ C1] ? rcu_read_lock_held+0xe/0x50 [12168.589545][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12168.589867][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12168.590131][ C1] ip_rcv+0x564/0x740 [12168.590337][ C1] ? __pfx_ip_rcv+0x10/0x10 [12168.590569][ C1] ? set_track_prepare+0x8a/0xd0 [12168.590824][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12168.591100][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12168.591377][ C1] ? skb_clone+0x10b/0x330 [12168.591604][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12168.591927][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12168.592244][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12168.592527][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12168.592824][ C1] ? __tcf_classify+0x329/0x7d0 [12168.593074][ C1] ? __pfx_ip_rcv+0x10/0x10 [12168.593305][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12168.593607][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12168.593892][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12168.594222][ C1] ? lock_acquire+0x1c1/0x220 [12168.594462][ C1] ? netif_receive_skb_internal+0x84/0x300 [12168.594761][ C1] netif_receive_skb_internal+0xb0/0x300 [12168.595046][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12168.595365][ C1] ? __copy_skb_header+0xaf/0x490 [12168.595624][ C1] ? __skb_clone+0x57a/0x760 [12168.595860][ C1] netif_receive_skb+0x55/0x280 [12168.596111][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12168.596426][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12168.596760][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12168.597058][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12168.597336][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12168.597626][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12168.597941][ C1] ? hlock_class+0x4e/0x130 [12168.598174][ C1] ? get_stack_info_noinstr+0x18/0x110 [12168.598454][ C1] ? get_stack_info_noinstr+0x18/0x110 [12168.598731][ C1] ? __pfx_validate_chain+0x10/0x10 [12168.598995][ C1] ? hlock_class+0x4e/0x130 [12168.599229][ C1] ? mark_lock+0x38/0x3e0 [12168.599449][ C1] ? stack_access_ok+0xda/0x1f0 [12168.599699][ C1] ? __lock_acquire+0xb67/0x1610 [12168.599955][ C1] ? get_stack_info_noinstr+0x18/0x110 [12168.600231][ C1] ? get_stack_info+0x36/0xc0 [12168.600473][ C1] ? stack_access_ok+0xda/0x1f0 [12168.600721][ C1] ? get_reg+0x119/0x190 [12168.600938][ C1] ? unwind_next_frame+0x12af/0x1d10 [12168.601209][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12168.601519][ C1] __tcf_classify+0x329/0x7d0 [12168.601763][ C1] tcf_classify+0x283/0x930 [12168.602002][ C1] ? arch_stack_walk+0xa2/0x100 [12168.602254][ C1] ? __pfx_tcf_classify+0x10/0x10 [12168.602512][ C1] ? get_stack_info+0x36/0xc0 [12168.602752][ C1] tc_run+0x2e4/0x5d0 [12168.602959][ C1] ? __pfx_tc_run+0x10/0x10 [12168.603192][ C1] ? lock_acquire+0x1c1/0x220 [12168.603432][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12168.603695][ C1] __dev_queue_xmit+0x686/0x17e0 [12168.603950][ C1] ? lock_acquire+0x1c1/0x220 [12168.604191][ C1] ? ip_finish_output2+0x786/0x18e0 [12168.604457][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12168.604764][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12168.605037][ C1] ? neigh_hh_output+0x348/0x590 [12168.605292][ C1] ? ip_finish_output2+0x262/0x18e0 [12168.605558][ C1] ip_finish_output2+0x786/0x18e0 [12168.605815][ C1] ? stack_depot_save_flags+0x45/0x550 [12168.606094][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12168.606432][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12168.606712][ C1] ? rcu_read_lock_held+0xe/0x50 [12168.606964][ C1] ? __ip_finish_output+0x10f/0x770 [12168.607229][ C1] ip_output+0x16b/0x4f0 [12168.607446][ C1] ? run_timer_softirq+0x72/0x100 [12168.607704][ C1] ? __pfx_ip_output+0x10/0x10 [12168.607948][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12168.608234][ C1] ? rcu_read_lock_held+0xe/0x50 [12168.608485][ C1] ? ip_local_out+0x114/0x3b0 [12168.608726][ C1] __ip_queue_xmit+0x672/0x1910 [12168.608975][ C1] ? __create_object+0x5e/0xb0 [12168.609220][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12168.609487][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12168.609767][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12168.610039][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12168.610323][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12168.610594][ C1] tcp_delack_timer+0x84/0x240 [12168.610838][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12168.611110][ C1] call_timer_fn+0x173/0x430 [12168.611347][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12168.611609][ C1] ? next_expiry_recalc+0xcd/0x220 [12168.611869][ C1] __run_timers.part.0+0x52d/0x890 [12168.612139][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12168.612412][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12168.612700][ C1] ? lock_acquire+0x1c1/0x220 [12168.612938][ C1] ? clockevents_program_event+0xf6/0x300 [12168.613229][ C1] ? lock_release+0x1d5/0x250 [12168.613468][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12168.613733][ C1] ? ktime_get+0xb3/0x190 [12168.613952][ C1] ? clockevents_program_event+0x1ea/0x300 [12168.614250][ C1] run_timer_softirq+0x72/0x100 [12168.614499][ C1] __do_softirq+0x1b9/0x7ff [12168.614729][ C1] irq_exit_rcu+0x98/0xc0 [12168.614951][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12168.615236][ C1] [12168.615389][ C1] [12168.615539][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12168.615844][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12168.616170][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12168.617142][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12168.617451][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12168.617850][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12168.618249][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12168.618648][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12168.619048][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12168.619449][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12168.619745][ C1] pipe_read+0xa16/0xdf0 [12168.619966][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12168.620243][ C1] ? __pfx_pipe_read+0x10/0x10 [12168.620487][ C1] ? iterate_tty_write+0x299/0x540 [12168.620747][ C1] ? lock_release+0x1d5/0x250 [12168.620988][ C1] vfs_read+0x911/0xc00 [12168.621203][ C1] ? lock_acquire+0x1c1/0x220 [12168.621443][ C1] ? __might_fault+0xc6/0x180 [12168.621684][ C1] ? __pfx_vfs_read+0x10/0x10 [12168.621925][ C1] ? __might_fault+0xc6/0x180 [12168.622170][ C1] ? lock_release+0x1d5/0x250 [12168.622410][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12168.622675][ C1] ? __fget_light+0x54/0x1e0 [12168.622914][ C1] ksys_read+0x17a/0x1e0 [12168.623131][ C1] ? __pfx_ksys_read+0x10/0x10 [12168.623376][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12168.623681][ C1] do_syscall_64+0xc9/0x1e0 [12168.623911][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12168.624212][ C1] RIP: 0033:0x7f08a1ea38b2 [12168.624440][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12168.625412][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12168.625832][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12168.626232][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12168.626630][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12168.627031][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12168.627430][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12168.627834][ C1] [12168.627991][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9141s! [swapper/2:0] [12168.628421][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12168.629681][ C2] irq event stamp: 44114564 [12168.629911][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12168.630447][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12168.630957][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12168.631434][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12168.631903][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12168.632369][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12168.632983][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12168.633310][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12168.634276][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12168.634583][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12168.634985][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12168.635383][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12168.635781][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12168.636180][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12168.636576][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12168.637023][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12168.637354][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12168.637755][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12168.638154][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12168.638550][ C2] PKRU: 55555554 [12168.638731][ C2] Call Trace: [12168.638903][ C2] [12168.639050][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12168.639313][ C2] ? __run_hrtimer+0x1c0/0x710 [12168.639557][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12168.639832][ C2] ? __hrtimer_run_queues+0x197/0x270 [12168.640104][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12168.640392][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12168.640656][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12168.640963][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12168.641224][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12168.641486][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12168.641794][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12168.642104][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12168.642421][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12168.642711][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12168.643004][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12168.643295][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12168.643605][ C2] ? get_stack_info+0x36/0xc0 [12168.643845][ C2] ? lock_acquire+0x1c1/0x220 [12168.644084][ C2] ? lock_release+0x1d5/0x250 [12168.644325][ C2] do_raw_spin_lock+0x1ec/0x270 [12168.644574][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12168.644844][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12168.645133][ C2] ? lock_acquire+0x1c1/0x220 [12168.645369][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12168.645611][ C2] _raw_spin_lock_nested+0x65/0x80 [12168.645869][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12168.646104][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12168.646351][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12168.646608][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12168.646884][ C2] ip_local_deliver_finish+0x2ae/0x480 [12168.647160][ C2] ip_local_deliver+0x19d/0x480 [12168.647406][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12168.647675][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12168.647939][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12168.648287][ C2] ? rcu_read_lock_held+0xe/0x50 [12168.648540][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12168.648859][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12168.649122][ C2] ip_rcv+0x564/0x740 [12168.649325][ C2] ? __pfx_ip_rcv+0x10/0x10 [12168.649555][ C2] ? set_track_prepare+0x8a/0xd0 [12168.649807][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12168.650084][ C2] ? start_secondary+0x21c/0x2b0 [12168.650337][ C2] ? skb_clone+0x10b/0x330 [12168.650562][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12168.650880][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12168.651187][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12168.651467][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12168.651764][ C2] ? __tcf_classify+0x329/0x7d0 [12168.652018][ C2] ? __pfx_ip_rcv+0x10/0x10 [12168.652247][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12168.652548][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12168.652832][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12168.653158][ C2] ? lock_acquire+0x1c1/0x220 [12168.653393][ C2] ? netif_receive_skb_internal+0x84/0x300 [12168.653690][ C2] netif_receive_skb_internal+0xb0/0x300 [12168.653973][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12168.654290][ C2] ? __copy_skb_header+0xaf/0x490 [12168.654548][ C2] ? __skb_clone+0x57a/0x760 [12168.654783][ C2] netif_receive_skb+0x55/0x280 [12168.655031][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12168.655345][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12168.655676][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12168.655973][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12168.656248][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12168.656534][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12168.656845][ C2] ? get_stack_info+0x36/0xc0 [12168.657087][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12168.657356][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12168.657673][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12168.657947][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12168.658222][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12168.658537][ C2] ? kernel_text_address+0x17/0xe0 [12168.658797][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12168.659111][ C2] ? arch_stack_walk+0x8c/0x100 [12168.659365][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12168.659629][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12168.659916][ C2] ? lock_acquire+0x1c1/0x220 [12168.660152][ C2] ? stack_depot_save_flags+0x281/0x550 [12168.660437][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12168.660743][ C2] ? get_stack_info_noinstr+0x18/0x110 [12168.661019][ C2] ? get_stack_info+0x36/0xc0 [12168.661260][ C2] __tcf_classify+0x329/0x7d0 [12168.661499][ C2] tcf_classify+0x283/0x930 [12168.661732][ C2] ? __pfx_tcf_classify+0x10/0x10 [12168.661996][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12168.662310][ C2] tc_run+0x2e4/0x5d0 [12168.662515][ C2] ? __pfx_tc_run+0x10/0x10 [12168.662746][ C2] ? lock_acquire+0x1c1/0x220 [12168.662981][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12168.663242][ C2] __dev_queue_xmit+0x686/0x17e0 [12168.663494][ C2] ? lock_acquire+0x1c1/0x220 [12168.663733][ C2] ? ip_finish_output2+0x786/0x18e0 [12168.663996][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12168.664300][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12168.664569][ C2] ? neigh_hh_output+0x348/0x590 [12168.664821][ C2] ? ip_finish_output2+0x262/0x18e0 [12168.665084][ C2] ip_finish_output2+0x786/0x18e0 [12168.665341][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12168.665678][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12168.665954][ C2] ? rcu_read_lock_held+0xe/0x50 [12168.666206][ C2] ? __ip_finish_output+0x10f/0x770 [12168.666470][ C2] ip_output+0x16b/0x4f0 [12168.666685][ C2] ? __pfx_ip_output+0x10/0x10 [12168.666928][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12168.667203][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12168.667516][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12168.667793][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12168.668042][ C2] ? __alloc_skb+0xd4/0x280 [12168.668272][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12168.668541][ C2] ? tcp_fragment+0x168/0x1040 [12168.668785][ C2] ? rcu_read_lock_held+0xe/0x50 [12168.669036][ C2] ? ip_local_out+0x114/0x3b0 [12168.669277][ C2] __ip_queue_xmit+0x672/0x1910 [12168.669524][ C2] ? __skb_clone+0x57a/0x760 [12168.669756][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12168.670024][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12168.670306][ C2] ? ipv4_dst_check+0xe3/0x170 [12168.670551][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12168.670801][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12168.671099][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12168.671418][ C2] ? tcp_fragment+0xb0e/0x1040 [12168.671662][ C2] tcp_send_loss_probe+0x348/0x830 [12168.671921][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12168.672195][ C2] tcp_write_timer+0x82/0x1d0 [12168.672435][ C2] call_timer_fn+0x173/0x430 [12168.672672][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12168.672933][ C2] ? next_expiry_recalc+0xcd/0x220 [12168.673194][ C2] __run_timers.part.0+0x52d/0x890 [12168.673453][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12168.673722][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12168.674006][ C2] ? lock_acquire+0x1c1/0x220 [12168.674243][ C2] ? clockevents_program_event+0xf6/0x300 [12168.674536][ C2] ? lock_release+0x1d5/0x250 [12168.674775][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12168.675039][ C2] ? ktime_get+0xb3/0x190 [12168.675258][ C2] ? clockevents_program_event+0x1ea/0x300 [12168.675555][ C2] run_timer_softirq+0x72/0x100 [12168.675801][ C2] __do_softirq+0x1b9/0x7ff [12168.676031][ C2] irq_exit_rcu+0x98/0xc0 [12168.676254][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12168.676537][ C2] [12168.676688][ C2] [12168.676838][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12168.677143][ C2] RIP: 0010:default_idle+0xf/0x20 [12168.677399][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12168.678365][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12168.678672][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12168.679069][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12168.679468][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12168.679863][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12168.680264][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12168.680663][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12168.680949][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12168.681212][ C2] default_idle_call+0x69/0xa0 [12168.681456][ C2] cpuidle_idle_call+0x1f6/0x280 [12168.681706][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12168.681989][ C2] ? lock_release+0x1d5/0x250 [12168.682229][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12168.682501][ C2] do_idle+0xfb/0x160 [12168.682705][ C2] cpu_startup_entry+0x55/0x60 [12168.682946][ C2] start_secondary+0x21c/0x2b0 [12168.683190][ C2] ? __pfx_start_secondary+0x10/0x10 [12168.683459][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12168.683768][ C2] [12196.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9167s! [perl:4135] [12196.569695][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12196.570948][ C1] irq event stamp: 209232 [12196.571167][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12196.571697][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12196.572178][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12196.572646][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12196.573108][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12196.573556][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12196.574164][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12196.574489][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12196.575460][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12196.575765][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12196.576165][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12196.576563][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12196.576961][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12196.577358][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12196.577757][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12196.578205][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12196.578537][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12196.578939][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12196.579338][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12196.579739][ C1] PKRU: 55555554 [12196.579920][ C1] Call Trace: [12196.580090][ C1] [12196.580239][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12196.580501][ C1] ? __run_hrtimer+0x1c0/0x710 [12196.580743][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12196.581021][ C1] ? __hrtimer_run_queues+0x197/0x270 [12196.581294][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12196.581582][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12196.581853][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12196.582157][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12196.582419][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12196.582735][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12196.583031][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12196.583351][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12196.583639][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12196.583934][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12196.584221][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12196.584533][ C1] ? get_stack_info+0x36/0xc0 [12196.584774][ C1] ? lock_acquire+0x1c1/0x220 [12196.585016][ C1] ? lock_release+0x1d5/0x250 [12196.585255][ C1] do_raw_spin_lock+0x1ec/0x270 [12196.585504][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12196.585777][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12196.586064][ C1] ? lock_acquire+0x1c1/0x220 [12196.586304][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12196.586543][ C1] _raw_spin_lock_nested+0x65/0x80 [12196.586805][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12196.587039][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12196.587287][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12196.587545][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12196.587823][ C1] ip_local_deliver_finish+0x2ae/0x480 [12196.588104][ C1] ip_local_deliver+0x19d/0x480 [12196.588352][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12196.588627][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12196.588892][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12196.589241][ C1] ? rcu_read_lock_held+0xe/0x50 [12196.589495][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12196.589816][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12196.590080][ C1] ip_rcv+0x564/0x740 [12196.590285][ C1] ? __pfx_ip_rcv+0x10/0x10 [12196.590521][ C1] ? set_track_prepare+0x8a/0xd0 [12196.590774][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12196.591052][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12196.591326][ C1] ? skb_clone+0x10b/0x330 [12196.591556][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12196.591880][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12196.592189][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12196.592471][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12196.592768][ C1] ? __tcf_classify+0x329/0x7d0 [12196.593017][ C1] ? __pfx_ip_rcv+0x10/0x10 [12196.593249][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12196.593550][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12196.593835][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12196.594161][ C1] ? lock_acquire+0x1c1/0x220 [12196.594401][ C1] ? netif_receive_skb_internal+0x84/0x300 [12196.594699][ C1] netif_receive_skb_internal+0xb0/0x300 [12196.594985][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12196.595303][ C1] ? __copy_skb_header+0xaf/0x490 [12196.595562][ C1] ? __skb_clone+0x57a/0x760 [12196.595798][ C1] netif_receive_skb+0x55/0x280 [12196.596046][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12196.596359][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12196.596694][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12196.596994][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12196.597268][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12196.597561][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12196.597874][ C1] ? hlock_class+0x4e/0x130 [12196.598106][ C1] ? get_stack_info_noinstr+0x18/0x110 [12196.598383][ C1] ? get_stack_info_noinstr+0x18/0x110 [12196.598661][ C1] ? __pfx_validate_chain+0x10/0x10 [12196.598925][ C1] ? hlock_class+0x4e/0x130 [12196.599158][ C1] ? mark_lock+0x38/0x3e0 [12196.599377][ C1] ? stack_access_ok+0xda/0x1f0 [12196.599627][ C1] ? __lock_acquire+0xb67/0x1610 [12196.599882][ C1] ? get_stack_info_noinstr+0x18/0x110 [12196.600159][ C1] ? get_stack_info+0x36/0xc0 [12196.600400][ C1] ? stack_access_ok+0xda/0x1f0 [12196.600649][ C1] ? get_reg+0x119/0x190 [12196.600864][ C1] ? unwind_next_frame+0x12af/0x1d10 [12196.601132][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12196.601443][ C1] __tcf_classify+0x329/0x7d0 [12196.601686][ C1] tcf_classify+0x283/0x930 [12196.601926][ C1] ? arch_stack_walk+0xa2/0x100 [12196.602174][ C1] ? __pfx_tcf_classify+0x10/0x10 [12196.602431][ C1] ? get_stack_info+0x36/0xc0 [12196.602671][ C1] tc_run+0x2e4/0x5d0 [12196.602875][ C1] ? __pfx_tc_run+0x10/0x10 [12196.603108][ C1] ? lock_acquire+0x1c1/0x220 [12196.603347][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12196.603608][ C1] __dev_queue_xmit+0x686/0x17e0 [12196.603861][ C1] ? lock_acquire+0x1c1/0x220 [12196.604098][ C1] ? ip_finish_output2+0x786/0x18e0 [12196.604364][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12196.604667][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12196.604941][ C1] ? neigh_hh_output+0x348/0x590 [12196.605194][ C1] ? ip_finish_output2+0x262/0x18e0 [12196.605460][ C1] ip_finish_output2+0x786/0x18e0 [12196.605719][ C1] ? stack_depot_save_flags+0x45/0x550 [12196.606001][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12196.606338][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12196.606614][ C1] ? rcu_read_lock_held+0xe/0x50 [12196.606866][ C1] ? __ip_finish_output+0x10f/0x770 [12196.607133][ C1] ip_output+0x16b/0x4f0 [12196.607349][ C1] ? run_timer_softirq+0x72/0x100 [12196.607605][ C1] ? __pfx_ip_output+0x10/0x10 [12196.607849][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12196.608135][ C1] ? rcu_read_lock_held+0xe/0x50 [12196.608386][ C1] ? ip_local_out+0x114/0x3b0 [12196.608626][ C1] __ip_queue_xmit+0x672/0x1910 [12196.608874][ C1] ? __create_object+0x5e/0xb0 [12196.609117][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12196.609384][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12196.609664][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12196.609936][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12196.610220][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12196.610491][ C1] tcp_delack_timer+0x84/0x240 [12196.610735][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12196.611006][ C1] call_timer_fn+0x173/0x430 [12196.611243][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12196.611505][ C1] ? next_expiry_recalc+0xcd/0x220 [12196.611766][ C1] __run_timers.part.0+0x52d/0x890 [12196.612031][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12196.612305][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12196.612589][ C1] ? lock_acquire+0x1c1/0x220 [12196.612827][ C1] ? clockevents_program_event+0xf6/0x300 [12196.613119][ C1] ? lock_release+0x1d5/0x250 [12196.613357][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12196.613621][ C1] ? ktime_get+0xb3/0x190 [12196.613842][ C1] ? clockevents_program_event+0x1ea/0x300 [12196.614140][ C1] run_timer_softirq+0x72/0x100 [12196.614388][ C1] __do_softirq+0x1b9/0x7ff [12196.614619][ C1] irq_exit_rcu+0x98/0xc0 [12196.614840][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12196.615125][ C1] [12196.615276][ C1] [12196.615428][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12196.615732][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12196.616057][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12196.617025][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12196.617332][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12196.617731][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12196.618130][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12196.618527][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12196.618926][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12196.619327][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12196.619622][ C1] pipe_read+0xa16/0xdf0 [12196.619844][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12196.620121][ C1] ? __pfx_pipe_read+0x10/0x10 [12196.620364][ C1] ? iterate_tty_write+0x299/0x540 [12196.620625][ C1] ? lock_release+0x1d5/0x250 [12196.620866][ C1] vfs_read+0x911/0xc00 [12196.621078][ C1] ? lock_acquire+0x1c1/0x220 [12196.621318][ C1] ? __might_fault+0xc6/0x180 [12196.621558][ C1] ? __pfx_vfs_read+0x10/0x10 [12196.621799][ C1] ? __might_fault+0xc6/0x180 [12196.622039][ C1] ? lock_release+0x1d5/0x250 [12196.622280][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12196.622543][ C1] ? __fget_light+0x54/0x1e0 [12196.622781][ C1] ksys_read+0x17a/0x1e0 [12196.622997][ C1] ? __pfx_ksys_read+0x10/0x10 [12196.623244][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12196.623547][ C1] do_syscall_64+0xc9/0x1e0 [12196.623778][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12196.624078][ C1] RIP: 0033:0x7f08a1ea38b2 [12196.624306][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12196.625280][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12196.625699][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12196.626096][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12196.626497][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12196.626896][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12196.627293][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12196.627692][ C1] [12196.627853][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9167s! [swapper/2:0] [12196.628280][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12196.629531][ C2] irq event stamp: 44114564 [12196.629759][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12196.630293][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12196.630803][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12196.631280][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12196.631748][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12196.632207][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12196.632818][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12196.633142][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12196.634109][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12196.634416][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12196.634812][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12196.635209][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12196.635610][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12196.636006][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12196.636404][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12196.636849][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12196.637181][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12196.637583][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12196.637979][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12196.638376][ C2] PKRU: 55555554 [12196.638556][ C2] Call Trace: [12196.638727][ C2] [12196.638874][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12196.639136][ C2] ? __run_hrtimer+0x1c0/0x710 [12196.639378][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12196.639652][ C2] ? __hrtimer_run_queues+0x197/0x270 [12196.639925][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12196.640214][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12196.640477][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12196.640782][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12196.641042][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12196.641305][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12196.641613][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12196.641913][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12196.642227][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12196.642517][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12196.642811][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12196.643099][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12196.643410][ C2] ? get_stack_info+0x36/0xc0 [12196.643650][ C2] ? lock_acquire+0x1c1/0x220 [12196.643888][ C2] ? lock_release+0x1d5/0x250 [12196.644128][ C2] do_raw_spin_lock+0x1ec/0x270 [12196.644377][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12196.644646][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12196.644930][ C2] ? lock_acquire+0x1c1/0x220 [12196.645167][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12196.645408][ C2] _raw_spin_lock_nested+0x65/0x80 [12196.645666][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12196.645901][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12196.646148][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12196.646404][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12196.646678][ C2] ip_local_deliver_finish+0x2ae/0x480 [12196.646952][ C2] ip_local_deliver+0x19d/0x480 [12196.647201][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12196.647470][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12196.647734][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12196.648080][ C2] ? rcu_read_lock_held+0xe/0x50 [12196.648334][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12196.648653][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12196.648915][ C2] ip_rcv+0x564/0x740 [12196.649119][ C2] ? __pfx_ip_rcv+0x10/0x10 [12196.649350][ C2] ? set_track_prepare+0x8a/0xd0 [12196.649601][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12196.649877][ C2] ? start_secondary+0x21c/0x2b0 [12196.650129][ C2] ? skb_clone+0x10b/0x330 [12196.650354][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12196.650673][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12196.650978][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12196.651258][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12196.651552][ C2] ? __tcf_classify+0x329/0x7d0 [12196.651807][ C2] ? __pfx_ip_rcv+0x10/0x10 [12196.652036][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12196.652335][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12196.652620][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12196.652945][ C2] ? lock_acquire+0x1c1/0x220 [12196.653181][ C2] ? netif_receive_skb_internal+0x84/0x300 [12196.653478][ C2] netif_receive_skb_internal+0xb0/0x300 [12196.653761][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12196.654081][ C2] ? __copy_skb_header+0xaf/0x490 [12196.654338][ C2] ? __skb_clone+0x57a/0x760 [12196.654573][ C2] netif_receive_skb+0x55/0x280 [12196.654820][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12196.655133][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12196.655468][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12196.655766][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12196.656040][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12196.656327][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12196.656639][ C2] ? get_stack_info+0x36/0xc0 [12196.656881][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12196.657149][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12196.657466][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12196.657740][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12196.658014][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12196.658328][ C2] ? kernel_text_address+0x17/0xe0 [12196.658589][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12196.658901][ C2] ? arch_stack_walk+0x8c/0x100 [12196.659150][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12196.659413][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12196.659699][ C2] ? lock_acquire+0x1c1/0x220 [12196.659936][ C2] ? stack_depot_save_flags+0x281/0x550 [12196.660219][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12196.660523][ C2] ? get_stack_info_noinstr+0x18/0x110 [12196.660798][ C2] ? get_stack_info+0x36/0xc0 [12196.661038][ C2] __tcf_classify+0x329/0x7d0 [12196.661277][ C2] tcf_classify+0x283/0x930 [12196.661511][ C2] ? __pfx_tcf_classify+0x10/0x10 [12196.661766][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12196.662088][ C2] tc_run+0x2e4/0x5d0 [12196.662293][ C2] ? __pfx_tc_run+0x10/0x10 [12196.662524][ C2] ? lock_acquire+0x1c1/0x220 [12196.662762][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12196.663023][ C2] __dev_queue_xmit+0x686/0x17e0 [12196.663275][ C2] ? lock_acquire+0x1c1/0x220 [12196.663512][ C2] ? ip_finish_output2+0x786/0x18e0 [12196.663775][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12196.664078][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12196.664348][ C2] ? neigh_hh_output+0x348/0x590 [12196.664600][ C2] ? ip_finish_output2+0x262/0x18e0 [12196.664862][ C2] ip_finish_output2+0x786/0x18e0 [12196.665118][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12196.665457][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12196.665732][ C2] ? rcu_read_lock_held+0xe/0x50 [12196.665984][ C2] ? __ip_finish_output+0x10f/0x770 [12196.666249][ C2] ip_output+0x16b/0x4f0 [12196.666463][ C2] ? __pfx_ip_output+0x10/0x10 [12196.666705][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12196.666981][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12196.667291][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12196.667569][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12196.667819][ C2] ? __alloc_skb+0xd4/0x280 [12196.668047][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12196.668316][ C2] ? tcp_fragment+0x168/0x1040 [12196.668561][ C2] ? rcu_read_lock_held+0xe/0x50 [12196.668812][ C2] ? ip_local_out+0x114/0x3b0 [12196.669051][ C2] __ip_queue_xmit+0x672/0x1910 [12196.669300][ C2] ? __skb_clone+0x57a/0x760 [12196.669533][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12196.669800][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12196.670079][ C2] ? ipv4_dst_check+0xe3/0x170 [12196.670325][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12196.670575][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12196.670874][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12196.671194][ C2] ? tcp_fragment+0xb0e/0x1040 [12196.671437][ C2] tcp_send_loss_probe+0x348/0x830 [12196.671696][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12196.671966][ C2] tcp_write_timer+0x82/0x1d0 [12196.672207][ C2] call_timer_fn+0x173/0x430 [12196.672444][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12196.672705][ C2] ? next_expiry_recalc+0xcd/0x220 [12196.672965][ C2] __run_timers.part.0+0x52d/0x890 [12196.673224][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12196.673492][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12196.673777][ C2] ? lock_acquire+0x1c1/0x220 [12196.674013][ C2] ? clockevents_program_event+0xf6/0x300 [12196.674306][ C2] ? lock_release+0x1d5/0x250 [12196.674545][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12196.674808][ C2] ? ktime_get+0xb3/0x190 [12196.675026][ C2] ? clockevents_program_event+0x1ea/0x300 [12196.675324][ C2] run_timer_softirq+0x72/0x100 [12196.675572][ C2] __do_softirq+0x1b9/0x7ff [12196.675802][ C2] irq_exit_rcu+0x98/0xc0 [12196.676024][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12196.676308][ C2] [12196.676459][ C2] [12196.676609][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12196.676913][ C2] RIP: 0010:default_idle+0xf/0x20 [12196.677171][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12196.678137][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12196.678446][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12196.678843][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12196.679239][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12196.679636][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12196.680036][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12196.680436][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12196.680722][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12196.680984][ C2] default_idle_call+0x69/0xa0 [12196.681227][ C2] cpuidle_idle_call+0x1f6/0x280 [12196.681478][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12196.681756][ C2] ? lock_release+0x1d5/0x250 [12196.681998][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12196.682272][ C2] do_idle+0xfb/0x160 [12196.682477][ C2] cpu_startup_entry+0x55/0x60 [12196.682722][ C2] start_secondary+0x21c/0x2b0 [12196.682963][ C2] ? __pfx_start_secondary+0x10/0x10 [12196.683234][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12196.683543][ C2] [12219.599103][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [12219.599467][ C1] rcu: 1-....: (9550594 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2315247 [12219.600031][ C1] rcu: (t=9864712 jiffies g=1882453 q=730 ncpus=4) [12219.600367][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12219.600817][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12219.601429][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12219.601763][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12219.602738][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12219.603046][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12219.603447][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12219.603848][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12219.604249][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12219.604648][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12219.605049][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12219.605498][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12219.605832][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12219.606237][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12219.606636][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12219.607038][ C1] PKRU: 55555554 [12219.607220][ C1] Call Trace: [12219.607391][ C1] [12219.607539][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [12219.607814][ C1] ? print_cpu_stall+0x263/0x6a0 [12219.608066][ C1] ? check_cpu_stall+0x284/0x500 [12219.608320][ C1] ? rcu_pending+0x92/0x360 [12219.608551][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [12219.608821][ C1] ? update_process_times+0xb9/0x110 [12219.609092][ C1] ? tick_sched_handle+0x67/0x130 [12219.609350][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [12219.609635][ C1] ? __run_hrtimer+0x1c0/0x710 [12219.609879][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [12219.610194][ C1] ? __hrtimer_run_queues+0x197/0x270 [12219.610471][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12219.610758][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12219.611026][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12219.611335][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12219.611598][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12219.611914][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12219.612212][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12219.612529][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12219.612819][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12219.613114][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12219.613403][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12219.613715][ C1] ? get_stack_info+0x36/0xc0 [12219.613956][ C1] ? lock_acquire+0x1c1/0x220 [12219.614198][ C1] ? lock_release+0x1d5/0x250 [12219.614437][ C1] do_raw_spin_lock+0x1ec/0x270 [12219.614686][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12219.614959][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12219.615246][ C1] ? lock_acquire+0x1c1/0x220 [12219.615486][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12219.615726][ C1] _raw_spin_lock_nested+0x65/0x80 [12219.615988][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12219.616223][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12219.616471][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12219.616731][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12219.617006][ C1] ip_local_deliver_finish+0x2ae/0x480 [12219.617287][ C1] ip_local_deliver+0x19d/0x480 [12219.617534][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12219.617812][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12219.618077][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12219.618427][ C1] ? rcu_read_lock_held+0xe/0x50 [12219.618682][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12219.619004][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12219.619270][ C1] ip_rcv+0x564/0x740 [12219.619475][ C1] ? __pfx_ip_rcv+0x10/0x10 [12219.619707][ C1] ? set_track_prepare+0x8a/0xd0 [12219.619962][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12219.620240][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12219.620514][ C1] ? skb_clone+0x10b/0x330 [12219.620744][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12219.621065][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12219.621373][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12219.621660][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12219.621963][ C1] ? __tcf_classify+0x329/0x7d0 [12219.622214][ C1] ? __pfx_ip_rcv+0x10/0x10 [12219.622446][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12219.622749][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12219.623035][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12219.623363][ C1] ? lock_acquire+0x1c1/0x220 [12219.623603][ C1] ? netif_receive_skb_internal+0x84/0x300 [12219.623903][ C1] netif_receive_skb_internal+0xb0/0x300 [12219.624190][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12219.624509][ C1] ? __copy_skb_header+0xaf/0x490 [12219.624768][ C1] ? __skb_clone+0x57a/0x760 [12219.625006][ C1] netif_receive_skb+0x55/0x280 [12219.625257][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12219.625571][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12219.625907][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12219.626207][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12219.626483][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12219.626775][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12219.627091][ C1] ? hlock_class+0x4e/0x130 [12219.627324][ C1] ? get_stack_info_noinstr+0x18/0x110 [12219.627604][ C1] ? get_stack_info_noinstr+0x18/0x110 [12219.627881][ C1] ? __pfx_validate_chain+0x10/0x10 [12219.628148][ C1] ? hlock_class+0x4e/0x130 [12219.628381][ C1] ? mark_lock+0x38/0x3e0 [12219.628601][ C1] ? stack_access_ok+0xda/0x1f0 [12219.628852][ C1] ? __lock_acquire+0xb67/0x1610 [12219.629109][ C1] ? get_stack_info_noinstr+0x18/0x110 [12219.629386][ C1] ? get_stack_info+0x36/0xc0 [12219.629628][ C1] ? stack_access_ok+0xda/0x1f0 [12219.629878][ C1] ? get_reg+0x119/0x190 [12219.630095][ C1] ? unwind_next_frame+0x12af/0x1d10 [12219.630364][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12219.630677][ C1] __tcf_classify+0x329/0x7d0 [12219.630921][ C1] tcf_classify+0x283/0x930 [12219.631155][ C1] ? arch_stack_walk+0xa2/0x100 [12219.631404][ C1] ? __pfx_tcf_classify+0x10/0x10 [12219.631663][ C1] ? get_stack_info+0x36/0xc0 [12219.631911][ C1] tc_run+0x2e4/0x5d0 [12219.632119][ C1] ? __pfx_tc_run+0x10/0x10 [12219.632352][ C1] ? lock_acquire+0x1c1/0x220 [12219.632595][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12219.632857][ C1] __dev_queue_xmit+0x686/0x17e0 [12219.633113][ C1] ? lock_acquire+0x1c1/0x220 [12219.633352][ C1] ? ip_finish_output2+0x786/0x18e0 [12219.633620][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12219.633923][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12219.634201][ C1] ? neigh_hh_output+0x348/0x590 [12219.634455][ C1] ? ip_finish_output2+0x262/0x18e0 [12219.634721][ C1] ip_finish_output2+0x786/0x18e0 [12219.634979][ C1] ? stack_depot_save_flags+0x45/0x550 [12219.635258][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12219.635596][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12219.635874][ C1] ? rcu_read_lock_held+0xe/0x50 [12219.636129][ C1] ? __ip_finish_output+0x10f/0x770 [12219.636397][ C1] ip_output+0x16b/0x4f0 [12219.636614][ C1] ? run_timer_softirq+0x72/0x100 [12219.636872][ C1] ? __pfx_ip_output+0x10/0x10 [12219.637117][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12219.637404][ C1] ? rcu_read_lock_held+0xe/0x50 [12219.637657][ C1] ? ip_local_out+0x114/0x3b0 [12219.637900][ C1] __ip_queue_xmit+0x672/0x1910 [12219.638150][ C1] ? __create_object+0x5e/0xb0 [12219.638395][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12219.638663][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12219.638946][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12219.639220][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12219.639505][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12219.639778][ C1] tcp_delack_timer+0x84/0x240 [12219.640024][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12219.640298][ C1] call_timer_fn+0x173/0x430 [12219.640536][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12219.640799][ C1] ? next_expiry_recalc+0xcd/0x220 [12219.641062][ C1] __run_timers.part.0+0x52d/0x890 [12219.641324][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12219.641598][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12219.641890][ C1] ? lock_acquire+0x1c1/0x220 [12219.642129][ C1] ? clockevents_program_event+0xf6/0x300 [12219.642422][ C1] ? lock_release+0x1d5/0x250 [12219.642663][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12219.642928][ C1] ? ktime_get+0xb3/0x190 [12219.643150][ C1] ? clockevents_program_event+0x1ea/0x300 [12219.643449][ C1] run_timer_softirq+0x72/0x100 [12219.643698][ C1] __do_softirq+0x1b9/0x7ff [12219.643930][ C1] irq_exit_rcu+0x98/0xc0 [12219.644156][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12219.644441][ C1] [12219.644592][ C1] [12219.644744][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12219.645050][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12219.645377][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12219.646355][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12219.646665][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12219.647067][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12219.647467][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12219.647866][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12219.648270][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12219.648673][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12219.648971][ C1] pipe_read+0xa16/0xdf0 [12219.649194][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12219.649471][ C1] ? __pfx_pipe_read+0x10/0x10 [12219.649717][ C1] ? iterate_tty_write+0x299/0x540 [12219.649979][ C1] ? lock_release+0x1d5/0x250 [12219.650223][ C1] vfs_read+0x911/0xc00 [12219.650438][ C1] ? lock_acquire+0x1c1/0x220 [12219.650678][ C1] ? __might_fault+0xc6/0x180 [12219.650920][ C1] ? __pfx_vfs_read+0x10/0x10 [12219.651159][ C1] ? __might_fault+0xc6/0x180 [12219.651401][ C1] ? lock_release+0x1d5/0x250 [12219.651643][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12219.651915][ C1] ? __fget_light+0x54/0x1e0 [12219.652156][ C1] ksys_read+0x17a/0x1e0 [12219.652373][ C1] ? __pfx_ksys_read+0x10/0x10 [12219.652620][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12219.652927][ C1] do_syscall_64+0xc9/0x1e0 [12219.653160][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12219.653463][ C1] RIP: 0033:0x7f08a1ea38b2 [12219.653691][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12219.654669][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12219.655091][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12219.655493][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12219.655895][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12219.656297][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12219.656697][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12219.657103][ C1] [12219.657263][ C1] Sending NMI from CPU 1 to CPUs 2: [12219.657541][ C2] NMI backtrace for cpu 2 [12219.657551][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12219.657559][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12219.657563][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12219.657577][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12219.657580][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12219.657584][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12219.657587][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12219.657589][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12219.657590][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12219.657592][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12219.657594][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12219.657596][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12219.657599][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12219.657601][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12219.657602][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12219.657604][ C2] PKRU: 55555554 [12219.657605][ C2] Call Trace: [12219.657609][ C2] [12219.657614][ C2] ? nmi_cpu_backtrace+0x112/0x220 [12219.657622][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [12219.657629][ C2] ? nmi_handle+0x153/0x420 [12219.657634][ C2] ? default_do_nmi+0x41/0x100 [12219.657638][ C2] ? exc_nmi+0xf3/0x120 [12219.657641][ C2] ? end_repeat_nmi+0xf/0x60 [12219.657648][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12219.657651][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12219.657654][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12219.657657][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12219.657660][ C2] [12219.657661][ C2] [12219.657663][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12219.657666][ C2] ? get_stack_info+0x36/0xc0 [12219.657671][ C2] ? lock_acquire+0x1c1/0x220 [12219.657676][ C2] ? lock_release+0x1d5/0x250 [12219.657679][ C2] do_raw_spin_lock+0x1ec/0x270 [12219.657684][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12219.657687][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12219.657690][ C2] ? lock_acquire+0x1c1/0x220 [12219.657693][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12219.657698][ C2] _raw_spin_lock_nested+0x65/0x80 [12219.657701][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12219.657708][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12219.657710][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12219.657716][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12219.657724][ C2] ip_local_deliver_finish+0x2ae/0x480 [12219.657728][ C2] ip_local_deliver+0x19d/0x480 [12219.657731][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12219.657733][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12219.657736][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12219.657743][ C2] ? rcu_read_lock_held+0xe/0x50 [12219.657748][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12219.657751][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12219.657762][ C2] ip_rcv+0x564/0x740 [12219.657765][ C2] ? __pfx_ip_rcv+0x10/0x10 [12219.657768][ C2] ? set_track_prepare+0x8a/0xd0 [12219.657773][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12219.657776][ C2] ? start_secondary+0x21c/0x2b0 [12219.657781][ C2] ? skb_clone+0x10b/0x330 [12219.657786][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12219.657792][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12219.657798][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12219.657803][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12219.657812][ C2] ? __tcf_classify+0x329/0x7d0 [12219.657816][ C2] ? __pfx_ip_rcv+0x10/0x10 [12219.657818][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12219.657822][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12219.657825][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12219.657830][ C2] ? lock_acquire+0x1c1/0x220 [12219.657832][ C2] ? netif_receive_skb_internal+0x84/0x300 [12219.657836][ C2] netif_receive_skb_internal+0xb0/0x300 [12219.657840][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12219.657844][ C2] ? __copy_skb_header+0xaf/0x490 [12219.657850][ C2] ? __skb_clone+0x57a/0x760 [12219.657852][ C2] netif_receive_skb+0x55/0x280 [12219.657856][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12219.657865][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12219.657871][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12219.657878][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12219.657883][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12219.657893][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12219.657900][ C2] ? get_stack_info+0x36/0xc0 [12219.657905][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12219.657909][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12219.657914][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12219.657917][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12219.657920][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12219.657922][ C2] ? kernel_text_address+0x17/0xe0 [12219.657927][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12219.657933][ C2] ? arch_stack_walk+0x8c/0x100 [12219.657937][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12219.657940][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12219.657944][ C2] ? lock_acquire+0x1c1/0x220 [12219.657946][ C2] ? stack_depot_save_flags+0x281/0x550 [12219.657952][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12219.657958][ C2] ? get_stack_info_noinstr+0x18/0x110 [12219.657961][ C2] ? get_stack_info+0x36/0xc0 [12219.657965][ C2] __tcf_classify+0x329/0x7d0 [12219.657971][ C2] tcf_classify+0x283/0x930 [12219.657976][ C2] ? __pfx_tcf_classify+0x10/0x10 [12219.657979][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12219.657983][ C2] tc_run+0x2e4/0x5d0 [12219.657988][ C2] ? __pfx_tc_run+0x10/0x10 [12219.657991][ C2] ? lock_acquire+0x1c1/0x220 [12219.657994][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12219.657998][ C2] __dev_queue_xmit+0x686/0x17e0 [12219.658003][ C2] ? lock_acquire+0x1c1/0x220 [12219.658005][ C2] ? ip_finish_output2+0x786/0x18e0 [12219.658009][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12219.658012][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12219.658014][ C2] ? neigh_hh_output+0x348/0x590 [12219.658018][ C2] ? ip_finish_output2+0x262/0x18e0 [12219.658022][ C2] ip_finish_output2+0x786/0x18e0 [12219.658025][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12219.658033][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12219.658035][ C2] ? rcu_read_lock_held+0xe/0x50 [12219.658039][ C2] ? __ip_finish_output+0x10f/0x770 [12219.658043][ C2] ip_output+0x16b/0x4f0 [12219.658046][ C2] ? __pfx_ip_output+0x10/0x10 [12219.658049][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12219.658052][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12219.658055][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12219.658059][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12219.658062][ C2] ? __alloc_skb+0xd4/0x280 [12219.658065][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12219.658070][ C2] ? tcp_fragment+0x168/0x1040 [12219.658074][ C2] ? rcu_read_lock_held+0xe/0x50 [12219.658077][ C2] ? ip_local_out+0x114/0x3b0 [12219.658081][ C2] __ip_queue_xmit+0x672/0x1910 [12219.658085][ C2] ? __skb_clone+0x57a/0x760 [12219.658088][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12219.658093][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12219.658096][ C2] ? ipv4_dst_check+0xe3/0x170 [12219.658101][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12219.658106][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12219.658111][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12219.658114][ C2] ? tcp_fragment+0xb0e/0x1040 [12219.658117][ C2] tcp_send_loss_probe+0x348/0x830 [12219.658121][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12219.658123][ C2] tcp_write_timer+0x82/0x1d0 [12219.658127][ C2] call_timer_fn+0x173/0x430 [12219.658133][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12219.658137][ C2] ? next_expiry_recalc+0xcd/0x220 [12219.658142][ C2] __run_timers.part.0+0x52d/0x890 [12219.658145][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12219.658149][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12219.658152][ C2] ? lock_acquire+0x1c1/0x220 [12219.658155][ C2] ? clockevents_program_event+0xf6/0x300 [12219.658159][ C2] ? lock_release+0x1d5/0x250 [12219.658162][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12219.658165][ C2] ? ktime_get+0xb3/0x190 [12219.658169][ C2] ? clockevents_program_event+0x1ea/0x300 [12219.658173][ C2] run_timer_softirq+0x72/0x100 [12219.658176][ C2] __do_softirq+0x1b9/0x7ff [12219.658181][ C2] irq_exit_rcu+0x98/0xc0 [12219.658184][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12219.658188][ C2] [12219.658189][ C2] [12219.658190][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12219.658193][ C2] RIP: 0010:default_idle+0xf/0x20 [12219.658197][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12219.658199][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12219.658202][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12219.658204][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12219.658206][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12219.658207][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12219.658209][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12219.658212][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12219.658215][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12219.658220][ C2] default_idle_call+0x69/0xa0 [12219.658223][ C2] cpuidle_idle_call+0x1f6/0x280 [12219.658226][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12219.658231][ C2] ? lock_release+0x1d5/0x250 [12219.658234][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12219.658239][ C2] do_idle+0xfb/0x160 [12219.658241][ C2] cpu_startup_entry+0x55/0x60 [12219.658244][ C2] start_secondary+0x21c/0x2b0 [12219.658247][ C2] ? __pfx_start_secondary+0x10/0x10 [12219.658251][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12219.658257][ C2] [12244.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9212s! [perl:4135] [12244.569702][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12244.570957][ C1] irq event stamp: 209232 [12244.571176][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12244.571718][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12244.572195][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12244.572661][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12244.573124][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12244.573573][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12244.574185][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12244.574510][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12244.575480][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12244.575786][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12244.576185][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12244.576587][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12244.576985][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12244.577384][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12244.577781][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12244.578228][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12244.578562][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12244.578962][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12244.579361][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12244.579758][ C1] PKRU: 55555554 [12244.579938][ C1] Call Trace: [12244.580111][ C1] [12244.580259][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12244.580521][ C1] ? __run_hrtimer+0x1c0/0x710 [12244.580765][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12244.581042][ C1] ? __hrtimer_run_queues+0x197/0x270 [12244.581316][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12244.581611][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12244.581883][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12244.582191][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12244.582452][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12244.582760][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12244.583056][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12244.583371][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12244.583660][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12244.583955][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12244.584243][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12244.584555][ C1] ? get_stack_info+0x36/0xc0 [12244.584796][ C1] ? lock_acquire+0x1c1/0x220 [12244.585037][ C1] ? lock_release+0x1d5/0x250 [12244.585277][ C1] do_raw_spin_lock+0x1ec/0x270 [12244.585528][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12244.585799][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12244.586086][ C1] ? lock_acquire+0x1c1/0x220 [12244.586326][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12244.586569][ C1] _raw_spin_lock_nested+0x65/0x80 [12244.586828][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12244.587065][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12244.587314][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12244.587572][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12244.587851][ C1] ip_local_deliver_finish+0x2ae/0x480 [12244.588130][ C1] ip_local_deliver+0x19d/0x480 [12244.588378][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12244.588653][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12244.588918][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12244.589268][ C1] ? rcu_read_lock_held+0xe/0x50 [12244.589521][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12244.589843][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12244.590108][ C1] ip_rcv+0x564/0x740 [12244.590312][ C1] ? __pfx_ip_rcv+0x10/0x10 [12244.590545][ C1] ? set_track_prepare+0x8a/0xd0 [12244.590800][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12244.591077][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12244.591349][ C1] ? skb_clone+0x10b/0x330 [12244.591588][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12244.591909][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12244.592217][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12244.592501][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12244.592797][ C1] ? __tcf_classify+0x329/0x7d0 [12244.593046][ C1] ? __pfx_ip_rcv+0x10/0x10 [12244.593280][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12244.593583][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12244.593868][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12244.594196][ C1] ? lock_acquire+0x1c1/0x220 [12244.594437][ C1] ? netif_receive_skb_internal+0x84/0x300 [12244.594733][ C1] netif_receive_skb_internal+0xb0/0x300 [12244.595020][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12244.595340][ C1] ? __copy_skb_header+0xaf/0x490 [12244.595599][ C1] ? __skb_clone+0x57a/0x760 [12244.595835][ C1] netif_receive_skb+0x55/0x280 [12244.596084][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12244.596397][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12244.596730][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12244.597033][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12244.597309][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12244.597601][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12244.597912][ C1] ? hlock_class+0x4e/0x130 [12244.598146][ C1] ? get_stack_info_noinstr+0x18/0x110 [12244.598423][ C1] ? get_stack_info_noinstr+0x18/0x110 [12244.598703][ C1] ? __pfx_validate_chain+0x10/0x10 [12244.598967][ C1] ? hlock_class+0x4e/0x130 [12244.599199][ C1] ? mark_lock+0x38/0x3e0 [12244.599421][ C1] ? stack_access_ok+0xda/0x1f0 [12244.599672][ C1] ? __lock_acquire+0xb67/0x1610 [12244.599927][ C1] ? get_stack_info_noinstr+0x18/0x110 [12244.600204][ C1] ? get_stack_info+0x36/0xc0 [12244.600447][ C1] ? stack_access_ok+0xda/0x1f0 [12244.600695][ C1] ? get_reg+0x119/0x190 [12244.600912][ C1] ? unwind_next_frame+0x12af/0x1d10 [12244.601182][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12244.601491][ C1] __tcf_classify+0x329/0x7d0 [12244.601741][ C1] tcf_classify+0x283/0x930 [12244.601972][ C1] ? arch_stack_walk+0xa2/0x100 [12244.602223][ C1] ? __pfx_tcf_classify+0x10/0x10 [12244.602479][ C1] ? get_stack_info+0x36/0xc0 [12244.602722][ C1] tc_run+0x2e4/0x5d0 [12244.602927][ C1] ? __pfx_tc_run+0x10/0x10 [12244.603161][ C1] ? lock_acquire+0x1c1/0x220 [12244.603401][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12244.603664][ C1] __dev_queue_xmit+0x686/0x17e0 [12244.603917][ C1] ? lock_acquire+0x1c1/0x220 [12244.604157][ C1] ? ip_finish_output2+0x786/0x18e0 [12244.604423][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12244.604729][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12244.605003][ C1] ? neigh_hh_output+0x348/0x590 [12244.605259][ C1] ? ip_finish_output2+0x262/0x18e0 [12244.605527][ C1] ip_finish_output2+0x786/0x18e0 [12244.605784][ C1] ? stack_depot_save_flags+0x45/0x550 [12244.606064][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12244.606403][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12244.606681][ C1] ? rcu_read_lock_held+0xe/0x50 [12244.606935][ C1] ? __ip_finish_output+0x10f/0x770 [12244.607201][ C1] ip_output+0x16b/0x4f0 [12244.607421][ C1] ? run_timer_softirq+0x72/0x100 [12244.607679][ C1] ? __pfx_ip_output+0x10/0x10 [12244.607922][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12244.608210][ C1] ? rcu_read_lock_held+0xe/0x50 [12244.608463][ C1] ? ip_local_out+0x114/0x3b0 [12244.608705][ C1] __ip_queue_xmit+0x672/0x1910 [12244.608954][ C1] ? __create_object+0x5e/0xb0 [12244.609198][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12244.609467][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12244.609750][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12244.610023][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12244.610308][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12244.610582][ C1] tcp_delack_timer+0x84/0x240 [12244.610826][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12244.611099][ C1] call_timer_fn+0x173/0x430 [12244.611335][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12244.611605][ C1] ? next_expiry_recalc+0xcd/0x220 [12244.611868][ C1] __run_timers.part.0+0x52d/0x890 [12244.612130][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12244.612406][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12244.612691][ C1] ? lock_acquire+0x1c1/0x220 [12244.612932][ C1] ? clockevents_program_event+0xf6/0x300 [12244.613225][ C1] ? lock_release+0x1d5/0x250 [12244.613463][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12244.613732][ C1] ? ktime_get+0xb3/0x190 [12244.613954][ C1] ? clockevents_program_event+0x1ea/0x300 [12244.614254][ C1] run_timer_softirq+0x72/0x100 [12244.614502][ C1] __do_softirq+0x1b9/0x7ff [12244.614735][ C1] irq_exit_rcu+0x98/0xc0 [12244.614957][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12244.615248][ C1] [12244.615399][ C1] [12244.615552][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12244.615856][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12244.616184][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12244.617157][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12244.617465][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12244.617866][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12244.618266][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12244.618665][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12244.619064][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12244.619469][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12244.619765][ C1] pipe_read+0xa16/0xdf0 [12244.619989][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12244.620268][ C1] ? __pfx_pipe_read+0x10/0x10 [12244.620513][ C1] ? iterate_tty_write+0x299/0x540 [12244.620775][ C1] ? lock_release+0x1d5/0x250 [12244.621017][ C1] vfs_read+0x911/0xc00 [12244.621233][ C1] ? lock_acquire+0x1c1/0x220 [12244.621473][ C1] ? __might_fault+0xc6/0x180 [12244.621719][ C1] ? __pfx_vfs_read+0x10/0x10 [12244.621960][ C1] ? __might_fault+0xc6/0x180 [12244.622202][ C1] ? lock_release+0x1d5/0x250 [12244.622443][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12244.622713][ C1] ? __fget_light+0x54/0x1e0 [12244.622951][ C1] ksys_read+0x17a/0x1e0 [12244.623171][ C1] ? __pfx_ksys_read+0x10/0x10 [12244.623418][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12244.623722][ C1] do_syscall_64+0xc9/0x1e0 [12244.623956][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12244.624258][ C1] RIP: 0033:0x7f08a1ea38b2 [12244.624485][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12244.625462][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12244.625886][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12244.626287][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12244.626687][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12244.627087][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12244.627488][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12244.627890][ C1] [12244.628050][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9212s! [swapper/2:0] [12244.628483][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12244.629738][ C2] irq event stamp: 44114564 [12244.629967][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12244.630504][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12244.631015][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12244.631490][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12244.631967][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12244.632423][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12244.633038][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12244.633363][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12244.634335][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12244.634642][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12244.635041][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12244.635441][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12244.635837][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12244.636234][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12244.636633][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12244.637079][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12244.637412][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12244.637810][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12244.638207][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12244.638606][ C2] PKRU: 55555554 [12244.638785][ C2] Call Trace: [12244.638957][ C2] [12244.639105][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12244.639368][ C2] ? __run_hrtimer+0x1c0/0x710 [12244.639610][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12244.639889][ C2] ? __hrtimer_run_queues+0x197/0x270 [12244.640161][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12244.640447][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12244.640714][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12244.641018][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12244.641279][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12244.641545][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12244.641857][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12244.642156][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12244.642470][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12244.642757][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12244.643052][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12244.643340][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12244.643652][ C2] ? get_stack_info+0x36/0xc0 [12244.643894][ C2] ? lock_acquire+0x1c1/0x220 [12244.644137][ C2] ? lock_release+0x1d5/0x250 [12244.644375][ C2] do_raw_spin_lock+0x1ec/0x270 [12244.644622][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12244.644895][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12244.645178][ C2] ? lock_acquire+0x1c1/0x220 [12244.645417][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12244.645656][ C2] _raw_spin_lock_nested+0x65/0x80 [12244.645916][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12244.646149][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12244.646395][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12244.646651][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12244.646924][ C2] ip_local_deliver_finish+0x2ae/0x480 [12244.647204][ C2] ip_local_deliver+0x19d/0x480 [12244.647450][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12244.647721][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12244.647983][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12244.648328][ C2] ? rcu_read_lock_held+0xe/0x50 [12244.648581][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12244.648899][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12244.649162][ C2] ip_rcv+0x564/0x740 [12244.649366][ C2] ? __pfx_ip_rcv+0x10/0x10 [12244.649596][ C2] ? set_track_prepare+0x8a/0xd0 [12244.649849][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12244.650124][ C2] ? start_secondary+0x21c/0x2b0 [12244.650375][ C2] ? skb_clone+0x10b/0x330 [12244.650603][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12244.650921][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12244.651226][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12244.651508][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12244.651812][ C2] ? __tcf_classify+0x329/0x7d0 [12244.652061][ C2] ? __pfx_ip_rcv+0x10/0x10 [12244.652293][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12244.652591][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12244.652875][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12244.653200][ C2] ? lock_acquire+0x1c1/0x220 [12244.653437][ C2] ? netif_receive_skb_internal+0x84/0x300 [12244.653731][ C2] netif_receive_skb_internal+0xb0/0x300 [12244.654017][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12244.654333][ C2] ? __copy_skb_header+0xaf/0x490 [12244.654590][ C2] ? __skb_clone+0x57a/0x760 [12244.654825][ C2] netif_receive_skb+0x55/0x280 [12244.655071][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12244.655384][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12244.655714][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12244.656014][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12244.656287][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12244.656576][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12244.656886][ C2] ? get_stack_info+0x36/0xc0 [12244.657128][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12244.657391][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12244.657709][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12244.657983][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12244.658262][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12244.658574][ C2] ? kernel_text_address+0x17/0xe0 [12244.658836][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12244.659150][ C2] ? arch_stack_walk+0x8c/0x100 [12244.659398][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12244.659663][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12244.659946][ C2] ? lock_acquire+0x1c1/0x220 [12244.660189][ C2] ? stack_depot_save_flags+0x281/0x550 [12244.660469][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12244.660774][ C2] ? get_stack_info_noinstr+0x18/0x110 [12244.661048][ C2] ? get_stack_info+0x36/0xc0 [12244.661291][ C2] __tcf_classify+0x329/0x7d0 [12244.661532][ C2] tcf_classify+0x283/0x930 [12244.661777][ C2] ? __pfx_tcf_classify+0x10/0x10 [12244.662033][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12244.662345][ C2] tc_run+0x2e4/0x5d0 [12244.662551][ C2] ? __pfx_tc_run+0x10/0x10 [12244.662781][ C2] ? lock_acquire+0x1c1/0x220 [12244.663019][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12244.663280][ C2] __dev_queue_xmit+0x686/0x17e0 [12244.663533][ C2] ? lock_acquire+0x1c1/0x220 [12244.663771][ C2] ? ip_finish_output2+0x786/0x18e0 [12244.664034][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12244.664336][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12244.664608][ C2] ? neigh_hh_output+0x348/0x590 [12244.664864][ C2] ? ip_finish_output2+0x262/0x18e0 [12244.665128][ C2] ip_finish_output2+0x786/0x18e0 [12244.665383][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12244.665719][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12244.665993][ C2] ? rcu_read_lock_held+0xe/0x50 [12244.666245][ C2] ? __ip_finish_output+0x10f/0x770 [12244.666508][ C2] ip_output+0x16b/0x4f0 [12244.666727][ C2] ? __pfx_ip_output+0x10/0x10 [12244.666969][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12244.667245][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12244.667556][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12244.667838][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12244.668087][ C2] ? __alloc_skb+0xd4/0x280 [12244.668319][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12244.668588][ C2] ? tcp_fragment+0x168/0x1040 [12244.668840][ C2] ? rcu_read_lock_held+0xe/0x50 [12244.669090][ C2] ? ip_local_out+0x114/0x3b0 [12244.669328][ C2] __ip_queue_xmit+0x672/0x1910 [12244.669577][ C2] ? __skb_clone+0x57a/0x760 [12244.669812][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12244.670077][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12244.670356][ C2] ? ipv4_dst_check+0xe3/0x170 [12244.670602][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12244.670852][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12244.671154][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12244.671473][ C2] ? tcp_fragment+0xb0e/0x1040 [12244.671723][ C2] tcp_send_loss_probe+0x348/0x830 [12244.671982][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12244.672251][ C2] tcp_write_timer+0x82/0x1d0 [12244.672491][ C2] call_timer_fn+0x173/0x430 [12244.672727][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12244.672987][ C2] ? next_expiry_recalc+0xcd/0x220 [12244.673254][ C2] __run_timers.part.0+0x52d/0x890 [12244.673516][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12244.673785][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12244.674069][ C2] ? lock_acquire+0x1c1/0x220 [12244.674308][ C2] ? clockevents_program_event+0xf6/0x300 [12244.674597][ C2] ? lock_release+0x1d5/0x250 [12244.674836][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12244.675099][ C2] ? ktime_get+0xb3/0x190 [12244.675322][ C2] ? clockevents_program_event+0x1ea/0x300 [12244.675616][ C2] run_timer_softirq+0x72/0x100 [12244.675864][ C2] __do_softirq+0x1b9/0x7ff [12244.676097][ C2] irq_exit_rcu+0x98/0xc0 [12244.676317][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12244.676604][ C2] [12244.676753][ C2] [12244.676902][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12244.677208][ C2] RIP: 0010:default_idle+0xf/0x20 [12244.677464][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12244.678429][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12244.678737][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12244.679134][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12244.679533][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12244.679930][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12244.680328][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12244.680725][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12244.681015][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12244.681277][ C2] default_idle_call+0x69/0xa0 [12244.681522][ C2] cpuidle_idle_call+0x1f6/0x280 [12244.681779][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12244.682055][ C2] ? lock_release+0x1d5/0x250 [12244.682294][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12244.682565][ C2] do_idle+0xfb/0x160 [12244.682768][ C2] cpu_startup_entry+0x55/0x60 [12244.683010][ C2] start_secondary+0x21c/0x2b0 [12244.683254][ C2] ? __pfx_start_secondary+0x10/0x10 [12244.683522][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12244.683832][ C2] [12272.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9238s! [swapper/2:0] [12272.569699][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12272.570951][ C2] irq event stamp: 44114564 [12272.571181][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12272.571718][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12272.572227][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12272.572703][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12272.573173][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12272.573627][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12272.574235][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12272.574558][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12272.575523][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12272.575831][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12272.576228][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12272.576625][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12272.577020][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12272.577419][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12272.577814][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12272.578258][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12272.578588][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12272.578984][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12272.579384][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12272.579781][ C2] PKRU: 55555554 [12272.579963][ C2] Call Trace: [12272.580133][ C2] [12272.580282][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12272.580544][ C2] ? __run_hrtimer+0x1c0/0x710 [12272.580786][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12272.581061][ C2] ? __hrtimer_run_queues+0x197/0x270 [12272.581332][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12272.581625][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12272.581891][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12272.582201][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12272.582461][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12272.582722][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12272.583028][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12272.583322][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12272.583634][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12272.583922][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12272.584216][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12272.584504][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12272.584814][ C2] ? get_stack_info+0x36/0xc0 [12272.585054][ C2] ? lock_acquire+0x1c1/0x220 [12272.585294][ C2] ? lock_release+0x1d5/0x250 [12272.585533][ C2] do_raw_spin_lock+0x1ec/0x270 [12272.585781][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12272.586052][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12272.586335][ C2] ? lock_acquire+0x1c1/0x220 [12272.586573][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12272.586814][ C2] _raw_spin_lock_nested+0x65/0x80 [12272.587072][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12272.587306][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12272.587551][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12272.587812][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12272.588089][ C2] ip_local_deliver_finish+0x2ae/0x480 [12272.588364][ C2] ip_local_deliver+0x19d/0x480 [12272.588611][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12272.588880][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12272.589142][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12272.589491][ C2] ? rcu_read_lock_held+0xe/0x50 [12272.589742][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12272.590061][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12272.590323][ C2] ip_rcv+0x564/0x740 [12272.590528][ C2] ? __pfx_ip_rcv+0x10/0x10 [12272.590755][ C2] ? set_track_prepare+0x8a/0xd0 [12272.591006][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12272.591283][ C2] ? start_secondary+0x21c/0x2b0 [12272.591539][ C2] ? skb_clone+0x10b/0x330 [12272.591771][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12272.592089][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12272.592395][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12272.592673][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12272.592968][ C2] ? __tcf_classify+0x329/0x7d0 [12272.593215][ C2] ? __pfx_ip_rcv+0x10/0x10 [12272.593444][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12272.593743][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12272.594026][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12272.594350][ C2] ? lock_acquire+0x1c1/0x220 [12272.594587][ C2] ? netif_receive_skb_internal+0x84/0x300 [12272.594882][ C2] netif_receive_skb_internal+0xb0/0x300 [12272.595165][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12272.595480][ C2] ? __copy_skb_header+0xaf/0x490 [12272.595737][ C2] ? __skb_clone+0x57a/0x760 [12272.595976][ C2] netif_receive_skb+0x55/0x280 [12272.596223][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12272.596532][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12272.596863][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12272.597159][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12272.597432][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12272.597721][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12272.598032][ C2] ? get_stack_info+0x36/0xc0 [12272.598271][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12272.598537][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12272.598854][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12272.599130][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12272.599405][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12272.599718][ C2] ? kernel_text_address+0x17/0xe0 [12272.599977][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12272.600289][ C2] ? arch_stack_walk+0x8c/0x100 [12272.600538][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12272.600801][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12272.601083][ C2] ? lock_acquire+0x1c1/0x220 [12272.601326][ C2] ? stack_depot_save_flags+0x281/0x550 [12272.601613][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12272.601916][ C2] ? get_stack_info_noinstr+0x18/0x110 [12272.602192][ C2] ? get_stack_info+0x36/0xc0 [12272.602430][ C2] __tcf_classify+0x329/0x7d0 [12272.602672][ C2] tcf_classify+0x283/0x930 [12272.602903][ C2] ? __pfx_tcf_classify+0x10/0x10 [12272.603159][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12272.603471][ C2] tc_run+0x2e4/0x5d0 [12272.603676][ C2] ? __pfx_tc_run+0x10/0x10 [12272.603904][ C2] ? lock_acquire+0x1c1/0x220 [12272.604143][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12272.604402][ C2] __dev_queue_xmit+0x686/0x17e0 [12272.604654][ C2] ? lock_acquire+0x1c1/0x220 [12272.604892][ C2] ? ip_finish_output2+0x786/0x18e0 [12272.605157][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12272.605460][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12272.605730][ C2] ? neigh_hh_output+0x348/0x590 [12272.605982][ C2] ? ip_finish_output2+0x262/0x18e0 [12272.606245][ C2] ip_finish_output2+0x786/0x18e0 [12272.606506][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12272.606841][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12272.607117][ C2] ? rcu_read_lock_held+0xe/0x50 [12272.607367][ C2] ? __ip_finish_output+0x10f/0x770 [12272.607632][ C2] ip_output+0x16b/0x4f0 [12272.607847][ C2] ? __pfx_ip_output+0x10/0x10 [12272.608090][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12272.608364][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12272.608674][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12272.608950][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12272.609199][ C2] ? __alloc_skb+0xd4/0x280 [12272.609430][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12272.609699][ C2] ? tcp_fragment+0x168/0x1040 [12272.609943][ C2] ? rcu_read_lock_held+0xe/0x50 [12272.610194][ C2] ? ip_local_out+0x114/0x3b0 [12272.610433][ C2] __ip_queue_xmit+0x672/0x1910 [12272.610680][ C2] ? __skb_clone+0x57a/0x760 [12272.610914][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12272.611179][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12272.611466][ C2] ? ipv4_dst_check+0xe3/0x170 [12272.611710][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12272.611958][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12272.612260][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12272.612577][ C2] ? tcp_fragment+0xb0e/0x1040 [12272.612821][ C2] tcp_send_loss_probe+0x348/0x830 [12272.613080][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12272.613348][ C2] tcp_write_timer+0x82/0x1d0 [12272.613586][ C2] call_timer_fn+0x173/0x430 [12272.613822][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12272.614082][ C2] ? next_expiry_recalc+0xcd/0x220 [12272.614342][ C2] __run_timers.part.0+0x52d/0x890 [12272.614607][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12272.614880][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12272.615162][ C2] ? lock_acquire+0x1c1/0x220 [12272.615401][ C2] ? clockevents_program_event+0xf6/0x300 [12272.615692][ C2] ? lock_release+0x1d5/0x250 [12272.615929][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12272.616193][ C2] ? ktime_get+0xb3/0x190 [12272.616413][ C2] ? clockevents_program_event+0x1ea/0x300 [12272.616708][ C2] run_timer_softirq+0x72/0x100 [12272.616953][ C2] __do_softirq+0x1b9/0x7ff [12272.617188][ C2] irq_exit_rcu+0x98/0xc0 [12272.617411][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12272.617698][ C2] [12272.617847][ C2] [12272.617998][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12272.618300][ C2] RIP: 0010:default_idle+0xf/0x20 [12272.618556][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12272.619526][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12272.619831][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12272.620231][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12272.620627][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12272.621024][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12272.621426][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12272.621826][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12272.622112][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12272.622373][ C2] default_idle_call+0x69/0xa0 [12272.622616][ C2] cpuidle_idle_call+0x1f6/0x280 [12272.622866][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12272.623143][ C2] ? lock_release+0x1d5/0x250 [12272.623381][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12272.623652][ C2] do_idle+0xfb/0x160 [12272.623855][ C2] cpu_startup_entry+0x55/0x60 [12272.624098][ C2] start_secondary+0x21c/0x2b0 [12272.624340][ C2] ? __pfx_start_secondary+0x10/0x10 [12272.624608][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12272.624918][ C2] [12272.625075][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9238s! [perl:4135] [12272.625499][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12272.626754][ C1] irq event stamp: 209232 [12272.626976][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12272.627505][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12272.627981][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12272.628452][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12272.628913][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12272.629363][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12272.629974][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12272.630301][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12272.631271][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12272.631584][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12272.631985][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12272.632385][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12272.632782][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12272.633182][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12272.633582][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12272.634029][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12272.634362][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12272.634761][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12272.635163][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12272.635563][ C1] PKRU: 55555554 [12272.635745][ C1] Call Trace: [12272.635914][ C1] [12272.636065][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12272.636328][ C1] ? __run_hrtimer+0x1c0/0x710 [12272.636572][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12272.636853][ C1] ? __hrtimer_run_queues+0x197/0x270 [12272.637126][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12272.637416][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12272.637682][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12272.637990][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12272.638255][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12272.638562][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12272.638859][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12272.639175][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12272.639462][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12272.639758][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12272.640046][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12272.640357][ C1] ? get_stack_info+0x36/0xc0 [12272.640600][ C1] ? lock_acquire+0x1c1/0x220 [12272.640841][ C1] ? lock_release+0x1d5/0x250 [12272.641082][ C1] do_raw_spin_lock+0x1ec/0x270 [12272.641331][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12272.641610][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12272.641895][ C1] ? lock_acquire+0x1c1/0x220 [12272.642135][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12272.642377][ C1] _raw_spin_lock_nested+0x65/0x80 [12272.642637][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12272.642869][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12272.643118][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12272.643376][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12272.643652][ C1] ip_local_deliver_finish+0x2ae/0x480 [12272.643933][ C1] ip_local_deliver+0x19d/0x480 [12272.644181][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12272.644452][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12272.644715][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12272.645062][ C1] ? rcu_read_lock_held+0xe/0x50 [12272.645315][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12272.645634][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12272.645897][ C1] ip_rcv+0x564/0x740 [12272.646103][ C1] ? __pfx_ip_rcv+0x10/0x10 [12272.646333][ C1] ? set_track_prepare+0x8a/0xd0 [12272.646587][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12272.646863][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12272.647138][ C1] ? skb_clone+0x10b/0x330 [12272.647364][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12272.647683][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12272.647988][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12272.648270][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12272.648566][ C1] ? __tcf_classify+0x329/0x7d0 [12272.648815][ C1] ? __pfx_ip_rcv+0x10/0x10 [12272.649043][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12272.649344][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12272.649628][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12272.649953][ C1] ? lock_acquire+0x1c1/0x220 [12272.650192][ C1] ? netif_receive_skb_internal+0x84/0x300 [12272.650489][ C1] netif_receive_skb_internal+0xb0/0x300 [12272.650773][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12272.651089][ C1] ? __copy_skb_header+0xaf/0x490 [12272.651347][ C1] ? __skb_clone+0x57a/0x760 [12272.651589][ C1] netif_receive_skb+0x55/0x280 [12272.651837][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12272.652151][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12272.652483][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12272.652780][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12272.653057][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12272.653345][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12272.653662][ C1] ? hlock_class+0x4e/0x130 [12272.653895][ C1] ? get_stack_info_noinstr+0x18/0x110 [12272.654175][ C1] ? get_stack_info_noinstr+0x18/0x110 [12272.654455][ C1] ? __pfx_validate_chain+0x10/0x10 [12272.654718][ C1] ? hlock_class+0x4e/0x130 [12272.654951][ C1] ? mark_lock+0x38/0x3e0 [12272.655171][ C1] ? stack_access_ok+0xda/0x1f0 [12272.655420][ C1] ? __lock_acquire+0xb67/0x1610 [12272.655675][ C1] ? get_stack_info_noinstr+0x18/0x110 [12272.655954][ C1] ? get_stack_info+0x36/0xc0 [12272.656196][ C1] ? stack_access_ok+0xda/0x1f0 [12272.656444][ C1] ? get_reg+0x119/0x190 [12272.656660][ C1] ? unwind_next_frame+0x12af/0x1d10 [12272.656931][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12272.657241][ C1] __tcf_classify+0x329/0x7d0 [12272.657486][ C1] tcf_classify+0x283/0x930 [12272.657720][ C1] ? arch_stack_walk+0xa2/0x100 [12272.657970][ C1] ? __pfx_tcf_classify+0x10/0x10 [12272.658230][ C1] ? get_stack_info+0x36/0xc0 [12272.658469][ C1] tc_run+0x2e4/0x5d0 [12272.658678][ C1] ? __pfx_tc_run+0x10/0x10 [12272.658909][ C1] ? lock_acquire+0x1c1/0x220 [12272.659150][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12272.659412][ C1] __dev_queue_xmit+0x686/0x17e0 [12272.659666][ C1] ? lock_acquire+0x1c1/0x220 [12272.659906][ C1] ? ip_finish_output2+0x786/0x18e0 [12272.660173][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12272.660479][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12272.660752][ C1] ? neigh_hh_output+0x348/0x590 [12272.661006][ C1] ? ip_finish_output2+0x262/0x18e0 [12272.661272][ C1] ip_finish_output2+0x786/0x18e0 [12272.661535][ C1] ? stack_depot_save_flags+0x45/0x550 [12272.661813][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12272.662151][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12272.662432][ C1] ? rcu_read_lock_held+0xe/0x50 [12272.662686][ C1] ? __ip_finish_output+0x10f/0x770 [12272.662951][ C1] ip_output+0x16b/0x4f0 [12272.663169][ C1] ? run_timer_softirq+0x72/0x100 [12272.663427][ C1] ? __pfx_ip_output+0x10/0x10 [12272.663672][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12272.663958][ C1] ? rcu_read_lock_held+0xe/0x50 [12272.664213][ C1] ? ip_local_out+0x114/0x3b0 [12272.664455][ C1] __ip_queue_xmit+0x672/0x1910 [12272.664705][ C1] ? __create_object+0x5e/0xb0 [12272.664951][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12272.665222][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12272.665503][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12272.665778][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12272.666061][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12272.666334][ C1] tcp_delack_timer+0x84/0x240 [12272.666579][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12272.666851][ C1] call_timer_fn+0x173/0x430 [12272.667091][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12272.667356][ C1] ? next_expiry_recalc+0xcd/0x220 [12272.667619][ C1] __run_timers.part.0+0x52d/0x890 [12272.667880][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12272.668155][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12272.668443][ C1] ? lock_acquire+0x1c1/0x220 [12272.668682][ C1] ? clockevents_program_event+0xf6/0x300 [12272.668974][ C1] ? lock_release+0x1d5/0x250 [12272.669217][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12272.669482][ C1] ? ktime_get+0xb3/0x190 [12272.669702][ C1] ? clockevents_program_event+0x1ea/0x300 [12272.670001][ C1] run_timer_softirq+0x72/0x100 [12272.670252][ C1] __do_softirq+0x1b9/0x7ff [12272.670485][ C1] irq_exit_rcu+0x98/0xc0 [12272.670707][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12272.670993][ C1] [12272.671147][ C1] [12272.671297][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12272.671607][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12272.671934][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12272.672911][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12272.673221][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12272.673621][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12272.674020][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12272.674423][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12272.674824][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12272.675227][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12272.675525][ C1] pipe_read+0xa16/0xdf0 [12272.675746][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12272.676023][ C1] ? __pfx_pipe_read+0x10/0x10 [12272.676268][ C1] ? iterate_tty_write+0x299/0x540 [12272.676530][ C1] ? lock_release+0x1d5/0x250 [12272.676772][ C1] vfs_read+0x911/0xc00 [12272.676987][ C1] ? lock_acquire+0x1c1/0x220 [12272.677229][ C1] ? __might_fault+0xc6/0x180 [12272.677472][ C1] ? __pfx_vfs_read+0x10/0x10 [12272.677711][ C1] ? __might_fault+0xc6/0x180 [12272.677950][ C1] ? lock_release+0x1d5/0x250 [12272.678193][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12272.678458][ C1] ? __fget_light+0x54/0x1e0 [12272.678698][ C1] ksys_read+0x17a/0x1e0 [12272.678915][ C1] ? __pfx_ksys_read+0x10/0x10 [12272.679162][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12272.679468][ C1] do_syscall_64+0xc9/0x1e0 [12272.679702][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12272.680002][ C1] RIP: 0033:0x7f08a1ea38b2 [12272.680233][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12272.681209][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12272.681636][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12272.682039][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12272.682440][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12272.682840][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12272.683240][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12272.683647][ C1] [12297.657104][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [12297.657491][ C1] rcu: 1-....: (9628424 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2333688 [12297.658053][ C1] rcu: (t=9942770 jiffies g=1882453 q=730 ncpus=4) [12297.658395][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12297.658847][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12297.659464][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12297.659800][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12297.660778][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12297.661090][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12297.661497][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12297.661897][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12297.662302][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12297.662705][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12297.663106][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12297.663556][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12297.663889][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12297.664292][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12297.664695][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12297.665095][ C1] PKRU: 55555554 [12297.665279][ C1] Call Trace: [12297.665451][ C1] [12297.665601][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [12297.665874][ C1] ? print_cpu_stall+0x263/0x6a0 [12297.666129][ C1] ? check_cpu_stall+0x284/0x500 [12297.666383][ C1] ? rcu_pending+0x92/0x360 [12297.666615][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [12297.666887][ C1] ? update_process_times+0xb9/0x110 [12297.667158][ C1] ? tick_sched_handle+0x67/0x130 [12297.667415][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [12297.667700][ C1] ? __run_hrtimer+0x1c0/0x710 [12297.667945][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [12297.668260][ C1] ? __hrtimer_run_queues+0x197/0x270 [12297.668533][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12297.668825][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12297.669091][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12297.669400][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12297.669664][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12297.669974][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12297.670271][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12297.670587][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12297.670878][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12297.671175][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12297.671472][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12297.671786][ C1] ? get_stack_info+0x36/0xc0 [12297.672026][ C1] ? lock_acquire+0x1c1/0x220 [12297.672269][ C1] ? lock_release+0x1d5/0x250 [12297.672510][ C1] do_raw_spin_lock+0x1ec/0x270 [12297.672761][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12297.673035][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12297.673321][ C1] ? lock_acquire+0x1c1/0x220 [12297.673561][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12297.673804][ C1] _raw_spin_lock_nested+0x65/0x80 [12297.674065][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12297.674301][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12297.674549][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12297.674808][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12297.675087][ C1] ip_local_deliver_finish+0x2ae/0x480 [12297.675365][ C1] ip_local_deliver+0x19d/0x480 [12297.675614][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12297.675889][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12297.676153][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12297.676503][ C1] ? rcu_read_lock_held+0xe/0x50 [12297.676757][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12297.677078][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12297.677345][ C1] ip_rcv+0x564/0x740 [12297.677550][ C1] ? __pfx_ip_rcv+0x10/0x10 [12297.677781][ C1] ? set_track_prepare+0x8a/0xd0 [12297.678034][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12297.678314][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12297.678587][ C1] ? skb_clone+0x10b/0x330 [12297.678816][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12297.679136][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12297.679443][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12297.679727][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12297.680022][ C1] ? __tcf_classify+0x329/0x7d0 [12297.680273][ C1] ? __pfx_ip_rcv+0x10/0x10 [12297.680505][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12297.680803][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12297.681091][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12297.681425][ C1] ? lock_acquire+0x1c1/0x220 [12297.681664][ C1] ? netif_receive_skb_internal+0x84/0x300 [12297.681962][ C1] netif_receive_skb_internal+0xb0/0x300 [12297.682250][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12297.682566][ C1] ? __copy_skb_header+0xaf/0x490 [12297.682824][ C1] ? __skb_clone+0x57a/0x760 [12297.683060][ C1] netif_receive_skb+0x55/0x280 [12297.683310][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12297.683625][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12297.683957][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12297.684258][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12297.684534][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12297.684822][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12297.685136][ C1] ? hlock_class+0x4e/0x130 [12297.685370][ C1] ? get_stack_info_noinstr+0x18/0x110 [12297.685647][ C1] ? get_stack_info_noinstr+0x18/0x110 [12297.685922][ C1] ? __pfx_validate_chain+0x10/0x10 [12297.686188][ C1] ? hlock_class+0x4e/0x130 [12297.686420][ C1] ? mark_lock+0x38/0x3e0 [12297.686640][ C1] ? stack_access_ok+0xda/0x1f0 [12297.686888][ C1] ? __lock_acquire+0xb67/0x1610 [12297.687148][ C1] ? get_stack_info_noinstr+0x18/0x110 [12297.687426][ C1] ? get_stack_info+0x36/0xc0 [12297.687665][ C1] ? stack_access_ok+0xda/0x1f0 [12297.687913][ C1] ? get_reg+0x119/0x190 [12297.688132][ C1] ? unwind_next_frame+0x12af/0x1d10 [12297.688401][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12297.688711][ C1] __tcf_classify+0x329/0x7d0 [12297.688952][ C1] tcf_classify+0x283/0x930 [12297.689185][ C1] ? arch_stack_walk+0xa2/0x100 [12297.689436][ C1] ? __pfx_tcf_classify+0x10/0x10 [12297.689693][ C1] ? get_stack_info+0x36/0xc0 [12297.689936][ C1] tc_run+0x2e4/0x5d0 [12297.690143][ C1] ? __pfx_tc_run+0x10/0x10 [12297.690374][ C1] ? lock_acquire+0x1c1/0x220 [12297.690613][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12297.690874][ C1] __dev_queue_xmit+0x686/0x17e0 [12297.691128][ C1] ? lock_acquire+0x1c1/0x220 [12297.691374][ C1] ? ip_finish_output2+0x786/0x18e0 [12297.691640][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12297.691946][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12297.692219][ C1] ? neigh_hh_output+0x348/0x590 [12297.692474][ C1] ? ip_finish_output2+0x262/0x18e0 [12297.692739][ C1] ip_finish_output2+0x786/0x18e0 [12297.692996][ C1] ? stack_depot_save_flags+0x45/0x550 [12297.693277][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12297.693618][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12297.693895][ C1] ? rcu_read_lock_held+0xe/0x50 [12297.694150][ C1] ? __ip_finish_output+0x10f/0x770 [12297.694415][ C1] ip_output+0x16b/0x4f0 [12297.694631][ C1] ? run_timer_softirq+0x72/0x100 [12297.694889][ C1] ? __pfx_ip_output+0x10/0x10 [12297.695135][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12297.695424][ C1] ? rcu_read_lock_held+0xe/0x50 [12297.695678][ C1] ? ip_local_out+0x114/0x3b0 [12297.695918][ C1] __ip_queue_xmit+0x672/0x1910 [12297.696169][ C1] ? __create_object+0x5e/0xb0 [12297.696415][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12297.696683][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12297.696966][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12297.697242][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12297.697527][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12297.697798][ C1] tcp_delack_timer+0x84/0x240 [12297.698044][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12297.698319][ C1] call_timer_fn+0x173/0x430 [12297.698557][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12297.698820][ C1] ? next_expiry_recalc+0xcd/0x220 [12297.699081][ C1] __run_timers.part.0+0x52d/0x890 [12297.699343][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12297.699621][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12297.699906][ C1] ? lock_acquire+0x1c1/0x220 [12297.700148][ C1] ? clockevents_program_event+0xf6/0x300 [12297.700438][ C1] ? lock_release+0x1d5/0x250 [12297.700678][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12297.700943][ C1] ? ktime_get+0xb3/0x190 [12297.701166][ C1] ? clockevents_program_event+0x1ea/0x300 [12297.701469][ C1] run_timer_softirq+0x72/0x100 [12297.701719][ C1] __do_softirq+0x1b9/0x7ff [12297.701953][ C1] irq_exit_rcu+0x98/0xc0 [12297.702175][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12297.702463][ C1] [12297.702613][ C1] [12297.702763][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12297.703070][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12297.703395][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12297.704371][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12297.704681][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12297.705080][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12297.705484][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12297.705883][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12297.706284][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12297.706685][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12297.706983][ C1] pipe_read+0xa16/0xdf0 [12297.707203][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12297.707488][ C1] ? __pfx_pipe_read+0x10/0x10 [12297.707731][ C1] ? iterate_tty_write+0x299/0x540 [12297.707993][ C1] ? lock_release+0x1d5/0x250 [12297.708234][ C1] vfs_read+0x911/0xc00 [12297.708450][ C1] ? lock_acquire+0x1c1/0x220 [12297.708687][ C1] ? __might_fault+0xc6/0x180 [12297.708928][ C1] ? __pfx_vfs_read+0x10/0x10 [12297.709170][ C1] ? __might_fault+0xc6/0x180 [12297.709410][ C1] ? lock_release+0x1d5/0x250 [12297.709649][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12297.709915][ C1] ? __fget_light+0x54/0x1e0 [12297.710152][ C1] ksys_read+0x17a/0x1e0 [12297.710370][ C1] ? __pfx_ksys_read+0x10/0x10 [12297.710614][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12297.710919][ C1] do_syscall_64+0xc9/0x1e0 [12297.711154][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12297.711456][ C1] RIP: 0033:0x7f08a1ea38b2 [12297.711691][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12297.712665][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12297.713088][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12297.713488][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12297.713886][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12297.714285][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12297.714686][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12297.715089][ C1] [12297.715250][ C1] Sending NMI from CPU 1 to CPUs 2: [12297.715534][ C2] NMI backtrace for cpu 2 [12297.715543][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12297.715550][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12297.715554][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12297.715560][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12297.715563][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12297.715567][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12297.715569][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12297.715570][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12297.715572][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12297.715574][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12297.715576][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12297.715578][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12297.715582][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12297.715583][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12297.715585][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12297.715586][ C2] PKRU: 55555554 [12297.715587][ C2] Call Trace: [12297.715591][ C2] [12297.715595][ C2] ? nmi_cpu_backtrace+0x112/0x220 [12297.715603][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [12297.715609][ C2] ? nmi_handle+0x153/0x420 [12297.715614][ C2] ? default_do_nmi+0x41/0x100 [12297.715617][ C2] ? exc_nmi+0xf3/0x120 [12297.715619][ C2] ? end_repeat_nmi+0xf/0x60 [12297.715625][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12297.715629][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12297.715632][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12297.715635][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12297.715639][ C2] [12297.715639][ C2] [12297.715641][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12297.715644][ C2] ? get_stack_info+0x36/0xc0 [12297.715648][ C2] ? lock_acquire+0x1c1/0x220 [12297.715652][ C2] ? lock_release+0x1d5/0x250 [12297.715655][ C2] do_raw_spin_lock+0x1ec/0x270 [12297.715659][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12297.715662][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12297.715665][ C2] ? lock_acquire+0x1c1/0x220 [12297.715668][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12297.715671][ C2] _raw_spin_lock_nested+0x65/0x80 [12297.715674][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12297.715681][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12297.715683][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12297.715688][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12297.715695][ C2] ip_local_deliver_finish+0x2ae/0x480 [12297.715699][ C2] ip_local_deliver+0x19d/0x480 [12297.715701][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12297.715704][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12297.715706][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12297.715713][ C2] ? rcu_read_lock_held+0xe/0x50 [12297.715717][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12297.715720][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12297.715730][ C2] ip_rcv+0x564/0x740 [12297.715733][ C2] ? __pfx_ip_rcv+0x10/0x10 [12297.715735][ C2] ? set_track_prepare+0x8a/0xd0 [12297.715740][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12297.715743][ C2] ? start_secondary+0x21c/0x2b0 [12297.715745][ C2] ? skb_clone+0x10b/0x330 [12297.715750][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12297.715756][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12297.715762][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12297.715766][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12297.715775][ C2] ? __tcf_classify+0x329/0x7d0 [12297.715779][ C2] ? __pfx_ip_rcv+0x10/0x10 [12297.715781][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12297.715785][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12297.715789][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12297.715793][ C2] ? lock_acquire+0x1c1/0x220 [12297.715795][ C2] ? netif_receive_skb_internal+0x84/0x300 [12297.715799][ C2] netif_receive_skb_internal+0xb0/0x300 [12297.715803][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12297.715807][ C2] ? __copy_skb_header+0xaf/0x490 [12297.715812][ C2] ? __skb_clone+0x57a/0x760 [12297.715815][ C2] netif_receive_skb+0x55/0x280 [12297.715818][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12297.715826][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12297.715833][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12297.715839][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12297.715844][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12297.715854][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12297.715861][ C2] ? get_stack_info+0x36/0xc0 [12297.715866][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12297.715869][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12297.715873][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12297.715875][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12297.715879][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12297.715881][ C2] ? kernel_text_address+0x17/0xe0 [12297.715885][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12297.715889][ C2] ? arch_stack_walk+0x8c/0x100 [12297.715893][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12297.715896][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12297.715899][ C2] ? lock_acquire+0x1c1/0x220 [12297.715902][ C2] ? stack_depot_save_flags+0x281/0x550 [12297.715907][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12297.715912][ C2] ? get_stack_info_noinstr+0x18/0x110 [12297.715915][ C2] ? get_stack_info+0x36/0xc0 [12297.715919][ C2] __tcf_classify+0x329/0x7d0 [12297.715924][ C2] tcf_classify+0x283/0x930 [12297.715929][ C2] ? __pfx_tcf_classify+0x10/0x10 [12297.715932][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12297.715937][ C2] tc_run+0x2e4/0x5d0 [12297.715941][ C2] ? __pfx_tc_run+0x10/0x10 [12297.715944][ C2] ? lock_acquire+0x1c1/0x220 [12297.715946][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12297.715950][ C2] __dev_queue_xmit+0x686/0x17e0 [12297.715954][ C2] ? lock_acquire+0x1c1/0x220 [12297.715956][ C2] ? ip_finish_output2+0x786/0x18e0 [12297.715960][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12297.715963][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12297.715966][ C2] ? neigh_hh_output+0x348/0x590 [12297.715970][ C2] ? ip_finish_output2+0x262/0x18e0 [12297.715973][ C2] ip_finish_output2+0x786/0x18e0 [12297.715977][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12297.715984][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12297.715987][ C2] ? rcu_read_lock_held+0xe/0x50 [12297.715991][ C2] ? __ip_finish_output+0x10f/0x770 [12297.715994][ C2] ip_output+0x16b/0x4f0 [12297.715998][ C2] ? __pfx_ip_output+0x10/0x10 [12297.716000][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12297.716003][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12297.716006][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12297.716009][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12297.716012][ C2] ? __alloc_skb+0xd4/0x280 [12297.716015][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12297.716019][ C2] ? tcp_fragment+0x168/0x1040 [12297.716022][ C2] ? rcu_read_lock_held+0xe/0x50 [12297.716025][ C2] ? ip_local_out+0x114/0x3b0 [12297.716029][ C2] __ip_queue_xmit+0x672/0x1910 [12297.716033][ C2] ? __skb_clone+0x57a/0x760 [12297.716035][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12297.716041][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12297.716044][ C2] ? ipv4_dst_check+0xe3/0x170 [12297.716048][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12297.716054][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12297.716058][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12297.716061][ C2] ? tcp_fragment+0xb0e/0x1040 [12297.716064][ C2] tcp_send_loss_probe+0x348/0x830 [12297.716067][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12297.716070][ C2] tcp_write_timer+0x82/0x1d0 [12297.716073][ C2] call_timer_fn+0x173/0x430 [12297.716077][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12297.716082][ C2] ? next_expiry_recalc+0xcd/0x220 [12297.716086][ C2] __run_timers.part.0+0x52d/0x890 [12297.716089][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12297.716093][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12297.716096][ C2] ? lock_acquire+0x1c1/0x220 [12297.716098][ C2] ? clockevents_program_event+0xf6/0x300 [12297.716103][ C2] ? lock_release+0x1d5/0x250 [12297.716105][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12297.716108][ C2] ? ktime_get+0xb3/0x190 [12297.716111][ C2] ? clockevents_program_event+0x1ea/0x300 [12297.716116][ C2] run_timer_softirq+0x72/0x100 [12297.716119][ C2] __do_softirq+0x1b9/0x7ff [12297.716123][ C2] irq_exit_rcu+0x98/0xc0 [12297.716127][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12297.716130][ C2] [12297.716131][ C2] [12297.716132][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12297.716136][ C2] RIP: 0010:default_idle+0xf/0x20 [12297.716139][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12297.716141][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12297.716143][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12297.716145][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12297.716146][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12297.716148][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12297.716149][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12297.716152][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12297.716155][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12297.716159][ C2] default_idle_call+0x69/0xa0 [12297.716162][ C2] cpuidle_idle_call+0x1f6/0x280 [12297.716165][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12297.716169][ C2] ? lock_release+0x1d5/0x250 [12297.716172][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12297.716176][ C2] do_idle+0xfb/0x160 [12297.716178][ C2] cpu_startup_entry+0x55/0x60 [12297.716181][ C2] start_secondary+0x21c/0x2b0 [12297.716184][ C2] ? __pfx_start_secondary+0x10/0x10 [12297.716188][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12297.716194][ C2] [12324.569271][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9287s! [swapper/2:0] [12324.569700][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12324.570949][ C2] irq event stamp: 44114564 [12324.571184][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12324.571721][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12324.572232][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12324.572708][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12324.573174][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12324.573628][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12324.574240][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12324.574563][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12324.575529][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12324.575836][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12324.576231][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12324.576628][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12324.577031][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12324.577428][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12324.577825][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12324.578270][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12324.578600][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12324.579000][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12324.579402][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12324.579798][ C2] PKRU: 55555554 [12324.579979][ C2] Call Trace: [12324.580151][ C2] [12324.580299][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12324.580558][ C2] ? __run_hrtimer+0x1c0/0x710 [12324.580802][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12324.581076][ C2] ? __hrtimer_run_queues+0x197/0x270 [12324.581355][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12324.581642][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12324.581906][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12324.582211][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12324.582470][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12324.582736][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12324.583045][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12324.583339][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12324.583654][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12324.583943][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12324.584236][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12324.584524][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12324.584835][ C2] ? get_stack_info+0x36/0xc0 [12324.585076][ C2] ? lock_acquire+0x1c1/0x220 [12324.585314][ C2] ? lock_release+0x1d5/0x250 [12324.585554][ C2] do_raw_spin_lock+0x1ec/0x270 [12324.585802][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12324.586072][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12324.586357][ C2] ? lock_acquire+0x1c1/0x220 [12324.586592][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12324.586834][ C2] _raw_spin_lock_nested+0x65/0x80 [12324.587092][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12324.587328][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12324.587574][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12324.587834][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12324.588109][ C2] ip_local_deliver_finish+0x2ae/0x480 [12324.588384][ C2] ip_local_deliver+0x19d/0x480 [12324.588631][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12324.588900][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12324.589164][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12324.589512][ C2] ? rcu_read_lock_held+0xe/0x50 [12324.589766][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12324.590085][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12324.590348][ C2] ip_rcv+0x564/0x740 [12324.590551][ C2] ? __pfx_ip_rcv+0x10/0x10 [12324.590781][ C2] ? set_track_prepare+0x8a/0xd0 [12324.591034][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12324.591316][ C2] ? start_secondary+0x21c/0x2b0 [12324.591568][ C2] ? skb_clone+0x10b/0x330 [12324.591793][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12324.592113][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12324.592418][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12324.592700][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12324.592993][ C2] ? __tcf_classify+0x329/0x7d0 [12324.593248][ C2] ? __pfx_ip_rcv+0x10/0x10 [12324.593476][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12324.593775][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12324.594060][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12324.594384][ C2] ? lock_acquire+0x1c1/0x220 [12324.594620][ C2] ? netif_receive_skb_internal+0x84/0x300 [12324.594917][ C2] netif_receive_skb_internal+0xb0/0x300 [12324.595201][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12324.595516][ C2] ? __copy_skb_header+0xaf/0x490 [12324.595775][ C2] ? __skb_clone+0x57a/0x760 [12324.596011][ C2] netif_receive_skb+0x55/0x280 [12324.596259][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12324.596571][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12324.596901][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12324.597199][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12324.597474][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12324.597760][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12324.598071][ C2] ? get_stack_info+0x36/0xc0 [12324.598313][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12324.598576][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12324.598894][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12324.599169][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12324.599443][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12324.599757][ C2] ? kernel_text_address+0x17/0xe0 [12324.600017][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12324.600331][ C2] ? arch_stack_walk+0x8c/0x100 [12324.600580][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12324.600843][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12324.601128][ C2] ? lock_acquire+0x1c1/0x220 [12324.601372][ C2] ? stack_depot_save_flags+0x281/0x550 [12324.601655][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12324.601960][ C2] ? get_stack_info_noinstr+0x18/0x110 [12324.602235][ C2] ? get_stack_info+0x36/0xc0 [12324.602475][ C2] __tcf_classify+0x329/0x7d0 [12324.602714][ C2] tcf_classify+0x283/0x930 [12324.602948][ C2] ? __pfx_tcf_classify+0x10/0x10 [12324.603203][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12324.603516][ C2] tc_run+0x2e4/0x5d0 [12324.603721][ C2] ? __pfx_tc_run+0x10/0x10 [12324.603952][ C2] ? lock_acquire+0x1c1/0x220 [12324.604189][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12324.604450][ C2] __dev_queue_xmit+0x686/0x17e0 [12324.604701][ C2] ? lock_acquire+0x1c1/0x220 [12324.604938][ C2] ? ip_finish_output2+0x786/0x18e0 [12324.605201][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12324.605505][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12324.605773][ C2] ? neigh_hh_output+0x348/0x590 [12324.606025][ C2] ? ip_finish_output2+0x262/0x18e0 [12324.606288][ C2] ip_finish_output2+0x786/0x18e0 [12324.606545][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12324.606883][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12324.607158][ C2] ? rcu_read_lock_held+0xe/0x50 [12324.607409][ C2] ? __ip_finish_output+0x10f/0x770 [12324.607672][ C2] ip_output+0x16b/0x4f0 [12324.607886][ C2] ? __pfx_ip_output+0x10/0x10 [12324.608130][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12324.608405][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12324.608714][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12324.608991][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12324.609241][ C2] ? __alloc_skb+0xd4/0x280 [12324.609469][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12324.609737][ C2] ? tcp_fragment+0x168/0x1040 [12324.609981][ C2] ? rcu_read_lock_held+0xe/0x50 [12324.610232][ C2] ? ip_local_out+0x114/0x3b0 [12324.610471][ C2] __ip_queue_xmit+0x672/0x1910 [12324.610720][ C2] ? __skb_clone+0x57a/0x760 [12324.610952][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12324.611229][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12324.611508][ C2] ? ipv4_dst_check+0xe3/0x170 [12324.611754][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12324.612003][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12324.612301][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12324.612619][ C2] ? tcp_fragment+0xb0e/0x1040 [12324.612861][ C2] tcp_send_loss_probe+0x348/0x830 [12324.613120][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12324.613386][ C2] tcp_write_timer+0x82/0x1d0 [12324.613625][ C2] call_timer_fn+0x173/0x430 [12324.613863][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12324.614124][ C2] ? next_expiry_recalc+0xcd/0x220 [12324.614383][ C2] __run_timers.part.0+0x52d/0x890 [12324.614642][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12324.614909][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12324.615193][ C2] ? lock_acquire+0x1c1/0x220 [12324.615428][ C2] ? clockevents_program_event+0xf6/0x300 [12324.615721][ C2] ? lock_release+0x1d5/0x250 [12324.615959][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12324.616221][ C2] ? ktime_get+0xb3/0x190 [12324.616439][ C2] ? clockevents_program_event+0x1ea/0x300 [12324.616735][ C2] run_timer_softirq+0x72/0x100 [12324.616983][ C2] __do_softirq+0x1b9/0x7ff [12324.617213][ C2] irq_exit_rcu+0x98/0xc0 [12324.617434][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12324.617717][ C2] [12324.617868][ C2] [12324.618017][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12324.618321][ C2] RIP: 0010:default_idle+0xf/0x20 [12324.618578][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12324.619540][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12324.619848][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12324.620246][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12324.620645][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12324.621040][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12324.621446][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12324.621843][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12324.622130][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12324.622391][ C2] default_idle_call+0x69/0xa0 [12324.622634][ C2] cpuidle_idle_call+0x1f6/0x280 [12324.622883][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12324.623161][ C2] ? lock_release+0x1d5/0x250 [12324.623397][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12324.623671][ C2] do_idle+0xfb/0x160 [12324.623875][ C2] cpu_startup_entry+0x55/0x60 [12324.624116][ C2] start_secondary+0x21c/0x2b0 [12324.624358][ C2] ? __pfx_start_secondary+0x10/0x10 [12324.624627][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12324.624936][ C2] [12324.625095][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9287s! [perl:4135] [12324.625527][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12324.626786][ C1] irq event stamp: 209232 [12324.627008][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12324.627545][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12324.628022][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12324.628495][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12324.628960][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12324.629412][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12324.630028][ C1] RIP: 0010:kasan_check_range+0x77/0x1c0 [12324.630317][ C1] Code: ff ff 48 39 c7 76 dd 4c 8d 54 37 ff 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 d1 48 c1 ed 03 49 c1 e9 03 48 01 c5 49 01 c1 <48> 89 e8 49 8d 59 01 48 89 da 48 29 ea 48 83 fa 10 0f 8e c0 00 00 [12324.631298][ C1] RSP: 0018:ffffc900001c7b58 EFLAGS: 00000286 [12324.631608][ C1] RAX: dffffc0000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12324.632009][ C1] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12324.632411][ C1] RBP: ffffed10014741c3 R08: 0000000000000000 R09: ffffed10014741c3 [12324.632811][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12324.633212][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12324.633611][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12324.634058][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12324.634392][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12324.634793][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12324.635194][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12324.635592][ C1] PKRU: 55555554 [12324.635774][ C1] Call Trace: [12324.635947][ C1] [12324.636095][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12324.636358][ C1] ? __run_hrtimer+0x1c0/0x710 [12324.636603][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12324.636884][ C1] ? __hrtimer_run_queues+0x197/0x270 [12324.637158][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12324.637447][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12324.637713][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12324.638021][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12324.638285][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12324.638594][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12324.638889][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12324.639206][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12324.639497][ C1] ? kasan_check_range+0x77/0x1c0 [12324.639755][ C1] queued_spin_lock_slowpath+0xb0/0xb90 [12324.640036][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12324.640350][ C1] ? get_stack_info+0x36/0xc0 [12324.640592][ C1] ? lock_acquire+0x1c1/0x220 [12324.640832][ C1] ? lock_release+0x1d5/0x250 [12324.641072][ C1] do_raw_spin_lock+0x1ec/0x270 [12324.641328][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12324.641599][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12324.641886][ C1] ? lock_acquire+0x1c1/0x220 [12324.642125][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12324.642365][ C1] _raw_spin_lock_nested+0x65/0x80 [12324.642626][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12324.642865][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12324.643113][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12324.643372][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12324.643647][ C1] ip_local_deliver_finish+0x2ae/0x480 [12324.643922][ C1] ip_local_deliver+0x19d/0x480 [12324.644172][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12324.644445][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12324.644710][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12324.645057][ C1] ? rcu_read_lock_held+0xe/0x50 [12324.645311][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12324.645632][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12324.645895][ C1] ip_rcv+0x564/0x740 [12324.646099][ C1] ? __pfx_ip_rcv+0x10/0x10 [12324.646334][ C1] ? set_track_prepare+0x8a/0xd0 [12324.646587][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12324.646862][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12324.647136][ C1] ? skb_clone+0x10b/0x330 [12324.647365][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12324.647685][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12324.647990][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12324.648274][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12324.648568][ C1] ? __tcf_classify+0x329/0x7d0 [12324.648818][ C1] ? __pfx_ip_rcv+0x10/0x10 [12324.649052][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12324.649353][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12324.649637][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12324.649962][ C1] ? lock_acquire+0x1c1/0x220 [12324.650201][ C1] ? netif_receive_skb_internal+0x84/0x300 [12324.650497][ C1] netif_receive_skb_internal+0xb0/0x300 [12324.650783][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12324.651100][ C1] ? __copy_skb_header+0xaf/0x490 [12324.651367][ C1] ? __skb_clone+0x57a/0x760 [12324.651601][ C1] netif_receive_skb+0x55/0x280 [12324.651848][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12324.652163][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12324.652495][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12324.652796][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12324.653070][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12324.653362][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12324.653673][ C1] ? hlock_class+0x4e/0x130 [12324.653907][ C1] ? get_stack_info_noinstr+0x18/0x110 [12324.654183][ C1] ? get_stack_info_noinstr+0x18/0x110 [12324.654460][ C1] ? __pfx_validate_chain+0x10/0x10 [12324.654726][ C1] ? hlock_class+0x4e/0x130 [12324.654955][ C1] ? mark_lock+0x38/0x3e0 [12324.655179][ C1] ? stack_access_ok+0xda/0x1f0 [12324.655429][ C1] ? __lock_acquire+0xb67/0x1610 [12324.655683][ C1] ? get_stack_info_noinstr+0x18/0x110 [12324.655959][ C1] ? get_stack_info+0x36/0xc0 [12324.656201][ C1] ? stack_access_ok+0xda/0x1f0 [12324.656449][ C1] ? get_reg+0x119/0x190 [12324.656665][ C1] ? unwind_next_frame+0x12af/0x1d10 [12324.656932][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12324.657242][ C1] __tcf_classify+0x329/0x7d0 [12324.657485][ C1] tcf_classify+0x283/0x930 [12324.657715][ C1] ? arch_stack_walk+0xa2/0x100 [12324.657964][ C1] ? __pfx_tcf_classify+0x10/0x10 [12324.658221][ C1] ? get_stack_info+0x36/0xc0 [12324.658463][ C1] tc_run+0x2e4/0x5d0 [12324.658668][ C1] ? __pfx_tc_run+0x10/0x10 [12324.658901][ C1] ? lock_acquire+0x1c1/0x220 [12324.659140][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12324.659402][ C1] __dev_queue_xmit+0x686/0x17e0 [12324.659655][ C1] ? lock_acquire+0x1c1/0x220 [12324.659893][ C1] ? ip_finish_output2+0x786/0x18e0 [12324.660159][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12324.660469][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12324.660740][ C1] ? neigh_hh_output+0x348/0x590 [12324.660993][ C1] ? ip_finish_output2+0x262/0x18e0 [12324.661264][ C1] ip_finish_output2+0x786/0x18e0 [12324.661520][ C1] ? stack_depot_save_flags+0x45/0x550 [12324.661800][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12324.662138][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12324.662414][ C1] ? rcu_read_lock_held+0xe/0x50 [12324.662668][ C1] ? __ip_finish_output+0x10f/0x770 [12324.662933][ C1] ip_output+0x16b/0x4f0 [12324.663153][ C1] ? run_timer_softirq+0x72/0x100 [12324.663411][ C1] ? __pfx_ip_output+0x10/0x10 [12324.663653][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12324.663940][ C1] ? rcu_read_lock_held+0xe/0x50 [12324.664194][ C1] ? ip_local_out+0x114/0x3b0 [12324.664439][ C1] __ip_queue_xmit+0x672/0x1910 [12324.664687][ C1] ? __create_object+0x5e/0xb0 [12324.664930][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12324.665200][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12324.665482][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12324.665755][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12324.666037][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12324.666317][ C1] tcp_delack_timer+0x84/0x240 [12324.666563][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12324.666836][ C1] call_timer_fn+0x173/0x430 [12324.667072][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12324.667336][ C1] ? next_expiry_recalc+0xcd/0x220 [12324.667598][ C1] __run_timers.part.0+0x52d/0x890 [12324.667859][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12324.668134][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12324.668418][ C1] ? lock_acquire+0x1c1/0x220 [12324.668658][ C1] ? clockevents_program_event+0xf6/0x300 [12324.668949][ C1] ? lock_release+0x1d5/0x250 [12324.669188][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12324.669453][ C1] ? ktime_get+0xb3/0x190 [12324.669675][ C1] ? clockevents_program_event+0x1ea/0x300 [12324.669973][ C1] run_timer_softirq+0x72/0x100 [12324.670221][ C1] __do_softirq+0x1b9/0x7ff [12324.670456][ C1] irq_exit_rcu+0x98/0xc0 [12324.670677][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12324.670963][ C1] [12324.671113][ C1] [12324.671273][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12324.671576][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12324.671903][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12324.672874][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12324.673181][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12324.673583][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12324.673982][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12324.674381][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12324.674779][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12324.675184][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12324.675480][ C1] pipe_read+0xa16/0xdf0 [12324.675707][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12324.675985][ C1] ? __pfx_pipe_read+0x10/0x10 [12324.676231][ C1] ? iterate_tty_write+0x299/0x540 [12324.676492][ C1] ? lock_release+0x1d5/0x250 [12324.676733][ C1] vfs_read+0x911/0xc00 [12324.676948][ C1] ? lock_acquire+0x1c1/0x220 [12324.677188][ C1] ? __might_fault+0xc6/0x180 [12324.677426][ C1] ? __pfx_vfs_read+0x10/0x10 [12324.677667][ C1] ? __might_fault+0xc6/0x180 [12324.677908][ C1] ? lock_release+0x1d5/0x250 [12324.678150][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12324.678416][ C1] ? __fget_light+0x54/0x1e0 [12324.678652][ C1] ksys_read+0x17a/0x1e0 [12324.678871][ C1] ? __pfx_ksys_read+0x10/0x10 [12324.679117][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12324.679421][ C1] do_syscall_64+0xc9/0x1e0 [12324.679656][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12324.679958][ C1] RIP: 0033:0x7f08a1ea38b2 [12324.680186][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12324.681166][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12324.681588][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12324.681987][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12324.682388][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12324.682787][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12324.683187][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12324.683588][ C1] [12352.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9313s! [perl:4135] [12352.569700][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12352.570954][ C1] irq event stamp: 209232 [12352.571177][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12352.571706][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12352.572184][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12352.572656][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12352.573121][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12352.573568][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12352.574181][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12352.574507][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12352.575478][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12352.575785][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12352.576187][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12352.576584][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12352.576981][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12352.577382][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12352.577781][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12352.578230][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12352.578562][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12352.578961][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12352.579362][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12352.579762][ C1] PKRU: 55555554 [12352.579943][ C1] Call Trace: [12352.580114][ C1] [12352.580263][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12352.580524][ C1] ? __run_hrtimer+0x1c0/0x710 [12352.580767][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12352.581048][ C1] ? __hrtimer_run_queues+0x197/0x270 [12352.581320][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12352.581610][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12352.581876][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12352.582182][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12352.582443][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12352.582753][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12352.583047][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12352.583363][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12352.583650][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12352.583944][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12352.584233][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12352.584543][ C1] ? get_stack_info+0x36/0xc0 [12352.584783][ C1] ? lock_acquire+0x1c1/0x220 [12352.585023][ C1] ? lock_release+0x1d5/0x250 [12352.585264][ C1] do_raw_spin_lock+0x1ec/0x270 [12352.585512][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12352.585783][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12352.586066][ C1] ? lock_acquire+0x1c1/0x220 [12352.586305][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12352.586546][ C1] _raw_spin_lock_nested+0x65/0x80 [12352.586806][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12352.587039][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12352.587285][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12352.587542][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12352.587818][ C1] ip_local_deliver_finish+0x2ae/0x480 [12352.588094][ C1] ip_local_deliver+0x19d/0x480 [12352.588341][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12352.588611][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12352.588874][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12352.589221][ C1] ? rcu_read_lock_held+0xe/0x50 [12352.589474][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12352.589792][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12352.590054][ C1] ip_rcv+0x564/0x740 [12352.590259][ C1] ? __pfx_ip_rcv+0x10/0x10 [12352.590488][ C1] ? set_track_prepare+0x8a/0xd0 [12352.590740][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12352.591021][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12352.591295][ C1] ? skb_clone+0x10b/0x330 [12352.591520][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12352.591837][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12352.592144][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12352.592425][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12352.592721][ C1] ? __tcf_classify+0x329/0x7d0 [12352.592969][ C1] ? __pfx_ip_rcv+0x10/0x10 [12352.593198][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12352.593496][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12352.593781][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12352.594105][ C1] ? lock_acquire+0x1c1/0x220 [12352.594342][ C1] ? netif_receive_skb_internal+0x84/0x300 [12352.594639][ C1] netif_receive_skb_internal+0xb0/0x300 [12352.594922][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12352.595240][ C1] ? __copy_skb_header+0xaf/0x490 [12352.595496][ C1] ? __skb_clone+0x57a/0x760 [12352.595731][ C1] netif_receive_skb+0x55/0x280 [12352.595979][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12352.596292][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12352.596623][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12352.596921][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12352.597196][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12352.597483][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12352.597795][ C1] ? hlock_class+0x4e/0x130 [12352.598028][ C1] ? get_stack_info_noinstr+0x18/0x110 [12352.598309][ C1] ? get_stack_info_noinstr+0x18/0x110 [12352.598583][ C1] ? __pfx_validate_chain+0x10/0x10 [12352.598845][ C1] ? hlock_class+0x4e/0x130 [12352.599076][ C1] ? mark_lock+0x38/0x3e0 [12352.599295][ C1] ? stack_access_ok+0xda/0x1f0 [12352.599545][ C1] ? __lock_acquire+0xb67/0x1610 [12352.599798][ C1] ? get_stack_info_noinstr+0x18/0x110 [12352.600073][ C1] ? get_stack_info+0x36/0xc0 [12352.600314][ C1] ? stack_access_ok+0xda/0x1f0 [12352.600559][ C1] ? get_reg+0x119/0x190 [12352.600774][ C1] ? unwind_next_frame+0x12af/0x1d10 [12352.601050][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12352.601357][ C1] __tcf_classify+0x329/0x7d0 [12352.601598][ C1] tcf_classify+0x283/0x930 [12352.601830][ C1] ? arch_stack_walk+0xa2/0x100 [12352.602078][ C1] ? __pfx_tcf_classify+0x10/0x10 [12352.602335][ C1] ? get_stack_info+0x36/0xc0 [12352.602574][ C1] tc_run+0x2e4/0x5d0 [12352.602780][ C1] ? __pfx_tc_run+0x10/0x10 [12352.603009][ C1] ? lock_acquire+0x1c1/0x220 [12352.603248][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12352.603508][ C1] __dev_queue_xmit+0x686/0x17e0 [12352.603760][ C1] ? lock_acquire+0x1c1/0x220 [12352.603999][ C1] ? ip_finish_output2+0x786/0x18e0 [12352.604264][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12352.604570][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12352.604841][ C1] ? neigh_hh_output+0x348/0x590 [12352.605093][ C1] ? ip_finish_output2+0x262/0x18e0 [12352.605358][ C1] ip_finish_output2+0x786/0x18e0 [12352.605613][ C1] ? stack_depot_save_flags+0x45/0x550 [12352.605890][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12352.606227][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12352.606503][ C1] ? rcu_read_lock_held+0xe/0x50 [12352.606755][ C1] ? __ip_finish_output+0x10f/0x770 [12352.607019][ C1] ip_output+0x16b/0x4f0 [12352.607233][ C1] ? run_timer_softirq+0x72/0x100 [12352.607490][ C1] ? __pfx_ip_output+0x10/0x10 [12352.607733][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12352.608018][ C1] ? rcu_read_lock_held+0xe/0x50 [12352.608269][ C1] ? ip_local_out+0x114/0x3b0 [12352.608511][ C1] __ip_queue_xmit+0x672/0x1910 [12352.608759][ C1] ? __create_object+0x5e/0xb0 [12352.609003][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12352.609269][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12352.609549][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12352.609823][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12352.610103][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12352.610374][ C1] tcp_delack_timer+0x84/0x240 [12352.610617][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12352.610887][ C1] call_timer_fn+0x173/0x430 [12352.611130][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12352.611391][ C1] ? next_expiry_recalc+0xcd/0x220 [12352.611651][ C1] __run_timers.part.0+0x52d/0x890 [12352.611910][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12352.612182][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12352.612468][ C1] ? lock_acquire+0x1c1/0x220 [12352.612706][ C1] ? clockevents_program_event+0xf6/0x300 [12352.612995][ C1] ? lock_release+0x1d5/0x250 [12352.613234][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12352.613497][ C1] ? ktime_get+0xb3/0x190 [12352.613716][ C1] ? clockevents_program_event+0x1ea/0x300 [12352.614017][ C1] run_timer_softirq+0x72/0x100 [12352.614265][ C1] __do_softirq+0x1b9/0x7ff [12352.614498][ C1] irq_exit_rcu+0x98/0xc0 [12352.614717][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12352.615000][ C1] [12352.615154][ C1] [12352.615303][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12352.615606][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12352.615929][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12352.616900][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12352.617209][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12352.617607][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12352.618003][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12352.618403][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12352.618800][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12352.619200][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12352.619497][ C1] pipe_read+0xa16/0xdf0 [12352.619717][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12352.619994][ C1] ? __pfx_pipe_read+0x10/0x10 [12352.620237][ C1] ? iterate_tty_write+0x299/0x540 [12352.620498][ C1] ? lock_release+0x1d5/0x250 [12352.620738][ C1] vfs_read+0x911/0xc00 [12352.620951][ C1] ? lock_acquire+0x1c1/0x220 [12352.621196][ C1] ? __might_fault+0xc6/0x180 [12352.621438][ C1] ? __pfx_vfs_read+0x10/0x10 [12352.621677][ C1] ? __might_fault+0xc6/0x180 [12352.621915][ C1] ? lock_release+0x1d5/0x250 [12352.622156][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12352.622419][ C1] ? __fget_light+0x54/0x1e0 [12352.622658][ C1] ksys_read+0x17a/0x1e0 [12352.622874][ C1] ? __pfx_ksys_read+0x10/0x10 [12352.623119][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12352.623424][ C1] do_syscall_64+0xc9/0x1e0 [12352.623656][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12352.623954][ C1] RIP: 0033:0x7f08a1ea38b2 [12352.624185][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12352.625156][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12352.625576][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12352.625981][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12352.626378][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12352.626775][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12352.627173][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12352.627576][ C1] [12352.627732][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9313s! [swapper/2:0] [12352.628166][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12352.629422][ C2] irq event stamp: 44114564 [12352.629652][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12352.630192][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12352.630704][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12352.631189][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12352.631660][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12352.632117][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12352.632729][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12352.633054][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12352.634026][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12352.634333][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12352.634732][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12352.635132][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12352.635529][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12352.635929][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12352.636330][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12352.636777][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12352.637109][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12352.637508][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12352.637909][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12352.638308][ C2] PKRU: 55555554 [12352.638490][ C2] Call Trace: [12352.638659][ C2] [12352.638811][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12352.639073][ C2] ? __run_hrtimer+0x1c0/0x710 [12352.639317][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12352.639593][ C2] ? __hrtimer_run_queues+0x197/0x270 [12352.639865][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12352.640156][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12352.640421][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12352.640725][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12352.640986][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12352.641257][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12352.641564][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12352.641860][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12352.642176][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12352.642464][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12352.642758][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12352.643048][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12352.643359][ C2] ? get_stack_info+0x36/0xc0 [12352.643600][ C2] ? lock_acquire+0x1c1/0x220 [12352.643840][ C2] ? lock_release+0x1d5/0x250 [12352.644084][ C2] do_raw_spin_lock+0x1ec/0x270 [12352.644334][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12352.644606][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12352.644889][ C2] ? lock_acquire+0x1c1/0x220 [12352.645129][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12352.645371][ C2] _raw_spin_lock_nested+0x65/0x80 [12352.645631][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12352.645865][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12352.646110][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12352.646369][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12352.646646][ C2] ip_local_deliver_finish+0x2ae/0x480 [12352.646923][ C2] ip_local_deliver+0x19d/0x480 [12352.647171][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12352.647443][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12352.647708][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12352.648055][ C2] ? rcu_read_lock_held+0xe/0x50 [12352.648310][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12352.648630][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12352.648892][ C2] ip_rcv+0x564/0x740 [12352.649098][ C2] ? __pfx_ip_rcv+0x10/0x10 [12352.649328][ C2] ? set_track_prepare+0x8a/0xd0 [12352.649581][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12352.649856][ C2] ? start_secondary+0x21c/0x2b0 [12352.650109][ C2] ? skb_clone+0x10b/0x330 [12352.650337][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12352.650657][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12352.650964][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12352.651252][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12352.651547][ C2] ? __tcf_classify+0x329/0x7d0 [12352.651794][ C2] ? __pfx_ip_rcv+0x10/0x10 [12352.652025][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12352.652326][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12352.652613][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12352.652939][ C2] ? lock_acquire+0x1c1/0x220 [12352.653180][ C2] ? netif_receive_skb_internal+0x84/0x300 [12352.653476][ C2] netif_receive_skb_internal+0xb0/0x300 [12352.653760][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12352.654078][ C2] ? __copy_skb_header+0xaf/0x490 [12352.654336][ C2] ? __skb_clone+0x57a/0x760 [12352.654572][ C2] netif_receive_skb+0x55/0x280 [12352.654820][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12352.655131][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12352.655464][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12352.655762][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12352.656036][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12352.656328][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12352.656640][ C2] ? get_stack_info+0x36/0xc0 [12352.656880][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12352.657144][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12352.657462][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12352.657742][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12352.658018][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12352.658334][ C2] ? kernel_text_address+0x17/0xe0 [12352.658595][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12352.658909][ C2] ? arch_stack_walk+0x8c/0x100 [12352.659158][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12352.659426][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12352.659711][ C2] ? lock_acquire+0x1c1/0x220 [12352.659950][ C2] ? stack_depot_save_flags+0x281/0x550 [12352.660233][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12352.660537][ C2] ? get_stack_info_noinstr+0x18/0x110 [12352.660814][ C2] ? get_stack_info+0x36/0xc0 [12352.661059][ C2] __tcf_classify+0x329/0x7d0 [12352.661303][ C2] tcf_classify+0x283/0x930 [12352.661537][ C2] ? __pfx_tcf_classify+0x10/0x10 [12352.661794][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12352.662106][ C2] tc_run+0x2e4/0x5d0 [12352.662315][ C2] ? __pfx_tc_run+0x10/0x10 [12352.662544][ C2] ? lock_acquire+0x1c1/0x220 [12352.662783][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12352.663044][ C2] __dev_queue_xmit+0x686/0x17e0 [12352.663297][ C2] ? lock_acquire+0x1c1/0x220 [12352.663541][ C2] ? ip_finish_output2+0x786/0x18e0 [12352.663805][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12352.664110][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12352.664381][ C2] ? neigh_hh_output+0x348/0x590 [12352.664634][ C2] ? ip_finish_output2+0x262/0x18e0 [12352.664898][ C2] ip_finish_output2+0x786/0x18e0 [12352.665156][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12352.665492][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12352.665768][ C2] ? rcu_read_lock_held+0xe/0x50 [12352.666020][ C2] ? __ip_finish_output+0x10f/0x770 [12352.666286][ C2] ip_output+0x16b/0x4f0 [12352.666503][ C2] ? __pfx_ip_output+0x10/0x10 [12352.666747][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12352.667022][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12352.667335][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12352.667612][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12352.667863][ C2] ? __alloc_skb+0xd4/0x280 [12352.668094][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12352.668365][ C2] ? tcp_fragment+0x168/0x1040 [12352.668610][ C2] ? rcu_read_lock_held+0xe/0x50 [12352.668862][ C2] ? ip_local_out+0x114/0x3b0 [12352.669101][ C2] __ip_queue_xmit+0x672/0x1910 [12352.669350][ C2] ? __skb_clone+0x57a/0x760 [12352.669590][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12352.669856][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12352.670140][ C2] ? ipv4_dst_check+0xe3/0x170 [12352.670383][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12352.670634][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12352.670937][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12352.671263][ C2] ? tcp_fragment+0xb0e/0x1040 [12352.671507][ C2] tcp_send_loss_probe+0x348/0x830 [12352.671768][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12352.672036][ C2] tcp_write_timer+0x82/0x1d0 [12352.672277][ C2] call_timer_fn+0x173/0x430 [12352.672513][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12352.672775][ C2] ? next_expiry_recalc+0xcd/0x220 [12352.673036][ C2] __run_timers.part.0+0x52d/0x890 [12352.673298][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12352.673568][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12352.673852][ C2] ? lock_acquire+0x1c1/0x220 [12352.674091][ C2] ? clockevents_program_event+0xf6/0x300 [12352.674383][ C2] ? lock_release+0x1d5/0x250 [12352.674621][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12352.674884][ C2] ? ktime_get+0xb3/0x190 [12352.675107][ C2] ? clockevents_program_event+0x1ea/0x300 [12352.675403][ C2] run_timer_softirq+0x72/0x100 [12352.675650][ C2] __do_softirq+0x1b9/0x7ff [12352.675884][ C2] irq_exit_rcu+0x98/0xc0 [12352.676108][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12352.676397][ C2] [12352.676546][ C2] [12352.676698][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12352.677000][ C2] RIP: 0010:default_idle+0xf/0x20 [12352.677258][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12352.678228][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12352.678536][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12352.678936][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12352.679335][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12352.679733][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12352.680130][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12352.680531][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12352.680820][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12352.681088][ C2] default_idle_call+0x69/0xa0 [12352.681333][ C2] cpuidle_idle_call+0x1f6/0x280 [12352.681585][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12352.681862][ C2] ? lock_release+0x1d5/0x250 [12352.682102][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12352.682376][ C2] do_idle+0xfb/0x160 [12352.682579][ C2] cpu_startup_entry+0x55/0x60 [12352.682827][ C2] start_secondary+0x21c/0x2b0 [12352.683070][ C2] ? __pfx_start_secondary+0x10/0x10 [12352.683340][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12352.683650][ C2] [12375.715105][ C1] rcu: INFO: rcu_preempt self-detected stall on CPU [12375.715467][ C1] rcu: 1-....: (9706254 ticks this GP) idle=46d4/1/0x4000000000000000 softirq=577792/577794 fqs=2352062 [12375.716030][ C1] rcu: (t=10020828 jiffies g=1882453 q=730 ncpus=4) [12375.716368][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12375.716815][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12375.717431][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12375.717759][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12375.718729][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12375.719038][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12375.719440][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12375.719837][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12375.720242][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12375.720642][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12375.721047][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12375.721494][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12375.721827][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12375.722231][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12375.722630][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12375.723029][ C1] PKRU: 55555554 [12375.723212][ C1] Call Trace: [12375.723384][ C1] [12375.723532][ C1] ? rcu_dump_cpu_stacks+0x2a3/0x4c0 [12375.723803][ C1] ? print_cpu_stall+0x263/0x6a0 [12375.724056][ C1] ? check_cpu_stall+0x284/0x500 [12375.724308][ C1] ? rcu_pending+0x92/0x360 [12375.724540][ C1] ? rcu_sched_clock_irq+0x107/0x3f0 [12375.724810][ C1] ? update_process_times+0xb9/0x110 [12375.725080][ C1] ? tick_sched_handle+0x67/0x130 [12375.725336][ C1] ? tick_nohz_highres_handler+0xa7/0xd0 [12375.725623][ C1] ? __run_hrtimer+0x1c0/0x710 [12375.725863][ C1] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [12375.726176][ C1] ? __hrtimer_run_queues+0x197/0x270 [12375.726450][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12375.726739][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12375.727005][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12375.727312][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12375.727575][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12375.727886][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12375.728182][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12375.728497][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12375.728789][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12375.729082][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12375.729374][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12375.729687][ C1] ? get_stack_info+0x36/0xc0 [12375.729928][ C1] ? lock_acquire+0x1c1/0x220 [12375.730168][ C1] ? lock_release+0x1d5/0x250 [12375.730408][ C1] do_raw_spin_lock+0x1ec/0x270 [12375.730658][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12375.730936][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12375.731222][ C1] ? lock_acquire+0x1c1/0x220 [12375.731459][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12375.731701][ C1] _raw_spin_lock_nested+0x65/0x80 [12375.731962][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12375.732198][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12375.732446][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12375.732704][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12375.732982][ C1] ip_local_deliver_finish+0x2ae/0x480 [12375.733260][ C1] ip_local_deliver+0x19d/0x480 [12375.733507][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12375.733782][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12375.734046][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12375.734395][ C1] ? rcu_read_lock_held+0xe/0x50 [12375.734648][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12375.734968][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12375.735230][ C1] ip_rcv+0x564/0x740 [12375.735433][ C1] ? __pfx_ip_rcv+0x10/0x10 [12375.735665][ C1] ? set_track_prepare+0x8a/0xd0 [12375.735917][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12375.736195][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12375.736466][ C1] ? skb_clone+0x10b/0x330 [12375.736696][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12375.737014][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12375.737319][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12375.737602][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12375.737895][ C1] ? __tcf_classify+0x329/0x7d0 [12375.738143][ C1] ? __pfx_ip_rcv+0x10/0x10 [12375.738374][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12375.738672][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12375.738959][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12375.739285][ C1] ? lock_acquire+0x1c1/0x220 [12375.739524][ C1] ? netif_receive_skb_internal+0x84/0x300 [12375.739818][ C1] netif_receive_skb_internal+0xb0/0x300 [12375.740104][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12375.740424][ C1] ? __copy_skb_header+0xaf/0x490 [12375.740682][ C1] ? __skb_clone+0x57a/0x760 [12375.740919][ C1] netif_receive_skb+0x55/0x280 [12375.741169][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12375.741481][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12375.741813][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12375.742113][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12375.742388][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12375.742675][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12375.742987][ C1] ? hlock_class+0x4e/0x130 [12375.743221][ C1] ? get_stack_info_noinstr+0x18/0x110 [12375.743496][ C1] ? get_stack_info_noinstr+0x18/0x110 [12375.743772][ C1] ? __pfx_validate_chain+0x10/0x10 [12375.744036][ C1] ? hlock_class+0x4e/0x130 [12375.744266][ C1] ? mark_lock+0x38/0x3e0 [12375.744486][ C1] ? stack_access_ok+0xda/0x1f0 [12375.744734][ C1] ? __lock_acquire+0xb67/0x1610 [12375.744988][ C1] ? get_stack_info_noinstr+0x18/0x110 [12375.745265][ C1] ? get_stack_info+0x36/0xc0 [12375.745506][ C1] ? stack_access_ok+0xda/0x1f0 [12375.745751][ C1] ? get_reg+0x119/0x190 [12375.745969][ C1] ? unwind_next_frame+0x12af/0x1d10 [12375.746236][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12375.746547][ C1] __tcf_classify+0x329/0x7d0 [12375.746787][ C1] tcf_classify+0x283/0x930 [12375.747018][ C1] ? arch_stack_walk+0xa2/0x100 [12375.747267][ C1] ? __pfx_tcf_classify+0x10/0x10 [12375.747523][ C1] ? get_stack_info+0x36/0xc0 [12375.747763][ C1] tc_run+0x2e4/0x5d0 [12375.747968][ C1] ? __pfx_tc_run+0x10/0x10 [12375.748200][ C1] ? lock_acquire+0x1c1/0x220 [12375.748436][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12375.748697][ C1] __dev_queue_xmit+0x686/0x17e0 [12375.748950][ C1] ? lock_acquire+0x1c1/0x220 [12375.749188][ C1] ? ip_finish_output2+0x786/0x18e0 [12375.749452][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12375.749757][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12375.750028][ C1] ? neigh_hh_output+0x348/0x590 [12375.750280][ C1] ? ip_finish_output2+0x262/0x18e0 [12375.750545][ C1] ip_finish_output2+0x786/0x18e0 [12375.750802][ C1] ? stack_depot_save_flags+0x45/0x550 [12375.751087][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12375.751425][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12375.751699][ C1] ? rcu_read_lock_held+0xe/0x50 [12375.751953][ C1] ? __ip_finish_output+0x10f/0x770 [12375.752218][ C1] ip_output+0x16b/0x4f0 [12375.752435][ C1] ? run_timer_softirq+0x72/0x100 [12375.752691][ C1] ? __pfx_ip_output+0x10/0x10 [12375.752933][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12375.753222][ C1] ? rcu_read_lock_held+0xe/0x50 [12375.753475][ C1] ? ip_local_out+0x114/0x3b0 [12375.753714][ C1] __ip_queue_xmit+0x672/0x1910 [12375.753962][ C1] ? __create_object+0x5e/0xb0 [12375.754205][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12375.754472][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12375.754755][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12375.755028][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12375.755309][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12375.755581][ C1] tcp_delack_timer+0x84/0x240 [12375.755824][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12375.756097][ C1] call_timer_fn+0x173/0x430 [12375.756332][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12375.756595][ C1] ? next_expiry_recalc+0xcd/0x220 [12375.756856][ C1] __run_timers.part.0+0x52d/0x890 [12375.757117][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12375.757395][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12375.757679][ C1] ? lock_acquire+0x1c1/0x220 [12375.757918][ C1] ? clockevents_program_event+0xf6/0x300 [12375.758208][ C1] ? lock_release+0x1d5/0x250 [12375.758448][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12375.758712][ C1] ? ktime_get+0xb3/0x190 [12375.758935][ C1] ? clockevents_program_event+0x1ea/0x300 [12375.759229][ C1] run_timer_softirq+0x72/0x100 [12375.759478][ C1] __do_softirq+0x1b9/0x7ff [12375.759712][ C1] irq_exit_rcu+0x98/0xc0 [12375.759932][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12375.760219][ C1] [12375.760369][ C1] [12375.760519][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12375.760823][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12375.761154][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12375.762123][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12375.762432][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12375.762831][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12375.763232][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12375.763629][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12375.764028][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12375.764429][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12375.764726][ C1] pipe_read+0xa16/0xdf0 [12375.764946][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12375.765225][ C1] ? __pfx_pipe_read+0x10/0x10 [12375.765468][ C1] ? iterate_tty_write+0x299/0x540 [12375.765730][ C1] ? lock_release+0x1d5/0x250 [12375.765968][ C1] vfs_read+0x911/0xc00 [12375.766185][ C1] ? lock_acquire+0x1c1/0x220 [12375.766423][ C1] ? __might_fault+0xc6/0x180 [12375.766663][ C1] ? __pfx_vfs_read+0x10/0x10 [12375.766902][ C1] ? __might_fault+0xc6/0x180 [12375.767143][ C1] ? lock_release+0x1d5/0x250 [12375.767381][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12375.767647][ C1] ? __fget_light+0x54/0x1e0 [12375.767882][ C1] ksys_read+0x17a/0x1e0 [12375.768101][ C1] ? __pfx_ksys_read+0x10/0x10 [12375.768344][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12375.768652][ C1] do_syscall_64+0xc9/0x1e0 [12375.768885][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12375.769185][ C1] RIP: 0033:0x7f08a1ea38b2 [12375.769413][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12375.770382][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12375.770804][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12375.771210][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12375.771608][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12375.772007][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12375.772406][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12375.772808][ C1] [12375.772965][ C1] Sending NMI from CPU 1 to CPUs 2: [12375.773243][ C2] NMI backtrace for cpu 2 [12375.773254][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12375.773260][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12375.773265][ C2] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12375.773277][ C2] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12375.773283][ C2] RSP: 0018:ffffc9000021fa98 EFLAGS: 00000202 [12375.773290][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12375.773294][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12375.773298][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12375.773302][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12375.773306][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12375.773310][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12375.773315][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12375.773321][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12375.773325][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12375.773328][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12375.773331][ C2] PKRU: 55555554 [12375.773332][ C2] Call Trace: [12375.773336][ C2] [12375.773340][ C2] ? nmi_cpu_backtrace+0x112/0x220 [12375.773349][ C2] ? nmi_cpu_backtrace_handler+0x11/0x20 [12375.773355][ C2] ? nmi_handle+0x153/0x420 [12375.773361][ C2] ? default_do_nmi+0x41/0x100 [12375.773365][ C2] ? exc_nmi+0xf3/0x120 [12375.773368][ C2] ? end_repeat_nmi+0xf/0x60 [12375.773375][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12375.773379][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12375.773382][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12375.773385][ C2] ? queued_spin_lock_slowpath+0x12d/0xb90 [12375.773388][ C2] [12375.773389][ C2] [12375.773390][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12375.773393][ C2] ? get_stack_info+0x36/0xc0 [12375.773398][ C2] ? lock_acquire+0x1c1/0x220 [12375.773403][ C2] ? lock_release+0x1d5/0x250 [12375.773406][ C2] do_raw_spin_lock+0x1ec/0x270 [12375.773410][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12375.773413][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12375.773416][ C2] ? lock_acquire+0x1c1/0x220 [12375.773419][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12375.773423][ C2] _raw_spin_lock_nested+0x65/0x80 [12375.773427][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12375.773434][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12375.773436][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12375.773441][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12375.773448][ C2] ip_local_deliver_finish+0x2ae/0x480 [12375.773452][ C2] ip_local_deliver+0x19d/0x480 [12375.773455][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12375.773457][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12375.773459][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12375.773466][ C2] ? rcu_read_lock_held+0xe/0x50 [12375.773471][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12375.773474][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12375.773485][ C2] ip_rcv+0x564/0x740 [12375.773488][ C2] ? __pfx_ip_rcv+0x10/0x10 [12375.773490][ C2] ? set_track_prepare+0x8a/0xd0 [12375.773496][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12375.773499][ C2] ? start_secondary+0x21c/0x2b0 [12375.773504][ C2] ? skb_clone+0x10b/0x330 [12375.773508][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12375.773514][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12375.773520][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12375.773525][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12375.773534][ C2] ? __tcf_classify+0x329/0x7d0 [12375.773539][ C2] ? __pfx_ip_rcv+0x10/0x10 [12375.773541][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12375.773545][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12375.773548][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12375.773553][ C2] ? lock_acquire+0x1c1/0x220 [12375.773555][ C2] ? netif_receive_skb_internal+0x84/0x300 [12375.773559][ C2] netif_receive_skb_internal+0xb0/0x300 [12375.773563][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12375.773567][ C2] ? __copy_skb_header+0xaf/0x490 [12375.773571][ C2] ? __skb_clone+0x57a/0x760 [12375.773574][ C2] netif_receive_skb+0x55/0x280 [12375.773577][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12375.773585][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12375.773592][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12375.773598][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12375.773603][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12375.773613][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12375.773620][ C2] ? get_stack_info+0x36/0xc0 [12375.773625][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12375.773629][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12375.773635][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12375.773638][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12375.773641][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12375.773644][ C2] ? kernel_text_address+0x17/0xe0 [12375.773648][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12375.773653][ C2] ? arch_stack_walk+0x8c/0x100 [12375.773657][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12375.773661][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12375.773664][ C2] ? lock_acquire+0x1c1/0x220 [12375.773666][ C2] ? stack_depot_save_flags+0x281/0x550 [12375.773671][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12375.773677][ C2] ? get_stack_info_noinstr+0x18/0x110 [12375.773680][ C2] ? get_stack_info+0x36/0xc0 [12375.773684][ C2] __tcf_classify+0x329/0x7d0 [12375.773690][ C2] tcf_classify+0x283/0x930 [12375.773695][ C2] ? __pfx_tcf_classify+0x10/0x10 [12375.773698][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12375.773703][ C2] tc_run+0x2e4/0x5d0 [12375.773707][ C2] ? __pfx_tc_run+0x10/0x10 [12375.773710][ C2] ? lock_acquire+0x1c1/0x220 [12375.773713][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12375.773717][ C2] __dev_queue_xmit+0x686/0x17e0 [12375.773721][ C2] ? lock_acquire+0x1c1/0x220 [12375.773723][ C2] ? ip_finish_output2+0x786/0x18e0 [12375.773727][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12375.773730][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12375.773733][ C2] ? neigh_hh_output+0x348/0x590 [12375.773737][ C2] ? ip_finish_output2+0x262/0x18e0 [12375.773741][ C2] ip_finish_output2+0x786/0x18e0 [12375.773745][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12375.773753][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12375.773755][ C2] ? rcu_read_lock_held+0xe/0x50 [12375.773759][ C2] ? __ip_finish_output+0x10f/0x770 [12375.773763][ C2] ip_output+0x16b/0x4f0 [12375.773766][ C2] ? __pfx_ip_output+0x10/0x10 [12375.773769][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12375.773771][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12375.773775][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12375.773779][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12375.773781][ C2] ? __alloc_skb+0xd4/0x280 [12375.773784][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12375.773789][ C2] ? tcp_fragment+0x168/0x1040 [12375.773793][ C2] ? rcu_read_lock_held+0xe/0x50 [12375.773796][ C2] ? ip_local_out+0x114/0x3b0 [12375.773799][ C2] __ip_queue_xmit+0x672/0x1910 [12375.773803][ C2] ? __skb_clone+0x57a/0x760 [12375.773806][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12375.773812][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12375.773815][ C2] ? ipv4_dst_check+0xe3/0x170 [12375.773820][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12375.773825][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12375.773830][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12375.773833][ C2] ? tcp_fragment+0xb0e/0x1040 [12375.773836][ C2] tcp_send_loss_probe+0x348/0x830 [12375.773840][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12375.773842][ C2] tcp_write_timer+0x82/0x1d0 [12375.773845][ C2] call_timer_fn+0x173/0x430 [12375.773850][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12375.773854][ C2] ? next_expiry_recalc+0xcd/0x220 [12375.773858][ C2] __run_timers.part.0+0x52d/0x890 [12375.773861][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12375.773866][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12375.773869][ C2] ? lock_acquire+0x1c1/0x220 [12375.773871][ C2] ? clockevents_program_event+0xf6/0x300 [12375.773877][ C2] ? lock_release+0x1d5/0x250 [12375.773879][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12375.773883][ C2] ? ktime_get+0xb3/0x190 [12375.773887][ C2] ? clockevents_program_event+0x1ea/0x300 [12375.773891][ C2] run_timer_softirq+0x72/0x100 [12375.773895][ C2] __do_softirq+0x1b9/0x7ff [12375.773899][ C2] irq_exit_rcu+0x98/0xc0 [12375.773903][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12375.773907][ C2] [12375.773907][ C2] [12375.773908][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12375.773912][ C2] RIP: 0010:default_idle+0xf/0x20 [12375.773915][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12375.773918][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12375.773921][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12375.773923][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12375.773925][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12375.773926][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12375.773928][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12375.773932][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12375.773935][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12375.773940][ C2] default_idle_call+0x69/0xa0 [12375.773944][ C2] cpuidle_idle_call+0x1f6/0x280 [12375.773946][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12375.773950][ C2] ? lock_release+0x1d5/0x250 [12375.773953][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12375.773957][ C2] do_idle+0xfb/0x160 [12375.773960][ C2] cpu_startup_entry+0x55/0x60 [12375.773962][ C2] start_secondary+0x21c/0x2b0 [12375.773965][ C2] ? __pfx_start_secondary+0x10/0x10 [12375.773969][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12375.773976][ C2] [12400.569270][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 9357s! [perl:4135] [12400.569694][ C1] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12400.570958][ C1] irq event stamp: 209232 [12400.571177][ C1] hardirqs last enabled at (209231): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12400.571706][ C1] hardirqs last disabled at (209232): [] common_interrupt+0x13/0x90 [12400.572188][ C1] softirqs last enabled at (196496): [] __do_softirq+0x519/0x7ff [12400.572657][ C1] softirqs last disabled at (196487): [] irq_exit_rcu+0x98/0xc0 [12400.573118][ C1] CPU: 1 PID: 4135 Comm: perl Tainted: G L 6.8.0-rc2-virtme #1 [12400.573568][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12400.574185][ C1] RIP: 0010:queued_spin_lock_slowpath+0x12d/0xb90 [12400.574514][ C1] Code: 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 43 0a 00 00 48 81 c4 88 00 00 00 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc f3 90 71 ff ff ff 44 8b 74 24 48 41 81 fe 00 01 00 00 0f 84 e2 00 00 [12400.575490][ C1] RSP: 0018:ffffc900001c7b78 EFLAGS: 00000202 [12400.575799][ C1] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12400.576200][ C1] RDX: ffffed10014741c4 RSI: 0000000000000004 RDI: ffff88800a3a0e18 [12400.576599][ C1] RBP: ffff88800a3a0e18 R08: 0000000000000000 R09: ffffed10014741c3 [12400.577000][ C1] R10: ffff88800a3a0e1b R11: 0000008000000000 R12: 0000000000000003 [12400.577401][ C1] R13: ffffed10014741c3 R14: 0000000000000001 R15: 1ffff92000038f70 [12400.577800][ C1] FS: 00007f08a1c4ef00(0000) GS:ffff888035600000(0000) knlGS:0000000000000000 [12400.578249][ C1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12400.578583][ C1] CR2: 0000564c37401220 CR3: 0000000007faa004 CR4: 0000000000770ef0 [12400.578986][ C1] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12400.579387][ C1] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12400.579786][ C1] PKRU: 55555554 [12400.579968][ C1] Call Trace: [12400.580141][ C1] [12400.580289][ C1] ? watchdog_timer_fn+0x2cf/0x3c0 [12400.580552][ C1] ? __run_hrtimer+0x1c0/0x710 [12400.580802][ C1] ? __pfx_watchdog_timer_fn+0x10/0x10 [12400.581078][ C1] ? __hrtimer_run_queues+0x197/0x270 [12400.581353][ C1] ? __pfx___hrtimer_run_queues+0x10/0x10 [12400.581642][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12400.581908][ C1] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12400.582217][ C1] ? hrtimer_interrupt+0x2c3/0x770 [12400.582480][ C1] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12400.582790][ C1] ? sysvec_apic_timer_interrupt+0x39/0x80 [12400.583085][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12400.583403][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12400.583695][ C1] ? queued_spin_lock_slowpath+0x12d/0xb90 [12400.583988][ C1] ? queued_spin_lock_slowpath+0xb0/0xb90 [12400.584280][ C1] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12400.584593][ C1] ? get_stack_info+0x36/0xc0 [12400.584834][ C1] ? lock_acquire+0x1c1/0x220 [12400.585075][ C1] ? lock_release+0x1d5/0x250 [12400.585317][ C1] do_raw_spin_lock+0x1ec/0x270 [12400.585568][ C1] ? __pfx_do_raw_spin_lock+0x10/0x10 [12400.585840][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12400.586127][ C1] ? lock_acquire+0x1c1/0x220 [12400.586366][ C1] ? tcp_v4_rcv+0x221e/0x2ac0 [12400.586609][ C1] _raw_spin_lock_nested+0x65/0x80 [12400.586870][ C1] tcp_v4_rcv+0x221e/0x2ac0 [12400.587106][ C1] ? __pfx_tcp_v4_rcv+0x10/0x10 [12400.587355][ C1] ? __pfx_raw_v4_input+0x10/0x10 [12400.587613][ C1] ip_protocol_deliver_rcu+0x93/0x360 [12400.587892][ C1] ip_local_deliver_finish+0x2ae/0x480 [12400.588170][ C1] ip_local_deliver+0x19d/0x480 [12400.588419][ C1] ? __pfx_ip_local_deliver+0x10/0x10 [12400.588690][ C1] ? tcp_v4_early_demux+0x59a/0x9d0 [12400.588953][ C1] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12400.589305][ C1] ? rcu_read_lock_held+0xe/0x50 [12400.589559][ C1] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12400.589880][ C1] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12400.590145][ C1] ip_rcv+0x564/0x740 [12400.590349][ C1] ? __pfx_ip_rcv+0x10/0x10 [12400.590581][ C1] ? set_track_prepare+0x8a/0xd0 [12400.590840][ C1] ? __pfx_set_track_prepare+0x10/0x10 [12400.591119][ C1] ? __tcp_transmit_skb+0x22b1/0x2d20 [12400.591393][ C1] ? skb_clone+0x10b/0x330 [12400.591622][ C1] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12400.591941][ C1] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12400.592248][ C1] ? tcf_action_exec.part.0+0x112/0x3d0 [12400.592533][ C1] ? fl_classify+0x4dc/0x650 [cls_flower] [12400.592827][ C1] ? __tcf_classify+0x329/0x7d0 [12400.593078][ C1] ? __pfx_ip_rcv+0x10/0x10 [12400.593310][ C1] __netif_receive_skb_one_core+0x166/0x1b0 [12400.593608][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12400.593896][ C1] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12400.594224][ C1] ? lock_acquire+0x1c1/0x220 [12400.594463][ C1] ? netif_receive_skb_internal+0x84/0x300 [12400.594759][ C1] netif_receive_skb_internal+0xb0/0x300 [12400.595047][ C1] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12400.595365][ C1] ? __copy_skb_header+0xaf/0x490 [12400.595623][ C1] ? __skb_clone+0x57a/0x760 [12400.595857][ C1] netif_receive_skb+0x55/0x280 [12400.596106][ C1] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12400.596421][ C1] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12400.596754][ C1] tcf_mirred_act+0x338/0x780 [act_mirred] [12400.597055][ C1] tcf_action_exec.part.0+0x112/0x3d0 [12400.597331][ C1] fl_classify+0x4dc/0x650 [cls_flower] [12400.597619][ C1] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12400.597933][ C1] ? hlock_class+0x4e/0x130 [12400.598168][ C1] ? get_stack_info_noinstr+0x18/0x110 [12400.598444][ C1] ? get_stack_info_noinstr+0x18/0x110 [12400.598719][ C1] ? __pfx_validate_chain+0x10/0x10 [12400.598985][ C1] ? hlock_class+0x4e/0x130 [12400.599218][ C1] ? mark_lock+0x38/0x3e0 [12400.599439][ C1] ? stack_access_ok+0xda/0x1f0 [12400.599687][ C1] ? __lock_acquire+0xb67/0x1610 [12400.599940][ C1] ? get_stack_info_noinstr+0x18/0x110 [12400.600220][ C1] ? get_stack_info+0x36/0xc0 [12400.600459][ C1] ? stack_access_ok+0xda/0x1f0 [12400.600707][ C1] ? get_reg+0x119/0x190 [12400.600935][ C1] ? unwind_next_frame+0x12af/0x1d10 [12400.601204][ C1] ? entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12400.601514][ C1] __tcf_classify+0x329/0x7d0 [12400.601756][ C1] tcf_classify+0x283/0x930 [12400.601989][ C1] ? arch_stack_walk+0xa2/0x100 [12400.602239][ C1] ? __pfx_tcf_classify+0x10/0x10 [12400.602496][ C1] ? get_stack_info+0x36/0xc0 [12400.602739][ C1] tc_run+0x2e4/0x5d0 [12400.602944][ C1] ? __pfx_tc_run+0x10/0x10 [12400.603176][ C1] ? lock_acquire+0x1c1/0x220 [12400.603414][ C1] ? __dev_queue_xmit+0x1da/0x17e0 [12400.603675][ C1] __dev_queue_xmit+0x686/0x17e0 [12400.603929][ C1] ? lock_acquire+0x1c1/0x220 [12400.604170][ C1] ? ip_finish_output2+0x786/0x18e0 [12400.604435][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12400.604742][ C1] ? __pfx___dev_queue_xmit+0x10/0x10 [12400.605015][ C1] ? neigh_hh_output+0x348/0x590 [12400.605270][ C1] ? ip_finish_output2+0x262/0x18e0 [12400.605535][ C1] ip_finish_output2+0x786/0x18e0 [12400.605791][ C1] ? stack_depot_save_flags+0x45/0x550 [12400.606071][ C1] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12400.606411][ C1] ? __pfx_ip_finish_output2+0x10/0x10 [12400.606689][ C1] ? rcu_read_lock_held+0xe/0x50 [12400.606943][ C1] ? __ip_finish_output+0x10f/0x770 [12400.607210][ C1] ip_output+0x16b/0x4f0 [12400.607428][ C1] ? run_timer_softirq+0x72/0x100 [12400.607686][ C1] ? __pfx_ip_output+0x10/0x10 [12400.607930][ C1] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12400.608220][ C1] ? rcu_read_lock_held+0xe/0x50 [12400.608473][ C1] ? ip_local_out+0x114/0x3b0 [12400.608711][ C1] __ip_queue_xmit+0x672/0x1910 [12400.608961][ C1] ? __create_object+0x5e/0xb0 [12400.609208][ C1] __tcp_transmit_skb+0x22b1/0x2d20 [12400.609475][ C1] ? __pfx___tcp_transmit_skb+0x10/0x10 [12400.609758][ C1] ? __tcp_send_ack.part.0+0x66/0x6e0 [12400.610032][ C1] tcp_delack_timer_handler+0x24f/0x3e0 [12400.610315][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12400.610588][ C1] tcp_delack_timer+0x84/0x240 [12400.610839][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12400.611114][ C1] call_timer_fn+0x173/0x430 [12400.611350][ C1] ? __pfx_call_timer_fn+0x10/0x10 [12400.611612][ C1] ? next_expiry_recalc+0xcd/0x220 [12400.611875][ C1] __run_timers.part.0+0x52d/0x890 [12400.612137][ C1] ? __pfx_tcp_delack_timer+0x10/0x10 [12400.612414][ C1] ? __pfx___run_timers.part.0+0x10/0x10 [12400.612699][ C1] ? lock_acquire+0x1c1/0x220 [12400.612939][ C1] ? clockevents_program_event+0xf6/0x300 [12400.613229][ C1] ? lock_release+0x1d5/0x250 [12400.613470][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12400.613735][ C1] ? ktime_get+0xb3/0x190 [12400.613957][ C1] ? clockevents_program_event+0x1ea/0x300 [12400.614256][ C1] run_timer_softirq+0x72/0x100 [12400.614506][ C1] __do_softirq+0x1b9/0x7ff [12400.614740][ C1] irq_exit_rcu+0x98/0xc0 [12400.614960][ C1] sysvec_apic_timer_interrupt+0x75/0x80 [12400.615250][ C1] [12400.615399][ C1] [12400.615549][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12400.615855][ C1] RIP: 0010:_raw_spin_unlock_irqrestore+0x43/0x70 [12400.616181][ C1] Code: 10 e8 91 59 a6 fd 48 89 ef e8 a9 e1 a6 fd 81 e3 00 02 00 00 75 1d 9c 58 f6 c4 02 75 29 48 85 db 74 01 fb 65 ff 0d 25 d6 57 68 <74> 0e 5b 5d c3 cc cc cc cc e8 2f a2 c8 fd eb dc 0f 1f 44 00 00 5b [12400.617155][ C1] RSP: 0018:ffffc900026cfbb8 EFLAGS: 00000286 [12400.617464][ C1] RAX: 0000000000000046 RBX: 0000000000000200 RCX: 1ffffffff331c323 [12400.617866][ C1] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff97c7e0b1 [12400.618272][ C1] RBP: ffff88801662dcf8 R08: 0000000000000000 R09: fffffbfff331c0da [12400.618672][ C1] R10: ffffffff998e06d7 R11: ffff8880165058f8 R12: ffff88801662dd54 [12400.619072][ C1] R13: 0000000000000001 R14: 0000000000000006 R15: ffff8880165058f0 [12400.619478][ C1] ? _raw_spin_unlock_irqrestore+0x51/0x70 [12400.619777][ C1] pipe_read+0xa16/0xdf0 [12400.619997][ C1] ? __pfx___fsnotify_parent+0x10/0x10 [12400.620279][ C1] ? __pfx_pipe_read+0x10/0x10 [12400.620524][ C1] ? iterate_tty_write+0x299/0x540 [12400.620791][ C1] ? lock_release+0x1d5/0x250 [12400.621031][ C1] vfs_read+0x911/0xc00 [12400.621248][ C1] ? lock_acquire+0x1c1/0x220 [12400.621486][ C1] ? __might_fault+0xc6/0x180 [12400.621728][ C1] ? __pfx_vfs_read+0x10/0x10 [12400.621968][ C1] ? __might_fault+0xc6/0x180 [12400.622210][ C1] ? lock_release+0x1d5/0x250 [12400.622448][ C1] ? kvm_clock_get_cycles+0x18/0x30 [12400.622715][ C1] ? __fget_light+0x54/0x1e0 [12400.622953][ C1] ksys_read+0x17a/0x1e0 [12400.623172][ C1] ? __pfx_ksys_read+0x10/0x10 [12400.623415][ C1] ? trace_irq_enable.constprop.0+0xd4/0x100 [12400.623721][ C1] do_syscall_64+0xc9/0x1e0 [12400.623955][ C1] entry_SYSCALL_64_after_hwframe+0x6f/0x77 [12400.624257][ C1] RIP: 0033:0x7f08a1ea38b2 [12400.624485][ C1] Code: c0 e9 b2 fe ff ff 50 48 8d 3d ea 0e 08 00 e8 65 ea 01 00 0f 1f 44 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 48 83 ec 28 48 89 54 24 [12400.625460][ C1] RSP: 002b:00007ffda662a3f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 [12400.625882][ C1] RAX: ffffffffffffffda RBX: 000055838e99f5d0 RCX: 00007f08a1ea38b2 [12400.626283][ C1] RDX: 0000000000000001 RSI: 000055838e99f5d0 RDI: 0000000000000000 [12400.626681][ C1] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [12400.627080][ C1] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000000 [12400.627482][ C1] R13: 0000000000000000 R14: 0000000000000001 R15: 000055838e95f2a0 [12400.627884][ C1] [12400.628043][ C2] watchdog: BUG: soft lockup - CPU#2 stuck for 9357s! [swapper/2:0] [12400.628478][ C2] Modules linked in: act_skbedit act_ct nf_flow_table nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vxlan ip6_udp_tunnel udp_tunnel act_mirred cls_matchall bridge stp llc ip_gre act_gact cls_flower sch_ingress 8021q ip6_gre ip6_tunnel tunnel6 gre vrf veth [12400.629731][ C2] irq event stamp: 44114564 [12400.629960][ C2] hardirqs last enabled at (44114564): [] _raw_spin_unlock_irqrestore+0x51/0x70 [12400.630499][ C2] hardirqs last disabled at (44114563): [] _raw_spin_lock_irqsave+0x70/0x90 [12400.631019][ C2] softirqs last enabled at (44113982): [] __do_softirq+0x519/0x7ff [12400.631493][ C2] softirqs last disabled at (44113989): [] irq_exit_rcu+0x98/0xc0 [12400.631964][ C2] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G L 6.8.0-rc2-virtme #1 [12400.632421][ C2] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014 [12400.633030][ C2] RIP: 0010:__kasan_check_read+0x0/0x20 [12400.633316][ C2] Code: 48 c7 c7 b0 5a 98 98 5b 5d 41 5c e9 ba 23 9c ff 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1e fa 48 8b 0c 24 89 f6 31 d2 e9 af ef ff ff 66 66 2e 0f 1f [12400.634284][ C2] RSP: 0018:ffffc9000021fa90 EFLAGS: 00000202 [12400.634591][ C2] RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff97c7eb80 [12400.634988][ C2] RDX: ffffed100147436c RSI: 0000000000000004 RDI: ffff88800a3a1b58 [12400.635386][ C2] RBP: ffff88800a3a1b58 R08: 0000000000000000 R09: ffffed100147436b [12400.635783][ C2] R10: ffff88800a3a1b5b R11: 0000008000000000 R12: 0000000000000003 [12400.636184][ C2] R13: ffffed100147436b R14: 0000000000000001 R15: 1ffff92000043f54 [12400.636582][ C2] FS: 0000000000000000(0000) GS:ffff888035a00000(0000) knlGS:0000000000000000 [12400.637025][ C2] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [12400.637356][ C2] CR2: 00005575f9a5f000 CR3: 0000000006876003 CR4: 0000000000770ef0 [12400.637754][ C2] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12400.638155][ C2] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [12400.638552][ C2] PKRU: 55555554 [12400.638732][ C2] Call Trace: [12400.638902][ C2] [12400.639052][ C2] ? watchdog_timer_fn+0x2cf/0x3c0 [12400.639314][ C2] ? __run_hrtimer+0x1c0/0x710 [12400.639557][ C2] ? __pfx_watchdog_timer_fn+0x10/0x10 [12400.639833][ C2] ? __hrtimer_run_queues+0x197/0x270 [12400.640104][ C2] ? __pfx___hrtimer_run_queues+0x10/0x10 [12400.640392][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12400.640657][ C2] ? ktime_get_update_offsets_now+0xe1/0x2d0 [12400.640970][ C2] ? hrtimer_interrupt+0x2c3/0x770 [12400.641231][ C2] ? trace_rcu_dyntick+0x10a/0x150 [12400.641493][ C2] ? __sysvec_apic_timer_interrupt+0xbe/0x380 [12400.641801][ C2] ? sysvec_apic_timer_interrupt+0x39/0x80 [12400.642096][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12400.642412][ C2] ? queued_spin_lock_slowpath+0xb0/0xb90 [12400.642700][ C2] ? __pfx___kasan_check_read+0x10/0x10 [12400.642981][ C2] queued_spin_lock_slowpath+0xb0/0xb90 [12400.643261][ C2] ? __pfx_queued_spin_lock_slowpath+0x10/0x10 [12400.643572][ C2] ? get_stack_info+0x36/0xc0 [12400.643824][ C2] ? lock_acquire+0x1c1/0x220 [12400.644065][ C2] ? lock_release+0x1d5/0x250 [12400.644304][ C2] do_raw_spin_lock+0x1ec/0x270 [12400.644554][ C2] ? __pfx_do_raw_spin_lock+0x10/0x10 [12400.644827][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12400.645113][ C2] ? lock_acquire+0x1c1/0x220 [12400.645352][ C2] ? tcp_v4_rcv+0x221e/0x2ac0 [12400.645592][ C2] _raw_spin_lock_nested+0x65/0x80 [12400.645851][ C2] tcp_v4_rcv+0x221e/0x2ac0 [12400.646086][ C2] ? __pfx_tcp_v4_rcv+0x10/0x10 [12400.646333][ C2] ? __pfx_raw_v4_input+0x10/0x10 [12400.646592][ C2] ip_protocol_deliver_rcu+0x93/0x360 [12400.646870][ C2] ip_local_deliver_finish+0x2ae/0x480 [12400.647149][ C2] ip_local_deliver+0x19d/0x480 [12400.647396][ C2] ? __pfx_ip_local_deliver+0x10/0x10 [12400.647670][ C2] ? tcp_v4_early_demux+0x59a/0x9d0 [12400.647934][ C2] ? __netif_receive_skb_core.constprop.0+0x648/0x2da0 [12400.648282][ C2] ? rcu_read_lock_held+0xe/0x50 [12400.648536][ C2] ? ip_rcv_finish_core.constprop.0+0x522/0x1300 [12400.648856][ C2] ? vrf_l3_rcv+0x3e5/0x510 [vrf] [12400.649124][ C2] ip_rcv+0x564/0x740 [12400.649327][ C2] ? __pfx_ip_rcv+0x10/0x10 [12400.649559][ C2] ? set_track_prepare+0x8a/0xd0 [12400.649813][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12400.650089][ C2] ? start_secondary+0x21c/0x2b0 [12400.650342][ C2] ? skb_clone+0x10b/0x330 [12400.650572][ C2] ? tcf_mirred_to_dev+0x130/0xd70 [act_mirred] [12400.650907][ C2] ? tcf_mirred_act+0x338/0x780 [act_mirred] [12400.651211][ C2] ? tcf_action_exec.part.0+0x112/0x3d0 [12400.651496][ C2] ? fl_classify+0x4dc/0x650 [cls_flower] [12400.651788][ C2] ? __tcf_classify+0x329/0x7d0 [12400.652039][ C2] ? __pfx_ip_rcv+0x10/0x10 [12400.652272][ C2] __netif_receive_skb_one_core+0x166/0x1b0 [12400.652571][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12400.652858][ C2] ? __pfx___netif_receive_skb_one_core+0x10/0x10 [12400.653185][ C2] ? lock_acquire+0x1c1/0x220 [12400.653425][ C2] ? netif_receive_skb_internal+0x84/0x300 [12400.653720][ C2] netif_receive_skb_internal+0xb0/0x300 [12400.654009][ C2] ? __pfx_netif_receive_skb_internal+0x10/0x10 [12400.654327][ C2] ? __copy_skb_header+0xaf/0x490 [12400.654587][ C2] ? __skb_clone+0x57a/0x760 [12400.654820][ C2] netif_receive_skb+0x55/0x280 [12400.655069][ C2] tcf_mirred_to_dev+0x444/0xd70 [act_mirred] [12400.655384][ C2] ? __pfx_tcf_skbedit_act+0x10/0x10 [act_skbedit] [12400.655715][ C2] tcf_mirred_act+0x338/0x780 [act_mirred] [12400.656015][ C2] tcf_action_exec.part.0+0x112/0x3d0 [12400.656291][ C2] fl_classify+0x4dc/0x650 [cls_flower] [12400.656579][ C2] ? __pfx_fl_classify+0x10/0x10 [cls_flower] [12400.656891][ C2] ? get_stack_info+0x36/0xc0 [12400.657135][ C2] ? unwind_next_frame+0x1cc/0x1d10 [12400.657400][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12400.657725][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12400.657999][ C2] ? __pfx_unwind_next_frame+0x10/0x10 [12400.658279][ C2] ? secondary_startup_64_no_verify+0x16d/0x17b [12400.658594][ C2] ? kernel_text_address+0x17/0xe0 [12400.658855][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12400.659168][ C2] ? arch_stack_walk+0x8c/0x100 [12400.659416][ C2] ? do_raw_spin_trylock+0xb9/0x190 [12400.659680][ C2] ? __pfx_do_raw_spin_trylock+0x10/0x10 [12400.659964][ C2] ? lock_acquire+0x1c1/0x220 [12400.660204][ C2] ? stack_depot_save_flags+0x281/0x550 [12400.660485][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12400.660799][ C2] ? get_stack_info_noinstr+0x18/0x110 [12400.661074][ C2] ? get_stack_info+0x36/0xc0 [12400.661319][ C2] __tcf_classify+0x329/0x7d0 [12400.661562][ C2] tcf_classify+0x283/0x930 [12400.661794][ C2] ? __pfx_tcf_classify+0x10/0x10 [12400.662050][ C2] ? __pfx_stack_trace_consume_entry+0x10/0x10 [12400.662365][ C2] tc_run+0x2e4/0x5d0 [12400.662573][ C2] ? __pfx_tc_run+0x10/0x10 [12400.662805][ C2] ? lock_acquire+0x1c1/0x220 [12400.663045][ C2] ? __dev_queue_xmit+0x1da/0x17e0 [12400.663307][ C2] __dev_queue_xmit+0x686/0x17e0 [12400.663561][ C2] ? lock_acquire+0x1c1/0x220 [12400.663800][ C2] ? ip_finish_output2+0x786/0x18e0 [12400.664067][ C2] ? trace_irq_enable.constprop.0+0xd4/0x100 [12400.664371][ C2] ? __pfx___dev_queue_xmit+0x10/0x10 [12400.664646][ C2] ? neigh_hh_output+0x348/0x590 [12400.664898][ C2] ? ip_finish_output2+0x262/0x18e0 [12400.665171][ C2] ip_finish_output2+0x786/0x18e0 [12400.665427][ C2] ? __pfx_vrf_ip_out_direct_finish+0x10/0x10 [vrf] [12400.665763][ C2] ? __pfx_ip_finish_output2+0x10/0x10 [12400.666037][ C2] ? rcu_read_lock_held+0xe/0x50 [12400.666291][ C2] ? __ip_finish_output+0x10f/0x770 [12400.666555][ C2] ip_output+0x16b/0x4f0 [12400.666773][ C2] ? __pfx_ip_output+0x10/0x10 [12400.667014][ C2] ? __pfx_set_track_prepare+0x10/0x10 [12400.667292][ C2] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12400.667605][ C2] ? kmem_cache_alloc_node+0x2b6/0x2e0 [12400.667883][ C2] ? kmalloc_reserve+0x11c/0x1f0 [12400.668135][ C2] ? __alloc_skb+0xd4/0x280 [12400.668367][ C2] ? tcp_stream_alloc_skb+0x30/0x510 [12400.668639][ C2] ? tcp_fragment+0x168/0x1040 [12400.668884][ C2] ? rcu_read_lock_held+0xe/0x50 [12400.669136][ C2] ? ip_local_out+0x114/0x3b0 [12400.669375][ C2] __ip_queue_xmit+0x672/0x1910 [12400.669625][ C2] ? __skb_clone+0x57a/0x760 [12400.669861][ C2] __tcp_transmit_skb+0x22b1/0x2d20 [12400.670130][ C2] ? __pfx___tcp_transmit_skb+0x10/0x10 [12400.670410][ C2] ? ipv4_dst_check+0xe3/0x170 [12400.670657][ C2] ? __sk_dst_check+0x1a1/0x2b0 [12400.670918][ C2] __tcp_retransmit_skb.part.0+0x4f5/0x1170 [12400.671220][ C2] ? __pfx___tcp_retransmit_skb.part.0+0x10/0x10 [12400.671541][ C2] ? tcp_fragment+0xb0e/0x1040 [12400.671784][ C2] tcp_send_loss_probe+0x348/0x830 [12400.672053][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12400.672322][ C2] tcp_write_timer+0x82/0x1d0 [12400.672561][ C2] call_timer_fn+0x173/0x430 [12400.672798][ C2] ? __pfx_call_timer_fn+0x10/0x10 [12400.673059][ C2] ? next_expiry_recalc+0xcd/0x220 [12400.673321][ C2] __run_timers.part.0+0x52d/0x890 [12400.673581][ C2] ? __pfx_tcp_write_timer+0x10/0x10 [12400.673852][ C2] ? __pfx___run_timers.part.0+0x10/0x10 [12400.674138][ C2] ? lock_acquire+0x1c1/0x220 [12400.674377][ C2] ? clockevents_program_event+0xf6/0x300 [12400.674668][ C2] ? lock_release+0x1d5/0x250 [12400.674908][ C2] ? kvm_clock_get_cycles+0x18/0x30 [12400.675173][ C2] ? ktime_get+0xb3/0x190 [12400.675395][ C2] ? clockevents_program_event+0x1ea/0x300 [12400.675690][ C2] run_timer_softirq+0x72/0x100 [12400.675943][ C2] __do_softirq+0x1b9/0x7ff [12400.676181][ C2] irq_exit_rcu+0x98/0xc0 [12400.676407][ C2] sysvec_apic_timer_interrupt+0x75/0x80 [12400.676695][ C2] [12400.676845][ C2] [12400.676995][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [12400.677302][ C2] RIP: 0010:default_idle+0xf/0x20 [12400.677562][ C2] Code: 4c 01 c7 4c 29 c2 e9 72 ff ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 66 90 0f 00 2d 93 51 41 00 fb f4 c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90 90 [12400.678527][ C2] RSP: 0018:ffffc9000014fdf8 EFLAGS: 00000246 [12400.678835][ C2] RAX: ffff888035bf7520 RBX: 1ffff92000029fc1 RCX: ffffffff97c4ba22 [12400.679238][ C2] RDX: ffffed1006b7eea5 RSI: 0000000000000004 RDI: ffffffff956968b6 [12400.679638][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffed1006b7eea4 [12400.680037][ C2] R10: ffff888035bf7523 R11: ffff888035bfc348 R12: 0000000000000000 [12400.680440][ C2] R13: ffff888001d1a640 R14: dffffc0000000000 R15: 0000000000000000 [12400.680847][ C2] ? ct_kernel_exit.constprop.0+0xc2/0xe0 [12400.681138][ C2] ? cpuidle_idle_call+0x1f6/0x280 [12400.681400][ C2] default_idle_call+0x69/0xa0 [12400.681644][ C2] cpuidle_idle_call+0x1f6/0x280 [12400.681905][ C2] ? __pfx_cpuidle_idle_call+0x10/0x10 [12400.682184][ C2] ? lock_release+0x1d5/0x250 [12400.682423][ C2] ? tsc_verify_tsc_adjust+0x65/0x2b0 [12400.682697][ C2] do_idle+0xfb/0x160 [12400.682901][ C2] cpu_startup_entry+0x55/0x60 [12400.683145][ C2] start_secondary+0x21c/0x2b0 [12400.683390][ C2] ? __pfx_start_secondary+0x10/0x10 [12400.683659][ C2] secondary_startup_64_no_verify+0x16d/0x17b [12400.683971][ C2] WAIT TIMEOUT stdout Ctrl-C stdout Ctrl-C stdout ^C^C WAIT TIMEOUT stdout